Desktop version Jobs Stats

PROJECT (sourcing_v2)
SPIDER (auto1.de)

2026-03-30 10:30:03 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 10:30:03 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 10:30:03 [auto1.de] INFO: Batch mode enabled: batch 1/2
2026-03-30 10:30:03 [auto1.de] INFO: Starting spider auto1.de
2026-03-30 10:30:03 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 10:30:03 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 10:30:03 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 10:30:03 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 10:30:03 [scrapy.extensions.telnet] INFO: Telnet Password: a61c494b1bc810b2
2026-03-30 10:30:03 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 10:30:03 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/task_17_2026-03-30T10_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 10:30:03 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 10:30:03 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 10:30:03 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 10:30:03 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 10:30:03 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 10:30:03 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 10:30:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 10:30:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-03-30 10:30:03 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 10:30:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 10:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:04 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 10:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 10:30:04 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 10:30:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 10:30:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 10:30:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 10:30:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 10:30:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 10:30:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 10:30:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 10:30:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 10:30:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 10:30:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 10:30:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 10:30:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 10:30:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 10:30:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 10:30:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 10:30:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 10:30:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 10:30:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 10:30:04 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 10:30:04 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 10:30:04 [scrapy.core.engine] INFO: Spider opened
2026-03-30 10:30:04 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 10:30:04 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-30 10:30:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-30 10:30:04 [scrapy-playwright] INFO: Starting download handler
2026-03-30 10:30:04 [scrapy-playwright] INFO: Starting download handler
2026-03-30 10:30:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 10:30:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:30:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 10:30:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:30:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 10:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 10:30:32 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 9389 | hits on page: 40
2026-03-30 10:30:32 [auto1.de] INFO: Found listing with ID: TB59441
2026-03-30 10:30:32 [auto1.de] INFO: Found listing with ID: BR87527
2026-03-30 10:30:32 [auto1.de] INFO: Found listing with ID: SL00980
2026-03-30 10:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL00980%27 HTTP/1.1" 200 None
2026-03-30 10:30:32 [auto1.de] INFO: Scrape type for SL00980: 1
2026-03-30 10:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:30:32 [auto1.de] INFO: Found listing with ID: SU59079
2026-03-30 10:30:32 [auto1.de] INFO: Found listing with ID: HT07403
2026-03-30 10:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT07403%27 HTTP/1.1" 200 None
2026-03-30 10:30:32 [auto1.de] INFO: Scrape type for HT07403: 2
2026-03-30 10:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecca4c8e-70bd-510b-b92b-4b067402eff9 with identifier: HT07403
2026-03-30 10:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecca4c8e-70bd-510b-b92b-4b067402eff9 with scrape type 2
2026-03-30 10:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecca4c8e-70bd-510b-b92b-4b067402eff9 with scrape type 2
2026-03-30 10:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecca4c8e-70bd-510b-b92b-4b067402eff9, identifier: HT07403
2026-03-30 10:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecca4c8e-70bd-510b-b92b-4b067402eff9 with identifier: HT07403
2026-03-30 10:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 10:30:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 10:30:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecca4c8e-70bd-510b-b92b-4b067402eff9 with identifier: HT07403
2026-03-30 10:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecca4c8e-70bd-510b-b92b-4b067402eff9 with identifier: HT07403 to the API
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:44:33Z',
 'fuel_type': 'diesel',
 'id': 'ecca4c8e-70bd-510b-b92b-4b067402eff9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT07403',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 133183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-03',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2017}
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT07403%27 HTTP/1.1" 200 None
2026-03-30 10:30:33 [auto1.de] INFO: Saving data for HT07403: {'auction_closing_time': 1774971873.0, 'created_time': 1773658016.402589, 'last_price_update_time': 1774866633.639892}
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT07403') HTTP/1.1" 204 0
2026-03-30 10:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: KB62051
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: KK63455
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK63455%27 HTTP/1.1" 200 None
2026-03-30 10:30:33 [auto1.de] INFO: Scrape type for KK63455: 1
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: SJ61730
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ61730%27 HTTP/1.1" 200 None
2026-03-30 10:30:33 [auto1.de] INFO: Scrape type for SJ61730: 1
2026-03-30 10:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: EZ41546
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: HX90600
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX90600%27 HTTP/1.1" 200 None
2026-03-30 10:30:33 [auto1.de] INFO: Scrape type for HX90600: 1
2026-03-30 10:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: CN17481
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: LB63142
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB63142%27 HTTP/1.1" 200 None
2026-03-30 10:30:33 [auto1.de] INFO: Scrape type for LB63142: 1
2026-03-30 10:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: MV22055
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV22055%27 HTTP/1.1" 200 None
2026-03-30 10:30:33 [auto1.de] INFO: Scrape type for MV22055: 1
2026-03-30 10:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: RB95028
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: HJ44005
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: ZT78115
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: NC73719
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC73719%27 HTTP/1.1" 200 None
2026-03-30 10:30:33 [auto1.de] INFO: Scrape type for NC73719: 1
2026-03-30 10:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: TS03709
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: NV34927
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: MV50915
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: BA33674
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA33674%27 HTTP/1.1" 200 None
2026-03-30 10:30:33 [auto1.de] INFO: Scrape type for BA33674: 1
2026-03-30 10:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: RE71978
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE71978%27 HTTP/1.1" 200 None
2026-03-30 10:30:33 [auto1.de] INFO: Scrape type for RE71978: 1
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: GE19068
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: FA89686
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: SR78906
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: AA01285
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: CJ96583
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ96583%27 HTTP/1.1" 200 None
2026-03-30 10:30:33 [auto1.de] INFO: Scrape type for CJ96583: 1
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: MJ14379
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: AC44957
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: AT48689
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT48689%27 HTTP/1.1" 200 None
2026-03-30 10:30:33 [auto1.de] INFO: Scrape type for AT48689: 1
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: LA60747
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA60747%27 HTTP/1.1" 200 None
2026-03-30 10:30:33 [auto1.de] INFO: Scrape type for LA60747: 1
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: RL05361
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: FY79679
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: GL90573
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL90573%27 HTTP/1.1" 200 None
2026-03-30 10:30:33 [auto1.de] INFO: Scrape type for GL90573: 1
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: UA27050
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: ZB67475
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: AF24454
2026-03-30 10:30:33 [auto1.de] INFO: Found listing with ID: VU63296
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU63296%27 HTTP/1.1" 200 None
2026-03-30 10:30:33 [auto1.de] INFO: Scrape type for VU63296: 1
2026-03-30 10:30:34 [auto1.de] INFO: Found listing with ID: PG43779
2026-03-30 10:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG43779%27 HTTP/1.1" 200 None
2026-03-30 10:30:34 [auto1.de] INFO: Scrape type for PG43779: 1
2026-03-30 10:30:34 [auto1.de] INFO: Found listing with ID: RM26402
2026-03-30 10:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM26402%27 HTTP/1.1" 200 None
2026-03-30 10:30:34 [auto1.de] INFO: Scrape type for RM26402: 2
2026-03-30 10:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14ca5714-9e01-5927-bcc0-1a8d1580f20a with identifier: RM26402
2026-03-30 10:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14ca5714-9e01-5927-bcc0-1a8d1580f20a with scrape type 2
2026-03-30 10:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14ca5714-9e01-5927-bcc0-1a8d1580f20a with scrape type 2
2026-03-30 10:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14ca5714-9e01-5927-bcc0-1a8d1580f20a, identifier: RM26402
2026-03-30 10:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14ca5714-9e01-5927-bcc0-1a8d1580f20a with identifier: RM26402
2026-03-30 10:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:30:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 10:30:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14ca5714-9e01-5927-bcc0-1a8d1580f20a with identifier: RM26402
2026-03-30 10:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14ca5714-9e01-5927-bcc0-1a8d1580f20a with identifier: RM26402 to the API
2026-03-30 10:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:15:06Z',
 'fuel_type': 'diesel',
 'id': '14ca5714-9e01-5927-bcc0-1a8d1580f20a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM26402',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 153933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-28',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2015}
2026-03-30 10:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM26402%27 HTTP/1.1" 200 None
2026-03-30 10:30:34 [auto1.de] INFO: Saving data for RM26402: {'auction_closing_time': 1774970106.0, 'created_time': 1774262583.722537, 'last_price_update_time': 1774866634.791459}
2026-03-30 10:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM26402') HTTP/1.1" 204 0
2026-03-30 10:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:30:35 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 9389 | hits on page: 40
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: TB59441
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: BR87527
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: SL00980
2026-03-30 10:30:35 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/SL00980/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: SU59079
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: HT07403
2026-03-30 10:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT07403%27 HTTP/1.1" 200 None
2026-03-30 10:30:35 [auto1.de] INFO: Scrape type for HT07403: 0
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: KB62051
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: KK63455
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: SJ61730
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: EZ41546
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: HX90600
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: CN17481
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: LB63142
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: MV22055
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: RB95028
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: HJ44005
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: ZT78115
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: NC73719
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: TS03709
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: NV34927
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: MV50915
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: BA33674
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: RE71978
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: GE19068
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: FA89686
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: SR78906
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: AA01285
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: CJ96583
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: MJ14379
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: AC44957
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: AT48689
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: LA60747
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: RL05361
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: FY79679
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: GL90573
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: UA27050
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: ZB67475
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: AF24454
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: VU63296
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: PG43779
2026-03-30 10:30:35 [auto1.de] INFO: Found listing with ID: RM26402
2026-03-30 10:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM26402%27 HTTP/1.1" 200 None
2026-03-30 10:30:35 [auto1.de] INFO: Scrape type for RM26402: 0
2026-03-30 10:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB63142/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HX90600/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SL00980/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ61730/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:30:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BA33674/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:31:04 [scrapy.extensions.logstats] INFO: Crawled 10 pages (at 10 pages/min), scraped 2 items (at 2 items/min)
2026-03-30 10:31:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 157MiB
2026-03-30 10:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GL90573/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:31:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VU63296/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:31:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PG43779/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:31:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC73719/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE71978/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:31:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HX90600> (referer: https://www.auto1.com/v1/car-details-view/HX90600/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:31:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f547e7b-c58d-51cb-823c-a6f13beddb81 with identifier: HX90600
2026-03-30 10:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f547e7b-c58d-51cb-823c-a6f13beddb81 with scrape type 1
2026-03-30 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f547e7b-c58d-51cb-823c-a6f13beddb81
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_88dc3c2abbfca38a82bf613a8611aed5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_88dc3c2abbfca38a82bf613a8611aed5.jpg not downloaded yet
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_3cf4ed5b573e6fa5926cb332ad9242c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_3cf4ed5b573e6fa5926cb332ad9242c9.jpg not downloaded yet
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_b4656206227a7940dd4e6d79eba45752.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_b4656206227a7940dd4e6d79eba45752.jpg not downloaded yet
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_71360b563f3d8f21ef0121dfcd0e7c99.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_71360b563f3d8f21ef0121dfcd0e7c99.jpg not downloaded yet
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_b6b608c2c6da62cfce7006e0912342a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_b6b608c2c6da62cfce7006e0912342a1.jpg not downloaded yet
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_c4c8fbcb6cc4dd55f96a62c6f2637dd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_c4c8fbcb6cc4dd55f96a62c6f2637dd4.jpg not downloaded yet
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_0e02743ab3f518aa12ede5996ae66463.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_0e02743ab3f518aa12ede5996ae66463.jpg not downloaded yet
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_86156f480b9ea36b9d65085e5df0a217.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_86156f480b9ea36b9d65085e5df0a217.jpg not downloaded yet
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_ef50c0f067a8a208e848725acf640d66.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_ef50c0f067a8a208e848725acf640d66.jpg not downloaded yet
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_0b0fc6ea173746e98bb64a3d57d21885.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_0b0fc6ea173746e98bb64a3d57d21885.jpg not downloaded yet
2026-03-30 10:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:31:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_88dc3c2abbfca38a82bf613a8611aed5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:28 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 9390 | hits on page: 40
2026-03-30 10:31:28 [auto1.de] INFO: Found listing with ID: PG43779
2026-03-30 10:31:28 [auto1.de] INFO: Found listing with ID: RM26402
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM26402%27 HTTP/1.1" 200 None
2026-03-30 10:31:28 [auto1.de] INFO: Scrape type for RM26402: 0
2026-03-30 10:31:28 [auto1.de] INFO: Found listing with ID: RY19910
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY19910%27 HTTP/1.1" 200 None
2026-03-30 10:31:28 [auto1.de] INFO: Scrape type for RY19910: 1
2026-03-30 10:31:28 [auto1.de] INFO: Found listing with ID: LR52017
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR52017%27 HTTP/1.1" 200 None
2026-03-30 10:31:28 [auto1.de] INFO: Scrape type for LR52017: 2
2026-03-30 10:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84421e77-1495-55bb-b51b-52ef9e769dee with identifier: LR52017
2026-03-30 10:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84421e77-1495-55bb-b51b-52ef9e769dee with scrape type 2
2026-03-30 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84421e77-1495-55bb-b51b-52ef9e769dee with scrape type 2
2026-03-30 10:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84421e77-1495-55bb-b51b-52ef9e769dee, identifier: LR52017
2026-03-30 10:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84421e77-1495-55bb-b51b-52ef9e769dee with identifier: LR52017
2026-03-30 10:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84421e77-1495-55bb-b51b-52ef9e769dee with identifier: LR52017
2026-03-30 10:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84421e77-1495-55bb-b51b-52ef9e769dee with identifier: LR52017 to the API
2026-03-30 10:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:30:51Z',
 'fuel_type': 'diesel',
 'id': '84421e77-1495-55bb-b51b-52ef9e769dee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR52017',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 251708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-27',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR52017%27 HTTP/1.1" 200 None
2026-03-30 10:31:29 [auto1.de] INFO: Saving data for LR52017: {'auction_closing_time': 1774971051.0, 'created_time': 1774262319.395619, 'last_price_update_time': 1774866689.181979}
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR52017') HTTP/1.1" 204 0
2026-03-30 10:31:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 10:31:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 10:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4302690>
2026-03-30 10:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_88dc3c2abbfca38a82bf613a8611aed5.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_88dc3c2abbfca38a82bf613a8611aed5.jpg saved to cache
2026-03-30 10:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f547e7b-c58d-51cb-823c-a6f13beddb81
2026-03-30 10:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_ef50c0f067a8a208e848725acf640d66.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_0b0fc6ea173746e98bb64a3d57d21885.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:29 [auto1.de] INFO: Found listing with ID: AC30992
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC30992%27 HTTP/1.1" 200 None
2026-03-30 10:31:29 [auto1.de] INFO: Scrape type for AC30992: 1
2026-03-30 10:31:29 [auto1.de] INFO: Found listing with ID: ZE05106
2026-03-30 10:31:29 [auto1.de] INFO: Found listing with ID: WL02580
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL02580%27 HTTP/1.1" 200 None
2026-03-30 10:31:29 [auto1.de] INFO: Scrape type for WL02580: 1
2026-03-30 10:31:29 [auto1.de] INFO: Found listing with ID: TN19858
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN19858%27 HTTP/1.1" 200 None
2026-03-30 10:31:29 [auto1.de] INFO: Scrape type for TN19858: 1
2026-03-30 10:31:29 [auto1.de] INFO: Found listing with ID: ND23678
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND23678%27 HTTP/1.1" 200 None
2026-03-30 10:31:29 [auto1.de] INFO: Scrape type for ND23678: 1
2026-03-30 10:31:29 [auto1.de] INFO: Found listing with ID: YP09894
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP09894%27 HTTP/1.1" 200 None
2026-03-30 10:31:29 [auto1.de] INFO: Scrape type for YP09894: 1
2026-03-30 10:31:29 [auto1.de] INFO: Found listing with ID: KH00073
2026-03-30 10:31:29 [auto1.de] INFO: Found listing with ID: MW69190
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW69190%27 HTTP/1.1" 200 None
2026-03-30 10:31:29 [auto1.de] INFO: Scrape type for MW69190: 1
2026-03-30 10:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4142f90>
2026-03-30 10:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_ef50c0f067a8a208e848725acf640d66.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_ef50c0f067a8a208e848725acf640d66.jpg saved to cache
2026-03-30 10:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2f547e7b-c58d-51cb-823c-a6f13beddb81
2026-03-30 10:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4198550>
2026-03-30 10:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_0b0fc6ea173746e98bb64a3d57d21885.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_0b0fc6ea173746e98bb64a3d57d21885.jpg saved to cache
2026-03-30 10:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2f547e7b-c58d-51cb-823c-a6f13beddb81
2026-03-30 10:31:29 [auto1.de] INFO: Found listing with ID: UT23109
2026-03-30 10:31:29 [auto1.de] INFO: Found listing with ID: HC62061
2026-03-30 10:31:29 [auto1.de] INFO: Found listing with ID: DV69723
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV69723%27 HTTP/1.1" 200 None
2026-03-30 10:31:29 [auto1.de] INFO: Scrape type for DV69723: 2
2026-03-30 10:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 934ab9ed-359a-5950-a40a-21e09e7c97d3 with identifier: DV69723
2026-03-30 10:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 934ab9ed-359a-5950-a40a-21e09e7c97d3 with scrape type 2
2026-03-30 10:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 934ab9ed-359a-5950-a40a-21e09e7c97d3 with scrape type 2
2026-03-30 10:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 934ab9ed-359a-5950-a40a-21e09e7c97d3, identifier: DV69723
2026-03-30 10:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 934ab9ed-359a-5950-a40a-21e09e7c97d3 with identifier: DV69723
2026-03-30 10:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:31:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 10:31:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:31:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 10:31:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 934ab9ed-359a-5950-a40a-21e09e7c97d3 with identifier: DV69723
2026-03-30 10:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 934ab9ed-359a-5950-a40a-21e09e7c97d3 with identifier: DV69723 to the API
2026-03-30 10:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:42:41Z',
 'fuel_type': 'petrol',
 'id': '934ab9ed-359a-5950-a40a-21e09e7c97d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV69723',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 74821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-02',
 'seller_name': None,
 'title': 'Skoda Octavia 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-30 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV69723%27 HTTP/1.1" 200 None
2026-03-30 10:31:30 [auto1.de] INFO: Saving data for DV69723: {'auction_closing_time': 1774971761.0, 'created_time': 1774380077.836258, 'last_price_update_time': 1774866690.532664}
2026-03-30 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV69723') HTTP/1.1" 204 0
2026-03-30 10:31:30 [auto1.de] INFO: Found listing with ID: LJ61664
2026-03-30 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ61664%27 HTTP/1.1" 200 None
2026-03-30 10:31:30 [auto1.de] INFO: Scrape type for LJ61664: 1
2026-03-30 10:31:30 [auto1.de] INFO: Found listing with ID: PT71111
2026-03-30 10:31:30 [auto1.de] INFO: Found listing with ID: MR59336
2026-03-30 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR59336%27 HTTP/1.1" 200 None
2026-03-30 10:31:30 [auto1.de] INFO: Scrape type for MR59336: 2
2026-03-30 10:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bcb16f6-845e-5d33-890e-94b74152d5ad with identifier: MR59336
2026-03-30 10:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bcb16f6-845e-5d33-890e-94b74152d5ad with scrape type 2
2026-03-30 10:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bcb16f6-845e-5d33-890e-94b74152d5ad with scrape type 2
2026-03-30 10:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bcb16f6-845e-5d33-890e-94b74152d5ad, identifier: MR59336
2026-03-30 10:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bcb16f6-845e-5d33-890e-94b74152d5ad with identifier: MR59336
2026-03-30 10:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bcb16f6-845e-5d33-890e-94b74152d5ad with identifier: MR59336
2026-03-30 10:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bcb16f6-845e-5d33-890e-94b74152d5ad with identifier: MR59336 to the API
2026-03-30 10:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:24:02Z',
 'fuel_type': 'petrol',
 'id': '3bcb16f6-845e-5d33-890e-94b74152d5ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR59336',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 181899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-20',
 'seller_name': None,
 'title': 'Renault Grand Scenic 2.0 Dynamique',
 'transmission': 'automatic',
 'trim': 'Dynamique',
 'year': 2011}
2026-03-30 10:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR59336%27 HTTP/1.1" 200 None
2026-03-30 10:31:31 [auto1.de] INFO: Saving data for MR59336: {'auction_closing_time': 1774970642.0, 'created_time': 1773224717.031606, 'last_price_update_time': 1774866691.524197}
2026-03-30 10:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR59336') HTTP/1.1" 204 0
2026-03-30 10:31:31 [auto1.de] INFO: Found listing with ID: BZ99779
2026-03-30 10:31:31 [auto1.de] INFO: Found listing with ID: KS12062
2026-03-30 10:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS12062%27 HTTP/1.1" 200 None
2026-03-30 10:31:31 [auto1.de] INFO: Scrape type for KS12062: 2
2026-03-30 10:31:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6f2510e-558c-5e32-8c8b-7b9ae2f3f501 with identifier: KS12062
2026-03-30 10:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6f2510e-558c-5e32-8c8b-7b9ae2f3f501 with scrape type 2
2026-03-30 10:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6f2510e-558c-5e32-8c8b-7b9ae2f3f501 with scrape type 2
2026-03-30 10:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6f2510e-558c-5e32-8c8b-7b9ae2f3f501, identifier: KS12062
2026-03-30 10:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6f2510e-558c-5e32-8c8b-7b9ae2f3f501 with identifier: KS12062
2026-03-30 10:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:31:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 10:31:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6f2510e-558c-5e32-8c8b-7b9ae2f3f501 with identifier: KS12062
2026-03-30 10:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6f2510e-558c-5e32-8c8b-7b9ae2f3f501 with identifier: KS12062 to the API
2026-03-30 10:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:41:09Z',
 'fuel_type': 'diesel',
 'id': 'd6f2510e-558c-5e32-8c8b-7b9ae2f3f501',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS12062',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 150598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-28',
 'seller_name': None,
 'title': 'Ford Mondeo 2.2 TDCi Titanium X',
 'transmission': 'manual',
 'trim': 'Titanium X',
 'year': 2013}
2026-03-30 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS12062%27 HTTP/1.1" 200 None
2026-03-30 10:31:32 [auto1.de] INFO: Saving data for KS12062: {'auction_closing_time': 1774971669.0, 'created_time': 1774380201.017097, 'last_price_update_time': 1774866692.95609}
2026-03-30 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS12062') HTTP/1.1" 204 0
2026-03-30 10:31:32 [auto1.de] INFO: Found listing with ID: HP60079
2026-03-30 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP60079%27 HTTP/1.1" 200 None
2026-03-30 10:31:32 [auto1.de] INFO: Scrape type for HP60079: 2
2026-03-30 10:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ce3b04b-6a43-546b-8663-5c9b42e66153 with identifier: HP60079
2026-03-30 10:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ce3b04b-6a43-546b-8663-5c9b42e66153 with scrape type 2
2026-03-30 10:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ce3b04b-6a43-546b-8663-5c9b42e66153 with scrape type 2
2026-03-30 10:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ce3b04b-6a43-546b-8663-5c9b42e66153, identifier: HP60079
2026-03-30 10:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ce3b04b-6a43-546b-8663-5c9b42e66153 with identifier: HP60079
2026-03-30 10:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ce3b04b-6a43-546b-8663-5c9b42e66153 with identifier: HP60079
2026-03-30 10:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ce3b04b-6a43-546b-8663-5c9b42e66153 with identifier: HP60079 to the API
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:58:12Z',
 'fuel_type': 'diesel',
 'id': '2ce3b04b-6a43-546b-8663-5c9b42e66153',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP60079',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 140351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2017}
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP60079%27 HTTP/1.1" 200 None
2026-03-30 10:31:33 [auto1.de] INFO: Saving data for HP60079: {'auction_closing_time': 1774972692.0, 'created_time': 1773228866.884302, 'last_price_update_time': 1774866693.433555}
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP60079') HTTP/1.1" 204 0
2026-03-30 10:31:33 [auto1.de] INFO: Found listing with ID: EH27268
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH27268%27 HTTP/1.1" 200 None
2026-03-30 10:31:33 [auto1.de] INFO: Scrape type for EH27268: 1
2026-03-30 10:31:33 [auto1.de] INFO: Found listing with ID: YY16041
2026-03-30 10:31:33 [auto1.de] INFO: Found listing with ID: NH36418
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH36418%27 HTTP/1.1" 200 None
2026-03-30 10:31:33 [auto1.de] INFO: Scrape type for NH36418: 2
2026-03-30 10:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da6407b4-1e4f-5f72-be5d-a472b260cffa with identifier: NH36418
2026-03-30 10:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da6407b4-1e4f-5f72-be5d-a472b260cffa with scrape type 2
2026-03-30 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da6407b4-1e4f-5f72-be5d-a472b260cffa with scrape type 2
2026-03-30 10:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da6407b4-1e4f-5f72-be5d-a472b260cffa, identifier: NH36418
2026-03-30 10:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da6407b4-1e4f-5f72-be5d-a472b260cffa with identifier: NH36418
2026-03-30 10:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da6407b4-1e4f-5f72-be5d-a472b260cffa with identifier: NH36418
2026-03-30 10:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da6407b4-1e4f-5f72-be5d-a472b260cffa with identifier: NH36418 to the API
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:12:40Z',
 'fuel_type': 'diesel',
 'id': 'da6407b4-1e4f-5f72-be5d-a472b260cffa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH36418',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 172717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-01',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L2 Trend',
 'transmission': 'automatic',
 'trim': '310 L2 Trend',
 'year': 2017}
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH36418%27 HTTP/1.1" 200 None
2026-03-30 10:31:33 [auto1.de] INFO: Saving data for NH36418: {'auction_closing_time': 1774969960.0, 'created_time': 1774463673.824886, 'last_price_update_time': 1774866693.903205}
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH36418') HTTP/1.1" 204 0
2026-03-30 10:31:33 [auto1.de] INFO: Found listing with ID: ME91178
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME91178%27 HTTP/1.1" 200 None
2026-03-30 10:31:33 [auto1.de] INFO: Scrape type for ME91178: 1
2026-03-30 10:31:33 [auto1.de] INFO: Found listing with ID: CK82511
2026-03-30 10:31:33 [auto1.de] INFO: Found listing with ID: HR29759
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR29759%27 HTTP/1.1" 200 None
2026-03-30 10:31:33 [auto1.de] INFO: Scrape type for HR29759: 2
2026-03-30 10:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeb33fa1-2df9-5c86-b23a-d4f2f3e6fd6c with identifier: HR29759
2026-03-30 10:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeb33fa1-2df9-5c86-b23a-d4f2f3e6fd6c with scrape type 2
2026-03-30 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aeb33fa1-2df9-5c86-b23a-d4f2f3e6fd6c with scrape type 2
2026-03-30 10:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aeb33fa1-2df9-5c86-b23a-d4f2f3e6fd6c, identifier: HR29759
2026-03-30 10:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aeb33fa1-2df9-5c86-b23a-d4f2f3e6fd6c with identifier: HR29759
2026-03-30 10:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aeb33fa1-2df9-5c86-b23a-d4f2f3e6fd6c with identifier: HR29759
2026-03-30 10:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aeb33fa1-2df9-5c86-b23a-d4f2f3e6fd6c with identifier: HR29759 to the API
2026-03-30 10:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:15:28Z',
 'fuel_type': 'diesel',
 'id': 'aeb33fa1-2df9-5c86-b23a-d4f2f3e6fd6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR29759',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 231552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-06',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang BlueTEC Avantgarde Edition',
 'transmission': 'automatic',
 'trim': 'lang BlueTEC Avantgarde Edition',
 'year': 2016}
2026-03-30 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR29759%27 HTTP/1.1" 200 None
2026-03-30 10:31:34 [auto1.de] INFO: Saving data for HR29759: {'auction_closing_time': 1774970128.0, 'created_time': 1773132172.933046, 'last_price_update_time': 1774866694.38164}
2026-03-30 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR29759') HTTP/1.1" 204 0
2026-03-30 10:31:34 [auto1.de] INFO: Found listing with ID: XU95663
2026-03-30 10:31:34 [auto1.de] INFO: Found listing with ID: DE87976
2026-03-30 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE87976%27 HTTP/1.1" 200 None
2026-03-30 10:31:34 [auto1.de] INFO: Scrape type for DE87976: 2
2026-03-30 10:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5b8e26e-aaf7-5886-abf5-b163658bd032 with identifier: DE87976
2026-03-30 10:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5b8e26e-aaf7-5886-abf5-b163658bd032 with scrape type 2
2026-03-30 10:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5b8e26e-aaf7-5886-abf5-b163658bd032 with scrape type 2
2026-03-30 10:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5b8e26e-aaf7-5886-abf5-b163658bd032, identifier: DE87976
2026-03-30 10:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5b8e26e-aaf7-5886-abf5-b163658bd032 with identifier: DE87976
2026-03-30 10:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:31:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 10:31:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5b8e26e-aaf7-5886-abf5-b163658bd032 with identifier: DE87976
2026-03-30 10:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5b8e26e-aaf7-5886-abf5-b163658bd032 with identifier: DE87976 to the API
2026-03-30 10:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:47:21Z',
 'fuel_type': 'petrol',
 'id': 'd5b8e26e-aaf7-5886-abf5-b163658bd032',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE87976',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 21062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2020}
2026-03-30 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE87976%27 HTTP/1.1" 200 None
2026-03-30 10:31:35 [auto1.de] INFO: Saving data for DE87976: {'auction_closing_time': 1774972041.0, 'created_time': 1773776143.450017, 'last_price_update_time': 1774866695.274292}
2026-03-30 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE87976') HTTP/1.1" 204 0
2026-03-30 10:31:35 [auto1.de] INFO: Found listing with ID: LA83514
2026-03-30 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA83514%27 HTTP/1.1" 200 None
2026-03-30 10:31:35 [auto1.de] INFO: Scrape type for LA83514: 1
2026-03-30 10:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB63142> (referer: https://www.auto1.com/v1/car-details-view/LB63142/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:31:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:31:35 [auto1.de] INFO: Found listing with ID: EJ77666
2026-03-30 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ77666%27 HTTP/1.1" 200 None
2026-03-30 10:31:35 [auto1.de] INFO: Scrape type for EJ77666: 1
2026-03-30 10:31:35 [auto1.de] INFO: Found listing with ID: FN78597
2026-03-30 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN78597%27 HTTP/1.1" 200 None
2026-03-30 10:31:35 [auto1.de] INFO: Scrape type for FN78597: 2
2026-03-30 10:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6abbce3-be8c-54f0-84f1-e08b080bd7be with identifier: FN78597
2026-03-30 10:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6abbce3-be8c-54f0-84f1-e08b080bd7be with scrape type 2
2026-03-30 10:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6abbce3-be8c-54f0-84f1-e08b080bd7be with scrape type 2
2026-03-30 10:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6abbce3-be8c-54f0-84f1-e08b080bd7be, identifier: FN78597
2026-03-30 10:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6abbce3-be8c-54f0-84f1-e08b080bd7be with identifier: FN78597
2026-03-30 10:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6abbce3-be8c-54f0-84f1-e08b080bd7be with identifier: FN78597
2026-03-30 10:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6abbce3-be8c-54f0-84f1-e08b080bd7be with identifier: FN78597 to the API
2026-03-30 10:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:52:15Z',
 'fuel_type': 'petrol',
 'id': 'e6abbce3-be8c-54f0-84f1-e08b080bd7be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN78597',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 163606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-12',
 'seller_name': None,
 'title': 'Hyundai Kona 1.6 TGDI Premium 4WD',
 'transmission': 'automatic',
 'trim': 'Premium 4WD',
 'year': 2019}
2026-03-30 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN78597%27 HTTP/1.1" 200 None
2026-03-30 10:31:35 [auto1.de] INFO: Saving data for FN78597: {'auction_closing_time': 1774972335.0, 'created_time': 1773227796.762921, 'last_price_update_time': 1774866695.784625}
2026-03-30 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN78597') HTTP/1.1" 204 0
2026-03-30 10:31:35 [auto1.de] INFO: Found listing with ID: SH78977
2026-03-30 10:31:35 [auto1.de] INFO: Found listing with ID: WF16279
2026-03-30 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF16279%27 HTTP/1.1" 200 None
2026-03-30 10:31:35 [auto1.de] INFO: Scrape type for WF16279: 2
2026-03-30 10:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9a23347-b8a8-5622-b144-2a55df60ceeb with identifier: WF16279
2026-03-30 10:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9a23347-b8a8-5622-b144-2a55df60ceeb with scrape type 2
2026-03-30 10:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9a23347-b8a8-5622-b144-2a55df60ceeb with scrape type 2
2026-03-30 10:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9a23347-b8a8-5622-b144-2a55df60ceeb, identifier: WF16279
2026-03-30 10:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9a23347-b8a8-5622-b144-2a55df60ceeb with identifier: WF16279
2026-03-30 10:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9a23347-b8a8-5622-b144-2a55df60ceeb with identifier: WF16279
2026-03-30 10:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9a23347-b8a8-5622-b144-2a55df60ceeb with identifier: WF16279 to the API
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:18:40Z',
 'fuel_type': 'diesel',
 'id': 'd9a23347-b8a8-5622-b144-2a55df60ceeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF16279',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 172028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-26',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF16279%27 HTTP/1.1" 200 None
2026-03-30 10:31:36 [auto1.de] INFO: Saving data for WF16279: {'auction_closing_time': 1774970320.0, 'created_time': 1773945081.269593, 'last_price_update_time': 1774866696.22732}
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF16279') HTTP/1.1" 204 0
2026-03-30 10:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9d00847-8b8b-5049-9eb3-4112a859702c with identifier: LB63142
2026-03-30 10:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9d00847-8b8b-5049-9eb3-4112a859702c with scrape type 1
2026-03-30 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9d00847-8b8b-5049-9eb3-4112a859702c
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_650c4b643f94365aa05c00bf42fddbc5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_650c4b643f94365aa05c00bf42fddbc5.jpg not downloaded yet
2026-03-30 10:31:36 [auto1.de] INFO: Found listing with ID: HC77089
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC77089%27 HTTP/1.1" 200 None
2026-03-30 10:31:36 [auto1.de] INFO: Scrape type for HC77089: 1
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_77811d26c8da3e3225740a80b2031156.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_77811d26c8da3e3225740a80b2031156.jpg not downloaded yet
2026-03-30 10:31:36 [auto1.de] INFO: Found listing with ID: TV02686
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV02686%27 HTTP/1.1" 200 None
2026-03-30 10:31:36 [auto1.de] INFO: Scrape type for TV02686: 1
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_ecf7adbc899f6d5822e8d4dfce6fab3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_ecf7adbc899f6d5822e8d4dfce6fab3a.jpg not downloaded yet
2026-03-30 10:31:36 [auto1.de] INFO: Found listing with ID: BR45511
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR45511%27 HTTP/1.1" 200 None
2026-03-30 10:31:36 [auto1.de] INFO: Scrape type for BR45511: 2
2026-03-30 10:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1b0c76f-a9b3-513a-b24a-55fbec71c328 with identifier: BR45511
2026-03-30 10:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1b0c76f-a9b3-513a-b24a-55fbec71c328 with scrape type 2
2026-03-30 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1b0c76f-a9b3-513a-b24a-55fbec71c328 with scrape type 2
2026-03-30 10:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1b0c76f-a9b3-513a-b24a-55fbec71c328, identifier: BR45511
2026-03-30 10:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1b0c76f-a9b3-513a-b24a-55fbec71c328 with identifier: BR45511
2026-03-30 10:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1b0c76f-a9b3-513a-b24a-55fbec71c328 with identifier: BR45511
2026-03-30 10:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1b0c76f-a9b3-513a-b24a-55fbec71c328 with identifier: BR45511 to the API
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:02:40Z',
 'fuel_type': 'diesel',
 'id': 'f1b0c76f-a9b3-513a-b24a-55fbec71c328',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR45511',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 146307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-18',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Join',
 'transmission': 'manual',
 'trim': 'Join',
 'year': 2018}
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR45511%27 HTTP/1.1" 200 None
2026-03-30 10:31:36 [auto1.de] INFO: Saving data for BR45511: {'auction_closing_time': 1774969360.0, 'created_time': 1774522348.611056, 'last_price_update_time': 1774866696.783342}
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR45511') HTTP/1.1" 204 0
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_e87a6765d14b752b185cab1f4b2336a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_e87a6765d14b752b185cab1f4b2336a9.jpg not downloaded yet
2026-03-30 10:31:36 [auto1.de] INFO: Found listing with ID: WW07802
2026-03-30 10:31:36 [auto1.de] INFO: Found listing with ID: WN73161
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN73161%27 HTTP/1.1" 200 None
2026-03-30 10:31:36 [auto1.de] INFO: Scrape type for WN73161: 2
2026-03-30 10:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a221b229-5e2f-5c81-b7ba-b7ec0236399f with identifier: WN73161
2026-03-30 10:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a221b229-5e2f-5c81-b7ba-b7ec0236399f with scrape type 2
2026-03-30 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a221b229-5e2f-5c81-b7ba-b7ec0236399f with scrape type 2
2026-03-30 10:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a221b229-5e2f-5c81-b7ba-b7ec0236399f, identifier: WN73161
2026-03-30 10:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a221b229-5e2f-5c81-b7ba-b7ec0236399f with identifier: WN73161
2026-03-30 10:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a221b229-5e2f-5c81-b7ba-b7ec0236399f with identifier: WN73161
2026-03-30 10:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a221b229-5e2f-5c81-b7ba-b7ec0236399f with identifier: WN73161 to the API
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:23:28Z',
 'fuel_type': 'petrol',
 'id': 'a221b229-5e2f-5c81-b7ba-b7ec0236399f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN73161',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 47304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-05',
 'seller_name': None,
 'title': 'Ford EcoSport 1.5 Ti-VCT Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN73161%27 HTTP/1.1" 200 None
2026-03-30 10:31:37 [auto1.de] INFO: Saving data for WN73161: {'auction_closing_time': 1774970608.0, 'created_time': 1773303957.976994, 'last_price_update_time': 1774866697.376841}
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN73161') HTTP/1.1" 204 0
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_cb785515e90eaccdc24e682b628ad368.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_cb785515e90eaccdc24e682b628ad368.jpg not downloaded yet
2026-03-30 10:31:37 [auto1.de] INFO: Found listing with ID: BH73994
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_95014e1a23dce2d1e58baa01cfb17aed.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_95014e1a23dce2d1e58baa01cfb17aed.jpg not downloaded yet
2026-03-30 10:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ61730> (referer: https://www.auto1.com/v1/car-details-view/SJ61730/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SL00980> (referer: https://www.auto1.com/v1/car-details-view/SL00980/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_24b6110178b0cc4edab7283a2e9466c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_24b6110178b0cc4edab7283a2e9466c4.jpg not downloaded yet
2026-03-30 10:31:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:31:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_ffbdb41ec591e1c4718b4b331e187331.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_ffbdb41ec591e1c4718b4b331e187331.jpg not downloaded yet
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_e64199e6057d6d81ee8e8aa3cbcbb3d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_e64199e6057d6d81ee8e8aa3cbcbb3d5.jpg not downloaded yet
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_ab9f989f932c2eea3d1628e72cec989c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_ab9f989f932c2eea3d1628e72cec989c.jpg not downloaded yet
2026-03-30 10:31:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9126a28-d17f-5b94-aaf5-72a83e8e2af5 with identifier: SJ61730
2026-03-30 10:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9126a28-d17f-5b94-aaf5-72a83e8e2af5 with scrape type 1
2026-03-30 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9126a28-d17f-5b94-aaf5-72a83e8e2af5
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_ae3a1d8f58d9d59cd2ba9261f30000ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_ae3a1d8f58d9d59cd2ba9261f30000ab.jpg not downloaded yet
2026-03-30 10:31:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf4da6b8-f01a-5146-a5f8-4685eeb2d21b with identifier: SL00980
2026-03-30 10:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf4da6b8-f01a-5146-a5f8-4685eeb2d21b with scrape type 1
2026-03-30 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf4da6b8-f01a-5146-a5f8-4685eeb2d21b
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c29821179275bf9a6119ac89329d61%252Fpa%252FSL00980_e9e4b50a875b59b25c3bd03aa39357d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_e9e4b50a875b59b25c3bd03aa39357d6.jpg already downloaded
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c29821179275bf9a6119ac89329d61%252Fpa%252FSL00980_21c9324c86f4c7a8d1a497ea568067e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_21c9324c86f4c7a8d1a497ea568067e7.jpg already downloaded
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c29821179275bf9a6119ac89329d61%252Fpa%252FSL00980_e15612123c97fc450c730b3d0cbd8205.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_e15612123c97fc450c730b3d0cbd8205.jpg already downloaded
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c29821179275bf9a6119ac89329d61%252Fpa%252FSL00980_488995c9815dce2b5736df2324314a02.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_488995c9815dce2b5736df2324314a02.jpg already downloaded
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c29821179275bf9a6119ac89329d61%252Fpa%252FSL00980_47acd7eb625667394ce947e3836b0866.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_47acd7eb625667394ce947e3836b0866.jpg already downloaded
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c29821179275bf9a6119ac89329d61%252Fpa%252FSL00980_3e6c7aff5539f60c346db9f6bb110ef8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_3e6c7aff5539f60c346db9f6bb110ef8.jpg already downloaded
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c29821179275bf9a6119ac89329d61%252Fpa%252FSL00980_239a8f5aac1fe97570bffc0c5c911383.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_239a8f5aac1fe97570bffc0c5c911383.jpg already downloaded
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c29821179275bf9a6119ac89329d61%252Fpa%252FSL00980_dcb9e9d9f02db491ca9b093d1d57a28b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_dcb9e9d9f02db491ca9b093d1d57a28b.jpg already downloaded
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c29821179275bf9a6119ac89329d61%252Fpa%252FSL00980_7527d5d56279e8b46e4174a0e617df8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_7527d5d56279e8b46e4174a0e617df8f.jpg already downloaded
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c29821179275bf9a6119ac89329d61%252Fpa%252FSL00980_2d9971e1774de47d2137cb76091628c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_2d9971e1774de47d2137cb76091628c1.jpg already downloaded
2026-03-30 10:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf4da6b8-f01a-5146-a5f8-4685eeb2d21b, identifier: SL00980
2026-03-30 10:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf4da6b8-f01a-5146-a5f8-4685eeb2d21b with identifier: SL00980
2026-03-30 10:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf4da6b8-f01a-5146-a5f8-4685eeb2d21b with identifier: SL00980
2026-03-30 10:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf4da6b8-f01a-5146-a5f8-4685eeb2d21b with identifier: SL00980 to the API
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SL00980>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:46:37Z',
 'fuel_type': 'petrol',
 'id': 'cf4da6b8-f01a-5146-a5f8-4685eeb2d21b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL00980',
 'listing': 'auction',
 'location': 'DE, Oberding',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 36085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_e9e4b50a875b59b25c3bd03aa39357d6.jpg',
                'https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_21c9324c86f4c7a8d1a497ea568067e7.jpg',
                'https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_e15612123c97fc450c730b3d0cbd8205.jpg',
                'https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_488995c9815dce2b5736df2324314a02.jpg',
                'https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_47acd7eb625667394ce947e3836b0866.jpg',
                'https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_3e6c7aff5539f60c346db9f6bb110ef8.jpg',
                'https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_239a8f5aac1fe97570bffc0c5c911383.jpg',
                'https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_dcb9e9d9f02db491ca9b093d1d57a28b.jpg',
                'https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_7527d5d56279e8b46e4174a0e617df8f.jpg',
                'https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_2d9971e1774de47d2137cb76091628c1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4da6b8-f01a-5146-a5f8-4685eeb2d21b/cf4da6b8-f01a-5146-a5f8-4685eeb2d21b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_e9e4b50a875b59b25c3bd03aa39357d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4da6b8-f01a-5146-a5f8-4685eeb2d21b/cf4da6b8-f01a-5146-a5f8-4685eeb2d21b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_21c9324c86f4c7a8d1a497ea568067e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4da6b8-f01a-5146-a5f8-4685eeb2d21b/cf4da6b8-f01a-5146-a5f8-4685eeb2d21b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_e15612123c97fc450c730b3d0cbd8205.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4da6b8-f01a-5146-a5f8-4685eeb2d21b/cf4da6b8-f01a-5146-a5f8-4685eeb2d21b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2825461,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_488995c9815dce2b5736df2324314a02.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4da6b8-f01a-5146-a5f8-4685eeb2d21b/cf4da6b8-f01a-5146-a5f8-4685eeb2d21b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_47acd7eb625667394ce947e3836b0866.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4da6b8-f01a-5146-a5f8-4685eeb2d21b/cf4da6b8-f01a-5146-a5f8-4685eeb2d21b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_3e6c7aff5539f60c346db9f6bb110ef8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4da6b8-f01a-5146-a5f8-4685eeb2d21b/cf4da6b8-f01a-5146-a5f8-4685eeb2d21b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_239a8f5aac1fe97570bffc0c5c911383.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4da6b8-f01a-5146-a5f8-4685eeb2d21b/cf4da6b8-f01a-5146-a5f8-4685eeb2d21b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_dcb9e9d9f02db491ca9b093d1d57a28b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4da6b8-f01a-5146-a5f8-4685eeb2d21b/cf4da6b8-f01a-5146-a5f8-4685eeb2d21b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_7527d5d56279e8b46e4174a0e617df8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4da6b8-f01a-5146-a5f8-4685eeb2d21b/cf4da6b8-f01a-5146-a5f8-4685eeb2d21b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2690093,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c29821179275bf9a6119ac89329d61/pa/SL00980_2d9971e1774de47d2137cb76091628c1.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL00980%27 HTTP/1.1" 200 None
2026-03-30 10:31:38 [auto1.de] INFO: Saving data for SL00980: {'created_time': 1774866698.377644, 'last_price_update_time': 1774866698.377655, 'auction_closing_time': 1774971997.0}
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL00980') HTTP/1.1" 204 0
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_24f12a935d5038dd3b1e04084a261b53.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_24f12a935d5038dd3b1e04084a261b53.jpg not downloaded yet
2026-03-30 10:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_cb785515e90eaccdc24e682b628ad368.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_95014e1a23dce2d1e58baa01cfb17aed.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_14421f7acd539a60386238e690312abe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_14421f7acd539a60386238e690312abe.jpg not downloaded yet
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_51b8e9c81c8993bb25435cc389fa6582.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_51b8e9c81c8993bb25435cc389fa6582.jpg not downloaded yet
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_eb0274193a60f4a8ed7d1e71f7aaa0ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_eb0274193a60f4a8ed7d1e71f7aaa0ae.jpg not downloaded yet
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_39d381f74eb5aca1da1dadb24926d94b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_39d381f74eb5aca1da1dadb24926d94b.jpg not downloaded yet
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_de9f699b3fb44cb65dd2f5fded14b69e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_de9f699b3fb44cb65dd2f5fded14b69e.jpg not downloaded yet
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_bbe5558b4045a3aea0dbec8c757e3faa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_bbe5558b4045a3aea0dbec8c757e3faa.jpg not downloaded yet
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_434dea7845ee73c3c0a5697e97cf7168.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_434dea7845ee73c3c0a5697e97cf7168.jpg not downloaded yet
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42850d0>
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_cb785515e90eaccdc24e682b628ad368.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_cb785515e90eaccdc24e682b628ad368.jpg saved to cache
2026-03-30 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9d00847-8b8b-5049-9eb3-4112a859702c
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f437b510>
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_95014e1a23dce2d1e58baa01cfb17aed.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_95014e1a23dce2d1e58baa01cfb17aed.jpg saved to cache
2026-03-30 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9d00847-8b8b-5049-9eb3-4112a859702c
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_4bd429aedd41060a96e83dcb0cea04d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_4bd429aedd41060a96e83dcb0cea04d9.jpg not downloaded yet
2026-03-30 10:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_ae3a1d8f58d9d59cd2ba9261f30000ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_ab9f989f932c2eea3d1628e72cec989c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f432e490>
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_ae3a1d8f58d9d59cd2ba9261f30000ab.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_ae3a1d8f58d9d59cd2ba9261f30000ab.jpg saved to cache
2026-03-30 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9126a28-d17f-5b94-aaf5-72a83e8e2af5
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f416c410>
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_ab9f989f932c2eea3d1628e72cec989c.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_ab9f989f932c2eea3d1628e72cec989c.jpg saved to cache
2026-03-30 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9d00847-8b8b-5049-9eb3-4112a859702c
2026-03-30 10:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_434dea7845ee73c3c0a5697e97cf7168.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_4bd429aedd41060a96e83dcb0cea04d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5911bd0>
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_434dea7845ee73c3c0a5697e97cf7168.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_434dea7845ee73c3c0a5697e97cf7168.jpg saved to cache
2026-03-30 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9126a28-d17f-5b94-aaf5-72a83e8e2af5
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4255290>
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_4bd429aedd41060a96e83dcb0cea04d9.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_4bd429aedd41060a96e83dcb0cea04d9.jpg saved to cache
2026-03-30 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9126a28-d17f-5b94-aaf5-72a83e8e2af5
2026-03-30 10:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_bbe5558b4045a3aea0dbec8c757e3faa.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_de9f699b3fb44cb65dd2f5fded14b69e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f426bed0>
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_bbe5558b4045a3aea0dbec8c757e3faa.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_bbe5558b4045a3aea0dbec8c757e3faa.jpg saved to cache
2026-03-30 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9126a28-d17f-5b94-aaf5-72a83e8e2af5
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42693d0>
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_de9f699b3fb44cb65dd2f5fded14b69e.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_de9f699b3fb44cb65dd2f5fded14b69e.jpg saved to cache
2026-03-30 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9126a28-d17f-5b94-aaf5-72a83e8e2af5
2026-03-30 10:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_39d381f74eb5aca1da1dadb24926d94b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_eb0274193a60f4a8ed7d1e71f7aaa0ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a3b50>
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_39d381f74eb5aca1da1dadb24926d94b.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_39d381f74eb5aca1da1dadb24926d94b.jpg saved to cache
2026-03-30 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9126a28-d17f-5b94-aaf5-72a83e8e2af5
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4254f90>
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_eb0274193a60f4a8ed7d1e71f7aaa0ae.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_eb0274193a60f4a8ed7d1e71f7aaa0ae.jpg saved to cache
2026-03-30 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9126a28-d17f-5b94-aaf5-72a83e8e2af5
2026-03-30 10:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_51b8e9c81c8993bb25435cc389fa6582.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_14421f7acd539a60386238e690312abe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4171590>
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_51b8e9c81c8993bb25435cc389fa6582.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_51b8e9c81c8993bb25435cc389fa6582.jpg saved to cache
2026-03-30 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9126a28-d17f-5b94-aaf5-72a83e8e2af5
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4194fd0>
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_14421f7acd539a60386238e690312abe.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_14421f7acd539a60386238e690312abe.jpg saved to cache
2026-03-30 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9126a28-d17f-5b94-aaf5-72a83e8e2af5
2026-03-30 10:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_24f12a935d5038dd3b1e04084a261b53.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_e64199e6057d6d81ee8e8aa3cbcbb3d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f416d390>
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f902b8891338f0d597cdfe18d290e9%252Fpa%252FSJ61730_24f12a935d5038dd3b1e04084a261b53.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_24f12a935d5038dd3b1e04084a261b53.jpg saved to cache
2026-03-30 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9126a28-d17f-5b94-aaf5-72a83e8e2af5
2026-03-30 10:31:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9126a28-d17f-5b94-aaf5-72a83e8e2af5, skipping ID generation
2026-03-30 10:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9126a28-d17f-5b94-aaf5-72a83e8e2af5 with scrape type 1
2026-03-30 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9126a28-d17f-5b94-aaf5-72a83e8e2af5 sending to next pipeline
2026-03-30 10:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9126a28-d17f-5b94-aaf5-72a83e8e2af5, identifier: SJ61730
2026-03-30 10:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9126a28-d17f-5b94-aaf5-72a83e8e2af5 with identifier: SJ61730
2026-03-30 10:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9126a28-d17f-5b94-aaf5-72a83e8e2af5 with identifier: SJ61730
2026-03-30 10:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9126a28-d17f-5b94-aaf5-72a83e8e2af5 with identifier: SJ61730 to the API
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_24f12a935d5038dd3b1e04084a261b53.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:59:06Z',
 'fuel_type': 'petrol',
 'id': 'd9126a28-d17f-5b94-aaf5-72a83e8e2af5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ61730',
 'listing': 'auction',
 'location': 'DE, Mülheim an der Ruhr',
 'make': 'Skoda',
 'model': 'Citigo',
 'odometer': 63612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_ae3a1d8f58d9d59cd2ba9261f30000ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_24f12a935d5038dd3b1e04084a261b53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_14421f7acd539a60386238e690312abe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_51b8e9c81c8993bb25435cc389fa6582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_eb0274193a60f4a8ed7d1e71f7aaa0ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_39d381f74eb5aca1da1dadb24926d94b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_de9f699b3fb44cb65dd2f5fded14b69e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_bbe5558b4045a3aea0dbec8c757e3faa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_434dea7845ee73c3c0a5697e97cf7168.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9126a28-d17f-5b94-aaf5-72a83e8e2af5/d9126a28-d17f-5b94-aaf5-72a83e8e2af5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f902b8891338f0d597cdfe18d290e9/pa/SJ61730_4bd429aedd41060a96e83dcb0cea04d9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Skoda Citigo 1.0 MPI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2013}
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ61730%27 HTTP/1.1" 200 None
2026-03-30 10:31:40 [auto1.de] INFO: Saving data for SJ61730: {'created_time': 1774866700.315836, 'last_price_update_time': 1774866700.315847, 'auction_closing_time': 1774972746.0}
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ61730') HTTP/1.1" 204 0
2026-03-30 10:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_ffbdb41ec591e1c4718b4b331e187331.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_24b6110178b0cc4edab7283a2e9466c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4278390>
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_e64199e6057d6d81ee8e8aa3cbcbb3d5.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_e64199e6057d6d81ee8e8aa3cbcbb3d5.jpg saved to cache
2026-03-30 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9d00847-8b8b-5049-9eb3-4112a859702c
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4289f90>
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_ffbdb41ec591e1c4718b4b331e187331.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_ffbdb41ec591e1c4718b4b331e187331.jpg saved to cache
2026-03-30 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9d00847-8b8b-5049-9eb3-4112a859702c
2026-03-30 10:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_e87a6765d14b752b185cab1f4b2336a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414ba50>
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_24b6110178b0cc4edab7283a2e9466c4.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_24b6110178b0cc4edab7283a2e9466c4.jpg saved to cache
2026-03-30 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9d00847-8b8b-5049-9eb3-4112a859702c
2026-03-30 10:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_ecf7adbc899f6d5822e8d4dfce6fab3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4223e90>
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_e87a6765d14b752b185cab1f4b2336a9.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_e87a6765d14b752b185cab1f4b2336a9.jpg saved to cache
2026-03-30 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9d00847-8b8b-5049-9eb3-4112a859702c
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4289110>
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_ecf7adbc899f6d5822e8d4dfce6fab3a.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_ecf7adbc899f6d5822e8d4dfce6fab3a.jpg saved to cache
2026-03-30 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9d00847-8b8b-5049-9eb3-4112a859702c
2026-03-30 10:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_77811d26c8da3e3225740a80b2031156.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41949d0>
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_77811d26c8da3e3225740a80b2031156.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_77811d26c8da3e3225740a80b2031156.jpg saved to cache
2026-03-30 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9d00847-8b8b-5049-9eb3-4112a859702c
2026-03-30 10:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KK63455/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:31:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_650c4b643f94365aa05c00bf42fddbc5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4289d50>
2026-03-30 10:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F78%252Fd4783e7663df4328519a981ac5b34ec8%252Fpa%252FLB63142_650c4b643f94365aa05c00bf42fddbc5.jpg') HTTP/1.1" 204 0
2026-03-30 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_650c4b643f94365aa05c00bf42fddbc5.jpg saved to cache
2026-03-30 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9d00847-8b8b-5049-9eb3-4112a859702c
2026-03-30 10:31:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9d00847-8b8b-5049-9eb3-4112a859702c, skipping ID generation
2026-03-30 10:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9d00847-8b8b-5049-9eb3-4112a859702c with scrape type 1
2026-03-30 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9d00847-8b8b-5049-9eb3-4112a859702c sending to next pipeline
2026-03-30 10:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9d00847-8b8b-5049-9eb3-4112a859702c, identifier: LB63142
2026-03-30 10:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9d00847-8b8b-5049-9eb3-4112a859702c with identifier: LB63142
2026-03-30 10:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9d00847-8b8b-5049-9eb3-4112a859702c with identifier: LB63142
2026-03-30 10:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9d00847-8b8b-5049-9eb3-4112a859702c with identifier: LB63142 to the API
2026-03-30 10:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_650c4b643f94365aa05c00bf42fddbc5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:57:18Z',
 'fuel_type': 'diesel',
 'id': 'e9d00847-8b8b-5049-9eb3-4112a859702c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB63142',
 'listing': 'auction',
 'location': 'DE, Gera',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 123430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_650c4b643f94365aa05c00bf42fddbc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_77811d26c8da3e3225740a80b2031156.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_ecf7adbc899f6d5822e8d4dfce6fab3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_e87a6765d14b752b185cab1f4b2336a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_cb785515e90eaccdc24e682b628ad368.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_95014e1a23dce2d1e58baa01cfb17aed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_24b6110178b0cc4edab7283a2e9466c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_ffbdb41ec591e1c4718b4b331e187331.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_e64199e6057d6d81ee8e8aa3cbcbb3d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9d00847-8b8b-5049-9eb3-4112a859702c/e9d00847-8b8b-5049-9eb3-4112a859702c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/78/d4783e7663df4328519a981ac5b34ec8/pa/LB63142_ab9f989f932c2eea3d1628e72cec989c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2016}
2026-03-30 10:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB63142%27 HTTP/1.1" 200 None
2026-03-30 10:31:43 [auto1.de] INFO: Saving data for LB63142: {'created_time': 1774866703.288943, 'last_price_update_time': 1774866703.288955, 'auction_closing_time': 1774972638.0}
2026-03-30 10:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB63142') HTTP/1.1" 204 0
2026-03-30 10:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CJ96583/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:31:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:32:04 [scrapy.extensions.logstats] INFO: Crawled 22 pages (at 12 pages/min), scraped 17 items (at 15 items/min)
2026-03-30 10:32:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-30 10:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC73719> (referer: https://www.auto1.com/v1/car-details-view/NC73719/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:32:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af632eeb-b78c-59f0-8a64-1fbc892297d2 with identifier: NC73719
2026-03-30 10:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af632eeb-b78c-59f0-8a64-1fbc892297d2 with scrape type 1
2026-03-30 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af632eeb-b78c-59f0-8a64-1fbc892297d2
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F52%252F5c52ac4e9b8df186c2231922807ea922%252Fpa%252FNC73719_97183880412c3598b3330fb626581f8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_97183880412c3598b3330fb626581f8c.jpg already downloaded
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F52%252F5c52ac4e9b8df186c2231922807ea922%252Fpa%252FNC73719_e20555be7aec0c86b704bc2c06bc4351.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_e20555be7aec0c86b704bc2c06bc4351.jpg already downloaded
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F52%252F5c52ac4e9b8df186c2231922807ea922%252Fpa%252FNC73719_89dc04394d26443940696cc9c9683f3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_89dc04394d26443940696cc9c9683f3d.jpg already downloaded
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F52%252F5c52ac4e9b8df186c2231922807ea922%252Fpa%252FNC73719_83e7bf528d59dfc52a8a8fd75df94937.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_83e7bf528d59dfc52a8a8fd75df94937.jpg already downloaded
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F52%252F5c52ac4e9b8df186c2231922807ea922%252Fpa%252FNC73719_07a0db5581de8908d95a0f282003acc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_07a0db5581de8908d95a0f282003acc2.jpg already downloaded
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F52%252F5c52ac4e9b8df186c2231922807ea922%252Fpa%252FNC73719_02b6fe0ed1229d602ebc69dc43e7ac12.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_02b6fe0ed1229d602ebc69dc43e7ac12.jpg already downloaded
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F52%252F5c52ac4e9b8df186c2231922807ea922%252Fpa%252FNC73719_7ea1d907ff8d2ceeb9c82be980a6cd2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_7ea1d907ff8d2ceeb9c82be980a6cd2f.jpg already downloaded
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F52%252F5c52ac4e9b8df186c2231922807ea922%252Fpa%252FNC73719_4b193d49808389430695c7fd744504ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_4b193d49808389430695c7fd744504ac.jpg already downloaded
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F52%252F5c52ac4e9b8df186c2231922807ea922%252Fpa%252FNC73719_75e2305584dc15cfcdee7e5b1eb94573.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_75e2305584dc15cfcdee7e5b1eb94573.jpg already downloaded
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F52%252F5c52ac4e9b8df186c2231922807ea922%252Fpa%252FNC73719_b62ac4225c1418f1127f48b4cbc85cce.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_b62ac4225c1418f1127f48b4cbc85cce.jpg already downloaded
2026-03-30 10:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af632eeb-b78c-59f0-8a64-1fbc892297d2, identifier: NC73719
2026-03-30 10:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af632eeb-b78c-59f0-8a64-1fbc892297d2 with identifier: NC73719
2026-03-30 10:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af632eeb-b78c-59f0-8a64-1fbc892297d2 with identifier: NC73719
2026-03-30 10:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af632eeb-b78c-59f0-8a64-1fbc892297d2 with identifier: NC73719 to the API
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NC73719>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:08:51Z',
 'fuel_type': 'petrol',
 'id': 'af632eeb-b78c-59f0-8a64-1fbc892297d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC73719',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 113974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_97183880412c3598b3330fb626581f8c.jpg',
                'https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_e20555be7aec0c86b704bc2c06bc4351.jpg',
                'https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_89dc04394d26443940696cc9c9683f3d.jpg',
                'https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_83e7bf528d59dfc52a8a8fd75df94937.jpg',
                'https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_07a0db5581de8908d95a0f282003acc2.jpg',
                'https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_02b6fe0ed1229d602ebc69dc43e7ac12.jpg',
                'https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_7ea1d907ff8d2ceeb9c82be980a6cd2f.jpg',
                'https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_4b193d49808389430695c7fd744504ac.jpg',
                'https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_75e2305584dc15cfcdee7e5b1eb94573.jpg',
                'https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_b62ac4225c1418f1127f48b4cbc85cce.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af632eeb-b78c-59f0-8a64-1fbc892297d2/af632eeb-b78c-59f0-8a64-1fbc892297d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2703651,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_97183880412c3598b3330fb626581f8c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af632eeb-b78c-59f0-8a64-1fbc892297d2/af632eeb-b78c-59f0-8a64-1fbc892297d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2741465,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_e20555be7aec0c86b704bc2c06bc4351.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af632eeb-b78c-59f0-8a64-1fbc892297d2/af632eeb-b78c-59f0-8a64-1fbc892297d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2621584,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_89dc04394d26443940696cc9c9683f3d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af632eeb-b78c-59f0-8a64-1fbc892297d2/af632eeb-b78c-59f0-8a64-1fbc892297d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2592473,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_83e7bf528d59dfc52a8a8fd75df94937.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af632eeb-b78c-59f0-8a64-1fbc892297d2/af632eeb-b78c-59f0-8a64-1fbc892297d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2797793,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_07a0db5581de8908d95a0f282003acc2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af632eeb-b78c-59f0-8a64-1fbc892297d2/af632eeb-b78c-59f0-8a64-1fbc892297d2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2655745,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_02b6fe0ed1229d602ebc69dc43e7ac12.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af632eeb-b78c-59f0-8a64-1fbc892297d2/af632eeb-b78c-59f0-8a64-1fbc892297d2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_7ea1d907ff8d2ceeb9c82be980a6cd2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af632eeb-b78c-59f0-8a64-1fbc892297d2/af632eeb-b78c-59f0-8a64-1fbc892297d2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2676497,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_4b193d49808389430695c7fd744504ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af632eeb-b78c-59f0-8a64-1fbc892297d2/af632eeb-b78c-59f0-8a64-1fbc892297d2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2661378,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_75e2305584dc15cfcdee7e5b1eb94573.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af632eeb-b78c-59f0-8a64-1fbc892297d2/af632eeb-b78c-59f0-8a64-1fbc892297d2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2836722,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/52/5c52ac4e9b8df186c2231922807ea922/pa/NC73719_b62ac4225c1418f1127f48b4cbc85cce.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Sport ultra',
 'transmission': 'automatic',
 'trim': 'Sport ultra',
 'year': 2018}
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC73719%27 HTTP/1.1" 200 None
2026-03-30 10:32:05 [auto1.de] INFO: Saving data for NC73719: {'created_time': 1774866725.685621, 'last_price_update_time': 1774866725.685632, 'auction_closing_time': 1774969731.0}
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC73719') HTTP/1.1" 204 0
2026-03-30 10:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE71978> (referer: https://www.auto1.com/v1/car-details-view/RE71978/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:32:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0e9782d-947a-5160-9545-0f3974cb81aa with identifier: RE71978
2026-03-30 10:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0e9782d-947a-5160-9545-0f3974cb81aa with scrape type 1
2026-03-30 10:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0e9782d-947a-5160-9545-0f3974cb81aa
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd5%252Fa4d5519e1067cafd6d0e56d218037f0c%252Fpa%252FRE71978_8a74e5f2593baddb0eb11e0c04544d8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_8a74e5f2593baddb0eb11e0c04544d8f.jpg already downloaded
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd5%252Fa4d5519e1067cafd6d0e56d218037f0c%252Fpa%252FRE71978_b0842f7c2755fbb23cc952284129f758.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_b0842f7c2755fbb23cc952284129f758.jpg already downloaded
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd5%252Fa4d5519e1067cafd6d0e56d218037f0c%252Fpa%252FRE71978_98435758a31f60fc22eaa3279d10b2fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_98435758a31f60fc22eaa3279d10b2fb.jpg already downloaded
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd5%252Fa4d5519e1067cafd6d0e56d218037f0c%252Fpa%252FRE71978_15ccfbd1c48a75aa3d4bb8776c38dc79.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_15ccfbd1c48a75aa3d4bb8776c38dc79.jpg already downloaded
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd5%252Fa4d5519e1067cafd6d0e56d218037f0c%252Fpa%252FRE71978_20b24795ef8bc1105393db2045ad1e18.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_20b24795ef8bc1105393db2045ad1e18.jpg already downloaded
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd5%252Fa4d5519e1067cafd6d0e56d218037f0c%252Fpa%252FRE71978_89a116c6d8e5f68ad4463ae9f66f30ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_89a116c6d8e5f68ad4463ae9f66f30ff.jpg already downloaded
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd5%252Fa4d5519e1067cafd6d0e56d218037f0c%252Fpa%252FRE71978_40d1f54e661e8e6c6ac75a645b69b037.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_40d1f54e661e8e6c6ac75a645b69b037.jpg already downloaded
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd5%252Fa4d5519e1067cafd6d0e56d218037f0c%252Fpa%252FRE71978_5a7ef5ee0f4192d12daaf601c6902eea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_5a7ef5ee0f4192d12daaf601c6902eea.jpg already downloaded
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd5%252Fa4d5519e1067cafd6d0e56d218037f0c%252Fpa%252FRE71978_399a10870d4aa3b6df84e6439b5003cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_399a10870d4aa3b6df84e6439b5003cb.jpg already downloaded
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd5%252Fa4d5519e1067cafd6d0e56d218037f0c%252Fpa%252FRE71978_8051c95764dce8169f773abafbffe725.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_8051c95764dce8169f773abafbffe725.jpg already downloaded
2026-03-30 10:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0e9782d-947a-5160-9545-0f3974cb81aa, identifier: RE71978
2026-03-30 10:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0e9782d-947a-5160-9545-0f3974cb81aa with identifier: RE71978
2026-03-30 10:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0e9782d-947a-5160-9545-0f3974cb81aa with identifier: RE71978
2026-03-30 10:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0e9782d-947a-5160-9545-0f3974cb81aa with identifier: RE71978 to the API
2026-03-30 10:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RE71978>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:06:01Z',
 'fuel_type': 'diesel',
 'id': 'c0e9782d-947a-5160-9545-0f3974cb81aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE71978',
 'listing': 'auction',
 'location': 'DE, Fockbek',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 244454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_8a74e5f2593baddb0eb11e0c04544d8f.jpg',
                'https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_b0842f7c2755fbb23cc952284129f758.jpg',
                'https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_98435758a31f60fc22eaa3279d10b2fb.jpg',
                'https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_15ccfbd1c48a75aa3d4bb8776c38dc79.jpg',
                'https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_20b24795ef8bc1105393db2045ad1e18.jpg',
                'https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_89a116c6d8e5f68ad4463ae9f66f30ff.jpg',
                'https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_40d1f54e661e8e6c6ac75a645b69b037.jpg',
                'https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_5a7ef5ee0f4192d12daaf601c6902eea.jpg',
                'https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_399a10870d4aa3b6df84e6439b5003cb.jpg',
                'https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_8051c95764dce8169f773abafbffe725.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0e9782d-947a-5160-9545-0f3974cb81aa/c0e9782d-947a-5160-9545-0f3974cb81aa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_8a74e5f2593baddb0eb11e0c04544d8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0e9782d-947a-5160-9545-0f3974cb81aa/c0e9782d-947a-5160-9545-0f3974cb81aa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_b0842f7c2755fbb23cc952284129f758.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0e9782d-947a-5160-9545-0f3974cb81aa/c0e9782d-947a-5160-9545-0f3974cb81aa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_98435758a31f60fc22eaa3279d10b2fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0e9782d-947a-5160-9545-0f3974cb81aa/c0e9782d-947a-5160-9545-0f3974cb81aa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_15ccfbd1c48a75aa3d4bb8776c38dc79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0e9782d-947a-5160-9545-0f3974cb81aa/c0e9782d-947a-5160-9545-0f3974cb81aa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_20b24795ef8bc1105393db2045ad1e18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0e9782d-947a-5160-9545-0f3974cb81aa/c0e9782d-947a-5160-9545-0f3974cb81aa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_89a116c6d8e5f68ad4463ae9f66f30ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0e9782d-947a-5160-9545-0f3974cb81aa/c0e9782d-947a-5160-9545-0f3974cb81aa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_40d1f54e661e8e6c6ac75a645b69b037.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0e9782d-947a-5160-9545-0f3974cb81aa/c0e9782d-947a-5160-9545-0f3974cb81aa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_5a7ef5ee0f4192d12daaf601c6902eea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0e9782d-947a-5160-9545-0f3974cb81aa/c0e9782d-947a-5160-9545-0f3974cb81aa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_399a10870d4aa3b6df84e6439b5003cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0e9782d-947a-5160-9545-0f3974cb81aa/c0e9782d-947a-5160-9545-0f3974cb81aa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d5/a4d5519e1067cafd6d0e56d218037f0c/pa/RE71978_8051c95764dce8169f773abafbffe725.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-01',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 116 CDI Pro lang',
 'transmission': 'automatic',
 'trim': 'Pro lang',
 'year': 2020}
2026-03-30 10:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE71978%27 HTTP/1.1" 200 None
2026-03-30 10:32:17 [auto1.de] INFO: Saving data for RE71978: {'created_time': 1774866737.276087, 'last_price_update_time': 1774866737.276101, 'auction_closing_time': 1774969561.0}
2026-03-30 10:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE71978') HTTP/1.1" 204 0
2026-03-30 10:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY19910/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:32:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:32:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:32:19 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 9394 | hits on page: 40
2026-03-30 10:32:19 [auto1.de] INFO: Found listing with ID: BR45511
2026-03-30 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR45511%27 HTTP/1.1" 200 None
2026-03-30 10:32:19 [auto1.de] INFO: Scrape type for BR45511: 0
2026-03-30 10:32:19 [auto1.de] INFO: Found listing with ID: WW07802
2026-03-30 10:32:19 [auto1.de] INFO: Found listing with ID: WN73161
2026-03-30 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN73161%27 HTTP/1.1" 200 None
2026-03-30 10:32:19 [auto1.de] INFO: Scrape type for WN73161: 0
2026-03-30 10:32:19 [auto1.de] INFO: Found listing with ID: BH73994
2026-03-30 10:32:19 [auto1.de] INFO: Found listing with ID: KN66141
2026-03-30 10:32:19 [auto1.de] INFO: Found listing with ID: PD23584
2026-03-30 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD23584%27 HTTP/1.1" 200 None
2026-03-30 10:32:19 [auto1.de] INFO: Scrape type for PD23584: 2
2026-03-30 10:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1b5f262-d14c-5db5-aca6-38a40a67c2aa with identifier: PD23584
2026-03-30 10:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1b5f262-d14c-5db5-aca6-38a40a67c2aa with scrape type 2
2026-03-30 10:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1b5f262-d14c-5db5-aca6-38a40a67c2aa with scrape type 2
2026-03-30 10:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1b5f262-d14c-5db5-aca6-38a40a67c2aa, identifier: PD23584
2026-03-30 10:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1b5f262-d14c-5db5-aca6-38a40a67c2aa with identifier: PD23584
2026-03-30 10:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:32:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-30 10:32:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1b5f262-d14c-5db5-aca6-38a40a67c2aa with identifier: PD23584
2026-03-30 10:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1b5f262-d14c-5db5-aca6-38a40a67c2aa with identifier: PD23584 to the API
2026-03-30 10:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:54:25Z',
 'fuel_type': 'petrol',
 'id': 'b1b5f262-d14c-5db5-aca6-38a40a67c2aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD23584',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 264639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-23',
 'seller_name': None,
 'title': 'Skoda Yeti 1.2 TSI Active Plus Edition',
 'transmission': 'manual',
 'trim': 'Active Plus Edition',
 'year': 2010}
2026-03-30 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD23584%27 HTTP/1.1" 200 None
2026-03-30 10:32:20 [auto1.de] INFO: Saving data for PD23584: {'auction_closing_time': 1774972465.0, 'created_time': 1772546180.796855, 'last_price_update_time': 1774866740.309503}
2026-03-30 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD23584') HTTP/1.1" 204 0
2026-03-30 10:32:20 [auto1.de] INFO: Found listing with ID: SE03800
2026-03-30 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE03800%27 HTTP/1.1" 200 None
2026-03-30 10:32:20 [auto1.de] INFO: Scrape type for SE03800: 1
2026-03-30 10:32:20 [auto1.de] INFO: Found listing with ID: DJ88162
2026-03-30 10:32:20 [auto1.de] INFO: Found listing with ID: JB65863
2026-03-30 10:32:20 [auto1.de] INFO: Found listing with ID: MN85536
2026-03-30 10:32:20 [auto1.de] INFO: Found listing with ID: WW55760
2026-03-30 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW55760%27 HTTP/1.1" 200 None
2026-03-30 10:32:20 [auto1.de] INFO: Scrape type for WW55760: 2
2026-03-30 10:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c6bcf5b-59cb-5fb1-b753-805c7c2db73c with identifier: WW55760
2026-03-30 10:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c6bcf5b-59cb-5fb1-b753-805c7c2db73c with scrape type 2
2026-03-30 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c6bcf5b-59cb-5fb1-b753-805c7c2db73c with scrape type 2
2026-03-30 10:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c6bcf5b-59cb-5fb1-b753-805c7c2db73c, identifier: WW55760
2026-03-30 10:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c6bcf5b-59cb-5fb1-b753-805c7c2db73c with identifier: WW55760
2026-03-30 10:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c6bcf5b-59cb-5fb1-b753-805c7c2db73c with identifier: WW55760
2026-03-30 10:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c6bcf5b-59cb-5fb1-b753-805c7c2db73c with identifier: WW55760 to the API
2026-03-30 10:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:17:31Z',
 'fuel_type': 'diesel',
 'id': '4c6bcf5b-59cb-5fb1-b753-805c7c2db73c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW55760',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 166227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-29',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.6 TDI StylePlus',
 'transmission': 'manual',
 'trim': 'StylePlus',
 'year': 2014}
2026-03-30 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW55760%27 HTTP/1.1" 200 None
2026-03-30 10:32:20 [auto1.de] INFO: Saving data for WW55760: {'auction_closing_time': 1774970251.0, 'created_time': 1773687578.786787, 'last_price_update_time': 1774866740.790673}
2026-03-30 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW55760') HTTP/1.1" 204 0
2026-03-30 10:32:20 [auto1.de] INFO: Found listing with ID: AH23390
2026-03-30 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH23390%27 HTTP/1.1" 200 None
2026-03-30 10:32:20 [auto1.de] INFO: Scrape type for AH23390: 2
2026-03-30 10:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 379f4d9a-fe63-5f7b-b7e8-f839b395fe80 with identifier: AH23390
2026-03-30 10:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 379f4d9a-fe63-5f7b-b7e8-f839b395fe80 with scrape type 2
2026-03-30 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 379f4d9a-fe63-5f7b-b7e8-f839b395fe80 with scrape type 2
2026-03-30 10:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 379f4d9a-fe63-5f7b-b7e8-f839b395fe80, identifier: AH23390
2026-03-30 10:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 379f4d9a-fe63-5f7b-b7e8-f839b395fe80 with identifier: AH23390
2026-03-30 10:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 379f4d9a-fe63-5f7b-b7e8-f839b395fe80 with identifier: AH23390
2026-03-30 10:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 379f4d9a-fe63-5f7b-b7e8-f839b395fe80 with identifier: AH23390 to the API
2026-03-30 10:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-31T15:43:09Z',
 'fuel_type': 'petrol',
 'id': '379f4d9a-fe63-5f7b-b7e8-f839b395fe80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH23390',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 110422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-16',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-30 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH23390%27 HTTP/1.1" 200 None
2026-03-30 10:32:21 [auto1.de] INFO: Saving data for AH23390: {'auction_closing_time': 1774971789.0, 'created_time': 1773776131.802502, 'last_price_update_time': 1774866741.901106}
2026-03-30 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH23390') HTTP/1.1" 204 0
2026-03-30 10:32:21 [auto1.de] INFO: Found listing with ID: NG72110
2026-03-30 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG72110%27 HTTP/1.1" 200 None
2026-03-30 10:32:21 [auto1.de] INFO: Scrape type for NG72110: 1
2026-03-30 10:32:21 [auto1.de] INFO: Found listing with ID: WK80523
2026-03-30 10:32:21 [auto1.de] INFO: Found listing with ID: UA29824
2026-03-30 10:32:21 [auto1.de] INFO: Found listing with ID: TW83915
2026-03-30 10:32:21 [auto1.de] INFO: Found listing with ID: AY86624
2026-03-30 10:32:21 [auto1.de] INFO: Found listing with ID: AL36767
2026-03-30 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL36767%27 HTTP/1.1" 200 None
2026-03-30 10:32:21 [auto1.de] INFO: Scrape type for AL36767: 1
2026-03-30 10:32:21 [auto1.de] INFO: Found listing with ID: ZT34022
2026-03-30 10:32:21 [auto1.de] INFO: Found listing with ID: YL93340
2026-03-30 10:32:21 [auto1.de] INFO: Found listing with ID: NV44287
2026-03-30 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV44287%27 HTTP/1.1" 200 None
2026-03-30 10:32:21 [auto1.de] INFO: Scrape type for NV44287: 1
2026-03-30 10:32:21 [auto1.de] INFO: Found listing with ID: ZW01245
2026-03-30 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW01245%27 HTTP/1.1" 200 None
2026-03-30 10:32:21 [auto1.de] INFO: Scrape type for ZW01245: 1
2026-03-30 10:32:21 [auto1.de] INFO: Found listing with ID: CH19633
2026-03-30 10:32:21 [auto1.de] INFO: Found listing with ID: KG08249
2026-03-30 10:32:22 [auto1.de] INFO: Found listing with ID: ZF42330
2026-03-30 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF42330%27 HTTP/1.1" 200 None
2026-03-30 10:32:22 [auto1.de] INFO: Scrape type for ZF42330: 2
2026-03-30 10:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fce6ecb3-fa84-5a80-9a9a-9529989925a8 with identifier: ZF42330
2026-03-30 10:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fce6ecb3-fa84-5a80-9a9a-9529989925a8 with scrape type 2
2026-03-30 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fce6ecb3-fa84-5a80-9a9a-9529989925a8 with scrape type 2
2026-03-30 10:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fce6ecb3-fa84-5a80-9a9a-9529989925a8, identifier: ZF42330
2026-03-30 10:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fce6ecb3-fa84-5a80-9a9a-9529989925a8 with identifier: ZF42330
2026-03-30 10:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:32:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-30 10:32:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fce6ecb3-fa84-5a80-9a9a-9529989925a8 with identifier: ZF42330
2026-03-30 10:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fce6ecb3-fa84-5a80-9a9a-9529989925a8 with identifier: ZF42330 to the API
2026-03-30 10:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:21:42Z',
 'fuel_type': 'diesel',
 'id': 'fce6ecb3-fa84-5a80-9a9a-9529989925a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF42330',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 79400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-18',
 'seller_name': None,
 'title': 'BMW 1er 120d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF42330%27 HTTP/1.1" 200 None
2026-03-30 10:32:22 [auto1.de] INFO: Saving data for ZF42330: {'auction_closing_time': 1774970502.0, 'created_time': 1774293825.913308, 'last_price_update_time': 1774866742.545266}
2026-03-30 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF42330') HTTP/1.1" 204 0
2026-03-30 10:32:22 [auto1.de] INFO: Found listing with ID: EL41101
2026-03-30 10:32:22 [auto1.de] INFO: Found listing with ID: UZ88379
2026-03-30 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ88379%27 HTTP/1.1" 200 None
2026-03-30 10:32:22 [auto1.de] INFO: Scrape type for UZ88379: 1
2026-03-30 10:32:22 [auto1.de] INFO: Found listing with ID: KF18796
2026-03-30 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF18796%27 HTTP/1.1" 200 None
2026-03-30 10:32:22 [auto1.de] INFO: Scrape type for KF18796: 2
2026-03-30 10:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cc2acd0-e6dd-5ebc-8a4d-a76c671d9be3 with identifier: KF18796
2026-03-30 10:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cc2acd0-e6dd-5ebc-8a4d-a76c671d9be3 with scrape type 2
2026-03-30 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cc2acd0-e6dd-5ebc-8a4d-a76c671d9be3 with scrape type 2
2026-03-30 10:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cc2acd0-e6dd-5ebc-8a4d-a76c671d9be3, identifier: KF18796
2026-03-30 10:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cc2acd0-e6dd-5ebc-8a4d-a76c671d9be3 with identifier: KF18796
2026-03-30 10:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:32:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 10:32:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cc2acd0-e6dd-5ebc-8a4d-a76c671d9be3 with identifier: KF18796
2026-03-30 10:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cc2acd0-e6dd-5ebc-8a4d-a76c671d9be3 with identifier: KF18796 to the API
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:32:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 381,
 'expiration_date': '2026-03-31T15:35:45Z',
 'fuel_type': 'hybrid',
 'id': '6cc2acd0-e6dd-5ebc-8a4d-a76c671d9be3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF18796',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 65881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.0 4xe Plug-in Hybrid Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2021}
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF18796%27 HTTP/1.1" 200 None
2026-03-30 10:32:23 [auto1.de] INFO: Saving data for KF18796: {'auction_closing_time': 1774971345.0, 'created_time': 1773346225.1618, 'last_price_update_time': 1774866743.540657}
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF18796') HTTP/1.1" 204 0
2026-03-30 10:32:23 [auto1.de] INFO: Found listing with ID: VV15875
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV15875%27 HTTP/1.1" 200 None
2026-03-30 10:32:23 [auto1.de] INFO: Scrape type for VV15875: 1
2026-03-30 10:32:23 [auto1.de] INFO: Found listing with ID: GT90153
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT90153%27 HTTP/1.1" 200 None
2026-03-30 10:32:23 [auto1.de] INFO: Scrape type for GT90153: 1
2026-03-30 10:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA83514/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:32:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:32:23 [auto1.de] INFO: Found listing with ID: YE41052
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE41052%27 HTTP/1.1" 200 None
2026-03-30 10:32:23 [auto1.de] INFO: Scrape type for YE41052: 1
2026-03-30 10:32:23 [auto1.de] INFO: Found listing with ID: WL34445
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL34445%27 HTTP/1.1" 200 None
2026-03-30 10:32:23 [auto1.de] INFO: Scrape type for WL34445: 1
2026-03-30 10:32:23 [auto1.de] INFO: Found listing with ID: VH91595
2026-03-30 10:32:23 [auto1.de] INFO: Found listing with ID: BX61235
2026-03-30 10:32:23 [auto1.de] INFO: Found listing with ID: KV96760
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV96760%27 HTTP/1.1" 200 None
2026-03-30 10:32:23 [auto1.de] INFO: Scrape type for KV96760: 2
2026-03-30 10:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50d6fadd-d649-5ed3-b656-0c7d19e2da14 with identifier: KV96760
2026-03-30 10:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50d6fadd-d649-5ed3-b656-0c7d19e2da14 with scrape type 2
2026-03-30 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50d6fadd-d649-5ed3-b656-0c7d19e2da14 with scrape type 2
2026-03-30 10:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50d6fadd-d649-5ed3-b656-0c7d19e2da14, identifier: KV96760
2026-03-30 10:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50d6fadd-d649-5ed3-b656-0c7d19e2da14 with identifier: KV96760
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 10:32:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50d6fadd-d649-5ed3-b656-0c7d19e2da14 with identifier: KV96760
2026-03-30 10:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50d6fadd-d649-5ed3-b656-0c7d19e2da14 with identifier: KV96760 to the API
2026-03-30 10:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:17:23Z',
 'fuel_type': 'petrol',
 'id': '50d6fadd-d649-5ed3-b656-0c7d19e2da14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV96760',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 107931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-03-10',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 280 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 1998}
2026-03-30 10:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV96760%27 HTTP/1.1" 200 None
2026-03-30 10:32:24 [auto1.de] INFO: Saving data for KV96760: {'auction_closing_time': 1774970243.0, 'created_time': 1774293793.62119, 'last_price_update_time': 1774866744.216884}
2026-03-30 10:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV96760') HTTP/1.1" 204 0
2026-03-30 10:32:24 [auto1.de] INFO: Found listing with ID: JB89867
2026-03-30 10:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB89867%27 HTTP/1.1" 200 None
2026-03-30 10:32:24 [auto1.de] INFO: Scrape type for JB89867: 1
2026-03-30 10:32:24 [auto1.de] INFO: Found listing with ID: XR47953
2026-03-30 10:32:24 [auto1.de] INFO: Found listing with ID: EH55820
2026-03-30 10:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH55820%27 HTTP/1.1" 200 None
2026-03-30 10:32:24 [auto1.de] INFO: Scrape type for EH55820: 1
2026-03-30 10:32:24 [auto1.de] INFO: Found listing with ID: MF71867
2026-03-30 10:32:24 [auto1.de] INFO: Found listing with ID: WH35124
2026-03-30 10:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH35124%27 HTTP/1.1" 200 None
2026-03-30 10:32:24 [auto1.de] INFO: Scrape type for WH35124: 1
2026-03-30 10:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TV02686/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:32:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HC77089/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:32:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PG43779> (referer: https://www.auto1.com/v1/car-details-view/PG43779/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:32:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3fbc0b5-862b-5164-991a-266a1eb7f088 with identifier: PG43779
2026-03-30 10:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3fbc0b5-862b-5164-991a-266a1eb7f088 with scrape type 1
2026-03-30 10:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b3fbc0b5-862b-5164-991a-266a1eb7f088
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011d25cb91889ee263bb5a417a7581e%252Fpa%252FPG43779_c4a198a025f9dcacf895ac974f4f2691.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_c4a198a025f9dcacf895ac974f4f2691.jpg already downloaded
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011d25cb91889ee263bb5a417a7581e%252Fpa%252FPG43779_2fa62c405d2e15dc6252cef1ad531341.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_2fa62c405d2e15dc6252cef1ad531341.jpg already downloaded
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011d25cb91889ee263bb5a417a7581e%252Fpa%252FPG43779_f5d2068f18ed9d45426d6302bef0583c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_f5d2068f18ed9d45426d6302bef0583c.jpg already downloaded
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011d25cb91889ee263bb5a417a7581e%252Fpa%252FPG43779_4e43180503a5012abe89bd3ae65b1010.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_4e43180503a5012abe89bd3ae65b1010.jpg already downloaded
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011d25cb91889ee263bb5a417a7581e%252Fpa%252FPG43779_c9343e8f8de838917a156e1166e69ae5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_c9343e8f8de838917a156e1166e69ae5.jpg already downloaded
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011d25cb91889ee263bb5a417a7581e%252Fpa%252FPG43779_3ca0dc94552a768b36f2d7cfd220604e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_3ca0dc94552a768b36f2d7cfd220604e.jpg already downloaded
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011d25cb91889ee263bb5a417a7581e%252Fpa%252FPG43779_ae477fecbd245e2a6d32913a8436213f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_ae477fecbd245e2a6d32913a8436213f.jpg already downloaded
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011d25cb91889ee263bb5a417a7581e%252Fpa%252FPG43779_824079aeb14105801e99904375532e5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_824079aeb14105801e99904375532e5e.jpg already downloaded
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011d25cb91889ee263bb5a417a7581e%252Fpa%252FPG43779_a252b873ad51d4b7d1cb2b767670bec4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_a252b873ad51d4b7d1cb2b767670bec4.jpg already downloaded
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011d25cb91889ee263bb5a417a7581e%252Fpa%252FPG43779_9c6b0101ebd3799f59a8463999b3a56c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_9c6b0101ebd3799f59a8463999b3a56c.jpg already downloaded
2026-03-30 10:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3fbc0b5-862b-5164-991a-266a1eb7f088, identifier: PG43779
2026-03-30 10:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3fbc0b5-862b-5164-991a-266a1eb7f088 with identifier: PG43779
2026-03-30 10:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3fbc0b5-862b-5164-991a-266a1eb7f088 with identifier: PG43779
2026-03-30 10:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3fbc0b5-862b-5164-991a-266a1eb7f088 with identifier: PG43779 to the API
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PG43779>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:53:44Z',
 'fuel_type': 'diesel',
 'id': 'b3fbc0b5-862b-5164-991a-266a1eb7f088',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG43779',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'BMW',
 'model': '3er',
 'odometer': 148494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_c4a198a025f9dcacf895ac974f4f2691.jpg',
                'https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_2fa62c405d2e15dc6252cef1ad531341.jpg',
                'https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_f5d2068f18ed9d45426d6302bef0583c.jpg',
                'https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_4e43180503a5012abe89bd3ae65b1010.jpg',
                'https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_c9343e8f8de838917a156e1166e69ae5.jpg',
                'https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_3ca0dc94552a768b36f2d7cfd220604e.jpg',
                'https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_ae477fecbd245e2a6d32913a8436213f.jpg',
                'https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_824079aeb14105801e99904375532e5e.jpg',
                'https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_a252b873ad51d4b7d1cb2b767670bec4.jpg',
                'https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_9c6b0101ebd3799f59a8463999b3a56c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3fbc0b5-862b-5164-991a-266a1eb7f088/b3fbc0b5-862b-5164-991a-266a1eb7f088_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2888172,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_c4a198a025f9dcacf895ac974f4f2691.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3fbc0b5-862b-5164-991a-266a1eb7f088/b3fbc0b5-862b-5164-991a-266a1eb7f088_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2791516,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_2fa62c405d2e15dc6252cef1ad531341.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3fbc0b5-862b-5164-991a-266a1eb7f088/b3fbc0b5-862b-5164-991a-266a1eb7f088_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2787126,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_f5d2068f18ed9d45426d6302bef0583c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3fbc0b5-862b-5164-991a-266a1eb7f088/b3fbc0b5-862b-5164-991a-266a1eb7f088_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2641952,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_4e43180503a5012abe89bd3ae65b1010.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3fbc0b5-862b-5164-991a-266a1eb7f088/b3fbc0b5-862b-5164-991a-266a1eb7f088_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_c9343e8f8de838917a156e1166e69ae5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3fbc0b5-862b-5164-991a-266a1eb7f088/b3fbc0b5-862b-5164-991a-266a1eb7f088_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_3ca0dc94552a768b36f2d7cfd220604e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3fbc0b5-862b-5164-991a-266a1eb7f088/b3fbc0b5-862b-5164-991a-266a1eb7f088_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2588064,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_ae477fecbd245e2a6d32913a8436213f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3fbc0b5-862b-5164-991a-266a1eb7f088/b3fbc0b5-862b-5164-991a-266a1eb7f088_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_824079aeb14105801e99904375532e5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3fbc0b5-862b-5164-991a-266a1eb7f088/b3fbc0b5-862b-5164-991a-266a1eb7f088_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_a252b873ad51d4b7d1cb2b767670bec4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3fbc0b5-862b-5164-991a-266a1eb7f088/b3fbc0b5-862b-5164-991a-266a1eb7f088_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011d25cb91889ee263bb5a417a7581e/pa/PG43779_9c6b0101ebd3799f59a8463999b3a56c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d Mild-Hybrid Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2020}
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG43779%27 HTTP/1.1" 200 None
2026-03-30 10:32:33 [auto1.de] INFO: Saving data for PG43779: {'created_time': 1774866753.84745, 'last_price_update_time': 1774866753.847461, 'auction_closing_time': 1774972424.0}
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG43779') HTTP/1.1" 204 0
2026-03-30 10:32:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.435(s), this was the 1st time calling it.
2026-03-30 10:32:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.498187909202302 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:32:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.165(s), this was the 1st time calling it.
2026-03-30 10:32:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.207881193040996 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:32:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.385(s), this was the 1st time calling it.
2026-03-30 10:32:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.594896293901947 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GL90573> (referer: https://www.auto1.com/v1/car-details-view/GL90573/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:32:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ced91f3-8819-5ad6-a7bb-126d680b7af2 with identifier: GL90573
2026-03-30 10:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ced91f3-8819-5ad6-a7bb-126d680b7af2 with scrape type 1
2026-03-30 10:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ced91f3-8819-5ad6-a7bb-126d680b7af2
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_77088786b8849cdcf4e29bd2605e20b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_77088786b8849cdcf4e29bd2605e20b4.jpg not downloaded yet
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_db8f306a11ec13fb8c33156e8b64867e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_db8f306a11ec13fb8c33156e8b64867e.jpg not downloaded yet
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_b60c4c424bcd8ac7bf38ef3cac982d2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_b60c4c424bcd8ac7bf38ef3cac982d2f.jpg not downloaded yet
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_9ccca7a8ff6e6a5eec2969b8ecb5b760.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_9ccca7a8ff6e6a5eec2969b8ecb5b760.jpg not downloaded yet
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_d198efa1ab3f5e6923f96e1771d2bc45.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_d198efa1ab3f5e6923f96e1771d2bc45.jpg not downloaded yet
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_5ac5e2764f585934c4e10f0930430e29.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_5ac5e2764f585934c4e10f0930430e29.jpg not downloaded yet
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_b728aaa564d923fee6429bb8a7facd5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_b728aaa564d923fee6429bb8a7facd5c.jpg not downloaded yet
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_4b6adc60e2a8a2295ad4b57d8e7879ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_4b6adc60e2a8a2295ad4b57d8e7879ac.jpg not downloaded yet
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_5381d3a9e58882a9ab9d6415b6c75e8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_5381d3a9e58882a9ab9d6415b6c75e8b.jpg not downloaded yet
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_7bd672c237460d5f40df7089dfa3acd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_7bd672c237460d5f40df7089dfa3acd4.jpg not downloaded yet
2026-03-30 10:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VU63296> (referer: https://www.auto1.com/v1/car-details-view/VU63296/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:32:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8913a16-c02d-5382-b94c-d53f045f56b8 with identifier: VU63296
2026-03-30 10:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8913a16-c02d-5382-b94c-d53f045f56b8 with scrape type 1
2026-03-30 10:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8913a16-c02d-5382-b94c-d53f045f56b8
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_21f47e16fb076651d04885124037e030.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_21f47e16fb076651d04885124037e030.jpg not downloaded yet
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_0f3d5fa17d9bfd098b1bf8e8c48a41f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_0f3d5fa17d9bfd098b1bf8e8c48a41f5.jpg not downloaded yet
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_ba2bc7ce14ce0456be317fd785cdadc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_ba2bc7ce14ce0456be317fd785cdadc2.jpg not downloaded yet
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_a4ee8e21d6f02cb0c459231b568a4526.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_a4ee8e21d6f02cb0c459231b568a4526.jpg not downloaded yet
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_2c60c45d1949006641661719b352ebe4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_2c60c45d1949006641661719b352ebe4.jpg not downloaded yet
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_5c5bcc1d00b521b60b2686b86c1d3722.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_5c5bcc1d00b521b60b2686b86c1d3722.jpg not downloaded yet
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_2fc19e10e96eb33e85018342571d84ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_2fc19e10e96eb33e85018342571d84ec.jpg not downloaded yet
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_a2704fcf4771e1031f2e37f367e9ebdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_a2704fcf4771e1031f2e37f367e9ebdc.jpg not downloaded yet
2026-03-30 10:32:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_77cd5e4f87316240fc3865a6280d50e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_77cd5e4f87316240fc3865a6280d50e0.jpg not downloaded yet
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_3da0bedc7be409adf90e1c1619f0eabe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_3da0bedc7be409adf90e1c1619f0eabe.jpg not downloaded yet
2026-03-30 10:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CJ96583> (referer: https://www.auto1.com/v1/car-details-view/CJ96583/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:32:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_7bd672c237460d5f40df7089dfa3acd4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_3da0bedc7be409adf90e1c1619f0eabe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_a2704fcf4771e1031f2e37f367e9ebdc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0871e266-bd70-57a8-84e2-b4086eb046ae with identifier: CJ96583
2026-03-30 10:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0871e266-bd70-57a8-84e2-b4086eb046ae with scrape type 1
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0871e266-bd70-57a8-84e2-b4086eb046ae
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_52d4b2d51e759df6a7d6c123db8d426b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_52d4b2d51e759df6a7d6c123db8d426b.jpg not downloaded yet
2026-03-30 10:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_2fc19e10e96eb33e85018342571d84ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_86a2651e12efcd8fd8c56dd8c511f460.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_86a2651e12efcd8fd8c56dd8c511f460.jpg not downloaded yet
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_f0f20f43f13d38851550e0736e974f4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_f0f20f43f13d38851550e0736e974f4e.jpg not downloaded yet
2026-03-30 10:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KK63455> (referer: https://www.auto1.com/v1/car-details-view/KK63455/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:32:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:32:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f59130d0>
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_7bd672c237460d5f40df7089dfa3acd4.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_7bd672c237460d5f40df7089dfa3acd4.jpg saved to cache
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ced91f3-8819-5ad6-a7bb-126d680b7af2
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42b7390>
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_3da0bedc7be409adf90e1c1619f0eabe.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_3da0bedc7be409adf90e1c1619f0eabe.jpg saved to cache
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8913a16-c02d-5382-b94c-d53f045f56b8
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_efa8f61d43ce24277a3d28e083f6e5d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_efa8f61d43ce24277a3d28e083f6e5d4.jpg not downloaded yet
2026-03-30 10:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_77cd5e4f87316240fc3865a6280d50e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_f7a5e6671f03ef20edbd2a969a954ace.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_f7a5e6671f03ef20edbd2a969a954ace.jpg not downloaded yet
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3c0d0>
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_a2704fcf4771e1031f2e37f367e9ebdc.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_a2704fcf4771e1031f2e37f367e9ebdc.jpg saved to cache
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8913a16-c02d-5382-b94c-d53f045f56b8
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41f0d50>
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_2fc19e10e96eb33e85018342571d84ec.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_2fc19e10e96eb33e85018342571d84ec.jpg saved to cache
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8913a16-c02d-5382-b94c-d53f045f56b8
2026-03-30 10:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 100d9089-f86b-574e-b3e9-2e594d2fa01f with identifier: KK63455
2026-03-30 10:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 100d9089-f86b-574e-b3e9-2e594d2fa01f with scrape type 1
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 100d9089-f86b-574e-b3e9-2e594d2fa01f
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_7f27a0d148c1c0d608fae291162d5ed6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_7f27a0d148c1c0d608fae291162d5ed6.jpg not downloaded yet
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_59dfe753de98dc8368dfc784b6274153.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_59dfe753de98dc8368dfc784b6274153.jpg not downloaded yet
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_fe4a7e264472a9c69eabdb703076b988.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_fe4a7e264472a9c69eabdb703076b988.jpg not downloaded yet
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef0e8d0>
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_77cd5e4f87316240fc3865a6280d50e0.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_77cd5e4f87316240fc3865a6280d50e0.jpg saved to cache
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8913a16-c02d-5382-b94c-d53f045f56b8
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_6e1943026e612556aade70f788f8e7b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_6e1943026e612556aade70f788f8e7b0.jpg not downloaded yet
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_6a5f03b2428fc33d5dec6586052361ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_6a5f03b2428fc33d5dec6586052361ba.jpg not downloaded yet
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_55c721f39ef5e0ac8e3c6b211c465248.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_55c721f39ef5e0ac8e3c6b211c465248.jpg not downloaded yet
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_6e5901ad649846cc2c7b48aad5f24cd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_6e5901ad649846cc2c7b48aad5f24cd8.jpg not downloaded yet
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_23f99e1a5b8175dd0ad0069c1f131076.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_23f99e1a5b8175dd0ad0069c1f131076.jpg not downloaded yet
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_4204b87849b97732c8342f660f5e566f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_4204b87849b97732c8342f660f5e566f.jpg not downloaded yet
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_594683ef24da83152923b0d11ec07340.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_594683ef24da83152923b0d11ec07340.jpg not downloaded yet
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_372b505d29c60a6a397288784db9b02b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_372b505d29c60a6a397288784db9b02b.jpg not downloaded yet
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_db2d087649e0cae84e828b9568662884.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_db2d087649e0cae84e828b9568662884.jpg not downloaded yet
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_25495eb3c03bac82f2c8a816e5a7d1b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_25495eb3c03bac82f2c8a816e5a7d1b7.jpg not downloaded yet
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_f118a0b4b2853084d2cb82226d5a43ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_f118a0b4b2853084d2cb82226d5a43ee.jpg not downloaded yet
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_84ffd761730fbcfd47d7cd9d2d83c987.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_84ffd761730fbcfd47d7cd9d2d83c987.jpg not downloaded yet
2026-03-30 10:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MV22055/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:32:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:32:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_52d4b2d51e759df6a7d6c123db8d426b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_efa8f61d43ce24277a3d28e083f6e5d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_86a2651e12efcd8fd8c56dd8c511f460.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_f118a0b4b2853084d2cb82226d5a43ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_25495eb3c03bac82f2c8a816e5a7d1b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f420da10>
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_52d4b2d51e759df6a7d6c123db8d426b.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_52d4b2d51e759df6a7d6c123db8d426b.jpg saved to cache
2026-03-30 10:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0871e266-bd70-57a8-84e2-b4086eb046ae
2026-03-30 10:32:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4254910>
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_efa8f61d43ce24277a3d28e083f6e5d4.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_efa8f61d43ce24277a3d28e083f6e5d4.jpg saved to cache
2026-03-30 10:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0871e266-bd70-57a8-84e2-b4086eb046ae
2026-03-30 10:32:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f433fbd0>
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_86a2651e12efcd8fd8c56dd8c511f460.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_86a2651e12efcd8fd8c56dd8c511f460.jpg saved to cache
2026-03-30 10:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0871e266-bd70-57a8-84e2-b4086eb046ae
2026-03-30 10:32:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a4910>
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_f118a0b4b2853084d2cb82226d5a43ee.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_f118a0b4b2853084d2cb82226d5a43ee.jpg saved to cache
2026-03-30 10:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 100d9089-f86b-574e-b3e9-2e594d2fa01f
2026-03-30 10:32:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419db10>
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_25495eb3c03bac82f2c8a816e5a7d1b7.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_25495eb3c03bac82f2c8a816e5a7d1b7.jpg saved to cache
2026-03-30 10:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 100d9089-f86b-574e-b3e9-2e594d2fa01f
2026-03-30 10:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_db2d087649e0cae84e828b9568662884.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_84ffd761730fbcfd47d7cd9d2d83c987.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_372b505d29c60a6a397288784db9b02b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_4204b87849b97732c8342f660f5e566f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_594683ef24da83152923b0d11ec07340.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a6250>
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_db2d087649e0cae84e828b9568662884.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_db2d087649e0cae84e828b9568662884.jpg saved to cache
2026-03-30 10:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 100d9089-f86b-574e-b3e9-2e594d2fa01f
2026-03-30 10:32:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef74f10>
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_84ffd761730fbcfd47d7cd9d2d83c987.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_84ffd761730fbcfd47d7cd9d2d83c987.jpg saved to cache
2026-03-30 10:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 100d9089-f86b-574e-b3e9-2e594d2fa01f
2026-03-30 10:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4388b10>
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_372b505d29c60a6a397288784db9b02b.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_372b505d29c60a6a397288784db9b02b.jpg saved to cache
2026-03-30 10:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 100d9089-f86b-574e-b3e9-2e594d2fa01f
2026-03-30 10:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef19250>
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_4204b87849b97732c8342f660f5e566f.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_4204b87849b97732c8342f660f5e566f.jpg saved to cache
2026-03-30 10:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 100d9089-f86b-574e-b3e9-2e594d2fa01f
2026-03-30 10:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef19f90>
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_594683ef24da83152923b0d11ec07340.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_594683ef24da83152923b0d11ec07340.jpg saved to cache
2026-03-30 10:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0871e266-bd70-57a8-84e2-b4086eb046ae
2026-03-30 10:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH27268/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:32:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_55c721f39ef5e0ac8e3c6b211c465248.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_6e5901ad649846cc2c7b48aad5f24cd8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_6a5f03b2428fc33d5dec6586052361ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_6e1943026e612556aade70f788f8e7b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_23f99e1a5b8175dd0ad0069c1f131076.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4255690>
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_55c721f39ef5e0ac8e3c6b211c465248.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_55c721f39ef5e0ac8e3c6b211c465248.jpg saved to cache
2026-03-30 10:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0871e266-bd70-57a8-84e2-b4086eb046ae
2026-03-30 10:32:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefa7f10>
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_6e5901ad649846cc2c7b48aad5f24cd8.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_6e5901ad649846cc2c7b48aad5f24cd8.jpg saved to cache
2026-03-30 10:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 100d9089-f86b-574e-b3e9-2e594d2fa01f
2026-03-30 10:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4292d10>
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_6a5f03b2428fc33d5dec6586052361ba.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_6a5f03b2428fc33d5dec6586052361ba.jpg saved to cache
2026-03-30 10:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 100d9089-f86b-574e-b3e9-2e594d2fa01f
2026-03-30 10:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f591eed0>
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_6e1943026e612556aade70f788f8e7b0.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_6e1943026e612556aade70f788f8e7b0.jpg saved to cache
2026-03-30 10:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0871e266-bd70-57a8-84e2-b4086eb046ae
2026-03-30 10:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428be50>
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_23f99e1a5b8175dd0ad0069c1f131076.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_23f99e1a5b8175dd0ad0069c1f131076.jpg saved to cache
2026-03-30 10:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0871e266-bd70-57a8-84e2-b4086eb046ae
2026-03-30 10:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_7f27a0d148c1c0d608fae291162d5ed6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_59dfe753de98dc8368dfc784b6274153.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_fe4a7e264472a9c69eabdb703076b988.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WH35124/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:32:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_f0f20f43f13d38851550e0736e974f4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414b090>
2026-03-30 10:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_7f27a0d148c1c0d608fae291162d5ed6.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_7f27a0d148c1c0d608fae291162d5ed6.jpg saved to cache
2026-03-30 10:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 100d9089-f86b-574e-b3e9-2e594d2fa01f
2026-03-30 10:32:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef45c10>
2026-03-30 10:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_59dfe753de98dc8368dfc784b6274153.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_59dfe753de98dc8368dfc784b6274153.jpg saved to cache
2026-03-30 10:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0871e266-bd70-57a8-84e2-b4086eb046ae
2026-03-30 10:32:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4388c50>
2026-03-30 10:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F09%252F1f092c55fb74e45806bd1e78c5f877c6%252Fpa%252FKK63455_fe4a7e264472a9c69eabdb703076b988.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_fe4a7e264472a9c69eabdb703076b988.jpg saved to cache
2026-03-30 10:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 100d9089-f86b-574e-b3e9-2e594d2fa01f
2026-03-30 10:32:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 100d9089-f86b-574e-b3e9-2e594d2fa01f, skipping ID generation
2026-03-30 10:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 100d9089-f86b-574e-b3e9-2e594d2fa01f with scrape type 1
2026-03-30 10:32:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 100d9089-f86b-574e-b3e9-2e594d2fa01f sending to next pipeline
2026-03-30 10:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 100d9089-f86b-574e-b3e9-2e594d2fa01f, identifier: KK63455
2026-03-30 10:32:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4228550>
2026-03-30 10:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_f0f20f43f13d38851550e0736e974f4e.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_f0f20f43f13d38851550e0736e974f4e.jpg saved to cache
2026-03-30 10:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0871e266-bd70-57a8-84e2-b4086eb046ae
2026-03-30 10:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 100d9089-f86b-574e-b3e9-2e594d2fa01f with identifier: KK63455
2026-03-30 10:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 100d9089-f86b-574e-b3e9-2e594d2fa01f with identifier: KK63455
2026-03-30 10:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 100d9089-f86b-574e-b3e9-2e594d2fa01f with identifier: KK63455 to the API
2026-03-30 10:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_fe4a7e264472a9c69eabdb703076b988.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:48:28Z',
 'fuel_type': 'diesel',
 'id': '100d9089-f86b-574e-b3e9-2e594d2fa01f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK63455',
 'listing': 'auction',
 'location': 'DE, Paderborn',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 277621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2493353,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_7f27a0d148c1c0d608fae291162d5ed6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2355051,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_fe4a7e264472a9c69eabdb703076b988.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2072069,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_6a5f03b2428fc33d5dec6586052361ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2123708,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_6e5901ad649846cc2c7b48aad5f24cd8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2255360,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_4204b87849b97732c8342f660f5e566f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2298254,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_372b505d29c60a6a397288784db9b02b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2076634,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_db2d087649e0cae84e828b9568662884.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2325775,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_25495eb3c03bac82f2c8a816e5a7d1b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2471994,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_f118a0b4b2853084d2cb82226d5a43ee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100d9089-f86b-574e-b3e9-2e594d2fa01f/100d9089-f86b-574e-b3e9-2e594d2fa01f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2455469,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/09/1f092c55fb74e45806bd1e78c5f877c6/pa/KK63455_84ffd761730fbcfd47d7cd9d2d83c987.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-09-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI GTD',
 'transmission': 'automatic',
 'trim': 'GTD',
 'year': 2012}
2026-03-30 10:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK63455%27 HTTP/1.1" 200 None
2026-03-30 10:32:53 [auto1.de] INFO: Saving data for KK63455: {'created_time': 1774866773.379098, 'last_price_update_time': 1774866773.379109, 'auction_closing_time': 1774972108.0}
2026-03-30 10:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK63455') HTTP/1.1" 204 0
2026-03-30 10:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_f7a5e6671f03ef20edbd2a969a954ace.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_a4ee8e21d6f02cb0c459231b568a4526.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_2c60c45d1949006641661719b352ebe4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_5c5bcc1d00b521b60b2686b86c1d3722.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_0f3d5fa17d9bfd098b1bf8e8c48a41f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_21f47e16fb076651d04885124037e030.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42b7d90>
2026-03-30 10:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F36%252F563685967f1d64fdc60a450ba6d0d68d%252Fpa%252FCJ96583_f7a5e6671f03ef20edbd2a969a954ace.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_f7a5e6671f03ef20edbd2a969a954ace.jpg saved to cache
2026-03-30 10:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0871e266-bd70-57a8-84e2-b4086eb046ae
2026-03-30 10:32:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0871e266-bd70-57a8-84e2-b4086eb046ae, skipping ID generation
2026-03-30 10:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0871e266-bd70-57a8-84e2-b4086eb046ae with scrape type 1
2026-03-30 10:32:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0871e266-bd70-57a8-84e2-b4086eb046ae sending to next pipeline
2026-03-30 10:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0871e266-bd70-57a8-84e2-b4086eb046ae, identifier: CJ96583
2026-03-30 10:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0871e266-bd70-57a8-84e2-b4086eb046ae with identifier: CJ96583
2026-03-30 10:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0871e266-bd70-57a8-84e2-b4086eb046ae with identifier: CJ96583
2026-03-30 10:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0871e266-bd70-57a8-84e2-b4086eb046ae with identifier: CJ96583 to the API
2026-03-30 10:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_f7a5e6671f03ef20edbd2a969a954ace.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 132,
 'expiration_date': '2026-03-31T15:26:38Z',
 'fuel_type': 'petrol',
 'id': '0871e266-bd70-57a8-84e2-b4086eb046ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ96583',
 'listing': 'auction',
 'location': 'DE, Hagen',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 97123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2398567,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_52d4b2d51e759df6a7d6c123db8d426b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2516080,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_86a2651e12efcd8fd8c56dd8c511f460.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2224117,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_f0f20f43f13d38851550e0736e974f4e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2260000,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_efa8f61d43ce24277a3d28e083f6e5d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2210701,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_f7a5e6671f03ef20edbd2a969a954ace.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1998176,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_59dfe753de98dc8368dfc784b6274153.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1948199,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_6e1943026e612556aade70f788f8e7b0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2104071,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_55c721f39ef5e0ac8e3c6b211c465248.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2361125,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_23f99e1a5b8175dd0ad0069c1f131076.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0871e266-bd70-57a8-84e2-b4086eb046ae/0871e266-bd70-57a8-84e2-b4086eb046ae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2199366,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/36/563685967f1d64fdc60a450ba6d0d68d/pa/CJ96583_594683ef24da83152923b0d11ec07340.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Dream Team 2WD',
 'transmission': 'manual',
 'trim': 'Dream Team 2WD',
 'year': 2017}
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ96583%27 HTTP/1.1" 200 None
2026-03-30 10:32:54 [auto1.de] INFO: Saving data for CJ96583: {'created_time': 1774866774.067487, 'last_price_update_time': 1774866774.067498, 'auction_closing_time': 1774970798.0}
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ96583') HTTP/1.1" 204 0
2026-03-30 10:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_ba2bc7ce14ce0456be317fd785cdadc2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef85950>
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_a4ee8e21d6f02cb0c459231b568a4526.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_a4ee8e21d6f02cb0c459231b568a4526.jpg saved to cache
2026-03-30 10:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8913a16-c02d-5382-b94c-d53f045f56b8
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41ebfd0>
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_2c60c45d1949006641661719b352ebe4.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_2c60c45d1949006641661719b352ebe4.jpg saved to cache
2026-03-30 10:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8913a16-c02d-5382-b94c-d53f045f56b8
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd5410>
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_5c5bcc1d00b521b60b2686b86c1d3722.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_5c5bcc1d00b521b60b2686b86c1d3722.jpg saved to cache
2026-03-30 10:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8913a16-c02d-5382-b94c-d53f045f56b8
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41995d0>
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_0f3d5fa17d9bfd098b1bf8e8c48a41f5.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_0f3d5fa17d9bfd098b1bf8e8c48a41f5.jpg saved to cache
2026-03-30 10:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8913a16-c02d-5382-b94c-d53f045f56b8
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef85fd0>
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_21f47e16fb076651d04885124037e030.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_21f47e16fb076651d04885124037e030.jpg saved to cache
2026-03-30 10:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8913a16-c02d-5382-b94c-d53f045f56b8
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefde5d0>
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F6f%252F8b6fee11f6e237903a283a25fe78d459%252Fpa%252FVU63296_ba2bc7ce14ce0456be317fd785cdadc2.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_ba2bc7ce14ce0456be317fd785cdadc2.jpg saved to cache
2026-03-30 10:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8913a16-c02d-5382-b94c-d53f045f56b8
2026-03-30 10:32:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8913a16-c02d-5382-b94c-d53f045f56b8, skipping ID generation
2026-03-30 10:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8913a16-c02d-5382-b94c-d53f045f56b8 with scrape type 1
2026-03-30 10:32:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8913a16-c02d-5382-b94c-d53f045f56b8 sending to next pipeline
2026-03-30 10:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8913a16-c02d-5382-b94c-d53f045f56b8, identifier: VU63296
2026-03-30 10:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8913a16-c02d-5382-b94c-d53f045f56b8 with identifier: VU63296
2026-03-30 10:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8913a16-c02d-5382-b94c-d53f045f56b8 with identifier: VU63296
2026-03-30 10:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8913a16-c02d-5382-b94c-d53f045f56b8 with identifier: VU63296 to the API
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_ba2bc7ce14ce0456be317fd785cdadc2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:54:59Z',
 'fuel_type': 'petrol',
 'id': 'c8913a16-c02d-5382-b94c-d53f045f56b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU63296',
 'listing': 'auction',
 'location': 'DE, Rosenheim',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 94877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_21f47e16fb076651d04885124037e030.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_0f3d5fa17d9bfd098b1bf8e8c48a41f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_ba2bc7ce14ce0456be317fd785cdadc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_a4ee8e21d6f02cb0c459231b568a4526.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_2c60c45d1949006641661719b352ebe4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_5c5bcc1d00b521b60b2686b86c1d3722.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_2fc19e10e96eb33e85018342571d84ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_a2704fcf4771e1031f2e37f367e9ebdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_77cd5e4f87316240fc3865a6280d50e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8913a16-c02d-5382-b94c-d53f045f56b8/c8913a16-c02d-5382-b94c-d53f045f56b8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/6f/8b6fee11f6e237903a283a25fe78d459/pa/VU63296_3da0bedc7be409adf90e1c1619f0eabe.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2018}
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU63296%27 HTTP/1.1" 200 None
2026-03-30 10:32:54 [auto1.de] INFO: Saving data for VU63296: {'created_time': 1774866774.972959, 'last_price_update_time': 1774866774.97297, 'auction_closing_time': 1774972499.0}
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU63296') HTTP/1.1" 204 0
2026-03-30 10:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV15875/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:32:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_4b6adc60e2a8a2295ad4b57d8e7879ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_5381d3a9e58882a9ab9d6415b6c75e8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_b728aaa564d923fee6429bb8a7facd5c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428e610>
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_4b6adc60e2a8a2295ad4b57d8e7879ac.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_4b6adc60e2a8a2295ad4b57d8e7879ac.jpg saved to cache
2026-03-30 10:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ced91f3-8819-5ad6-a7bb-126d680b7af2
2026-03-30 10:32:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41e8650>
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_5381d3a9e58882a9ab9d6415b6c75e8b.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_5381d3a9e58882a9ab9d6415b6c75e8b.jpg saved to cache
2026-03-30 10:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ced91f3-8819-5ad6-a7bb-126d680b7af2
2026-03-30 10:32:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f433a290>
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_b728aaa564d923fee6429bb8a7facd5c.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_b728aaa564d923fee6429bb8a7facd5c.jpg saved to cache
2026-03-30 10:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ced91f3-8819-5ad6-a7bb-126d680b7af2
2026-03-30 10:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_d198efa1ab3f5e6923f96e1771d2bc45.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_5ac5e2764f585934c4e10f0930430e29.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef1be90>
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_d198efa1ab3f5e6923f96e1771d2bc45.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_d198efa1ab3f5e6923f96e1771d2bc45.jpg saved to cache
2026-03-30 10:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ced91f3-8819-5ad6-a7bb-126d680b7af2
2026-03-30 10:32:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4300090>
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_5ac5e2764f585934c4e10f0930430e29.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_5ac5e2764f585934c4e10f0930430e29.jpg saved to cache
2026-03-30 10:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ced91f3-8819-5ad6-a7bb-126d680b7af2
2026-03-30 10:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_9ccca7a8ff6e6a5eec2969b8ecb5b760.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_b60c4c424bcd8ac7bf38ef3cac982d2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_db8f306a11ec13fb8c33156e8b64867e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4220710>
2026-03-30 10:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_9ccca7a8ff6e6a5eec2969b8ecb5b760.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_9ccca7a8ff6e6a5eec2969b8ecb5b760.jpg saved to cache
2026-03-30 10:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ced91f3-8819-5ad6-a7bb-126d680b7af2
2026-03-30 10:32:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8fb90>
2026-03-30 10:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_b60c4c424bcd8ac7bf38ef3cac982d2f.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_b60c4c424bcd8ac7bf38ef3cac982d2f.jpg saved to cache
2026-03-30 10:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ced91f3-8819-5ad6-a7bb-126d680b7af2
2026-03-30 10:32:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419fd50>
2026-03-30 10:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_db8f306a11ec13fb8c33156e8b64867e.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_db8f306a11ec13fb8c33156e8b64867e.jpg saved to cache
2026-03-30 10:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ced91f3-8819-5ad6-a7bb-126d680b7af2
2026-03-30 10:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_77088786b8849cdcf4e29bd2605e20b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:32:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4378e10>
2026-03-30 10:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fb6%252Ff8b6338cc5717dc6bea8416c71406615%252Fpa%252FGL90573_77088786b8849cdcf4e29bd2605e20b4.jpg') HTTP/1.1" 204 0
2026-03-30 10:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_77088786b8849cdcf4e29bd2605e20b4.jpg saved to cache
2026-03-30 10:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ced91f3-8819-5ad6-a7bb-126d680b7af2
2026-03-30 10:32:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ced91f3-8819-5ad6-a7bb-126d680b7af2, skipping ID generation
2026-03-30 10:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ced91f3-8819-5ad6-a7bb-126d680b7af2 with scrape type 1
2026-03-30 10:32:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ced91f3-8819-5ad6-a7bb-126d680b7af2 sending to next pipeline
2026-03-30 10:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ced91f3-8819-5ad6-a7bb-126d680b7af2, identifier: GL90573
2026-03-30 10:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ced91f3-8819-5ad6-a7bb-126d680b7af2 with identifier: GL90573
2026-03-30 10:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ced91f3-8819-5ad6-a7bb-126d680b7af2 with identifier: GL90573
2026-03-30 10:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ced91f3-8819-5ad6-a7bb-126d680b7af2 with identifier: GL90573 to the API
2026-03-30 10:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_77088786b8849cdcf4e29bd2605e20b4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 196,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:17:03Z',
 'fuel_type': 'diesel',
 'id': '4ced91f3-8819-5ad6-a7bb-126d680b7af2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL90573',
 'listing': 'auction',
 'location': 'DE, Euskirchen',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 329691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2610445,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_77088786b8849cdcf4e29bd2605e20b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2573950,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_db8f306a11ec13fb8c33156e8b64867e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2731424,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_b60c4c424bcd8ac7bf38ef3cac982d2f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2525408,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_9ccca7a8ff6e6a5eec2969b8ecb5b760.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3047703,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_d198efa1ab3f5e6923f96e1771d2bc45.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2748515,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_5ac5e2764f585934c4e10f0930430e29.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2577329,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_b728aaa564d923fee6429bb8a7facd5c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2495990,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_4b6adc60e2a8a2295ad4b57d8e7879ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2646864,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_5381d3a9e58882a9ab9d6415b6c75e8b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ced91f3-8819-5ad6-a7bb-126d680b7af2/4ced91f3-8819-5ad6-a7bb-126d680b7af2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2959908,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/b6/f8b6338cc5717dc6bea8416c71406615/pa/GL90573_7bd672c237460d5f40df7089dfa3acd4.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 30d',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 10:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL90573%27 HTTP/1.1" 200 None
2026-03-30 10:32:57 [auto1.de] INFO: Saving data for GL90573: {'created_time': 1774866777.213396, 'last_price_update_time': 1774866777.213407, 'auction_closing_time': 1774970223.0}
2026-03-30 10:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL90573') HTTP/1.1" 204 0
2026-03-30 10:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY19910> (referer: https://www.auto1.com/v1/car-details-view/RY19910/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:32:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45d16ebc-fbed-5de9-94b7-19e911931bc6 with identifier: RY19910
2026-03-30 10:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45d16ebc-fbed-5de9-94b7-19e911931bc6 with scrape type 1
2026-03-30 10:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 45d16ebc-fbed-5de9-94b7-19e911931bc6
2026-03-30 10:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F5a%252F455afd2f901fcb601b2b9b6e6e78a6ce%252Fpa%252FRY19910_8b15d677b4c029df83078a4aa5dd6e33.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_8b15d677b4c029df83078a4aa5dd6e33.jpg not downloaded yet
2026-03-30 10:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F5a%252F455afd2f901fcb601b2b9b6e6e78a6ce%252Fpa%252FRY19910_ee76b9dcff30f898e93eccb5fbb666b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_ee76b9dcff30f898e93eccb5fbb666b3.jpg not downloaded yet
2026-03-30 10:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F5a%252F455afd2f901fcb601b2b9b6e6e78a6ce%252Fpa%252FRY19910_7ade3c67ed29f0e5850b31121dc7ae59.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_7ade3c67ed29f0e5850b31121dc7ae59.jpg not downloaded yet
2026-03-30 10:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F5a%252F455afd2f901fcb601b2b9b6e6e78a6ce%252Fpa%252FRY19910_d9b8e894d2b42eca7313fe0ee0a03c80.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_d9b8e894d2b42eca7313fe0ee0a03c80.jpg not downloaded yet
2026-03-30 10:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F5a%252F455afd2f901fcb601b2b9b6e6e78a6ce%252Fpa%252FRY19910_9a87054fa563d150f25679087c069b20.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_9a87054fa563d150f25679087c069b20.jpg not downloaded yet
2026-03-30 10:33:04 [scrapy.extensions.logstats] INFO: Crawled 39 pages (at 17 pages/min), scraped 30 items (at 13 items/min)
2026-03-30 10:33:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 10:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HC77089> (referer: https://www.auto1.com/v1/car-details-view/HC77089/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:33:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_9a87054fa563d150f25679087c069b20.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fe0a349-8197-50a3-a4c4-fde713162651 with identifier: HC77089
2026-03-30 10:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fe0a349-8197-50a3-a4c4-fde713162651 with scrape type 1
2026-03-30 10:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6fe0a349-8197-50a3-a4c4-fde713162651
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_3fa38719604a525e3ff807e406303ef4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_3fa38719604a525e3ff807e406303ef4.jpg not downloaded yet
2026-03-30 10:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_d9b8e894d2b42eca7313fe0ee0a03c80.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_3266578cd7c923ea97f1430611684e02.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_3266578cd7c923ea97f1430611684e02.jpg not downloaded yet
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_94213c206355bf2588e0819d128729ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_94213c206355bf2588e0819d128729ed.jpg not downloaded yet
2026-03-30 10:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a7850>
2026-03-30 10:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45d16ebc-fbed-5de9-94b7-19e911931bc6/45d16ebc-fbed-5de9-94b7-19e911931bc6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F5a%252F455afd2f901fcb601b2b9b6e6e78a6ce%252Fpa%252FRY19910_9a87054fa563d150f25679087c069b20.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_9a87054fa563d150f25679087c069b20.jpg saved to cache
2026-03-30 10:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45d16ebc-fbed-5de9-94b7-19e911931bc6
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_d1011ef51a3d0501bf2bebe04974c243.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_d1011ef51a3d0501bf2bebe04974c243.jpg not downloaded yet
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_4ca8e4fea3b22bf4b179b7e43da4e7e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_4ca8e4fea3b22bf4b179b7e43da4e7e2.jpg not downloaded yet
2026-03-30 10:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_3fa38719604a525e3ff807e406303ef4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_1fe46bbdb47d8f25f6fa5aa8204b36b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_1fe46bbdb47d8f25f6fa5aa8204b36b6.jpg not downloaded yet
2026-03-30 10:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3a010>
2026-03-30 10:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45d16ebc-fbed-5de9-94b7-19e911931bc6/45d16ebc-fbed-5de9-94b7-19e911931bc6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F5a%252F455afd2f901fcb601b2b9b6e6e78a6ce%252Fpa%252FRY19910_d9b8e894d2b42eca7313fe0ee0a03c80.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_d9b8e894d2b42eca7313fe0ee0a03c80.jpg saved to cache
2026-03-30 10:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45d16ebc-fbed-5de9-94b7-19e911931bc6
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_320310cc5b970a349ad7311b8af8fbfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_320310cc5b970a349ad7311b8af8fbfa.jpg not downloaded yet
2026-03-30 10:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5958650>
2026-03-30 10:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_3fa38719604a525e3ff807e406303ef4.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_3fa38719604a525e3ff807e406303ef4.jpg saved to cache
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6fe0a349-8197-50a3-a4c4-fde713162651
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_c479c0c79783e7dfb925b36b5f5597ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_c479c0c79783e7dfb925b36b5f5597ff.jpg not downloaded yet
2026-03-30 10:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_4ca8e4fea3b22bf4b179b7e43da4e7e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_9ac5d915208ac154a6a5a2139879a228.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_9ac5d915208ac154a6a5a2139879a228.jpg not downloaded yet
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_19507db955c40a380ff2ab3ba4d11d35.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_19507db955c40a380ff2ab3ba4d11d35.jpg not downloaded yet
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4327a50>
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_4ca8e4fea3b22bf4b179b7e43da4e7e2.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_4ca8e4fea3b22bf4b179b7e43da4e7e2.jpg saved to cache
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6fe0a349-8197-50a3-a4c4-fde713162651
2026-03-30 10:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_c479c0c79783e7dfb925b36b5f5597ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3c850>
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_c479c0c79783e7dfb925b36b5f5597ff.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_c479c0c79783e7dfb925b36b5f5597ff.jpg saved to cache
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6fe0a349-8197-50a3-a4c4-fde713162651
2026-03-30 10:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH55820/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:33:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_9ac5d915208ac154a6a5a2139879a228.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_19507db955c40a380ff2ab3ba4d11d35.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_320310cc5b970a349ad7311b8af8fbfa.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_1fe46bbdb47d8f25f6fa5aa8204b36b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f413b910>
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_9ac5d915208ac154a6a5a2139879a228.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_9ac5d915208ac154a6a5a2139879a228.jpg saved to cache
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6fe0a349-8197-50a3-a4c4-fde713162651
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a5690>
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_19507db955c40a380ff2ab3ba4d11d35.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_19507db955c40a380ff2ab3ba4d11d35.jpg saved to cache
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6fe0a349-8197-50a3-a4c4-fde713162651
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4164410>
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_320310cc5b970a349ad7311b8af8fbfa.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_320310cc5b970a349ad7311b8af8fbfa.jpg saved to cache
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6fe0a349-8197-50a3-a4c4-fde713162651
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef37290>
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_1fe46bbdb47d8f25f6fa5aa8204b36b6.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_1fe46bbdb47d8f25f6fa5aa8204b36b6.jpg saved to cache
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6fe0a349-8197-50a3-a4c4-fde713162651
2026-03-30 10:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MV22055> (referer: https://www.auto1.com/v1/car-details-view/MV22055/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:33:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_d1011ef51a3d0501bf2bebe04974c243.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_94213c206355bf2588e0819d128729ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07d73fe8-9a82-5c97-a746-cb642e24c5c4 with identifier: MV22055
2026-03-30 10:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07d73fe8-9a82-5c97-a746-cb642e24c5c4 with scrape type 1
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 07d73fe8-9a82-5c97-a746-cb642e24c5c4
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd6%252Febd60e177ef8b12a86e1096afa08284b%252Fpa%252FMV22055_781a4fbeea997eb10bc1c1be6174edd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_781a4fbeea997eb10bc1c1be6174edd3.jpg already downloaded
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd6%252Febd60e177ef8b12a86e1096afa08284b%252Fpa%252FMV22055_c9bbff075238c7a3b3b8a16a7ee2d4cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_c9bbff075238c7a3b3b8a16a7ee2d4cf.jpg already downloaded
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd6%252Febd60e177ef8b12a86e1096afa08284b%252Fpa%252FMV22055_506838768d38f7f0f0cd2c4f0e04a373.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_506838768d38f7f0f0cd2c4f0e04a373.jpg already downloaded
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd6%252Febd60e177ef8b12a86e1096afa08284b%252Fpa%252FMV22055_28b99c73e838e70eed8ecd6bdcfec686.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_28b99c73e838e70eed8ecd6bdcfec686.jpg already downloaded
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd6%252Febd60e177ef8b12a86e1096afa08284b%252Fpa%252FMV22055_456ddf3b8c1854fa64d56fc87be69c94.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_456ddf3b8c1854fa64d56fc87be69c94.jpg already downloaded
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd6%252Febd60e177ef8b12a86e1096afa08284b%252Fpa%252FMV22055_aabd429fc387d16032ebc6af6cb8a7b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_aabd429fc387d16032ebc6af6cb8a7b4.jpg already downloaded
2026-03-30 10:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd6%252Febd60e177ef8b12a86e1096afa08284b%252Fpa%252FMV22055_ef3bd7aaa52914937cb251f1b4f2953a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_ef3bd7aaa52914937cb251f1b4f2953a.jpg already downloaded
2026-03-30 10:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd6%252Febd60e177ef8b12a86e1096afa08284b%252Fpa%252FMV22055_dec79be365c5fcc800e85e1e61431758.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_dec79be365c5fcc800e85e1e61431758.jpg already downloaded
2026-03-30 10:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd6%252Febd60e177ef8b12a86e1096afa08284b%252Fpa%252FMV22055_b14b6c744f62b0253be498f226331eb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_b14b6c744f62b0253be498f226331eb9.jpg already downloaded
2026-03-30 10:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd6%252Febd60e177ef8b12a86e1096afa08284b%252Fpa%252FMV22055_4f9ebf26fbbd8842a478dbda6c87fdab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_4f9ebf26fbbd8842a478dbda6c87fdab.jpg already downloaded
2026-03-30 10:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07d73fe8-9a82-5c97-a746-cb642e24c5c4, identifier: MV22055
2026-03-30 10:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07d73fe8-9a82-5c97-a746-cb642e24c5c4 with identifier: MV22055
2026-03-30 10:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07d73fe8-9a82-5c97-a746-cb642e24c5c4 with identifier: MV22055
2026-03-30 10:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07d73fe8-9a82-5c97-a746-cb642e24c5c4 with identifier: MV22055 to the API
2026-03-30 10:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MV22055>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:34:21Z',
 'fuel_type': 'diesel',
 'id': '07d73fe8-9a82-5c97-a746-cb642e24c5c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV22055',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 201838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_781a4fbeea997eb10bc1c1be6174edd3.jpg',
                'https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_c9bbff075238c7a3b3b8a16a7ee2d4cf.jpg',
                'https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_506838768d38f7f0f0cd2c4f0e04a373.jpg',
                'https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_28b99c73e838e70eed8ecd6bdcfec686.jpg',
                'https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_456ddf3b8c1854fa64d56fc87be69c94.jpg',
                'https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_aabd429fc387d16032ebc6af6cb8a7b4.jpg',
                'https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_ef3bd7aaa52914937cb251f1b4f2953a.jpg',
                'https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_dec79be365c5fcc800e85e1e61431758.jpg',
                'https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_b14b6c744f62b0253be498f226331eb9.jpg',
                'https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_4f9ebf26fbbd8842a478dbda6c87fdab.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d73fe8-9a82-5c97-a746-cb642e24c5c4/07d73fe8-9a82-5c97-a746-cb642e24c5c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_781a4fbeea997eb10bc1c1be6174edd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d73fe8-9a82-5c97-a746-cb642e24c5c4/07d73fe8-9a82-5c97-a746-cb642e24c5c4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_c9bbff075238c7a3b3b8a16a7ee2d4cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d73fe8-9a82-5c97-a746-cb642e24c5c4/07d73fe8-9a82-5c97-a746-cb642e24c5c4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_506838768d38f7f0f0cd2c4f0e04a373.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d73fe8-9a82-5c97-a746-cb642e24c5c4/07d73fe8-9a82-5c97-a746-cb642e24c5c4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_28b99c73e838e70eed8ecd6bdcfec686.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d73fe8-9a82-5c97-a746-cb642e24c5c4/07d73fe8-9a82-5c97-a746-cb642e24c5c4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_456ddf3b8c1854fa64d56fc87be69c94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d73fe8-9a82-5c97-a746-cb642e24c5c4/07d73fe8-9a82-5c97-a746-cb642e24c5c4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_aabd429fc387d16032ebc6af6cb8a7b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d73fe8-9a82-5c97-a746-cb642e24c5c4/07d73fe8-9a82-5c97-a746-cb642e24c5c4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_ef3bd7aaa52914937cb251f1b4f2953a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d73fe8-9a82-5c97-a746-cb642e24c5c4/07d73fe8-9a82-5c97-a746-cb642e24c5c4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_dec79be365c5fcc800e85e1e61431758.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d73fe8-9a82-5c97-a746-cb642e24c5c4/07d73fe8-9a82-5c97-a746-cb642e24c5c4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_b14b6c744f62b0253be498f226331eb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d73fe8-9a82-5c97-a746-cb642e24c5c4/07d73fe8-9a82-5c97-a746-cb642e24c5c4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d6/ebd60e177ef8b12a86e1096afa08284b/pa/MV22055_4f9ebf26fbbd8842a478dbda6c87fdab.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV22055%27 HTTP/1.1" 200 None
2026-03-30 10:33:16 [auto1.de] INFO: Saving data for MV22055: {'created_time': 1774866796.068763, 'last_price_update_time': 1774866796.068773, 'auction_closing_time': 1774971261.0}
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV22055') HTTP/1.1" 204 0
2026-03-30 10:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_7ade3c67ed29f0e5850b31121dc7ae59.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_3266578cd7c923ea97f1430611684e02.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41dbb90>
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_d1011ef51a3d0501bf2bebe04974c243.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_d1011ef51a3d0501bf2bebe04974c243.jpg saved to cache
2026-03-30 10:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6fe0a349-8197-50a3-a4c4-fde713162651
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417cf50>
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_94213c206355bf2588e0819d128729ed.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_94213c206355bf2588e0819d128729ed.jpg saved to cache
2026-03-30 10:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6fe0a349-8197-50a3-a4c4-fde713162651
2026-03-30 10:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_ee76b9dcff30f898e93eccb5fbb666b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4339cd0>
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45d16ebc-fbed-5de9-94b7-19e911931bc6/45d16ebc-fbed-5de9-94b7-19e911931bc6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F5a%252F455afd2f901fcb601b2b9b6e6e78a6ce%252Fpa%252FRY19910_7ade3c67ed29f0e5850b31121dc7ae59.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_7ade3c67ed29f0e5850b31121dc7ae59.jpg saved to cache
2026-03-30 10:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45d16ebc-fbed-5de9-94b7-19e911931bc6
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4809190>
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9e%252Fdc9e834c86561ff8dcebf16f458747bb%252Fpa%252FHC77089_3266578cd7c923ea97f1430611684e02.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_3266578cd7c923ea97f1430611684e02.jpg saved to cache
2026-03-30 10:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6fe0a349-8197-50a3-a4c4-fde713162651
2026-03-30 10:33:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6fe0a349-8197-50a3-a4c4-fde713162651, skipping ID generation
2026-03-30 10:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fe0a349-8197-50a3-a4c4-fde713162651 with scrape type 1
2026-03-30 10:33:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6fe0a349-8197-50a3-a4c4-fde713162651 sending to next pipeline
2026-03-30 10:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fe0a349-8197-50a3-a4c4-fde713162651, identifier: HC77089
2026-03-30 10:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fe0a349-8197-50a3-a4c4-fde713162651 with identifier: HC77089
2026-03-30 10:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fe0a349-8197-50a3-a4c4-fde713162651 with identifier: HC77089
2026-03-30 10:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fe0a349-8197-50a3-a4c4-fde713162651 with identifier: HC77089 to the API
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_3266578cd7c923ea97f1430611684e02.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 213,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '3.6L',
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:10:46Z',
 'fuel_type': 'petrol',
 'id': '6fe0a349-8197-50a3-a4c4-fde713162651',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC77089',
 'listing': 'auction',
 'location': 'DE, Hanau',
 'make': 'Volkswagen',
 'model': 'CC',
 'odometer': 110699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_3fa38719604a525e3ff807e406303ef4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_3266578cd7c923ea97f1430611684e02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_94213c206355bf2588e0819d128729ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_d1011ef51a3d0501bf2bebe04974c243.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_4ca8e4fea3b22bf4b179b7e43da4e7e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_1fe46bbdb47d8f25f6fa5aa8204b36b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_320310cc5b970a349ad7311b8af8fbfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_c479c0c79783e7dfb925b36b5f5597ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_9ac5d915208ac154a6a5a2139879a228.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe0a349-8197-50a3-a4c4-fde713162651/6fe0a349-8197-50a3-a4c4-fde713162651_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9e/dc9e834c86561ff8dcebf16f458747bb/pa/HC77089_19507db955c40a380ff2ab3ba4d11d35.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-09-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen CC 3.6 V6 FSI 4Motion',
 'transmission': 'automatic',
 'trim': '4Motion',
 'year': 2012}
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC77089%27 HTTP/1.1" 200 None
2026-03-30 10:33:16 [auto1.de] INFO: Saving data for HC77089: {'created_time': 1774866796.773694, 'last_price_update_time': 1774866796.773705, 'auction_closing_time': 1774969846.0}
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC77089') HTTP/1.1" 204 0
2026-03-30 10:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_8b15d677b4c029df83078a4aa5dd6e33.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef1a090>
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45d16ebc-fbed-5de9-94b7-19e911931bc6/45d16ebc-fbed-5de9-94b7-19e911931bc6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F5a%252F455afd2f901fcb601b2b9b6e6e78a6ce%252Fpa%252FRY19910_ee76b9dcff30f898e93eccb5fbb666b3.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_ee76b9dcff30f898e93eccb5fbb666b3.jpg saved to cache
2026-03-30 10:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45d16ebc-fbed-5de9-94b7-19e911931bc6
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c0ae90>
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45d16ebc-fbed-5de9-94b7-19e911931bc6/45d16ebc-fbed-5de9-94b7-19e911931bc6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F5a%252F455afd2f901fcb601b2b9b6e6e78a6ce%252Fpa%252FRY19910_8b15d677b4c029df83078a4aa5dd6e33.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_8b15d677b4c029df83078a4aa5dd6e33.jpg saved to cache
2026-03-30 10:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45d16ebc-fbed-5de9-94b7-19e911931bc6
2026-03-30 10:33:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45d16ebc-fbed-5de9-94b7-19e911931bc6, skipping ID generation
2026-03-30 10:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45d16ebc-fbed-5de9-94b7-19e911931bc6 with scrape type 1
2026-03-30 10:33:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45d16ebc-fbed-5de9-94b7-19e911931bc6 sending to next pipeline
2026-03-30 10:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45d16ebc-fbed-5de9-94b7-19e911931bc6, identifier: RY19910
2026-03-30 10:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45d16ebc-fbed-5de9-94b7-19e911931bc6 with identifier: RY19910
2026-03-30 10:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45d16ebc-fbed-5de9-94b7-19e911931bc6 with identifier: RY19910
2026-03-30 10:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45d16ebc-fbed-5de9-94b7-19e911931bc6 with identifier: RY19910 to the API
2026-03-30 10:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_8b15d677b4c029df83078a4aa5dd6e33.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 252,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.6L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:05:16Z',
 'fuel_type': 'petrol',
 'id': '45d16ebc-fbed-5de9-94b7-19e911931bc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY19910',
 'listing': 'auction',
 'location': 'DE, Reinbek',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 206680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45d16ebc-fbed-5de9-94b7-19e911931bc6/45d16ebc-fbed-5de9-94b7-19e911931bc6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_8b15d677b4c029df83078a4aa5dd6e33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45d16ebc-fbed-5de9-94b7-19e911931bc6/45d16ebc-fbed-5de9-94b7-19e911931bc6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_ee76b9dcff30f898e93eccb5fbb666b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45d16ebc-fbed-5de9-94b7-19e911931bc6/45d16ebc-fbed-5de9-94b7-19e911931bc6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_7ade3c67ed29f0e5850b31121dc7ae59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45d16ebc-fbed-5de9-94b7-19e911931bc6/45d16ebc-fbed-5de9-94b7-19e911931bc6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_d9b8e894d2b42eca7313fe0ee0a03c80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45d16ebc-fbed-5de9-94b7-19e911931bc6/45d16ebc-fbed-5de9-94b7-19e911931bc6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/5a/455afd2f901fcb601b2b9b6e6e78a6ce/pa/RY19910_9a87054fa563d150f25679087c069b20.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 240 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2002}
2026-03-30 10:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY19910%27 HTTP/1.1" 200 None
2026-03-30 10:33:17 [auto1.de] INFO: Saving data for RY19910: {'created_time': 1774866797.490799, 'last_price_update_time': 1774866797.490811, 'auction_closing_time': 1774969516.0}
2026-03-30 10:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY19910') HTTP/1.1" 204 0
2026-03-30 10:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TV02686> (referer: https://www.auto1.com/v1/car-details-view/TV02686/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:33:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:33:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e3393c4-fd1f-5dd4-8a11-3d6de8fa1e0e with identifier: TV02686
2026-03-30 10:33:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e3393c4-fd1f-5dd4-8a11-3d6de8fa1e0e with scrape type 1
2026-03-30 10:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7e3393c4-fd1f-5dd4-8a11-3d6de8fa1e0e
2026-03-30 10:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8c%252Fba8ce91b90966ae15d6e9019a76f7a0e%252Fpa%252FTV02686_dd2d872b247aee676ef2ab13c450dd21.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8c/ba8ce91b90966ae15d6e9019a76f7a0e/pa/TV02686_dd2d872b247aee676ef2ab13c450dd21.jpg already downloaded
2026-03-30 10:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8c%252Fba8ce91b90966ae15d6e9019a76f7a0e%252Fpa%252FTV02686_332a9c57e19af9dc2ef064803dbabed5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8c/ba8ce91b90966ae15d6e9019a76f7a0e/pa/TV02686_332a9c57e19af9dc2ef064803dbabed5.jpg already downloaded
2026-03-30 10:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8c%252Fba8ce91b90966ae15d6e9019a76f7a0e%252Fpa%252FTV02686_29600a9545025d66de18317ec4ffe0a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8c/ba8ce91b90966ae15d6e9019a76f7a0e/pa/TV02686_29600a9545025d66de18317ec4ffe0a3.jpg already downloaded
2026-03-30 10:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8c%252Fba8ce91b90966ae15d6e9019a76f7a0e%252Fpa%252FTV02686_97795cd3b01498f954a4837c28d25122.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8c/ba8ce91b90966ae15d6e9019a76f7a0e/pa/TV02686_97795cd3b01498f954a4837c28d25122.jpg already downloaded
2026-03-30 10:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8c%252Fba8ce91b90966ae15d6e9019a76f7a0e%252Fpa%252FTV02686_b2752d4ae88a6d126cd1704413a15bbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8c/ba8ce91b90966ae15d6e9019a76f7a0e/pa/TV02686_b2752d4ae88a6d126cd1704413a15bbb.jpg already downloaded
2026-03-30 10:33:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e3393c4-fd1f-5dd4-8a11-3d6de8fa1e0e, identifier: TV02686
2026-03-30 10:33:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e3393c4-fd1f-5dd4-8a11-3d6de8fa1e0e with identifier: TV02686
2026-03-30 10:33:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e3393c4-fd1f-5dd4-8a11-3d6de8fa1e0e with identifier: TV02686
2026-03-30 10:33:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e3393c4-fd1f-5dd4-8a11-3d6de8fa1e0e with identifier: TV02686 to the API
2026-03-30 10:33:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:33:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:33:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TV02686>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:42:45Z',
 'fuel_type': 'diesel',
 'id': '7e3393c4-fd1f-5dd4-8a11-3d6de8fa1e0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV02686',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 303552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgba/8c/ba8ce91b90966ae15d6e9019a76f7a0e/pa/TV02686_dd2d872b247aee676ef2ab13c450dd21.jpg',
                'https://img-pa.auto1.com/imgba/8c/ba8ce91b90966ae15d6e9019a76f7a0e/pa/TV02686_332a9c57e19af9dc2ef064803dbabed5.jpg',
                'https://img-pa.auto1.com/imgba/8c/ba8ce91b90966ae15d6e9019a76f7a0e/pa/TV02686_29600a9545025d66de18317ec4ffe0a3.jpg',
                'https://img-pa.auto1.com/imgba/8c/ba8ce91b90966ae15d6e9019a76f7a0e/pa/TV02686_97795cd3b01498f954a4837c28d25122.jpg',
                'https://img-pa.auto1.com/imgba/8c/ba8ce91b90966ae15d6e9019a76f7a0e/pa/TV02686_b2752d4ae88a6d126cd1704413a15bbb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e3393c4-fd1f-5dd4-8a11-3d6de8fa1e0e/7e3393c4-fd1f-5dd4-8a11-3d6de8fa1e0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8c/ba8ce91b90966ae15d6e9019a76f7a0e/pa/TV02686_dd2d872b247aee676ef2ab13c450dd21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e3393c4-fd1f-5dd4-8a11-3d6de8fa1e0e/7e3393c4-fd1f-5dd4-8a11-3d6de8fa1e0e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8c/ba8ce91b90966ae15d6e9019a76f7a0e/pa/TV02686_332a9c57e19af9dc2ef064803dbabed5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e3393c4-fd1f-5dd4-8a11-3d6de8fa1e0e/7e3393c4-fd1f-5dd4-8a11-3d6de8fa1e0e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8c/ba8ce91b90966ae15d6e9019a76f7a0e/pa/TV02686_29600a9545025d66de18317ec4ffe0a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e3393c4-fd1f-5dd4-8a11-3d6de8fa1e0e/7e3393c4-fd1f-5dd4-8a11-3d6de8fa1e0e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8c/ba8ce91b90966ae15d6e9019a76f7a0e/pa/TV02686_97795cd3b01498f954a4837c28d25122.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e3393c4-fd1f-5dd4-8a11-3d6de8fa1e0e/7e3393c4-fd1f-5dd4-8a11-3d6de8fa1e0e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8c/ba8ce91b90966ae15d6e9019a76f7a0e/pa/TV02686_b2752d4ae88a6d126cd1704413a15bbb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2011}
2026-03-30 10:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV02686%27 HTTP/1.1" 200 None
2026-03-30 10:33:25 [auto1.de] INFO: Saving data for TV02686: {'created_time': 1774866805.507162, 'last_price_update_time': 1774866805.507172, 'auction_closing_time': 1774971765.0}
2026-03-30 10:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV02686') HTTP/1.1" 204 0
2026-03-30 10:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME91178/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:33:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA83514> (referer: https://www.auto1.com/v1/car-details-view/LA83514/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:33:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88937290-07af-5b12-a31d-fbab1c3ddc34 with identifier: LA83514
2026-03-30 10:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88937290-07af-5b12-a31d-fbab1c3ddc34 with scrape type 1
2026-03-30 10:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 88937290-07af-5b12-a31d-fbab1c3ddc34
2026-03-30 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F72%252F2572af5a93ea3362912f728c7ba7e781%252Fpa%252FLA83514_de3fa440603c06f45b9f06e284d4f27c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_de3fa440603c06f45b9f06e284d4f27c.jpg not downloaded yet
2026-03-30 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F72%252F2572af5a93ea3362912f728c7ba7e781%252Fpa%252FLA83514_af10bc0cd2093dc63003f14257f73f30.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_af10bc0cd2093dc63003f14257f73f30.jpg not downloaded yet
2026-03-30 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F72%252F2572af5a93ea3362912f728c7ba7e781%252Fpa%252FLA83514_af4c95ea2f20498ec4f1e61ef4a8a243.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_af4c95ea2f20498ec4f1e61ef4a8a243.jpg not downloaded yet
2026-03-30 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F72%252F2572af5a93ea3362912f728c7ba7e781%252Fpa%252FLA83514_418b5e752ac9f6aeb241ae817be29bfb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_418b5e752ac9f6aeb241ae817be29bfb.jpg not downloaded yet
2026-03-30 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F72%252F2572af5a93ea3362912f728c7ba7e781%252Fpa%252FLA83514_cde79cb5bde2474109a8c9df6279c6c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_cde79cb5bde2474109a8c9df6279c6c8.jpg not downloaded yet
2026-03-30 10:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA60747/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:33:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_cde79cb5bde2474109a8c9df6279c6c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41651d0>
2026-03-30 10:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88937290-07af-5b12-a31d-fbab1c3ddc34/88937290-07af-5b12-a31d-fbab1c3ddc34_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F72%252F2572af5a93ea3362912f728c7ba7e781%252Fpa%252FLA83514_cde79cb5bde2474109a8c9df6279c6c8.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_cde79cb5bde2474109a8c9df6279c6c8.jpg saved to cache
2026-03-30 10:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88937290-07af-5b12-a31d-fbab1c3ddc34
2026-03-30 10:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV15875> (referer: https://www.auto1.com/v1/car-details-view/VV15875/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:33:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:33:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f85d09b-b46f-531d-b18c-dd040d830660 with identifier: VV15875
2026-03-30 10:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f85d09b-b46f-531d-b18c-dd040d830660 with scrape type 1
2026-03-30 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f85d09b-b46f-531d-b18c-dd040d830660
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F1c%252Ffc1c16610f5a12fd566868a74b38ef13%252Fpa%252FVV15875_8d411e4de007388bc4668a7ace588604.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_8d411e4de007388bc4668a7ace588604.jpg already downloaded
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F1c%252Ffc1c16610f5a12fd566868a74b38ef13%252Fpa%252FVV15875_1f939b9429151c7663e69f7b62e8ac75.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_1f939b9429151c7663e69f7b62e8ac75.jpg already downloaded
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F1c%252Ffc1c16610f5a12fd566868a74b38ef13%252Fpa%252FVV15875_e9be9434461f38530ae4ef82c42cc310.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_e9be9434461f38530ae4ef82c42cc310.jpg already downloaded
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F1c%252Ffc1c16610f5a12fd566868a74b38ef13%252Fpa%252FVV15875_25465a1a0b195bede79b085df0e95ab3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_25465a1a0b195bede79b085df0e95ab3.jpg already downloaded
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F1c%252Ffc1c16610f5a12fd566868a74b38ef13%252Fpa%252FVV15875_5c5ef0cd23ef74c3a719253372bc89ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_5c5ef0cd23ef74c3a719253372bc89ca.jpg already downloaded
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F1c%252Ffc1c16610f5a12fd566868a74b38ef13%252Fpa%252FVV15875_cab02ddfc89bbcdd52bc9362be78cf9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_cab02ddfc89bbcdd52bc9362be78cf9b.jpg already downloaded
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F1c%252Ffc1c16610f5a12fd566868a74b38ef13%252Fpa%252FVV15875_dd1833d5b482b83e0ac47ed518fb80bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_dd1833d5b482b83e0ac47ed518fb80bb.jpg already downloaded
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F1c%252Ffc1c16610f5a12fd566868a74b38ef13%252Fpa%252FVV15875_e21daa2b839a6eca80be4bcb9c9500dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_e21daa2b839a6eca80be4bcb9c9500dc.jpg already downloaded
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F1c%252Ffc1c16610f5a12fd566868a74b38ef13%252Fpa%252FVV15875_1d8776625d5c3a10a11ce6e4e0de2f3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_1d8776625d5c3a10a11ce6e4e0de2f3d.jpg already downloaded
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F1c%252Ffc1c16610f5a12fd566868a74b38ef13%252Fpa%252FVV15875_ee1b14098cb85cc442ba116ab57be0ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_ee1b14098cb85cc442ba116ab57be0ea.jpg already downloaded
2026-03-30 10:33:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f85d09b-b46f-531d-b18c-dd040d830660, identifier: VV15875
2026-03-30 10:33:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f85d09b-b46f-531d-b18c-dd040d830660 with identifier: VV15875
2026-03-30 10:33:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f85d09b-b46f-531d-b18c-dd040d830660 with identifier: VV15875
2026-03-30 10:33:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f85d09b-b46f-531d-b18c-dd040d830660 with identifier: VV15875 to the API
2026-03-30 10:33:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:33:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VV15875>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:57:29Z',
 'fuel_type': 'diesel',
 'id': '2f85d09b-b46f-531d-b18c-dd040d830660',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV15875',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 163143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_8d411e4de007388bc4668a7ace588604.jpg',
                'https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_1f939b9429151c7663e69f7b62e8ac75.jpg',
                'https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_e9be9434461f38530ae4ef82c42cc310.jpg',
                'https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_25465a1a0b195bede79b085df0e95ab3.jpg',
                'https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_5c5ef0cd23ef74c3a719253372bc89ca.jpg',
                'https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_cab02ddfc89bbcdd52bc9362be78cf9b.jpg',
                'https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_dd1833d5b482b83e0ac47ed518fb80bb.jpg',
                'https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_e21daa2b839a6eca80be4bcb9c9500dc.jpg',
                'https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_1d8776625d5c3a10a11ce6e4e0de2f3d.jpg',
                'https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_ee1b14098cb85cc442ba116ab57be0ea.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f85d09b-b46f-531d-b18c-dd040d830660/2f85d09b-b46f-531d-b18c-dd040d830660_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_8d411e4de007388bc4668a7ace588604.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f85d09b-b46f-531d-b18c-dd040d830660/2f85d09b-b46f-531d-b18c-dd040d830660_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_1f939b9429151c7663e69f7b62e8ac75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f85d09b-b46f-531d-b18c-dd040d830660/2f85d09b-b46f-531d-b18c-dd040d830660_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_e9be9434461f38530ae4ef82c42cc310.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f85d09b-b46f-531d-b18c-dd040d830660/2f85d09b-b46f-531d-b18c-dd040d830660_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_25465a1a0b195bede79b085df0e95ab3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f85d09b-b46f-531d-b18c-dd040d830660/2f85d09b-b46f-531d-b18c-dd040d830660_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_5c5ef0cd23ef74c3a719253372bc89ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f85d09b-b46f-531d-b18c-dd040d830660/2f85d09b-b46f-531d-b18c-dd040d830660_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_cab02ddfc89bbcdd52bc9362be78cf9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f85d09b-b46f-531d-b18c-dd040d830660/2f85d09b-b46f-531d-b18c-dd040d830660_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_dd1833d5b482b83e0ac47ed518fb80bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f85d09b-b46f-531d-b18c-dd040d830660/2f85d09b-b46f-531d-b18c-dd040d830660_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_e21daa2b839a6eca80be4bcb9c9500dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f85d09b-b46f-531d-b18c-dd040d830660/2f85d09b-b46f-531d-b18c-dd040d830660_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_1d8776625d5c3a10a11ce6e4e0de2f3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f85d09b-b46f-531d-b18c-dd040d830660/2f85d09b-b46f-531d-b18c-dd040d830660_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/1c/fc1c16610f5a12fd566868a74b38ef13/pa/VV15875_ee1b14098cb85cc442ba116ab57be0ea.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2017}
2026-03-30 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV15875%27 HTTP/1.1" 200 None
2026-03-30 10:33:33 [auto1.de] INFO: Saving data for VV15875: {'created_time': 1774866813.402823, 'last_price_update_time': 1774866813.402834, 'auction_closing_time': 1774972649.0}
2026-03-30 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV15875') HTTP/1.1" 204 0
2026-03-30 10:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_418b5e752ac9f6aeb241ae817be29bfb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd6390>
2026-03-30 10:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88937290-07af-5b12-a31d-fbab1c3ddc34/88937290-07af-5b12-a31d-fbab1c3ddc34_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F72%252F2572af5a93ea3362912f728c7ba7e781%252Fpa%252FLA83514_418b5e752ac9f6aeb241ae817be29bfb.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_418b5e752ac9f6aeb241ae817be29bfb.jpg saved to cache
2026-03-30 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88937290-07af-5b12-a31d-fbab1c3ddc34
2026-03-30 10:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_af4c95ea2f20498ec4f1e61ef4a8a243.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd7790>
2026-03-30 10:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88937290-07af-5b12-a31d-fbab1c3ddc34/88937290-07af-5b12-a31d-fbab1c3ddc34_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F72%252F2572af5a93ea3362912f728c7ba7e781%252Fpa%252FLA83514_af4c95ea2f20498ec4f1e61ef4a8a243.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_af4c95ea2f20498ec4f1e61ef4a8a243.jpg saved to cache
2026-03-30 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88937290-07af-5b12-a31d-fbab1c3ddc34
2026-03-30 10:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_af10bc0cd2093dc63003f14257f73f30.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_de3fa440603c06f45b9f06e284d4f27c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41f0250>
2026-03-30 10:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88937290-07af-5b12-a31d-fbab1c3ddc34/88937290-07af-5b12-a31d-fbab1c3ddc34_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F72%252F2572af5a93ea3362912f728c7ba7e781%252Fpa%252FLA83514_af10bc0cd2093dc63003f14257f73f30.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_af10bc0cd2093dc63003f14257f73f30.jpg saved to cache
2026-03-30 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88937290-07af-5b12-a31d-fbab1c3ddc34
2026-03-30 10:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd5b50>
2026-03-30 10:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88937290-07af-5b12-a31d-fbab1c3ddc34/88937290-07af-5b12-a31d-fbab1c3ddc34_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F72%252F2572af5a93ea3362912f728c7ba7e781%252Fpa%252FLA83514_de3fa440603c06f45b9f06e284d4f27c.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_de3fa440603c06f45b9f06e284d4f27c.jpg saved to cache
2026-03-30 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88937290-07af-5b12-a31d-fbab1c3ddc34
2026-03-30 10:33:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88937290-07af-5b12-a31d-fbab1c3ddc34, skipping ID generation
2026-03-30 10:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88937290-07af-5b12-a31d-fbab1c3ddc34 with scrape type 1
2026-03-30 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88937290-07af-5b12-a31d-fbab1c3ddc34 sending to next pipeline
2026-03-30 10:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88937290-07af-5b12-a31d-fbab1c3ddc34, identifier: LA83514
2026-03-30 10:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88937290-07af-5b12-a31d-fbab1c3ddc34 with identifier: LA83514
2026-03-30 10:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88937290-07af-5b12-a31d-fbab1c3ddc34 with identifier: LA83514
2026-03-30 10:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88937290-07af-5b12-a31d-fbab1c3ddc34 with identifier: LA83514 to the API
2026-03-30 10:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_de3fa440603c06f45b9f06e284d4f27c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 83,
 'expiration_date': '2026-03-31T15:13:54Z',
 'fuel_type': 'petrol',
 'id': '88937290-07af-5b12-a31d-fbab1c3ddc34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA83514',
 'listing': 'auction',
 'location': 'DE, Oberhausen',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 142008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88937290-07af-5b12-a31d-fbab1c3ddc34/88937290-07af-5b12-a31d-fbab1c3ddc34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_de3fa440603c06f45b9f06e284d4f27c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88937290-07af-5b12-a31d-fbab1c3ddc34/88937290-07af-5b12-a31d-fbab1c3ddc34_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_af10bc0cd2093dc63003f14257f73f30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88937290-07af-5b12-a31d-fbab1c3ddc34/88937290-07af-5b12-a31d-fbab1c3ddc34_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_af4c95ea2f20498ec4f1e61ef4a8a243.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88937290-07af-5b12-a31d-fbab1c3ddc34/88937290-07af-5b12-a31d-fbab1c3ddc34_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_418b5e752ac9f6aeb241ae817be29bfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88937290-07af-5b12-a31d-fbab1c3ddc34/88937290-07af-5b12-a31d-fbab1c3ddc34_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/72/2572af5a93ea3362912f728c7ba7e781/pa/LA83514_cde79cb5bde2474109a8c9df6279c6c8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Jazz 1.4 DSi LS',
 'transmission': 'automatic',
 'trim': 'LS',
 'year': 2004}
2026-03-30 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA83514%27 HTTP/1.1" 200 None
2026-03-30 10:33:34 [auto1.de] INFO: Saving data for LA83514: {'created_time': 1774866814.468227, 'last_price_update_time': 1774866814.468237, 'auction_closing_time': 1774970034.0}
2026-03-30 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA83514') HTTP/1.1" 204 0
2026-03-30 10:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH27268> (referer: https://www.auto1.com/v1/car-details-view/EH27268/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:33:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56e53f10-5d52-5b97-9a72-4644c88ab4fb with identifier: EH27268
2026-03-30 10:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56e53f10-5d52-5b97-9a72-4644c88ab4fb with scrape type 1
2026-03-30 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 56e53f10-5d52-5b97-9a72-4644c88ab4fb
2026-03-30 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ffe%252F26fe40c0d1c78548e8fe5405ac74e18a%252Fpa%252FEH27268_e418f1b3d399582a349b8757e6a3437c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_e418f1b3d399582a349b8757e6a3437c.jpg already downloaded
2026-03-30 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ffe%252F26fe40c0d1c78548e8fe5405ac74e18a%252Fpa%252FEH27268_4d14054952eec51bd7f5099b3c161390.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_4d14054952eec51bd7f5099b3c161390.jpg already downloaded
2026-03-30 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ffe%252F26fe40c0d1c78548e8fe5405ac74e18a%252Fpa%252FEH27268_7a415fbf0ecd65d1b4b1284509b7db11.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_7a415fbf0ecd65d1b4b1284509b7db11.jpg already downloaded
2026-03-30 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ffe%252F26fe40c0d1c78548e8fe5405ac74e18a%252Fpa%252FEH27268_aab0b2b4eef62386f577d6031480952c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_aab0b2b4eef62386f577d6031480952c.jpg already downloaded
2026-03-30 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ffe%252F26fe40c0d1c78548e8fe5405ac74e18a%252Fpa%252FEH27268_ba59359fb52e8b29a94d805e0038332f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_ba59359fb52e8b29a94d805e0038332f.jpg already downloaded
2026-03-30 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ffe%252F26fe40c0d1c78548e8fe5405ac74e18a%252Fpa%252FEH27268_ac626ca87fe6b0b9cee22c07dae31b4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_ac626ca87fe6b0b9cee22c07dae31b4a.jpg already downloaded
2026-03-30 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ffe%252F26fe40c0d1c78548e8fe5405ac74e18a%252Fpa%252FEH27268_0bb3ff2f19a88b36cbe73d47d7566caa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_0bb3ff2f19a88b36cbe73d47d7566caa.jpg already downloaded
2026-03-30 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ffe%252F26fe40c0d1c78548e8fe5405ac74e18a%252Fpa%252FEH27268_6c9ec150fa50911a32435faf10e77144.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_6c9ec150fa50911a32435faf10e77144.jpg already downloaded
2026-03-30 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ffe%252F26fe40c0d1c78548e8fe5405ac74e18a%252Fpa%252FEH27268_631d295636261487ff6a360f8cfcac61.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_631d295636261487ff6a360f8cfcac61.jpg already downloaded
2026-03-30 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ffe%252F26fe40c0d1c78548e8fe5405ac74e18a%252Fpa%252FEH27268_1f3d9a8ec79b07c074aeca0f83743cf5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_1f3d9a8ec79b07c074aeca0f83743cf5.jpg already downloaded
2026-03-30 10:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56e53f10-5d52-5b97-9a72-4644c88ab4fb, identifier: EH27268
2026-03-30 10:33:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56e53f10-5d52-5b97-9a72-4644c88ab4fb with identifier: EH27268
2026-03-30 10:33:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56e53f10-5d52-5b97-9a72-4644c88ab4fb with identifier: EH27268
2026-03-30 10:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56e53f10-5d52-5b97-9a72-4644c88ab4fb with identifier: EH27268 to the API
2026-03-30 10:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:33:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EH27268>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:17:26Z',
 'fuel_type': 'petrol',
 'id': '56e53f10-5d52-5b97-9a72-4644c88ab4fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH27268',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 55258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_e418f1b3d399582a349b8757e6a3437c.jpg',
                'https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_4d14054952eec51bd7f5099b3c161390.jpg',
                'https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_7a415fbf0ecd65d1b4b1284509b7db11.jpg',
                'https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_aab0b2b4eef62386f577d6031480952c.jpg',
                'https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_ba59359fb52e8b29a94d805e0038332f.jpg',
                'https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_ac626ca87fe6b0b9cee22c07dae31b4a.jpg',
                'https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_0bb3ff2f19a88b36cbe73d47d7566caa.jpg',
                'https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_6c9ec150fa50911a32435faf10e77144.jpg',
                'https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_631d295636261487ff6a360f8cfcac61.jpg',
                'https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_1f3d9a8ec79b07c074aeca0f83743cf5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e53f10-5d52-5b97-9a72-4644c88ab4fb/56e53f10-5d52-5b97-9a72-4644c88ab4fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2539164,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_e418f1b3d399582a349b8757e6a3437c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e53f10-5d52-5b97-9a72-4644c88ab4fb/56e53f10-5d52-5b97-9a72-4644c88ab4fb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2624759,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_4d14054952eec51bd7f5099b3c161390.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e53f10-5d52-5b97-9a72-4644c88ab4fb/56e53f10-5d52-5b97-9a72-4644c88ab4fb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_7a415fbf0ecd65d1b4b1284509b7db11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e53f10-5d52-5b97-9a72-4644c88ab4fb/56e53f10-5d52-5b97-9a72-4644c88ab4fb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_aab0b2b4eef62386f577d6031480952c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e53f10-5d52-5b97-9a72-4644c88ab4fb/56e53f10-5d52-5b97-9a72-4644c88ab4fb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2312193,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_ba59359fb52e8b29a94d805e0038332f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e53f10-5d52-5b97-9a72-4644c88ab4fb/56e53f10-5d52-5b97-9a72-4644c88ab4fb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2432185,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_ac626ca87fe6b0b9cee22c07dae31b4a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e53f10-5d52-5b97-9a72-4644c88ab4fb/56e53f10-5d52-5b97-9a72-4644c88ab4fb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2475649,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_0bb3ff2f19a88b36cbe73d47d7566caa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e53f10-5d52-5b97-9a72-4644c88ab4fb/56e53f10-5d52-5b97-9a72-4644c88ab4fb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2564187,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_6c9ec150fa50911a32435faf10e77144.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e53f10-5d52-5b97-9a72-4644c88ab4fb/56e53f10-5d52-5b97-9a72-4644c88ab4fb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_631d295636261487ff6a360f8cfcac61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e53f10-5d52-5b97-9a72-4644c88ab4fb/56e53f10-5d52-5b97-9a72-4644c88ab4fb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/fe/26fe40c0d1c78548e8fe5405ac74e18a/pa/EH27268_1f3d9a8ec79b07c074aeca0f83743cf5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kangoo 1.3 TCe Edition ONE',
 'transmission': 'manual',
 'trim': 'Edition ONE',
 'year': 2022}
2026-03-30 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH27268%27 HTTP/1.1" 200 None
2026-03-30 10:33:36 [auto1.de] INFO: Saving data for EH27268: {'created_time': 1774866816.42564, 'last_price_update_time': 1774866816.425651, 'auction_closing_time': 1774970246.0}
2026-03-30 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH27268') HTTP/1.1" 204 0
2026-03-30 10:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH55820> (referer: https://www.auto1.com/v1/car-details-view/EH55820/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:33:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:33:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8a84004-476a-50f2-be31-9b0bffd46aab with identifier: EH55820
2026-03-30 10:33:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8a84004-476a-50f2-be31-9b0bffd46aab with scrape type 1
2026-03-30 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a8a84004-476a-50f2-be31-9b0bffd46aab
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fb7%252Fc3b790addde1592ee5269b30ceb32011%252Fpa%252FEH55820_1f74bdcf64279ae23ac357d084422010.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_1f74bdcf64279ae23ac357d084422010.jpg already downloaded
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fb7%252Fc3b790addde1592ee5269b30ceb32011%252Fpa%252FEH55820_9777fe14cd4eff444c71de89980eb0de.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_9777fe14cd4eff444c71de89980eb0de.jpg already downloaded
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fb7%252Fc3b790addde1592ee5269b30ceb32011%252Fpa%252FEH55820_57e385849094ed9826876a09f5637950.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_57e385849094ed9826876a09f5637950.jpg already downloaded
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fb7%252Fc3b790addde1592ee5269b30ceb32011%252Fpa%252FEH55820_ddc556404c0a8849c9eb06f3f24c121e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_ddc556404c0a8849c9eb06f3f24c121e.jpg already downloaded
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fb7%252Fc3b790addde1592ee5269b30ceb32011%252Fpa%252FEH55820_d1d4ca269e6f4301308eabcf7359f92a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_d1d4ca269e6f4301308eabcf7359f92a.jpg already downloaded
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fb7%252Fc3b790addde1592ee5269b30ceb32011%252Fpa%252FEH55820_2b08c88149e4b7b9cf885fa0c60e37ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_2b08c88149e4b7b9cf885fa0c60e37ab.jpg already downloaded
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fb7%252Fc3b790addde1592ee5269b30ceb32011%252Fpa%252FEH55820_d494982eb6c1bfd61ef0256c9b1ee0fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_d494982eb6c1bfd61ef0256c9b1ee0fa.jpg already downloaded
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fb7%252Fc3b790addde1592ee5269b30ceb32011%252Fpa%252FEH55820_276548f7d956936e8e8b350fd0815cae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_276548f7d956936e8e8b350fd0815cae.jpg already downloaded
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fb7%252Fc3b790addde1592ee5269b30ceb32011%252Fpa%252FEH55820_968983afb88338abd5ca173fdb9ae0cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_968983afb88338abd5ca173fdb9ae0cf.jpg already downloaded
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fb7%252Fc3b790addde1592ee5269b30ceb32011%252Fpa%252FEH55820_d75a6746c85e7e2e194c6c77c3e6d07f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_d75a6746c85e7e2e194c6c77c3e6d07f.jpg already downloaded
2026-03-30 10:33:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8a84004-476a-50f2-be31-9b0bffd46aab, identifier: EH55820
2026-03-30 10:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8a84004-476a-50f2-be31-9b0bffd46aab with identifier: EH55820
2026-03-30 10:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8a84004-476a-50f2-be31-9b0bffd46aab with identifier: EH55820
2026-03-30 10:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8a84004-476a-50f2-be31-9b0bffd46aab with identifier: EH55820 to the API
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EH55820>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:24:17Z',
 'fuel_type': 'diesel',
 'id': 'a8a84004-476a-50f2-be31-9b0bffd46aab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH55820',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 184895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_1f74bdcf64279ae23ac357d084422010.jpg',
                'https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_9777fe14cd4eff444c71de89980eb0de.jpg',
                'https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_57e385849094ed9826876a09f5637950.jpg',
                'https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_ddc556404c0a8849c9eb06f3f24c121e.jpg',
                'https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_d1d4ca269e6f4301308eabcf7359f92a.jpg',
                'https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_2b08c88149e4b7b9cf885fa0c60e37ab.jpg',
                'https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_d494982eb6c1bfd61ef0256c9b1ee0fa.jpg',
                'https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_276548f7d956936e8e8b350fd0815cae.jpg',
                'https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_968983afb88338abd5ca173fdb9ae0cf.jpg',
                'https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_d75a6746c85e7e2e194c6c77c3e6d07f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8a84004-476a-50f2-be31-9b0bffd46aab/a8a84004-476a-50f2-be31-9b0bffd46aab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_1f74bdcf64279ae23ac357d084422010.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8a84004-476a-50f2-be31-9b0bffd46aab/a8a84004-476a-50f2-be31-9b0bffd46aab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_9777fe14cd4eff444c71de89980eb0de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8a84004-476a-50f2-be31-9b0bffd46aab/a8a84004-476a-50f2-be31-9b0bffd46aab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2878431,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_57e385849094ed9826876a09f5637950.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8a84004-476a-50f2-be31-9b0bffd46aab/a8a84004-476a-50f2-be31-9b0bffd46aab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2763434,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_ddc556404c0a8849c9eb06f3f24c121e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8a84004-476a-50f2-be31-9b0bffd46aab/a8a84004-476a-50f2-be31-9b0bffd46aab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2874977,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_d1d4ca269e6f4301308eabcf7359f92a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8a84004-476a-50f2-be31-9b0bffd46aab/a8a84004-476a-50f2-be31-9b0bffd46aab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_2b08c88149e4b7b9cf885fa0c60e37ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8a84004-476a-50f2-be31-9b0bffd46aab/a8a84004-476a-50f2-be31-9b0bffd46aab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2600686,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_d494982eb6c1bfd61ef0256c9b1ee0fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8a84004-476a-50f2-be31-9b0bffd46aab/a8a84004-476a-50f2-be31-9b0bffd46aab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_276548f7d956936e8e8b350fd0815cae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8a84004-476a-50f2-be31-9b0bffd46aab/a8a84004-476a-50f2-be31-9b0bffd46aab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_968983afb88338abd5ca173fdb9ae0cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8a84004-476a-50f2-be31-9b0bffd46aab/a8a84004-476a-50f2-be31-9b0bffd46aab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3003083,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/b7/c3b790addde1592ee5269b30ceb32011/pa/EH55820_d75a6746c85e7e2e194c6c77c3e6d07f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2016}
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH55820%27 HTTP/1.1" 200 None
2026-03-30 10:33:43 [auto1.de] INFO: Saving data for EH55820: {'created_time': 1774866823.977489, 'last_price_update_time': 1774866823.977501, 'auction_closing_time': 1774970657.0}
2026-03-30 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH55820') HTTP/1.1" 204 0
2026-03-30 10:33:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.383(s), this was the 1st time calling it.
2026-03-30 10:33:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.630035541432157 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:33:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WH35124> (referer: https://www.auto1.com/v1/car-details-view/WH35124/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:33:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1818e11-8506-5630-b819-4e2debb8d46e with identifier: WH35124
2026-03-30 10:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1818e11-8506-5630-b819-4e2debb8d46e with scrape type 1
2026-03-30 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d1818e11-8506-5630-b819-4e2debb8d46e
2026-03-30 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F43%252F6743c3d6b2d458ac9493e6c9007a61dd%252Fpa%252FWH35124_76f6685515c4c3e4843f0d0d8496b14a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_76f6685515c4c3e4843f0d0d8496b14a.jpg not downloaded yet
2026-03-30 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F43%252F6743c3d6b2d458ac9493e6c9007a61dd%252Fpa%252FWH35124_3b0d288fee028735bb34368278e7c43e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_3b0d288fee028735bb34368278e7c43e.jpg not downloaded yet
2026-03-30 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F43%252F6743c3d6b2d458ac9493e6c9007a61dd%252Fpa%252FWH35124_709f56bb1ece3689b51609a5ee8d077f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_709f56bb1ece3689b51609a5ee8d077f.jpg not downloaded yet
2026-03-30 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F43%252F6743c3d6b2d458ac9493e6c9007a61dd%252Fpa%252FWH35124_d218b169608e898d6d8aac26c80ad2bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_d218b169608e898d6d8aac26c80ad2bd.jpg not downloaded yet
2026-03-30 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F43%252F6743c3d6b2d458ac9493e6c9007a61dd%252Fpa%252FWH35124_93d7e0d3774fd60f964b80365ee26323.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_93d7e0d3774fd60f964b80365ee26323.jpg not downloaded yet
2026-03-30 10:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GT90153/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:33:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_93d7e0d3774fd60f964b80365ee26323.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419d6d0>
2026-03-30 10:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1818e11-8506-5630-b819-4e2debb8d46e/d1818e11-8506-5630-b819-4e2debb8d46e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F43%252F6743c3d6b2d458ac9493e6c9007a61dd%252Fpa%252FWH35124_93d7e0d3774fd60f964b80365ee26323.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_93d7e0d3774fd60f964b80365ee26323.jpg saved to cache
2026-03-30 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1818e11-8506-5630-b819-4e2debb8d46e
2026-03-30 10:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZW01245/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:33:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_d218b169608e898d6d8aac26c80ad2bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefdd310>
2026-03-30 10:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1818e11-8506-5630-b819-4e2debb8d46e/d1818e11-8506-5630-b819-4e2debb8d46e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F43%252F6743c3d6b2d458ac9493e6c9007a61dd%252Fpa%252FWH35124_d218b169608e898d6d8aac26c80ad2bd.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_d218b169608e898d6d8aac26c80ad2bd.jpg saved to cache
2026-03-30 10:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1818e11-8506-5630-b819-4e2debb8d46e
2026-03-30 10:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YE41052/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:33:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_709f56bb1ece3689b51609a5ee8d077f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41c4590>
2026-03-30 10:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1818e11-8506-5630-b819-4e2debb8d46e/d1818e11-8506-5630-b819-4e2debb8d46e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F43%252F6743c3d6b2d458ac9493e6c9007a61dd%252Fpa%252FWH35124_709f56bb1ece3689b51609a5ee8d077f.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_709f56bb1ece3689b51609a5ee8d077f.jpg saved to cache
2026-03-30 10:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1818e11-8506-5630-b819-4e2debb8d46e
2026-03-30 10:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_3b0d288fee028735bb34368278e7c43e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef1b110>
2026-03-30 10:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1818e11-8506-5630-b819-4e2debb8d46e/d1818e11-8506-5630-b819-4e2debb8d46e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F43%252F6743c3d6b2d458ac9493e6c9007a61dd%252Fpa%252FWH35124_3b0d288fee028735bb34368278e7c43e.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_3b0d288fee028735bb34368278e7c43e.jpg saved to cache
2026-03-30 10:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1818e11-8506-5630-b819-4e2debb8d46e
2026-03-30 10:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ88379/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:33:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_76f6685515c4c3e4843f0d0d8496b14a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a5390>
2026-03-30 10:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1818e11-8506-5630-b819-4e2debb8d46e/d1818e11-8506-5630-b819-4e2debb8d46e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F43%252F6743c3d6b2d458ac9493e6c9007a61dd%252Fpa%252FWH35124_76f6685515c4c3e4843f0d0d8496b14a.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_76f6685515c4c3e4843f0d0d8496b14a.jpg saved to cache
2026-03-30 10:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1818e11-8506-5630-b819-4e2debb8d46e
2026-03-30 10:33:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1818e11-8506-5630-b819-4e2debb8d46e, skipping ID generation
2026-03-30 10:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1818e11-8506-5630-b819-4e2debb8d46e with scrape type 1
2026-03-30 10:33:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1818e11-8506-5630-b819-4e2debb8d46e sending to next pipeline
2026-03-30 10:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1818e11-8506-5630-b819-4e2debb8d46e, identifier: WH35124
2026-03-30 10:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1818e11-8506-5630-b819-4e2debb8d46e with identifier: WH35124
2026-03-30 10:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1818e11-8506-5630-b819-4e2debb8d46e with identifier: WH35124
2026-03-30 10:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1818e11-8506-5630-b819-4e2debb8d46e with identifier: WH35124 to the API
2026-03-30 10:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_76f6685515c4c3e4843f0d0d8496b14a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:46:45Z',
 'fuel_type': 'petrol',
 'id': 'd1818e11-8506-5630-b819-4e2debb8d46e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH35124',
 'listing': 'auction',
 'location': 'DE, Waiblingen',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 149364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1818e11-8506-5630-b819-4e2debb8d46e/d1818e11-8506-5630-b819-4e2debb8d46e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_76f6685515c4c3e4843f0d0d8496b14a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1818e11-8506-5630-b819-4e2debb8d46e/d1818e11-8506-5630-b819-4e2debb8d46e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_3b0d288fee028735bb34368278e7c43e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1818e11-8506-5630-b819-4e2debb8d46e/d1818e11-8506-5630-b819-4e2debb8d46e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_709f56bb1ece3689b51609a5ee8d077f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1818e11-8506-5630-b819-4e2debb8d46e/d1818e11-8506-5630-b819-4e2debb8d46e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_d218b169608e898d6d8aac26c80ad2bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1818e11-8506-5630-b819-4e2debb8d46e/d1818e11-8506-5630-b819-4e2debb8d46e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/43/6743c3d6b2d458ac9493e6c9007a61dd/pa/WH35124_93d7e0d3774fd60f964b80365ee26323.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost SYNC Edition',
 'transmission': 'manual',
 'trim': 'SYNC Edition',
 'year': 2015}
2026-03-30 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH35124%27 HTTP/1.1" 200 None
2026-03-30 10:33:56 [auto1.de] INFO: Saving data for WH35124: {'created_time': 1774866836.554813, 'last_price_update_time': 1774866836.554824, 'auction_closing_time': 1774972005.0}
2026-03-30 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WH35124') HTTP/1.1" 204 0
2026-03-30 10:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BA33674> (referer: https://www.auto1.com/v1/car-details-view/BA33674/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:33:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80f76873-3b37-583f-a766-6e398b06c2e4 with identifier: BA33674
2026-03-30 10:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80f76873-3b37-583f-a766-6e398b06c2e4 with scrape type 1
2026-03-30 10:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80f76873-3b37-583f-a766-6e398b06c2e4
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_9e02b7241760f8942dcdf09f552941da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_9e02b7241760f8942dcdf09f552941da.jpg not downloaded yet
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_5ee0383e4de47cd5736154e2e8382f6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_5ee0383e4de47cd5736154e2e8382f6d.jpg not downloaded yet
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_430afc65572f218ea28a759bb4fef99d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_430afc65572f218ea28a759bb4fef99d.jpg not downloaded yet
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_6eacc4f6ec7f9c898aea0e1624efe28a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_6eacc4f6ec7f9c898aea0e1624efe28a.jpg not downloaded yet
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_f326bd4c86e02fd41a3de74ec84906d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_f326bd4c86e02fd41a3de74ec84906d7.jpg not downloaded yet
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_b7bdf4a17bc3ba010168688fc7611ed5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_b7bdf4a17bc3ba010168688fc7611ed5.jpg not downloaded yet
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_b5e5b7fd059e7a45ae8b0cfd9def0ca1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_b5e5b7fd059e7a45ae8b0cfd9def0ca1.jpg not downloaded yet
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_c24fe93cc086aa149523031c8c90e3b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_c24fe93cc086aa149523031c8c90e3b5.jpg not downloaded yet
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_522185c6cd9b0563150b6abc25264bd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_522185c6cd9b0563150b6abc25264bd5.jpg not downloaded yet
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_a73ace506ac803519963353818232030.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_a73ace506ac803519963353818232030.jpg not downloaded yet
2026-03-30 10:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT48689/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:33:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_a73ace506ac803519963353818232030.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419c850>
2026-03-30 10:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_a73ace506ac803519963353818232030.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_a73ace506ac803519963353818232030.jpg saved to cache
2026-03-30 10:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80f76873-3b37-583f-a766-6e398b06c2e4
2026-03-30 10:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_522185c6cd9b0563150b6abc25264bd5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:33:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f433bf90>
2026-03-30 10:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_522185c6cd9b0563150b6abc25264bd5.jpg') HTTP/1.1" 204 0
2026-03-30 10:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_522185c6cd9b0563150b6abc25264bd5.jpg saved to cache
2026-03-30 10:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80f76873-3b37-583f-a766-6e398b06c2e4
2026-03-30 10:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG72110/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_c24fe93cc086aa149523031c8c90e3b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8ef50>
2026-03-30 10:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_c24fe93cc086aa149523031c8c90e3b5.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_c24fe93cc086aa149523031c8c90e3b5.jpg saved to cache
2026-03-30 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80f76873-3b37-583f-a766-6e398b06c2e4
2026-03-30 10:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV44287/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_b5e5b7fd059e7a45ae8b0cfd9def0ca1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef357d0>
2026-03-30 10:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_b5e5b7fd059e7a45ae8b0cfd9def0ca1.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_b5e5b7fd059e7a45ae8b0cfd9def0ca1.jpg saved to cache
2026-03-30 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80f76873-3b37-583f-a766-6e398b06c2e4
2026-03-30 10:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE03800/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_b7bdf4a17bc3ba010168688fc7611ed5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a5c50>
2026-03-30 10:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_b7bdf4a17bc3ba010168688fc7611ed5.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_b7bdf4a17bc3ba010168688fc7611ed5.jpg saved to cache
2026-03-30 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80f76873-3b37-583f-a766-6e398b06c2e4
2026-03-30 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:03 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 9403 | hits on page: 40
2026-03-30 10:34:03 [auto1.de] INFO: Found listing with ID: WL34445
2026-03-30 10:34:03 [auto1.de] INFO: Found listing with ID: VH91595
2026-03-30 10:34:03 [auto1.de] INFO: Found listing with ID: BX61235
2026-03-30 10:34:03 [auto1.de] INFO: Found listing with ID: KV96760
2026-03-30 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV96760%27 HTTP/1.1" 200 None
2026-03-30 10:34:03 [auto1.de] INFO: Scrape type for KV96760: 0
2026-03-30 10:34:03 [auto1.de] INFO: Found listing with ID: JB89867
2026-03-30 10:34:03 [auto1.de] INFO: Found listing with ID: XR47953
2026-03-30 10:34:03 [auto1.de] INFO: Found listing with ID: EH55820
2026-03-30 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH55820%27 HTTP/1.1" 200 None
2026-03-30 10:34:03 [auto1.de] INFO: Scrape type for EH55820: 0
2026-03-30 10:34:03 [auto1.de] INFO: Found listing with ID: MF71867
2026-03-30 10:34:03 [auto1.de] INFO: Found listing with ID: WH35124
2026-03-30 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH35124%27 HTTP/1.1" 200 None
2026-03-30 10:34:03 [auto1.de] INFO: Scrape type for WH35124: 0
2026-03-30 10:34:03 [auto1.de] INFO: Found listing with ID: AN41238
2026-03-30 10:34:03 [auto1.de] INFO: Found listing with ID: XB34738
2026-03-30 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB34738%27 HTTP/1.1" 200 None
2026-03-30 10:34:03 [auto1.de] INFO: Scrape type for XB34738: 1
2026-03-30 10:34:03 [auto1.de] INFO: Found listing with ID: XY53001
2026-03-30 10:34:03 [auto1.de] INFO: Found listing with ID: BK47474
2026-03-30 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK47474%27 HTTP/1.1" 200 None
2026-03-30 10:34:03 [auto1.de] INFO: Scrape type for BK47474: 2
2026-03-30 10:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fda5f3c-c68e-5b02-9432-608e1759e312 with identifier: BK47474
2026-03-30 10:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fda5f3c-c68e-5b02-9432-608e1759e312 with scrape type 2
2026-03-30 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fda5f3c-c68e-5b02-9432-608e1759e312 with scrape type 2
2026-03-30 10:34:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fda5f3c-c68e-5b02-9432-608e1759e312, identifier: BK47474
2026-03-30 10:34:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fda5f3c-c68e-5b02-9432-608e1759e312 with identifier: BK47474
2026-03-30 10:34:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fda5f3c-c68e-5b02-9432-608e1759e312 with identifier: BK47474
2026-03-30 10:34:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fda5f3c-c68e-5b02-9432-608e1759e312 with identifier: BK47474 to the API
2026-03-30 10:34:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:44:25Z',
 'fuel_type': 'diesel',
 'id': '1fda5f3c-c68e-5b02-9432-608e1759e312',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK47474',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 231715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-27',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-30 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK47474%27 HTTP/1.1" 200 None
2026-03-30 10:34:03 [auto1.de] INFO: Saving data for BK47474: {'auction_closing_time': 1774971865.0, 'created_time': 1773688622.911878, 'last_price_update_time': 1774866843.971572}
2026-03-30 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK47474') HTTP/1.1" 204 0
2026-03-30 10:34:04 [auto1.de] INFO: Found listing with ID: UK28735
2026-03-30 10:34:04 [auto1.de] INFO: Found listing with ID: YS62418
2026-03-30 10:34:04 [auto1.de] INFO: Found listing with ID: DJ38509
2026-03-30 10:34:04 [auto1.de] INFO: Found listing with ID: BH58234
2026-03-30 10:34:04 [auto1.de] INFO: Found listing with ID: HJ01307
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ01307%27 HTTP/1.1" 200 None
2026-03-30 10:34:04 [auto1.de] INFO: Scrape type for HJ01307: 1
2026-03-30 10:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB89867/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:04 [auto1.de] INFO: Found listing with ID: PZ96037
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ96037%27 HTTP/1.1" 200 None
2026-03-30 10:34:04 [auto1.de] INFO: Scrape type for PZ96037: 2
2026-03-30 10:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74195520-69dd-50ea-ab3a-ff7ff3e5a4b5 with identifier: PZ96037
2026-03-30 10:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74195520-69dd-50ea-ab3a-ff7ff3e5a4b5 with scrape type 2
2026-03-30 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74195520-69dd-50ea-ab3a-ff7ff3e5a4b5 with scrape type 2
2026-03-30 10:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74195520-69dd-50ea-ab3a-ff7ff3e5a4b5, identifier: PZ96037
2026-03-30 10:34:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA60747> (referer: https://www.auto1.com/v1/car-details-view/LA60747/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:04 [scrapy.extensions.logstats] INFO: Crawled 62 pages (at 23 pages/min), scraped 40 items (at 10 items/min)
2026-03-30 10:34:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 10:34:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74195520-69dd-50ea-ab3a-ff7ff3e5a4b5 with identifier: PZ96037
2026-03-30 10:34:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74195520-69dd-50ea-ab3a-ff7ff3e5a4b5 with identifier: PZ96037
2026-03-30 10:34:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74195520-69dd-50ea-ab3a-ff7ff3e5a4b5 with identifier: PZ96037 to the API
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:28:01Z',
 'fuel_type': 'petrol',
 'id': '74195520-69dd-50ea-ab3a-ff7ff3e5a4b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ96037',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 116079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-09-29',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 FSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2004}
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ96037%27 HTTP/1.1" 200 None
2026-03-30 10:34:04 [auto1.de] INFO: Saving data for PZ96037: {'auction_closing_time': 1774970881.0, 'created_time': 1774262587.719989, 'last_price_update_time': 1774866844.535849}
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ96037') HTTP/1.1" 204 0
2026-03-30 10:34:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:04 [auto1.de] INFO: Found listing with ID: BN24933
2026-03-30 10:34:04 [auto1.de] INFO: Found listing with ID: TU30152
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU30152%27 HTTP/1.1" 200 None
2026-03-30 10:34:04 [auto1.de] INFO: Scrape type for TU30152: 1
2026-03-30 10:34:04 [auto1.de] INFO: Found listing with ID: MW00897
2026-03-30 10:34:04 [auto1.de] INFO: Found listing with ID: VY67471
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67471%27 HTTP/1.1" 200 None
2026-03-30 10:34:04 [auto1.de] INFO: Scrape type for VY67471: 1
2026-03-30 10:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f877359f-3e73-56b2-a075-007f7ff51db6 with identifier: LA60747
2026-03-30 10:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f877359f-3e73-56b2-a075-007f7ff51db6 with scrape type 1
2026-03-30 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f877359f-3e73-56b2-a075-007f7ff51db6
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F8b%252F9d8b93f4fedd3c59f1d5211bc494b4da%252Fpa%252FLA60747_c316afeed5b0ff7d386769fd0b4753a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_c316afeed5b0ff7d386769fd0b4753a7.jpg already downloaded
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F8b%252F9d8b93f4fedd3c59f1d5211bc494b4da%252Fpa%252FLA60747_5d24a6b876c435428b32696e6429b211.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_5d24a6b876c435428b32696e6429b211.jpg already downloaded
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F8b%252F9d8b93f4fedd3c59f1d5211bc494b4da%252Fpa%252FLA60747_e3f7580069411098634671bc641ed1af.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_e3f7580069411098634671bc641ed1af.jpg already downloaded
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F8b%252F9d8b93f4fedd3c59f1d5211bc494b4da%252Fpa%252FLA60747_bf06edf92b3119a1101ef3f50fd24dfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_bf06edf92b3119a1101ef3f50fd24dfc.jpg already downloaded
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F8b%252F9d8b93f4fedd3c59f1d5211bc494b4da%252Fpa%252FLA60747_094313c00a18674cef6c1447faf720bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_094313c00a18674cef6c1447faf720bb.jpg already downloaded
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F8b%252F9d8b93f4fedd3c59f1d5211bc494b4da%252Fpa%252FLA60747_ed7e2ba164ed26cf48ff889bce0930cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_ed7e2ba164ed26cf48ff889bce0930cc.jpg already downloaded
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F8b%252F9d8b93f4fedd3c59f1d5211bc494b4da%252Fpa%252FLA60747_910279ce7c9da7d0aa295bc88ea4f4ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_910279ce7c9da7d0aa295bc88ea4f4ed.jpg already downloaded
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F8b%252F9d8b93f4fedd3c59f1d5211bc494b4da%252Fpa%252FLA60747_4fe55b2746c3a5fe2d09e60e35cbc5f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_4fe55b2746c3a5fe2d09e60e35cbc5f4.jpg already downloaded
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F8b%252F9d8b93f4fedd3c59f1d5211bc494b4da%252Fpa%252FLA60747_c5f220ec6f3306256bbdd98a8f1b33ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_c5f220ec6f3306256bbdd98a8f1b33ae.jpg already downloaded
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F8b%252F9d8b93f4fedd3c59f1d5211bc494b4da%252Fpa%252FLA60747_50eb266fcc74375323eac0aaa3609313.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_50eb266fcc74375323eac0aaa3609313.jpg already downloaded
2026-03-30 10:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f877359f-3e73-56b2-a075-007f7ff51db6, identifier: LA60747
2026-03-30 10:34:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f877359f-3e73-56b2-a075-007f7ff51db6 with identifier: LA60747
2026-03-30 10:34:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f877359f-3e73-56b2-a075-007f7ff51db6 with identifier: LA60747
2026-03-30 10:34:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f877359f-3e73-56b2-a075-007f7ff51db6 with identifier: LA60747 to the API
2026-03-30 10:34:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LA60747>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:59:51Z',
 'fuel_type': 'diesel',
 'id': 'f877359f-3e73-56b2-a075-007f7ff51db6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA60747',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 186324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_c316afeed5b0ff7d386769fd0b4753a7.jpg',
                'https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_5d24a6b876c435428b32696e6429b211.jpg',
                'https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_e3f7580069411098634671bc641ed1af.jpg',
                'https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_bf06edf92b3119a1101ef3f50fd24dfc.jpg',
                'https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_094313c00a18674cef6c1447faf720bb.jpg',
                'https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_ed7e2ba164ed26cf48ff889bce0930cc.jpg',
                'https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_910279ce7c9da7d0aa295bc88ea4f4ed.jpg',
                'https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_4fe55b2746c3a5fe2d09e60e35cbc5f4.jpg',
                'https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_c5f220ec6f3306256bbdd98a8f1b33ae.jpg',
                'https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_50eb266fcc74375323eac0aaa3609313.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877359f-3e73-56b2-a075-007f7ff51db6/f877359f-3e73-56b2-a075-007f7ff51db6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_c316afeed5b0ff7d386769fd0b4753a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877359f-3e73-56b2-a075-007f7ff51db6/f877359f-3e73-56b2-a075-007f7ff51db6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_5d24a6b876c435428b32696e6429b211.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877359f-3e73-56b2-a075-007f7ff51db6/f877359f-3e73-56b2-a075-007f7ff51db6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_e3f7580069411098634671bc641ed1af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877359f-3e73-56b2-a075-007f7ff51db6/f877359f-3e73-56b2-a075-007f7ff51db6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_bf06edf92b3119a1101ef3f50fd24dfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877359f-3e73-56b2-a075-007f7ff51db6/f877359f-3e73-56b2-a075-007f7ff51db6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_094313c00a18674cef6c1447faf720bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877359f-3e73-56b2-a075-007f7ff51db6/f877359f-3e73-56b2-a075-007f7ff51db6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_ed7e2ba164ed26cf48ff889bce0930cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877359f-3e73-56b2-a075-007f7ff51db6/f877359f-3e73-56b2-a075-007f7ff51db6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_910279ce7c9da7d0aa295bc88ea4f4ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877359f-3e73-56b2-a075-007f7ff51db6/f877359f-3e73-56b2-a075-007f7ff51db6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_4fe55b2746c3a5fe2d09e60e35cbc5f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877359f-3e73-56b2-a075-007f7ff51db6/f877359f-3e73-56b2-a075-007f7ff51db6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_c5f220ec6f3306256bbdd98a8f1b33ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877359f-3e73-56b2-a075-007f7ff51db6/f877359f-3e73-56b2-a075-007f7ff51db6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/8b/9d8b93f4fedd3c59f1d5211bc494b4da/pa/LA60747_50eb266fcc74375323eac0aaa3609313.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Clever',
 'transmission': 'automatic',
 'trim': 'Clever',
 'year': 2018}
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA60747%27 HTTP/1.1" 200 None
2026-03-30 10:34:05 [auto1.de] INFO: Saving data for LA60747: {'created_time': 1774866845.377371, 'last_price_update_time': 1774866845.377381, 'auction_closing_time': 1774972791.0}
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA60747') HTTP/1.1" 204 0
2026-03-30 10:34:05 [auto1.de] INFO: Found listing with ID: UB22204
2026-03-30 10:34:05 [auto1.de] INFO: Found listing with ID: LG30254
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG30254%27 HTTP/1.1" 200 None
2026-03-30 10:34:05 [auto1.de] INFO: Scrape type for LG30254: 1
2026-03-30 10:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZW01245> (referer: https://www.auto1.com/v1/car-details-view/ZW01245/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:05 [auto1.de] INFO: Found listing with ID: ZU32637
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU32637%27 HTTP/1.1" 200 None
2026-03-30 10:34:05 [auto1.de] INFO: Scrape type for ZU32637: 1
2026-03-30 10:34:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:05 [auto1.de] INFO: Found listing with ID: ZA80746
2026-03-30 10:34:05 [auto1.de] INFO: Found listing with ID: ZZ54313
2026-03-30 10:34:05 [auto1.de] INFO: Found listing with ID: LK73650
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK73650%27 HTTP/1.1" 200 None
2026-03-30 10:34:05 [auto1.de] INFO: Scrape type for LK73650: 1
2026-03-30 10:34:05 [auto1.de] INFO: Found listing with ID: LK11873
2026-03-30 10:34:05 [auto1.de] INFO: Found listing with ID: FW21815
2026-03-30 10:34:05 [auto1.de] INFO: Found listing with ID: WD03646
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD03646%27 HTTP/1.1" 200 None
2026-03-30 10:34:05 [auto1.de] INFO: Scrape type for WD03646: 1
2026-03-30 10:34:05 [auto1.de] INFO: Found listing with ID: VZ38032
2026-03-30 10:34:05 [auto1.de] INFO: Found listing with ID: KN27665
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN27665%27 HTTP/1.1" 200 None
2026-03-30 10:34:05 [auto1.de] INFO: Scrape type for KN27665: 1
2026-03-30 10:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WL34445/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:05 [auto1.de] INFO: Found listing with ID: JA21775
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA21775%27 HTTP/1.1" 200 None
2026-03-30 10:34:05 [auto1.de] INFO: Scrape type for JA21775: 1
2026-03-30 10:34:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:05 [auto1.de] INFO: Found listing with ID: VZ06022
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ06022%27 HTTP/1.1" 200 None
2026-03-30 10:34:05 [auto1.de] INFO: Scrape type for VZ06022: 2
2026-03-30 10:34:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56254f51-d2e4-5efd-a8ed-03be84d49d0c with identifier: VZ06022
2026-03-30 10:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56254f51-d2e4-5efd-a8ed-03be84d49d0c with scrape type 2
2026-03-30 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56254f51-d2e4-5efd-a8ed-03be84d49d0c with scrape type 2
2026-03-30 10:34:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56254f51-d2e4-5efd-a8ed-03be84d49d0c, identifier: VZ06022
2026-03-30 10:34:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56254f51-d2e4-5efd-a8ed-03be84d49d0c with identifier: VZ06022
2026-03-30 10:34:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56254f51-d2e4-5efd-a8ed-03be84d49d0c with identifier: VZ06022
2026-03-30 10:34:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56254f51-d2e4-5efd-a8ed-03be84d49d0c with identifier: VZ06022 to the API
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:05:14Z',
 'fuel_type': 'petrol',
 'id': '56254f51-d2e4-5efd-a8ed-03be84d49d0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ06022',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 87854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-30',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ06022%27 HTTP/1.1" 200 None
2026-03-30 10:34:06 [auto1.de] INFO: Saving data for VZ06022: {'auction_closing_time': 1774969514.0, 'created_time': 1774263363.695573, 'last_price_update_time': 1774866846.045422}
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ06022') HTTP/1.1" 204 0
2026-03-30 10:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03138c0d-6831-50ce-a241-6c500b0318cb with identifier: ZW01245
2026-03-30 10:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03138c0d-6831-50ce-a241-6c500b0318cb with scrape type 1
2026-03-30 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 03138c0d-6831-50ce-a241-6c500b0318cb
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9b%252F589bb414569653892ea317c6ce1a01d4%252Fpa%252FZW01245_0496c37c1e74735e94b31e3705fed44b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_0496c37c1e74735e94b31e3705fed44b.jpg not downloaded yet
2026-03-30 10:34:06 [auto1.de] INFO: Found listing with ID: KF51408
2026-03-30 10:34:06 [auto1.de] INFO: Found listing with ID: SK04411
2026-03-30 10:34:06 [auto1.de] INFO: Found listing with ID: FY02898
2026-03-30 10:34:06 [auto1.de] INFO: Found listing with ID: CY80853
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY80853%27 HTTP/1.1" 200 None
2026-03-30 10:34:06 [auto1.de] INFO: Scrape type for CY80853: 2
2026-03-30 10:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6fb16b5-b378-5171-85c7-a3fb13d8c43f with identifier: CY80853
2026-03-30 10:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6fb16b5-b378-5171-85c7-a3fb13d8c43f with scrape type 2
2026-03-30 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6fb16b5-b378-5171-85c7-a3fb13d8c43f with scrape type 2
2026-03-30 10:34:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6fb16b5-b378-5171-85c7-a3fb13d8c43f, identifier: CY80853
2026-03-30 10:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6fb16b5-b378-5171-85c7-a3fb13d8c43f with identifier: CY80853
2026-03-30 10:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6fb16b5-b378-5171-85c7-a3fb13d8c43f with identifier: CY80853
2026-03-30 10:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6fb16b5-b378-5171-85c7-a3fb13d8c43f with identifier: CY80853 to the API
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:47:54Z',
 'fuel_type': 'petrol',
 'id': 'e6fb16b5-b378-5171-85c7-a3fb13d8c43f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY80853',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-22',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2018}
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY80853%27 HTTP/1.1" 200 None
2026-03-30 10:34:06 [auto1.de] INFO: Saving data for CY80853: {'auction_closing_time': 1774972074.0, 'created_time': 1774380100.673488, 'last_price_update_time': 1774866846.618278}
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY80853') HTTP/1.1" 204 0
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9b%252F589bb414569653892ea317c6ce1a01d4%252Fpa%252FZW01245_8b43a2de0a0414924a864c751b334b6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_8b43a2de0a0414924a864c751b334b6a.jpg not downloaded yet
2026-03-30 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME91178> (referer: https://www.auto1.com/v1/car-details-view/ME91178/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9b%252F589bb414569653892ea317c6ce1a01d4%252Fpa%252FZW01245_6366adef2cb9471f7707ffe712fa4c13.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_6366adef2cb9471f7707ffe712fa4c13.jpg not downloaded yet
2026-03-30 10:34:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YE41052> (referer: https://www.auto1.com/v1/car-details-view/YE41052/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_f326bd4c86e02fd41a3de74ec84906d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9b%252F589bb414569653892ea317c6ce1a01d4%252Fpa%252FZW01245_56f0b7887fb45eccca9ea87ed6506a0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_56f0b7887fb45eccca9ea87ed6506a0e.jpg not downloaded yet
2026-03-30 10:34:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9b%252F589bb414569653892ea317c6ce1a01d4%252Fpa%252FZW01245_9b2d792557e7e2e7598fddbb4af53cf8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_9b2d792557e7e2e7598fddbb4af53cf8.jpg not downloaded yet
2026-03-30 10:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df2291d5-b9a6-5db0-ab8a-b7671dd1249e with identifier: ME91178
2026-03-30 10:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df2291d5-b9a6-5db0-ab8a-b7671dd1249e with scrape type 1
2026-03-30 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item df2291d5-b9a6-5db0-ab8a-b7671dd1249e
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bbac062f1a7e38acd5153f511cb978%252Fpa%252FME91178_1cd16048e555d76516c64c5c8dd66db4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_1cd16048e555d76516c64c5c8dd66db4.jpg not downloaded yet
2026-03-30 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_8b43a2de0a0414924a864c751b334b6a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_6366adef2cb9471f7707ffe712fa4c13.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bbac062f1a7e38acd5153f511cb978%252Fpa%252FME91178_85c9780c29b193071c0c4cbebc82d122.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_85c9780c29b193071c0c4cbebc82d122.jpg not downloaded yet
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bbac062f1a7e38acd5153f511cb978%252Fpa%252FME91178_740196363d63472080912406b7125e7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_740196363d63472080912406b7125e7a.jpg not downloaded yet
2026-03-30 10:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63fa3323-9bf5-57e8-a126-3c16afdac4cb with identifier: YE41052
2026-03-30 10:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63fa3323-9bf5-57e8-a126-3c16afdac4cb with scrape type 1
2026-03-30 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63fa3323-9bf5-57e8-a126-3c16afdac4cb
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_5726b51c737ceaaca73bbf3eb4985940.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_5726b51c737ceaaca73bbf3eb4985940.jpg not downloaded yet
2026-03-30 10:34:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a1310>
2026-03-30 10:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_f326bd4c86e02fd41a3de74ec84906d7.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_f326bd4c86e02fd41a3de74ec84906d7.jpg saved to cache
2026-03-30 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80f76873-3b37-583f-a766-6e398b06c2e4
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bbac062f1a7e38acd5153f511cb978%252Fpa%252FME91178_dafabab28ecdd635cee5fad39e65f183.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_dafabab28ecdd635cee5fad39e65f183.jpg not downloaded yet
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_ea0f249060e903e3dd0fc2635a54f42b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_ea0f249060e903e3dd0fc2635a54f42b.jpg not downloaded yet
2026-03-30 10:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_1cd16048e555d76516c64c5c8dd66db4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_9b2d792557e7e2e7598fddbb4af53cf8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bbac062f1a7e38acd5153f511cb978%252Fpa%252FME91178_d41d23d4f0847f91e8c75d9440394e6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_d41d23d4f0847f91e8c75d9440394e6c.jpg not downloaded yet
2026-03-30 10:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL36767/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LJ61664/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_540caad136afeabf0c3c1e3a5bb90038.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_540caad136afeabf0c3c1e3a5bb90038.jpg not downloaded yet
2026-03-30 10:34:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3a2d0>
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03138c0d-6831-50ce-a241-6c500b0318cb/03138c0d-6831-50ce-a241-6c500b0318cb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9b%252F589bb414569653892ea317c6ce1a01d4%252Fpa%252FZW01245_8b43a2de0a0414924a864c751b334b6a.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_8b43a2de0a0414924a864c751b334b6a.jpg saved to cache
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03138c0d-6831-50ce-a241-6c500b0318cb
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f432f450>
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03138c0d-6831-50ce-a241-6c500b0318cb/03138c0d-6831-50ce-a241-6c500b0318cb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9b%252F589bb414569653892ea317c6ce1a01d4%252Fpa%252FZW01245_6366adef2cb9471f7707ffe712fa4c13.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_6366adef2cb9471f7707ffe712fa4c13.jpg saved to cache
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03138c0d-6831-50ce-a241-6c500b0318cb
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_db9889b65bf127e1fef26cf2996efc1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_db9889b65bf127e1fef26cf2996efc1d.jpg not downloaded yet
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4347490>
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2291d5-b9a6-5db0-ab8a-b7671dd1249e/df2291d5-b9a6-5db0-ab8a-b7671dd1249e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bbac062f1a7e38acd5153f511cb978%252Fpa%252FME91178_1cd16048e555d76516c64c5c8dd66db4.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_1cd16048e555d76516c64c5c8dd66db4.jpg saved to cache
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df2291d5-b9a6-5db0-ab8a-b7671dd1249e
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefdc910>
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03138c0d-6831-50ce-a241-6c500b0318cb/03138c0d-6831-50ce-a241-6c500b0318cb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9b%252F589bb414569653892ea317c6ce1a01d4%252Fpa%252FZW01245_9b2d792557e7e2e7598fddbb4af53cf8.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_9b2d792557e7e2e7598fddbb4af53cf8.jpg saved to cache
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 03138c0d-6831-50ce-a241-6c500b0318cb
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_cbb62dc1f0ddd1c3821e285517ad96a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_cbb62dc1f0ddd1c3821e285517ad96a7.jpg not downloaded yet
2026-03-30 10:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_740196363d63472080912406b7125e7a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_dafabab28ecdd635cee5fad39e65f183.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_e5c19fb5e3c4eab60ba3fb413448dd98.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_e5c19fb5e3c4eab60ba3fb413448dd98.jpg not downloaded yet
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_7b83eb406162ab96d88074472380e098.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_7b83eb406162ab96d88074472380e098.jpg not downloaded yet
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_f4f587771a0f3b683318009716ff1704.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_f4f587771a0f3b683318009716ff1704.jpg not downloaded yet
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_4e8719ec433adf280d12f11e7799525a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_4e8719ec433adf280d12f11e7799525a.jpg not downloaded yet
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_684a61eb57f01a967fc9600771b9c795.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_684a61eb57f01a967fc9600771b9c795.jpg not downloaded yet
2026-03-30 10:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ88379> (referer: https://www.auto1.com/v1/car-details-view/UZ88379/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42b7b10>
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2291d5-b9a6-5db0-ab8a-b7671dd1249e/df2291d5-b9a6-5db0-ab8a-b7671dd1249e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bbac062f1a7e38acd5153f511cb978%252Fpa%252FME91178_740196363d63472080912406b7125e7a.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_740196363d63472080912406b7125e7a.jpg saved to cache
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df2291d5-b9a6-5db0-ab8a-b7671dd1249e
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c00c10>
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2291d5-b9a6-5db0-ab8a-b7671dd1249e/df2291d5-b9a6-5db0-ab8a-b7671dd1249e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bbac062f1a7e38acd5153f511cb978%252Fpa%252FME91178_dafabab28ecdd635cee5fad39e65f183.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_dafabab28ecdd635cee5fad39e65f183.jpg saved to cache
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df2291d5-b9a6-5db0-ab8a-b7671dd1249e
2026-03-30 10:34:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_5726b51c737ceaaca73bbf3eb4985940.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_ea0f249060e903e3dd0fc2635a54f42b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1282fb24-a056-5262-af8d-e3794f4665d2 with identifier: UZ88379
2026-03-30 10:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1282fb24-a056-5262-af8d-e3794f4665d2 with scrape type 1
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1282fb24-a056-5262-af8d-e3794f4665d2
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_17b85ce866c4e16930c63b45aff44f79.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_17b85ce866c4e16930c63b45aff44f79.jpg not downloaded yet
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_680d8fc38835ee7ec3421c7fa67ee253.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_680d8fc38835ee7ec3421c7fa67ee253.jpg not downloaded yet
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_12bce38855eb511532f252e61c5632e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_12bce38855eb511532f252e61c5632e4.jpg not downloaded yet
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_cb9582f05b15480674a43214b8172d39.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_cb9582f05b15480674a43214b8172d39.jpg not downloaded yet
2026-03-30 10:34:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee0fe90>
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_5726b51c737ceaaca73bbf3eb4985940.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_5726b51c737ceaaca73bbf3eb4985940.jpg saved to cache
2026-03-30 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63fa3323-9bf5-57e8-a126-3c16afdac4cb
2026-03-30 10:34:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef44cd0>
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_ea0f249060e903e3dd0fc2635a54f42b.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_ea0f249060e903e3dd0fc2635a54f42b.jpg saved to cache
2026-03-30 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63fa3323-9bf5-57e8-a126-3c16afdac4cb
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_69dbdd59910adad89ca36b1a80968f43.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_69dbdd59910adad89ca36b1a80968f43.jpg not downloaded yet
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_c0d62902ee22e5e571b0e7baea6f31f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_c0d62902ee22e5e571b0e7baea6f31f4.jpg not downloaded yet
2026-03-30 10:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HJ01307/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_c43e46e1ab532c99b083bd6e5e647d4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_c43e46e1ab532c99b083bd6e5e647d4a.jpg not downloaded yet
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_a98c8798919b28381072b2390407a557.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_a98c8798919b28381072b2390407a557.jpg not downloaded yet
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_c4bb2e5b2f6c8de6c958081499c1dbb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_c4bb2e5b2f6c8de6c958081499c1dbb1.jpg not downloaded yet
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_35845ca5597be4b77c6f1832ee44a790.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_35845ca5597be4b77c6f1832ee44a790.jpg not downloaded yet
2026-03-30 10:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_684a61eb57f01a967fc9600771b9c795.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_69dbdd59910adad89ca36b1a80968f43.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4197090>
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_684a61eb57f01a967fc9600771b9c795.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_684a61eb57f01a967fc9600771b9c795.jpg saved to cache
2026-03-30 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63fa3323-9bf5-57e8-a126-3c16afdac4cb
2026-03-30 10:34:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4198290>
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_69dbdd59910adad89ca36b1a80968f43.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_69dbdd59910adad89ca36b1a80968f43.jpg saved to cache
2026-03-30 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1282fb24-a056-5262-af8d-e3794f4665d2
2026-03-30 10:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_cb9582f05b15480674a43214b8172d39.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE03800> (referer: https://www.auto1.com/v1/car-details-view/SE03800/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_12bce38855eb511532f252e61c5632e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_35845ca5597be4b77c6f1832ee44a790.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_cbb62dc1f0ddd1c3821e285517ad96a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f593d750>
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_cb9582f05b15480674a43214b8172d39.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_cb9582f05b15480674a43214b8172d39.jpg saved to cache
2026-03-30 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1282fb24-a056-5262-af8d-e3794f4665d2
2026-03-30 10:34:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df23a1a5-fbcc-56d9-93fe-3d980673ee74 with identifier: SE03800
2026-03-30 10:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df23a1a5-fbcc-56d9-93fe-3d980673ee74 with scrape type 1
2026-03-30 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item df23a1a5-fbcc-56d9-93fe-3d980673ee74
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2f%252Fa72fce2b5e9e4d55c98b0957b48733c5%252Fpa%252FSE03800_35348a2973229236cae1826f1494e1d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_35348a2973229236cae1826f1494e1d3.jpg not downloaded yet
2026-03-30 10:34:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41c7a90>
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_12bce38855eb511532f252e61c5632e4.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_12bce38855eb511532f252e61c5632e4.jpg saved to cache
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1282fb24-a056-5262-af8d-e3794f4665d2
2026-03-30 10:34:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef7c250>
2026-03-30 10:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_35845ca5597be4b77c6f1832ee44a790.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_35845ca5597be4b77c6f1832ee44a790.jpg saved to cache
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1282fb24-a056-5262-af8d-e3794f4665d2
2026-03-30 10:34:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43273d0>
2026-03-30 10:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_cbb62dc1f0ddd1c3821e285517ad96a7.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_cbb62dc1f0ddd1c3821e285517ad96a7.jpg saved to cache
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63fa3323-9bf5-57e8-a126-3c16afdac4cb
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2f%252Fa72fce2b5e9e4d55c98b0957b48733c5%252Fpa%252FSE03800_3fdcc26c092d8107e68c5d354239237f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_3fdcc26c092d8107e68c5d354239237f.jpg not downloaded yet
2026-03-30 10:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GT90153> (referer: https://www.auto1.com/v1/car-details-view/GT90153/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG30254/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2f%252Fa72fce2b5e9e4d55c98b0957b48733c5%252Fpa%252FSE03800_73a2eee1799d824e34d8a17b2dda7712.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_73a2eee1799d824e34d8a17b2dda7712.jpg not downloaded yet
2026-03-30 10:34:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2f%252Fa72fce2b5e9e4d55c98b0957b48733c5%252Fpa%252FSE03800_356f45891c63f775c9adca7dd985c1fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_356f45891c63f775c9adca7dd985c1fc.jpg not downloaded yet
2026-03-30 10:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV44287> (referer: https://www.auto1.com/v1/car-details-view/NV44287/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2f%252Fa72fce2b5e9e4d55c98b0957b48733c5%252Fpa%252FSE03800_7bf86899958182dee69fd88f12986832.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_7bf86899958182dee69fd88f12986832.jpg not downloaded yet
2026-03-30 10:34:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2f%252Fa72fce2b5e9e4d55c98b0957b48733c5%252Fpa%252FSE03800_1fc110119dbf16e3d3f186031129d01b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_1fc110119dbf16e3d3f186031129d01b.jpg not downloaded yet
2026-03-30 10:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_35348a2973229236cae1826f1494e1d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0633b60-85a2-5c37-969f-e882908006de with identifier: GT90153
2026-03-30 10:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0633b60-85a2-5c37-969f-e882908006de with scrape type 1
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0633b60-85a2-5c37-969f-e882908006de
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_17daf7c367289f1a25937c799a5c46a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_17daf7c367289f1a25937c799a5c46a6.jpg not downloaded yet
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_4346dde67a5dbd00056e01ff2192641b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_4346dde67a5dbd00056e01ff2192641b.jpg not downloaded yet
2026-03-30 10:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_c4bb2e5b2f6c8de6c958081499c1dbb1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_1fc110119dbf16e3d3f186031129d01b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_aeabb1094de2948074c12315d26cc1a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_aeabb1094de2948074c12315d26cc1a5.jpg not downloaded yet
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_8a0a7e652527b824550692382fecae0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_8a0a7e652527b824550692382fecae0f.jpg not downloaded yet
2026-03-30 10:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07d56e91-8bc4-5a9c-8a42-fcc230c9f725 with identifier: NV44287
2026-03-30 10:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07d56e91-8bc4-5a9c-8a42-fcc230c9f725 with scrape type 1
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 07d56e91-8bc4-5a9c-8a42-fcc230c9f725
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_d749124209ba4f0d5139d7f47c3fc999.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_d749124209ba4f0d5139d7f47c3fc999.jpg not downloaded yet
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_687e92b0227eb2a412a6097e3b6333b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_687e92b0227eb2a412a6097e3b6333b8.jpg not downloaded yet
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_18386df8762231c937736b4094526dd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_18386df8762231c937736b4094526dd2.jpg not downloaded yet
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_ebd5358f509e34cebd4f487f54358c1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_ebd5358f509e34cebd4f487f54358c1d.jpg not downloaded yet
2026-03-30 10:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_17daf7c367289f1a25937c799a5c46a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_0332f6b7e8d57bdf72beb4beb9e51ee4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_0332f6b7e8d57bdf72beb4beb9e51ee4.jpg not downloaded yet
2026-03-30 10:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4184dd0>
2026-03-30 10:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df23a1a5-fbcc-56d9-93fe-3d980673ee74/df23a1a5-fbcc-56d9-93fe-3d980673ee74_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2f%252Fa72fce2b5e9e4d55c98b0957b48733c5%252Fpa%252FSE03800_35348a2973229236cae1826f1494e1d3.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_35348a2973229236cae1826f1494e1d3.jpg saved to cache
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df23a1a5-fbcc-56d9-93fe-3d980673ee74
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_3c2d4c2b308b170c7ea78842d2585c0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_3c2d4c2b308b170c7ea78842d2585c0b.jpg not downloaded yet
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_9a7d298660850ba412b290ba4189dd9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_9a7d298660850ba412b290ba4189dd9f.jpg not downloaded yet
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_95cedbfa9309f95c3c0ad5615d5f00cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_95cedbfa9309f95c3c0ad5615d5f00cc.jpg not downloaded yet
2026-03-30 10:34:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef5b190>
2026-03-30 10:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_c4bb2e5b2f6c8de6c958081499c1dbb1.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_c4bb2e5b2f6c8de6c958081499c1dbb1.jpg saved to cache
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1282fb24-a056-5262-af8d-e3794f4665d2
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4231b50>
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df23a1a5-fbcc-56d9-93fe-3d980673ee74/df23a1a5-fbcc-56d9-93fe-3d980673ee74_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2f%252Fa72fce2b5e9e4d55c98b0957b48733c5%252Fpa%252FSE03800_1fc110119dbf16e3d3f186031129d01b.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_1fc110119dbf16e3d3f186031129d01b.jpg saved to cache
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df23a1a5-fbcc-56d9-93fe-3d980673ee74
2026-03-30 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_356f45891c63f775c9adca7dd985c1fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_65ac9b42c7cd4c03c325c231c6d3b88f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_65ac9b42c7cd4c03c325c231c6d3b88f.jpg not downloaded yet
2026-03-30 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_18386df8762231c937736b4094526dd2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_3fdcc26c092d8107e68c5d354239237f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_f1894570c0a53c9bd012a683f553c61b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_f1894570c0a53c9bd012a683f553c61b.jpg not downloaded yet
2026-03-30 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT48689> (referer: https://www.auto1.com/v1/car-details-view/AT48689/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f591db90>
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_17daf7c367289f1a25937c799a5c46a6.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_17daf7c367289f1a25937c799a5c46a6.jpg saved to cache
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0633b60-85a2-5c37-969f-e882908006de
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_e9ada3cf06c208da8b2b7f6997a3becf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_e9ada3cf06c208da8b2b7f6997a3becf.jpg not downloaded yet
2026-03-30 10:34:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_32d3ce5a97453990ebf068f18e1f0fe5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_32d3ce5a97453990ebf068f18e1f0fe5.jpg not downloaded yet
2026-03-30 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB34738/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_0aeccc022e156e5b1a2f816cb9afb643.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_0aeccc022e156e5b1a2f816cb9afb643.jpg not downloaded yet
2026-03-30 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_9a7d298660850ba412b290ba4189dd9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_1fc4fbcd92b8f35a0e6c75a754ae97da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_1fc4fbcd92b8f35a0e6c75a754ae97da.jpg not downloaded yet
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43a9c10>
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df23a1a5-fbcc-56d9-93fe-3d980673ee74/df23a1a5-fbcc-56d9-93fe-3d980673ee74_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2f%252Fa72fce2b5e9e4d55c98b0957b48733c5%252Fpa%252FSE03800_356f45891c63f775c9adca7dd985c1fc.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_356f45891c63f775c9adca7dd985c1fc.jpg saved to cache
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df23a1a5-fbcc-56d9-93fe-3d980673ee74
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee07410>
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_18386df8762231c937736b4094526dd2.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_18386df8762231c937736b4094526dd2.jpg saved to cache
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07d56e91-8bc4-5a9c-8a42-fcc230c9f725
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee43350>
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df23a1a5-fbcc-56d9-93fe-3d980673ee74/df23a1a5-fbcc-56d9-93fe-3d980673ee74_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2f%252Fa72fce2b5e9e4d55c98b0957b48733c5%252Fpa%252FSE03800_3fdcc26c092d8107e68c5d354239237f.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_3fdcc26c092d8107e68c5d354239237f.jpg saved to cache
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df23a1a5-fbcc-56d9-93fe-3d980673ee74
2026-03-30 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_65ac9b42c7cd4c03c325c231c6d3b88f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_3c2d4c2b308b170c7ea78842d2585c0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_b20f90da8142a22a2184624d195b155b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_b20f90da8142a22a2184624d195b155b.jpg not downloaded yet
2026-03-30 10:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 711156bf-6f01-53b7-8b3e-e6f97a4fa70e with identifier: AT48689
2026-03-30 10:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 711156bf-6f01-53b7-8b3e-e6f97a4fa70e with scrape type 1
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 711156bf-6f01-53b7-8b3e-e6f97a4fa70e
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_1e5aafa289841eaae6121afd77753fc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_1e5aafa289841eaae6121afd77753fc2.jpg not downloaded yet
2026-03-30 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KN27665/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_e9ada3cf06c208da8b2b7f6997a3becf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_7050f27ea34cdcc4451c93404f34f4cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_7050f27ea34cdcc4451c93404f34f4cf.jpg not downloaded yet
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_8870d98ed3de56914b3e008da05dfc99.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_8870d98ed3de56914b3e008da05dfc99.jpg not downloaded yet
2026-03-30 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LJ61664> (referer: https://www.auto1.com/v1/car-details-view/LJ61664/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414b790>
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_9a7d298660850ba412b290ba4189dd9f.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_9a7d298660850ba412b290ba4189dd9f.jpg saved to cache
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07d56e91-8bc4-5a9c-8a42-fcc230c9f725
2026-03-30 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_1fc4fbcd92b8f35a0e6c75a754ae97da.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_0aeccc022e156e5b1a2f816cb9afb643.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_a8d6297669db36cde91ab93ac6a39621.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_a8d6297669db36cde91ab93ac6a39621.jpg not downloaded yet
2026-03-30 10:34:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_984177535fb9ae13859e6125977dd2bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_984177535fb9ae13859e6125977dd2bf.jpg not downloaded yet
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f432d5d0>
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_65ac9b42c7cd4c03c325c231c6d3b88f.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_65ac9b42c7cd4c03c325c231c6d3b88f.jpg saved to cache
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07d56e91-8bc4-5a9c-8a42-fcc230c9f725
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41c6010>
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_3c2d4c2b308b170c7ea78842d2585c0b.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_3c2d4c2b308b170c7ea78842d2585c0b.jpg saved to cache
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0633b60-85a2-5c37-969f-e882908006de
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef36a10>
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_e9ada3cf06c208da8b2b7f6997a3becf.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_e9ada3cf06c208da8b2b7f6997a3becf.jpg saved to cache
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07d56e91-8bc4-5a9c-8a42-fcc230c9f725
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_fcb34659e6aad595fba128ee383ad683.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_fcb34659e6aad595fba128ee383ad683.jpg not downloaded yet
2026-03-30 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_32d3ce5a97453990ebf068f18e1f0fe5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_2ef9c5e9dc0f33c1bca669427c830547.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_2ef9c5e9dc0f33c1bca669427c830547.jpg not downloaded yet
2026-03-30 10:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f48e8135-1333-590a-90f1-add68305e013 with identifier: LJ61664
2026-03-30 10:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f48e8135-1333-590a-90f1-add68305e013 with scrape type 1
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item f48e8135-1333-590a-90f1-add68305e013
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F07%252F2707983b1e4186337980f670e70ec319%252Fpa%252FLJ61664_74c9a568e46628842a8747066ee0dbc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_74c9a568e46628842a8747066ee0dbc1.jpg not downloaded yet
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c0ac90>
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_1fc4fbcd92b8f35a0e6c75a754ae97da.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_1fc4fbcd92b8f35a0e6c75a754ae97da.jpg saved to cache
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 07d56e91-8bc4-5a9c-8a42-fcc230c9f725
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee11810>
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_0aeccc022e156e5b1a2f816cb9afb643.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_0aeccc022e156e5b1a2f816cb9afb643.jpg saved to cache
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 07d56e91-8bc4-5a9c-8a42-fcc230c9f725
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_1567b7c5005071128fc4a738d82304e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_1567b7c5005071128fc4a738d82304e9.jpg not downloaded yet
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F07%252F2707983b1e4186337980f670e70ec319%252Fpa%252FLJ61664_db0a70667a2108578bf12b8122efecd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_db0a70667a2108578bf12b8122efecd9.jpg not downloaded yet
2026-03-30 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WL34445> (referer: https://www.auto1.com/v1/car-details-view/WL34445/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_a98c8798919b28381072b2390407a557.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_c43e46e1ab532c99b083bd6e5e647d4a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414a850>
2026-03-30 10:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_32d3ce5a97453990ebf068f18e1f0fe5.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_32d3ce5a97453990ebf068f18e1f0fe5.jpg saved to cache
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0633b60-85a2-5c37-969f-e882908006de
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_3acc085cc4a809a5d1c49a2ad9ff58af.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_3acc085cc4a809a5d1c49a2ad9ff58af.jpg not downloaded yet
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F07%252F2707983b1e4186337980f670e70ec319%252Fpa%252FLJ61664_0a2204a9cc93f537112d87852ddbcde5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_0a2204a9cc93f537112d87852ddbcde5.jpg not downloaded yet
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_1030e28e30d069d103f869e0ea0240a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_1030e28e30d069d103f869e0ea0240a1.jpg not downloaded yet
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F07%252F2707983b1e4186337980f670e70ec319%252Fpa%252FLJ61664_bc8b3f9927f28b3d3cbfa5f34c3971c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_bc8b3f9927f28b3d3cbfa5f34c3971c4.jpg not downloaded yet
2026-03-30 10:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_c0d62902ee22e5e571b0e7baea6f31f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_6876d9d67db3ff6014814b3febacf845.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_6876d9d67db3ff6014814b3febacf845.jpg not downloaded yet
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F07%252F2707983b1e4186337980f670e70ec319%252Fpa%252FLJ61664_71faf761705dabaac4403aeef027b2cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_71faf761705dabaac4403aeef027b2cc.jpg not downloaded yet
2026-03-30 10:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9893309-a070-5a33-8a54-2e4e3a369457 with identifier: WL34445
2026-03-30 10:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9893309-a070-5a33-8a54-2e4e3a369457 with scrape type 1
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9893309-a070-5a33-8a54-2e4e3a369457
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377c6f0fa498822ea295a0e98164f699%252Fpa%252FWL34445_529e4063660d4dba1f8a037170e2fd04.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_529e4063660d4dba1f8a037170e2fd04.jpg already downloaded
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377c6f0fa498822ea295a0e98164f699%252Fpa%252FWL34445_0f7cab32cfdc7ffad7d5336bf19f8b95.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_0f7cab32cfdc7ffad7d5336bf19f8b95.jpg already downloaded
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377c6f0fa498822ea295a0e98164f699%252Fpa%252FWL34445_d969aba109a01ec3d10082d1b3f3969c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_d969aba109a01ec3d10082d1b3f3969c.jpg already downloaded
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377c6f0fa498822ea295a0e98164f699%252Fpa%252FWL34445_74deefe2678c5bd45ad6bfbc9f87b730.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_74deefe2678c5bd45ad6bfbc9f87b730.jpg already downloaded
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377c6f0fa498822ea295a0e98164f699%252Fpa%252FWL34445_05e17fca3d1cd34688934982f4e336ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_05e17fca3d1cd34688934982f4e336ba.jpg already downloaded
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377c6f0fa498822ea295a0e98164f699%252Fpa%252FWL34445_12d3e9b7b8631c751d21e3d1d9c555a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_12d3e9b7b8631c751d21e3d1d9c555a6.jpg already downloaded
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377c6f0fa498822ea295a0e98164f699%252Fpa%252FWL34445_99526d65b388cf91fb4951b8fe621661.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_99526d65b388cf91fb4951b8fe621661.jpg already downloaded
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377c6f0fa498822ea295a0e98164f699%252Fpa%252FWL34445_2023c42a65169e5bace3bfa03d53eada.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_2023c42a65169e5bace3bfa03d53eada.jpg already downloaded
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377c6f0fa498822ea295a0e98164f699%252Fpa%252FWL34445_119c9ba49b75c6266b6e2a7ace5c7c81.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_119c9ba49b75c6266b6e2a7ace5c7c81.jpg already downloaded
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377c6f0fa498822ea295a0e98164f699%252Fpa%252FWL34445_a4f7b6d7d4273fcba3132ac4e43d0ce5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_a4f7b6d7d4273fcba3132ac4e43d0ce5.jpg already downloaded
2026-03-30 10:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9893309-a070-5a33-8a54-2e4e3a369457, identifier: WL34445
2026-03-30 10:34:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414df90>
2026-03-30 10:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_a98c8798919b28381072b2390407a557.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_a98c8798919b28381072b2390407a557.jpg saved to cache
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1282fb24-a056-5262-af8d-e3794f4665d2
2026-03-30 10:34:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee4f950>
2026-03-30 10:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_c43e46e1ab532c99b083bd6e5e647d4a.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_c43e46e1ab532c99b083bd6e5e647d4a.jpg saved to cache
2026-03-30 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1282fb24-a056-5262-af8d-e3794f4665d2
2026-03-30 10:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9893309-a070-5a33-8a54-2e4e3a369457 with identifier: WL34445
2026-03-30 10:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9893309-a070-5a33-8a54-2e4e3a369457 with identifier: WL34445
2026-03-30 10:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9893309-a070-5a33-8a54-2e4e3a369457 with identifier: WL34445 to the API
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WL34445>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:44:03Z',
 'fuel_type': 'diesel',
 'id': 'b9893309-a070-5a33-8a54-2e4e3a369457',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL34445',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 138866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_529e4063660d4dba1f8a037170e2fd04.jpg',
                'https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_0f7cab32cfdc7ffad7d5336bf19f8b95.jpg',
                'https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_d969aba109a01ec3d10082d1b3f3969c.jpg',
                'https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_74deefe2678c5bd45ad6bfbc9f87b730.jpg',
                'https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_05e17fca3d1cd34688934982f4e336ba.jpg',
                'https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_12d3e9b7b8631c751d21e3d1d9c555a6.jpg',
                'https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_99526d65b388cf91fb4951b8fe621661.jpg',
                'https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_2023c42a65169e5bace3bfa03d53eada.jpg',
                'https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_119c9ba49b75c6266b6e2a7ace5c7c81.jpg',
                'https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_a4f7b6d7d4273fcba3132ac4e43d0ce5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9893309-a070-5a33-8a54-2e4e3a369457/b9893309-a070-5a33-8a54-2e4e3a369457_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2811651,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_529e4063660d4dba1f8a037170e2fd04.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9893309-a070-5a33-8a54-2e4e3a369457/b9893309-a070-5a33-8a54-2e4e3a369457_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_0f7cab32cfdc7ffad7d5336bf19f8b95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9893309-a070-5a33-8a54-2e4e3a369457/b9893309-a070-5a33-8a54-2e4e3a369457_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_d969aba109a01ec3d10082d1b3f3969c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9893309-a070-5a33-8a54-2e4e3a369457/b9893309-a070-5a33-8a54-2e4e3a369457_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_74deefe2678c5bd45ad6bfbc9f87b730.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9893309-a070-5a33-8a54-2e4e3a369457/b9893309-a070-5a33-8a54-2e4e3a369457_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2712616,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_05e17fca3d1cd34688934982f4e336ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9893309-a070-5a33-8a54-2e4e3a369457/b9893309-a070-5a33-8a54-2e4e3a369457_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2719006,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_12d3e9b7b8631c751d21e3d1d9c555a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9893309-a070-5a33-8a54-2e4e3a369457/b9893309-a070-5a33-8a54-2e4e3a369457_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2950990,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_99526d65b388cf91fb4951b8fe621661.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9893309-a070-5a33-8a54-2e4e3a369457/b9893309-a070-5a33-8a54-2e4e3a369457_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_2023c42a65169e5bace3bfa03d53eada.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9893309-a070-5a33-8a54-2e4e3a369457/b9893309-a070-5a33-8a54-2e4e3a369457_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2739452,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_119c9ba49b75c6266b6e2a7ace5c7c81.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9893309-a070-5a33-8a54-2e4e3a369457/b9893309-a070-5a33-8a54-2e4e3a369457_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7c/377c6f0fa498822ea295a0e98164f699/pa/WL34445_a4f7b6d7d4273fcba3132ac4e43d0ce5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-12-26',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L1 Tourneo Titanium',
 'transmission': 'manual',
 'trim': '310 L1 Tourneo Titanium',
 'year': 2016}
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL34445%27 HTTP/1.1" 200 None
2026-03-30 10:34:12 [auto1.de] INFO: Saving data for WL34445: {'created_time': 1774866852.314626, 'last_price_update_time': 1774866852.314638, 'auction_closing_time': 1774971843.0}
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL34445') HTTP/1.1" 204 0
2026-03-30 10:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_7050f27ea34cdcc4451c93404f34f4cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG30254> (referer: https://www.auto1.com/v1/car-details-view/LG30254/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG72110> (referer: https://www.auto1.com/v1/car-details-view/NG72110/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefed810>
2026-03-30 10:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_c0d62902ee22e5e571b0e7baea6f31f4.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_c0d62902ee22e5e571b0e7baea6f31f4.jpg saved to cache
2026-03-30 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1282fb24-a056-5262-af8d-e3794f4665d2
2026-03-30 10:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef383d0>
2026-03-30 10:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_7050f27ea34cdcc4451c93404f34f4cf.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_7050f27ea34cdcc4451c93404f34f4cf.jpg saved to cache
2026-03-30 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 07d56e91-8bc4-5a9c-8a42-fcc230c9f725
2026-03-30 10:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d893e3aa-ec08-5028-9892-6271f0e7f430 with identifier: LG30254
2026-03-30 10:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d893e3aa-ec08-5028-9892-6271f0e7f430 with scrape type 1
2026-03-30 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d893e3aa-ec08-5028-9892-6271f0e7f430
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F12%252F2b12abdd4d97d1a3732162d83f92928d%252Fpa%252FLG30254_5852acef6944afbb8c04d4057e9db9b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_5852acef6944afbb8c04d4057e9db9b6.jpg already downloaded
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F12%252F2b12abdd4d97d1a3732162d83f92928d%252Fpa%252FLG30254_d2a348ec4c7d9cde6069d950b6ed5d7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_d2a348ec4c7d9cde6069d950b6ed5d7d.jpg already downloaded
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F12%252F2b12abdd4d97d1a3732162d83f92928d%252Fpa%252FLG30254_6d2495eddc1e06ac6e105f5b73e9cecb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_6d2495eddc1e06ac6e105f5b73e9cecb.jpg already downloaded
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F12%252F2b12abdd4d97d1a3732162d83f92928d%252Fpa%252FLG30254_0c373018a38e7e2da99ddcd117f72372.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_0c373018a38e7e2da99ddcd117f72372.jpg already downloaded
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F12%252F2b12abdd4d97d1a3732162d83f92928d%252Fpa%252FLG30254_e10de38d808f99032217deb50340a10f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_e10de38d808f99032217deb50340a10f.jpg already downloaded
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F12%252F2b12abdd4d97d1a3732162d83f92928d%252Fpa%252FLG30254_43e2630599feb2469ce51f4d3a2c3de4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_43e2630599feb2469ce51f4d3a2c3de4.jpg already downloaded
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F12%252F2b12abdd4d97d1a3732162d83f92928d%252Fpa%252FLG30254_c37ffa1ff72b67861d2e4ea85a62b0bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_c37ffa1ff72b67861d2e4ea85a62b0bd.jpg already downloaded
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F12%252F2b12abdd4d97d1a3732162d83f92928d%252Fpa%252FLG30254_472e19b8918f6196ee3c596c4cfc3ed1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_472e19b8918f6196ee3c596c4cfc3ed1.jpg already downloaded
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F12%252F2b12abdd4d97d1a3732162d83f92928d%252Fpa%252FLG30254_3a91df8f71fea46fc0b3a2a42db151e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_3a91df8f71fea46fc0b3a2a42db151e5.jpg already downloaded
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F12%252F2b12abdd4d97d1a3732162d83f92928d%252Fpa%252FLG30254_e88d29ae65d542a9b261061a734633b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_e88d29ae65d542a9b261061a734633b2.jpg already downloaded
2026-03-30 10:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d893e3aa-ec08-5028-9892-6271f0e7f430, identifier: LG30254
2026-03-30 10:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60f9bb57-fb10-51bc-a6ba-b8ff758818ac with identifier: NG72110
2026-03-30 10:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60f9bb57-fb10-51bc-a6ba-b8ff758818ac with scrape type 1
2026-03-30 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 60f9bb57-fb10-51bc-a6ba-b8ff758818ac
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4d%252F584d214e19ba2e687f07a1b3c8a298b0%252Fpa%252FNG72110_5556254b05749c3897885a1eca6dd33a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_5556254b05749c3897885a1eca6dd33a.jpg not downloaded yet
2026-03-30 10:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d893e3aa-ec08-5028-9892-6271f0e7f430 with identifier: LG30254
2026-03-30 10:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d893e3aa-ec08-5028-9892-6271f0e7f430 with identifier: LG30254
2026-03-30 10:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d893e3aa-ec08-5028-9892-6271f0e7f430 with identifier: LG30254 to the API
2026-03-30 10:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LG30254>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:41:57Z',
 'fuel_type': 'diesel',
 'id': 'd893e3aa-ec08-5028-9892-6271f0e7f430',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG30254',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 154624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_5852acef6944afbb8c04d4057e9db9b6.jpg',
                'https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_d2a348ec4c7d9cde6069d950b6ed5d7d.jpg',
                'https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_6d2495eddc1e06ac6e105f5b73e9cecb.jpg',
                'https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_0c373018a38e7e2da99ddcd117f72372.jpg',
                'https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_e10de38d808f99032217deb50340a10f.jpg',
                'https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_43e2630599feb2469ce51f4d3a2c3de4.jpg',
                'https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_c37ffa1ff72b67861d2e4ea85a62b0bd.jpg',
                'https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_472e19b8918f6196ee3c596c4cfc3ed1.jpg',
                'https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_3a91df8f71fea46fc0b3a2a42db151e5.jpg',
                'https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_e88d29ae65d542a9b261061a734633b2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d893e3aa-ec08-5028-9892-6271f0e7f430/d893e3aa-ec08-5028-9892-6271f0e7f430_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_5852acef6944afbb8c04d4057e9db9b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d893e3aa-ec08-5028-9892-6271f0e7f430/d893e3aa-ec08-5028-9892-6271f0e7f430_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2982245,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_d2a348ec4c7d9cde6069d950b6ed5d7d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d893e3aa-ec08-5028-9892-6271f0e7f430/d893e3aa-ec08-5028-9892-6271f0e7f430_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_6d2495eddc1e06ac6e105f5b73e9cecb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d893e3aa-ec08-5028-9892-6271f0e7f430/d893e3aa-ec08-5028-9892-6271f0e7f430_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2890444,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_0c373018a38e7e2da99ddcd117f72372.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d893e3aa-ec08-5028-9892-6271f0e7f430/d893e3aa-ec08-5028-9892-6271f0e7f430_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_e10de38d808f99032217deb50340a10f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d893e3aa-ec08-5028-9892-6271f0e7f430/d893e3aa-ec08-5028-9892-6271f0e7f430_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2967886,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_43e2630599feb2469ce51f4d3a2c3de4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d893e3aa-ec08-5028-9892-6271f0e7f430/d893e3aa-ec08-5028-9892-6271f0e7f430_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2752822,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_c37ffa1ff72b67861d2e4ea85a62b0bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d893e3aa-ec08-5028-9892-6271f0e7f430/d893e3aa-ec08-5028-9892-6271f0e7f430_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_472e19b8918f6196ee3c596c4cfc3ed1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d893e3aa-ec08-5028-9892-6271f0e7f430/d893e3aa-ec08-5028-9892-6271f0e7f430_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3039136,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_3a91df8f71fea46fc0b3a2a42db151e5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d893e3aa-ec08-5028-9892-6271f0e7f430/d893e3aa-ec08-5028-9892-6271f0e7f430_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3088375,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/12/2b12abdd4d97d1a3732162d83f92928d/pa/LG30254_e88d29ae65d542a9b261061a734633b2.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG30254%27 HTTP/1.1" 200 None
2026-03-30 10:34:13 [auto1.de] INFO: Saving data for LG30254: {'created_time': 1774866853.165848, 'last_price_update_time': 1774866853.165858, 'auction_closing_time': 1774971717.0}
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG30254') HTTP/1.1" 204 0
2026-03-30 10:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_71faf761705dabaac4403aeef027b2cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4d%252F584d214e19ba2e687f07a1b3c8a298b0%252Fpa%252FNG72110_1b3b098ba06639db3e7a6ac08bf9fed3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_1b3b098ba06639db3e7a6ac08bf9fed3.jpg not downloaded yet
2026-03-30 10:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_680d8fc38835ee7ec3421c7fa67ee253.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HJ01307> (referer: https://www.auto1.com/v1/car-details-view/HJ01307/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4d%252F584d214e19ba2e687f07a1b3c8a298b0%252Fpa%252FNG72110_f3af71645c9b6df45084bfa9dececed3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_f3af71645c9b6df45084bfa9dececed3.jpg not downloaded yet
2026-03-30 10:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB34738> (referer: https://www.auto1.com/v1/car-details-view/XB34738/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4d%252F584d214e19ba2e687f07a1b3c8a298b0%252Fpa%252FNG72110_1c7da707cbbaa3041082dbf337c1f43c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_1c7da707cbbaa3041082dbf337c1f43c.jpg not downloaded yet
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4d%252F584d214e19ba2e687f07a1b3c8a298b0%252Fpa%252FNG72110_68af4f619a565fb55ae43d06a684835b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_68af4f619a565fb55ae43d06a684835b.jpg not downloaded yet
2026-03-30 10:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_95cedbfa9309f95c3c0ad5615d5f00cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_bc8b3f9927f28b3d3cbfa5f34c3971c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef59450>
2026-03-30 10:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f48e8135-1333-590a-90f1-add68305e013/f48e8135-1333-590a-90f1-add68305e013_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F07%252F2707983b1e4186337980f670e70ec319%252Fpa%252FLJ61664_71faf761705dabaac4403aeef027b2cc.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_71faf761705dabaac4403aeef027b2cc.jpg saved to cache
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f48e8135-1333-590a-90f1-add68305e013
2026-03-30 10:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_0a2204a9cc93f537112d87852ddbcde5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14020c45d0>
2026-03-30 10:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_680d8fc38835ee7ec3421c7fa67ee253.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_680d8fc38835ee7ec3421c7fa67ee253.jpg saved to cache
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1282fb24-a056-5262-af8d-e3794f4665d2
2026-03-30 10:34:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac654143-76a8-5d1c-b50e-fc49c0e48a74 with identifier: HJ01307
2026-03-30 10:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac654143-76a8-5d1c-b50e-fc49c0e48a74 with scrape type 1
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ac654143-76a8-5d1c-b50e-fc49c0e48a74
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fd3%252F18d3488609940d8f52d8d14887769ad9%252Fpa%252FHJ01307_cdf55ab51d5b36f7d5d0f75586c0f71e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_cdf55ab51d5b36f7d5d0f75586c0f71e.jpg not downloaded yet
2026-03-30 10:34:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 609c05b5-bafa-5e3e-a21d-379e738f0d59 with identifier: XB34738
2026-03-30 10:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 609c05b5-bafa-5e3e-a21d-379e738f0d59 with scrape type 1
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 609c05b5-bafa-5e3e-a21d-379e738f0d59
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fcd%252F5ecd722a8b9e363aca9dc3dd59d9c5fe%252Fpa%252FXB34738_7b81feac1dc7912d1fcfb9a38c9949e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_7b81feac1dc7912d1fcfb9a38c9949e2.jpg already downloaded
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fcd%252F5ecd722a8b9e363aca9dc3dd59d9c5fe%252Fpa%252FXB34738_063ea435b2806d05ee00b8471c5376e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_063ea435b2806d05ee00b8471c5376e8.jpg already downloaded
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fcd%252F5ecd722a8b9e363aca9dc3dd59d9c5fe%252Fpa%252FXB34738_d89bbb5adab4bafa0035dd0dddcab1a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_d89bbb5adab4bafa0035dd0dddcab1a6.jpg already downloaded
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fcd%252F5ecd722a8b9e363aca9dc3dd59d9c5fe%252Fpa%252FXB34738_fefc5623ad2147837aaa2efd6cd283e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_fefc5623ad2147837aaa2efd6cd283e4.jpg already downloaded
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fcd%252F5ecd722a8b9e363aca9dc3dd59d9c5fe%252Fpa%252FXB34738_93a58122aad7841c9830ed068cba7757.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_93a58122aad7841c9830ed068cba7757.jpg already downloaded
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fcd%252F5ecd722a8b9e363aca9dc3dd59d9c5fe%252Fpa%252FXB34738_dbcd7f68f8f9ae95a23e7de83274e878.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_dbcd7f68f8f9ae95a23e7de83274e878.jpg already downloaded
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fcd%252F5ecd722a8b9e363aca9dc3dd59d9c5fe%252Fpa%252FXB34738_5ab64077d35d7e8c5008b9d680d86621.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_5ab64077d35d7e8c5008b9d680d86621.jpg already downloaded
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fcd%252F5ecd722a8b9e363aca9dc3dd59d9c5fe%252Fpa%252FXB34738_dd70b901ca08b73180c1e15533d4f3e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_dd70b901ca08b73180c1e15533d4f3e1.jpg already downloaded
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fcd%252F5ecd722a8b9e363aca9dc3dd59d9c5fe%252Fpa%252FXB34738_c82f70140db39f1cd2d20ce55ab9b424.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_c82f70140db39f1cd2d20ce55ab9b424.jpg already downloaded
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fcd%252F5ecd722a8b9e363aca9dc3dd59d9c5fe%252Fpa%252FXB34738_bb5e9dbade8abc6f5940d6996cf30985.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_bb5e9dbade8abc6f5940d6996cf30985.jpg already downloaded
2026-03-30 10:34:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 609c05b5-bafa-5e3e-a21d-379e738f0d59, identifier: XB34738
2026-03-30 10:34:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41fd850>
2026-03-30 10:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_95cedbfa9309f95c3c0ad5615d5f00cc.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_95cedbfa9309f95c3c0ad5615d5f00cc.jpg saved to cache
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0633b60-85a2-5c37-969f-e882908006de
2026-03-30 10:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f425bcd0>
2026-03-30 10:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f48e8135-1333-590a-90f1-add68305e013/f48e8135-1333-590a-90f1-add68305e013_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F07%252F2707983b1e4186337980f670e70ec319%252Fpa%252FLJ61664_bc8b3f9927f28b3d3cbfa5f34c3971c4.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_bc8b3f9927f28b3d3cbfa5f34c3971c4.jpg saved to cache
2026-03-30 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f48e8135-1333-590a-90f1-add68305e013
2026-03-30 10:34:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 609c05b5-bafa-5e3e-a21d-379e738f0d59 with identifier: XB34738
2026-03-30 10:34:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 609c05b5-bafa-5e3e-a21d-379e738f0d59 with identifier: XB34738
2026-03-30 10:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 609c05b5-bafa-5e3e-a21d-379e738f0d59 with identifier: XB34738 to the API
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XB34738>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.4L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:51:00Z',
 'fuel_type': 'diesel',
 'id': '609c05b5-bafa-5e3e-a21d-379e738f0d59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB34738',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 169723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_7b81feac1dc7912d1fcfb9a38c9949e2.jpg',
                'https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_063ea435b2806d05ee00b8471c5376e8.jpg',
                'https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_d89bbb5adab4bafa0035dd0dddcab1a6.jpg',
                'https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_fefc5623ad2147837aaa2efd6cd283e4.jpg',
                'https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_93a58122aad7841c9830ed068cba7757.jpg',
                'https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_dbcd7f68f8f9ae95a23e7de83274e878.jpg',
                'https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_5ab64077d35d7e8c5008b9d680d86621.jpg',
                'https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_dd70b901ca08b73180c1e15533d4f3e1.jpg',
                'https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_c82f70140db39f1cd2d20ce55ab9b424.jpg',
                'https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_bb5e9dbade8abc6f5940d6996cf30985.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_609c05b5-bafa-5e3e-a21d-379e738f0d59/609c05b5-bafa-5e3e-a21d-379e738f0d59_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_7b81feac1dc7912d1fcfb9a38c9949e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_609c05b5-bafa-5e3e-a21d-379e738f0d59/609c05b5-bafa-5e3e-a21d-379e738f0d59_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_063ea435b2806d05ee00b8471c5376e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_609c05b5-bafa-5e3e-a21d-379e738f0d59/609c05b5-bafa-5e3e-a21d-379e738f0d59_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_d89bbb5adab4bafa0035dd0dddcab1a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_609c05b5-bafa-5e3e-a21d-379e738f0d59/609c05b5-bafa-5e3e-a21d-379e738f0d59_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_fefc5623ad2147837aaa2efd6cd283e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_609c05b5-bafa-5e3e-a21d-379e738f0d59/609c05b5-bafa-5e3e-a21d-379e738f0d59_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_93a58122aad7841c9830ed068cba7757.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_609c05b5-bafa-5e3e-a21d-379e738f0d59/609c05b5-bafa-5e3e-a21d-379e738f0d59_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 6869,
             'Height': 144,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_dbcd7f68f8f9ae95a23e7de83274e878.jpg',
             'Width': 192},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_609c05b5-bafa-5e3e-a21d-379e738f0d59/609c05b5-bafa-5e3e-a21d-379e738f0d59_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_5ab64077d35d7e8c5008b9d680d86621.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_609c05b5-bafa-5e3e-a21d-379e738f0d59/609c05b5-bafa-5e3e-a21d-379e738f0d59_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_dd70b901ca08b73180c1e15533d4f3e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_609c05b5-bafa-5e3e-a21d-379e738f0d59/609c05b5-bafa-5e3e-a21d-379e738f0d59_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_c82f70140db39f1cd2d20ce55ab9b424.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_609c05b5-bafa-5e3e-a21d-379e738f0d59/609c05b5-bafa-5e3e-a21d-379e738f0d59_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/cd/5ecd722a8b9e363aca9dc3dd59d9c5fe/pa/XB34738_bb5e9dbade8abc6f5940d6996cf30985.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D4 Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2017}
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB34738%27 HTTP/1.1" 200 None
2026-03-30 10:34:14 [auto1.de] INFO: Saving data for XB34738: {'created_time': 1774866854.361829, 'last_price_update_time': 1774866854.361844, 'auction_closing_time': 1774972260.0}
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB34738') HTTP/1.1" 204 0
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fd3%252F18d3488609940d8f52d8d14887769ad9%252Fpa%252FHJ01307_c423e2720d264dac9051750ad8c934c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_c423e2720d264dac9051750ad8c934c3.jpg not downloaded yet
2026-03-30 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_b20f90da8142a22a2184624d195b155b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_1e5aafa289841eaae6121afd77753fc2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_db0a70667a2108578bf12b8122efecd9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fd3%252F18d3488609940d8f52d8d14887769ad9%252Fpa%252FHJ01307_d59ea5e0d7631b0b01b535c4242d72bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_d59ea5e0d7631b0b01b535c4242d72bf.jpg not downloaded yet
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43ab810>
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f48e8135-1333-590a-90f1-add68305e013/f48e8135-1333-590a-90f1-add68305e013_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F07%252F2707983b1e4186337980f670e70ec319%252Fpa%252FLJ61664_0a2204a9cc93f537112d87852ddbcde5.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_0a2204a9cc93f537112d87852ddbcde5.jpg saved to cache
2026-03-30 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f48e8135-1333-590a-90f1-add68305e013
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fd3%252F18d3488609940d8f52d8d14887769ad9%252Fpa%252FHJ01307_840ba09f852b8b3ddb823d50b98c0106.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_840ba09f852b8b3ddb823d50b98c0106.jpg not downloaded yet
2026-03-30 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_8870d98ed3de56914b3e008da05dfc99.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_5556254b05749c3897885a1eca6dd33a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fd3%252F18d3488609940d8f52d8d14887769ad9%252Fpa%252FHJ01307_01a8434258afd4d8897bbfcd3e4bfbf4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_01a8434258afd4d8897bbfcd3e4bfbf4.jpg not downloaded yet
2026-03-30 10:34:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8dbd0>
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_b20f90da8142a22a2184624d195b155b.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_b20f90da8142a22a2184624d195b155b.jpg saved to cache
2026-03-30 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 07d56e91-8bc4-5a9c-8a42-fcc230c9f725
2026-03-30 10:34:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9bb50>
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_1e5aafa289841eaae6121afd77753fc2.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_1e5aafa289841eaae6121afd77753fc2.jpg saved to cache
2026-03-30 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 711156bf-6f01-53b7-8b3e-e6f97a4fa70e
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f420c050>
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f48e8135-1333-590a-90f1-add68305e013/f48e8135-1333-590a-90f1-add68305e013_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F07%252F2707983b1e4186337980f670e70ec319%252Fpa%252FLJ61664_db0a70667a2108578bf12b8122efecd9.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_db0a70667a2108578bf12b8122efecd9.jpg saved to cache
2026-03-30 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f48e8135-1333-590a-90f1-add68305e013
2026-03-30 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_fcb34659e6aad595fba128ee383ad683.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_74c9a568e46628842a8747066ee0dbc1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_cdf55ab51d5b36f7d5d0f75586c0f71e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_1b3b098ba06639db3e7a6ac08bf9fed3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4389c90>
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_8870d98ed3de56914b3e008da05dfc99.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_8870d98ed3de56914b3e008da05dfc99.jpg saved to cache
2026-03-30 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 711156bf-6f01-53b7-8b3e-e6f97a4fa70e
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f611f850>
2026-03-30 10:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60f9bb57-fb10-51bc-a6ba-b8ff758818ac/60f9bb57-fb10-51bc-a6ba-b8ff758818ac_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4d%252F584d214e19ba2e687f07a1b3c8a298b0%252Fpa%252FNG72110_5556254b05749c3897885a1eca6dd33a.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_5556254b05749c3897885a1eca6dd33a.jpg saved to cache
2026-03-30 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60f9bb57-fb10-51bc-a6ba-b8ff758818ac
2026-03-30 10:34:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4337b50>
2026-03-30 10:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_fcb34659e6aad595fba128ee383ad683.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_fcb34659e6aad595fba128ee383ad683.jpg saved to cache
2026-03-30 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 711156bf-6f01-53b7-8b3e-e6f97a4fa70e
2026-03-30 10:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee5eed0>
2026-03-30 10:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f48e8135-1333-590a-90f1-add68305e013/f48e8135-1333-590a-90f1-add68305e013_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F07%252F2707983b1e4186337980f670e70ec319%252Fpa%252FLJ61664_74c9a568e46628842a8747066ee0dbc1.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_74c9a568e46628842a8747066ee0dbc1.jpg saved to cache
2026-03-30 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f48e8135-1333-590a-90f1-add68305e013
2026-03-30 10:34:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f48e8135-1333-590a-90f1-add68305e013, skipping ID generation
2026-03-30 10:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f48e8135-1333-590a-90f1-add68305e013 with scrape type 1
2026-03-30 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f48e8135-1333-590a-90f1-add68305e013 sending to next pipeline
2026-03-30 10:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f48e8135-1333-590a-90f1-add68305e013, identifier: LJ61664
2026-03-30 10:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4255550>
2026-03-30 10:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac654143-76a8-5d1c-b50e-fc49c0e48a74/ac654143-76a8-5d1c-b50e-fc49c0e48a74_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fd3%252F18d3488609940d8f52d8d14887769ad9%252Fpa%252FHJ01307_cdf55ab51d5b36f7d5d0f75586c0f71e.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_cdf55ab51d5b36f7d5d0f75586c0f71e.jpg saved to cache
2026-03-30 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac654143-76a8-5d1c-b50e-fc49c0e48a74
2026-03-30 10:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f411f550>
2026-03-30 10:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60f9bb57-fb10-51bc-a6ba-b8ff758818ac/60f9bb57-fb10-51bc-a6ba-b8ff758818ac_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4d%252F584d214e19ba2e687f07a1b3c8a298b0%252Fpa%252FNG72110_1b3b098ba06639db3e7a6ac08bf9fed3.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_1b3b098ba06639db3e7a6ac08bf9fed3.jpg saved to cache
2026-03-30 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60f9bb57-fb10-51bc-a6ba-b8ff758818ac
2026-03-30 10:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f48e8135-1333-590a-90f1-add68305e013 with identifier: LJ61664
2026-03-30 10:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f48e8135-1333-590a-90f1-add68305e013 with identifier: LJ61664
2026-03-30 10:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f48e8135-1333-590a-90f1-add68305e013 with identifier: LJ61664 to the API
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_74c9a568e46628842a8747066ee0dbc1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:56:33Z',
 'fuel_type': 'petrol',
 'id': 'f48e8135-1333-590a-90f1-add68305e013',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ61664',
 'listing': 'auction',
 'location': 'DE, Kandel',
 'make': 'Toyota',
 'model': 'Corolla Verso',
 'odometer': 189577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f48e8135-1333-590a-90f1-add68305e013/f48e8135-1333-590a-90f1-add68305e013_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_74c9a568e46628842a8747066ee0dbc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f48e8135-1333-590a-90f1-add68305e013/f48e8135-1333-590a-90f1-add68305e013_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_db0a70667a2108578bf12b8122efecd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f48e8135-1333-590a-90f1-add68305e013/f48e8135-1333-590a-90f1-add68305e013_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_0a2204a9cc93f537112d87852ddbcde5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f48e8135-1333-590a-90f1-add68305e013/f48e8135-1333-590a-90f1-add68305e013_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_bc8b3f9927f28b3d3cbfa5f34c3971c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f48e8135-1333-590a-90f1-add68305e013/f48e8135-1333-590a-90f1-add68305e013_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/07/2707983b1e4186337980f670e70ec319/pa/LJ61664_71faf761705dabaac4403aeef027b2cc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Corolla Verso 1.8 Luna',
 'transmission': 'manual',
 'trim': 'Luna',
 'year': 2004}
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ61664%27 HTTP/1.1" 200 None
2026-03-30 10:34:16 [auto1.de] INFO: Saving data for LJ61664: {'created_time': 1774866856.033892, 'last_price_update_time': 1774866856.033905, 'auction_closing_time': 1774972593.0}
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ61664') HTTP/1.1" 204 0
2026-03-30 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_68af4f619a565fb55ae43d06a684835b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_f3af71645c9b6df45084bfa9dececed3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_1c7da707cbbaa3041082dbf337c1f43c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_01a8434258afd4d8897bbfcd3e4bfbf4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_6876d9d67db3ff6014814b3febacf845.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_1030e28e30d069d103f869e0ea0240a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_3acc085cc4a809a5d1c49a2ad9ff58af.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_1567b7c5005071128fc4a738d82304e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_d59ea5e0d7631b0b01b535c4242d72bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_840ba09f852b8b3ddb823d50b98c0106.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_0332f6b7e8d57bdf72beb4beb9e51ee4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_c423e2720d264dac9051750ad8c934c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_d749124209ba4f0d5139d7f47c3fc999.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_f1894570c0a53c9bd012a683f553c61b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58d4350>
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60f9bb57-fb10-51bc-a6ba-b8ff758818ac/60f9bb57-fb10-51bc-a6ba-b8ff758818ac_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4d%252F584d214e19ba2e687f07a1b3c8a298b0%252Fpa%252FNG72110_68af4f619a565fb55ae43d06a684835b.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_68af4f619a565fb55ae43d06a684835b.jpg saved to cache
2026-03-30 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60f9bb57-fb10-51bc-a6ba-b8ff758818ac
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd8b90>
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60f9bb57-fb10-51bc-a6ba-b8ff758818ac/60f9bb57-fb10-51bc-a6ba-b8ff758818ac_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4d%252F584d214e19ba2e687f07a1b3c8a298b0%252Fpa%252FNG72110_f3af71645c9b6df45084bfa9dececed3.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_f3af71645c9b6df45084bfa9dececed3.jpg saved to cache
2026-03-30 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60f9bb57-fb10-51bc-a6ba-b8ff758818ac
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef38c90>
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60f9bb57-fb10-51bc-a6ba-b8ff758818ac/60f9bb57-fb10-51bc-a6ba-b8ff758818ac_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4d%252F584d214e19ba2e687f07a1b3c8a298b0%252Fpa%252FNG72110_1c7da707cbbaa3041082dbf337c1f43c.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_1c7da707cbbaa3041082dbf337c1f43c.jpg saved to cache
2026-03-30 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60f9bb57-fb10-51bc-a6ba-b8ff758818ac
2026-03-30 10:34:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60f9bb57-fb10-51bc-a6ba-b8ff758818ac, skipping ID generation
2026-03-30 10:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60f9bb57-fb10-51bc-a6ba-b8ff758818ac with scrape type 1
2026-03-30 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60f9bb57-fb10-51bc-a6ba-b8ff758818ac sending to next pipeline
2026-03-30 10:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60f9bb57-fb10-51bc-a6ba-b8ff758818ac, identifier: NG72110
2026-03-30 10:34:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60f9bb57-fb10-51bc-a6ba-b8ff758818ac with identifier: NG72110
2026-03-30 10:34:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60f9bb57-fb10-51bc-a6ba-b8ff758818ac with identifier: NG72110
2026-03-30 10:34:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60f9bb57-fb10-51bc-a6ba-b8ff758818ac with identifier: NG72110 to the API
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_1c7da707cbbaa3041082dbf337c1f43c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:43:13Z',
 'fuel_type': 'petrol',
 'id': '60f9bb57-fb10-51bc-a6ba-b8ff758818ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG72110',
 'listing': 'auction',
 'location': 'DE, Magdeburg',
 'make': 'Chevrolet',
 'model': 'Aveo',
 'odometer': 172035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60f9bb57-fb10-51bc-a6ba-b8ff758818ac/60f9bb57-fb10-51bc-a6ba-b8ff758818ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_5556254b05749c3897885a1eca6dd33a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60f9bb57-fb10-51bc-a6ba-b8ff758818ac/60f9bb57-fb10-51bc-a6ba-b8ff758818ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_1b3b098ba06639db3e7a6ac08bf9fed3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60f9bb57-fb10-51bc-a6ba-b8ff758818ac/60f9bb57-fb10-51bc-a6ba-b8ff758818ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_f3af71645c9b6df45084bfa9dececed3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60f9bb57-fb10-51bc-a6ba-b8ff758818ac/60f9bb57-fb10-51bc-a6ba-b8ff758818ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_1c7da707cbbaa3041082dbf337c1f43c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60f9bb57-fb10-51bc-a6ba-b8ff758818ac/60f9bb57-fb10-51bc-a6ba-b8ff758818ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/4d/584d214e19ba2e687f07a1b3c8a298b0/pa/NG72110_68af4f619a565fb55ae43d06a684835b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Chevrolet Aveo 1.2 LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2011}
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG72110%27 HTTP/1.1" 200 None
2026-03-30 10:34:16 [auto1.de] INFO: Saving data for NG72110: {'created_time': 1774866856.811205, 'last_price_update_time': 1774866856.811222, 'auction_closing_time': 1774971793.0}
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG72110') HTTP/1.1" 204 0
2026-03-30 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_ebd5358f509e34cebd4f487f54358c1d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_687e92b0227eb2a412a6097e3b6333b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434c410>
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac654143-76a8-5d1c-b50e-fc49c0e48a74/ac654143-76a8-5d1c-b50e-fc49c0e48a74_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fd3%252F18d3488609940d8f52d8d14887769ad9%252Fpa%252FHJ01307_01a8434258afd4d8897bbfcd3e4bfbf4.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_01a8434258afd4d8897bbfcd3e4bfbf4.jpg saved to cache
2026-03-30 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac654143-76a8-5d1c-b50e-fc49c0e48a74
2026-03-30 10:34:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee463b50>
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_6876d9d67db3ff6014814b3febacf845.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_6876d9d67db3ff6014814b3febacf845.jpg saved to cache
2026-03-30 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 711156bf-6f01-53b7-8b3e-e6f97a4fa70e
2026-03-30 10:34:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee46b550>
2026-03-30 10:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_1030e28e30d069d103f869e0ea0240a1.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_1030e28e30d069d103f869e0ea0240a1.jpg saved to cache
2026-03-30 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 711156bf-6f01-53b7-8b3e-e6f97a4fa70e
2026-03-30 10:34:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee463d90>
2026-03-30 10:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_3acc085cc4a809a5d1c49a2ad9ff58af.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_3acc085cc4a809a5d1c49a2ad9ff58af.jpg saved to cache
2026-03-30 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 711156bf-6f01-53b7-8b3e-e6f97a4fa70e
2026-03-30 10:34:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee47f250>
2026-03-30 10:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_1567b7c5005071128fc4a738d82304e9.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_1567b7c5005071128fc4a738d82304e9.jpg saved to cache
2026-03-30 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 711156bf-6f01-53b7-8b3e-e6f97a4fa70e
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee479250>
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac654143-76a8-5d1c-b50e-fc49c0e48a74/ac654143-76a8-5d1c-b50e-fc49c0e48a74_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fd3%252F18d3488609940d8f52d8d14887769ad9%252Fpa%252FHJ01307_d59ea5e0d7631b0b01b535c4242d72bf.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_d59ea5e0d7631b0b01b535c4242d72bf.jpg saved to cache
2026-03-30 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac654143-76a8-5d1c-b50e-fc49c0e48a74
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee472e50>
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac654143-76a8-5d1c-b50e-fc49c0e48a74/ac654143-76a8-5d1c-b50e-fc49c0e48a74_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fd3%252F18d3488609940d8f52d8d14887769ad9%252Fpa%252FHJ01307_840ba09f852b8b3ddb823d50b98c0106.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_840ba09f852b8b3ddb823d50b98c0106.jpg saved to cache
2026-03-30 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac654143-76a8-5d1c-b50e-fc49c0e48a74
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef51650>
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_0332f6b7e8d57bdf72beb4beb9e51ee4.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_0332f6b7e8d57bdf72beb4beb9e51ee4.jpg saved to cache
2026-03-30 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07d56e91-8bc4-5a9c-8a42-fcc230c9f725
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4799d0>
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac654143-76a8-5d1c-b50e-fc49c0e48a74/ac654143-76a8-5d1c-b50e-fc49c0e48a74_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fd3%252F18d3488609940d8f52d8d14887769ad9%252Fpa%252FHJ01307_c423e2720d264dac9051750ad8c934c3.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_c423e2720d264dac9051750ad8c934c3.jpg saved to cache
2026-03-30 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac654143-76a8-5d1c-b50e-fc49c0e48a74
2026-03-30 10:34:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac654143-76a8-5d1c-b50e-fc49c0e48a74, skipping ID generation
2026-03-30 10:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac654143-76a8-5d1c-b50e-fc49c0e48a74 with scrape type 1
2026-03-30 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac654143-76a8-5d1c-b50e-fc49c0e48a74 sending to next pipeline
2026-03-30 10:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac654143-76a8-5d1c-b50e-fc49c0e48a74, identifier: HJ01307
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4149010>
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fc9%252F8dc9480fc05a3fc24ca350882c729ded%252Fpa%252FNV44287_d749124209ba4f0d5139d7f47c3fc999.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_d749124209ba4f0d5139d7f47c3fc999.jpg saved to cache
2026-03-30 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07d56e91-8bc4-5a9c-8a42-fcc230c9f725
2026-03-30 10:34:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07d56e91-8bc4-5a9c-8a42-fcc230c9f725, skipping ID generation
2026-03-30 10:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07d56e91-8bc4-5a9c-8a42-fcc230c9f725 with scrape type 1
2026-03-30 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07d56e91-8bc4-5a9c-8a42-fcc230c9f725 sending to next pipeline
2026-03-30 10:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07d56e91-8bc4-5a9c-8a42-fcc230c9f725, identifier: NV44287
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee463a10>
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_f1894570c0a53c9bd012a683f553c61b.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_f1894570c0a53c9bd012a683f553c61b.jpg saved to cache
2026-03-30 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0633b60-85a2-5c37-969f-e882908006de
2026-03-30 10:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac654143-76a8-5d1c-b50e-fc49c0e48a74 with identifier: HJ01307
2026-03-30 10:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac654143-76a8-5d1c-b50e-fc49c0e48a74 with identifier: HJ01307
2026-03-30 10:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac654143-76a8-5d1c-b50e-fc49c0e48a74 with identifier: HJ01307 to the API
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_c423e2720d264dac9051750ad8c934c3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.4L',
 'engine_horse_power': 98,
 'expiration_date': '2026-03-31T15:51:07Z',
 'fuel_type': 'petrol',
 'id': 'ac654143-76a8-5d1c-b50e-fc49c0e48a74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ01307',
 'listing': 'auction',
 'location': 'DE, Saarlouis',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 131232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac654143-76a8-5d1c-b50e-fc49c0e48a74/ac654143-76a8-5d1c-b50e-fc49c0e48a74_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_cdf55ab51d5b36f7d5d0f75586c0f71e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac654143-76a8-5d1c-b50e-fc49c0e48a74/ac654143-76a8-5d1c-b50e-fc49c0e48a74_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_c423e2720d264dac9051750ad8c934c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac654143-76a8-5d1c-b50e-fc49c0e48a74/ac654143-76a8-5d1c-b50e-fc49c0e48a74_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_d59ea5e0d7631b0b01b535c4242d72bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac654143-76a8-5d1c-b50e-fc49c0e48a74/ac654143-76a8-5d1c-b50e-fc49c0e48a74_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_840ba09f852b8b3ddb823d50b98c0106.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac654143-76a8-5d1c-b50e-fc49c0e48a74/ac654143-76a8-5d1c-b50e-fc49c0e48a74_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/d3/18d3488609940d8f52d8d14887769ad9/pa/HJ01307_01a8434258afd4d8897bbfcd3e4bfbf4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.4 Emotion',
 'transmission': 'manual',
 'trim': 'Emotion',
 'year': 2004}
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ01307%27 HTTP/1.1" 200 None
2026-03-30 10:34:18 [auto1.de] INFO: Saving data for HJ01307: {'created_time': 1774866858.87663, 'last_price_update_time': 1774866858.876641, 'auction_closing_time': 1774972267.0}
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ01307') HTTP/1.1" 204 0
2026-03-30 10:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07d56e91-8bc4-5a9c-8a42-fcc230c9f725 with identifier: NV44287
2026-03-30 10:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07d56e91-8bc4-5a9c-8a42-fcc230c9f725 with identifier: NV44287
2026-03-30 10:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07d56e91-8bc4-5a9c-8a42-fcc230c9f725 with identifier: NV44287 to the API
2026-03-30 10:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_d749124209ba4f0d5139d7f47c3fc999.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:09:24Z',
 'fuel_type': 'petrol',
 'id': '07d56e91-8bc4-5a9c-8a42-fcc230c9f725',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV44287',
 'listing': 'auction',
 'location': 'DE, Wuppertal',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 245016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47295,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_d749124209ba4f0d5139d7f47c3fc999.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35325,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_18386df8762231c937736b4094526dd2.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50313,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_0332f6b7e8d57bdf72beb4beb9e51ee4.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43060,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_9a7d298660850ba412b290ba4189dd9f.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41721,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_65ac9b42c7cd4c03c325c231c6d3b88f.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45209,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_e9ada3cf06c208da8b2b7f6997a3becf.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35930,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_0aeccc022e156e5b1a2f816cb9afb643.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55626,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_1fc4fbcd92b8f35a0e6c75a754ae97da.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2998018,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_b20f90da8142a22a2184624d195b155b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d56e91-8bc4-5a9c-8a42-fcc230c9f725/07d56e91-8bc4-5a9c-8a42-fcc230c9f725_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/c9/8dc9480fc05a3fc24ca350882c729ded/pa/NV44287_7050f27ea34cdcc4451c93404f34f4cf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2015}
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV44287%27 HTTP/1.1" 200 None
2026-03-30 10:34:19 [auto1.de] INFO: Saving data for NV44287: {'created_time': 1774866859.640843, 'last_price_update_time': 1774866859.640858, 'auction_closing_time': 1774969764.0}
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV44287') HTTP/1.1" 204 0
2026-03-30 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KN27665> (referer: https://www.auto1.com/v1/car-details-view/KN27665/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec63d0>
2026-03-30 10:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_ebd5358f509e34cebd4f487f54358c1d.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_ebd5358f509e34cebd4f487f54358c1d.jpg saved to cache
2026-03-30 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0633b60-85a2-5c37-969f-e882908006de
2026-03-30 10:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec5c90>
2026-03-30 10:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_687e92b0227eb2a412a6097e3b6333b8.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_687e92b0227eb2a412a6097e3b6333b8.jpg saved to cache
2026-03-30 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0633b60-85a2-5c37-969f-e882908006de
2026-03-30 10:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e261d4bd-4f18-5521-8139-1bb6392e8bd7 with identifier: KN27665
2026-03-30 10:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e261d4bd-4f18-5521-8139-1bb6392e8bd7 with scrape type 1
2026-03-30 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e261d4bd-4f18-5521-8139-1bb6392e8bd7
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fc9%252Fc1c9e53dab0cd75557ac8d296d146714%252Fpa%252FKN27665_7323f2a48c864f54ab22fc24397e586b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_7323f2a48c864f54ab22fc24397e586b.jpg not downloaded yet
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fc9%252Fc1c9e53dab0cd75557ac8d296d146714%252Fpa%252FKN27665_d41ccc057ae509d79cf2a6ef9db7c061.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_d41ccc057ae509d79cf2a6ef9db7c061.jpg not downloaded yet
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fc9%252Fc1c9e53dab0cd75557ac8d296d146714%252Fpa%252FKN27665_7864ba98040731b0fa5d418df79e28d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_7864ba98040731b0fa5d418df79e28d2.jpg not downloaded yet
2026-03-30 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_4346dde67a5dbd00056e01ff2192641b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_aeabb1094de2948074c12315d26cc1a5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fc9%252Fc1c9e53dab0cd75557ac8d296d146714%252Fpa%252FKN27665_efe512d5fd08764d7bab8c3a18c23cf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_efe512d5fd08764d7bab8c3a18c23cf3.jpg not downloaded yet
2026-03-30 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_73a2eee1799d824e34d8a17b2dda7712.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_7bf86899958182dee69fd88f12986832.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fc9%252Fc1c9e53dab0cd75557ac8d296d146714%252Fpa%252FKN27665_aa8cc3c186ec1d6ccef20c0bebc51dc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_aa8cc3c186ec1d6ccef20c0bebc51dc7.jpg not downloaded yet
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fc9%252Fc1c9e53dab0cd75557ac8d296d146714%252Fpa%252FKN27665_39a0ac5c54f99e2d46c5a2d7799f4142.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_39a0ac5c54f99e2d46c5a2d7799f4142.jpg not downloaded yet
2026-03-30 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_2ef9c5e9dc0f33c1bca669427c830547.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_984177535fb9ae13859e6125977dd2bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_a8d6297669db36cde91ab93ac6a39621.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee93750>
2026-03-30 10:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_4346dde67a5dbd00056e01ff2192641b.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_4346dde67a5dbd00056e01ff2192641b.jpg saved to cache
2026-03-30 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0633b60-85a2-5c37-969f-e882908006de
2026-03-30 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_8a0a7e652527b824550692382fecae0f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_7864ba98040731b0fa5d418df79e28d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee97850>
2026-03-30 10:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_aeabb1094de2948074c12315d26cc1a5.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_aeabb1094de2948074c12315d26cc1a5.jpg saved to cache
2026-03-30 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0633b60-85a2-5c37-969f-e882908006de
2026-03-30 10:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d76d0>
2026-03-30 10:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df23a1a5-fbcc-56d9-93fe-3d980673ee74/df23a1a5-fbcc-56d9-93fe-3d980673ee74_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2f%252Fa72fce2b5e9e4d55c98b0957b48733c5%252Fpa%252FSE03800_73a2eee1799d824e34d8a17b2dda7712.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_73a2eee1799d824e34d8a17b2dda7712.jpg saved to cache
2026-03-30 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df23a1a5-fbcc-56d9-93fe-3d980673ee74
2026-03-30 10:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4235e10>
2026-03-30 10:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df23a1a5-fbcc-56d9-93fe-3d980673ee74/df23a1a5-fbcc-56d9-93fe-3d980673ee74_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2f%252Fa72fce2b5e9e4d55c98b0957b48733c5%252Fpa%252FSE03800_7bf86899958182dee69fd88f12986832.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_7bf86899958182dee69fd88f12986832.jpg saved to cache
2026-03-30 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df23a1a5-fbcc-56d9-93fe-3d980673ee74
2026-03-30 10:34:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df23a1a5-fbcc-56d9-93fe-3d980673ee74, skipping ID generation
2026-03-30 10:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df23a1a5-fbcc-56d9-93fe-3d980673ee74 with scrape type 1
2026-03-30 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df23a1a5-fbcc-56d9-93fe-3d980673ee74 sending to next pipeline
2026-03-30 10:34:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df23a1a5-fbcc-56d9-93fe-3d980673ee74, identifier: SE03800
2026-03-30 10:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df23a1a5-fbcc-56d9-93fe-3d980673ee74 with identifier: SE03800
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 10:34:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:34:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df23a1a5-fbcc-56d9-93fe-3d980673ee74 with identifier: SE03800
2026-03-30 10:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df23a1a5-fbcc-56d9-93fe-3d980673ee74 with identifier: SE03800 to the API
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_7bf86899958182dee69fd88f12986832.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:22:55Z',
 'fuel_type': 'petrol',
 'id': 'df23a1a5-fbcc-56d9-93fe-3d980673ee74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE03800',
 'listing': 'auction',
 'location': 'DE, München',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 110778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df23a1a5-fbcc-56d9-93fe-3d980673ee74/df23a1a5-fbcc-56d9-93fe-3d980673ee74_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_35348a2973229236cae1826f1494e1d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df23a1a5-fbcc-56d9-93fe-3d980673ee74/df23a1a5-fbcc-56d9-93fe-3d980673ee74_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_3fdcc26c092d8107e68c5d354239237f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df23a1a5-fbcc-56d9-93fe-3d980673ee74/df23a1a5-fbcc-56d9-93fe-3d980673ee74_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_73a2eee1799d824e34d8a17b2dda7712.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df23a1a5-fbcc-56d9-93fe-3d980673ee74/df23a1a5-fbcc-56d9-93fe-3d980673ee74_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_356f45891c63f775c9adca7dd985c1fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df23a1a5-fbcc-56d9-93fe-3d980673ee74/df23a1a5-fbcc-56d9-93fe-3d980673ee74_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_7bf86899958182dee69fd88f12986832.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df23a1a5-fbcc-56d9-93fe-3d980673ee74/df23a1a5-fbcc-56d9-93fe-3d980673ee74_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2f/a72fce2b5e9e4d55c98b0957b48733c5/pa/SE03800_1fc110119dbf16e3d3f186031129d01b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-05-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Edition Dynamique',
 'transmission': 'manual',
 'trim': 'Edition Dynamique',
 'year': 2006}
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE03800%27 HTTP/1.1" 200 None
2026-03-30 10:34:20 [auto1.de] INFO: Saving data for SE03800: {'created_time': 1774866860.723068, 'last_price_update_time': 1774866860.723078, 'auction_closing_time': 1774970575.0}
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE03800') HTTP/1.1" 204 0
2026-03-30 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_7323f2a48c864f54ab22fc24397e586b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_d41ccc057ae509d79cf2a6ef9db7c061.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d2450>
2026-03-30 10:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_2ef9c5e9dc0f33c1bca669427c830547.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_2ef9c5e9dc0f33c1bca669427c830547.jpg saved to cache
2026-03-30 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 711156bf-6f01-53b7-8b3e-e6f97a4fa70e
2026-03-30 10:34:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee5db90>
2026-03-30 10:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_984177535fb9ae13859e6125977dd2bf.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_984177535fb9ae13859e6125977dd2bf.jpg saved to cache
2026-03-30 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 711156bf-6f01-53b7-8b3e-e6f97a4fa70e
2026-03-30 10:34:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f432d8d0>
2026-03-30 10:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc5%252F16c5ad381c10f0151db87358782a1e52%252Fpa%252FAT48689_a8d6297669db36cde91ab93ac6a39621.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_a8d6297669db36cde91ab93ac6a39621.jpg saved to cache
2026-03-30 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 711156bf-6f01-53b7-8b3e-e6f97a4fa70e
2026-03-30 10:34:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 711156bf-6f01-53b7-8b3e-e6f97a4fa70e, skipping ID generation
2026-03-30 10:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 711156bf-6f01-53b7-8b3e-e6f97a4fa70e with scrape type 1
2026-03-30 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 711156bf-6f01-53b7-8b3e-e6f97a4fa70e sending to next pipeline
2026-03-30 10:34:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 711156bf-6f01-53b7-8b3e-e6f97a4fa70e, identifier: AT48689
2026-03-30 10:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4143d10>
2026-03-30 10:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff6%252F34f61191ebb498192f9e3b005d339a30%252Fpa%252FGT90153_8a0a7e652527b824550692382fecae0f.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_8a0a7e652527b824550692382fecae0f.jpg saved to cache
2026-03-30 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0633b60-85a2-5c37-969f-e882908006de
2026-03-30 10:34:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0633b60-85a2-5c37-969f-e882908006de, skipping ID generation
2026-03-30 10:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0633b60-85a2-5c37-969f-e882908006de with scrape type 1
2026-03-30 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0633b60-85a2-5c37-969f-e882908006de sending to next pipeline
2026-03-30 10:34:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0633b60-85a2-5c37-969f-e882908006de, identifier: GT90153
2026-03-30 10:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4141310>
2026-03-30 10:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e261d4bd-4f18-5521-8139-1bb6392e8bd7/e261d4bd-4f18-5521-8139-1bb6392e8bd7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fc9%252Fc1c9e53dab0cd75557ac8d296d146714%252Fpa%252FKN27665_7864ba98040731b0fa5d418df79e28d2.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_7864ba98040731b0fa5d418df79e28d2.jpg saved to cache
2026-03-30 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e261d4bd-4f18-5521-8139-1bb6392e8bd7
2026-03-30 10:34:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 711156bf-6f01-53b7-8b3e-e6f97a4fa70e with identifier: AT48689
2026-03-30 10:34:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 711156bf-6f01-53b7-8b3e-e6f97a4fa70e with identifier: AT48689
2026-03-30 10:34:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 711156bf-6f01-53b7-8b3e-e6f97a4fa70e with identifier: AT48689 to the API
2026-03-30 10:34:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_a8d6297669db36cde91ab93ac6a39621.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 233,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 272,
 'expiration_date': '2026-03-31T15:37:40Z',
 'fuel_type': 'petrol',
 'id': '711156bf-6f01-53b7-8b3e-e6f97a4fa70e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT48689',
 'listing': 'auction',
 'location': 'DE, Ludwigsburg',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 140967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3083239,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_1e5aafa289841eaae6121afd77753fc2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2934002,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_8870d98ed3de56914b3e008da05dfc99.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3152175,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_a8d6297669db36cde91ab93ac6a39621.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3190022,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_984177535fb9ae13859e6125977dd2bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3103540,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_fcb34659e6aad595fba128ee383ad683.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3168166,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_2ef9c5e9dc0f33c1bca669427c830547.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3139871,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_1567b7c5005071128fc4a738d82304e9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2968079,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_3acc085cc4a809a5d1c49a2ad9ff58af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2951121,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_1030e28e30d069d103f869e0ea0240a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_711156bf-6f01-53b7-8b3e-e6f97a4fa70e/711156bf-6f01-53b7-8b3e-e6f97a4fa70e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3085878,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c5/16c5ad381c10f0151db87358782a1e52/pa/AT48689_6876d9d67db3ff6014814b3febacf845.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 30i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT48689%27 HTTP/1.1" 200 None
2026-03-30 10:34:22 [auto1.de] INFO: Saving data for AT48689: {'created_time': 1774866862.089073, 'last_price_update_time': 1774866862.089086, 'auction_closing_time': 1774971460.0}
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT48689') HTTP/1.1" 204 0
2026-03-30 10:34:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0633b60-85a2-5c37-969f-e882908006de with identifier: GT90153
2026-03-30 10:34:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0633b60-85a2-5c37-969f-e882908006de with identifier: GT90153
2026-03-30 10:34:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0633b60-85a2-5c37-969f-e882908006de with identifier: GT90153 to the API
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_8a0a7e652527b824550692382fecae0f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:28:00Z',
 'fuel_type': 'diesel',
 'id': 'a0633b60-85a2-5c37-969f-e882908006de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT90153',
 'listing': 'auction',
 'location': 'DE, Landsberg am Lech',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 168677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_17daf7c367289f1a25937c799a5c46a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_4346dde67a5dbd00056e01ff2192641b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_aeabb1094de2948074c12315d26cc1a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_8a0a7e652527b824550692382fecae0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_687e92b0227eb2a412a6097e3b6333b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_ebd5358f509e34cebd4f487f54358c1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_3c2d4c2b308b170c7ea78842d2585c0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2679250,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_95cedbfa9309f95c3c0ad5615d5f00cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_f1894570c0a53c9bd012a683f553c61b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0633b60-85a2-5c37-969f-e882908006de/a0633b60-85a2-5c37-969f-e882908006de_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/f6/34f61191ebb498192f9e3b005d339a30/pa/GT90153_32d3ce5a97453990ebf068f18e1f0fe5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 350 d Shooting Brake BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2013}
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT90153%27 HTTP/1.1" 200 None
2026-03-30 10:34:22 [auto1.de] INFO: Saving data for GT90153: {'created_time': 1774866862.474104, 'last_price_update_time': 1774866862.474115, 'auction_closing_time': 1774970880.0}
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT90153') HTTP/1.1" 204 0
2026-03-30 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_39a0ac5c54f99e2d46c5a2d7799f4142.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_efe512d5fd08764d7bab8c3a18c23cf3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL36767> (referer: https://www.auto1.com/v1/car-details-view/AL36767/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f60c02d0>
2026-03-30 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e261d4bd-4f18-5521-8139-1bb6392e8bd7/e261d4bd-4f18-5521-8139-1bb6392e8bd7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fc9%252Fc1c9e53dab0cd75557ac8d296d146714%252Fpa%252FKN27665_7323f2a48c864f54ab22fc24397e586b.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_7323f2a48c864f54ab22fc24397e586b.jpg saved to cache
2026-03-30 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e261d4bd-4f18-5521-8139-1bb6392e8bd7
2026-03-30 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41f2250>
2026-03-30 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e261d4bd-4f18-5521-8139-1bb6392e8bd7/e261d4bd-4f18-5521-8139-1bb6392e8bd7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fc9%252Fc1c9e53dab0cd75557ac8d296d146714%252Fpa%252FKN27665_d41ccc057ae509d79cf2a6ef9db7c061.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_d41ccc057ae509d79cf2a6ef9db7c061.jpg saved to cache
2026-03-30 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e261d4bd-4f18-5521-8139-1bb6392e8bd7
2026-03-30 10:34:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefe8d50>
2026-03-30 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e261d4bd-4f18-5521-8139-1bb6392e8bd7/e261d4bd-4f18-5521-8139-1bb6392e8bd7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fc9%252Fc1c9e53dab0cd75557ac8d296d146714%252Fpa%252FKN27665_39a0ac5c54f99e2d46c5a2d7799f4142.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_39a0ac5c54f99e2d46c5a2d7799f4142.jpg saved to cache
2026-03-30 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e261d4bd-4f18-5521-8139-1bb6392e8bd7
2026-03-30 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef03cd0>
2026-03-30 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e261d4bd-4f18-5521-8139-1bb6392e8bd7/e261d4bd-4f18-5521-8139-1bb6392e8bd7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fc9%252Fc1c9e53dab0cd75557ac8d296d146714%252Fpa%252FKN27665_efe512d5fd08764d7bab8c3a18c23cf3.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_efe512d5fd08764d7bab8c3a18c23cf3.jpg saved to cache
2026-03-30 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e261d4bd-4f18-5521-8139-1bb6392e8bd7
2026-03-30 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_4e8719ec433adf280d12f11e7799525a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fbaf57c-c6ff-595c-ba95-57453798e701 with identifier: AL36767
2026-03-30 10:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fbaf57c-c6ff-595c-ba95-57453798e701 with scrape type 1
2026-03-30 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3fbaf57c-c6ff-595c-ba95-57453798e701
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F95159624e50cb7c9b454ba6c50d83165%252Fpa%252FAL36767_20f1c31ec781f0f528757b5dba2b4cda.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_20f1c31ec781f0f528757b5dba2b4cda.jpg already downloaded
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F95159624e50cb7c9b454ba6c50d83165%252Fpa%252FAL36767_9af5a8c4b383ab72f29c064d96b715e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_9af5a8c4b383ab72f29c064d96b715e5.jpg already downloaded
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F95159624e50cb7c9b454ba6c50d83165%252Fpa%252FAL36767_686567326e2373d8296083f409838280.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_686567326e2373d8296083f409838280.jpg already downloaded
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F95159624e50cb7c9b454ba6c50d83165%252Fpa%252FAL36767_71a56488ce51d707924a92d18e401be0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_71a56488ce51d707924a92d18e401be0.jpg already downloaded
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F95159624e50cb7c9b454ba6c50d83165%252Fpa%252FAL36767_0f56fe3745282a2ce2af7b77c690c434.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_0f56fe3745282a2ce2af7b77c690c434.jpg already downloaded
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F95159624e50cb7c9b454ba6c50d83165%252Fpa%252FAL36767_51575d9d51103038f0f0ca9da9f00039.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_51575d9d51103038f0f0ca9da9f00039.jpg already downloaded
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F95159624e50cb7c9b454ba6c50d83165%252Fpa%252FAL36767_efb9d107f76881b3099708ced4461032.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_efb9d107f76881b3099708ced4461032.jpg already downloaded
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F95159624e50cb7c9b454ba6c50d83165%252Fpa%252FAL36767_291af86c4b5963a89d3b80915680b01d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_291af86c4b5963a89d3b80915680b01d.jpg already downloaded
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F95159624e50cb7c9b454ba6c50d83165%252Fpa%252FAL36767_7f07e51c4f8daf0177f48f62f4d9bbcd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_7f07e51c4f8daf0177f48f62f4d9bbcd.jpg already downloaded
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F15%252F95159624e50cb7c9b454ba6c50d83165%252Fpa%252FAL36767_9e1a162317d48e33b20a4f07dd3157c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_9e1a162317d48e33b20a4f07dd3157c0.jpg already downloaded
2026-03-30 10:34:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3fbaf57c-c6ff-595c-ba95-57453798e701, identifier: AL36767
2026-03-30 10:34:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3fbaf57c-c6ff-595c-ba95-57453798e701 with identifier: AL36767
2026-03-30 10:34:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-30 10:34:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3fbaf57c-c6ff-595c-ba95-57453798e701 with identifier: AL36767
2026-03-30 10:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3fbaf57c-c6ff-595c-ba95-57453798e701 with identifier: AL36767 to the API
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AL36767>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:58:58Z',
 'fuel_type': 'gas',
 'id': '3fbaf57c-c6ff-595c-ba95-57453798e701',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL36767',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 45998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_20f1c31ec781f0f528757b5dba2b4cda.jpg',
                'https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_9af5a8c4b383ab72f29c064d96b715e5.jpg',
                'https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_686567326e2373d8296083f409838280.jpg',
                'https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_71a56488ce51d707924a92d18e401be0.jpg',
                'https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_0f56fe3745282a2ce2af7b77c690c434.jpg',
                'https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_51575d9d51103038f0f0ca9da9f00039.jpg',
                'https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_efb9d107f76881b3099708ced4461032.jpg',
                'https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_291af86c4b5963a89d3b80915680b01d.jpg',
                'https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_7f07e51c4f8daf0177f48f62f4d9bbcd.jpg',
                'https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_9e1a162317d48e33b20a4f07dd3157c0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbaf57c-c6ff-595c-ba95-57453798e701/3fbaf57c-c6ff-595c-ba95-57453798e701_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_20f1c31ec781f0f528757b5dba2b4cda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbaf57c-c6ff-595c-ba95-57453798e701/3fbaf57c-c6ff-595c-ba95-57453798e701_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_9af5a8c4b383ab72f29c064d96b715e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbaf57c-c6ff-595c-ba95-57453798e701/3fbaf57c-c6ff-595c-ba95-57453798e701_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_686567326e2373d8296083f409838280.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbaf57c-c6ff-595c-ba95-57453798e701/3fbaf57c-c6ff-595c-ba95-57453798e701_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_71a56488ce51d707924a92d18e401be0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbaf57c-c6ff-595c-ba95-57453798e701/3fbaf57c-c6ff-595c-ba95-57453798e701_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_0f56fe3745282a2ce2af7b77c690c434.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbaf57c-c6ff-595c-ba95-57453798e701/3fbaf57c-c6ff-595c-ba95-57453798e701_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_51575d9d51103038f0f0ca9da9f00039.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbaf57c-c6ff-595c-ba95-57453798e701/3fbaf57c-c6ff-595c-ba95-57453798e701_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_efb9d107f76881b3099708ced4461032.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbaf57c-c6ff-595c-ba95-57453798e701/3fbaf57c-c6ff-595c-ba95-57453798e701_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_291af86c4b5963a89d3b80915680b01d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbaf57c-c6ff-595c-ba95-57453798e701/3fbaf57c-c6ff-595c-ba95-57453798e701_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_7f07e51c4f8daf0177f48f62f4d9bbcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbaf57c-c6ff-595c-ba95-57453798e701/3fbaf57c-c6ff-595c-ba95-57453798e701_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/15/95159624e50cb7c9b454ba6c50d83165/pa/AL36767_9e1a162317d48e33b20a4f07dd3157c0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2023}
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL36767%27 HTTP/1.1" 200 None
2026-03-30 10:34:23 [auto1.de] INFO: Saving data for AL36767: {'created_time': 1774866863.46406, 'last_price_update_time': 1774866863.464071, 'auction_closing_time': 1774972738.0}
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL36767') HTTP/1.1" 204 0
2026-03-30 10:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_aa8cc3c186ec1d6ccef20c0bebc51dc7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_d41d23d4f0847f91e8c75d9440394e6c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefeb810>
2026-03-30 10:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_4e8719ec433adf280d12f11e7799525a.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_4e8719ec433adf280d12f11e7799525a.jpg saved to cache
2026-03-30 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63fa3323-9bf5-57e8-a126-3c16afdac4cb
2026-03-30 10:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_7b83eb406162ab96d88074472380e098.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef188d0>
2026-03-30 10:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e261d4bd-4f18-5521-8139-1bb6392e8bd7/e261d4bd-4f18-5521-8139-1bb6392e8bd7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fc9%252Fc1c9e53dab0cd75557ac8d296d146714%252Fpa%252FKN27665_aa8cc3c186ec1d6ccef20c0bebc51dc7.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_aa8cc3c186ec1d6ccef20c0bebc51dc7.jpg saved to cache
2026-03-30 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e261d4bd-4f18-5521-8139-1bb6392e8bd7
2026-03-30 10:34:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e261d4bd-4f18-5521-8139-1bb6392e8bd7, skipping ID generation
2026-03-30 10:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e261d4bd-4f18-5521-8139-1bb6392e8bd7 with scrape type 1
2026-03-30 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e261d4bd-4f18-5521-8139-1bb6392e8bd7 sending to next pipeline
2026-03-30 10:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e261d4bd-4f18-5521-8139-1bb6392e8bd7, identifier: KN27665
2026-03-30 10:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee96310>
2026-03-30 10:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2291d5-b9a6-5db0-ab8a-b7671dd1249e/df2291d5-b9a6-5db0-ab8a-b7671dd1249e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bbac062f1a7e38acd5153f511cb978%252Fpa%252FME91178_d41d23d4f0847f91e8c75d9440394e6c.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_d41d23d4f0847f91e8c75d9440394e6c.jpg saved to cache
2026-03-30 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df2291d5-b9a6-5db0-ab8a-b7671dd1249e
2026-03-30 10:34:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e261d4bd-4f18-5521-8139-1bb6392e8bd7 with identifier: KN27665
2026-03-30 10:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e261d4bd-4f18-5521-8139-1bb6392e8bd7 with identifier: KN27665
2026-03-30 10:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e261d4bd-4f18-5521-8139-1bb6392e8bd7 with identifier: KN27665 to the API
2026-03-30 10:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_aa8cc3c186ec1d6ccef20c0bebc51dc7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:54:30Z',
 'fuel_type': 'diesel',
 'id': 'e261d4bd-4f18-5521-8139-1bb6392e8bd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN27665',
 'listing': 'auction',
 'location': 'DE, München',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 278299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e261d4bd-4f18-5521-8139-1bb6392e8bd7/e261d4bd-4f18-5521-8139-1bb6392e8bd7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_7323f2a48c864f54ab22fc24397e586b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e261d4bd-4f18-5521-8139-1bb6392e8bd7/e261d4bd-4f18-5521-8139-1bb6392e8bd7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_d41ccc057ae509d79cf2a6ef9db7c061.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e261d4bd-4f18-5521-8139-1bb6392e8bd7/e261d4bd-4f18-5521-8139-1bb6392e8bd7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_7864ba98040731b0fa5d418df79e28d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e261d4bd-4f18-5521-8139-1bb6392e8bd7/e261d4bd-4f18-5521-8139-1bb6392e8bd7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_efe512d5fd08764d7bab8c3a18c23cf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e261d4bd-4f18-5521-8139-1bb6392e8bd7/e261d4bd-4f18-5521-8139-1bb6392e8bd7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_aa8cc3c186ec1d6ccef20c0bebc51dc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e261d4bd-4f18-5521-8139-1bb6392e8bd7/e261d4bd-4f18-5521-8139-1bb6392e8bd7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/c9/c1c9e53dab0cd75557ac8d296d146714/pa/KN27665_39a0ac5c54f99e2d46c5a2d7799f4142.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-01-29',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi Ghia',
 'transmission': 'manual',
 'trim': 'Ghia',
 'year': 2007}
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN27665%27 HTTP/1.1" 200 None
2026-03-30 10:34:24 [auto1.de] INFO: Saving data for KN27665: {'created_time': 1774866864.2235, 'last_price_update_time': 1774866864.22351, 'auction_closing_time': 1774972470.0}
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN27665') HTTP/1.1" 204 0
2026-03-30 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_db9889b65bf127e1fef26cf2996efc1d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_56f0b7887fb45eccca9ea87ed6506a0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_85c9780c29b193071c0c4cbebc82d122.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_e5c19fb5e3c4eab60ba3fb413448dd98.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_0496c37c1e74735e94b31e3705fed44b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_f4f587771a0f3b683318009716ff1704.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f416d410>
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_7b83eb406162ab96d88074472380e098.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_7b83eb406162ab96d88074472380e098.jpg saved to cache
2026-03-30 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63fa3323-9bf5-57e8-a126-3c16afdac4cb
2026-03-30 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LK73650/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_17b85ce866c4e16930c63b45aff44f79.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeebcfd0>
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_db9889b65bf127e1fef26cf2996efc1d.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_db9889b65bf127e1fef26cf2996efc1d.jpg saved to cache
2026-03-30 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63fa3323-9bf5-57e8-a126-3c16afdac4cb
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42aab50>
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03138c0d-6831-50ce-a241-6c500b0318cb/03138c0d-6831-50ce-a241-6c500b0318cb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9b%252F589bb414569653892ea317c6ce1a01d4%252Fpa%252FZW01245_56f0b7887fb45eccca9ea87ed6506a0e.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_56f0b7887fb45eccca9ea87ed6506a0e.jpg saved to cache
2026-03-30 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03138c0d-6831-50ce-a241-6c500b0318cb
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f426b910>
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2291d5-b9a6-5db0-ab8a-b7671dd1249e/df2291d5-b9a6-5db0-ab8a-b7671dd1249e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bbac062f1a7e38acd5153f511cb978%252Fpa%252FME91178_85c9780c29b193071c0c4cbebc82d122.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_85c9780c29b193071c0c4cbebc82d122.jpg saved to cache
2026-03-30 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df2291d5-b9a6-5db0-ab8a-b7671dd1249e
2026-03-30 10:34:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df2291d5-b9a6-5db0-ab8a-b7671dd1249e, skipping ID generation
2026-03-30 10:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df2291d5-b9a6-5db0-ab8a-b7671dd1249e with scrape type 1
2026-03-30 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df2291d5-b9a6-5db0-ab8a-b7671dd1249e sending to next pipeline
2026-03-30 10:34:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df2291d5-b9a6-5db0-ab8a-b7671dd1249e, identifier: ME91178
2026-03-30 10:34:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef18e10>
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_e5c19fb5e3c4eab60ba3fb413448dd98.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_e5c19fb5e3c4eab60ba3fb413448dd98.jpg saved to cache
2026-03-30 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63fa3323-9bf5-57e8-a126-3c16afdac4cb
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41fcfd0>
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03138c0d-6831-50ce-a241-6c500b0318cb/03138c0d-6831-50ce-a241-6c500b0318cb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9b%252F589bb414569653892ea317c6ce1a01d4%252Fpa%252FZW01245_0496c37c1e74735e94b31e3705fed44b.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_0496c37c1e74735e94b31e3705fed44b.jpg saved to cache
2026-03-30 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03138c0d-6831-50ce-a241-6c500b0318cb
2026-03-30 10:34:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03138c0d-6831-50ce-a241-6c500b0318cb, skipping ID generation
2026-03-30 10:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03138c0d-6831-50ce-a241-6c500b0318cb with scrape type 1
2026-03-30 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03138c0d-6831-50ce-a241-6c500b0318cb sending to next pipeline
2026-03-30 10:34:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03138c0d-6831-50ce-a241-6c500b0318cb, identifier: ZW01245
2026-03-30 10:34:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4258bd0>
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_f4f587771a0f3b683318009716ff1704.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_f4f587771a0f3b683318009716ff1704.jpg saved to cache
2026-03-30 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63fa3323-9bf5-57e8-a126-3c16afdac4cb
2026-03-30 10:34:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df2291d5-b9a6-5db0-ab8a-b7671dd1249e with identifier: ME91178
2026-03-30 10:34:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:34:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 10:34:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:34:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df2291d5-b9a6-5db0-ab8a-b7671dd1249e with identifier: ME91178
2026-03-30 10:34:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df2291d5-b9a6-5db0-ab8a-b7671dd1249e with identifier: ME91178 to the API
2026-03-30 10:34:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_85c9780c29b193071c0c4cbebc82d122.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 87,
 'expiration_date': '2026-03-31T15:08:25Z',
 'fuel_type': 'petrol',
 'id': 'df2291d5-b9a6-5db0-ab8a-b7671dd1249e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME91178',
 'listing': 'auction',
 'location': 'DE, Landau in der Pfalz',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 190056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2291d5-b9a6-5db0-ab8a-b7671dd1249e/df2291d5-b9a6-5db0-ab8a-b7671dd1249e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_1cd16048e555d76516c64c5c8dd66db4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2291d5-b9a6-5db0-ab8a-b7671dd1249e/df2291d5-b9a6-5db0-ab8a-b7671dd1249e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_85c9780c29b193071c0c4cbebc82d122.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2291d5-b9a6-5db0-ab8a-b7671dd1249e/df2291d5-b9a6-5db0-ab8a-b7671dd1249e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_740196363d63472080912406b7125e7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2291d5-b9a6-5db0-ab8a-b7671dd1249e/df2291d5-b9a6-5db0-ab8a-b7671dd1249e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_dafabab28ecdd635cee5fad39e65f183.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2291d5-b9a6-5db0-ab8a-b7671dd1249e/df2291d5-b9a6-5db0-ab8a-b7671dd1249e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/bb/f6bbac062f1a7e38acd5153f511cb978/pa/ME91178_d41d23d4f0847f91e8c75d9440394e6c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2013}
2026-03-30 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME91178%27 HTTP/1.1" 200 None
2026-03-30 10:34:25 [auto1.de] INFO: Saving data for ME91178: {'created_time': 1774866865.566813, 'last_price_update_time': 1774866865.566827, 'auction_closing_time': 1774969705.0}
2026-03-30 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME91178') HTTP/1.1" 204 0
2026-03-30 10:34:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03138c0d-6831-50ce-a241-6c500b0318cb with identifier: ZW01245
2026-03-30 10:34:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03138c0d-6831-50ce-a241-6c500b0318cb with identifier: ZW01245
2026-03-30 10:34:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03138c0d-6831-50ce-a241-6c500b0318cb with identifier: ZW01245 to the API
2026-03-30 10:34:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_0496c37c1e74735e94b31e3705fed44b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:29:27Z',
 'fuel_type': 'petrol',
 'id': '03138c0d-6831-50ce-a241-6c500b0318cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW01245',
 'listing': 'auction',
 'location': 'DE, Köln',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 155642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03138c0d-6831-50ce-a241-6c500b0318cb/03138c0d-6831-50ce-a241-6c500b0318cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_0496c37c1e74735e94b31e3705fed44b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03138c0d-6831-50ce-a241-6c500b0318cb/03138c0d-6831-50ce-a241-6c500b0318cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_8b43a2de0a0414924a864c751b334b6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03138c0d-6831-50ce-a241-6c500b0318cb/03138c0d-6831-50ce-a241-6c500b0318cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_6366adef2cb9471f7707ffe712fa4c13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03138c0d-6831-50ce-a241-6c500b0318cb/03138c0d-6831-50ce-a241-6c500b0318cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_56f0b7887fb45eccca9ea87ed6506a0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03138c0d-6831-50ce-a241-6c500b0318cb/03138c0d-6831-50ce-a241-6c500b0318cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/9b/589bb414569653892ea317c6ce1a01d4/pa/ZW01245_9b2d792557e7e2e7598fddbb4af53cf8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-12-12',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-30 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW01245%27 HTTP/1.1" 200 None
2026-03-30 10:34:25 [auto1.de] INFO: Saving data for ZW01245: {'created_time': 1774866865.962983, 'last_price_update_time': 1774866865.962995, 'auction_closing_time': 1774970967.0}
2026-03-30 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW01245') HTTP/1.1" 204 0
2026-03-30 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU30152/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WD03646/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZU32637/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB89867> (referer: https://www.auto1.com/v1/car-details-view/JB89867/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY67471/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef19490>
2026-03-30 10:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fdb%252Fd4dbd976ae6fd0a35f8520d548db9580%252Fpa%252FUZ88379_17b85ce866c4e16930c63b45aff44f79.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_17b85ce866c4e16930c63b45aff44f79.jpg saved to cache
2026-03-30 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1282fb24-a056-5262-af8d-e3794f4665d2
2026-03-30 10:34:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1282fb24-a056-5262-af8d-e3794f4665d2, skipping ID generation
2026-03-30 10:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1282fb24-a056-5262-af8d-e3794f4665d2 with scrape type 1
2026-03-30 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1282fb24-a056-5262-af8d-e3794f4665d2 sending to next pipeline
2026-03-30 10:34:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1282fb24-a056-5262-af8d-e3794f4665d2, identifier: UZ88379
2026-03-30 10:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1282fb24-a056-5262-af8d-e3794f4665d2 with identifier: UZ88379
2026-03-30 10:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1282fb24-a056-5262-af8d-e3794f4665d2 with identifier: UZ88379
2026-03-30 10:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1282fb24-a056-5262-af8d-e3794f4665d2 with identifier: UZ88379 to the API
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_17b85ce866c4e16930c63b45aff44f79.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:30:54Z',
 'fuel_type': 'petrol',
 'id': '1282fb24-a056-5262-af8d-e3794f4665d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ88379',
 'listing': 'auction',
 'location': 'DE, Stuttgart',
 'make': 'BMW',
 'model': '1er',
 'odometer': 174528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3095031,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_17b85ce866c4e16930c63b45aff44f79.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2939957,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_680d8fc38835ee7ec3421c7fa67ee253.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2582811,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_12bce38855eb511532f252e61c5632e4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2755148,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_cb9582f05b15480674a43214b8172d39.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2637876,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_69dbdd59910adad89ca36b1a80968f43.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2508802,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_c0d62902ee22e5e571b0e7baea6f31f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2369896,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_c43e46e1ab532c99b083bd6e5e647d4a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2732620,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_a98c8798919b28381072b2390407a557.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2945143,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_c4bb2e5b2f6c8de6c958081499c1dbb1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1282fb24-a056-5262-af8d-e3794f4665d2/1282fb24-a056-5262-af8d-e3794f4665d2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2908906,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/db/d4dbd976ae6fd0a35f8520d548db9580/pa/UZ88379_35845ca5597be4b77c6f1832ee44a790.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ88379%27 HTTP/1.1" 200 None
2026-03-30 10:34:26 [auto1.de] INFO: Saving data for UZ88379: {'created_time': 1774866866.803521, 'last_price_update_time': 1774866866.803533, 'auction_closing_time': 1774971054.0}
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ88379') HTTP/1.1" 204 0
2026-03-30 10:34:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bd23069-98ed-54e3-81a9-4218667ba0da with identifier: JB89867
2026-03-30 10:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bd23069-98ed-54e3-81a9-4218667ba0da with scrape type 1
2026-03-30 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9bd23069-98ed-54e3-81a9-4218667ba0da
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F39%252F5d396e922102ce33f2f5fc97e8865208%252Fpa%252FJB89867_e9594656da77b908f009ce094e3ad538.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_e9594656da77b908f009ce094e3ad538.jpg already downloaded
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F39%252F5d396e922102ce33f2f5fc97e8865208%252Fpa%252FJB89867_2ffd563310ea9c422ea3772d22aaba79.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_2ffd563310ea9c422ea3772d22aaba79.jpg already downloaded
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F39%252F5d396e922102ce33f2f5fc97e8865208%252Fpa%252FJB89867_a57119901a717d4269c5df2806f0b217.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_a57119901a717d4269c5df2806f0b217.jpg already downloaded
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F39%252F5d396e922102ce33f2f5fc97e8865208%252Fpa%252FJB89867_c63fab789dbe4df0da2112bdff46bc8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_c63fab789dbe4df0da2112bdff46bc8f.jpg already downloaded
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F39%252F5d396e922102ce33f2f5fc97e8865208%252Fpa%252FJB89867_1352c75b4168fa81eb18b862f92095c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_1352c75b4168fa81eb18b862f92095c5.jpg already downloaded
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F39%252F5d396e922102ce33f2f5fc97e8865208%252Fpa%252FJB89867_27c1cdf5273dc2f83e99cd7fcb5530d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_27c1cdf5273dc2f83e99cd7fcb5530d0.jpg already downloaded
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F39%252F5d396e922102ce33f2f5fc97e8865208%252Fpa%252FJB89867_2049b133f433032a563b4e04ca8ecdba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_2049b133f433032a563b4e04ca8ecdba.jpg already downloaded
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F39%252F5d396e922102ce33f2f5fc97e8865208%252Fpa%252FJB89867_f53718f0c24101c70291b784adfb2109.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_f53718f0c24101c70291b784adfb2109.jpg already downloaded
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F39%252F5d396e922102ce33f2f5fc97e8865208%252Fpa%252FJB89867_f146904ce8dae1ee145d32397104d794.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_f146904ce8dae1ee145d32397104d794.jpg already downloaded
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F39%252F5d396e922102ce33f2f5fc97e8865208%252Fpa%252FJB89867_8cebb3bf514c6e576b919f85217a3098.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_8cebb3bf514c6e576b919f85217a3098.jpg already downloaded
2026-03-30 10:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9bd23069-98ed-54e3-81a9-4218667ba0da, identifier: JB89867
2026-03-30 10:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9bd23069-98ed-54e3-81a9-4218667ba0da with identifier: JB89867
2026-03-30 10:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9bd23069-98ed-54e3-81a9-4218667ba0da with identifier: JB89867
2026-03-30 10:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9bd23069-98ed-54e3-81a9-4218667ba0da with identifier: JB89867 to the API
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JB89867>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:54:34Z',
 'fuel_type': 'petrol',
 'id': '9bd23069-98ed-54e3-81a9-4218667ba0da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB89867',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 28821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_e9594656da77b908f009ce094e3ad538.jpg',
                'https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_2ffd563310ea9c422ea3772d22aaba79.jpg',
                'https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_a57119901a717d4269c5df2806f0b217.jpg',
                'https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_c63fab789dbe4df0da2112bdff46bc8f.jpg',
                'https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_1352c75b4168fa81eb18b862f92095c5.jpg',
                'https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_27c1cdf5273dc2f83e99cd7fcb5530d0.jpg',
                'https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_2049b133f433032a563b4e04ca8ecdba.jpg',
                'https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_f53718f0c24101c70291b784adfb2109.jpg',
                'https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_f146904ce8dae1ee145d32397104d794.jpg',
                'https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_8cebb3bf514c6e576b919f85217a3098.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd23069-98ed-54e3-81a9-4218667ba0da/9bd23069-98ed-54e3-81a9-4218667ba0da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2637673,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_e9594656da77b908f009ce094e3ad538.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd23069-98ed-54e3-81a9-4218667ba0da/9bd23069-98ed-54e3-81a9-4218667ba0da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_2ffd563310ea9c422ea3772d22aaba79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd23069-98ed-54e3-81a9-4218667ba0da/9bd23069-98ed-54e3-81a9-4218667ba0da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2629585,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_a57119901a717d4269c5df2806f0b217.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd23069-98ed-54e3-81a9-4218667ba0da/9bd23069-98ed-54e3-81a9-4218667ba0da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_c63fab789dbe4df0da2112bdff46bc8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd23069-98ed-54e3-81a9-4218667ba0da/9bd23069-98ed-54e3-81a9-4218667ba0da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_1352c75b4168fa81eb18b862f92095c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd23069-98ed-54e3-81a9-4218667ba0da/9bd23069-98ed-54e3-81a9-4218667ba0da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_27c1cdf5273dc2f83e99cd7fcb5530d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd23069-98ed-54e3-81a9-4218667ba0da/9bd23069-98ed-54e3-81a9-4218667ba0da_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_2049b133f433032a563b4e04ca8ecdba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd23069-98ed-54e3-81a9-4218667ba0da/9bd23069-98ed-54e3-81a9-4218667ba0da_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_f53718f0c24101c70291b784adfb2109.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd23069-98ed-54e3-81a9-4218667ba0da/9bd23069-98ed-54e3-81a9-4218667ba0da_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_f146904ce8dae1ee145d32397104d794.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd23069-98ed-54e3-81a9-4218667ba0da/9bd23069-98ed-54e3-81a9-4218667ba0da_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/39/5d396e922102ce33f2f5fc97e8865208/pa/JB89867_8cebb3bf514c6e576b919f85217a3098.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid Trend 2WD',
 'transmission': 'automatic',
 'trim': 'Trend 2WD',
 'year': 2021}
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB89867%27 HTTP/1.1" 200 None
2026-03-30 10:34:27 [auto1.de] INFO: Saving data for JB89867: {'created_time': 1774866867.538143, 'last_price_update_time': 1774866867.538154, 'auction_closing_time': 1774972474.0}
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB89867') HTTP/1.1" 204 0
2026-03-30 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_0e02743ab3f518aa12ede5996ae66463.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_86156f480b9ea36b9d65085e5df0a217.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_540caad136afeabf0c3c1e3a5bb90038.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_6eacc4f6ec7f9c898aea0e1624efe28a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_430afc65572f218ea28a759bb4fef99d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_5ee0383e4de47cd5736154e2e8382f6d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_9e02b7241760f8942dcdf09f552941da.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f432c150>
2026-03-30 10:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_0e02743ab3f518aa12ede5996ae66463.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_0e02743ab3f518aa12ede5996ae66463.jpg saved to cache
2026-03-30 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2f547e7b-c58d-51cb-823c-a6f13beddb81
2026-03-30 10:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4808750>
2026-03-30 10:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_86156f480b9ea36b9d65085e5df0a217.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_86156f480b9ea36b9d65085e5df0a217.jpg saved to cache
2026-03-30 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2f547e7b-c58d-51cb-823c-a6f13beddb81
2026-03-30 10:34:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec1a50>
2026-03-30 10:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F7c%252F6c7cc890914db3fd8297a65daab2e153%252Fpa%252FYE41052_540caad136afeabf0c3c1e3a5bb90038.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_540caad136afeabf0c3c1e3a5bb90038.jpg saved to cache
2026-03-30 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63fa3323-9bf5-57e8-a126-3c16afdac4cb
2026-03-30 10:34:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63fa3323-9bf5-57e8-a126-3c16afdac4cb, skipping ID generation
2026-03-30 10:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63fa3323-9bf5-57e8-a126-3c16afdac4cb with scrape type 1
2026-03-30 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63fa3323-9bf5-57e8-a126-3c16afdac4cb sending to next pipeline
2026-03-30 10:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63fa3323-9bf5-57e8-a126-3c16afdac4cb, identifier: YE41052
2026-03-30 10:34:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f480a8d0>
2026-03-30 10:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_6eacc4f6ec7f9c898aea0e1624efe28a.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_6eacc4f6ec7f9c898aea0e1624efe28a.jpg saved to cache
2026-03-30 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80f76873-3b37-583f-a766-6e398b06c2e4
2026-03-30 10:34:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a3c50>
2026-03-30 10:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_430afc65572f218ea28a759bb4fef99d.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_430afc65572f218ea28a759bb4fef99d.jpg saved to cache
2026-03-30 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80f76873-3b37-583f-a766-6e398b06c2e4
2026-03-30 10:34:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414aa10>
2026-03-30 10:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_5ee0383e4de47cd5736154e2e8382f6d.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_5ee0383e4de47cd5736154e2e8382f6d.jpg saved to cache
2026-03-30 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80f76873-3b37-583f-a766-6e398b06c2e4
2026-03-30 10:34:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb1b90>
2026-03-30 10:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F68%252Fa0686db8d8176b856bd007b0a6ffd3f5%252Fpa%252FBA33674_9e02b7241760f8942dcdf09f552941da.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_9e02b7241760f8942dcdf09f552941da.jpg saved to cache
2026-03-30 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80f76873-3b37-583f-a766-6e398b06c2e4
2026-03-30 10:34:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80f76873-3b37-583f-a766-6e398b06c2e4, skipping ID generation
2026-03-30 10:34:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80f76873-3b37-583f-a766-6e398b06c2e4 with scrape type 1
2026-03-30 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80f76873-3b37-583f-a766-6e398b06c2e4 sending to next pipeline
2026-03-30 10:34:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80f76873-3b37-583f-a766-6e398b06c2e4, identifier: BA33674
2026-03-30 10:34:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63fa3323-9bf5-57e8-a126-3c16afdac4cb with identifier: YE41052
2026-03-30 10:34:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63fa3323-9bf5-57e8-a126-3c16afdac4cb with identifier: YE41052
2026-03-30 10:34:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63fa3323-9bf5-57e8-a126-3c16afdac4cb with identifier: YE41052 to the API
2026-03-30 10:34:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_540caad136afeabf0c3c1e3a5bb90038.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:37:10Z',
 'fuel_type': 'petrol',
 'id': '63fa3323-9bf5-57e8-a126-3c16afdac4cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE41052',
 'listing': 'auction',
 'location': 'DE, Deggendorf',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 128011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2762859,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_5726b51c737ceaaca73bbf3eb4985940.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2828121,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_ea0f249060e903e3dd0fc2635a54f42b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2838643,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_540caad136afeabf0c3c1e3a5bb90038.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2676004,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_db9889b65bf127e1fef26cf2996efc1d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2661876,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_cbb62dc1f0ddd1c3821e285517ad96a7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2743201,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_e5c19fb5e3c4eab60ba3fb413448dd98.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2695466,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_7b83eb406162ab96d88074472380e098.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2839893,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_f4f587771a0f3b683318009716ff1704.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2715646,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_4e8719ec433adf280d12f11e7799525a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fa3323-9bf5-57e8-a126-3c16afdac4cb/63fa3323-9bf5-57e8-a126-3c16afdac4cb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2873298,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/7c/6c7cc890914db3fd8297a65daab2e153/pa/YE41052_684a61eb57f01a967fc9600771b9c795.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE41052%27 HTTP/1.1" 200 None
2026-03-30 10:34:29 [auto1.de] INFO: Saving data for YE41052: {'created_time': 1774866869.060834, 'last_price_update_time': 1774866869.060845, 'auction_closing_time': 1774971430.0}
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE41052') HTTP/1.1" 204 0
2026-03-30 10:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80f76873-3b37-583f-a766-6e398b06c2e4 with identifier: BA33674
2026-03-30 10:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80f76873-3b37-583f-a766-6e398b06c2e4 with identifier: BA33674
2026-03-30 10:34:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80f76873-3b37-583f-a766-6e398b06c2e4 with identifier: BA33674 to the API
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_9e02b7241760f8942dcdf09f552941da.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 159,
 'expiration_date': '2026-03-31T15:51:49Z',
 'fuel_type': 'petrol',
 'id': '80f76873-3b37-583f-a766-6e398b06c2e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA33674',
 'listing': 'auction',
 'location': 'DE, Buchholz',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 44136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2727900,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_9e02b7241760f8942dcdf09f552941da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2712395,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_5ee0383e4de47cd5736154e2e8382f6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2604796,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_430afc65572f218ea28a759bb4fef99d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2549564,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_6eacc4f6ec7f9c898aea0e1624efe28a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2487812,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_f326bd4c86e02fd41a3de74ec84906d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2498846,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_b7bdf4a17bc3ba010168688fc7611ed5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2297021,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_b5e5b7fd059e7a45ae8b0cfd9def0ca1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2371402,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_c24fe93cc086aa149523031c8c90e3b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2322741,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_522185c6cd9b0563150b6abc25264bd5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80f76873-3b37-583f-a766-6e398b06c2e4/80f76873-3b37-583f-a766-6e398b06c2e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/68/a0686db8d8176b856bd007b0a6ffd3f5/pa/BA33674_a73ace506ac803519963353818232030.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Talisman 1.3 TCe Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2020}
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA33674%27 HTTP/1.1" 200 None
2026-03-30 10:34:29 [auto1.de] INFO: Saving data for BA33674: {'created_time': 1774866869.480282, 'last_price_update_time': 1774866869.480292, 'auction_closing_time': 1774972309.0}
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA33674') HTTP/1.1" 204 0
2026-03-30 10:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ND23678/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TN19858/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MW69190/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP09894/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:29 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 9408 | hits on page: 40
2026-03-30 10:34:29 [auto1.de] INFO: Found listing with ID: VZ06022
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ06022%27 HTTP/1.1" 200 None
2026-03-30 10:34:29 [auto1.de] INFO: Scrape type for VZ06022: 0
2026-03-30 10:34:29 [auto1.de] INFO: Found listing with ID: KF51408
2026-03-30 10:34:29 [auto1.de] INFO: Found listing with ID: SK04411
2026-03-30 10:34:29 [auto1.de] INFO: Found listing with ID: FY02898
2026-03-30 10:34:29 [auto1.de] INFO: Found listing with ID: CY80853
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY80853%27 HTTP/1.1" 200 None
2026-03-30 10:34:29 [auto1.de] INFO: Scrape type for CY80853: 0
2026-03-30 10:34:29 [auto1.de] INFO: Found listing with ID: ZZ25351
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ25351%27 HTTP/1.1" 200 None
2026-03-30 10:34:29 [auto1.de] INFO: Scrape type for ZZ25351: 1
2026-03-30 10:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_71360b563f3d8f21ef0121dfcd0e7c99.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:29 [auto1.de] INFO: Found listing with ID: GB07563
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB07563%27 HTTP/1.1" 200 None
2026-03-30 10:34:29 [auto1.de] INFO: Scrape type for GB07563: 1
2026-03-30 10:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_b4656206227a7940dd4e6d79eba45752.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_c4c8fbcb6cc4dd55f96a62c6f2637dd4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:29 [auto1.de] INFO: Found listing with ID: KV37303
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV37303%27 HTTP/1.1" 200 None
2026-03-30 10:34:29 [auto1.de] INFO: Scrape type for KV37303: 1
2026-03-30 10:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_3cf4ed5b573e6fa5926cb332ad9242c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:29 [auto1.de] INFO: Found listing with ID: FW24951
2026-03-30 10:34:29 [auto1.de] INFO: Found listing with ID: SE83942
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE83942%27 HTTP/1.1" 200 None
2026-03-30 10:34:29 [auto1.de] INFO: Scrape type for SE83942: 1
2026-03-30 10:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_b6b608c2c6da62cfce7006e0912342a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:29 [auto1.de] INFO: Found listing with ID: TR68176
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR68176%27 HTTP/1.1" 200 None
2026-03-30 10:34:29 [auto1.de] INFO: Scrape type for TR68176: 1
2026-03-30 10:34:29 [auto1.de] INFO: Found listing with ID: LA66050
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA66050%27 HTTP/1.1" 200 None
2026-03-30 10:34:29 [auto1.de] INFO: Scrape type for LA66050: 2
2026-03-30 10:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cc887c0-0b0b-5f53-857f-7904b97611c0 with identifier: LA66050
2026-03-30 10:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cc887c0-0b0b-5f53-857f-7904b97611c0 with scrape type 2
2026-03-30 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cc887c0-0b0b-5f53-857f-7904b97611c0 with scrape type 2
2026-03-30 10:34:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7cc887c0-0b0b-5f53-857f-7904b97611c0, identifier: LA66050
2026-03-30 10:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7cc887c0-0b0b-5f53-857f-7904b97611c0 with identifier: LA66050
2026-03-30 10:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7cc887c0-0b0b-5f53-857f-7904b97611c0 with identifier: LA66050
2026-03-30 10:34:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7cc887c0-0b0b-5f53-857f-7904b97611c0 with identifier: LA66050 to the API
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:57:23Z',
 'fuel_type': 'diesel',
 'id': '7cc887c0-0b0b-5f53-857f-7904b97611c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA66050',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 125567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-24',
 'seller_name': None,
 'title': 'Jeep Cherokee 2.2 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2016}
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA66050%27 HTTP/1.1" 200 None
2026-03-30 10:34:30 [auto1.de] INFO: Saving data for LA66050: {'auction_closing_time': 1774972643.0, 'created_time': 1773741270.702906, 'last_price_update_time': 1774866870.308532}
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA66050') HTTP/1.1" 204 0
2026-03-30 10:34:30 [auto1.de] INFO: Found listing with ID: TV08904
2026-03-30 10:34:30 [auto1.de] INFO: Found listing with ID: MR47328
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR47328%27 HTTP/1.1" 200 None
2026-03-30 10:34:30 [auto1.de] INFO: Scrape type for MR47328: 1
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee30e50>
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_71360b563f3d8f21ef0121dfcd0e7c99.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_71360b563f3d8f21ef0121dfcd0e7c99.jpg saved to cache
2026-03-30 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2f547e7b-c58d-51cb-823c-a6f13beddb81
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3f9d0>
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_b4656206227a7940dd4e6d79eba45752.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_b4656206227a7940dd4e6d79eba45752.jpg saved to cache
2026-03-30 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2f547e7b-c58d-51cb-823c-a6f13beddb81
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefb4c10>
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_c4c8fbcb6cc4dd55f96a62c6f2637dd4.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_c4c8fbcb6cc4dd55f96a62c6f2637dd4.jpg saved to cache
2026-03-30 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2f547e7b-c58d-51cb-823c-a6f13beddb81
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec6590>
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_3cf4ed5b573e6fa5926cb332ad9242c9.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_3cf4ed5b573e6fa5926cb332ad9242c9.jpg saved to cache
2026-03-30 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2f547e7b-c58d-51cb-823c-a6f13beddb81
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefb6110>
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fed%252F42ed4e16cd2a03bccff579ca0df6e51d%252Fpa%252FHX90600_b6b608c2c6da62cfce7006e0912342a1.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_b6b608c2c6da62cfce7006e0912342a1.jpg saved to cache
2026-03-30 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2f547e7b-c58d-51cb-823c-a6f13beddb81
2026-03-30 10:34:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f547e7b-c58d-51cb-823c-a6f13beddb81, skipping ID generation
2026-03-30 10:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f547e7b-c58d-51cb-823c-a6f13beddb81 with scrape type 1
2026-03-30 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f547e7b-c58d-51cb-823c-a6f13beddb81 sending to next pipeline
2026-03-30 10:34:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f547e7b-c58d-51cb-823c-a6f13beddb81, identifier: HX90600
2026-03-30 10:34:30 [auto1.de] INFO: Found listing with ID: RV63045
2026-03-30 10:34:30 [auto1.de] INFO: Found listing with ID: AL74934
2026-03-30 10:34:30 [auto1.de] INFO: Found listing with ID: KJ13654
2026-03-30 10:34:30 [auto1.de] INFO: Found listing with ID: YE31815
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE31815%27 HTTP/1.1" 200 None
2026-03-30 10:34:30 [auto1.de] INFO: Scrape type for YE31815: 2
2026-03-30 10:34:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62cc4a02-dfbe-57e7-8601-0495f3887bfc with identifier: YE31815
2026-03-30 10:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62cc4a02-dfbe-57e7-8601-0495f3887bfc with scrape type 2
2026-03-30 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62cc4a02-dfbe-57e7-8601-0495f3887bfc with scrape type 2
2026-03-30 10:34:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62cc4a02-dfbe-57e7-8601-0495f3887bfc, identifier: YE31815
2026-03-30 10:34:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f547e7b-c58d-51cb-823c-a6f13beddb81 with identifier: HX90600
2026-03-30 10:34:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f547e7b-c58d-51cb-823c-a6f13beddb81 with identifier: HX90600
2026-03-30 10:34:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f547e7b-c58d-51cb-823c-a6f13beddb81 with identifier: HX90600 to the API
2026-03-30 10:34:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_b6b608c2c6da62cfce7006e0912342a1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:13:14Z',
 'fuel_type': 'petrol',
 'id': '2f547e7b-c58d-51cb-823c-a6f13beddb81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX90600',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 42741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_88dc3c2abbfca38a82bf613a8611aed5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_3cf4ed5b573e6fa5926cb332ad9242c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_b4656206227a7940dd4e6d79eba45752.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_71360b563f3d8f21ef0121dfcd0e7c99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_b6b608c2c6da62cfce7006e0912342a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_c4c8fbcb6cc4dd55f96a62c6f2637dd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_0e02743ab3f518aa12ede5996ae66463.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_86156f480b9ea36b9d65085e5df0a217.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_ef50c0f067a8a208e848725acf640d66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f547e7b-c58d-51cb-823c-a6f13beddb81/2f547e7b-c58d-51cb-823c-a6f13beddb81_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ed/42ed4e16cd2a03bccff579ca0df6e51d/pa/HX90600_0b0fc6ea173746e98bb64a3d57d21885.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2022}
2026-03-30 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX90600%27 HTTP/1.1" 200 None
2026-03-30 10:34:31 [auto1.de] INFO: Saving data for HX90600: {'created_time': 1774866871.86692, 'last_price_update_time': 1774866871.866934, 'auction_closing_time': 1774969994.0}
2026-03-30 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX90600') HTTP/1.1" 204 0
2026-03-30 10:34:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62cc4a02-dfbe-57e7-8601-0495f3887bfc with identifier: YE31815
2026-03-30 10:34:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62cc4a02-dfbe-57e7-8601-0495f3887bfc with identifier: YE31815
2026-03-30 10:34:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62cc4a02-dfbe-57e7-8601-0495f3887bfc with identifier: YE31815 to the API
2026-03-30 10:34:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:51:24Z',
 'fuel_type': 'petrol',
 'id': '62cc4a02-dfbe-57e7-8601-0495f3887bfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE31815',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 51785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-03',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2017}
2026-03-30 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE31815%27 HTTP/1.1" 200 None
2026-03-30 10:34:32 [auto1.de] INFO: Saving data for YE31815: {'auction_closing_time': 1774972284.0, 'created_time': 1774293329.866135, 'last_price_update_time': 1774866872.219589}
2026-03-30 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE31815') HTTP/1.1" 204 0
2026-03-30 10:34:32 [auto1.de] INFO: Found listing with ID: CL87122
2026-03-30 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL87122%27 HTTP/1.1" 200 None
2026-03-30 10:34:32 [auto1.de] INFO: Scrape type for CL87122: 2
2026-03-30 10:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c6fe0a7-2d67-5942-9af2-a793717d6d47 with identifier: CL87122
2026-03-30 10:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c6fe0a7-2d67-5942-9af2-a793717d6d47 with scrape type 2
2026-03-30 10:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c6fe0a7-2d67-5942-9af2-a793717d6d47 with scrape type 2
2026-03-30 10:34:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c6fe0a7-2d67-5942-9af2-a793717d6d47, identifier: CL87122
2026-03-30 10:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY67471> (referer: https://www.auto1.com/v1/car-details-view/VY67471/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZU32637> (referer: https://www.auto1.com/v1/car-details-view/ZU32637/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AC30992/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU30152> (referer: https://www.auto1.com/v1/car-details-view/TU30152/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c6fe0a7-2d67-5942-9af2-a793717d6d47 with identifier: CL87122
2026-03-30 10:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c6fe0a7-2d67-5942-9af2-a793717d6d47 with identifier: CL87122
2026-03-30 10:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c6fe0a7-2d67-5942-9af2-a793717d6d47 with identifier: CL87122 to the API
2026-03-30 10:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:35:04Z',
 'fuel_type': 'petrol',
 'id': '4c6fe0a7-2d67-5942-9af2-a793717d6d47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL87122',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 111206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-05',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2006}
2026-03-30 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL87122%27 HTTP/1.1" 200 None
2026-03-30 10:34:32 [auto1.de] INFO: Saving data for CL87122: {'auction_closing_time': 1774971304.0, 'created_time': 1773687230.733782, 'last_price_update_time': 1774866872.799175}
2026-03-30 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL87122') HTTP/1.1" 204 0
2026-03-30 10:34:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WL02580/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA21775/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:32 [auto1.de] INFO: Found listing with ID: KJ05833
2026-03-30 10:34:32 [auto1.de] INFO: Found listing with ID: DK89944
2026-03-30 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK89944%27 HTTP/1.1" 200 None
2026-03-30 10:34:32 [auto1.de] INFO: Scrape type for DK89944: 2
2026-03-30 10:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 648c073d-1611-5425-ade9-b3726c4428aa with identifier: DK89944
2026-03-30 10:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 648c073d-1611-5425-ade9-b3726c4428aa with scrape type 2
2026-03-30 10:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 648c073d-1611-5425-ade9-b3726c4428aa with scrape type 2
2026-03-30 10:34:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 648c073d-1611-5425-ade9-b3726c4428aa, identifier: DK89944
2026-03-30 10:34:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WD03646> (referer: https://www.auto1.com/v1/car-details-view/WD03646/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 648c073d-1611-5425-ade9-b3726c4428aa with identifier: DK89944
2026-03-30 10:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 648c073d-1611-5425-ade9-b3726c4428aa with identifier: DK89944
2026-03-30 10:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 648c073d-1611-5425-ade9-b3726c4428aa with identifier: DK89944 to the API
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:26:21Z',
 'fuel_type': 'petrol',
 'id': '648c073d-1611-5425-ade9-b3726c4428aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK89944',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLC-Klasse',
 'odometer': 45024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-07',
 'seller_name': None,
 'title': 'Mercedes-Benz SLC-Klasse SLC 200 CGI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK89944%27 HTTP/1.1" 200 None
2026-03-30 10:34:33 [auto1.de] INFO: Saving data for DK89944: {'auction_closing_time': 1774970781.0, 'created_time': 1773646258.984292, 'last_price_update_time': 1774866873.266552}
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK89944') HTTP/1.1" 204 0
2026-03-30 10:34:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:33 [auto1.de] INFO: Found listing with ID: FM12370
2026-03-30 10:34:33 [auto1.de] INFO: Found listing with ID: XR25787
2026-03-30 10:34:33 [auto1.de] INFO: Found listing with ID: PC55242
2026-03-30 10:34:33 [auto1.de] INFO: Found listing with ID: AM41059
2026-03-30 10:34:33 [auto1.de] INFO: Found listing with ID: WX33837
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX33837%27 HTTP/1.1" 200 None
2026-03-30 10:34:33 [auto1.de] INFO: Scrape type for WX33837: 1
2026-03-30 10:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b40d5609-d44e-587d-bcb0-68c5a8db35eb with identifier: VY67471
2026-03-30 10:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b40d5609-d44e-587d-bcb0-68c5a8db35eb with scrape type 1
2026-03-30 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b40d5609-d44e-587d-bcb0-68c5a8db35eb
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_fae298b09fd16704817c3dbbd28eb4f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_fae298b09fd16704817c3dbbd28eb4f4.jpg not downloaded yet
2026-03-30 10:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72585f43-9ebd-5e3f-b847-0344e7671e63 with identifier: ZU32637
2026-03-30 10:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72585f43-9ebd-5e3f-b847-0344e7671e63 with scrape type 1
2026-03-30 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 72585f43-9ebd-5e3f-b847-0344e7671e63
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F36%252F55361520dda4a29367e333dd0bc7e13d%252Fpa%252FZU32637_a01099c5ced41c0c632871663ef0a6a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_a01099c5ced41c0c632871663ef0a6a5.jpg already downloaded
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F36%252F55361520dda4a29367e333dd0bc7e13d%252Fpa%252FZU32637_62f00e0153a303ab08a3474495bdcfa6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_62f00e0153a303ab08a3474495bdcfa6.jpg already downloaded
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F36%252F55361520dda4a29367e333dd0bc7e13d%252Fpa%252FZU32637_6610328ac1c6f53309b8c9169adae5fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_6610328ac1c6f53309b8c9169adae5fd.jpg already downloaded
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F36%252F55361520dda4a29367e333dd0bc7e13d%252Fpa%252FZU32637_20443bd6403beed3d0400b4664fcb7b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_20443bd6403beed3d0400b4664fcb7b0.jpg already downloaded
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F36%252F55361520dda4a29367e333dd0bc7e13d%252Fpa%252FZU32637_e439d689aae239de9bc7ce703a0fc76a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_e439d689aae239de9bc7ce703a0fc76a.jpg already downloaded
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F36%252F55361520dda4a29367e333dd0bc7e13d%252Fpa%252FZU32637_efb3a2189f9ba9a0ee66ef1a79ab8aac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_efb3a2189f9ba9a0ee66ef1a79ab8aac.jpg already downloaded
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F36%252F55361520dda4a29367e333dd0bc7e13d%252Fpa%252FZU32637_1971c78b3d1640842037abb0fa4659e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_1971c78b3d1640842037abb0fa4659e5.jpg already downloaded
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F36%252F55361520dda4a29367e333dd0bc7e13d%252Fpa%252FZU32637_0c43540198bf9a874ae7cd4b2af8362c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_0c43540198bf9a874ae7cd4b2af8362c.jpg already downloaded
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F36%252F55361520dda4a29367e333dd0bc7e13d%252Fpa%252FZU32637_d8f29a78a51c64ba41adb564b2713642.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_d8f29a78a51c64ba41adb564b2713642.jpg already downloaded
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F36%252F55361520dda4a29367e333dd0bc7e13d%252Fpa%252FZU32637_00d4e8fe54a57eb960d4ce16344c5af7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_00d4e8fe54a57eb960d4ce16344c5af7.jpg already downloaded
2026-03-30 10:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72585f43-9ebd-5e3f-b847-0344e7671e63, identifier: ZU32637
2026-03-30 10:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8b4ed73-b977-51b6-9904-16b975722641 with identifier: TU30152
2026-03-30 10:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8b4ed73-b977-51b6-9904-16b975722641 with scrape type 1
2026-03-30 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8b4ed73-b977-51b6-9904-16b975722641
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_7dc0859ee05c36bac832a269057c38bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_7dc0859ee05c36bac832a269057c38bb.jpg not downloaded yet
2026-03-30 10:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72585f43-9ebd-5e3f-b847-0344e7671e63 with identifier: ZU32637
2026-03-30 10:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72585f43-9ebd-5e3f-b847-0344e7671e63 with identifier: ZU32637
2026-03-30 10:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72585f43-9ebd-5e3f-b847-0344e7671e63 with identifier: ZU32637 to the API
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZU32637>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:21:21Z',
 'fuel_type': 'petrol',
 'id': '72585f43-9ebd-5e3f-b847-0344e7671e63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU32637',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 71418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_a01099c5ced41c0c632871663ef0a6a5.jpg',
                'https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_62f00e0153a303ab08a3474495bdcfa6.jpg',
                'https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_6610328ac1c6f53309b8c9169adae5fd.jpg',
                'https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_20443bd6403beed3d0400b4664fcb7b0.jpg',
                'https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_e439d689aae239de9bc7ce703a0fc76a.jpg',
                'https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_efb3a2189f9ba9a0ee66ef1a79ab8aac.jpg',
                'https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_1971c78b3d1640842037abb0fa4659e5.jpg',
                'https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_0c43540198bf9a874ae7cd4b2af8362c.jpg',
                'https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_d8f29a78a51c64ba41adb564b2713642.jpg',
                'https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_00d4e8fe54a57eb960d4ce16344c5af7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72585f43-9ebd-5e3f-b847-0344e7671e63/72585f43-9ebd-5e3f-b847-0344e7671e63_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_a01099c5ced41c0c632871663ef0a6a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72585f43-9ebd-5e3f-b847-0344e7671e63/72585f43-9ebd-5e3f-b847-0344e7671e63_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_62f00e0153a303ab08a3474495bdcfa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72585f43-9ebd-5e3f-b847-0344e7671e63/72585f43-9ebd-5e3f-b847-0344e7671e63_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_6610328ac1c6f53309b8c9169adae5fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72585f43-9ebd-5e3f-b847-0344e7671e63/72585f43-9ebd-5e3f-b847-0344e7671e63_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_20443bd6403beed3d0400b4664fcb7b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72585f43-9ebd-5e3f-b847-0344e7671e63/72585f43-9ebd-5e3f-b847-0344e7671e63_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3065156,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_e439d689aae239de9bc7ce703a0fc76a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72585f43-9ebd-5e3f-b847-0344e7671e63/72585f43-9ebd-5e3f-b847-0344e7671e63_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_efb3a2189f9ba9a0ee66ef1a79ab8aac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72585f43-9ebd-5e3f-b847-0344e7671e63/72585f43-9ebd-5e3f-b847-0344e7671e63_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_1971c78b3d1640842037abb0fa4659e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72585f43-9ebd-5e3f-b847-0344e7671e63/72585f43-9ebd-5e3f-b847-0344e7671e63_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_0c43540198bf9a874ae7cd4b2af8362c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72585f43-9ebd-5e3f-b847-0344e7671e63/72585f43-9ebd-5e3f-b847-0344e7671e63_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_d8f29a78a51c64ba41adb564b2713642.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72585f43-9ebd-5e3f-b847-0344e7671e63/72585f43-9ebd-5e3f-b847-0344e7671e63_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/36/55361520dda4a29367e333dd0bc7e13d/pa/ZU32637_00d4e8fe54a57eb960d4ce16344c5af7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU32637%27 HTTP/1.1" 200 None
2026-03-30 10:34:33 [auto1.de] INFO: Saving data for ZU32637: {'created_time': 1774866873.951325, 'last_price_update_time': 1774866873.951337, 'auction_closing_time': 1774970481.0}
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU32637') HTTP/1.1" 204 0
2026-03-30 10:34:34 [auto1.de] INFO: Found listing with ID: RM21186
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM21186%27 HTTP/1.1" 200 None
2026-03-30 10:34:34 [auto1.de] INFO: Scrape type for RM21186: 1
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_f146909702ed0bfafe4b355e16896a4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_f146909702ed0bfafe4b355e16896a4e.jpg not downloaded yet
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_9eae36ec492b3b1cae25397a4d4dc524.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_9eae36ec492b3b1cae25397a4d4dc524.jpg not downloaded yet
2026-03-30 10:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7f97e5e-8884-55f3-8ccf-af7c698e0fa6 with identifier: WD03646
2026-03-30 10:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7f97e5e-8884-55f3-8ccf-af7c698e0fa6 with scrape type 1
2026-03-30 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7f97e5e-8884-55f3-8ccf-af7c698e0fa6
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_58df5e2d83d98ad75abff2e10f6f136c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_58df5e2d83d98ad75abff2e10f6f136c.jpg not downloaded yet
2026-03-30 10:34:34 [auto1.de] INFO: Found listing with ID: CZ81825
2026-03-30 10:34:34 [auto1.de] INFO: Found listing with ID: TD64392
2026-03-30 10:34:34 [auto1.de] INFO: Found listing with ID: KT88198
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT88198%27 HTTP/1.1" 200 None
2026-03-30 10:34:34 [auto1.de] INFO: Scrape type for KT88198: 2
2026-03-30 10:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fb6f717-7ea1-5b4d-850f-42cbf6514e62 with identifier: KT88198
2026-03-30 10:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fb6f717-7ea1-5b4d-850f-42cbf6514e62 with scrape type 2
2026-03-30 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fb6f717-7ea1-5b4d-850f-42cbf6514e62 with scrape type 2
2026-03-30 10:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fb6f717-7ea1-5b4d-850f-42cbf6514e62, identifier: KT88198
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_dfe22d4642b59893aecf69fe4aa1c1b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_dfe22d4642b59893aecf69fe4aa1c1b4.jpg not downloaded yet
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_5698031e2e05a154b1e4c6738b15b400.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_5698031e2e05a154b1e4c6738b15b400.jpg not downloaded yet
2026-03-30 10:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fb6f717-7ea1-5b4d-850f-42cbf6514e62 with identifier: KT88198
2026-03-30 10:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fb6f717-7ea1-5b4d-850f-42cbf6514e62 with identifier: KT88198
2026-03-30 10:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fb6f717-7ea1-5b4d-850f-42cbf6514e62 with identifier: KT88198 to the API
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:53:26Z',
 'fuel_type': 'petrol',
 'id': '0fb6f717-7ea1-5b4d-850f-42cbf6514e62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT88198',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 287646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-17',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 FIFA WM Edition',
 'transmission': 'manual',
 'trim': 'FIFA WM Edition',
 'year': 2011}
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT88198%27 HTTP/1.1" 200 None
2026-03-30 10:34:34 [auto1.de] INFO: Saving data for KT88198: {'auction_closing_time': 1774972406.0, 'created_time': 1774377343.830123, 'last_price_update_time': 1774866874.582817}
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT88198') HTTP/1.1" 204 0
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_8219d245dbc968ffa33431834cc23161.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_8219d245dbc968ffa33431834cc23161.jpg not downloaded yet
2026-03-30 10:34:34 [auto1.de] INFO: Found listing with ID: ZX44823
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX44823%27 HTTP/1.1" 200 None
2026-03-30 10:34:34 [auto1.de] INFO: Scrape type for ZX44823: 1
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_0757987ad11c9e4e05c54f57bee559a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_0757987ad11c9e4e05c54f57bee559a1.jpg not downloaded yet
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_a147bb05929c4e778b9e49cc824abb0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_a147bb05929c4e778b9e49cc824abb0c.jpg not downloaded yet
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_6194179781bc708bbdef25c4db842c23.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_6194179781bc708bbdef25c4db842c23.jpg not downloaded yet
2026-03-30 10:34:34 [auto1.de] INFO: Found listing with ID: VX41327
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX41327%27 HTTP/1.1" 200 None
2026-03-30 10:34:34 [auto1.de] INFO: Scrape type for VX41327: 2
2026-03-30 10:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dca10b27-ab11-581a-a2ee-0314aa7bd45e with identifier: VX41327
2026-03-30 10:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dca10b27-ab11-581a-a2ee-0314aa7bd45e with scrape type 2
2026-03-30 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dca10b27-ab11-581a-a2ee-0314aa7bd45e with scrape type 2
2026-03-30 10:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dca10b27-ab11-581a-a2ee-0314aa7bd45e, identifier: VX41327
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_8c827a4a1f24e087780aa57c3e027aa7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_8c827a4a1f24e087780aa57c3e027aa7.jpg not downloaded yet
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_e7f2a851f50a1a81a9ce4580295771ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_e7f2a851f50a1a81a9ce4580295771ae.jpg not downloaded yet
2026-03-30 10:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dca10b27-ab11-581a-a2ee-0314aa7bd45e with identifier: VX41327
2026-03-30 10:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dca10b27-ab11-581a-a2ee-0314aa7bd45e with identifier: VX41327
2026-03-30 10:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dca10b27-ab11-581a-a2ee-0314aa7bd45e with identifier: VX41327 to the API
2026-03-30 10:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:33:58Z',
 'fuel_type': 'petrol',
 'id': 'dca10b27-ab11-581a-a2ee-0314aa7bd45e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX41327',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 79309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-03',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2019}
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX41327%27 HTTP/1.1" 200 None
2026-03-30 10:34:35 [auto1.de] INFO: Saving data for VX41327: {'auction_closing_time': 1774971238.0, 'created_time': 1773741968.484622, 'last_price_update_time': 1774866875.129193}
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX41327') HTTP/1.1" 204 0
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_28329be8eb800af1e078ff674c52229c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_28329be8eb800af1e078ff674c52229c.jpg not downloaded yet
2026-03-30 10:34:35 [auto1.de] INFO: Found listing with ID: YM81802
2026-03-30 10:34:35 [auto1.de] INFO: Found listing with ID: JB14555
2026-03-30 10:34:35 [auto1.de] INFO: Found listing with ID: DB12378
2026-03-30 10:34:35 [auto1.de] INFO: Found listing with ID: TH79589
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH79589%27 HTTP/1.1" 200 None
2026-03-30 10:34:35 [auto1.de] INFO: Scrape type for TH79589: 1
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_e4df7ad28efc4b639fa4ea34b9d09b67.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_e4df7ad28efc4b639fa4ea34b9d09b67.jpg not downloaded yet
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_fbbdf1135d9ce11e5fb8cd828ba604f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_fbbdf1135d9ce11e5fb8cd828ba604f1.jpg not downloaded yet
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_71f5bbebfbbf3a794fb608a74f71af35.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_71f5bbebfbbf3a794fb608a74f71af35.jpg not downloaded yet
2026-03-30 10:34:35 [auto1.de] INFO: Found listing with ID: PD59539
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD59539%27 HTTP/1.1" 200 None
2026-03-30 10:34:35 [auto1.de] INFO: Scrape type for PD59539: 2
2026-03-30 10:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ecd4bff-4ecd-539c-8e95-94e4ead29d03 with identifier: PD59539
2026-03-30 10:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ecd4bff-4ecd-539c-8e95-94e4ead29d03 with scrape type 2
2026-03-30 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ecd4bff-4ecd-539c-8e95-94e4ead29d03 with scrape type 2
2026-03-30 10:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ecd4bff-4ecd-539c-8e95-94e4ead29d03, identifier: PD59539
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_d2dc510dcff875b8290c95454eca120a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_d2dc510dcff875b8290c95454eca120a.jpg not downloaded yet
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_505345bbff0fe788187cd31626566c5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_505345bbff0fe788187cd31626566c5a.jpg not downloaded yet
2026-03-30 10:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ecd4bff-4ecd-539c-8e95-94e4ead29d03 with identifier: PD59539
2026-03-30 10:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ecd4bff-4ecd-539c-8e95-94e4ead29d03 with identifier: PD59539
2026-03-30 10:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ecd4bff-4ecd-539c-8e95-94e4ead29d03 with identifier: PD59539 to the API
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:23:33Z',
 'fuel_type': 'diesel',
 'id': '5ecd4bff-4ecd-539c-8e95-94e4ead29d03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD59539',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 114346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-07',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD59539%27 HTTP/1.1" 200 None
2026-03-30 10:34:35 [auto1.de] INFO: Saving data for PD59539: {'auction_closing_time': 1774970613.0, 'created_time': 1774293433.235449, 'last_price_update_time': 1774866875.693652}
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD59539') HTTP/1.1" 204 0
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_f6975209ae3be432f4b4068b3886062d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_f6975209ae3be432f4b4068b3886062d.jpg not downloaded yet
2026-03-30 10:34:35 [auto1.de] INFO: Found listing with ID: TZ25189
2026-03-30 10:34:35 [auto1.de] INFO: Found listing with ID: NG72078
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG72078%27 HTTP/1.1" 200 None
2026-03-30 10:34:35 [auto1.de] INFO: Scrape type for NG72078: 1
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_45d35d725db3ad4a994d1277aebbf9f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_45d35d725db3ad4a994d1277aebbf9f0.jpg not downloaded yet
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_9215b8294d788276143c26da10d72e6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_9215b8294d788276143c26da10d72e6b.jpg not downloaded yet
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_1f94bb342cde16604b388995000b069d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_1f94bb342cde16604b388995000b069d.jpg not downloaded yet
2026-03-30 10:34:35 [auto1.de] INFO: Found listing with ID: KD91632
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD91632%27 HTTP/1.1" 200 None
2026-03-30 10:34:35 [auto1.de] INFO: Scrape type for KD91632: 2
2026-03-30 10:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de97e93f-def6-59f3-9a74-589eb19876ce with identifier: KD91632
2026-03-30 10:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de97e93f-def6-59f3-9a74-589eb19876ce with scrape type 2
2026-03-30 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de97e93f-def6-59f3-9a74-589eb19876ce with scrape type 2
2026-03-30 10:34:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de97e93f-def6-59f3-9a74-589eb19876ce, identifier: KD91632
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_d31414a2b65164cf41e9a9232f8413f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_d31414a2b65164cf41e9a9232f8413f2.jpg not downloaded yet
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_ee76aa321f0c13da40bd948585b362ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_ee76aa321f0c13da40bd948585b362ef.jpg not downloaded yet
2026-03-30 10:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de97e93f-def6-59f3-9a74-589eb19876ce with identifier: KD91632
2026-03-30 10:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de97e93f-def6-59f3-9a74-589eb19876ce with identifier: KD91632
2026-03-30 10:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de97e93f-def6-59f3-9a74-589eb19876ce with identifier: KD91632 to the API
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:48:08Z',
 'fuel_type': 'diesel',
 'id': 'de97e93f-def6-59f3-9a74-589eb19876ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD91632',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 164317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-05',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD91632%27 HTTP/1.1" 200 None
2026-03-30 10:34:36 [auto1.de] INFO: Saving data for KD91632: {'auction_closing_time': 1774972088.0, 'created_time': 1774379818.598817, 'last_price_update_time': 1774866876.379241}
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD91632') HTTP/1.1" 204 0
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_b8f8fa3265c87623ae971e4864de9ab9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_b8f8fa3265c87623ae971e4864de9ab9.jpg not downloaded yet
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_239ebc4e9097261ea94fd30c6b50c6eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_239ebc4e9097261ea94fd30c6b50c6eb.jpg not downloaded yet
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_6ffb85db7d1c103dd5c2bd407cbbbd50.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_6ffb85db7d1c103dd5c2bd407cbbbd50.jpg not downloaded yet
2026-03-30 10:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB07563/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_6faef50dddb5889a75b7290fea24d759.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_6faef50dddb5889a75b7290fea24d759.jpg not downloaded yet
2026-03-30 10:34:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LK73650> (referer: https://www.auto1.com/v1/car-details-view/LK73650/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TN19858> (referer: https://www.auto1.com/v1/car-details-view/TN19858/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP09894> (referer: https://www.auto1.com/v1/car-details-view/YP09894/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_20812345e6c0c07766901ce8091dd512.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_20812345e6c0c07766901ce8091dd512.jpg not downloaded yet
2026-03-30 10:34:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_fae298b09fd16704817c3dbbd28eb4f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_7dc0859ee05c36bac832a269057c38bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV37303/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8 with identifier: LK73650
2026-03-30 10:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8 with scrape type 1
2026-03-30 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_6efe14bf48419d207772ee1b794b026f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_6efe14bf48419d207772ee1b794b026f.jpg not downloaded yet
2026-03-30 10:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d63708c1-fd06-5daa-8d4b-d9f87ef758ef with identifier: TN19858
2026-03-30 10:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d63708c1-fd06-5daa-8d4b-d9f87ef758ef with scrape type 1
2026-03-30 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d63708c1-fd06-5daa-8d4b-d9f87ef758ef
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_ab31c4c016fd8b9b41a1c5a7f556ff3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_ab31c4c016fd8b9b41a1c5a7f556ff3a.jpg not downloaded yet
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_a3042f7a139c25dc6a46b52e522fb3d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_a3042f7a139c25dc6a46b52e522fb3d5.jpg not downloaded yet
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_de75eee4f840910e3b449ce94123e670.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_de75eee4f840910e3b449ce94123e670.jpg not downloaded yet
2026-03-30 10:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbd9ca6d-2eab-53cd-b404-cd1030af16c2 with identifier: YP09894
2026-03-30 10:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbd9ca6d-2eab-53cd-b404-cd1030af16c2 with scrape type 1
2026-03-30 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fbd9ca6d-2eab-53cd-b404-cd1030af16c2
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_4b0ea85bce0001d2d1d00f5918b00c6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_4b0ea85bce0001d2d1d00f5918b00c6e.jpg not downloaded yet
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_6fa130ecf2fbc4480deeceb0437c0c87.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_6fa130ecf2fbc4480deeceb0437c0c87.jpg not downloaded yet
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_8222adf16872435aedddad0d7d5612f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_8222adf16872435aedddad0d7d5612f7.jpg not downloaded yet
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_ee3f5895d9fc5496164cbd3288dbaad8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_ee3f5895d9fc5496164cbd3288dbaad8.jpg not downloaded yet
2026-03-30 10:34:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4166790>
2026-03-30 10:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_fae298b09fd16704817c3dbbd28eb4f4.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_fae298b09fd16704817c3dbbd28eb4f4.jpg saved to cache
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b40d5609-d44e-587d-bcb0-68c5a8db35eb
2026-03-30 10:34:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f411fa90>
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_7dc0859ee05c36bac832a269057c38bb.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_7dc0859ee05c36bac832a269057c38bb.jpg saved to cache
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8b4ed73-b977-51b6-9904-16b975722641
2026-03-30 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_6faef50dddb5889a75b7290fea24d759.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_20812345e6c0c07766901ce8091dd512.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_b8f8fa3265c87623ae971e4864de9ab9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_d2eeb58cfdc816027d3d8a16ef69056e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_d2eeb58cfdc816027d3d8a16ef69056e.jpg not downloaded yet
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_c83756ab93b21a48bfc233353f963357.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_c83756ab93b21a48bfc233353f963357.jpg not downloaded yet
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_4758e44ad3cb91cd98375fa102a05517.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_4758e44ad3cb91cd98375fa102a05517.jpg not downloaded yet
2026-03-30 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MW69190> (referer: https://www.auto1.com/v1/car-details-view/MW69190/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_91afaaf9b74beb21f05e515f40ced17c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_91afaaf9b74beb21f05e515f40ced17c.jpg not downloaded yet
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_206841a5bf11f56bc65618b0a3a632d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_206841a5bf11f56bc65618b0a3a632d2.jpg not downloaded yet
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_b881d101588bf0d3bc8ece32bbfc7fe7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_b881d101588bf0d3bc8ece32bbfc7fe7.jpg not downloaded yet
2026-03-30 10:34:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_4563d5d77eaad0dea3c99e2d32ff8814.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_4563d5d77eaad0dea3c99e2d32ff8814.jpg not downloaded yet
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_12c18fcd0a2bc75e6515368380727220.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_12c18fcd0a2bc75e6515368380727220.jpg not downloaded yet
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_8f011a16ff4a1203ccd3c1302a428e86.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_8f011a16ff4a1203ccd3c1302a428e86.jpg not downloaded yet
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_207efbcddabfa6a2989b08509a5e165e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_207efbcddabfa6a2989b08509a5e165e.jpg not downloaded yet
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_e8973bb9267d0ad0b7c510eb338b4244.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_e8973bb9267d0ad0b7c510eb338b4244.jpg not downloaded yet
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_a3b2491ff41b8a2670c491f6cfb2d60c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_a3b2491ff41b8a2670c491f6cfb2d60c.jpg not downloaded yet
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef84550>
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_6faef50dddb5889a75b7290fea24d759.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_6faef50dddb5889a75b7290fea24d759.jpg saved to cache
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7f97e5e-8884-55f3-8ccf-af7c698e0fa6
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee61190>
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_20812345e6c0c07766901ce8091dd512.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_20812345e6c0c07766901ce8091dd512.jpg saved to cache
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7f97e5e-8884-55f3-8ccf-af7c698e0fa6
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee0ddd0>
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_b8f8fa3265c87623ae971e4864de9ab9.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_b8f8fa3265c87623ae971e4864de9ab9.jpg saved to cache
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7f97e5e-8884-55f3-8ccf-af7c698e0fa6
2026-03-30 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_d2eeb58cfdc816027d3d8a16ef69056e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_6fa130ecf2fbc4480deeceb0437c0c87.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_d1e3bfa4051466cb4e035f576b8b2ed0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_d1e3bfa4051466cb4e035f576b8b2ed0.jpg not downloaded yet
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_1aa774b4a9a7a0f01ef266d9bfa9f7b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_1aa774b4a9a7a0f01ef266d9bfa9f7b2.jpg not downloaded yet
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_f33c67e6280dfd7826f63b2fd7a20cfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_f33c67e6280dfd7826f63b2fd7a20cfe.jpg not downloaded yet
2026-03-30 10:34:37 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 9409 | hits on page: 40
2026-03-30 10:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddc22b32-58ae-50bb-87e0-17e4ddbcc469 with identifier: MW69190
2026-03-30 10:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddc22b32-58ae-50bb-87e0-17e4ddbcc469 with scrape type 1
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ddc22b32-58ae-50bb-87e0-17e4ddbcc469
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ffd%252Fb9fd195b0f64825a7bbe690700b34631%252Fpa%252FMW69190_5c9f214fda2489a8a87fe6c814207f16.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_5c9f214fda2489a8a87fe6c814207f16.jpg not downloaded yet
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_ed1b96f9fd581ec9ce036c3759f66dd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_ed1b96f9fd581ec9ce036c3759f66dd4.jpg not downloaded yet
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_0acff0cec4ac5ce6bc51e3770fc0de34.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_0acff0cec4ac5ce6bc51e3770fc0de34.jpg not downloaded yet
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_212872d1fca04c887c71901c53bc542a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_212872d1fca04c887c71901c53bc542a.jpg not downloaded yet
2026-03-30 10:34:37 [auto1.de] INFO: Found listing with ID: KD91632
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD91632%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [auto1.de] INFO: Scrape type for KD91632: 0
2026-03-30 10:34:37 [auto1.de] INFO: Found listing with ID: UD25726
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD25726%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [auto1.de] INFO: Scrape type for UD25726: 1
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ffd%252Fb9fd195b0f64825a7bbe690700b34631%252Fpa%252FMW69190_b25662d8a98476b9566468d477922e06.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_b25662d8a98476b9566468d477922e06.jpg not downloaded yet
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefed390>
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_d2eeb58cfdc816027d3d8a16ef69056e.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_d2eeb58cfdc816027d3d8a16ef69056e.jpg saved to cache
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd7dd0>
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_6fa130ecf2fbc4480deeceb0437c0c87.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_6fa130ecf2fbc4480deeceb0437c0c87.jpg saved to cache
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_6755d5decb1b175ab4aa7d8ae8fbc055.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_6755d5decb1b175ab4aa7d8ae8fbc055.jpg not downloaded yet
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_2c8abc8dfbaf88af60dabdc330e70e16.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_2c8abc8dfbaf88af60dabdc330e70e16.jpg not downloaded yet
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_b328e9cffc498fca5c9f54bf09bc4b0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_b328e9cffc498fca5c9f54bf09bc4b0b.jpg not downloaded yet
2026-03-30 10:34:37 [auto1.de] INFO: Found listing with ID: VZ62992
2026-03-30 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ62992%27 HTTP/1.1" 200 None
2026-03-30 10:34:38 [auto1.de] INFO: Scrape type for VZ62992: 2
2026-03-30 10:34:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32111123-9255-5e04-a6bf-8ace1f53bf73 with identifier: VZ62992
2026-03-30 10:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32111123-9255-5e04-a6bf-8ace1f53bf73 with scrape type 2
2026-03-30 10:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32111123-9255-5e04-a6bf-8ace1f53bf73 with scrape type 2
2026-03-30 10:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32111123-9255-5e04-a6bf-8ace1f53bf73, identifier: VZ62992
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ffd%252Fb9fd195b0f64825a7bbe690700b34631%252Fpa%252FMW69190_a99a9e161a179ac8119762a9cd374d67.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_a99a9e161a179ac8119762a9cd374d67.jpg not downloaded yet
2026-03-30 10:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32111123-9255-5e04-a6bf-8ace1f53bf73 with identifier: VZ62992
2026-03-30 10:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32111123-9255-5e04-a6bf-8ace1f53bf73 with identifier: VZ62992
2026-03-30 10:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32111123-9255-5e04-a6bf-8ace1f53bf73 with identifier: VZ62992 to the API
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-31T15:18:56Z',
 'fuel_type': 'petrol',
 'id': '32111123-9255-5e04-a6bf-8ace1f53bf73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ62992',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 88675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-13',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 Advantage blue 2WD',
 'transmission': 'manual',
 'trim': 'Advantage blue 2WD',
 'year': 2017}
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ62992%27 HTTP/1.1" 200 None
2026-03-30 10:34:38 [auto1.de] INFO: Saving data for VZ62992: {'auction_closing_time': 1774970336.0, 'created_time': 1773775198.307702, 'last_price_update_time': 1774866878.524419}
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ62992') HTTP/1.1" 204 0
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_6448d10e9d8ae94f875fcbadf0061feb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_6448d10e9d8ae94f875fcbadf0061feb.jpg not downloaded yet
2026-03-30 10:34:38 [auto1.de] INFO: Found listing with ID: AU07976
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU07976%27 HTTP/1.1" 200 None
2026-03-30 10:34:38 [auto1.de] INFO: Scrape type for AU07976: 1
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ffd%252Fb9fd195b0f64825a7bbe690700b34631%252Fpa%252FMW69190_11832d9734b1fe8398fb5f1b2020bfd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_11832d9734b1fe8398fb5f1b2020bfd5.jpg not downloaded yet
2026-03-30 10:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE83942/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:38 [auto1.de] INFO: Found listing with ID: ZD62787
2026-03-30 10:34:38 [auto1.de] INFO: Found listing with ID: WG88044
2026-03-30 10:34:38 [auto1.de] INFO: Found listing with ID: SD14914
2026-03-30 10:34:38 [auto1.de] INFO: Found listing with ID: RH79105
2026-03-30 10:34:38 [auto1.de] INFO: Found listing with ID: BB09478
2026-03-30 10:34:38 [auto1.de] INFO: Found listing with ID: UY94864
2026-03-30 10:34:38 [auto1.de] INFO: Found listing with ID: NB58576
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB58576%27 HTTP/1.1" 200 None
2026-03-30 10:34:38 [auto1.de] INFO: Scrape type for NB58576: 1
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ffd%252Fb9fd195b0f64825a7bbe690700b34631%252Fpa%252FMW69190_6cf96ef3c0bbf65bd82b427fe3fb6ca5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_6cf96ef3c0bbf65bd82b427fe3fb6ca5.jpg not downloaded yet
2026-03-30 10:34:38 [auto1.de] INFO: Found listing with ID: ZM82524
2026-03-30 10:34:38 [auto1.de] INFO: Found listing with ID: VT56580
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT56580%27 HTTP/1.1" 200 None
2026-03-30 10:34:38 [auto1.de] INFO: Scrape type for VT56580: 2
2026-03-30 10:34:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a463fe0-569f-5eec-83db-502b7257534e with identifier: VT56580
2026-03-30 10:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a463fe0-569f-5eec-83db-502b7257534e with scrape type 2
2026-03-30 10:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a463fe0-569f-5eec-83db-502b7257534e with scrape type 2
2026-03-30 10:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a463fe0-569f-5eec-83db-502b7257534e, identifier: VT56580
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ffd%252Fb9fd195b0f64825a7bbe690700b34631%252Fpa%252FMW69190_eefe065c804bb20043e0ec04d5a1957e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_eefe065c804bb20043e0ec04d5a1957e.jpg not downloaded yet
2026-03-30 10:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a463fe0-569f-5eec-83db-502b7257534e with identifier: VT56580
2026-03-30 10:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a463fe0-569f-5eec-83db-502b7257534e with identifier: VT56580
2026-03-30 10:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a463fe0-569f-5eec-83db-502b7257534e with identifier: VT56580 to the API
2026-03-30 10:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:11:10Z',
 'fuel_type': 'diesel',
 'id': '0a463fe0-569f-5eec-83db-502b7257534e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT56580',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 139618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-29',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2018}
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT56580%27 HTTP/1.1" 200 None
2026-03-30 10:34:39 [auto1.de] INFO: Saving data for VT56580: {'auction_closing_time': 1774969870.0, 'created_time': 1773229581.860133, 'last_price_update_time': 1774866879.15384}
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT56580') HTTP/1.1" 204 0
2026-03-30 10:34:39 [auto1.de] INFO: Found listing with ID: JZ36451
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ36451%27 HTTP/1.1" 200 None
2026-03-30 10:34:39 [auto1.de] INFO: Scrape type for JZ36451: 1
2026-03-30 10:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ25351/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:39 [auto1.de] INFO: Found listing with ID: LJ01907
2026-03-30 10:34:39 [auto1.de] INFO: Found listing with ID: BP27054
2026-03-30 10:34:39 [auto1.de] INFO: Found listing with ID: FM86230
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM86230%27 HTTP/1.1" 200 None
2026-03-30 10:34:39 [auto1.de] INFO: Scrape type for FM86230: 1
2026-03-30 10:34:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:39 [auto1.de] INFO: Found listing with ID: WB27214
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB27214%27 HTTP/1.1" 200 None
2026-03-30 10:34:39 [auto1.de] INFO: Scrape type for WB27214: 2
2026-03-30 10:34:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f38ae58-d99c-5cea-8fa8-8b60a737f5d9 with identifier: WB27214
2026-03-30 10:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f38ae58-d99c-5cea-8fa8-8b60a737f5d9 with scrape type 2
2026-03-30 10:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f38ae58-d99c-5cea-8fa8-8b60a737f5d9 with scrape type 2
2026-03-30 10:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f38ae58-d99c-5cea-8fa8-8b60a737f5d9, identifier: WB27214
2026-03-30 10:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f38ae58-d99c-5cea-8fa8-8b60a737f5d9 with identifier: WB27214
2026-03-30 10:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f38ae58-d99c-5cea-8fa8-8b60a737f5d9 with identifier: WB27214
2026-03-30 10:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f38ae58-d99c-5cea-8fa8-8b60a737f5d9 with identifier: WB27214 to the API
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-31T15:48:33Z',
 'fuel_type': 'petrol',
 'id': '0f38ae58-d99c-5cea-8fa8-8b60a737f5d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB27214',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 170829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seller_name': None,
 'title': 'Mazda CX-5 2.5 Sports-Line 2WD',
 'transmission': 'automatic',
 'trim': 'Sports-Line 2WD',
 'year': 2022}
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB27214%27 HTTP/1.1" 200 None
2026-03-30 10:34:39 [auto1.de] INFO: Saving data for WB27214: {'auction_closing_time': 1774972113.0, 'created_time': 1774262783.153643, 'last_price_update_time': 1774866879.750521}
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB27214') HTTP/1.1" 204 0
2026-03-30 10:34:39 [auto1.de] INFO: Found listing with ID: BW18419
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18419%27 HTTP/1.1" 200 None
2026-03-30 10:34:39 [auto1.de] INFO: Scrape type for BW18419: 1
2026-03-30 10:34:39 [auto1.de] INFO: Found listing with ID: VP88886
2026-03-30 10:34:39 [auto1.de] INFO: Found listing with ID: WX76835
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX76835%27 HTTP/1.1" 200 None
2026-03-30 10:34:39 [auto1.de] INFO: Scrape type for WX76835: 1
2026-03-30 10:34:39 [auto1.de] INFO: Found listing with ID: KP85790
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP85790%27 HTTP/1.1" 200 None
2026-03-30 10:34:39 [auto1.de] INFO: Scrape type for KP85790: 1
2026-03-30 10:34:39 [auto1.de] INFO: Found listing with ID: CL77227
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL77227%27 HTTP/1.1" 200 None
2026-03-30 10:34:39 [auto1.de] INFO: Scrape type for CL77227: 1
2026-03-30 10:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_239ebc4e9097261ea94fd30c6b50c6eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:39 [auto1.de] INFO: Found listing with ID: SV86811
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV86811%27 HTTP/1.1" 200 None
2026-03-30 10:34:39 [auto1.de] INFO: Scrape type for SV86811: 1
2026-03-30 10:34:39 [auto1.de] INFO: Found listing with ID: WK34527
2026-03-30 10:34:39 [auto1.de] INFO: Found listing with ID: GW16115
2026-03-30 10:34:39 [auto1.de] INFO: Found listing with ID: KY27075
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY27075%27 HTTP/1.1" 200 None
2026-03-30 10:34:39 [auto1.de] INFO: Scrape type for KY27075: 1
2026-03-30 10:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_6ffb85db7d1c103dd5c2bd407cbbbd50.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:39 [auto1.de] INFO: Found listing with ID: ZK56270
2026-03-30 10:34:39 [auto1.de] INFO: Found listing with ID: DC27012
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC27012%27 HTTP/1.1" 200 None
2026-03-30 10:34:39 [auto1.de] INFO: Scrape type for DC27012: 1
2026-03-30 10:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_11832d9734b1fe8398fb5f1b2020bfd5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:39 [auto1.de] INFO: Found listing with ID: TR56494
2026-03-30 10:34:39 [auto1.de] INFO: Found listing with ID: UE91025
2026-03-30 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE91025%27 HTTP/1.1" 200 None
2026-03-30 10:34:40 [auto1.de] INFO: Scrape type for UE91025: 1
2026-03-30 10:34:40 [auto1.de] INFO: Found listing with ID: AE19872
2026-03-30 10:34:40 [auto1.de] INFO: Found listing with ID: GX87704
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX87704%27 HTTP/1.1" 200 None
2026-03-30 10:34:40 [auto1.de] INFO: Scrape type for GX87704: 1
2026-03-30 10:34:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee02bd0>
2026-03-30 10:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_239ebc4e9097261ea94fd30c6b50c6eb.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_239ebc4e9097261ea94fd30c6b50c6eb.jpg saved to cache
2026-03-30 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b40d5609-d44e-587d-bcb0-68c5a8db35eb
2026-03-30 10:34:40 [auto1.de] INFO: Found listing with ID: BG55575
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG55575%27 HTTP/1.1" 200 None
2026-03-30 10:34:40 [auto1.de] INFO: Scrape type for BG55575: 1
2026-03-30 10:34:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4199b10>
2026-03-30 10:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_6ffb85db7d1c103dd5c2bd407cbbbd50.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_6ffb85db7d1c103dd5c2bd407cbbbd50.jpg saved to cache
2026-03-30 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8b4ed73-b977-51b6-9904-16b975722641
2026-03-30 10:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3eac50>
2026-03-30 10:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddc22b32-58ae-50bb-87e0-17e4ddbcc469/ddc22b32-58ae-50bb-87e0-17e4ddbcc469_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ffd%252Fb9fd195b0f64825a7bbe690700b34631%252Fpa%252FMW69190_11832d9734b1fe8398fb5f1b2020bfd5.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_11832d9734b1fe8398fb5f1b2020bfd5.jpg saved to cache
2026-03-30 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ddc22b32-58ae-50bb-87e0-17e4ddbcc469
2026-03-30 10:34:40 [auto1.de] INFO: Found listing with ID: GM26241
2026-03-30 10:34:40 [auto1.de] INFO: Found listing with ID: FR16544
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR16544%27 HTTP/1.1" 200 None
2026-03-30 10:34:40 [auto1.de] INFO: Scrape type for FR16544: 1
2026-03-30 10:34:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV37303> (referer: https://www.auto1.com/v1/car-details-view/KV37303/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_c83756ab93b21a48bfc233353f963357.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:40 [auto1.de] INFO: Found listing with ID: SF86380
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF86380%27 HTTP/1.1" 200 None
2026-03-30 10:34:40 [auto1.de] INFO: Scrape type for SF86380: 1
2026-03-30 10:34:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_8222adf16872435aedddad0d7d5612f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_4758e44ad3cb91cd98375fa102a05517.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:40 [auto1.de] INFO: Found listing with ID: DZ96943
2026-03-30 10:34:40 [auto1.de] INFO: Found listing with ID: HK07148
2026-03-30 10:34:40 [auto1.de] INFO: Found listing with ID: WJ62591
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ62591%27 HTTP/1.1" 200 None
2026-03-30 10:34:40 [auto1.de] INFO: Scrape type for WJ62591: 1
2026-03-30 10:34:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_ee3f5895d9fc5496164cbd3288dbaad8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_e8973bb9267d0ad0b7c510eb338b4244.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_a3b2491ff41b8a2670c491f6cfb2d60c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80f3b975-b734-5e96-aa53-0391c8b980ae with identifier: KV37303
2026-03-30 10:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80f3b975-b734-5e96-aa53-0391c8b980ae with scrape type 1
2026-03-30 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 80f3b975-b734-5e96-aa53-0391c8b980ae
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F4b%252F4d4b8c78e4cf50edd7b38f985ab47b0b%252Fpa%252FKV37303_21bf79c4747541a657b60de312bac227.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/4b/4d4b8c78e4cf50edd7b38f985ab47b0b/pa/KV37303_21bf79c4747541a657b60de312bac227.jpg already downloaded
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F4b%252F4d4b8c78e4cf50edd7b38f985ab47b0b%252Fpa%252FKV37303_44c480c811402744f0b16320a8f591a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/4b/4d4b8c78e4cf50edd7b38f985ab47b0b/pa/KV37303_44c480c811402744f0b16320a8f591a3.jpg already downloaded
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F4b%252F4d4b8c78e4cf50edd7b38f985ab47b0b%252Fpa%252FKV37303_d85fc8d0d6451ff7c321a7481e1a991d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/4b/4d4b8c78e4cf50edd7b38f985ab47b0b/pa/KV37303_d85fc8d0d6451ff7c321a7481e1a991d.jpg already downloaded
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F4b%252F4d4b8c78e4cf50edd7b38f985ab47b0b%252Fpa%252FKV37303_ac263273c914ccff6da02dff0b600732.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/4b/4d4b8c78e4cf50edd7b38f985ab47b0b/pa/KV37303_ac263273c914ccff6da02dff0b600732.jpg already downloaded
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F4b%252F4d4b8c78e4cf50edd7b38f985ab47b0b%252Fpa%252FKV37303_f5cb39cad3f2f704c5665c0eaa95ef03.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/4b/4d4b8c78e4cf50edd7b38f985ab47b0b/pa/KV37303_f5cb39cad3f2f704c5665c0eaa95ef03.jpg already downloaded
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F4b%252F4d4b8c78e4cf50edd7b38f985ab47b0b%252Fpa%252FKV37303_54d8eaffa5a8eb5ce14779d3259509fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/4b/4d4b8c78e4cf50edd7b38f985ab47b0b/pa/KV37303_54d8eaffa5a8eb5ce14779d3259509fc.jpg already downloaded
2026-03-30 10:34:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80f3b975-b734-5e96-aa53-0391c8b980ae, identifier: KV37303
2026-03-30 10:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80f3b975-b734-5e96-aa53-0391c8b980ae with identifier: KV37303
2026-03-30 10:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80f3b975-b734-5e96-aa53-0391c8b980ae with identifier: KV37303
2026-03-30 10:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80f3b975-b734-5e96-aa53-0391c8b980ae with identifier: KV37303 to the API
2026-03-30 10:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KV37303>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:10:57Z',
 'fuel_type': 'petrol',
 'id': '80f3b975-b734-5e96-aa53-0391c8b980ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV37303',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 171600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img4d/4b/4d4b8c78e4cf50edd7b38f985ab47b0b/pa/KV37303_21bf79c4747541a657b60de312bac227.jpg',
                'https://img-pa.auto1.com/img4d/4b/4d4b8c78e4cf50edd7b38f985ab47b0b/pa/KV37303_44c480c811402744f0b16320a8f591a3.jpg',
                'https://img-pa.auto1.com/img4d/4b/4d4b8c78e4cf50edd7b38f985ab47b0b/pa/KV37303_d85fc8d0d6451ff7c321a7481e1a991d.jpg',
                'https://img-pa.auto1.com/img4d/4b/4d4b8c78e4cf50edd7b38f985ab47b0b/pa/KV37303_ac263273c914ccff6da02dff0b600732.jpg',
                'https://img-pa.auto1.com/img4d/4b/4d4b8c78e4cf50edd7b38f985ab47b0b/pa/KV37303_f5cb39cad3f2f704c5665c0eaa95ef03.jpg',
                'https://img-pa.auto1.com/img4d/4b/4d4b8c78e4cf50edd7b38f985ab47b0b/pa/KV37303_54d8eaffa5a8eb5ce14779d3259509fc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80f3b975-b734-5e96-aa53-0391c8b980ae/80f3b975-b734-5e96-aa53-0391c8b980ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/4b/4d4b8c78e4cf50edd7b38f985ab47b0b/pa/KV37303_21bf79c4747541a657b60de312bac227.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80f3b975-b734-5e96-aa53-0391c8b980ae/80f3b975-b734-5e96-aa53-0391c8b980ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/4b/4d4b8c78e4cf50edd7b38f985ab47b0b/pa/KV37303_44c480c811402744f0b16320a8f591a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80f3b975-b734-5e96-aa53-0391c8b980ae/80f3b975-b734-5e96-aa53-0391c8b980ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/4b/4d4b8c78e4cf50edd7b38f985ab47b0b/pa/KV37303_d85fc8d0d6451ff7c321a7481e1a991d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80f3b975-b734-5e96-aa53-0391c8b980ae/80f3b975-b734-5e96-aa53-0391c8b980ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/4b/4d4b8c78e4cf50edd7b38f985ab47b0b/pa/KV37303_ac263273c914ccff6da02dff0b600732.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80f3b975-b734-5e96-aa53-0391c8b980ae/80f3b975-b734-5e96-aa53-0391c8b980ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/4b/4d4b8c78e4cf50edd7b38f985ab47b0b/pa/KV37303_f5cb39cad3f2f704c5665c0eaa95ef03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80f3b975-b734-5e96-aa53-0391c8b980ae/80f3b975-b734-5e96-aa53-0391c8b980ae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/4b/4d4b8c78e4cf50edd7b38f985ab47b0b/pa/KV37303_54d8eaffa5a8eb5ce14779d3259509fc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV37303%27 HTTP/1.1" 200 None
2026-03-30 10:34:41 [auto1.de] INFO: Saving data for KV37303: {'created_time': 1774866881.206453, 'last_price_update_time': 1774866881.206463, 'auction_closing_time': 1774969857.0}
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV37303') HTTP/1.1" 204 0
2026-03-30 10:34:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee56410>
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_c83756ab93b21a48bfc233353f963357.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_c83756ab93b21a48bfc233353f963357.jpg saved to cache
2026-03-30 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d63708c1-fd06-5daa-8d4b-d9f87ef758ef
2026-03-30 10:34:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeecaf90>
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_8222adf16872435aedddad0d7d5612f7.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_8222adf16872435aedddad0d7d5612f7.jpg saved to cache
2026-03-30 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d63708c1-fd06-5daa-8d4b-d9f87ef758ef
2026-03-30 10:34:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef19ad0>
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_4758e44ad3cb91cd98375fa102a05517.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_4758e44ad3cb91cd98375fa102a05517.jpg saved to cache
2026-03-30 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fbd9ca6d-2eab-53cd-b404-cd1030af16c2
2026-03-30 10:34:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4334a50>
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_ee3f5895d9fc5496164cbd3288dbaad8.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_ee3f5895d9fc5496164cbd3288dbaad8.jpg saved to cache
2026-03-30 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fbd9ca6d-2eab-53cd-b404-cd1030af16c2
2026-03-30 10:34:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f427bbd0>
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_e8973bb9267d0ad0b7c510eb338b4244.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_e8973bb9267d0ad0b7c510eb338b4244.jpg saved to cache
2026-03-30 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d63708c1-fd06-5daa-8d4b-d9f87ef758ef
2026-03-30 10:34:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4229b50>
2026-03-30 10:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_a3b2491ff41b8a2670c491f6cfb2d60c.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_a3b2491ff41b8a2670c491f6cfb2d60c.jpg saved to cache
2026-03-30 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fbd9ca6d-2eab-53cd-b404-cd1030af16c2
2026-03-30 10:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ND23678> (referer: https://www.auto1.com/v1/car-details-view/ND23678/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10002550-1074-57c4-9820-62c0ff499daa with identifier: ND23678
2026-03-30 10:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10002550-1074-57c4-9820-62c0ff499daa with scrape type 1
2026-03-30 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10002550-1074-57c4-9820-62c0ff499daa
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_19f9ff7595b4f327d68627a03abe1726.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_19f9ff7595b4f327d68627a03abe1726.jpg not downloaded yet
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_e9adb6f0483def104b4607d3083f6f86.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_e9adb6f0483def104b4607d3083f6f86.jpg not downloaded yet
2026-03-30 10:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BG55575/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_b0e83771d423e01e00f443a9bd944f9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_b0e83771d423e01e00f443a9bd944f9e.jpg not downloaded yet
2026-03-30 10:34:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_bc9caa46a699e8c600188ec0597c7716.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_bc9caa46a699e8c600188ec0597c7716.jpg not downloaded yet
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_204a4e1aa80ffdcae2fce98251ebae66.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_204a4e1aa80ffdcae2fce98251ebae66.jpg not downloaded yet
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_469aa84c86b753db4869659fbf76bbf6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_469aa84c86b753db4869659fbf76bbf6.jpg not downloaded yet
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_41e245b39318ff30775e07ba757630b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_41e245b39318ff30775e07ba757630b7.jpg not downloaded yet
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_8e4b43f317ccd5e1376a01417eb2bad6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_8e4b43f317ccd5e1376a01417eb2bad6.jpg not downloaded yet
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_48eedf517b49fc46da969f991fcfb9bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_48eedf517b49fc46da969f991fcfb9bc.jpg not downloaded yet
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_b38013e89de2cacd0ec93c4ac66ec148.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_b38013e89de2cacd0ec93c4ac66ec148.jpg not downloaded yet
2026-03-30 10:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_e9adb6f0483def104b4607d3083f6f86.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee0e390>
2026-03-30 10:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_e9adb6f0483def104b4607d3083f6f86.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_e9adb6f0483def104b4607d3083f6f86.jpg saved to cache
2026-03-30 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-03-30 10:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_b38013e89de2cacd0ec93c4ac66ec148.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec7190>
2026-03-30 10:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_b38013e89de2cacd0ec93c4ac66ec148.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_b38013e89de2cacd0ec93c4ac66ec148.jpg saved to cache
2026-03-30 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-03-30 10:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AC30992> (referer: https://www.auto1.com/v1/car-details-view/AC30992/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1060e49b-1ec0-5983-bb5f-22f83d3ff265 with identifier: AC30992
2026-03-30 10:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1060e49b-1ec0-5983-bb5f-22f83d3ff265 with scrape type 1
2026-03-30 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1060e49b-1ec0-5983-bb5f-22f83d3ff265
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_1816839814becbc1a9049d73f3256354.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_1816839814becbc1a9049d73f3256354.jpg not downloaded yet
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_28c05d686a899165abc748cc8f63ae66.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_28c05d686a899165abc748cc8f63ae66.jpg not downloaded yet
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_feccaa7773882ca7e45ae5e277342e49.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_feccaa7773882ca7e45ae5e277342e49.jpg not downloaded yet
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_c1914d80bc5596b616d4ece628dfc745.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_c1914d80bc5596b616d4ece628dfc745.jpg not downloaded yet
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_476212e4b4a5328cdcfa11638697c21f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_476212e4b4a5328cdcfa11638697c21f.jpg not downloaded yet
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_189c7892767db554ceccc81ee4cd0053.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_189c7892767db554ceccc81ee4cd0053.jpg not downloaded yet
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_76aa589ea9bd16263daf17ff9d7123ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_76aa589ea9bd16263daf17ff9d7123ef.jpg not downloaded yet
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_5ee70cad26cebb87dd43a15fd5838020.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_5ee70cad26cebb87dd43a15fd5838020.jpg not downloaded yet
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_94d3b851e9868b30fa26104050680fc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_94d3b851e9868b30fa26104050680fc1.jpg not downloaded yet
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_b70905ffd2d32d0e4b778bbf9ef7dcf1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_b70905ffd2d32d0e4b778bbf9ef7dcf1.jpg not downloaded yet
2026-03-30 10:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_48eedf517b49fc46da969f991fcfb9bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42a84d0>
2026-03-30 10:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_48eedf517b49fc46da969f991fcfb9bc.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_48eedf517b49fc46da969f991fcfb9bc.jpg saved to cache
2026-03-30 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-03-30 10:34:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.943(s), this was the 1st time calling it.
2026-03-30 10:34:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.819931037472003 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_b70905ffd2d32d0e4b778bbf9ef7dcf1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP85790/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414b990>
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_b70905ffd2d32d0e4b778bbf9ef7dcf1.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_b70905ffd2d32d0e4b778bbf9ef7dcf1.jpg saved to cache
2026-03-30 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1060e49b-1ec0-5983-bb5f-22f83d3ff265
2026-03-30 10:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_94d3b851e9868b30fa26104050680fc1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec7310>
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_94d3b851e9868b30fa26104050680fc1.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_94d3b851e9868b30fa26104050680fc1.jpg saved to cache
2026-03-30 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1060e49b-1ec0-5983-bb5f-22f83d3ff265
2026-03-30 10:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_5ee70cad26cebb87dd43a15fd5838020.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec4f50>
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_5ee70cad26cebb87dd43a15fd5838020.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_5ee70cad26cebb87dd43a15fd5838020.jpg saved to cache
2026-03-30 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1060e49b-1ec0-5983-bb5f-22f83d3ff265
2026-03-30 10:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_76aa589ea9bd16263daf17ff9d7123ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f433cad0>
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_76aa589ea9bd16263daf17ff9d7123ef.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_76aa589ea9bd16263daf17ff9d7123ef.jpg saved to cache
2026-03-30 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1060e49b-1ec0-5983-bb5f-22f83d3ff265
2026-03-30 10:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_189c7892767db554ceccc81ee4cd0053.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_476212e4b4a5328cdcfa11638697c21f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41db0d0>
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_189c7892767db554ceccc81ee4cd0053.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_189c7892767db554ceccc81ee4cd0053.jpg saved to cache
2026-03-30 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1060e49b-1ec0-5983-bb5f-22f83d3ff265
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41dba90>
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_476212e4b4a5328cdcfa11638697c21f.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_476212e4b4a5328cdcfa11638697c21f.jpg saved to cache
2026-03-30 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1060e49b-1ec0-5983-bb5f-22f83d3ff265
2026-03-30 10:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_c1914d80bc5596b616d4ece628dfc745.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_feccaa7773882ca7e45ae5e277342e49.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef58a50>
2026-03-30 10:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_c1914d80bc5596b616d4ece628dfc745.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_c1914d80bc5596b616d4ece628dfc745.jpg saved to cache
2026-03-30 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1060e49b-1ec0-5983-bb5f-22f83d3ff265
2026-03-30 10:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f433ea90>
2026-03-30 10:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_feccaa7773882ca7e45ae5e277342e49.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_feccaa7773882ca7e45ae5e277342e49.jpg saved to cache
2026-03-30 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1060e49b-1ec0-5983-bb5f-22f83d3ff265
2026-03-30 10:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_28c05d686a899165abc748cc8f63ae66.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_1816839814becbc1a9049d73f3256354.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee0d390>
2026-03-30 10:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_28c05d686a899165abc748cc8f63ae66.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_28c05d686a899165abc748cc8f63ae66.jpg saved to cache
2026-03-30 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1060e49b-1ec0-5983-bb5f-22f83d3ff265
2026-03-30 10:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FR16544/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb01d0>
2026-03-30 10:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Ff1%252F61f13883c8a575bcf1f0d8b24def1853%252Fpa%252FAC30992_1816839814becbc1a9049d73f3256354.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_1816839814becbc1a9049d73f3256354.jpg saved to cache
2026-03-30 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1060e49b-1ec0-5983-bb5f-22f83d3ff265
2026-03-30 10:34:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1060e49b-1ec0-5983-bb5f-22f83d3ff265, skipping ID generation
2026-03-30 10:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1060e49b-1ec0-5983-bb5f-22f83d3ff265 with scrape type 1
2026-03-30 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1060e49b-1ec0-5983-bb5f-22f83d3ff265 sending to next pipeline
2026-03-30 10:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1060e49b-1ec0-5983-bb5f-22f83d3ff265, identifier: AC30992
2026-03-30 10:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1060e49b-1ec0-5983-bb5f-22f83d3ff265 with identifier: AC30992
2026-03-30 10:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1060e49b-1ec0-5983-bb5f-22f83d3ff265 with identifier: AC30992
2026-03-30 10:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1060e49b-1ec0-5983-bb5f-22f83d3ff265 with identifier: AC30992 to the API
2026-03-30 10:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_1816839814becbc1a9049d73f3256354.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:17:23Z',
 'fuel_type': 'diesel',
 'id': '1060e49b-1ec0-5983-bb5f-22f83d3ff265',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC30992',
 'listing': 'auction',
 'location': 'DE, Schwerin',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 135556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_1816839814becbc1a9049d73f3256354.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_28c05d686a899165abc748cc8f63ae66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_feccaa7773882ca7e45ae5e277342e49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_c1914d80bc5596b616d4ece628dfc745.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_476212e4b4a5328cdcfa11638697c21f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_189c7892767db554ceccc81ee4cd0053.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_76aa589ea9bd16263daf17ff9d7123ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_5ee70cad26cebb87dd43a15fd5838020.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_94d3b851e9868b30fa26104050680fc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1060e49b-1ec0-5983-bb5f-22f83d3ff265/1060e49b-1ec0-5983-bb5f-22f83d3ff265_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/f1/61f13883c8a575bcf1f0d8b24def1853/pa/AC30992_b70905ffd2d32d0e4b778bbf9ef7dcf1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Allstar BlueMotion',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion',
 'year': 2017}
2026-03-30 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC30992%27 HTTP/1.1" 200 None
2026-03-30 10:34:46 [auto1.de] INFO: Saving data for AC30992: {'created_time': 1774866886.218178, 'last_price_update_time': 1774866886.218188, 'auction_closing_time': 1774970243.0}
2026-03-30 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC30992') HTTP/1.1" 204 0
2026-03-30 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GX87704/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_41e245b39318ff30775e07ba757630b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb0750>
2026-03-30 10:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_41e245b39318ff30775e07ba757630b7.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_41e245b39318ff30775e07ba757630b7.jpg saved to cache
2026-03-30 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-03-30 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_8e4b43f317ccd5e1376a01417eb2bad6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_469aa84c86b753db4869659fbf76bbf6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43abdd0>
2026-03-30 10:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_8e4b43f317ccd5e1376a01417eb2bad6.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_8e4b43f317ccd5e1376a01417eb2bad6.jpg saved to cache
2026-03-30 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-03-30 10:34:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb1510>
2026-03-30 10:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_469aa84c86b753db4869659fbf76bbf6.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_469aa84c86b753db4869659fbf76bbf6.jpg saved to cache
2026-03-30 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-03-30 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_204a4e1aa80ffdcae2fce98251ebae66.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UE91025/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4379650>
2026-03-30 10:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_204a4e1aa80ffdcae2fce98251ebae66.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_204a4e1aa80ffdcae2fce98251ebae66.jpg saved to cache
2026-03-30 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-03-30 10:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_bc9caa46a699e8c600188ec0597c7716.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43ab8d0>
2026-03-30 10:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_bc9caa46a699e8c600188ec0597c7716.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_bc9caa46a699e8c600188ec0597c7716.jpg saved to cache
2026-03-30 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-03-30 10:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_b0e83771d423e01e00f443a9bd944f9e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MR47328/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ62591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb0d50>
2026-03-30 10:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_b0e83771d423e01e00f443a9bd944f9e.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_b0e83771d423e01e00f443a9bd944f9e.jpg saved to cache
2026-03-30 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-03-30 10:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_19f9ff7595b4f327d68627a03abe1726.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41bc610>
2026-03-30 10:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fd2%252F35d2865612278624f003633e2f1750f9%252Fpa%252FND23678_19f9ff7595b4f327d68627a03abe1726.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_19f9ff7595b4f327d68627a03abe1726.jpg saved to cache
2026-03-30 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-03-30 10:34:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10002550-1074-57c4-9820-62c0ff499daa, skipping ID generation
2026-03-30 10:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10002550-1074-57c4-9820-62c0ff499daa with scrape type 1
2026-03-30 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10002550-1074-57c4-9820-62c0ff499daa sending to next pipeline
2026-03-30 10:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10002550-1074-57c4-9820-62c0ff499daa, identifier: ND23678
2026-03-30 10:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10002550-1074-57c4-9820-62c0ff499daa with identifier: ND23678
2026-03-30 10:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10002550-1074-57c4-9820-62c0ff499daa with identifier: ND23678
2026-03-30 10:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10002550-1074-57c4-9820-62c0ff499daa with identifier: ND23678 to the API
2026-03-30 10:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_19f9ff7595b4f327d68627a03abe1726.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 208,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 275,
 'expiration_date': '2026-03-31T15:38:50Z',
 'fuel_type': 'diesel',
 'id': '10002550-1074-57c4-9820-62c0ff499daa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND23678',
 'listing': 'auction',
 'location': 'DE, Würzburg',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 182799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2398933,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_19f9ff7595b4f327d68627a03abe1726.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2370441,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_e9adb6f0483def104b4607d3083f6f86.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2260898,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_b0e83771d423e01e00f443a9bd944f9e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2225496,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_bc9caa46a699e8c600188ec0597c7716.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2244229,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_204a4e1aa80ffdcae2fce98251ebae66.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2236007,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_469aa84c86b753db4869659fbf76bbf6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1990563,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_41e245b39318ff30775e07ba757630b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2365583,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_8e4b43f317ccd5e1376a01417eb2bad6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2317579,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_48eedf517b49fc46da969f991fcfb9bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2413707,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_b38013e89de2cacd0ec93c4ac66ec148.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 3.0 SD V6 R-Dynamic SE',
 'transmission': 'automatic',
 'trim': 'R-Dynamic SE',
 'year': 2019}
2026-03-30 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND23678%27 HTTP/1.1" 200 None
2026-03-30 10:34:48 [auto1.de] INFO: Saving data for ND23678: {'created_time': 1774866888.274978, 'last_price_update_time': 1774866888.274989, 'auction_closing_time': 1774971530.0}
2026-03-30 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND23678') HTTP/1.1" 204 0
2026-03-30 10:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KY27075/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BG55575> (referer: https://www.auto1.com/v1/car-details-view/BG55575/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b with identifier: BG55575
2026-03-30 10:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b with scrape type 1
2026-03-30 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd7%252Fecd72d20a2ccde9c0042e21e878aa87d%252Fpa%252FBG55575_6430b978642bf2c514e0f7a748ca4c93.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_6430b978642bf2c514e0f7a748ca4c93.jpg already downloaded
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd7%252Fecd72d20a2ccde9c0042e21e878aa87d%252Fpa%252FBG55575_c6d78dd124881bd02239d7550a04ebb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_c6d78dd124881bd02239d7550a04ebb0.jpg already downloaded
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd7%252Fecd72d20a2ccde9c0042e21e878aa87d%252Fpa%252FBG55575_1c89d33a2eaa1318cac06e338c21bb2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_1c89d33a2eaa1318cac06e338c21bb2f.jpg already downloaded
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd7%252Fecd72d20a2ccde9c0042e21e878aa87d%252Fpa%252FBG55575_09e4f36e09f1e4f35a883fa6518e7ef5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_09e4f36e09f1e4f35a883fa6518e7ef5.jpg already downloaded
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd7%252Fecd72d20a2ccde9c0042e21e878aa87d%252Fpa%252FBG55575_0c62c8bcce64c8a2414ae13894acb12a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_0c62c8bcce64c8a2414ae13894acb12a.jpg already downloaded
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd7%252Fecd72d20a2ccde9c0042e21e878aa87d%252Fpa%252FBG55575_3aaef9c7fcd2a3798184cddd7cd79c71.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_3aaef9c7fcd2a3798184cddd7cd79c71.jpg already downloaded
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd7%252Fecd72d20a2ccde9c0042e21e878aa87d%252Fpa%252FBG55575_349e739ce811b4366af4a0e4198b8020.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_349e739ce811b4366af4a0e4198b8020.jpg already downloaded
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd7%252Fecd72d20a2ccde9c0042e21e878aa87d%252Fpa%252FBG55575_857281e871a7e3c0210e1eae6e88da96.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_857281e871a7e3c0210e1eae6e88da96.jpg already downloaded
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd7%252Fecd72d20a2ccde9c0042e21e878aa87d%252Fpa%252FBG55575_a7d5ae793a8498687fad80ac4f7f623f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_a7d5ae793a8498687fad80ac4f7f623f.jpg already downloaded
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd7%252Fecd72d20a2ccde9c0042e21e878aa87d%252Fpa%252FBG55575_d0dc2e3d479bdc2b406b9120a2536173.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_d0dc2e3d479bdc2b406b9120a2536173.jpg already downloaded
2026-03-30 10:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b, identifier: BG55575
2026-03-30 10:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b with identifier: BG55575
2026-03-30 10:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b with identifier: BG55575
2026-03-30 10:34:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b with identifier: BG55575 to the API
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BG55575>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:02:55Z',
 'fuel_type': 'petrol',
 'id': 'aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG55575',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 152445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_6430b978642bf2c514e0f7a748ca4c93.jpg',
                'https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_c6d78dd124881bd02239d7550a04ebb0.jpg',
                'https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_1c89d33a2eaa1318cac06e338c21bb2f.jpg',
                'https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_09e4f36e09f1e4f35a883fa6518e7ef5.jpg',
                'https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_0c62c8bcce64c8a2414ae13894acb12a.jpg',
                'https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_3aaef9c7fcd2a3798184cddd7cd79c71.jpg',
                'https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_349e739ce811b4366af4a0e4198b8020.jpg',
                'https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_857281e871a7e3c0210e1eae6e88da96.jpg',
                'https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_a7d5ae793a8498687fad80ac4f7f623f.jpg',
                'https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_d0dc2e3d479bdc2b406b9120a2536173.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b/aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2954393,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_6430b978642bf2c514e0f7a748ca4c93.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b/aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_c6d78dd124881bd02239d7550a04ebb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b/aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2988885,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_1c89d33a2eaa1318cac06e338c21bb2f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b/aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_09e4f36e09f1e4f35a883fa6518e7ef5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b/aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3079953,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_0c62c8bcce64c8a2414ae13894acb12a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b/aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2976573,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_3aaef9c7fcd2a3798184cddd7cd79c71.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b/aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3178950,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_349e739ce811b4366af4a0e4198b8020.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b/aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_857281e871a7e3c0210e1eae6e88da96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b/aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_a7d5ae793a8498687fad80ac4f7f623f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b/aa05949d-8f57-53e1-b6cb-c5e5ccc29d4b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3174319,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d7/ecd72d20a2ccde9c0042e21e878aa87d/pa/BG55575_d0dc2e3d479bdc2b406b9120a2536173.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.4 TSI Allstar BlueMotion',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion',
 'year': 2017}
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG55575%27 HTTP/1.1" 200 None
2026-03-30 10:34:51 [auto1.de] INFO: Saving data for BG55575: {'created_time': 1774866891.961677, 'last_price_update_time': 1774866891.961687, 'auction_closing_time': 1774969375.0}
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG55575') HTTP/1.1" 204 0
2026-03-30 10:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP85790> (referer: https://www.auto1.com/v1/car-details-view/KP85790/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f36db48e-58ae-510f-aa38-25ffe46ce16d with identifier: KP85790
2026-03-30 10:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f36db48e-58ae-510f-aa38-25ffe46ce16d with scrape type 1
2026-03-30 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f36db48e-58ae-510f-aa38-25ffe46ce16d
2026-03-30 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_2d6574c8308c6085ed92dcbadedb3b4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_2d6574c8308c6085ed92dcbadedb3b4e.jpg not downloaded yet
2026-03-30 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_9e0b238c76fda1e25d23e77f7c4b0c08.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_9e0b238c76fda1e25d23e77f7c4b0c08.jpg not downloaded yet
2026-03-30 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_d8635407db2f31892f6884cb83fd43b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_d8635407db2f31892f6884cb83fd43b9.jpg not downloaded yet
2026-03-30 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_d4486ee26be3eec886ae6a3167d3f155.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_d4486ee26be3eec886ae6a3167d3f155.jpg not downloaded yet
2026-03-30 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_4f9037945250522fd2aa4c69931c6e41.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_4f9037945250522fd2aa4c69931c6e41.jpg not downloaded yet
2026-03-30 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_b33ac5275aeb670b43a4d09c05419770.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_b33ac5275aeb670b43a4d09c05419770.jpg not downloaded yet
2026-03-30 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_d4fe650ace18a77cc587e7f2c2a904ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_d4fe650ace18a77cc587e7f2c2a904ce.jpg not downloaded yet
2026-03-30 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_26a0ead4c41e4c97b2d0d8a8b1d10290.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_26a0ead4c41e4c97b2d0d8a8b1d10290.jpg not downloaded yet
2026-03-30 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_85b617e54b830759b64d99a8f11e53f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_85b617e54b830759b64d99a8f11e53f3.jpg not downloaded yet
2026-03-30 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_8e361c90e9227765ef715e251f88c7fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_8e361c90e9227765ef715e251f88c7fe.jpg not downloaded yet
2026-03-30 10:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL77227/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_8e361c90e9227765ef715e251f88c7fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE83942> (referer: https://www.auto1.com/v1/car-details-view/SE83942/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_85b617e54b830759b64d99a8f11e53f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeebf0d0>
2026-03-30 10:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_8e361c90e9227765ef715e251f88c7fe.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_8e361c90e9227765ef715e251f88c7fe.jpg saved to cache
2026-03-30 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f36db48e-58ae-510f-aa38-25ffe46ce16d
2026-03-30 10:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV86811/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9d3ef6a-0fea-5bb4-864c-d7b2057c322d with identifier: SE83942
2026-03-30 10:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9d3ef6a-0fea-5bb4-864c-d7b2057c322d with scrape type 1
2026-03-30 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9d3ef6a-0fea-5bb4-864c-d7b2057c322d
2026-03-30 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_9ce5690292db06eeecd050acf15507e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_9ce5690292db06eeecd050acf15507e4.jpg not downloaded yet
2026-03-30 10:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4228090>
2026-03-30 10:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_85b617e54b830759b64d99a8f11e53f3.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_85b617e54b830759b64d99a8f11e53f3.jpg saved to cache
2026-03-30 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f36db48e-58ae-510f-aa38-25ffe46ce16d
2026-03-30 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_1b915177737c2f8b42b47a80510e37ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_1b915177737c2f8b42b47a80510e37ff.jpg not downloaded yet
2026-03-30 10:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_26a0ead4c41e4c97b2d0d8a8b1d10290.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_7bb8d28e5100f82b6938b10a6eb95a04.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_7bb8d28e5100f82b6938b10a6eb95a04.jpg not downloaded yet
2026-03-30 10:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EJ77666/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_37134285607e43eae9283274156dd5d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_37134285607e43eae9283274156dd5d2.jpg not downloaded yet
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_1e4f2f8ecdec18dba1d342aa63221da8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_1e4f2f8ecdec18dba1d342aa63221da8.jpg not downloaded yet
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_5525f20e53a01a7444420e0510934db7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_5525f20e53a01a7444420e0510934db7.jpg not downloaded yet
2026-03-30 10:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_d4fe650ace18a77cc587e7f2c2a904ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec2550>
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_26a0ead4c41e4c97b2d0d8a8b1d10290.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_26a0ead4c41e4c97b2d0d8a8b1d10290.jpg saved to cache
2026-03-30 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f36db48e-58ae-510f-aa38-25ffe46ce16d
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_367f153435e025a01c3184347a830c2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_367f153435e025a01c3184347a830c2f.jpg not downloaded yet
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_84c4ad6c88bc0ba61c147eb5e1f366b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_84c4ad6c88bc0ba61c147eb5e1f366b0.jpg not downloaded yet
2026-03-30 10:34:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4346cd0>
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_d4fe650ace18a77cc587e7f2c2a904ce.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_d4fe650ace18a77cc587e7f2c2a904ce.jpg saved to cache
2026-03-30 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f36db48e-58ae-510f-aa38-25ffe46ce16d
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_5dd67eacbdf73083f056ecee3c1c4cde.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_5dd67eacbdf73083f056ecee3c1c4cde.jpg not downloaded yet
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_0946cec417a8a825c9848db88888aa8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_0946cec417a8a825c9848db88888aa8c.jpg not downloaded yet
2026-03-30 10:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_1b915177737c2f8b42b47a80510e37ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_9ce5690292db06eeecd050acf15507e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef51dd0>
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_1b915177737c2f8b42b47a80510e37ff.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_1b915177737c2f8b42b47a80510e37ff.jpg saved to cache
2026-03-30 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f9d3ef6a-0fea-5bb4-864c-d7b2057c322d
2026-03-30 10:34:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c06710>
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_9ce5690292db06eeecd050acf15507e4.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_9ce5690292db06eeecd050acf15507e4.jpg saved to cache
2026-03-30 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9d3ef6a-0fea-5bb4-864c-d7b2057c322d
2026-03-30 10:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_1e4f2f8ecdec18dba1d342aa63221da8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_0946cec417a8a825c9848db88888aa8c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UE91025> (referer: https://www.auto1.com/v1/car-details-view/UE91025/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeebd810>
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_1e4f2f8ecdec18dba1d342aa63221da8.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_1e4f2f8ecdec18dba1d342aa63221da8.jpg saved to cache
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f9d3ef6a-0fea-5bb4-864c-d7b2057c322d
2026-03-30 10:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WX76835/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee33250>
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_0946cec417a8a825c9848db88888aa8c.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_0946cec417a8a825c9848db88888aa8c.jpg saved to cache
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f9d3ef6a-0fea-5bb4-864c-d7b2057c322d
2026-03-30 10:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bfd40c1-1031-591c-a7c8-451dc9930f1f with identifier: UE91025
2026-03-30 10:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bfd40c1-1031-591c-a7c8-451dc9930f1f with scrape type 1
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7bfd40c1-1031-591c-a7c8-451dc9930f1f
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_5402cb40a7933086a055f32e14d5bea3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_5402cb40a7933086a055f32e14d5bea3.jpg not downloaded yet
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_f482e34efcf4898de35e3ec91c49fc5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_f482e34efcf4898de35e3ec91c49fc5c.jpg not downloaded yet
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_fae42f045b67fe33dce294399658b154.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_fae42f045b67fe33dce294399658b154.jpg not downloaded yet
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_39f4f76c092485b20b74235bd8cb4bfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_39f4f76c092485b20b74235bd8cb4bfe.jpg not downloaded yet
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_1089c61632f6a7f2d8ba2105a1ed8797.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_1089c61632f6a7f2d8ba2105a1ed8797.jpg not downloaded yet
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_3b4bbce4aaaa55eaab6ad332111feb5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_3b4bbce4aaaa55eaab6ad332111feb5a.jpg not downloaded yet
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_b0252d8662030cc60b969ac616edb7b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_b0252d8662030cc60b969ac616edb7b3.jpg not downloaded yet
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_9a4a7c175c9d5fec007036372503a417.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_9a4a7c175c9d5fec007036372503a417.jpg not downloaded yet
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_80ab2325d95961accbf9a22b2b7901b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_80ab2325d95961accbf9a22b2b7901b2.jpg not downloaded yet
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_702ae4fcf94e32853c7d09fe0c45f3ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_702ae4fcf94e32853c7d09fe0c45f3ca.jpg not downloaded yet
2026-03-30 10:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_5dd67eacbdf73083f056ecee3c1c4cde.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_84c4ad6c88bc0ba61c147eb5e1f366b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_702ae4fcf94e32853c7d09fe0c45f3ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_5525f20e53a01a7444420e0510934db7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4230b90>
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_5dd67eacbdf73083f056ecee3c1c4cde.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_5dd67eacbdf73083f056ecee3c1c4cde.jpg saved to cache
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f9d3ef6a-0fea-5bb4-864c-d7b2057c322d
2026-03-30 10:34:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41be1d0>
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_84c4ad6c88bc0ba61c147eb5e1f366b0.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_84c4ad6c88bc0ba61c147eb5e1f366b0.jpg saved to cache
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f9d3ef6a-0fea-5bb4-864c-d7b2057c322d
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef50290>
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_702ae4fcf94e32853c7d09fe0c45f3ca.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_702ae4fcf94e32853c7d09fe0c45f3ca.jpg saved to cache
2026-03-30 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7bfd40c1-1031-591c-a7c8-451dc9930f1f
2026-03-30 10:34:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4199710>
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_5525f20e53a01a7444420e0510934db7.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_5525f20e53a01a7444420e0510934db7.jpg saved to cache
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f9d3ef6a-0fea-5bb4-864c-d7b2057c322d
2026-03-30 10:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ25351> (referer: https://www.auto1.com/v1/car-details-view/ZZ25351/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:34:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_b0252d8662030cc60b969ac616edb7b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_80ab2325d95961accbf9a22b2b7901b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_9a4a7c175c9d5fec007036372503a417.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_367f153435e025a01c3184347a830c2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_3b4bbce4aaaa55eaab6ad332111feb5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91bf2107-1027-54cb-be3c-eaf2420b95ba with identifier: ZZ25351
2026-03-30 10:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91bf2107-1027-54cb-be3c-eaf2420b95ba with scrape type 1
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91bf2107-1027-54cb-be3c-eaf2420b95ba
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_cd1edaa6295ee994fd47a13d67956a46.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_cd1edaa6295ee994fd47a13d67956a46.jpg not downloaded yet
2026-03-30 10:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_fae42f045b67fe33dce294399658b154.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_e29cec30cedf6efa3a642d1d176eb085.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_e29cec30cedf6efa3a642d1d176eb085.jpg not downloaded yet
2026-03-30 10:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_1089c61632f6a7f2d8ba2105a1ed8797.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_39f4f76c092485b20b74235bd8cb4bfe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_dab06d68497c96dbbfbc7d9ed1114f30.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_dab06d68497c96dbbfbc7d9ed1114f30.jpg not downloaded yet
2026-03-30 10:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_f482e34efcf4898de35e3ec91c49fc5c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_a3ca4c3ef672601ca0c61701644e5e67.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_a3ca4c3ef672601ca0c61701644e5e67.jpg not downloaded yet
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_29c328f26a4c0707b86c8c9925ed1cdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_29c328f26a4c0707b86c8c9925ed1cdc.jpg not downloaded yet
2026-03-30 10:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_cd1edaa6295ee994fd47a13d67956a46.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee75690>
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_b0252d8662030cc60b969ac616edb7b3.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_b0252d8662030cc60b969ac616edb7b3.jpg saved to cache
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7bfd40c1-1031-591c-a7c8-451dc9930f1f
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee4e550>
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_80ab2325d95961accbf9a22b2b7901b2.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_80ab2325d95961accbf9a22b2b7901b2.jpg saved to cache
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7bfd40c1-1031-591c-a7c8-451dc9930f1f
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee0e150>
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_9a4a7c175c9d5fec007036372503a417.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_9a4a7c175c9d5fec007036372503a417.jpg saved to cache
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7bfd40c1-1031-591c-a7c8-451dc9930f1f
2026-03-30 10:34:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f413af50>
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_367f153435e025a01c3184347a830c2f.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_367f153435e025a01c3184347a830c2f.jpg saved to cache
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f9d3ef6a-0fea-5bb4-864c-d7b2057c322d
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_7b1d33bc64aee05ee2c0058009276c2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_7b1d33bc64aee05ee2c0058009276c2e.jpg not downloaded yet
2026-03-30 10:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_5402cb40a7933086a055f32e14d5bea3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_dab06d68497c96dbbfbc7d9ed1114f30.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_42d1feb2abc881f9a8954aaa82d9a2a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_42d1feb2abc881f9a8954aaa82d9a2a0.jpg not downloaded yet
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f420c4d0>
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_3b4bbce4aaaa55eaab6ad332111feb5a.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_3b4bbce4aaaa55eaab6ad332111feb5a.jpg saved to cache
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7bfd40c1-1031-591c-a7c8-451dc9930f1f
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee958d0>
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_fae42f045b67fe33dce294399658b154.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_fae42f045b67fe33dce294399658b154.jpg saved to cache
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7bfd40c1-1031-591c-a7c8-451dc9930f1f
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414d1d0>
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_1089c61632f6a7f2d8ba2105a1ed8797.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_1089c61632f6a7f2d8ba2105a1ed8797.jpg saved to cache
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7bfd40c1-1031-591c-a7c8-451dc9930f1f
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef75910>
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_39f4f76c092485b20b74235bd8cb4bfe.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_39f4f76c092485b20b74235bd8cb4bfe.jpg saved to cache
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7bfd40c1-1031-591c-a7c8-451dc9930f1f
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4223450>
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_f482e34efcf4898de35e3ec91c49fc5c.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_f482e34efcf4898de35e3ec91c49fc5c.jpg saved to cache
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7bfd40c1-1031-591c-a7c8-451dc9930f1f
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41ffa90>
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_cd1edaa6295ee994fd47a13d67956a46.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_cd1edaa6295ee994fd47a13d67956a46.jpg saved to cache
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91bf2107-1027-54cb-be3c-eaf2420b95ba
2026-03-30 10:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_a3ca4c3ef672601ca0c61701644e5e67.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_acfa25c30e74f81eda7b93e8ca0648ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_acfa25c30e74f81eda7b93e8ca0648ae.jpg not downloaded yet
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41fd790>
2026-03-30 10:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F3b%252F883bd29c3f17903753a5422deec84c6d%252Fpa%252FUE91025_5402cb40a7933086a055f32e14d5bea3.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_5402cb40a7933086a055f32e14d5bea3.jpg saved to cache
2026-03-30 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7bfd40c1-1031-591c-a7c8-451dc9930f1f
2026-03-30 10:34:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7bfd40c1-1031-591c-a7c8-451dc9930f1f, skipping ID generation
2026-03-30 10:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bfd40c1-1031-591c-a7c8-451dc9930f1f with scrape type 1
2026-03-30 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7bfd40c1-1031-591c-a7c8-451dc9930f1f sending to next pipeline
2026-03-30 10:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bfd40c1-1031-591c-a7c8-451dc9930f1f, identifier: UE91025
2026-03-30 10:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c0c4d0>
2026-03-30 10:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_dab06d68497c96dbbfbc7d9ed1114f30.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_dab06d68497c96dbbfbc7d9ed1114f30.jpg saved to cache
2026-03-30 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91bf2107-1027-54cb-be3c-eaf2420b95ba
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_57a8e779dad8dbfab3e3929868f9a3a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_57a8e779dad8dbfab3e3929868f9a3a7.jpg not downloaded yet
2026-03-30 10:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bfd40c1-1031-591c-a7c8-451dc9930f1f with identifier: UE91025
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 10:34:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bfd40c1-1031-591c-a7c8-451dc9930f1f with identifier: UE91025
2026-03-30 10:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bfd40c1-1031-591c-a7c8-451dc9930f1f with identifier: UE91025 to the API
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_5402cb40a7933086a055f32e14d5bea3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:34:11Z',
 'fuel_type': 'electro',
 'id': '7bfd40c1-1031-591c-a7c8-451dc9930f1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE91025',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 39596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_5402cb40a7933086a055f32e14d5bea3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_f482e34efcf4898de35e3ec91c49fc5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_fae42f045b67fe33dce294399658b154.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_39f4f76c092485b20b74235bd8cb4bfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_1089c61632f6a7f2d8ba2105a1ed8797.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_3b4bbce4aaaa55eaab6ad332111feb5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_b0252d8662030cc60b969ac616edb7b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_9a4a7c175c9d5fec007036372503a417.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_80ab2325d95961accbf9a22b2b7901b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfd40c1-1031-591c-a7c8-451dc9930f1f/7bfd40c1-1031-591c-a7c8-451dc9930f1f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/3b/883bd29c3f17903753a5422deec84c6d/pa/UE91025_702ae4fcf94e32853c7d09fe0c45f3ca.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 electric drive 100 kW e-Shine',
 'transmission': 'automatic',
 'trim': 'e-Shine',
 'year': 2022}
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE91025%27 HTTP/1.1" 200 None
2026-03-30 10:34:59 [auto1.de] INFO: Saving data for UE91025: {'created_time': 1774866899.853793, 'last_price_update_time': 1774866899.853807, 'auction_closing_time': 1774971251.0}
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE91025') HTTP/1.1" 204 0
2026-03-30 10:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_7b1d33bc64aee05ee2c0058009276c2e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_29c328f26a4c0707b86c8c9925ed1cdc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_b2689117e9c4a88b0996f2ce8522ad28.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_b2689117e9c4a88b0996f2ce8522ad28.jpg not downloaded yet
2026-03-30 10:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414c910>
2026-03-30 10:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_a3ca4c3ef672601ca0c61701644e5e67.jpg') HTTP/1.1" 204 0
2026-03-30 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_a3ca4c3ef672601ca0c61701644e5e67.jpg saved to cache
2026-03-30 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91bf2107-1027-54cb-be3c-eaf2420b95ba
2026-03-30 10:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_42d1feb2abc881f9a8954aaa82d9a2a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee85410>
2026-03-30 10:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_7b1d33bc64aee05ee2c0058009276c2e.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_7b1d33bc64aee05ee2c0058009276c2e.jpg saved to cache
2026-03-30 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91bf2107-1027-54cb-be3c-eaf2420b95ba
2026-03-30 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_57a8e779dad8dbfab3e3929868f9a3a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_acfa25c30e74f81eda7b93e8ca0648ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_b2689117e9c4a88b0996f2ce8522ad28.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee151d0>
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_29c328f26a4c0707b86c8c9925ed1cdc.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_29c328f26a4c0707b86c8c9925ed1cdc.jpg saved to cache
2026-03-30 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91bf2107-1027-54cb-be3c-eaf2420b95ba
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee725d0>
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_42d1feb2abc881f9a8954aaa82d9a2a0.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_42d1feb2abc881f9a8954aaa82d9a2a0.jpg saved to cache
2026-03-30 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 91bf2107-1027-54cb-be3c-eaf2420b95ba
2026-03-30 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_e29cec30cedf6efa3a642d1d176eb085.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5a82bd0>
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_57a8e779dad8dbfab3e3929868f9a3a7.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_57a8e779dad8dbfab3e3929868f9a3a7.jpg saved to cache
2026-03-30 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 91bf2107-1027-54cb-be3c-eaf2420b95ba
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee07490>
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_acfa25c30e74f81eda7b93e8ca0648ae.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_acfa25c30e74f81eda7b93e8ca0648ae.jpg saved to cache
2026-03-30 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 91bf2107-1027-54cb-be3c-eaf2420b95ba
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41fc790>
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_b2689117e9c4a88b0996f2ce8522ad28.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_b2689117e9c4a88b0996f2ce8522ad28.jpg saved to cache
2026-03-30 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 91bf2107-1027-54cb-be3c-eaf2420b95ba
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7f1d0>
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0d%252Fa60dd4f7ffc501fda3282f0f4d918ad5%252Fpa%252FZZ25351_e29cec30cedf6efa3a642d1d176eb085.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_e29cec30cedf6efa3a642d1d176eb085.jpg saved to cache
2026-03-30 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91bf2107-1027-54cb-be3c-eaf2420b95ba
2026-03-30 10:35:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91bf2107-1027-54cb-be3c-eaf2420b95ba, skipping ID generation
2026-03-30 10:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91bf2107-1027-54cb-be3c-eaf2420b95ba with scrape type 1
2026-03-30 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91bf2107-1027-54cb-be3c-eaf2420b95ba sending to next pipeline
2026-03-30 10:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91bf2107-1027-54cb-be3c-eaf2420b95ba, identifier: ZZ25351
2026-03-30 10:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91bf2107-1027-54cb-be3c-eaf2420b95ba with identifier: ZZ25351
2026-03-30 10:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91bf2107-1027-54cb-be3c-eaf2420b95ba with identifier: ZZ25351
2026-03-30 10:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91bf2107-1027-54cb-be3c-eaf2420b95ba with identifier: ZZ25351 to the API
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_e29cec30cedf6efa3a642d1d176eb085.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:36:49Z',
 'fuel_type': 'diesel',
 'id': '91bf2107-1027-54cb-be3c-eaf2420b95ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ25351',
 'listing': 'auction',
 'location': 'DE, Hodenhagen',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 128015,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_cd1edaa6295ee994fd47a13d67956a46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_e29cec30cedf6efa3a642d1d176eb085.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_dab06d68497c96dbbfbc7d9ed1114f30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_a3ca4c3ef672601ca0c61701644e5e67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_29c328f26a4c0707b86c8c9925ed1cdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_7b1d33bc64aee05ee2c0058009276c2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_42d1feb2abc881f9a8954aaa82d9a2a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_acfa25c30e74f81eda7b93e8ca0648ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_57a8e779dad8dbfab3e3929868f9a3a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf2107-1027-54cb-be3c-eaf2420b95ba/91bf2107-1027-54cb-be3c-eaf2420b95ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0d/a60dd4f7ffc501fda3282f0f4d918ad5/pa/ZZ25351_b2689117e9c4a88b0996f2ce8522ad28.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI United',
 'transmission': 'automatic',
 'trim': 'United',
 'year': 2020}
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ25351%27 HTTP/1.1" 200 None
2026-03-30 10:35:00 [auto1.de] INFO: Saving data for ZZ25351: {'created_time': 1774866900.87356, 'last_price_update_time': 1774866900.873571, 'auction_closing_time': 1774971409.0}
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ25351') HTTP/1.1" 204 0
2026-03-30 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_b33ac5275aeb670b43a4d09c05419770.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GX87704> (referer: https://www.auto1.com/v1/car-details-view/GX87704/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_7bb8d28e5100f82b6938b10a6eb95a04.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_37134285607e43eae9283274156dd5d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_d4486ee26be3eec886ae6a3167d3f155.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_4f9037945250522fd2aa4c69931c6e41.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42860d0>
2026-03-30 10:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_b33ac5275aeb670b43a4d09c05419770.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_b33ac5275aeb670b43a4d09c05419770.jpg saved to cache
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f36db48e-58ae-510f-aa38-25ffe46ce16d
2026-03-30 10:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_d8635407db2f31892f6884cb83fd43b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9639509-373e-5ff7-b8a7-67455cd3d5e6 with identifier: GX87704
2026-03-30 10:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9639509-373e-5ff7-b8a7-67455cd3d5e6 with scrape type 1
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9639509-373e-5ff7-b8a7-67455cd3d5e6
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbf%252F28bfa95bac03086dd8aa8dfecd630fe3%252Fpa%252FGX87704_2b5c667fdaacc03ed8bcd42a438e3821.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_2b5c667fdaacc03ed8bcd42a438e3821.jpg already downloaded
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbf%252F28bfa95bac03086dd8aa8dfecd630fe3%252Fpa%252FGX87704_e241df03474689e50f32e6ed1b6df176.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_e241df03474689e50f32e6ed1b6df176.jpg already downloaded
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbf%252F28bfa95bac03086dd8aa8dfecd630fe3%252Fpa%252FGX87704_538fc0c1342902a90586eff0222f4d24.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_538fc0c1342902a90586eff0222f4d24.jpg already downloaded
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbf%252F28bfa95bac03086dd8aa8dfecd630fe3%252Fpa%252FGX87704_c6c5d1e91b5f1cd552d3b51084ff1e00.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_c6c5d1e91b5f1cd552d3b51084ff1e00.jpg already downloaded
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbf%252F28bfa95bac03086dd8aa8dfecd630fe3%252Fpa%252FGX87704_b05adb5e779f4dadf1b30a5f42c3d857.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_b05adb5e779f4dadf1b30a5f42c3d857.jpg already downloaded
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbf%252F28bfa95bac03086dd8aa8dfecd630fe3%252Fpa%252FGX87704_8f5561d7a499da0d44d924a6ce87a3b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_8f5561d7a499da0d44d924a6ce87a3b4.jpg already downloaded
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbf%252F28bfa95bac03086dd8aa8dfecd630fe3%252Fpa%252FGX87704_929a19c157300e4d59c543ede941cba9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_929a19c157300e4d59c543ede941cba9.jpg already downloaded
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbf%252F28bfa95bac03086dd8aa8dfecd630fe3%252Fpa%252FGX87704_300f597a94a3ed60d496160dcbb28426.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_300f597a94a3ed60d496160dcbb28426.jpg already downloaded
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbf%252F28bfa95bac03086dd8aa8dfecd630fe3%252Fpa%252FGX87704_89a1301fa50b990d6159546466fb94eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_89a1301fa50b990d6159546466fb94eb.jpg already downloaded
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbf%252F28bfa95bac03086dd8aa8dfecd630fe3%252Fpa%252FGX87704_c6bcd9e483ff7abd642d0fc11bc6efa9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_c6bcd9e483ff7abd642d0fc11bc6efa9.jpg already downloaded
2026-03-30 10:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9639509-373e-5ff7-b8a7-67455cd3d5e6, identifier: GX87704
2026-03-30 10:35:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3eb250>
2026-03-30 10:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_7bb8d28e5100f82b6938b10a6eb95a04.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_7bb8d28e5100f82b6938b10a6eb95a04.jpg saved to cache
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f9d3ef6a-0fea-5bb4-864c-d7b2057c322d
2026-03-30 10:35:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f3ed0>
2026-03-30 10:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e3b50908c092631840940be782f2d6%252Fpa%252FSE83942_37134285607e43eae9283274156dd5d2.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_37134285607e43eae9283274156dd5d2.jpg saved to cache
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f9d3ef6a-0fea-5bb4-864c-d7b2057c322d
2026-03-30 10:35:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9d3ef6a-0fea-5bb4-864c-d7b2057c322d, skipping ID generation
2026-03-30 10:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9d3ef6a-0fea-5bb4-864c-d7b2057c322d with scrape type 1
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9d3ef6a-0fea-5bb4-864c-d7b2057c322d sending to next pipeline
2026-03-30 10:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9d3ef6a-0fea-5bb4-864c-d7b2057c322d, identifier: SE83942
2026-03-30 10:35:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e8e50>
2026-03-30 10:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_d4486ee26be3eec886ae6a3167d3f155.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_d4486ee26be3eec886ae6a3167d3f155.jpg saved to cache
2026-03-30 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f36db48e-58ae-510f-aa38-25ffe46ce16d
2026-03-30 10:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9639509-373e-5ff7-b8a7-67455cd3d5e6 with identifier: GX87704
2026-03-30 10:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9639509-373e-5ff7-b8a7-67455cd3d5e6 with identifier: GX87704
2026-03-30 10:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9639509-373e-5ff7-b8a7-67455cd3d5e6 with identifier: GX87704 to the API
2026-03-30 10:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GX87704>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:22:49Z',
 'fuel_type': 'petrol',
 'id': 'a9639509-373e-5ff7-b8a7-67455cd3d5e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX87704',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 114592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_2b5c667fdaacc03ed8bcd42a438e3821.jpg',
                'https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_e241df03474689e50f32e6ed1b6df176.jpg',
                'https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_538fc0c1342902a90586eff0222f4d24.jpg',
                'https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_c6c5d1e91b5f1cd552d3b51084ff1e00.jpg',
                'https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_b05adb5e779f4dadf1b30a5f42c3d857.jpg',
                'https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_8f5561d7a499da0d44d924a6ce87a3b4.jpg',
                'https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_929a19c157300e4d59c543ede941cba9.jpg',
                'https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_300f597a94a3ed60d496160dcbb28426.jpg',
                'https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_89a1301fa50b990d6159546466fb94eb.jpg',
                'https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_c6bcd9e483ff7abd642d0fc11bc6efa9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9639509-373e-5ff7-b8a7-67455cd3d5e6/a9639509-373e-5ff7-b8a7-67455cd3d5e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_2b5c667fdaacc03ed8bcd42a438e3821.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9639509-373e-5ff7-b8a7-67455cd3d5e6/a9639509-373e-5ff7-b8a7-67455cd3d5e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_e241df03474689e50f32e6ed1b6df176.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9639509-373e-5ff7-b8a7-67455cd3d5e6/a9639509-373e-5ff7-b8a7-67455cd3d5e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_538fc0c1342902a90586eff0222f4d24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9639509-373e-5ff7-b8a7-67455cd3d5e6/a9639509-373e-5ff7-b8a7-67455cd3d5e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_c6c5d1e91b5f1cd552d3b51084ff1e00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9639509-373e-5ff7-b8a7-67455cd3d5e6/a9639509-373e-5ff7-b8a7-67455cd3d5e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_b05adb5e779f4dadf1b30a5f42c3d857.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9639509-373e-5ff7-b8a7-67455cd3d5e6/a9639509-373e-5ff7-b8a7-67455cd3d5e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_8f5561d7a499da0d44d924a6ce87a3b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9639509-373e-5ff7-b8a7-67455cd3d5e6/a9639509-373e-5ff7-b8a7-67455cd3d5e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_929a19c157300e4d59c543ede941cba9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9639509-373e-5ff7-b8a7-67455cd3d5e6/a9639509-373e-5ff7-b8a7-67455cd3d5e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_300f597a94a3ed60d496160dcbb28426.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9639509-373e-5ff7-b8a7-67455cd3d5e6/a9639509-373e-5ff7-b8a7-67455cd3d5e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_89a1301fa50b990d6159546466fb94eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9639509-373e-5ff7-b8a7-67455cd3d5e6/a9639509-373e-5ff7-b8a7-67455cd3d5e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/bf/28bfa95bac03086dd8aa8dfecd630fe3/pa/GX87704_c6bcd9e483ff7abd642d0fc11bc6efa9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2015}
2026-03-30 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX87704%27 HTTP/1.1" 200 None
2026-03-30 10:35:02 [auto1.de] INFO: Saving data for GX87704: {'created_time': 1774866902.174792, 'last_price_update_time': 1774866902.174808, 'auction_closing_time': 1774970569.0}
2026-03-30 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX87704') HTTP/1.1" 204 0
2026-03-30 10:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9d3ef6a-0fea-5bb4-864c-d7b2057c322d with identifier: SE83942
2026-03-30 10:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9d3ef6a-0fea-5bb4-864c-d7b2057c322d with identifier: SE83942
2026-03-30 10:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9d3ef6a-0fea-5bb4-864c-d7b2057c322d with identifier: SE83942 to the API
2026-03-30 10:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_37134285607e43eae9283274156dd5d2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:01:12Z',
 'fuel_type': 'petrol',
 'id': 'f9d3ef6a-0fea-5bb4-864c-d7b2057c322d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE83942',
 'listing': 'auction',
 'location': 'DE, Halle',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 144915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2948974,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_9ce5690292db06eeecd050acf15507e4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3055040,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_1b915177737c2f8b42b47a80510e37ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3211624,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_7bb8d28e5100f82b6938b10a6eb95a04.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3276590,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_37134285607e43eae9283274156dd5d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3221953,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_1e4f2f8ecdec18dba1d342aa63221da8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3115374,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_5525f20e53a01a7444420e0510934db7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3086349,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_367f153435e025a01c3184347a830c2f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3139163,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_84c4ad6c88bc0ba61c147eb5e1f366b0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2997704,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_5dd67eacbdf73083f056ecee3c1c4cde.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9d3ef6a-0fea-5bb4-864c-d7b2057c322d/f9d3ef6a-0fea-5bb4-864c-d7b2057c322d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3181799,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e3b50908c092631840940be782f2d6/pa/SE83942_0946cec417a8a825c9848db88888aa8c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2011}
2026-03-30 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE83942%27 HTTP/1.1" 200 None
2026-03-30 10:35:02 [auto1.de] INFO: Saving data for SE83942: {'created_time': 1774866902.626978, 'last_price_update_time': 1774866902.626996, 'auction_closing_time': 1774969272.0}
2026-03-30 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE83942') HTTP/1.1" 204 0
2026-03-30 10:35:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4396290>
2026-03-30 10:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_4f9037945250522fd2aa4c69931c6e41.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_4f9037945250522fd2aa4c69931c6e41.jpg saved to cache
2026-03-30 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f36db48e-58ae-510f-aa38-25ffe46ce16d
2026-03-30 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SF86380/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FR16544> (referer: https://www.auto1.com/v1/car-details-view/FR16544/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MR47328> (referer: https://www.auto1.com/v1/car-details-view/MR47328/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee441ad0>
2026-03-30 10:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_d8635407db2f31892f6884cb83fd43b9.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_d8635407db2f31892f6884cb83fd43b9.jpg saved to cache
2026-03-30 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f36db48e-58ae-510f-aa38-25ffe46ce16d
2026-03-30 10:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f9748b5-0e7b-51ad-8095-50cffe1b0c44 with identifier: FR16544
2026-03-30 10:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f9748b5-0e7b-51ad-8095-50cffe1b0c44 with scrape type 1
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f9748b5-0e7b-51ad-8095-50cffe1b0c44
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_a489c3391c99513b486141f62b5d9dc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_a489c3391c99513b486141f62b5d9dc3.jpg not downloaded yet
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_8a3839532b5678cd3ffde36b9f3b5eae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_8a3839532b5678cd3ffde36b9f3b5eae.jpg not downloaded yet
2026-03-30 10:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a576386e-6c5f-5433-ac49-17b5d6fdb67e with identifier: MR47328
2026-03-30 10:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a576386e-6c5f-5433-ac49-17b5d6fdb67e with scrape type 1
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a576386e-6c5f-5433-ac49-17b5d6fdb67e
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_91c63afa6544c65cd623007020888a78.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_91c63afa6544c65cd623007020888a78.jpg not downloaded yet
2026-03-30 10:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_6cf96ef3c0bbf65bd82b427fe3fb6ca5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_eefe065c804bb20043e0ec04d5a1957e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_0758d46dff8aeae37857bd88cdd793db.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_0758d46dff8aeae37857bd88cdd793db.jpg not downloaded yet
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_5e9f81a3f0af09f573f7168cd2ea8d48.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_5e9f81a3f0af09f573f7168cd2ea8d48.jpg not downloaded yet
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_feea070ce92212bb52ff92eb3ce3e9d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_feea070ce92212bb52ff92eb3ce3e9d7.jpg not downloaded yet
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_bd949f52b7dfaf0a670bcfddb448a961.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_bd949f52b7dfaf0a670bcfddb448a961.jpg not downloaded yet
2026-03-30 10:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_2d6574c8308c6085ed92dcbadedb3b4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_9e0b238c76fda1e25d23e77f7c4b0c08.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_3b454bea06df7b7e6ec83575382cf8e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_3b454bea06df7b7e6ec83575382cf8e6.jpg not downloaded yet
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_3d119ea4bbf1e7e5cbf37adf71fd042f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_3d119ea4bbf1e7e5cbf37adf71fd042f.jpg not downloaded yet
2026-03-30 10:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_8a3839532b5678cd3ffde36b9f3b5eae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_9be5ee2e991dac3c1d478d9da9208372.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_9be5ee2e991dac3c1d478d9da9208372.jpg not downloaded yet
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_d5894a60233408174a15d10ae27c664c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_d5894a60233408174a15d10ae27c664c.jpg not downloaded yet
2026-03-30 10:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_91c63afa6544c65cd623007020888a78.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_0c4d5ac7e1d9104cf9c997c2cbc65502.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_0c4d5ac7e1d9104cf9c997c2cbc65502.jpg not downloaded yet
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_ba27e4ec9780849dcbb3ba0f27cd5365.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_ba27e4ec9780849dcbb3ba0f27cd5365.jpg not downloaded yet
2026-03-30 10:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424ded0>
2026-03-30 10:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddc22b32-58ae-50bb-87e0-17e4ddbcc469/ddc22b32-58ae-50bb-87e0-17e4ddbcc469_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ffd%252Fb9fd195b0f64825a7bbe690700b34631%252Fpa%252FMW69190_6cf96ef3c0bbf65bd82b427fe3fb6ca5.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_6cf96ef3c0bbf65bd82b427fe3fb6ca5.jpg saved to cache
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ddc22b32-58ae-50bb-87e0-17e4ddbcc469
2026-03-30 10:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f6174190>
2026-03-30 10:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddc22b32-58ae-50bb-87e0-17e4ddbcc469/ddc22b32-58ae-50bb-87e0-17e4ddbcc469_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ffd%252Fb9fd195b0f64825a7bbe690700b34631%252Fpa%252FMW69190_eefe065c804bb20043e0ec04d5a1957e.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_eefe065c804bb20043e0ec04d5a1957e.jpg saved to cache
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ddc22b32-58ae-50bb-87e0-17e4ddbcc469
2026-03-30 10:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_5e9f81a3f0af09f573f7168cd2ea8d48.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_e92ba3991ab74904172747c78d2c361b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_e92ba3991ab74904172747c78d2c361b.jpg not downloaded yet
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_545c94b5f9f989d89ac81fbd6666747b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_545c94b5f9f989d89ac81fbd6666747b.jpg not downloaded yet
2026-03-30 10:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_0758d46dff8aeae37857bd88cdd793db.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW18419/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41da490>
2026-03-30 10:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_2d6574c8308c6085ed92dcbadedb3b4e.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_2d6574c8308c6085ed92dcbadedb3b4e.jpg saved to cache
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f36db48e-58ae-510f-aa38-25ffe46ce16d
2026-03-30 10:35:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d7a50>
2026-03-30 10:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F36%252F82361d6396869bcff23144227e217763%252Fpa%252FKP85790_9e0b238c76fda1e25d23e77f7c4b0c08.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_9e0b238c76fda1e25d23e77f7c4b0c08.jpg saved to cache
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f36db48e-58ae-510f-aa38-25ffe46ce16d
2026-03-30 10:35:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f36db48e-58ae-510f-aa38-25ffe46ce16d, skipping ID generation
2026-03-30 10:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f36db48e-58ae-510f-aa38-25ffe46ce16d with scrape type 1
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f36db48e-58ae-510f-aa38-25ffe46ce16d sending to next pipeline
2026-03-30 10:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f36db48e-58ae-510f-aa38-25ffe46ce16d, identifier: KP85790
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_423d5d7b532843926855a7a712fc2089.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_423d5d7b532843926855a7a712fc2089.jpg not downloaded yet
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_6ce511739268b2bedb1f4232346a27c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_6ce511739268b2bedb1f4232346a27c1.jpg not downloaded yet
2026-03-30 10:35:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f36db48e-58ae-510f-aa38-25ffe46ce16d with identifier: KP85790
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 10:35:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f36db48e-58ae-510f-aa38-25ffe46ce16d with identifier: KP85790
2026-03-30 10:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f36db48e-58ae-510f-aa38-25ffe46ce16d with identifier: KP85790 to the API
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_9e0b238c76fda1e25d23e77f7c4b0c08.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:52:40Z',
 'fuel_type': 'petrol',
 'id': 'f36db48e-58ae-510f-aa38-25ffe46ce16d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP85790',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 99382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370869,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_2d6574c8308c6085ed92dcbadedb3b4e.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370159,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_9e0b238c76fda1e25d23e77f7c4b0c08.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381297,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_d8635407db2f31892f6884cb83fd43b9.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338908,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_d4486ee26be3eec886ae6a3167d3f155.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317365,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_4f9037945250522fd2aa4c69931c6e41.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318637,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_b33ac5275aeb670b43a4d09c05419770.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325291,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_d4fe650ace18a77cc587e7f2c2a904ce.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294787,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_26a0ead4c41e4c97b2d0d8a8b1d10290.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_85b617e54b830759b64d99a8f11e53f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36db48e-58ae-510f-aa38-25ffe46ce16d/f36db48e-58ae-510f-aa38-25ffe46ce16d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294614,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img82/36/82361d6396869bcff23144227e217763/pa/KP85790_8e361c90e9227765ef715e251f88c7fe.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.6 GDI FIFA World Cup Edition",
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2013}
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP85790%27 HTTP/1.1" 200 None
2026-03-30 10:35:04 [auto1.de] INFO: Saving data for KP85790: {'created_time': 1774866904.333009, 'last_price_update_time': 1774866904.333021, 'auction_closing_time': 1774972360.0}
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP85790') HTTP/1.1" 204 0
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee3f390>
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_8a3839532b5678cd3ffde36b9f3b5eae.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_8a3839532b5678cd3ffde36b9f3b5eae.jpg saved to cache
2026-03-30 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f9748b5-0e7b-51ad-8095-50cffe1b0c44
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f433ad90>
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_91c63afa6544c65cd623007020888a78.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_91c63afa6544c65cd623007020888a78.jpg saved to cache
2026-03-30 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a576386e-6c5f-5433-ac49-17b5d6fdb67e
2026-03-30 10:35:04 [scrapy.extensions.logstats] INFO: Crawled 139 pages (at 77 pages/min), scraped 84 items (at 44 items/min)
2026-03-30 10:35:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-30 10:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_d5894a60233408174a15d10ae27c664c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_28f5456ea2d7cc7778b3e707a98fce06.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_28f5456ea2d7cc7778b3e707a98fce06.jpg not downloaded yet
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_44c3b88fb25625551e76a2978f867947.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_44c3b88fb25625551e76a2978f867947.jpg not downloaded yet
2026-03-30 10:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC27012/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee47bc50>
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_5e9f81a3f0af09f573f7168cd2ea8d48.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_5e9f81a3f0af09f573f7168cd2ea8d48.jpg saved to cache
2026-03-30 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a576386e-6c5f-5433-ac49-17b5d6fdb67e
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f411f490>
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_0758d46dff8aeae37857bd88cdd793db.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_0758d46dff8aeae37857bd88cdd793db.jpg saved to cache
2026-03-30 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f9748b5-0e7b-51ad-8095-50cffe1b0c44
2026-03-30 10:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_ba27e4ec9780849dcbb3ba0f27cd5365.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ62591> (referer: https://www.auto1.com/v1/car-details-view/WJ62591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_42c7cac32ad52623365349a3d5236aee.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_42c7cac32ad52623365349a3d5236aee.jpg not downloaded yet
2026-03-30 10:35:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_545c94b5f9f989d89ac81fbd6666747b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_0c4d5ac7e1d9104cf9c997c2cbc65502.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee459310>
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_d5894a60233408174a15d10ae27c664c.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_d5894a60233408174a15d10ae27c664c.jpg saved to cache
2026-03-30 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a576386e-6c5f-5433-ac49-17b5d6fdb67e
2026-03-30 10:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_6ce511739268b2bedb1f4232346a27c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c01190>
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_ba27e4ec9780849dcbb3ba0f27cd5365.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_ba27e4ec9780849dcbb3ba0f27cd5365.jpg saved to cache
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a576386e-6c5f-5433-ac49-17b5d6fdb67e
2026-03-30 10:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84e264aa-bf53-5011-aa10-994a0cd1d349 with identifier: WJ62591
2026-03-30 10:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84e264aa-bf53-5011-aa10-994a0cd1d349 with scrape type 1
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 84e264aa-bf53-5011-aa10-994a0cd1d349
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_a37222508a4ddd469cf4ee8a54228800.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_a37222508a4ddd469cf4ee8a54228800.jpg not downloaded yet
2026-03-30 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_e92ba3991ab74904172747c78d2c361b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_423d5d7b532843926855a7a712fc2089.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_8895058d8daa5bb6cabca565cd6df9b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_8895058d8daa5bb6cabca565cd6df9b4.jpg not downloaded yet
2026-03-30 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_28f5456ea2d7cc7778b3e707a98fce06.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_44c3b88fb25625551e76a2978f867947.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3ff050>
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_545c94b5f9f989d89ac81fbd6666747b.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_545c94b5f9f989d89ac81fbd6666747b.jpg saved to cache
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a576386e-6c5f-5433-ac49-17b5d6fdb67e
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee47aa50>
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_0c4d5ac7e1d9104cf9c997c2cbc65502.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_0c4d5ac7e1d9104cf9c997c2cbc65502.jpg saved to cache
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f9748b5-0e7b-51ad-8095-50cffe1b0c44
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_b3a3c895bd905afe2d395ab6642b2293.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_b3a3c895bd905afe2d395ab6642b2293.jpg not downloaded yet
2026-03-30 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_42c7cac32ad52623365349a3d5236aee.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_b3d6fe4bc5c5d644e6ddc228bf8731f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_b3d6fe4bc5c5d644e6ddc228bf8731f4.jpg not downloaded yet
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a7410>
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_6ce511739268b2bedb1f4232346a27c1.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_6ce511739268b2bedb1f4232346a27c1.jpg saved to cache
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a576386e-6c5f-5433-ac49-17b5d6fdb67e
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef74a50>
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_e92ba3991ab74904172747c78d2c361b.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_e92ba3991ab74904172747c78d2c361b.jpg saved to cache
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f9748b5-0e7b-51ad-8095-50cffe1b0c44
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41db710>
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_423d5d7b532843926855a7a712fc2089.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_423d5d7b532843926855a7a712fc2089.jpg saved to cache
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f9748b5-0e7b-51ad-8095-50cffe1b0c44
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_881f7f55e6416a865257e17fb57607b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_881f7f55e6416a865257e17fb57607b0.jpg not downloaded yet
2026-03-30 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_3b454bea06df7b7e6ec83575382cf8e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_9be5ee2e991dac3c1d478d9da9208372.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee93f10>
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_28f5456ea2d7cc7778b3e707a98fce06.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_28f5456ea2d7cc7778b3e707a98fce06.jpg saved to cache
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5f9748b5-0e7b-51ad-8095-50cffe1b0c44
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4172750>
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_44c3b88fb25625551e76a2978f867947.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_44c3b88fb25625551e76a2978f867947.jpg saved to cache
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a576386e-6c5f-5433-ac49-17b5d6fdb67e
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42796d0>
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_42c7cac32ad52623365349a3d5236aee.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_42c7cac32ad52623365349a3d5236aee.jpg saved to cache
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a576386e-6c5f-5433-ac49-17b5d6fdb67e
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_75d821dbe402c105237f0cec215ad506.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_75d821dbe402c105237f0cec215ad506.jpg not downloaded yet
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_3691aa19b5b28889e34c5871948aa189.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_3691aa19b5b28889e34c5871948aa189.jpg not downloaded yet
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7e5d0>
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_3b454bea06df7b7e6ec83575382cf8e6.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_3b454bea06df7b7e6ec83575382cf8e6.jpg saved to cache
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f9748b5-0e7b-51ad-8095-50cffe1b0c44
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429f5d0>
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_9be5ee2e991dac3c1d478d9da9208372.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_9be5ee2e991dac3c1d478d9da9208372.jpg saved to cache
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f9748b5-0e7b-51ad-8095-50cffe1b0c44
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_f70941d3799cf654ea543654e56f7f1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_f70941d3799cf654ea543654e56f7f1d.jpg not downloaded yet
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_bbcb6253c88086898483fb9327e88b23.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_bbcb6253c88086898483fb9327e88b23.jpg not downloaded yet
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_9b23e33a1601b762022128c697babc24.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_9b23e33a1601b762022128c697babc24.jpg not downloaded yet
2026-03-30 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV86811> (referer: https://www.auto1.com/v1/car-details-view/SV86811/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_3d119ea4bbf1e7e5cbf37adf71fd042f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_a37222508a4ddd469cf4ee8a54228800.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_b3a3c895bd905afe2d395ab6642b2293.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 000cb108-ea22-5f96-9822-5deb06fae5a4 with identifier: SV86811
2026-03-30 10:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 000cb108-ea22-5f96-9822-5deb06fae5a4 with scrape type 1
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 000cb108-ea22-5f96-9822-5deb06fae5a4
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f13cfa82c6f98a199ce2be56e225a1%252Fpa%252FSV86811_a1a682bb8621f8b161f738812f139950.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_a1a682bb8621f8b161f738812f139950.jpg already downloaded
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f13cfa82c6f98a199ce2be56e225a1%252Fpa%252FSV86811_a6328c340d0075f9d2f6a43044ba1956.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_a6328c340d0075f9d2f6a43044ba1956.jpg already downloaded
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f13cfa82c6f98a199ce2be56e225a1%252Fpa%252FSV86811_0f2bc14c930f04bae1e899f613017f69.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_0f2bc14c930f04bae1e899f613017f69.jpg already downloaded
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f13cfa82c6f98a199ce2be56e225a1%252Fpa%252FSV86811_3d4913f68c62707c2e9ebb3a068d9622.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_3d4913f68c62707c2e9ebb3a068d9622.jpg already downloaded
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f13cfa82c6f98a199ce2be56e225a1%252Fpa%252FSV86811_3ae74ab961f40aa54cb2b4b3355eaa10.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_3ae74ab961f40aa54cb2b4b3355eaa10.jpg already downloaded
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f13cfa82c6f98a199ce2be56e225a1%252Fpa%252FSV86811_7cf84bcd8a85f24138ac5d07c078f298.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_7cf84bcd8a85f24138ac5d07c078f298.jpg already downloaded
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f13cfa82c6f98a199ce2be56e225a1%252Fpa%252FSV86811_4c8e2e3ecaabcea0f1a97c934816bd1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_4c8e2e3ecaabcea0f1a97c934816bd1d.jpg already downloaded
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f13cfa82c6f98a199ce2be56e225a1%252Fpa%252FSV86811_a5ec9b38c038409631d3da36e5d8b326.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_a5ec9b38c038409631d3da36e5d8b326.jpg already downloaded
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f13cfa82c6f98a199ce2be56e225a1%252Fpa%252FSV86811_9b0a3a511ff5c84b28d43ff87c4295d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_9b0a3a511ff5c84b28d43ff87c4295d5.jpg already downloaded
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f13cfa82c6f98a199ce2be56e225a1%252Fpa%252FSV86811_a402637e214d5332bb1e4a7272875d4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_a402637e214d5332bb1e4a7272875d4d.jpg already downloaded
2026-03-30 10:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 000cb108-ea22-5f96-9822-5deb06fae5a4, identifier: SV86811
2026-03-30 10:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 000cb108-ea22-5f96-9822-5deb06fae5a4 with identifier: SV86811
2026-03-30 10:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 000cb108-ea22-5f96-9822-5deb06fae5a4 with identifier: SV86811
2026-03-30 10:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 000cb108-ea22-5f96-9822-5deb06fae5a4 with identifier: SV86811 to the API
2026-03-30 10:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SV86811>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:27:59Z',
 'fuel_type': 'petrol',
 'id': '000cb108-ea22-5f96-9822-5deb06fae5a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV86811',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 115115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_a1a682bb8621f8b161f738812f139950.jpg',
                'https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_a6328c340d0075f9d2f6a43044ba1956.jpg',
                'https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_0f2bc14c930f04bae1e899f613017f69.jpg',
                'https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_3d4913f68c62707c2e9ebb3a068d9622.jpg',
                'https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_3ae74ab961f40aa54cb2b4b3355eaa10.jpg',
                'https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_7cf84bcd8a85f24138ac5d07c078f298.jpg',
                'https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_4c8e2e3ecaabcea0f1a97c934816bd1d.jpg',
                'https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_a5ec9b38c038409631d3da36e5d8b326.jpg',
                'https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_9b0a3a511ff5c84b28d43ff87c4295d5.jpg',
                'https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_a402637e214d5332bb1e4a7272875d4d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000cb108-ea22-5f96-9822-5deb06fae5a4/000cb108-ea22-5f96-9822-5deb06fae5a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_a1a682bb8621f8b161f738812f139950.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000cb108-ea22-5f96-9822-5deb06fae5a4/000cb108-ea22-5f96-9822-5deb06fae5a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_a6328c340d0075f9d2f6a43044ba1956.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000cb108-ea22-5f96-9822-5deb06fae5a4/000cb108-ea22-5f96-9822-5deb06fae5a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_0f2bc14c930f04bae1e899f613017f69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000cb108-ea22-5f96-9822-5deb06fae5a4/000cb108-ea22-5f96-9822-5deb06fae5a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_3d4913f68c62707c2e9ebb3a068d9622.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000cb108-ea22-5f96-9822-5deb06fae5a4/000cb108-ea22-5f96-9822-5deb06fae5a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_3ae74ab961f40aa54cb2b4b3355eaa10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000cb108-ea22-5f96-9822-5deb06fae5a4/000cb108-ea22-5f96-9822-5deb06fae5a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_7cf84bcd8a85f24138ac5d07c078f298.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000cb108-ea22-5f96-9822-5deb06fae5a4/000cb108-ea22-5f96-9822-5deb06fae5a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_4c8e2e3ecaabcea0f1a97c934816bd1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000cb108-ea22-5f96-9822-5deb06fae5a4/000cb108-ea22-5f96-9822-5deb06fae5a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_a5ec9b38c038409631d3da36e5d8b326.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000cb108-ea22-5f96-9822-5deb06fae5a4/000cb108-ea22-5f96-9822-5deb06fae5a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_9b0a3a511ff5c84b28d43ff87c4295d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000cb108-ea22-5f96-9822-5deb06fae5a4/000cb108-ea22-5f96-9822-5deb06fae5a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f13cfa82c6f98a199ce2be56e225a1/pa/SV86811_a402637e214d5332bb1e4a7272875d4d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2013}
2026-03-30 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV86811%27 HTTP/1.1" 200 None
2026-03-30 10:35:06 [auto1.de] INFO: Saving data for SV86811: {'created_time': 1774866906.476595, 'last_price_update_time': 1774866906.476606, 'auction_closing_time': 1774970879.0}
2026-03-30 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV86811') HTTP/1.1" 204 0
2026-03-30 10:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM86230/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeee5e10>
2026-03-30 10:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_3d119ea4bbf1e7e5cbf37adf71fd042f.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_3d119ea4bbf1e7e5cbf37adf71fd042f.jpg saved to cache
2026-03-30 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a576386e-6c5f-5433-ac49-17b5d6fdb67e
2026-03-30 10:35:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee10050>
2026-03-30 10:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_a37222508a4ddd469cf4ee8a54228800.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_a37222508a4ddd469cf4ee8a54228800.jpg saved to cache
2026-03-30 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84e264aa-bf53-5011-aa10-994a0cd1d349
2026-03-30 10:35:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41fd190>
2026-03-30 10:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_b3a3c895bd905afe2d395ab6642b2293.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_b3a3c895bd905afe2d395ab6642b2293.jpg saved to cache
2026-03-30 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84e264aa-bf53-5011-aa10-994a0cd1d349
2026-03-30 10:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KY27075> (referer: https://www.auto1.com/v1/car-details-view/KY27075/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_8895058d8daa5bb6cabca565cd6df9b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_b3d6fe4bc5c5d644e6ddc228bf8731f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_9b23e33a1601b762022128c697babc24.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_bbcb6253c88086898483fb9327e88b23.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a415b86-b650-5d64-9ec1-5b1eebdd71cb with identifier: KY27075
2026-03-30 10:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a415b86-b650-5d64-9ec1-5b1eebdd71cb with scrape type 1
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a415b86-b650-5d64-9ec1-5b1eebdd71cb
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_d8e76481dca8c7b651ffa772a9a939d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_d8e76481dca8c7b651ffa772a9a939d7.jpg not downloaded yet
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_d754c4fba6e785c24ad7fed04b442952.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_d754c4fba6e785c24ad7fed04b442952.jpg not downloaded yet
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_34b4b6d1db22e7f12f8e049559d2d1af.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_34b4b6d1db22e7f12f8e049559d2d1af.jpg not downloaded yet
2026-03-30 10:35:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee109d0>
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_8895058d8daa5bb6cabca565cd6df9b4.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_8895058d8daa5bb6cabca565cd6df9b4.jpg saved to cache
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84e264aa-bf53-5011-aa10-994a0cd1d349
2026-03-30 10:35:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefed390>
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_b3d6fe4bc5c5d644e6ddc228bf8731f4.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_b3d6fe4bc5c5d644e6ddc228bf8731f4.jpg saved to cache
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84e264aa-bf53-5011-aa10-994a0cd1d349
2026-03-30 10:35:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3fc410>
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_9b23e33a1601b762022128c697babc24.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_9b23e33a1601b762022128c697babc24.jpg saved to cache
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84e264aa-bf53-5011-aa10-994a0cd1d349
2026-03-30 10:35:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeec210>
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_bbcb6253c88086898483fb9327e88b23.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_bbcb6253c88086898483fb9327e88b23.jpg saved to cache
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84e264aa-bf53-5011-aa10-994a0cd1d349
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_441053ba9e3e01cfe8314d1fcae86669.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_441053ba9e3e01cfe8314d1fcae86669.jpg not downloaded yet
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_95528c6df51e5d1149d36d572bf49c8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_95528c6df51e5d1149d36d572bf49c8d.jpg not downloaded yet
2026-03-30 10:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR68176/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_7ebbc2d96d4a75bc506a6073fee4442f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_7ebbc2d96d4a75bc506a6073fee4442f.jpg not downloaded yet
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_79002222e237ac9b849f1daff5a61526.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_79002222e237ac9b849f1daff5a61526.jpg not downloaded yet
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_71d84cde06692fcbb90ac6bd1a9ce82f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_71d84cde06692fcbb90ac6bd1a9ce82f.jpg not downloaded yet
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_199f541414d0de02c336bb51f1b44d3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_199f541414d0de02c336bb51f1b44d3d.jpg not downloaded yet
2026-03-30 10:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_d754c4fba6e785c24ad7fed04b442952.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_34b4b6d1db22e7f12f8e049559d2d1af.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_441053ba9e3e01cfe8314d1fcae86669.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_c0466931bd37762572538d021df0a3c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_c0466931bd37762572538d021df0a3c4.jpg not downloaded yet
2026-03-30 10:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_d8e76481dca8c7b651ffa772a9a939d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_3691aa19b5b28889e34c5871948aa189.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EJ77666> (referer: https://www.auto1.com/v1/car-details-view/EJ77666/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_881f7f55e6416a865257e17fb57607b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_75d821dbe402c105237f0cec215ad506.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_f70941d3799cf654ea543654e56f7f1d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_c0466931bd37762572538d021df0a3c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_71d84cde06692fcbb90ac6bd1a9ce82f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_199f541414d0de02c336bb51f1b44d3d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a0ad0>
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_d754c4fba6e785c24ad7fed04b442952.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_d754c4fba6e785c24ad7fed04b442952.jpg saved to cache
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a415b86-b650-5d64-9ec1-5b1eebdd71cb
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c09690>
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_34b4b6d1db22e7f12f8e049559d2d1af.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_34b4b6d1db22e7f12f8e049559d2d1af.jpg saved to cache
2026-03-30 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a415b86-b650-5d64-9ec1-5b1eebdd71cb
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec0ed0>
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_441053ba9e3e01cfe8314d1fcae86669.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_441053ba9e3e01cfe8314d1fcae86669.jpg saved to cache
2026-03-30 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a415b86-b650-5d64-9ec1-5b1eebdd71cb
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4214c10>
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_d8e76481dca8c7b651ffa772a9a939d7.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_d8e76481dca8c7b651ffa772a9a939d7.jpg saved to cache
2026-03-30 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a415b86-b650-5d64-9ec1-5b1eebdd71cb
2026-03-30 10:35:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec3290>
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_3691aa19b5b28889e34c5871948aa189.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_3691aa19b5b28889e34c5871948aa189.jpg saved to cache
2026-03-30 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84e264aa-bf53-5011-aa10-994a0cd1d349
2026-03-30 10:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18c8c221-5973-5afc-8704-b7acc85e0855 with identifier: EJ77666
2026-03-30 10:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18c8c221-5973-5afc-8704-b7acc85e0855 with scrape type 1
2026-03-30 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 18c8c221-5973-5afc-8704-b7acc85e0855
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fbd%252Faebd2e2d1d2b73b3a61ad3ddf95f6123%252Fpa%252FEJ77666_2e1d579d23942590e3678bef2238f7eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/bd/aebd2e2d1d2b73b3a61ad3ddf95f6123/pa/EJ77666_2e1d579d23942590e3678bef2238f7eb.jpg already downloaded
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fbd%252Faebd2e2d1d2b73b3a61ad3ddf95f6123%252Fpa%252FEJ77666_b2734ea1ad731477680080d58d3f447b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/bd/aebd2e2d1d2b73b3a61ad3ddf95f6123/pa/EJ77666_b2734ea1ad731477680080d58d3f447b.jpg already downloaded
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fbd%252Faebd2e2d1d2b73b3a61ad3ddf95f6123%252Fpa%252FEJ77666_5ad2ea7fde5bccbc026e9d7c5ea463f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/bd/aebd2e2d1d2b73b3a61ad3ddf95f6123/pa/EJ77666_5ad2ea7fde5bccbc026e9d7c5ea463f7.jpg already downloaded
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fbd%252Faebd2e2d1d2b73b3a61ad3ddf95f6123%252Fpa%252FEJ77666_34313ea197ce1ff19a09ae66e9775353.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/bd/aebd2e2d1d2b73b3a61ad3ddf95f6123/pa/EJ77666_34313ea197ce1ff19a09ae66e9775353.jpg already downloaded
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fbd%252Faebd2e2d1d2b73b3a61ad3ddf95f6123%252Fpa%252FEJ77666_a535c812c5720cb341ad2526ccdf0838.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/bd/aebd2e2d1d2b73b3a61ad3ddf95f6123/pa/EJ77666_a535c812c5720cb341ad2526ccdf0838.jpg already downloaded
2026-03-30 10:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18c8c221-5973-5afc-8704-b7acc85e0855, identifier: EJ77666
2026-03-30 10:35:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee105d0>
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_881f7f55e6416a865257e17fb57607b0.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_881f7f55e6416a865257e17fb57607b0.jpg saved to cache
2026-03-30 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84e264aa-bf53-5011-aa10-994a0cd1d349
2026-03-30 10:35:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f437a810>
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_75d821dbe402c105237f0cec215ad506.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_75d821dbe402c105237f0cec215ad506.jpg saved to cache
2026-03-30 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84e264aa-bf53-5011-aa10-994a0cd1d349
2026-03-30 10:35:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee95850>
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fe4%252F5fe4c082aea83e0156d97d39d1a63972%252Fpa%252FWJ62591_f70941d3799cf654ea543654e56f7f1d.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_f70941d3799cf654ea543654e56f7f1d.jpg saved to cache
2026-03-30 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84e264aa-bf53-5011-aa10-994a0cd1d349
2026-03-30 10:35:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84e264aa-bf53-5011-aa10-994a0cd1d349, skipping ID generation
2026-03-30 10:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84e264aa-bf53-5011-aa10-994a0cd1d349 with scrape type 1
2026-03-30 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84e264aa-bf53-5011-aa10-994a0cd1d349 sending to next pipeline
2026-03-30 10:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84e264aa-bf53-5011-aa10-994a0cd1d349, identifier: WJ62591
2026-03-30 10:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18c8c221-5973-5afc-8704-b7acc85e0855 with identifier: EJ77666
2026-03-30 10:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18c8c221-5973-5afc-8704-b7acc85e0855 with identifier: EJ77666
2026-03-30 10:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18c8c221-5973-5afc-8704-b7acc85e0855 with identifier: EJ77666 to the API
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EJ77666>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:52:59Z',
 'fuel_type': 'diesel',
 'id': '18c8c221-5973-5afc-8704-b7acc85e0855',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ77666',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 185308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgae/bd/aebd2e2d1d2b73b3a61ad3ddf95f6123/pa/EJ77666_2e1d579d23942590e3678bef2238f7eb.jpg',
                'https://img-pa.auto1.com/imgae/bd/aebd2e2d1d2b73b3a61ad3ddf95f6123/pa/EJ77666_b2734ea1ad731477680080d58d3f447b.jpg',
                'https://img-pa.auto1.com/imgae/bd/aebd2e2d1d2b73b3a61ad3ddf95f6123/pa/EJ77666_5ad2ea7fde5bccbc026e9d7c5ea463f7.jpg',
                'https://img-pa.auto1.com/imgae/bd/aebd2e2d1d2b73b3a61ad3ddf95f6123/pa/EJ77666_34313ea197ce1ff19a09ae66e9775353.jpg',
                'https://img-pa.auto1.com/imgae/bd/aebd2e2d1d2b73b3a61ad3ddf95f6123/pa/EJ77666_a535c812c5720cb341ad2526ccdf0838.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18c8c221-5973-5afc-8704-b7acc85e0855/18c8c221-5973-5afc-8704-b7acc85e0855_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/bd/aebd2e2d1d2b73b3a61ad3ddf95f6123/pa/EJ77666_2e1d579d23942590e3678bef2238f7eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18c8c221-5973-5afc-8704-b7acc85e0855/18c8c221-5973-5afc-8704-b7acc85e0855_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/bd/aebd2e2d1d2b73b3a61ad3ddf95f6123/pa/EJ77666_b2734ea1ad731477680080d58d3f447b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18c8c221-5973-5afc-8704-b7acc85e0855/18c8c221-5973-5afc-8704-b7acc85e0855_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/bd/aebd2e2d1d2b73b3a61ad3ddf95f6123/pa/EJ77666_5ad2ea7fde5bccbc026e9d7c5ea463f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18c8c221-5973-5afc-8704-b7acc85e0855/18c8c221-5973-5afc-8704-b7acc85e0855_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/bd/aebd2e2d1d2b73b3a61ad3ddf95f6123/pa/EJ77666_34313ea197ce1ff19a09ae66e9775353.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18c8c221-5973-5afc-8704-b7acc85e0855/18c8c221-5973-5afc-8704-b7acc85e0855_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/bd/aebd2e2d1d2b73b3a61ad3ddf95f6123/pa/EJ77666_a535c812c5720cb341ad2526ccdf0838.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2010}
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ77666%27 HTTP/1.1" 200 None
2026-03-30 10:35:09 [auto1.de] INFO: Saving data for EJ77666: {'created_time': 1774866909.382483, 'last_price_update_time': 1774866909.382494, 'auction_closing_time': 1774972379.0}
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ77666') HTTP/1.1" 204 0
2026-03-30 10:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84e264aa-bf53-5011-aa10-994a0cd1d349 with identifier: WJ62591
2026-03-30 10:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84e264aa-bf53-5011-aa10-994a0cd1d349 with identifier: WJ62591
2026-03-30 10:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84e264aa-bf53-5011-aa10-994a0cd1d349 with identifier: WJ62591 to the API
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_f70941d3799cf654ea543654e56f7f1d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.7L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:51:33Z',
 'fuel_type': 'diesel',
 'id': '84e264aa-bf53-5011-aa10-994a0cd1d349',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ62591',
 'listing': 'auction',
 'location': 'DE, Stendal',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 197592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2795731,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_a37222508a4ddd469cf4ee8a54228800.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2625186,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_8895058d8daa5bb6cabca565cd6df9b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2660549,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_b3a3c895bd905afe2d395ab6642b2293.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2398278,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_b3d6fe4bc5c5d644e6ddc228bf8731f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2839290,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_881f7f55e6416a865257e17fb57607b0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2656376,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_75d821dbe402c105237f0cec215ad506.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2438867,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_3691aa19b5b28889e34c5871948aa189.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2709632,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_f70941d3799cf654ea543654e56f7f1d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2642749,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_bbcb6253c88086898483fb9327e88b23.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e264aa-bf53-5011-aa10-994a0cd1d349/84e264aa-bf53-5011-aa10-994a0cd1d349_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2680740,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/e4/5fe4c082aea83e0156d97d39d1a63972/pa/WJ62591_9b23e33a1601b762022128c697babc24.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i40 1.7 CRDi Premium Blue',
 'transmission': 'automatic',
 'trim': 'Premium Blue',
 'year': 2015}
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ62591%27 HTTP/1.1" 200 None
2026-03-30 10:35:09 [auto1.de] INFO: Saving data for WJ62591: {'created_time': 1774866909.769294, 'last_price_update_time': 1774866909.769305, 'auction_closing_time': 1774972293.0}
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ62591') HTTP/1.1" 204 0
2026-03-30 10:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_79002222e237ac9b849f1daff5a61526.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_7ebbc2d96d4a75bc506a6073fee4442f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC27012> (referer: https://www.auto1.com/v1/car-details-view/DC27012/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW18419> (referer: https://www.auto1.com/v1/car-details-view/BW18419/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee0e7d0>
2026-03-30 10:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_c0466931bd37762572538d021df0a3c4.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_c0466931bd37762572538d021df0a3c4.jpg saved to cache
2026-03-30 10:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a415b86-b650-5d64-9ec1-5b1eebdd71cb
2026-03-30 10:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f2350>
2026-03-30 10:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_71d84cde06692fcbb90ac6bd1a9ce82f.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_71d84cde06692fcbb90ac6bd1a9ce82f.jpg saved to cache
2026-03-30 10:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a415b86-b650-5d64-9ec1-5b1eebdd71cb
2026-03-30 10:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41eb250>
2026-03-30 10:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_199f541414d0de02c336bb51f1b44d3d.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_199f541414d0de02c336bb51f1b44d3d.jpg saved to cache
2026-03-30 10:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a415b86-b650-5d64-9ec1-5b1eebdd71cb
2026-03-30 10:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_95528c6df51e5d1149d36d572bf49c8d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_a489c3391c99513b486141f62b5d9dc3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_feea070ce92212bb52ff92eb3ce3e9d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_bd949f52b7dfaf0a670bcfddb448a961.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4329ad0>
2026-03-30 10:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_79002222e237ac9b849f1daff5a61526.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_79002222e237ac9b849f1daff5a61526.jpg saved to cache
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a415b86-b650-5d64-9ec1-5b1eebdd71cb
2026-03-30 10:35:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef85490>
2026-03-30 10:35:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_7ebbc2d96d4a75bc506a6073fee4442f.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_7ebbc2d96d4a75bc506a6073fee4442f.jpg saved to cache
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a415b86-b650-5d64-9ec1-5b1eebdd71cb
2026-03-30 10:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7825e54-9391-5a33-99cd-bf830d86d565 with identifier: DC27012
2026-03-30 10:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7825e54-9391-5a33-99cd-bf830d86d565 with scrape type 1
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7825e54-9391-5a33-99cd-bf830d86d565
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ffb%252F25fb884e32b1034b519a3a29bdc896c0%252Fpa%252FDC27012_d112d36be5a88b37f18396b121df34bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_d112d36be5a88b37f18396b121df34bb.jpg already downloaded
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ffb%252F25fb884e32b1034b519a3a29bdc896c0%252Fpa%252FDC27012_79dfe296f0a6263f08b5add9a3c996b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_79dfe296f0a6263f08b5add9a3c996b6.jpg already downloaded
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ffb%252F25fb884e32b1034b519a3a29bdc896c0%252Fpa%252FDC27012_e708759b6f061c3883b047027631a76c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_e708759b6f061c3883b047027631a76c.jpg already downloaded
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ffb%252F25fb884e32b1034b519a3a29bdc896c0%252Fpa%252FDC27012_c7fc2bf4fe7445ca3406c6a9bb8608aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_c7fc2bf4fe7445ca3406c6a9bb8608aa.jpg already downloaded
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ffb%252F25fb884e32b1034b519a3a29bdc896c0%252Fpa%252FDC27012_379fe19f7ea2916dd54bfd5c2cd59f82.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_379fe19f7ea2916dd54bfd5c2cd59f82.jpg already downloaded
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ffb%252F25fb884e32b1034b519a3a29bdc896c0%252Fpa%252FDC27012_8e965655173b5d312a1576845cb15c97.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_8e965655173b5d312a1576845cb15c97.jpg already downloaded
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ffb%252F25fb884e32b1034b519a3a29bdc896c0%252Fpa%252FDC27012_10818fdf920a4676984863d78c4aa348.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_10818fdf920a4676984863d78c4aa348.jpg already downloaded
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ffb%252F25fb884e32b1034b519a3a29bdc896c0%252Fpa%252FDC27012_cb49a50e18e958b31b6c4f6a0b3ea086.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_cb49a50e18e958b31b6c4f6a0b3ea086.jpg already downloaded
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ffb%252F25fb884e32b1034b519a3a29bdc896c0%252Fpa%252FDC27012_469d97b9256a7b078229cfe18f7994bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_469d97b9256a7b078229cfe18f7994bd.jpg already downloaded
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ffb%252F25fb884e32b1034b519a3a29bdc896c0%252Fpa%252FDC27012_1870e45af4d184ddc1c1d60873409c31.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_1870e45af4d184ddc1c1d60873409c31.jpg already downloaded
2026-03-30 10:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7825e54-9391-5a33-99cd-bf830d86d565, identifier: DC27012
2026-03-30 10:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf with identifier: BW18419
2026-03-30 10:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf with scrape type 1
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_9687b7f335feedf9da25e6941d67a881.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_9687b7f335feedf9da25e6941d67a881.jpg not downloaded yet
2026-03-30 10:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7825e54-9391-5a33-99cd-bf830d86d565 with identifier: DC27012
2026-03-30 10:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7825e54-9391-5a33-99cd-bf830d86d565 with identifier: DC27012
2026-03-30 10:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7825e54-9391-5a33-99cd-bf830d86d565 with identifier: DC27012 to the API
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DC27012>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:30:45Z',
 'fuel_type': 'petrol',
 'id': 'b7825e54-9391-5a33-99cd-bf830d86d565',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC27012',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 155644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_d112d36be5a88b37f18396b121df34bb.jpg',
                'https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_79dfe296f0a6263f08b5add9a3c996b6.jpg',
                'https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_e708759b6f061c3883b047027631a76c.jpg',
                'https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_c7fc2bf4fe7445ca3406c6a9bb8608aa.jpg',
                'https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_379fe19f7ea2916dd54bfd5c2cd59f82.jpg',
                'https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_8e965655173b5d312a1576845cb15c97.jpg',
                'https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_10818fdf920a4676984863d78c4aa348.jpg',
                'https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_cb49a50e18e958b31b6c4f6a0b3ea086.jpg',
                'https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_469d97b9256a7b078229cfe18f7994bd.jpg',
                'https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_1870e45af4d184ddc1c1d60873409c31.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7825e54-9391-5a33-99cd-bf830d86d565/b7825e54-9391-5a33-99cd-bf830d86d565_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2842539,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_d112d36be5a88b37f18396b121df34bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7825e54-9391-5a33-99cd-bf830d86d565/b7825e54-9391-5a33-99cd-bf830d86d565_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2748245,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_79dfe296f0a6263f08b5add9a3c996b6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7825e54-9391-5a33-99cd-bf830d86d565/b7825e54-9391-5a33-99cd-bf830d86d565_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_e708759b6f061c3883b047027631a76c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7825e54-9391-5a33-99cd-bf830d86d565/b7825e54-9391-5a33-99cd-bf830d86d565_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2452703,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_c7fc2bf4fe7445ca3406c6a9bb8608aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7825e54-9391-5a33-99cd-bf830d86d565/b7825e54-9391-5a33-99cd-bf830d86d565_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2644538,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_379fe19f7ea2916dd54bfd5c2cd59f82.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7825e54-9391-5a33-99cd-bf830d86d565/b7825e54-9391-5a33-99cd-bf830d86d565_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2695250,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_8e965655173b5d312a1576845cb15c97.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7825e54-9391-5a33-99cd-bf830d86d565/b7825e54-9391-5a33-99cd-bf830d86d565_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2633006,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_10818fdf920a4676984863d78c4aa348.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7825e54-9391-5a33-99cd-bf830d86d565/b7825e54-9391-5a33-99cd-bf830d86d565_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2846858,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_cb49a50e18e958b31b6c4f6a0b3ea086.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7825e54-9391-5a33-99cd-bf830d86d565/b7825e54-9391-5a33-99cd-bf830d86d565_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_469d97b9256a7b078229cfe18f7994bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7825e54-9391-5a33-99cd-bf830d86d565/b7825e54-9391-5a33-99cd-bf830d86d565_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/fb/25fb884e32b1034b519a3a29bdc896c0/pa/DC27012_1870e45af4d184ddc1c1d60873409c31.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Transit 1.0 EcoBoost Kombi Trend',
 'transmission': 'manual',
 'trim': 'Kombi Trend',
 'year': 2019}
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC27012%27 HTTP/1.1" 200 None
2026-03-30 10:35:10 [auto1.de] INFO: Saving data for DC27012: {'created_time': 1774866910.669261, 'last_price_update_time': 1774866910.669269, 'auction_closing_time': 1774971045.0}
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC27012') HTTP/1.1" 204 0
2026-03-30 10:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_a99a9e161a179ac8119762a9cd374d67.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_489d84a25ace569c81314ca5c2315699.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_489d84a25ace569c81314ca5c2315699.jpg not downloaded yet
2026-03-30 10:35:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f595b1d0>
2026-03-30 10:35:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F44%252Ffe44ff21583bd2ca326540e5fecc6c79%252Fpa%252FKY27075_95528c6df51e5d1149d36d572bf49c8d.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_95528c6df51e5d1149d36d572bf49c8d.jpg saved to cache
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a415b86-b650-5d64-9ec1-5b1eebdd71cb
2026-03-30 10:35:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a415b86-b650-5d64-9ec1-5b1eebdd71cb, skipping ID generation
2026-03-30 10:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a415b86-b650-5d64-9ec1-5b1eebdd71cb with scrape type 1
2026-03-30 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a415b86-b650-5d64-9ec1-5b1eebdd71cb sending to next pipeline
2026-03-30 10:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a415b86-b650-5d64-9ec1-5b1eebdd71cb, identifier: KY27075
2026-03-30 10:35:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c0c490>
2026-03-30 10:35:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_a489c3391c99513b486141f62b5d9dc3.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_a489c3391c99513b486141f62b5d9dc3.jpg saved to cache
2026-03-30 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f9748b5-0e7b-51ad-8095-50cffe1b0c44
2026-03-30 10:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41bf050>
2026-03-30 10:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fac%252Fecac8ebfd140f74e19a4e5492e80aa37%252Fpa%252FFR16544_feea070ce92212bb52ff92eb3ce3e9d7.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_feea070ce92212bb52ff92eb3ce3e9d7.jpg saved to cache
2026-03-30 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f9748b5-0e7b-51ad-8095-50cffe1b0c44
2026-03-30 10:35:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f9748b5-0e7b-51ad-8095-50cffe1b0c44, skipping ID generation
2026-03-30 10:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f9748b5-0e7b-51ad-8095-50cffe1b0c44 with scrape type 1
2026-03-30 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f9748b5-0e7b-51ad-8095-50cffe1b0c44 sending to next pipeline
2026-03-30 10:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f9748b5-0e7b-51ad-8095-50cffe1b0c44, identifier: FR16544
2026-03-30 10:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef73990>
2026-03-30 10:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F04%252F56040e5389b7b0e366d93f80d5604a51%252Fpa%252FMR47328_bd949f52b7dfaf0a670bcfddb448a961.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_bd949f52b7dfaf0a670bcfddb448a961.jpg saved to cache
2026-03-30 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a576386e-6c5f-5433-ac49-17b5d6fdb67e
2026-03-30 10:35:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a576386e-6c5f-5433-ac49-17b5d6fdb67e, skipping ID generation
2026-03-30 10:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a576386e-6c5f-5433-ac49-17b5d6fdb67e with scrape type 1
2026-03-30 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a576386e-6c5f-5433-ac49-17b5d6fdb67e sending to next pipeline
2026-03-30 10:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a576386e-6c5f-5433-ac49-17b5d6fdb67e, identifier: MR47328
2026-03-30 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_d53449b2f137fdccf76a6852a4dc3d2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_d53449b2f137fdccf76a6852a4dc3d2b.jpg not downloaded yet
2026-03-30 10:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM86230> (referer: https://www.auto1.com/v1/car-details-view/FM86230/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a415b86-b650-5d64-9ec1-5b1eebdd71cb with identifier: KY27075
2026-03-30 10:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a415b86-b650-5d64-9ec1-5b1eebdd71cb with identifier: KY27075
2026-03-30 10:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a415b86-b650-5d64-9ec1-5b1eebdd71cb with identifier: KY27075 to the API
2026-03-30 10:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_95528c6df51e5d1149d36d572bf49c8d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:33:22Z',
 'fuel_type': 'diesel',
 'id': '2a415b86-b650-5d64-9ec1-5b1eebdd71cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY27075',
 'listing': 'auction',
 'location': 'DE, Worms',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 194002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_d8e76481dca8c7b651ffa772a9a939d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_d754c4fba6e785c24ad7fed04b442952.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_34b4b6d1db22e7f12f8e049559d2d1af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_441053ba9e3e01cfe8314d1fcae86669.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_95528c6df51e5d1149d36d572bf49c8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_7ebbc2d96d4a75bc506a6073fee4442f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_79002222e237ac9b849f1daff5a61526.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_71d84cde06692fcbb90ac6bd1a9ce82f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_199f541414d0de02c336bb51f1b44d3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a415b86-b650-5d64-9ec1-5b1eebdd71cb/2a415b86-b650-5d64-9ec1-5b1eebdd71cb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/44/fe44ff21583bd2ca326540e5fecc6c79/pa/KY27075_c0466931bd37762572538d021df0a3c4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY27075%27 HTTP/1.1" 200 None
2026-03-30 10:35:11 [auto1.de] INFO: Saving data for KY27075: {'created_time': 1774866911.671767, 'last_price_update_time': 1774866911.671778, 'auction_closing_time': 1774971202.0}
2026-03-30 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY27075') HTTP/1.1" 204 0
2026-03-30 10:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f9748b5-0e7b-51ad-8095-50cffe1b0c44 with identifier: FR16544
2026-03-30 10:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f9748b5-0e7b-51ad-8095-50cffe1b0c44 with identifier: FR16544
2026-03-30 10:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f9748b5-0e7b-51ad-8095-50cffe1b0c44 with identifier: FR16544 to the API
2026-03-30 10:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_feea070ce92212bb52ff92eb3ce3e9d7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:27:57Z',
 'fuel_type': 'petrol',
 'id': '5f9748b5-0e7b-51ad-8095-50cffe1b0c44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR16544',
 'listing': 'auction',
 'location': 'DE, Beckum',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 146489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_a489c3391c99513b486141f62b5d9dc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_8a3839532b5678cd3ffde36b9f3b5eae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_0758d46dff8aeae37857bd88cdd793db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_feea070ce92212bb52ff92eb3ce3e9d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_3b454bea06df7b7e6ec83575382cf8e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_9be5ee2e991dac3c1d478d9da9208372.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_0c4d5ac7e1d9104cf9c997c2cbc65502.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_e92ba3991ab74904172747c78d2c361b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_423d5d7b532843926855a7a712fc2089.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9748b5-0e7b-51ad-8095-50cffe1b0c44/5f9748b5-0e7b-51ad-8095-50cffe1b0c44_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ac/ecac8ebfd140f74e19a4e5492e80aa37/pa/FR16544_28f5456ea2d7cc7778b3e707a98fce06.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Lounge BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2015}
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR16544%27 HTTP/1.1" 200 None
2026-03-30 10:35:12 [auto1.de] INFO: Saving data for FR16544: {'created_time': 1774866912.087297, 'last_price_update_time': 1774866912.087309, 'auction_closing_time': 1774970877.0}
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR16544') HTTP/1.1" 204 0
2026-03-30 10:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a576386e-6c5f-5433-ac49-17b5d6fdb67e with identifier: MR47328
2026-03-30 10:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a576386e-6c5f-5433-ac49-17b5d6fdb67e with identifier: MR47328
2026-03-30 10:35:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a576386e-6c5f-5433-ac49-17b5d6fdb67e with identifier: MR47328 to the API
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_bd949f52b7dfaf0a670bcfddb448a961.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 209,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 239,
 'expiration_date': '2026-03-31T15:34:02Z',
 'fuel_type': 'diesel',
 'id': 'a576386e-6c5f-5433-ac49-17b5d6fdb67e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR47328',
 'listing': 'auction',
 'location': 'DE, Oldenburg',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 119997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_91c63afa6544c65cd623007020888a78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_5e9f81a3f0af09f573f7168cd2ea8d48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_bd949f52b7dfaf0a670bcfddb448a961.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2832638,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_3d119ea4bbf1e7e5cbf37adf71fd042f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_d5894a60233408174a15d10ae27c664c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_ba27e4ec9780849dcbb3ba0f27cd5365.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_545c94b5f9f989d89ac81fbd6666747b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_6ce511739268b2bedb1f4232346a27c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_44c3b88fb25625551e76a2978f867947.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a576386e-6c5f-5433-ac49-17b5d6fdb67e/a576386e-6c5f-5433-ac49-17b5d6fdb67e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/04/56040e5389b7b0e366d93f80d5604a51/pa/MR47328_42c7cac32ad52623365349a3d5236aee.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 BiTDI RS 4x4',
 'transmission': 'automatic',
 'trim': 'RS 4x4',
 'year': 2020}
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR47328%27 HTTP/1.1" 200 None
2026-03-30 10:35:12 [auto1.de] INFO: Saving data for MR47328: {'created_time': 1774866912.457702, 'last_price_update_time': 1774866912.457711, 'auction_closing_time': 1774971242.0}
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR47328') HTTP/1.1" 204 0
2026-03-30 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_b25662d8a98476b9566468d477922e06.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_6755d5decb1b175ab4aa7d8ae8fbc055.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR68176> (referer: https://www.auto1.com/v1/car-details-view/TR68176/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_b133c26535d6ca34002228339103d126.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_b133c26535d6ca34002228339103d126.jpg not downloaded yet
2026-03-30 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL77227> (referer: https://www.auto1.com/v1/car-details-view/CL77227/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NB58576/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WX76835> (referer: https://www.auto1.com/v1/car-details-view/WX76835/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef73c10>
2026-03-30 10:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddc22b32-58ae-50bb-87e0-17e4ddbcc469/ddc22b32-58ae-50bb-87e0-17e4ddbcc469_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ffd%252Fb9fd195b0f64825a7bbe690700b34631%252Fpa%252FMW69190_a99a9e161a179ac8119762a9cd374d67.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_a99a9e161a179ac8119762a9cd374d67.jpg saved to cache
2026-03-30 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ddc22b32-58ae-50bb-87e0-17e4ddbcc469
2026-03-30 10:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_0ca33d1ab5d2dedda5590814ea9e4901.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_0ca33d1ab5d2dedda5590814ea9e4901.jpg not downloaded yet
2026-03-30 10:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8860a78-627f-5706-afce-ea6df6eb0cc4 with identifier: FM86230
2026-03-30 10:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8860a78-627f-5706-afce-ea6df6eb0cc4 with scrape type 1
2026-03-30 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f8860a78-627f-5706-afce-ea6df6eb0cc4
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F78%252F0778ab93c442dd40a798a797c337f6ec%252Fpa%252FFM86230_c171c67c9485e7e8a46e6a3cd0278e26.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_c171c67c9485e7e8a46e6a3cd0278e26.jpg already downloaded
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F78%252F0778ab93c442dd40a798a797c337f6ec%252Fpa%252FFM86230_63bd76e0ead76da6475398345f4f87ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_63bd76e0ead76da6475398345f4f87ac.jpg already downloaded
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F78%252F0778ab93c442dd40a798a797c337f6ec%252Fpa%252FFM86230_6d73d76d35037d628711274050802f1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_6d73d76d35037d628711274050802f1b.jpg already downloaded
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F78%252F0778ab93c442dd40a798a797c337f6ec%252Fpa%252FFM86230_6f18a394daa63ce850df779b773ca0db.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_6f18a394daa63ce850df779b773ca0db.jpg already downloaded
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F78%252F0778ab93c442dd40a798a797c337f6ec%252Fpa%252FFM86230_690ca12b557a479278e7468926b74e23.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_690ca12b557a479278e7468926b74e23.jpg already downloaded
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F78%252F0778ab93c442dd40a798a797c337f6ec%252Fpa%252FFM86230_d1945cfa7db9cf323d253070b5ef94db.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_d1945cfa7db9cf323d253070b5ef94db.jpg already downloaded
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F78%252F0778ab93c442dd40a798a797c337f6ec%252Fpa%252FFM86230_333768e0e260cca2be3732d1fcacab01.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_333768e0e260cca2be3732d1fcacab01.jpg already downloaded
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F78%252F0778ab93c442dd40a798a797c337f6ec%252Fpa%252FFM86230_cf260fc2a14d126deb4f025ddf8bddfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_cf260fc2a14d126deb4f025ddf8bddfc.jpg already downloaded
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F78%252F0778ab93c442dd40a798a797c337f6ec%252Fpa%252FFM86230_709679a2a42fa6e6d6d8ec6213fc070f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_709679a2a42fa6e6d6d8ec6213fc070f.jpg already downloaded
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F78%252F0778ab93c442dd40a798a797c337f6ec%252Fpa%252FFM86230_f79fe6b80f2de52794466d1d62d49779.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_f79fe6b80f2de52794466d1d62d49779.jpg already downloaded
2026-03-30 10:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8860a78-627f-5706-afce-ea6df6eb0cc4, identifier: FM86230
2026-03-30 10:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8860a78-627f-5706-afce-ea6df6eb0cc4 with identifier: FM86230
2026-03-30 10:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8860a78-627f-5706-afce-ea6df6eb0cc4 with identifier: FM86230
2026-03-30 10:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8860a78-627f-5706-afce-ea6df6eb0cc4 with identifier: FM86230 to the API
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FM86230>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.7L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:09:52Z',
 'fuel_type': 'diesel',
 'id': 'f8860a78-627f-5706-afce-ea6df6eb0cc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM86230',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 190678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_c171c67c9485e7e8a46e6a3cd0278e26.jpg',
                'https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_63bd76e0ead76da6475398345f4f87ac.jpg',
                'https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_6d73d76d35037d628711274050802f1b.jpg',
                'https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_6f18a394daa63ce850df779b773ca0db.jpg',
                'https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_690ca12b557a479278e7468926b74e23.jpg',
                'https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_d1945cfa7db9cf323d253070b5ef94db.jpg',
                'https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_333768e0e260cca2be3732d1fcacab01.jpg',
                'https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_cf260fc2a14d126deb4f025ddf8bddfc.jpg',
                'https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_709679a2a42fa6e6d6d8ec6213fc070f.jpg',
                'https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_f79fe6b80f2de52794466d1d62d49779.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8860a78-627f-5706-afce-ea6df6eb0cc4/f8860a78-627f-5706-afce-ea6df6eb0cc4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_c171c67c9485e7e8a46e6a3cd0278e26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8860a78-627f-5706-afce-ea6df6eb0cc4/f8860a78-627f-5706-afce-ea6df6eb0cc4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_63bd76e0ead76da6475398345f4f87ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8860a78-627f-5706-afce-ea6df6eb0cc4/f8860a78-627f-5706-afce-ea6df6eb0cc4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_6d73d76d35037d628711274050802f1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8860a78-627f-5706-afce-ea6df6eb0cc4/f8860a78-627f-5706-afce-ea6df6eb0cc4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_6f18a394daa63ce850df779b773ca0db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8860a78-627f-5706-afce-ea6df6eb0cc4/f8860a78-627f-5706-afce-ea6df6eb0cc4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_690ca12b557a479278e7468926b74e23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8860a78-627f-5706-afce-ea6df6eb0cc4/f8860a78-627f-5706-afce-ea6df6eb0cc4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_d1945cfa7db9cf323d253070b5ef94db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8860a78-627f-5706-afce-ea6df6eb0cc4/f8860a78-627f-5706-afce-ea6df6eb0cc4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_333768e0e260cca2be3732d1fcacab01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8860a78-627f-5706-afce-ea6df6eb0cc4/f8860a78-627f-5706-afce-ea6df6eb0cc4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_cf260fc2a14d126deb4f025ddf8bddfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8860a78-627f-5706-afce-ea6df6eb0cc4/f8860a78-627f-5706-afce-ea6df6eb0cc4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_709679a2a42fa6e6d6d8ec6213fc070f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8860a78-627f-5706-afce-ea6df6eb0cc4/f8860a78-627f-5706-afce-ea6df6eb0cc4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/78/0778ab93c442dd40a798a797c337f6ec/pa/FM86230_f79fe6b80f2de52794466d1d62d49779.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Trend blue 2WD',
 'transmission': 'manual',
 'trim': 'Trend blue 2WD',
 'year': 2017}
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM86230%27 HTTP/1.1" 200 None
2026-03-30 10:35:13 [auto1.de] INFO: Saving data for FM86230: {'created_time': 1774866913.223107, 'last_price_update_time': 1774866913.223117, 'auction_closing_time': 1774969792.0}
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM86230') HTTP/1.1" 204 0
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_c06d0c59b52271ca1e4522f007d1f2be.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_c06d0c59b52271ca1e4522f007d1f2be.jpg not downloaded yet
2026-03-30 10:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e8050>
2026-03-30 10:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddc22b32-58ae-50bb-87e0-17e4ddbcc469/ddc22b32-58ae-50bb-87e0-17e4ddbcc469_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ffd%252Fb9fd195b0f64825a7bbe690700b34631%252Fpa%252FMW69190_b25662d8a98476b9566468d477922e06.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_b25662d8a98476b9566468d477922e06.jpg saved to cache
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ddc22b32-58ae-50bb-87e0-17e4ddbcc469
2026-03-30 10:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4214b90>
2026-03-30 10:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_6755d5decb1b175ab4aa7d8ae8fbc055.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_6755d5decb1b175ab4aa7d8ae8fbc055.jpg saved to cache
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8
2026-03-30 10:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fbc1a10-52d5-5265-bcec-1e0fccd09a65 with identifier: TR68176
2026-03-30 10:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fbc1a10-52d5-5265-bcec-1e0fccd09a65 with scrape type 1
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1fbc1a10-52d5-5265-bcec-1e0fccd09a65
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Ff7%252F17f74b67a9dd6f03a39cd224599099cb%252Fpa%252FTR68176_7705d2fff69ca3b3d8b94fc34f895014.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_7705d2fff69ca3b3d8b94fc34f895014.jpg already downloaded
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Ff7%252F17f74b67a9dd6f03a39cd224599099cb%252Fpa%252FTR68176_451911446e81aecca8526a5f860ae257.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_451911446e81aecca8526a5f860ae257.jpg already downloaded
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Ff7%252F17f74b67a9dd6f03a39cd224599099cb%252Fpa%252FTR68176_fc610dbe9e6da359fc2feecee2e18bb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_fc610dbe9e6da359fc2feecee2e18bb9.jpg already downloaded
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Ff7%252F17f74b67a9dd6f03a39cd224599099cb%252Fpa%252FTR68176_b9ca5906bd5c127ba7e3e5cb5641635a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_b9ca5906bd5c127ba7e3e5cb5641635a.jpg already downloaded
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Ff7%252F17f74b67a9dd6f03a39cd224599099cb%252Fpa%252FTR68176_bff11e89f11890ab3ac057abbb599dae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_bff11e89f11890ab3ac057abbb599dae.jpg already downloaded
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Ff7%252F17f74b67a9dd6f03a39cd224599099cb%252Fpa%252FTR68176_6f01c4cbd6ddef6c4ab3f4431ff02c8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_6f01c4cbd6ddef6c4ab3f4431ff02c8f.jpg already downloaded
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Ff7%252F17f74b67a9dd6f03a39cd224599099cb%252Fpa%252FTR68176_d1620347bb80d7f5104d00e53517750e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_d1620347bb80d7f5104d00e53517750e.jpg already downloaded
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Ff7%252F17f74b67a9dd6f03a39cd224599099cb%252Fpa%252FTR68176_f7d98f15affc219c7cc96fa51c76c366.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_f7d98f15affc219c7cc96fa51c76c366.jpg already downloaded
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Ff7%252F17f74b67a9dd6f03a39cd224599099cb%252Fpa%252FTR68176_7db168746959be7543432f33e3548534.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_7db168746959be7543432f33e3548534.jpg already downloaded
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Ff7%252F17f74b67a9dd6f03a39cd224599099cb%252Fpa%252FTR68176_94e89cd0f1e709841308cb224d6f1910.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_94e89cd0f1e709841308cb224d6f1910.jpg already downloaded
2026-03-30 10:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fbc1a10-52d5-5265-bcec-1e0fccd09a65, identifier: TR68176
2026-03-30 10:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2729ad5-4575-5944-801e-296d58cf625a with identifier: CL77227
2026-03-30 10:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2729ad5-4575-5944-801e-296d58cf625a with scrape type 1
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c2729ad5-4575-5944-801e-296d58cf625a
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fd4%252Fffd4b2e425cfe7638778f75ac692e8d7%252Fpa%252FCL77227_4ec514d238a6be3e16036614aaab8a0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_4ec514d238a6be3e16036614aaab8a0e.jpg not downloaded yet
2026-03-30 10:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb09548c-31ca-50d7-989d-b288b7a2cdde with identifier: WX76835
2026-03-30 10:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb09548c-31ca-50d7-989d-b288b7a2cdde with scrape type 1
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb09548c-31ca-50d7-989d-b288b7a2cdde
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_04caaeef49e3ada345aed7d15faac411.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_04caaeef49e3ada345aed7d15faac411.jpg not downloaded yet
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_c3169392db7dd94b20e721e96d234249.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_c3169392db7dd94b20e721e96d234249.jpg not downloaded yet
2026-03-30 10:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fbc1a10-52d5-5265-bcec-1e0fccd09a65 with identifier: TR68176
2026-03-30 10:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fbc1a10-52d5-5265-bcec-1e0fccd09a65 with identifier: TR68176
2026-03-30 10:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fbc1a10-52d5-5265-bcec-1e0fccd09a65 with identifier: TR68176 to the API
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TR68176>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:05:47Z',
 'fuel_type': 'petrol',
 'id': '1fbc1a10-52d5-5265-bcec-1e0fccd09a65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR68176',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 143834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_7705d2fff69ca3b3d8b94fc34f895014.jpg',
                'https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_451911446e81aecca8526a5f860ae257.jpg',
                'https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_fc610dbe9e6da359fc2feecee2e18bb9.jpg',
                'https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_b9ca5906bd5c127ba7e3e5cb5641635a.jpg',
                'https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_bff11e89f11890ab3ac057abbb599dae.jpg',
                'https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_6f01c4cbd6ddef6c4ab3f4431ff02c8f.jpg',
                'https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_d1620347bb80d7f5104d00e53517750e.jpg',
                'https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_f7d98f15affc219c7cc96fa51c76c366.jpg',
                'https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_7db168746959be7543432f33e3548534.jpg',
                'https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_94e89cd0f1e709841308cb224d6f1910.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbc1a10-52d5-5265-bcec-1e0fccd09a65/1fbc1a10-52d5-5265-bcec-1e0fccd09a65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_7705d2fff69ca3b3d8b94fc34f895014.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbc1a10-52d5-5265-bcec-1e0fccd09a65/1fbc1a10-52d5-5265-bcec-1e0fccd09a65_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_451911446e81aecca8526a5f860ae257.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbc1a10-52d5-5265-bcec-1e0fccd09a65/1fbc1a10-52d5-5265-bcec-1e0fccd09a65_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_fc610dbe9e6da359fc2feecee2e18bb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbc1a10-52d5-5265-bcec-1e0fccd09a65/1fbc1a10-52d5-5265-bcec-1e0fccd09a65_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_b9ca5906bd5c127ba7e3e5cb5641635a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbc1a10-52d5-5265-bcec-1e0fccd09a65/1fbc1a10-52d5-5265-bcec-1e0fccd09a65_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_bff11e89f11890ab3ac057abbb599dae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbc1a10-52d5-5265-bcec-1e0fccd09a65/1fbc1a10-52d5-5265-bcec-1e0fccd09a65_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_6f01c4cbd6ddef6c4ab3f4431ff02c8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbc1a10-52d5-5265-bcec-1e0fccd09a65/1fbc1a10-52d5-5265-bcec-1e0fccd09a65_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_d1620347bb80d7f5104d00e53517750e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbc1a10-52d5-5265-bcec-1e0fccd09a65/1fbc1a10-52d5-5265-bcec-1e0fccd09a65_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_f7d98f15affc219c7cc96fa51c76c366.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbc1a10-52d5-5265-bcec-1e0fccd09a65/1fbc1a10-52d5-5265-bcec-1e0fccd09a65_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_7db168746959be7543432f33e3548534.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbc1a10-52d5-5265-bcec-1e0fccd09a65/1fbc1a10-52d5-5265-bcec-1e0fccd09a65_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/f7/17f74b67a9dd6f03a39cd224599099cb/pa/TR68176_94e89cd0f1e709841308cb224d6f1910.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Elegance',
 'year': 2013}
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR68176%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [auto1.de] INFO: Saving data for TR68176: {'created_time': 1774866914.096448, 'last_price_update_time': 1774866914.096459, 'auction_closing_time': 1774969547.0}
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR68176') HTTP/1.1" 204 0
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fd4%252Fffd4b2e425cfe7638778f75ac692e8d7%252Fpa%252FCL77227_4976467ab2bc903045f2683411f47a84.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_4976467ab2bc903045f2683411f47a84.jpg not downloaded yet
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_d910d20cd5a8fecda81eca8a3736d57b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_d910d20cd5a8fecda81eca8a3736d57b.jpg not downloaded yet
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_c447e92c4c59e5d91065609db981e2da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_c447e92c4c59e5d91065609db981e2da.jpg not downloaded yet
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fd4%252Fffd4b2e425cfe7638778f75ac692e8d7%252Fpa%252FCL77227_c5e70376239a07ae1f1f19cf7a6dde60.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_c5e70376239a07ae1f1f19cf7a6dde60.jpg not downloaded yet
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_411db2ec327be0b1f86e462c5cdb81d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_411db2ec327be0b1f86e462c5cdb81d9.jpg not downloaded yet
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_c16744b5318454b52a68691deb754360.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_c16744b5318454b52a68691deb754360.jpg not downloaded yet
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fd4%252Fffd4b2e425cfe7638778f75ac692e8d7%252Fpa%252FCL77227_c0adfda8a6f469c942516ae4b19f0b84.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_c0adfda8a6f469c942516ae4b19f0b84.jpg not downloaded yet
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_2e177f15aae4f718e9838cc422c76506.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_2e177f15aae4f718e9838cc422c76506.jpg not downloaded yet
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_e065310a51c693b8d82f765fda1cf2c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_e065310a51c693b8d82f765fda1cf2c1.jpg not downloaded yet
2026-03-30 10:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SF86380> (referer: https://www.auto1.com/v1/car-details-view/SF86380/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fd4%252Fffd4b2e425cfe7638778f75ac692e8d7%252Fpa%252FCL77227_e6f904c7c0cad6dbb2dbc9d75f152da3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_e6f904c7c0cad6dbb2dbc9d75f152da3.jpg not downloaded yet
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_aacfcbb833209e167940438a36748be2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_aacfcbb833209e167940438a36748be2.jpg not downloaded yet
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fd4%252Fffd4b2e425cfe7638778f75ac692e8d7%252Fpa%252FCL77227_54f862f18f625c6a51366379767e6a3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_54f862f18f625c6a51366379767e6a3e.jpg not downloaded yet
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_faf17caa87d8085944e90bc7ab3ee664.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_faf17caa87d8085944e90bc7ab3ee664.jpg not downloaded yet
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_feee07f6efb0d7178a6b009bdd54d019.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_feee07f6efb0d7178a6b009bdd54d019.jpg not downloaded yet
2026-03-30 10:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ36451/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_8ba8fa9299e634f57feb4ba9c85b5a68.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_8ba8fa9299e634f57feb4ba9c85b5a68.jpg not downloaded yet
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_bf8702531509f57b3f68cc50ec5b5935.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_bf8702531509f57b3f68cc50ec5b5935.jpg not downloaded yet
2026-03-30 10:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8c1f413-c899-58d3-884e-c4a713dbd76c with identifier: SF86380
2026-03-30 10:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c1f413-c899-58d3-884e-c4a713dbd76c with scrape type 1
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f8c1f413-c899-58d3-884e-c4a713dbd76c
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fa3%252Fcfa3424558fb3b5aaeb7e24e4c7d44a1%252Fpa%252FSF86380_a8ae6e2849f770583847b56e29a9a7b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_a8ae6e2849f770583847b56e29a9a7b8.jpg already downloaded
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fa3%252Fcfa3424558fb3b5aaeb7e24e4c7d44a1%252Fpa%252FSF86380_f48c1ec81021b1439a85c7cf1c6e1cd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_f48c1ec81021b1439a85c7cf1c6e1cd5.jpg already downloaded
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fa3%252Fcfa3424558fb3b5aaeb7e24e4c7d44a1%252Fpa%252FSF86380_545e3d7d686e3345258ff35ce24fdfe9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_545e3d7d686e3345258ff35ce24fdfe9.jpg already downloaded
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fa3%252Fcfa3424558fb3b5aaeb7e24e4c7d44a1%252Fpa%252FSF86380_e8fd4a0d625053c26a3a3c1ba736956a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_e8fd4a0d625053c26a3a3c1ba736956a.jpg already downloaded
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fa3%252Fcfa3424558fb3b5aaeb7e24e4c7d44a1%252Fpa%252FSF86380_1a2acdd3b9b4d209d284e557671eea75.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_1a2acdd3b9b4d209d284e557671eea75.jpg already downloaded
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fa3%252Fcfa3424558fb3b5aaeb7e24e4c7d44a1%252Fpa%252FSF86380_5de1ec65e35f4624c22f5c1639945ed2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_5de1ec65e35f4624c22f5c1639945ed2.jpg already downloaded
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fa3%252Fcfa3424558fb3b5aaeb7e24e4c7d44a1%252Fpa%252FSF86380_70e33c7c6b950ac07005cbafa81bb71b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_70e33c7c6b950ac07005cbafa81bb71b.jpg already downloaded
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fa3%252Fcfa3424558fb3b5aaeb7e24e4c7d44a1%252Fpa%252FSF86380_acb5796fe31fd766457c87912d671a1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_acb5796fe31fd766457c87912d671a1d.jpg already downloaded
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fa3%252Fcfa3424558fb3b5aaeb7e24e4c7d44a1%252Fpa%252FSF86380_7a9c159ef7febaeaa4f01c355067375f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_7a9c159ef7febaeaa4f01c355067375f.jpg already downloaded
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fa3%252Fcfa3424558fb3b5aaeb7e24e4c7d44a1%252Fpa%252FSF86380_8e7a98f74c9fe4ca79d779c471dc5b40.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_8e7a98f74c9fe4ca79d779c471dc5b40.jpg already downloaded
2026-03-30 10:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8c1f413-c899-58d3-884e-c4a713dbd76c, identifier: SF86380
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_960f5ebe1d5ffc8f40abb70f38ee457f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_960f5ebe1d5ffc8f40abb70f38ee457f.jpg not downloaded yet
2026-03-30 10:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8c1f413-c899-58d3-884e-c4a713dbd76c with identifier: SF86380
2026-03-30 10:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8c1f413-c899-58d3-884e-c4a713dbd76c with identifier: SF86380
2026-03-30 10:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8c1f413-c899-58d3-884e-c4a713dbd76c with identifier: SF86380 to the API
2026-03-30 10:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SF86380>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:17:34Z',
 'fuel_type': 'petrol',
 'id': 'f8c1f413-c899-58d3-884e-c4a713dbd76c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF86380',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 169743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_a8ae6e2849f770583847b56e29a9a7b8.jpg',
                'https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_f48c1ec81021b1439a85c7cf1c6e1cd5.jpg',
                'https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_545e3d7d686e3345258ff35ce24fdfe9.jpg',
                'https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_e8fd4a0d625053c26a3a3c1ba736956a.jpg',
                'https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_1a2acdd3b9b4d209d284e557671eea75.jpg',
                'https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_5de1ec65e35f4624c22f5c1639945ed2.jpg',
                'https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_70e33c7c6b950ac07005cbafa81bb71b.jpg',
                'https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_acb5796fe31fd766457c87912d671a1d.jpg',
                'https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_7a9c159ef7febaeaa4f01c355067375f.jpg',
                'https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_8e7a98f74c9fe4ca79d779c471dc5b40.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c1f413-c899-58d3-884e-c4a713dbd76c/f8c1f413-c899-58d3-884e-c4a713dbd76c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_a8ae6e2849f770583847b56e29a9a7b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c1f413-c899-58d3-884e-c4a713dbd76c/f8c1f413-c899-58d3-884e-c4a713dbd76c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_f48c1ec81021b1439a85c7cf1c6e1cd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c1f413-c899-58d3-884e-c4a713dbd76c/f8c1f413-c899-58d3-884e-c4a713dbd76c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_545e3d7d686e3345258ff35ce24fdfe9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c1f413-c899-58d3-884e-c4a713dbd76c/f8c1f413-c899-58d3-884e-c4a713dbd76c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_e8fd4a0d625053c26a3a3c1ba736956a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c1f413-c899-58d3-884e-c4a713dbd76c/f8c1f413-c899-58d3-884e-c4a713dbd76c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_1a2acdd3b9b4d209d284e557671eea75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c1f413-c899-58d3-884e-c4a713dbd76c/f8c1f413-c899-58d3-884e-c4a713dbd76c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_5de1ec65e35f4624c22f5c1639945ed2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c1f413-c899-58d3-884e-c4a713dbd76c/f8c1f413-c899-58d3-884e-c4a713dbd76c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2845193,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_70e33c7c6b950ac07005cbafa81bb71b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c1f413-c899-58d3-884e-c4a713dbd76c/f8c1f413-c899-58d3-884e-c4a713dbd76c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_acb5796fe31fd766457c87912d671a1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c1f413-c899-58d3-884e-c4a713dbd76c/f8c1f413-c899-58d3-884e-c4a713dbd76c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_7a9c159ef7febaeaa4f01c355067375f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c1f413-c899-58d3-884e-c4a713dbd76c/f8c1f413-c899-58d3-884e-c4a713dbd76c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/a3/cfa3424558fb3b5aaeb7e24e4c7d44a1/pa/SF86380_8e7a98f74c9fe4ca79d779c471dc5b40.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF86380%27 HTTP/1.1" 200 None
2026-03-30 10:35:15 [auto1.de] INFO: Saving data for SF86380: {'created_time': 1774866915.182018, 'last_price_update_time': 1774866915.182029, 'auction_closing_time': 1774970254.0}
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF86380') HTTP/1.1" 204 0
2026-03-30 10:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD25726/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_b328e9cffc498fca5c9f54bf09bc4b0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_6448d10e9d8ae94f875fcbadf0061feb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_9687b7f335feedf9da25e6941d67a881.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_d53449b2f137fdccf76a6852a4dc3d2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_2c8abc8dfbaf88af60dabdc330e70e16.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_212872d1fca04c887c71901c53bc542a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_489d84a25ace569c81314ca5c2315699.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_0acff0cec4ac5ce6bc51e3770fc0de34.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_5c9f214fda2489a8a87fe6c814207f16.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_ed1b96f9fd581ec9ce036c3759f66dd4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:15 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 9412 | hits on page: 40
2026-03-30 10:35:15 [auto1.de] INFO: Found listing with ID: DZ96943
2026-03-30 10:35:15 [auto1.de] INFO: Found listing with ID: HK07148
2026-03-30 10:35:15 [auto1.de] INFO: Found listing with ID: WJ62591
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ62591%27 HTTP/1.1" 200 None
2026-03-30 10:35:15 [auto1.de] INFO: Scrape type for WJ62591: 0
2026-03-30 10:35:15 [auto1.de] INFO: Found listing with ID: CF24380
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF24380%27 HTTP/1.1" 200 None
2026-03-30 10:35:15 [auto1.de] INFO: Scrape type for CF24380: 1
2026-03-30 10:35:15 [auto1.de] INFO: Found listing with ID: AN69770
2026-03-30 10:35:15 [auto1.de] INFO: Found listing with ID: WA34292
2026-03-30 10:35:15 [auto1.de] INFO: Found listing with ID: PH80163
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH80163%27 HTTP/1.1" 200 None
2026-03-30 10:35:15 [auto1.de] INFO: Scrape type for PH80163: 1
2026-03-30 10:35:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeebff50>
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_b328e9cffc498fca5c9f54bf09bc4b0b.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_b328e9cffc498fca5c9f54bf09bc4b0b.jpg saved to cache
2026-03-30 10:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fbd9ca6d-2eab-53cd-b404-cd1030af16c2
2026-03-30 10:35:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb0a10>
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_6448d10e9d8ae94f875fcbadf0061feb.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_6448d10e9d8ae94f875fcbadf0061feb.jpg saved to cache
2026-03-30 10:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fbd9ca6d-2eab-53cd-b404-cd1030af16c2
2026-03-30 10:35:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef5ac50>
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_9687b7f335feedf9da25e6941d67a881.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_9687b7f335feedf9da25e6941d67a881.jpg saved to cache
2026-03-30 10:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf
2026-03-30 10:35:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428dc10>
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_d53449b2f137fdccf76a6852a4dc3d2b.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_d53449b2f137fdccf76a6852a4dc3d2b.jpg saved to cache
2026-03-30 10:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf
2026-03-30 10:35:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee0d610>
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_2c8abc8dfbaf88af60dabdc330e70e16.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_2c8abc8dfbaf88af60dabdc330e70e16.jpg saved to cache
2026-03-30 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d63708c1-fd06-5daa-8d4b-d9f87ef758ef
2026-03-30 10:35:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4232b10>
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_212872d1fca04c887c71901c53bc542a.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_212872d1fca04c887c71901c53bc542a.jpg saved to cache
2026-03-30 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fbd9ca6d-2eab-53cd-b404-cd1030af16c2
2026-03-30 10:35:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef4fdd0>
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_489d84a25ace569c81314ca5c2315699.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_489d84a25ace569c81314ca5c2315699.jpg saved to cache
2026-03-30 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf
2026-03-30 10:35:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428f510>
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_0acff0cec4ac5ce6bc51e3770fc0de34.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_0acff0cec4ac5ce6bc51e3770fc0de34.jpg saved to cache
2026-03-30 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d63708c1-fd06-5daa-8d4b-d9f87ef758ef
2026-03-30 10:35:16 [auto1.de] INFO: Found listing with ID: YP01427
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP01427%27 HTTP/1.1" 200 None
2026-03-30 10:35:16 [auto1.de] INFO: Scrape type for YP01427: 1
2026-03-30 10:35:16 [auto1.de] INFO: Found listing with ID: EC09035
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC09035%27 HTTP/1.1" 200 None
2026-03-30 10:35:16 [auto1.de] INFO: Scrape type for EC09035: 1
2026-03-30 10:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee479e50>
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddc22b32-58ae-50bb-87e0-17e4ddbcc469/ddc22b32-58ae-50bb-87e0-17e4ddbcc469_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ffd%252Fb9fd195b0f64825a7bbe690700b34631%252Fpa%252FMW69190_5c9f214fda2489a8a87fe6c814207f16.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_5c9f214fda2489a8a87fe6c814207f16.jpg saved to cache
2026-03-30 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ddc22b32-58ae-50bb-87e0-17e4ddbcc469
2026-03-30 10:35:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ddc22b32-58ae-50bb-87e0-17e4ddbcc469, skipping ID generation
2026-03-30 10:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddc22b32-58ae-50bb-87e0-17e4ddbcc469 with scrape type 1
2026-03-30 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ddc22b32-58ae-50bb-87e0-17e4ddbcc469 sending to next pipeline
2026-03-30 10:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ddc22b32-58ae-50bb-87e0-17e4ddbcc469, identifier: MW69190
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428cd10>
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_ed1b96f9fd581ec9ce036c3759f66dd4.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_ed1b96f9fd581ec9ce036c3759f66dd4.jpg saved to cache
2026-03-30 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8
2026-03-30 10:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ddc22b32-58ae-50bb-87e0-17e4ddbcc469 with identifier: MW69190
2026-03-30 10:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ddc22b32-58ae-50bb-87e0-17e4ddbcc469 with identifier: MW69190
2026-03-30 10:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ddc22b32-58ae-50bb-87e0-17e4ddbcc469 with identifier: MW69190 to the API
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_5c9f214fda2489a8a87fe6c814207f16.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:17:01Z',
 'fuel_type': 'petrol',
 'id': 'ddc22b32-58ae-50bb-87e0-17e4ddbcc469',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW69190',
 'listing': 'auction',
 'location': 'DE, Bruchsal',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 117894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc22b32-58ae-50bb-87e0-17e4ddbcc469/ddc22b32-58ae-50bb-87e0-17e4ddbcc469_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_5c9f214fda2489a8a87fe6c814207f16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc22b32-58ae-50bb-87e0-17e4ddbcc469/ddc22b32-58ae-50bb-87e0-17e4ddbcc469_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_b25662d8a98476b9566468d477922e06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc22b32-58ae-50bb-87e0-17e4ddbcc469/ddc22b32-58ae-50bb-87e0-17e4ddbcc469_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_a99a9e161a179ac8119762a9cd374d67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc22b32-58ae-50bb-87e0-17e4ddbcc469/ddc22b32-58ae-50bb-87e0-17e4ddbcc469_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_11832d9734b1fe8398fb5f1b2020bfd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc22b32-58ae-50bb-87e0-17e4ddbcc469/ddc22b32-58ae-50bb-87e0-17e4ddbcc469_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_6cf96ef3c0bbf65bd82b427fe3fb6ca5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddc22b32-58ae-50bb-87e0-17e4ddbcc469/ddc22b32-58ae-50bb-87e0-17e4ddbcc469_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/fd/b9fd195b0f64825a7bbe690700b34631/pa/MW69190_eefe065c804bb20043e0ec04d5a1957e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-11-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2010}
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW69190%27 HTTP/1.1" 200 None
2026-03-30 10:35:17 [auto1.de] INFO: Saving data for MW69190: {'created_time': 1774866917.046358, 'last_price_update_time': 1774866917.046368, 'auction_closing_time': 1774970221.0}
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW69190') HTTP/1.1" 204 0
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: WR86170
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: TM34763
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM34763%27 HTTP/1.1" 200 None
2026-03-30 10:35:17 [auto1.de] INFO: Scrape type for TM34763: 1
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: FZ80671
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ80671%27 HTTP/1.1" 200 None
2026-03-30 10:35:17 [auto1.de] INFO: Scrape type for FZ80671: 1
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: PZ26473
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ26473%27 HTTP/1.1" 200 None
2026-03-30 10:35:17 [auto1.de] INFO: Scrape type for PZ26473: 1
2026-03-30 10:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_54f862f18f625c6a51366379767e6a3e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: MH98212
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: VN28198
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN28198%27 HTTP/1.1" 200 None
2026-03-30 10:35:17 [auto1.de] INFO: Scrape type for VN28198: 1
2026-03-30 10:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: JC14226
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC14226%27 HTTP/1.1" 200 None
2026-03-30 10:35:17 [auto1.de] INFO: Scrape type for JC14226: 1
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: KS67117
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: RL84583
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: GW35897
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: XM57589
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM57589%27 HTTP/1.1" 200 None
2026-03-30 10:35:17 [auto1.de] INFO: Scrape type for XM57589: 1
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: DY18162
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY18162%27 HTTP/1.1" 200 None
2026-03-30 10:35:17 [auto1.de] INFO: Scrape type for DY18162: 1
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: XV98071
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: KE92414
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: DW30618
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: GC48113
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC48113%27 HTTP/1.1" 200 None
2026-03-30 10:35:17 [auto1.de] INFO: Scrape type for GC48113: 1
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: XJ52167
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: GE74181
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE74181%27 HTTP/1.1" 200 None
2026-03-30 10:35:17 [auto1.de] INFO: Scrape type for GE74181: 1
2026-03-30 10:35:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4214d90>
2026-03-30 10:35:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2729ad5-4575-5944-801e-296d58cf625a/c2729ad5-4575-5944-801e-296d58cf625a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fd4%252Fffd4b2e425cfe7638778f75ac692e8d7%252Fpa%252FCL77227_54f862f18f625c6a51366379767e6a3e.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_54f862f18f625c6a51366379767e6a3e.jpg saved to cache
2026-03-30 10:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2729ad5-4575-5944-801e-296d58cf625a
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: XT86965
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: FK50326
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK50326%27 HTTP/1.1" 200 None
2026-03-30 10:35:17 [auto1.de] INFO: Scrape type for FK50326: 1
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: WY58747
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: TT41826
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT41826%27 HTTP/1.1" 200 None
2026-03-30 10:35:17 [auto1.de] INFO: Scrape type for TT41826: 1
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: YY59176
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: HC21911
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: DU23790
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: NX05190
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX05190%27 HTTP/1.1" 200 None
2026-03-30 10:35:17 [auto1.de] INFO: Scrape type for NX05190: 1
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: YV11797
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV11797%27 HTTP/1.1" 200 None
2026-03-30 10:35:17 [auto1.de] INFO: Scrape type for YV11797: 2
2026-03-30 10:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc3762f4-b0b6-51d0-b165-c2c51fb7e12d with identifier: YV11797
2026-03-30 10:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc3762f4-b0b6-51d0-b165-c2c51fb7e12d with scrape type 2
2026-03-30 10:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc3762f4-b0b6-51d0-b165-c2c51fb7e12d with scrape type 2
2026-03-30 10:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc3762f4-b0b6-51d0-b165-c2c51fb7e12d, identifier: YV11797
2026-03-30 10:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc3762f4-b0b6-51d0-b165-c2c51fb7e12d with identifier: YV11797
2026-03-30 10:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc3762f4-b0b6-51d0-b165-c2c51fb7e12d with identifier: YV11797
2026-03-30 10:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc3762f4-b0b6-51d0-b165-c2c51fb7e12d with identifier: YV11797 to the API
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:18:41Z',
 'fuel_type': 'diesel',
 'id': 'fc3762f4-b0b6-51d0-b165-c2c51fb7e12d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV11797',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 183112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-18',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 CRDi Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2013}
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV11797%27 HTTP/1.1" 200 None
2026-03-30 10:35:17 [auto1.de] INFO: Saving data for YV11797: {'auction_closing_time': 1774970321.0, 'created_time': 1774292324.862502, 'last_price_update_time': 1774866917.863275}
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV11797') HTTP/1.1" 204 0
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: CN97004
2026-03-30 10:35:17 [auto1.de] INFO: Found listing with ID: WS55091
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS55091%27 HTTP/1.1" 200 None
2026-03-30 10:35:17 [auto1.de] INFO: Scrape type for WS55091: 1
2026-03-30 10:35:18 [auto1.de] INFO: Found listing with ID: AL20723
2026-03-30 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL20723%27 HTTP/1.1" 200 None
2026-03-30 10:35:18 [auto1.de] INFO: Scrape type for AL20723: 1
2026-03-30 10:35:18 [auto1.de] INFO: Found listing with ID: SE11859
2026-03-30 10:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_bf8702531509f57b3f68cc50ec5b5935.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_feee07f6efb0d7178a6b009bdd54d019.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_e065310a51c693b8d82f765fda1cf2c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_f33c67e6280dfd7826f63b2fd7a20cfe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_960f5ebe1d5ffc8f40abb70f38ee457f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_faf17caa87d8085944e90bc7ab3ee664.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_8ba8fa9299e634f57feb4ba9c85b5a68.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_aacfcbb833209e167940438a36748be2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee159d0>
2026-03-30 10:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_bf8702531509f57b3f68cc50ec5b5935.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_bf8702531509f57b3f68cc50ec5b5935.jpg saved to cache
2026-03-30 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb09548c-31ca-50d7-989d-b288b7a2cdde
2026-03-30 10:35:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f438ae50>
2026-03-30 10:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_feee07f6efb0d7178a6b009bdd54d019.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_feee07f6efb0d7178a6b009bdd54d019.jpg saved to cache
2026-03-30 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb09548c-31ca-50d7-989d-b288b7a2cdde
2026-03-30 10:35:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42b76d0>
2026-03-30 10:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_e065310a51c693b8d82f765fda1cf2c1.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_e065310a51c693b8d82f765fda1cf2c1.jpg saved to cache
2026-03-30 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf
2026-03-30 10:35:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee54650>
2026-03-30 10:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_f33c67e6280dfd7826f63b2fd7a20cfe.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_f33c67e6280dfd7826f63b2fd7a20cfe.jpg saved to cache
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fbd9ca6d-2eab-53cd-b404-cd1030af16c2
2026-03-30 10:35:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4215650>
2026-03-30 10:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_960f5ebe1d5ffc8f40abb70f38ee457f.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_960f5ebe1d5ffc8f40abb70f38ee457f.jpg saved to cache
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb09548c-31ca-50d7-989d-b288b7a2cdde
2026-03-30 10:35:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434fc90>
2026-03-30 10:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_faf17caa87d8085944e90bc7ab3ee664.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_faf17caa87d8085944e90bc7ab3ee664.jpg saved to cache
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb09548c-31ca-50d7-989d-b288b7a2cdde
2026-03-30 10:35:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c0b310>
2026-03-30 10:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_8ba8fa9299e634f57feb4ba9c85b5a68.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_8ba8fa9299e634f57feb4ba9c85b5a68.jpg saved to cache
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb09548c-31ca-50d7-989d-b288b7a2cdde
2026-03-30 10:35:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9cfd0>
2026-03-30 10:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_aacfcbb833209e167940438a36748be2.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_aacfcbb833209e167940438a36748be2.jpg saved to cache
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb09548c-31ca-50d7-989d-b288b7a2cdde
2026-03-30 10:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ36451> (referer: https://www.auto1.com/v1/car-details-view/JZ36451/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44b68d5d-6d74-5f28-a732-78f2e78caed1 with identifier: JZ36451
2026-03-30 10:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44b68d5d-6d74-5f28-a732-78f2e78caed1 with scrape type 1
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44b68d5d-6d74-5f28-a732-78f2e78caed1
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_eb06c8a0045a8de39ad57e4c156ec253.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_eb06c8a0045a8de39ad57e4c156ec253.jpg not downloaded yet
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_985285b4cecb23bf585f13f8b839aa41.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_985285b4cecb23bf585f13f8b839aa41.jpg not downloaded yet
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_02547bcd268e6c84212977736ef4cb42.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_02547bcd268e6c84212977736ef4cb42.jpg not downloaded yet
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_6c7b22947d94ee7c1f334b7cf0758cc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_6c7b22947d94ee7c1f334b7cf0758cc4.jpg not downloaded yet
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_96a19fb184554505a35aca1471a09fc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_96a19fb184554505a35aca1471a09fc7.jpg not downloaded yet
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_02d844f2a9ff20db71c3f58923495396.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_02d844f2a9ff20db71c3f58923495396.jpg not downloaded yet
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_b27d842af492dd6203d8e780757c87d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_b27d842af492dd6203d8e780757c87d1.jpg not downloaded yet
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_2e36ecee1900a8baf8574ecf2336fe62.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_2e36ecee1900a8baf8574ecf2336fe62.jpg not downloaded yet
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_20cab2fa0ab888a5b740439935669728.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_20cab2fa0ab888a5b740439935669728.jpg not downloaded yet
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_af699a64514ea6c968e1e6b88dcd7691.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_af699a64514ea6c968e1e6b88dcd7691.jpg not downloaded yet
2026-03-30 10:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF24380/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_af699a64514ea6c968e1e6b88dcd7691.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4293e50>
2026-03-30 10:35:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_af699a64514ea6c968e1e6b88dcd7691.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_af699a64514ea6c968e1e6b88dcd7691.jpg saved to cache
2026-03-30 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 44b68d5d-6d74-5f28-a732-78f2e78caed1
2026-03-30 10:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:20 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 9411 | hits on page: 40
2026-03-30 10:35:20 [auto1.de] INFO: Found listing with ID: MD03906
2026-03-30 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD03906%27 HTTP/1.1" 200 None
2026-03-30 10:35:20 [auto1.de] INFO: Scrape type for MD03906: 1
2026-03-30 10:35:20 [auto1.de] INFO: Found listing with ID: UB09336
2026-03-30 10:35:20 [auto1.de] INFO: Found listing with ID: KX13373
2026-03-30 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX13373%27 HTTP/1.1" 200 None
2026-03-30 10:35:20 [auto1.de] INFO: Scrape type for KX13373: 2
2026-03-30 10:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36a29fe2-6608-56a6-9c9f-07e8771317e4 with identifier: KX13373
2026-03-30 10:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36a29fe2-6608-56a6-9c9f-07e8771317e4 with scrape type 2
2026-03-30 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36a29fe2-6608-56a6-9c9f-07e8771317e4 with scrape type 2
2026-03-30 10:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36a29fe2-6608-56a6-9c9f-07e8771317e4, identifier: KX13373
2026-03-30 10:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36a29fe2-6608-56a6-9c9f-07e8771317e4 with identifier: KX13373
2026-03-30 10:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36a29fe2-6608-56a6-9c9f-07e8771317e4 with identifier: KX13373
2026-03-30 10:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36a29fe2-6608-56a6-9c9f-07e8771317e4 with identifier: KX13373 to the API
2026-03-30 10:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:23:28Z',
 'fuel_type': 'petrol',
 'id': '36a29fe2-6608-56a6-9c9f-07e8771317e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX13373',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 198713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-27',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX13373%27 HTTP/1.1" 200 None
2026-03-30 10:35:21 [auto1.de] INFO: Saving data for KX13373: {'auction_closing_time': 1774970608.0, 'created_time': 1773725449.933218, 'last_price_update_time': 1774866921.113513}
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX13373') HTTP/1.1" 204 0
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: WT92496
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: GD33265
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: MC21805
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: ZT80632
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: ED86664
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED86664%27 HTTP/1.1" 200 None
2026-03-30 10:35:21 [auto1.de] INFO: Scrape type for ED86664: 1
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: ME32399
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: CX78933
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: XP42912
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP42912%27 HTTP/1.1" 200 None
2026-03-30 10:35:21 [auto1.de] INFO: Scrape type for XP42912: 1
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: LD24624
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD24624%27 HTTP/1.1" 200 None
2026-03-30 10:35:21 [auto1.de] INFO: Scrape type for LD24624: 1
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: BJ16323
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: GC02244
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC02244%27 HTTP/1.1" 200 None
2026-03-30 10:35:21 [auto1.de] INFO: Scrape type for GC02244: 1
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: ZE36706
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: HJ77178
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: FS99477
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: JX90545
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: CM52893
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: ZF52635
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: CE73784
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: GB07030
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB07030%27 HTTP/1.1" 200 None
2026-03-30 10:35:21 [auto1.de] INFO: Scrape type for GB07030: 1
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: HX91404
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX91404%27 HTTP/1.1" 200 None
2026-03-30 10:35:21 [auto1.de] INFO: Scrape type for HX91404: 1
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: CY18097
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: NJ28052
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ28052%27 HTTP/1.1" 200 None
2026-03-30 10:35:21 [auto1.de] INFO: Scrape type for NJ28052: 1
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: CP02770
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP02770%27 HTTP/1.1" 200 None
2026-03-30 10:35:21 [auto1.de] INFO: Scrape type for CP02770: 1
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: US18230
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: YG35577
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG35577%27 HTTP/1.1" 200 None
2026-03-30 10:35:21 [auto1.de] INFO: Scrape type for YG35577: 1
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: HN97244
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN97244%27 HTTP/1.1" 200 None
2026-03-30 10:35:21 [auto1.de] INFO: Scrape type for HN97244: 1
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: LC24532
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC24532%27 HTTP/1.1" 200 None
2026-03-30 10:35:21 [auto1.de] INFO: Scrape type for LC24532: 1
2026-03-30 10:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_20cab2fa0ab888a5b740439935669728.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: VC21585
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: UY84465
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY84465%27 HTTP/1.1" 200 None
2026-03-30 10:35:21 [auto1.de] INFO: Scrape type for UY84465: 1
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: BM81671
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: RS58437
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: RD39449
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD39449%27 HTTP/1.1" 200 None
2026-03-30 10:35:21 [auto1.de] INFO: Scrape type for RD39449: 1
2026-03-30 10:35:21 [auto1.de] INFO: Found listing with ID: KF94036
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF94036%27 HTTP/1.1" 200 None
2026-03-30 10:35:21 [auto1.de] INFO: Scrape type for KF94036: 2
2026-03-30 10:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac676d46-781e-50aa-9072-dcc46d2d4e17 with identifier: KF94036
2026-03-30 10:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac676d46-781e-50aa-9072-dcc46d2d4e17 with scrape type 2
2026-03-30 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac676d46-781e-50aa-9072-dcc46d2d4e17 with scrape type 2
2026-03-30 10:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac676d46-781e-50aa-9072-dcc46d2d4e17, identifier: KF94036
2026-03-30 10:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac676d46-781e-50aa-9072-dcc46d2d4e17 with identifier: KF94036
2026-03-30 10:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac676d46-781e-50aa-9072-dcc46d2d4e17 with identifier: KF94036
2026-03-30 10:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac676d46-781e-50aa-9072-dcc46d2d4e17 with identifier: KF94036 to the API
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-31T15:38:54Z',
 'fuel_type': 'hybrid',
 'id': 'ac676d46-781e-50aa-9072-dcc46d2d4e17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF94036',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 94705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-06',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF94036%27 HTTP/1.1" 200 None
2026-03-30 10:35:21 [auto1.de] INFO: Saving data for KF94036: {'auction_closing_time': 1774971534.0, 'created_time': 1773229670.493825, 'last_price_update_time': 1774866921.903779}
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF94036') HTTP/1.1" 204 0
2026-03-30 10:35:22 [auto1.de] INFO: Found listing with ID: FF99965
2026-03-30 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF99965%27 HTTP/1.1" 200 None
2026-03-30 10:35:22 [auto1.de] INFO: Scrape type for FF99965: 1
2026-03-30 10:35:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef34850>
2026-03-30 10:35:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_20cab2fa0ab888a5b740439935669728.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_20cab2fa0ab888a5b740439935669728.jpg saved to cache
2026-03-30 10:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 44b68d5d-6d74-5f28-a732-78f2e78caed1
2026-03-30 10:35:22 [auto1.de] INFO: Found listing with ID: JZ50172
2026-03-30 10:35:22 [auto1.de] INFO: Found listing with ID: HW82301
2026-03-30 10:35:22 [auto1.de] INFO: Found listing with ID: AU89070
2026-03-30 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP01427/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TT41826/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PZ26473/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WS55091/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK50326/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NX05190/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY18162/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE74181/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC48113/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH80163/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD25726> (referer: https://www.auto1.com/v1/car-details-view/UD25726/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a4eb8f-db47-57c0-8be9-3d85051a0909 with identifier: UD25726
2026-03-30 10:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a4eb8f-db47-57c0-8be9-3d85051a0909 with scrape type 1
2026-03-30 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2a4eb8f-db47-57c0-8be9-3d85051a0909
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F5a%252F305aa012f0989609bb0561ad8e95950f%252Fpa%252FUD25726_eb0b6a1c20abd4688574dfef09c4fa20.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_eb0b6a1c20abd4688574dfef09c4fa20.jpg already downloaded
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F5a%252F305aa012f0989609bb0561ad8e95950f%252Fpa%252FUD25726_6158f25b534d85e73cbc01eb9e0b5a09.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_6158f25b534d85e73cbc01eb9e0b5a09.jpg already downloaded
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F5a%252F305aa012f0989609bb0561ad8e95950f%252Fpa%252FUD25726_f929fde8643d74d9c9a7ee5903526c7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_f929fde8643d74d9c9a7ee5903526c7f.jpg already downloaded
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F5a%252F305aa012f0989609bb0561ad8e95950f%252Fpa%252FUD25726_adba10699b43613c3f774b7e3fb4c599.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_adba10699b43613c3f774b7e3fb4c599.jpg already downloaded
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F5a%252F305aa012f0989609bb0561ad8e95950f%252Fpa%252FUD25726_ccbc2611b4a269199f2d20b52c91982d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_ccbc2611b4a269199f2d20b52c91982d.jpg already downloaded
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F5a%252F305aa012f0989609bb0561ad8e95950f%252Fpa%252FUD25726_f907d342c510ba199d6d3fa7c425fa08.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_f907d342c510ba199d6d3fa7c425fa08.jpg already downloaded
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F5a%252F305aa012f0989609bb0561ad8e95950f%252Fpa%252FUD25726_7556d2ff168b781d83c2d2529736fae4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_7556d2ff168b781d83c2d2529736fae4.jpg already downloaded
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F5a%252F305aa012f0989609bb0561ad8e95950f%252Fpa%252FUD25726_20be5920f70d395a9d8603b863ae79f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_20be5920f70d395a9d8603b863ae79f6.jpg already downloaded
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F5a%252F305aa012f0989609bb0561ad8e95950f%252Fpa%252FUD25726_77f7985fa35d5c50bcc902286dcc3af2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_77f7985fa35d5c50bcc902286dcc3af2.jpg already downloaded
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F5a%252F305aa012f0989609bb0561ad8e95950f%252Fpa%252FUD25726_0222800fa019fc0b4b9fcbe4a608823f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_0222800fa019fc0b4b9fcbe4a608823f.jpg already downloaded
2026-03-30 10:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2a4eb8f-db47-57c0-8be9-3d85051a0909, identifier: UD25726
2026-03-30 10:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2a4eb8f-db47-57c0-8be9-3d85051a0909 with identifier: UD25726
2026-03-30 10:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2a4eb8f-db47-57c0-8be9-3d85051a0909 with identifier: UD25726
2026-03-30 10:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2a4eb8f-db47-57c0-8be9-3d85051a0909 with identifier: UD25726 to the API
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UD25726>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-31T15:40:29Z',
 'fuel_type': 'petrol',
 'id': 'd2a4eb8f-db47-57c0-8be9-3d85051a0909',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD25726',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 55147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_eb0b6a1c20abd4688574dfef09c4fa20.jpg',
                'https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_6158f25b534d85e73cbc01eb9e0b5a09.jpg',
                'https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_f929fde8643d74d9c9a7ee5903526c7f.jpg',
                'https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_adba10699b43613c3f774b7e3fb4c599.jpg',
                'https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_ccbc2611b4a269199f2d20b52c91982d.jpg',
                'https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_f907d342c510ba199d6d3fa7c425fa08.jpg',
                'https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_7556d2ff168b781d83c2d2529736fae4.jpg',
                'https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_20be5920f70d395a9d8603b863ae79f6.jpg',
                'https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_77f7985fa35d5c50bcc902286dcc3af2.jpg',
                'https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_0222800fa019fc0b4b9fcbe4a608823f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a4eb8f-db47-57c0-8be9-3d85051a0909/d2a4eb8f-db47-57c0-8be9-3d85051a0909_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_eb0b6a1c20abd4688574dfef09c4fa20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a4eb8f-db47-57c0-8be9-3d85051a0909/d2a4eb8f-db47-57c0-8be9-3d85051a0909_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2688497,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_6158f25b534d85e73cbc01eb9e0b5a09.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a4eb8f-db47-57c0-8be9-3d85051a0909/d2a4eb8f-db47-57c0-8be9-3d85051a0909_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2607459,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_f929fde8643d74d9c9a7ee5903526c7f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a4eb8f-db47-57c0-8be9-3d85051a0909/d2a4eb8f-db47-57c0-8be9-3d85051a0909_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2126055,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_adba10699b43613c3f774b7e3fb4c599.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a4eb8f-db47-57c0-8be9-3d85051a0909/d2a4eb8f-db47-57c0-8be9-3d85051a0909_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_ccbc2611b4a269199f2d20b52c91982d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a4eb8f-db47-57c0-8be9-3d85051a0909/d2a4eb8f-db47-57c0-8be9-3d85051a0909_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2617833,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_f907d342c510ba199d6d3fa7c425fa08.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a4eb8f-db47-57c0-8be9-3d85051a0909/d2a4eb8f-db47-57c0-8be9-3d85051a0909_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_7556d2ff168b781d83c2d2529736fae4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a4eb8f-db47-57c0-8be9-3d85051a0909/d2a4eb8f-db47-57c0-8be9-3d85051a0909_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2542122,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_20be5920f70d395a9d8603b863ae79f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a4eb8f-db47-57c0-8be9-3d85051a0909/d2a4eb8f-db47-57c0-8be9-3d85051a0909_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_77f7985fa35d5c50bcc902286dcc3af2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a4eb8f-db47-57c0-8be9-3d85051a0909/d2a4eb8f-db47-57c0-8be9-3d85051a0909_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2349244,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/5a/305aa012f0989609bb0561ad8e95950f/pa/UD25726_0222800fa019fc0b4b9fcbe4a608823f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI Coupe',
 'transmission': 'automatic',
 'trim': 'Coupe',
 'year': 2017}
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD25726%27 HTTP/1.1" 200 None
2026-03-30 10:35:29 [auto1.de] INFO: Saving data for UD25726: {'created_time': 1774866929.50888, 'last_price_update_time': 1774866929.508894, 'auction_closing_time': 1774971629.0}
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD25726') HTTP/1.1" 204 0
2026-03-30 10:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XM57589/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL20723/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN97244/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF99965/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CF24380> (referer: https://www.auto1.com/v1/car-details-view/CF24380/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP01427> (referer: https://www.auto1.com/v1/car-details-view/YP01427/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84d7901b-f205-58da-8b05-e9d29617391f with identifier: CF24380
2026-03-30 10:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84d7901b-f205-58da-8b05-e9d29617391f with scrape type 1
2026-03-30 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 84d7901b-f205-58da-8b05-e9d29617391f
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff3%252F37f3853154ba41f0368dc78ca523d32d%252Fpa%252FCF24380_73ca7a13b09b91a63745d7f676088236.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f3/37f3853154ba41f0368dc78ca523d32d/pa/CF24380_73ca7a13b09b91a63745d7f676088236.jpg already downloaded
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff3%252F37f3853154ba41f0368dc78ca523d32d%252Fpa%252FCF24380_424d6093d29273731c631434690a943d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f3/37f3853154ba41f0368dc78ca523d32d/pa/CF24380_424d6093d29273731c631434690a943d.jpg already downloaded
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff3%252F37f3853154ba41f0368dc78ca523d32d%252Fpa%252FCF24380_954cb53a2a695a579d372ccd1a0814f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f3/37f3853154ba41f0368dc78ca523d32d/pa/CF24380_954cb53a2a695a579d372ccd1a0814f9.jpg already downloaded
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff3%252F37f3853154ba41f0368dc78ca523d32d%252Fpa%252FCF24380_e2cd152e0c0d8c571030acb1ac97ce0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f3/37f3853154ba41f0368dc78ca523d32d/pa/CF24380_e2cd152e0c0d8c571030acb1ac97ce0b.jpg already downloaded
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff3%252F37f3853154ba41f0368dc78ca523d32d%252Fpa%252FCF24380_adbe9f4647d8533f9579ae2dc3948fb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f3/37f3853154ba41f0368dc78ca523d32d/pa/CF24380_adbe9f4647d8533f9579ae2dc3948fb6.jpg already downloaded
2026-03-30 10:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84d7901b-f205-58da-8b05-e9d29617391f, identifier: CF24380
2026-03-30 10:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84d7901b-f205-58da-8b05-e9d29617391f with identifier: CF24380
2026-03-30 10:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84d7901b-f205-58da-8b05-e9d29617391f with identifier: CF24380
2026-03-30 10:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84d7901b-f205-58da-8b05-e9d29617391f with identifier: CF24380 to the API
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CF24380>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:29:02Z',
 'fuel_type': 'petrol',
 'id': '84d7901b-f205-58da-8b05-e9d29617391f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF24380',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 181782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img37/f3/37f3853154ba41f0368dc78ca523d32d/pa/CF24380_73ca7a13b09b91a63745d7f676088236.jpg',
                'https://img-pa.auto1.com/img37/f3/37f3853154ba41f0368dc78ca523d32d/pa/CF24380_424d6093d29273731c631434690a943d.jpg',
                'https://img-pa.auto1.com/img37/f3/37f3853154ba41f0368dc78ca523d32d/pa/CF24380_954cb53a2a695a579d372ccd1a0814f9.jpg',
                'https://img-pa.auto1.com/img37/f3/37f3853154ba41f0368dc78ca523d32d/pa/CF24380_e2cd152e0c0d8c571030acb1ac97ce0b.jpg',
                'https://img-pa.auto1.com/img37/f3/37f3853154ba41f0368dc78ca523d32d/pa/CF24380_adbe9f4647d8533f9579ae2dc3948fb6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d7901b-f205-58da-8b05-e9d29617391f/84d7901b-f205-58da-8b05-e9d29617391f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/f3/37f3853154ba41f0368dc78ca523d32d/pa/CF24380_73ca7a13b09b91a63745d7f676088236.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d7901b-f205-58da-8b05-e9d29617391f/84d7901b-f205-58da-8b05-e9d29617391f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/f3/37f3853154ba41f0368dc78ca523d32d/pa/CF24380_424d6093d29273731c631434690a943d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d7901b-f205-58da-8b05-e9d29617391f/84d7901b-f205-58da-8b05-e9d29617391f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/f3/37f3853154ba41f0368dc78ca523d32d/pa/CF24380_954cb53a2a695a579d372ccd1a0814f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d7901b-f205-58da-8b05-e9d29617391f/84d7901b-f205-58da-8b05-e9d29617391f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/f3/37f3853154ba41f0368dc78ca523d32d/pa/CF24380_e2cd152e0c0d8c571030acb1ac97ce0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d7901b-f205-58da-8b05-e9d29617391f/84d7901b-f205-58da-8b05-e9d29617391f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/f3/37f3853154ba41f0368dc78ca523d32d/pa/CF24380_adbe9f4647d8533f9579ae2dc3948fb6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI GT Sport',
 'transmission': 'manual',
 'trim': 'GT Sport',
 'year': 2008}
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF24380%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [auto1.de] INFO: Saving data for CF24380: {'created_time': 1774866931.612533, 'last_price_update_time': 1774866931.612541, 'auction_closing_time': 1774970942.0}
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF24380') HTTP/1.1" 204 0
2026-03-30 10:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TT41826> (referer: https://www.auto1.com/v1/car-details-view/TT41826/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f32639be-4cd9-53a9-920d-405b279998f7 with identifier: YP01427
2026-03-30 10:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f32639be-4cd9-53a9-920d-405b279998f7 with scrape type 1
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f32639be-4cd9-53a9-920d-405b279998f7
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_7f8b79e7e5fa5e65f215983c4c79bcfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_7f8b79e7e5fa5e65f215983c4c79bcfa.jpg not downloaded yet
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_6fc16a7a0931f9b63457e56513a74cb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_6fc16a7a0931f9b63457e56513a74cb6.jpg not downloaded yet
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_86f5b9c9319b37eef0c61e7987400ff7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_86f5b9c9319b37eef0c61e7987400ff7.jpg not downloaded yet
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_ea926b9a5bbdd18b2abbbabc7558c574.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_ea926b9a5bbdd18b2abbbabc7558c574.jpg not downloaded yet
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_3da019d348c1f6ae5c7e3a06ce66a088.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_3da019d348c1f6ae5c7e3a06ce66a088.jpg not downloaded yet
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_91cae919d95a311a8da5f2952624f87e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_91cae919d95a311a8da5f2952624f87e.jpg not downloaded yet
2026-03-30 10:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03e2343d-305b-52a7-9125-2a28e52f4692 with identifier: TT41826
2026-03-30 10:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03e2343d-305b-52a7-9125-2a28e52f4692 with scrape type 1
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03e2343d-305b-52a7-9125-2a28e52f4692
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_bfbb72c6b4acf9c7a65ef9c6148a13e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_bfbb72c6b4acf9c7a65ef9c6148a13e4.jpg not downloaded yet
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_411ce271941f291b694954a71e49bd3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_411ce271941f291b694954a71e49bd3a.jpg not downloaded yet
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_b936b33c78d8eb4fd39b0572b9568d44.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_b936b33c78d8eb4fd39b0572b9568d44.jpg not downloaded yet
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_8a750cd5c536053bb1e971bdc9fd86bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_8a750cd5c536053bb1e971bdc9fd86bf.jpg not downloaded yet
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_1c89235d17445c29535a9f0728742720.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_1c89235d17445c29535a9f0728742720.jpg not downloaded yet
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_63b4119961bf28300a75e41cb6d3f318.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_63b4119961bf28300a75e41cb6d3f318.jpg not downloaded yet
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_2c6120f25d4d1e6de2a36e38b06635d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_2c6120f25d4d1e6de2a36e38b06635d3.jpg not downloaded yet
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_a482cd38fa7453732731be83f7dcbf0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_a482cd38fa7453732731be83f7dcbf0c.jpg not downloaded yet
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_895a9b241e86383b4f2555eb5eb9ac53.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_895a9b241e86383b4f2555eb5eb9ac53.jpg not downloaded yet
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_34e16e68a030d5e5ff8faf5b1c7faaff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_34e16e68a030d5e5ff8faf5b1c7faaff.jpg not downloaded yet
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_0f82aefec24715d7774849088ffea86a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_0f82aefec24715d7774849088ffea86a.jpg not downloaded yet
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_6c120bde7800c29a4517a40f1056b4ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_6c120bde7800c29a4517a40f1056b4ff.jpg not downloaded yet
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_7c9077cb449434723eff88e3cff2c587.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_7c9077cb449434723eff88e3cff2c587.jpg not downloaded yet
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_6015078b6a27e975728c8bc7d51d9c0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_6015078b6a27e975728c8bc7d51d9c0b.jpg not downloaded yet
2026-03-30 10:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PZ26473> (referer: https://www.auto1.com/v1/car-details-view/PZ26473/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_6015078b6a27e975728c8bc7d51d9c0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f4633b6-8654-5b4a-955b-9dbacbca30ee with identifier: PZ26473
2026-03-30 10:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f4633b6-8654-5b4a-955b-9dbacbca30ee with scrape type 1
2026-03-30 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f4633b6-8654-5b4a-955b-9dbacbca30ee
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_4d2b7b924cd5956ad6891324b0112982.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_4d2b7b924cd5956ad6891324b0112982.jpg not downloaded yet
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_421fd3362ccd49fad6dc375edb616b6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_421fd3362ccd49fad6dc375edb616b6d.jpg not downloaded yet
2026-03-30 10:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_7c9077cb449434723eff88e3cff2c587.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_144fc0bb573d2a71c6b892d3cbc39d03.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_144fc0bb573d2a71c6b892d3cbc39d03.jpg not downloaded yet
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_bc977b381a2a6168cc409aefaac81649.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_bc977b381a2a6168cc409aefaac81649.jpg not downloaded yet
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_0a9dff1c0758ec8f7318b7ee0961b0b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_0a9dff1c0758ec8f7318b7ee0961b0b0.jpg not downloaded yet
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_6e5784fe9e74da9d67c946ac0da2e1dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_6e5784fe9e74da9d67c946ac0da2e1dc.jpg not downloaded yet
2026-03-30 10:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef03290>
2026-03-30 10:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_6015078b6a27e975728c8bc7d51d9c0b.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_6015078b6a27e975728c8bc7d51d9c0b.jpg saved to cache
2026-03-30 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 03e2343d-305b-52a7-9125-2a28e52f4692
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_5ef9c608d48e5957302db6d0f8c681ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_5ef9c608d48e5957302db6d0f8c681ad.jpg not downloaded yet
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_777c12311275c1c624d2f9d4a4bb6321.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_777c12311275c1c624d2f9d4a4bb6321.jpg not downloaded yet
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_c1064a00d3d0dd940c907397342d7d68.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_c1064a00d3d0dd940c907397342d7d68.jpg not downloaded yet
2026-03-30 10:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb4d50>
2026-03-30 10:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_7c9077cb449434723eff88e3cff2c587.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_7c9077cb449434723eff88e3cff2c587.jpg saved to cache
2026-03-30 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 03e2343d-305b-52a7-9125-2a28e52f4692
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_d66e39a0bb7994cfc570fdeedc093da8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_d66e39a0bb7994cfc570fdeedc093da8.jpg not downloaded yet
2026-03-30 10:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD39449/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_421fd3362ccd49fad6dc375edb616b6d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4378510>
2026-03-30 10:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_421fd3362ccd49fad6dc375edb616b6d.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_421fd3362ccd49fad6dc375edb616b6d.jpg saved to cache
2026-03-30 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f4633b6-8654-5b4a-955b-9dbacbca30ee
2026-03-30 10:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_d66e39a0bb7994cfc570fdeedc093da8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WS55091> (referer: https://www.auto1.com/v1/car-details-view/WS55091/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419dd10>
2026-03-30 10:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_d66e39a0bb7994cfc570fdeedc093da8.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_d66e39a0bb7994cfc570fdeedc093da8.jpg saved to cache
2026-03-30 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f4633b6-8654-5b4a-955b-9dbacbca30ee
2026-03-30 10:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e31ae82b-b0ea-5e53-b0af-00e34fceb473 with identifier: WS55091
2026-03-30 10:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e31ae82b-b0ea-5e53-b0af-00e34fceb473 with scrape type 1
2026-03-30 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e31ae82b-b0ea-5e53-b0af-00e34fceb473
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F3d%252F1f3d6e70ef9b3b16abce8e0db3747d4a%252Fpa%252FWS55091_0c856e14c8ad0954ec743cea47f6ff77.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_0c856e14c8ad0954ec743cea47f6ff77.jpg already downloaded
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F3d%252F1f3d6e70ef9b3b16abce8e0db3747d4a%252Fpa%252FWS55091_296724e5e3638a0b97e417fed8114599.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_296724e5e3638a0b97e417fed8114599.jpg already downloaded
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F3d%252F1f3d6e70ef9b3b16abce8e0db3747d4a%252Fpa%252FWS55091_f26b62556735a827ed724c5bb5281798.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_f26b62556735a827ed724c5bb5281798.jpg already downloaded
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F3d%252F1f3d6e70ef9b3b16abce8e0db3747d4a%252Fpa%252FWS55091_0a214df9bc98d9e95114cca94cf2046d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_0a214df9bc98d9e95114cca94cf2046d.jpg already downloaded
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F3d%252F1f3d6e70ef9b3b16abce8e0db3747d4a%252Fpa%252FWS55091_8c78b4f3843b02e2cf69ba13c28f97e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_8c78b4f3843b02e2cf69ba13c28f97e6.jpg already downloaded
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F3d%252F1f3d6e70ef9b3b16abce8e0db3747d4a%252Fpa%252FWS55091_b2da4454d3775d937b47ab56dba3304e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_b2da4454d3775d937b47ab56dba3304e.jpg already downloaded
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F3d%252F1f3d6e70ef9b3b16abce8e0db3747d4a%252Fpa%252FWS55091_fe1ff211796738228d58bd8c3268c1ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_fe1ff211796738228d58bd8c3268c1ba.jpg already downloaded
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F3d%252F1f3d6e70ef9b3b16abce8e0db3747d4a%252Fpa%252FWS55091_2df6f76703cd42d228ec13a006c883f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_2df6f76703cd42d228ec13a006c883f0.jpg already downloaded
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F3d%252F1f3d6e70ef9b3b16abce8e0db3747d4a%252Fpa%252FWS55091_71b3db62fd2d0c985b86c639d01931d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_71b3db62fd2d0c985b86c639d01931d6.jpg already downloaded
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F3d%252F1f3d6e70ef9b3b16abce8e0db3747d4a%252Fpa%252FWS55091_02b371c3360915b9305d90098f7d7095.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_02b371c3360915b9305d90098f7d7095.jpg already downloaded
2026-03-30 10:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e31ae82b-b0ea-5e53-b0af-00e34fceb473, identifier: WS55091
2026-03-30 10:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e31ae82b-b0ea-5e53-b0af-00e34fceb473 with identifier: WS55091
2026-03-30 10:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e31ae82b-b0ea-5e53-b0af-00e34fceb473 with identifier: WS55091
2026-03-30 10:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e31ae82b-b0ea-5e53-b0af-00e34fceb473 with identifier: WS55091 to the API
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WS55091>
{'auction_title': '',
 'c_o_2_emission_value': 250,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '4.0L',
 'engine_horse_power': 435,
 'expiration_date': '2026-03-31T15:09:28Z',
 'fuel_type': 'diesel',
 'id': 'e31ae82b-b0ea-5e53-b0af-00e34fceb473',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS55091',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Audi',
 'model': 'SQ7',
 'odometer': 192383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_0c856e14c8ad0954ec743cea47f6ff77.jpg',
                'https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_296724e5e3638a0b97e417fed8114599.jpg',
                'https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_f26b62556735a827ed724c5bb5281798.jpg',
                'https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_0a214df9bc98d9e95114cca94cf2046d.jpg',
                'https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_8c78b4f3843b02e2cf69ba13c28f97e6.jpg',
                'https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_b2da4454d3775d937b47ab56dba3304e.jpg',
                'https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_fe1ff211796738228d58bd8c3268c1ba.jpg',
                'https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_2df6f76703cd42d228ec13a006c883f0.jpg',
                'https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_71b3db62fd2d0c985b86c639d01931d6.jpg',
                'https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_02b371c3360915b9305d90098f7d7095.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e31ae82b-b0ea-5e53-b0af-00e34fceb473/e31ae82b-b0ea-5e53-b0af-00e34fceb473_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_0c856e14c8ad0954ec743cea47f6ff77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e31ae82b-b0ea-5e53-b0af-00e34fceb473/e31ae82b-b0ea-5e53-b0af-00e34fceb473_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_296724e5e3638a0b97e417fed8114599.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e31ae82b-b0ea-5e53-b0af-00e34fceb473/e31ae82b-b0ea-5e53-b0af-00e34fceb473_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_f26b62556735a827ed724c5bb5281798.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e31ae82b-b0ea-5e53-b0af-00e34fceb473/e31ae82b-b0ea-5e53-b0af-00e34fceb473_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_0a214df9bc98d9e95114cca94cf2046d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e31ae82b-b0ea-5e53-b0af-00e34fceb473/e31ae82b-b0ea-5e53-b0af-00e34fceb473_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_8c78b4f3843b02e2cf69ba13c28f97e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e31ae82b-b0ea-5e53-b0af-00e34fceb473/e31ae82b-b0ea-5e53-b0af-00e34fceb473_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_b2da4454d3775d937b47ab56dba3304e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e31ae82b-b0ea-5e53-b0af-00e34fceb473/e31ae82b-b0ea-5e53-b0af-00e34fceb473_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_fe1ff211796738228d58bd8c3268c1ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e31ae82b-b0ea-5e53-b0af-00e34fceb473/e31ae82b-b0ea-5e53-b0af-00e34fceb473_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_2df6f76703cd42d228ec13a006c883f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e31ae82b-b0ea-5e53-b0af-00e34fceb473/e31ae82b-b0ea-5e53-b0af-00e34fceb473_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_71b3db62fd2d0c985b86c639d01931d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e31ae82b-b0ea-5e53-b0af-00e34fceb473/e31ae82b-b0ea-5e53-b0af-00e34fceb473_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/3d/1f3d6e70ef9b3b16abce8e0db3747d4a/pa/WS55091_02b371c3360915b9305d90098f7d7095.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi SQ7 4.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS55091%27 HTTP/1.1" 200 None
2026-03-30 10:35:36 [auto1.de] INFO: Saving data for WS55091: {'created_time': 1774866936.010286, 'last_price_update_time': 1774866936.010297, 'auction_closing_time': 1774969768.0}
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS55091') HTTP/1.1" 204 0
2026-03-30 10:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_c1064a00d3d0dd940c907397342d7d68.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_777c12311275c1c624d2f9d4a4bb6321.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee07350>
2026-03-30 10:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_c1064a00d3d0dd940c907397342d7d68.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_c1064a00d3d0dd940c907397342d7d68.jpg saved to cache
2026-03-30 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f4633b6-8654-5b4a-955b-9dbacbca30ee
2026-03-30 10:35:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4339150>
2026-03-30 10:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_777c12311275c1c624d2f9d4a4bb6321.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_777c12311275c1c624d2f9d4a4bb6321.jpg saved to cache
2026-03-30 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f4633b6-8654-5b4a-955b-9dbacbca30ee
2026-03-30 10:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_5ef9c608d48e5957302db6d0f8c681ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4379490>
2026-03-30 10:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_5ef9c608d48e5957302db6d0f8c681ad.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_5ef9c608d48e5957302db6d0f8c681ad.jpg saved to cache
2026-03-30 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f4633b6-8654-5b4a-955b-9dbacbca30ee
2026-03-30 10:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_6e5784fe9e74da9d67c946ac0da2e1dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f437b910>
2026-03-30 10:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_6e5784fe9e74da9d67c946ac0da2e1dc.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_6e5784fe9e74da9d67c946ac0da2e1dc.jpg saved to cache
2026-03-30 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f4633b6-8654-5b4a-955b-9dbacbca30ee
2026-03-30 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_0a9dff1c0758ec8f7318b7ee0961b0b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_bc977b381a2a6168cc409aefaac81649.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefdd510>
2026-03-30 10:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_0a9dff1c0758ec8f7318b7ee0961b0b0.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_0a9dff1c0758ec8f7318b7ee0961b0b0.jpg saved to cache
2026-03-30 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f4633b6-8654-5b4a-955b-9dbacbca30ee
2026-03-30 10:35:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef36e10>
2026-03-30 10:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_bc977b381a2a6168cc409aefaac81649.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_bc977b381a2a6168cc409aefaac81649.jpg saved to cache
2026-03-30 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f4633b6-8654-5b4a-955b-9dbacbca30ee
2026-03-30 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_4d2b7b924cd5956ad6891324b0112982.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_144fc0bb573d2a71c6b892d3cbc39d03.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_6c120bde7800c29a4517a40f1056b4ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429d110>
2026-03-30 10:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_4d2b7b924cd5956ad6891324b0112982.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_4d2b7b924cd5956ad6891324b0112982.jpg saved to cache
2026-03-30 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f4633b6-8654-5b4a-955b-9dbacbca30ee
2026-03-30 10:35:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee62010>
2026-03-30 10:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd3%252F9fd3932055555bc2a01f4501be8485ac%252Fpa%252FPZ26473_144fc0bb573d2a71c6b892d3cbc39d03.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_144fc0bb573d2a71c6b892d3cbc39d03.jpg saved to cache
2026-03-30 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f4633b6-8654-5b4a-955b-9dbacbca30ee
2026-03-30 10:35:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f4633b6-8654-5b4a-955b-9dbacbca30ee, skipping ID generation
2026-03-30 10:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f4633b6-8654-5b4a-955b-9dbacbca30ee with scrape type 1
2026-03-30 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f4633b6-8654-5b4a-955b-9dbacbca30ee sending to next pipeline
2026-03-30 10:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f4633b6-8654-5b4a-955b-9dbacbca30ee, identifier: PZ26473
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4286050>
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_6c120bde7800c29a4517a40f1056b4ff.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_6c120bde7800c29a4517a40f1056b4ff.jpg saved to cache
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 03e2343d-305b-52a7-9125-2a28e52f4692
2026-03-30 10:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f4633b6-8654-5b4a-955b-9dbacbca30ee with identifier: PZ26473
2026-03-30 10:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f4633b6-8654-5b4a-955b-9dbacbca30ee with identifier: PZ26473
2026-03-30 10:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f4633b6-8654-5b4a-955b-9dbacbca30ee with identifier: PZ26473 to the API
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_144fc0bb573d2a71c6b892d3cbc39d03.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:47:52Z',
 'fuel_type': 'petrol',
 'id': '8f4633b6-8654-5b4a-955b-9dbacbca30ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ26473',
 'listing': 'auction',
 'location': 'DE, Hanau',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 7134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3046106,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_4d2b7b924cd5956ad6891324b0112982.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3074544,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_421fd3362ccd49fad6dc375edb616b6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3049117,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_144fc0bb573d2a71c6b892d3cbc39d03.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2883642,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_bc977b381a2a6168cc409aefaac81649.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2957239,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_0a9dff1c0758ec8f7318b7ee0961b0b0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3073722,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_6e5784fe9e74da9d67c946ac0da2e1dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2946783,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_5ef9c608d48e5957302db6d0f8c681ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3144566,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_777c12311275c1c624d2f9d4a4bb6321.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3173285,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_c1064a00d3d0dd940c907397342d7d68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4633b6-8654-5b4a-955b-9dbacbca30ee/8f4633b6-8654-5b4a-955b-9dbacbca30ee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3060988,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d3/9fd3932055555bc2a01f4501be8485ac/pa/PZ26473_d66e39a0bb7994cfc570fdeedc093da8.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid N Line 4WD',
 'transmission': 'automatic',
 'trim': 'N Line 4WD',
 'year': 2024}
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ26473%27 HTTP/1.1" 200 None
2026-03-30 10:35:38 [auto1.de] INFO: Saving data for PZ26473: {'created_time': 1774866938.472098, 'last_price_update_time': 1774866938.472108, 'auction_closing_time': 1774972072.0}
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ26473') HTTP/1.1" 204 0
2026-03-30 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_34e16e68a030d5e5ff8faf5b1c7faaff.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_0f82aefec24715d7774849088ffea86a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY84465/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK50326> (referer: https://www.auto1.com/v1/car-details-view/FK50326/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_895a9b241e86383b4f2555eb5eb9ac53.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_2c6120f25d4d1e6de2a36e38b06635d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd5090>
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_34e16e68a030d5e5ff8faf5b1c7faaff.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_34e16e68a030d5e5ff8faf5b1c7faaff.jpg saved to cache
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 03e2343d-305b-52a7-9125-2a28e52f4692
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4198e50>
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_0f82aefec24715d7774849088ffea86a.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_0f82aefec24715d7774849088ffea86a.jpg saved to cache
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 03e2343d-305b-52a7-9125-2a28e52f4692
2026-03-30 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_1c89235d17445c29535a9f0728742720.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86c2910d-4aeb-5e15-a801-57661f1c9a0d with identifier: FK50326
2026-03-30 10:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86c2910d-4aeb-5e15-a801-57661f1c9a0d with scrape type 1
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 86c2910d-4aeb-5e15-a801-57661f1c9a0d
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_938091235c9f7a44a520bcd55eb2ec44.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_938091235c9f7a44a520bcd55eb2ec44.jpg not downloaded yet
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41869d0>
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_895a9b241e86383b4f2555eb5eb9ac53.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_895a9b241e86383b4f2555eb5eb9ac53.jpg saved to cache
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 03e2343d-305b-52a7-9125-2a28e52f4692
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f593fd90>
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_2c6120f25d4d1e6de2a36e38b06635d3.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_2c6120f25d4d1e6de2a36e38b06635d3.jpg saved to cache
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03e2343d-305b-52a7-9125-2a28e52f4692
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_a74563f2f7a5e0044947f91705735936.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_a74563f2f7a5e0044947f91705735936.jpg not downloaded yet
2026-03-30 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_b936b33c78d8eb4fd39b0572b9568d44.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_bdb6fd5310af09fb219aaed587424f69.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_bdb6fd5310af09fb219aaed587424f69.jpg not downloaded yet
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41c4fd0>
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_1c89235d17445c29535a9f0728742720.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_1c89235d17445c29535a9f0728742720.jpg saved to cache
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03e2343d-305b-52a7-9125-2a28e52f4692
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_c17ce0f93422c098041f20f4cadd5b53.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_c17ce0f93422c098041f20f4cadd5b53.jpg not downloaded yet
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_f69ab58b196471efad25c8da0578c45c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_f69ab58b196471efad25c8da0578c45c.jpg not downloaded yet
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_4818f7a882c05ca2db13cbb9b7ce7be0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_4818f7a882c05ca2db13cbb9b7ce7be0.jpg not downloaded yet
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_b9a83a2b30adb873956f98e411b79d83.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_b9a83a2b30adb873956f98e411b79d83.jpg not downloaded yet
2026-03-30 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_938091235c9f7a44a520bcd55eb2ec44.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec7c90>
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_b936b33c78d8eb4fd39b0572b9568d44.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_b936b33c78d8eb4fd39b0572b9568d44.jpg saved to cache
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03e2343d-305b-52a7-9125-2a28e52f4692
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_254c073c9a6eeb79fec3145adbb176e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_254c073c9a6eeb79fec3145adbb176e6.jpg not downloaded yet
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_11f8586b2e9f19f10e0ab1ddb069605f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_11f8586b2e9f19f10e0ab1ddb069605f.jpg not downloaded yet
2026-03-30 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_63b4119961bf28300a75e41cb6d3f318.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_ba5029887e1217053b91f3540544f378.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_ba5029887e1217053b91f3540544f378.jpg not downloaded yet
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4214a50>
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_938091235c9f7a44a520bcd55eb2ec44.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_938091235c9f7a44a520bcd55eb2ec44.jpg saved to cache
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86c2910d-4aeb-5e15-a801-57661f1c9a0d
2026-03-30 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_4818f7a882c05ca2db13cbb9b7ce7be0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef9f6d0>
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_63b4119961bf28300a75e41cb6d3f318.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_63b4119961bf28300a75e41cb6d3f318.jpg saved to cache
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f32639be-4cd9-53a9-920d-405b279998f7
2026-03-30 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_11f8586b2e9f19f10e0ab1ddb069605f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_ba5029887e1217053b91f3540544f378.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f437bb90>
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_4818f7a882c05ca2db13cbb9b7ce7be0.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_4818f7a882c05ca2db13cbb9b7ce7be0.jpg saved to cache
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86c2910d-4aeb-5e15-a801-57661f1c9a0d
2026-03-30 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_a482cd38fa7453732731be83f7dcbf0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_8a750cd5c536053bb1e971bdc9fd86bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_254c073c9a6eeb79fec3145adbb176e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_f69ab58b196471efad25c8da0578c45c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f2c10>
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_11f8586b2e9f19f10e0ab1ddb069605f.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_11f8586b2e9f19f10e0ab1ddb069605f.jpg saved to cache
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 86c2910d-4aeb-5e15-a801-57661f1c9a0d
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e1750>
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_ba5029887e1217053b91f3540544f378.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_ba5029887e1217053b91f3540544f378.jpg saved to cache
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86c2910d-4aeb-5e15-a801-57661f1c9a0d
2026-03-30 10:35:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefb6dd0>
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_a482cd38fa7453732731be83f7dcbf0c.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_a482cd38fa7453732731be83f7dcbf0c.jpg saved to cache
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f32639be-4cd9-53a9-920d-405b279998f7
2026-03-30 10:35:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4194110>
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_8a750cd5c536053bb1e971bdc9fd86bf.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_8a750cd5c536053bb1e971bdc9fd86bf.jpg saved to cache
2026-03-30 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f32639be-4cd9-53a9-920d-405b279998f7
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee41710>
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_254c073c9a6eeb79fec3145adbb176e6.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_254c073c9a6eeb79fec3145adbb176e6.jpg saved to cache
2026-03-30 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86c2910d-4aeb-5e15-a801-57661f1c9a0d
2026-03-30 10:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_b9a83a2b30adb873956f98e411b79d83.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4255d90>
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_f69ab58b196471efad25c8da0578c45c.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_f69ab58b196471efad25c8da0578c45c.jpg saved to cache
2026-03-30 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86c2910d-4aeb-5e15-a801-57661f1c9a0d
2026-03-30 10:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_c17ce0f93422c098041f20f4cadd5b53.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd7d10>
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_b9a83a2b30adb873956f98e411b79d83.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_b9a83a2b30adb873956f98e411b79d83.jpg saved to cache
2026-03-30 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86c2910d-4aeb-5e15-a801-57661f1c9a0d
2026-03-30 10:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_bdb6fd5310af09fb219aaed587424f69.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_a74563f2f7a5e0044947f91705735936.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f436c450>
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_c17ce0f93422c098041f20f4cadd5b53.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_c17ce0f93422c098041f20f4cadd5b53.jpg saved to cache
2026-03-30 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86c2910d-4aeb-5e15-a801-57661f1c9a0d
2026-03-30 10:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_bfbb72c6b4acf9c7a65ef9c6148a13e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d4b10>
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_bdb6fd5310af09fb219aaed587424f69.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_bdb6fd5310af09fb219aaed587424f69.jpg saved to cache
2026-03-30 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86c2910d-4aeb-5e15-a801-57661f1c9a0d
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4186610>
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faa%252Fedaab9cd312c3e4a58b9ab5542be494d%252Fpa%252FFK50326_a74563f2f7a5e0044947f91705735936.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_a74563f2f7a5e0044947f91705735936.jpg saved to cache
2026-03-30 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86c2910d-4aeb-5e15-a801-57661f1c9a0d
2026-03-30 10:35:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86c2910d-4aeb-5e15-a801-57661f1c9a0d, skipping ID generation
2026-03-30 10:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86c2910d-4aeb-5e15-a801-57661f1c9a0d with scrape type 1
2026-03-30 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86c2910d-4aeb-5e15-a801-57661f1c9a0d sending to next pipeline
2026-03-30 10:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86c2910d-4aeb-5e15-a801-57661f1c9a0d, identifier: FK50326
2026-03-30 10:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86c2910d-4aeb-5e15-a801-57661f1c9a0d with identifier: FK50326
2026-03-30 10:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86c2910d-4aeb-5e15-a801-57661f1c9a0d with identifier: FK50326
2026-03-30 10:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86c2910d-4aeb-5e15-a801-57661f1c9a0d with identifier: FK50326 to the API
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_a74563f2f7a5e0044947f91705735936.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:54:47Z',
 'fuel_type': 'petrol',
 'id': '86c2910d-4aeb-5e15-a801-57661f1c9a0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK50326',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 67858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_938091235c9f7a44a520bcd55eb2ec44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_a74563f2f7a5e0044947f91705735936.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_bdb6fd5310af09fb219aaed587424f69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_c17ce0f93422c098041f20f4cadd5b53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_f69ab58b196471efad25c8da0578c45c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_4818f7a882c05ca2db13cbb9b7ce7be0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_b9a83a2b30adb873956f98e411b79d83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_254c073c9a6eeb79fec3145adbb176e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_11f8586b2e9f19f10e0ab1ddb069605f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c2910d-4aeb-5e15-a801-57661f1c9a0d/86c2910d-4aeb-5e15-a801-57661f1c9a0d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab9cd312c3e4a58b9ab5542be494d/pa/FK50326_ba5029887e1217053b91f3540544f378.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI R BlueMotion 4Motion',
 'transmission': 'automatic',
 'trim': 'R BlueMotion 4Motion',
 'year': 2019}
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK50326%27 HTTP/1.1" 200 None
2026-03-30 10:35:40 [auto1.de] INFO: Saving data for FK50326: {'created_time': 1774866940.979413, 'last_price_update_time': 1774866940.979425, 'auction_closing_time': 1774972487.0}
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK50326') HTTP/1.1" 204 0
2026-03-30 10:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4284bd0>
2026-03-30 10:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F6b%252F876b7d591ad7df4b8ee6f8fad79abb6a%252Fpa%252FTT41826_bfbb72c6b4acf9c7a65ef9c6148a13e4.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_bfbb72c6b4acf9c7a65ef9c6148a13e4.jpg saved to cache
2026-03-30 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03e2343d-305b-52a7-9125-2a28e52f4692
2026-03-30 10:35:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03e2343d-305b-52a7-9125-2a28e52f4692, skipping ID generation
2026-03-30 10:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03e2343d-305b-52a7-9125-2a28e52f4692 with scrape type 1
2026-03-30 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03e2343d-305b-52a7-9125-2a28e52f4692 sending to next pipeline
2026-03-30 10:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03e2343d-305b-52a7-9125-2a28e52f4692, identifier: TT41826
2026-03-30 10:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03e2343d-305b-52a7-9125-2a28e52f4692 with identifier: TT41826
2026-03-30 10:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03e2343d-305b-52a7-9125-2a28e52f4692 with identifier: TT41826
2026-03-30 10:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03e2343d-305b-52a7-9125-2a28e52f4692 with identifier: TT41826 to the API
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_bfbb72c6b4acf9c7a65ef9c6148a13e4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:30:23Z',
 'fuel_type': 'diesel',
 'id': '03e2343d-305b-52a7-9125-2a28e52f4692',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT41826',
 'listing': 'auction',
 'location': 'DE, Hildesheim',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 229764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_bfbb72c6b4acf9c7a65ef9c6148a13e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_b936b33c78d8eb4fd39b0572b9568d44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_1c89235d17445c29535a9f0728742720.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_2c6120f25d4d1e6de2a36e38b06635d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_895a9b241e86383b4f2555eb5eb9ac53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_34e16e68a030d5e5ff8faf5b1c7faaff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_0f82aefec24715d7774849088ffea86a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_6c120bde7800c29a4517a40f1056b4ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_7c9077cb449434723eff88e3cff2c587.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e2343d-305b-52a7-9125-2a28e52f4692/03e2343d-305b-52a7-9125-2a28e52f4692_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/6b/876b7d591ad7df4b8ee6f8fad79abb6a/pa/TT41826_6015078b6a27e975728c8bc7d51d9c0b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT41826%27 HTTP/1.1" 200 None
2026-03-30 10:35:41 [auto1.de] INFO: Saving data for TT41826: {'created_time': 1774866941.453435, 'last_price_update_time': 1774866941.453446, 'auction_closing_time': 1774971023.0}
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT41826') HTTP/1.1" 204 0
2026-03-30 10:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_411ce271941f291b694954a71e49bd3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_91cae919d95a311a8da5f2952624f87e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_3da019d348c1f6ae5c7e3a06ce66a088.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42926d0>
2026-03-30 10:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_411ce271941f291b694954a71e49bd3a.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_411ce271941f291b694954a71e49bd3a.jpg saved to cache
2026-03-30 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f32639be-4cd9-53a9-920d-405b279998f7
2026-03-30 10:35:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d9190>
2026-03-30 10:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_91cae919d95a311a8da5f2952624f87e.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_91cae919d95a311a8da5f2952624f87e.jpg saved to cache
2026-03-30 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f32639be-4cd9-53a9-920d-405b279998f7
2026-03-30 10:35:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429fb90>
2026-03-30 10:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_3da019d348c1f6ae5c7e3a06ce66a088.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_3da019d348c1f6ae5c7e3a06ce66a088.jpg saved to cache
2026-03-30 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f32639be-4cd9-53a9-920d-405b279998f7
2026-03-30 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_ea926b9a5bbdd18b2abbbabc7558c574.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424d450>
2026-03-30 10:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_ea926b9a5bbdd18b2abbbabc7558c574.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_ea926b9a5bbdd18b2abbbabc7558c574.jpg saved to cache
2026-03-30 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f32639be-4cd9-53a9-920d-405b279998f7
2026-03-30 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_86f5b9c9319b37eef0c61e7987400ff7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_7f8b79e7e5fa5e65f215983c4c79bcfa.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_6fc16a7a0931f9b63457e56513a74cb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429c190>
2026-03-30 10:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_86f5b9c9319b37eef0c61e7987400ff7.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_86f5b9c9319b37eef0c61e7987400ff7.jpg saved to cache
2026-03-30 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f32639be-4cd9-53a9-920d-405b279998f7
2026-03-30 10:35:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4167450>
2026-03-30 10:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_7f8b79e7e5fa5e65f215983c4c79bcfa.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_7f8b79e7e5fa5e65f215983c4c79bcfa.jpg saved to cache
2026-03-30 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f32639be-4cd9-53a9-920d-405b279998f7
2026-03-30 10:35:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58d31d0>
2026-03-30 10:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F78%252Fd67802832a9c31a667bb4195dfe4e133%252Fpa%252FYP01427_6fc16a7a0931f9b63457e56513a74cb6.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_6fc16a7a0931f9b63457e56513a74cb6.jpg saved to cache
2026-03-30 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f32639be-4cd9-53a9-920d-405b279998f7
2026-03-30 10:35:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f32639be-4cd9-53a9-920d-405b279998f7, skipping ID generation
2026-03-30 10:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f32639be-4cd9-53a9-920d-405b279998f7 with scrape type 1
2026-03-30 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f32639be-4cd9-53a9-920d-405b279998f7 sending to next pipeline
2026-03-30 10:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f32639be-4cd9-53a9-920d-405b279998f7, identifier: YP01427
2026-03-30 10:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f32639be-4cd9-53a9-920d-405b279998f7 with identifier: YP01427
2026-03-30 10:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f32639be-4cd9-53a9-920d-405b279998f7 with identifier: YP01427
2026-03-30 10:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f32639be-4cd9-53a9-920d-405b279998f7 with identifier: YP01427 to the API
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_6fc16a7a0931f9b63457e56513a74cb6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.7L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:36:44Z',
 'fuel_type': 'petrol',
 'id': 'f32639be-4cd9-53a9-920d-405b279998f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP01427',
 'listing': 'auction',
 'location': 'DE, Lohr am Main',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 100299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3124941,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_7f8b79e7e5fa5e65f215983c4c79bcfa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2870687,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_6fc16a7a0931f9b63457e56513a74cb6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2910639,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_86f5b9c9319b37eef0c61e7987400ff7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2527021,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_ea926b9a5bbdd18b2abbbabc7558c574.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2887066,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_3da019d348c1f6ae5c7e3a06ce66a088.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2794614,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_91cae919d95a311a8da5f2952624f87e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2769024,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_411ce271941f291b694954a71e49bd3a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2904698,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_8a750cd5c536053bb1e971bdc9fd86bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3019988,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_63b4119961bf28300a75e41cb6d3f318.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32639be-4cd9-53a9-920d-405b279998f7/f32639be-4cd9-53a9-920d-405b279998f7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2729192,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/78/d67802832a9c31a667bb4195dfe4e133/pa/YP01427_a482cd38fa7453732731be83f7dcbf0c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 170',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP01427%27 HTTP/1.1" 200 None
2026-03-30 10:35:43 [auto1.de] INFO: Saving data for YP01427: {'created_time': 1774866943.304184, 'last_price_update_time': 1774866943.304196, 'auction_closing_time': 1774971404.0}
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP01427') HTTP/1.1" 204 0
2026-03-30 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NX05190> (referer: https://www.auto1.com/v1/car-details-view/NX05190/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7a20d77-beb6-5943-864b-24480fa9b17d with identifier: NX05190
2026-03-30 10:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7a20d77-beb6-5943-864b-24480fa9b17d with scrape type 1
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7a20d77-beb6-5943-864b-24480fa9b17d
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_bbfbe6b51ea61b4dbdba957dfe686290.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_bbfbe6b51ea61b4dbdba957dfe686290.jpg not downloaded yet
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_cd23d27759adb68e2267dfe830df4012.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_cd23d27759adb68e2267dfe830df4012.jpg not downloaded yet
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_a42f31e02e11a5ab63e684b489cc437c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_a42f31e02e11a5ab63e684b489cc437c.jpg not downloaded yet
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_a5a31d93970aa95a6ddc208ce9112558.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_a5a31d93970aa95a6ddc208ce9112558.jpg not downloaded yet
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_0dc5098346092409363d560b3cbf7f30.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_0dc5098346092409363d560b3cbf7f30.jpg not downloaded yet
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_8208c59fe2ae87f0ca43affa6e95ddcd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_8208c59fe2ae87f0ca43affa6e95ddcd.jpg not downloaded yet
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_bf95bc0cabad7a32c3502889136b8a99.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_bf95bc0cabad7a32c3502889136b8a99.jpg not downloaded yet
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_a8258b0069e5796734b233b7abf84ec4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_a8258b0069e5796734b233b7abf84ec4.jpg not downloaded yet
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_094f6f48f9f76dde4fe90dc3f4c27165.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_094f6f48f9f76dde4fe90dc3f4c27165.jpg not downloaded yet
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_bf1d569a6b9083c5f75944fec1ae655c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_bf1d569a6b9083c5f75944fec1ae655c.jpg not downloaded yet
2026-03-30 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU07976/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_bf1d569a6b9083c5f75944fec1ae655c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_094f6f48f9f76dde4fe90dc3f4c27165.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a4fd0>
2026-03-30 10:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_bf1d569a6b9083c5f75944fec1ae655c.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_bf1d569a6b9083c5f75944fec1ae655c.jpg saved to cache
2026-03-30 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7a20d77-beb6-5943-864b-24480fa9b17d
2026-03-30 10:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee818d0>
2026-03-30 10:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_094f6f48f9f76dde4fe90dc3f4c27165.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_094f6f48f9f76dde4fe90dc3f4c27165.jpg saved to cache
2026-03-30 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7a20d77-beb6-5943-864b-24480fa9b17d
2026-03-30 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FF99965> (referer: https://www.auto1.com/v1/car-details-view/FF99965/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_a8258b0069e5796734b233b7abf84ec4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 619c6e53-5fb4-5082-b2e6-0490bdf77cd3 with identifier: FF99965
2026-03-30 10:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 619c6e53-5fb4-5082-b2e6-0490bdf77cd3 with scrape type 1
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 619c6e53-5fb4-5082-b2e6-0490bdf77cd3
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_8ea7ee6e7c405bc62b0d03f24a586502.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_8ea7ee6e7c405bc62b0d03f24a586502.jpg not downloaded yet
2026-03-30 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_bf95bc0cabad7a32c3502889136b8a99.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_77fcdde365f5c14668afecdd6926d30f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_77fcdde365f5c14668afecdd6926d30f.jpg not downloaded yet
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_eea6411c5f1caffc5d7500d5a9882d14.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_eea6411c5f1caffc5d7500d5a9882d14.jpg not downloaded yet
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_1e23acb465ab617aa175842f7e2b61e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_1e23acb465ab617aa175842f7e2b61e3.jpg not downloaded yet
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_dd62c3259e892ed08d6d334afaf2ac6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_dd62c3259e892ed08d6d334afaf2ac6d.jpg not downloaded yet
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef7250>
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_a8258b0069e5796734b233b7abf84ec4.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_a8258b0069e5796734b233b7abf84ec4.jpg saved to cache
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7a20d77-beb6-5943-864b-24480fa9b17d
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_a3b15fdefdc75bf4f083b786a3f2910c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_a3b15fdefdc75bf4f083b786a3f2910c.jpg not downloaded yet
2026-03-30 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_8ea7ee6e7c405bc62b0d03f24a586502.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_97b7db5f2e9d4c193ae40a342348f9f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_97b7db5f2e9d4c193ae40a342348f9f3.jpg not downloaded yet
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_b416982afccb98a7c22b9e0911b1c7e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_b416982afccb98a7c22b9e0911b1c7e0.jpg not downloaded yet
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8ea10>
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_bf95bc0cabad7a32c3502889136b8a99.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_bf95bc0cabad7a32c3502889136b8a99.jpg saved to cache
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7a20d77-beb6-5943-864b-24480fa9b17d
2026-03-30 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_dd62c3259e892ed08d6d334afaf2ac6d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_51211918855dc9dfd91f97be8d749bfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_51211918855dc9dfd91f97be8d749bfa.jpg not downloaded yet
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_c9b332a4f4f8ae8766e0b5264d70781f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_c9b332a4f4f8ae8766e0b5264d70781f.jpg not downloaded yet
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429e9d0>
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_8ea7ee6e7c405bc62b0d03f24a586502.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_8ea7ee6e7c405bc62b0d03f24a586502.jpg saved to cache
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 619c6e53-5fb4-5082-b2e6-0490bdf77cd3
2026-03-30 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_b416982afccb98a7c22b9e0911b1c7e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef35410>
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_dd62c3259e892ed08d6d334afaf2ac6d.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_dd62c3259e892ed08d6d334afaf2ac6d.jpg saved to cache
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 619c6e53-5fb4-5082-b2e6-0490bdf77cd3
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef44e10>
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_b416982afccb98a7c22b9e0911b1c7e0.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_b416982afccb98a7c22b9e0911b1c7e0.jpg saved to cache
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 619c6e53-5fb4-5082-b2e6-0490bdf77cd3
2026-03-30 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_c9b332a4f4f8ae8766e0b5264d70781f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_51211918855dc9dfd91f97be8d749bfa.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4255a10>
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_c9b332a4f4f8ae8766e0b5264d70781f.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_c9b332a4f4f8ae8766e0b5264d70781f.jpg saved to cache
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 619c6e53-5fb4-5082-b2e6-0490bdf77cd3
2026-03-30 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_97b7db5f2e9d4c193ae40a342348f9f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3e990>
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_51211918855dc9dfd91f97be8d749bfa.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_51211918855dc9dfd91f97be8d749bfa.jpg saved to cache
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 619c6e53-5fb4-5082-b2e6-0490bdf77cd3
2026-03-30 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_a3b15fdefdc75bf4f083b786a3f2910c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3e050>
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_97b7db5f2e9d4c193ae40a342348f9f3.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_97b7db5f2e9d4c193ae40a342348f9f3.jpg saved to cache
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 619c6e53-5fb4-5082-b2e6-0490bdf77cd3
2026-03-30 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_1e23acb465ab617aa175842f7e2b61e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428cc10>
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_a3b15fdefdc75bf4f083b786a3f2910c.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_a3b15fdefdc75bf4f083b786a3f2910c.jpg saved to cache
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 619c6e53-5fb4-5082-b2e6-0490bdf77cd3
2026-03-30 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_eea6411c5f1caffc5d7500d5a9882d14.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee81510>
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_1e23acb465ab617aa175842f7e2b61e3.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_1e23acb465ab617aa175842f7e2b61e3.jpg saved to cache
2026-03-30 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 619c6e53-5fb4-5082-b2e6-0490bdf77cd3
2026-03-30 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_77fcdde365f5c14668afecdd6926d30f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee01d90>
2026-03-30 10:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_eea6411c5f1caffc5d7500d5a9882d14.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_eea6411c5f1caffc5d7500d5a9882d14.jpg saved to cache
2026-03-30 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 619c6e53-5fb4-5082-b2e6-0490bdf77cd3
2026-03-30 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_8208c59fe2ae87f0ca43affa6e95ddcd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41c4350>
2026-03-30 10:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdb%252F22dbc7038ba38af41f434f2249846822%252Fpa%252FFF99965_77fcdde365f5c14668afecdd6926d30f.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_77fcdde365f5c14668afecdd6926d30f.jpg saved to cache
2026-03-30 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 619c6e53-5fb4-5082-b2e6-0490bdf77cd3
2026-03-30 10:35:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 619c6e53-5fb4-5082-b2e6-0490bdf77cd3, skipping ID generation
2026-03-30 10:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 619c6e53-5fb4-5082-b2e6-0490bdf77cd3 with scrape type 1
2026-03-30 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 619c6e53-5fb4-5082-b2e6-0490bdf77cd3 sending to next pipeline
2026-03-30 10:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 619c6e53-5fb4-5082-b2e6-0490bdf77cd3, identifier: FF99965
2026-03-30 10:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 619c6e53-5fb4-5082-b2e6-0490bdf77cd3 with identifier: FF99965
2026-03-30 10:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 619c6e53-5fb4-5082-b2e6-0490bdf77cd3 with identifier: FF99965
2026-03-30 10:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 619c6e53-5fb4-5082-b2e6-0490bdf77cd3 with identifier: FF99965 to the API
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_77fcdde365f5c14668afecdd6926d30f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:30:18Z',
 'fuel_type': 'petrol',
 'id': '619c6e53-5fb4-5082-b2e6-0490bdf77cd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF99965',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 99159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_8ea7ee6e7c405bc62b0d03f24a586502.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_77fcdde365f5c14668afecdd6926d30f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_eea6411c5f1caffc5d7500d5a9882d14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_1e23acb465ab617aa175842f7e2b61e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_dd62c3259e892ed08d6d334afaf2ac6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_a3b15fdefdc75bf4f083b786a3f2910c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_97b7db5f2e9d4c193ae40a342348f9f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_b416982afccb98a7c22b9e0911b1c7e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_51211918855dc9dfd91f97be8d749bfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_619c6e53-5fb4-5082-b2e6-0490bdf77cd3/619c6e53-5fb4-5082-b2e6-0490bdf77cd3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/db/22dbc7038ba38af41f434f2249846822/pa/FF99965_c9b332a4f4f8ae8766e0b5264d70781f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI Cupra 300 4Drive',
 'transmission': 'automatic',
 'trim': 'Cupra 300 4Drive',
 'year': 2018}
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF99965%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [auto1.de] INFO: Saving data for FF99965: {'created_time': 1774866949.138066, 'last_price_update_time': 1774866949.138079, 'auction_closing_time': 1774971018.0}
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF99965') HTTP/1.1" 204 0
2026-03-30 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_0dc5098346092409363d560b3cbf7f30.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HN97244> (referer: https://www.auto1.com/v1/car-details-view/HN97244/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefb5dd0>
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_8208c59fe2ae87f0ca43affa6e95ddcd.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_8208c59fe2ae87f0ca43affa6e95ddcd.jpg saved to cache
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7a20d77-beb6-5943-864b-24480fa9b17d
2026-03-30 10:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee4ccd0>
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_0dc5098346092409363d560b3cbf7f30.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_0dc5098346092409363d560b3cbf7f30.jpg saved to cache
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7a20d77-beb6-5943-864b-24480fa9b17d
2026-03-30 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_a42f31e02e11a5ab63e684b489cc437c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_a5a31d93970aa95a6ddc208ce9112558.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a2bc55-e87d-5f56-b5c5-516650124ea0 with identifier: HN97244
2026-03-30 10:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a2bc55-e87d-5f56-b5c5-516650124ea0 with scrape type 1
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96a2bc55-e87d-5f56-b5c5-516650124ea0
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_01cd3305846ae0e4683bccef890b0399.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_01cd3305846ae0e4683bccef890b0399.jpg not downloaded yet
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_9d7ed4df4edd9b568809e297bbb3f5c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_9d7ed4df4edd9b568809e297bbb3f5c2.jpg not downloaded yet
2026-03-30 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_bbfbe6b51ea61b4dbdba957dfe686290.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_cd23d27759adb68e2267dfe830df4012.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_104d0f927ffa8a33bf23db4977e0abe1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_104d0f927ffa8a33bf23db4977e0abe1.jpg not downloaded yet
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_71c55ea639fd9688ce681734eda49260.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_71c55ea639fd9688ce681734eda49260.jpg not downloaded yet
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_bc11e944b4934f4c54fb93c6d72994da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_bc11e944b4934f4c54fb93c6d72994da.jpg not downloaded yet
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_5ebd8b6466ce84298daffd6aa925d8f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_5ebd8b6466ce84298daffd6aa925d8f4.jpg not downloaded yet
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41c5150>
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_a42f31e02e11a5ab63e684b489cc437c.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_a42f31e02e11a5ab63e684b489cc437c.jpg saved to cache
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7a20d77-beb6-5943-864b-24480fa9b17d
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefc9cd0>
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_a5a31d93970aa95a6ddc208ce9112558.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_a5a31d93970aa95a6ddc208ce9112558.jpg saved to cache
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7a20d77-beb6-5943-864b-24480fa9b17d
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_0e753c50e0439b3ff12953e776668278.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_0e753c50e0439b3ff12953e776668278.jpg not downloaded yet
2026-03-30 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_01cd3305846ae0e4683bccef890b0399.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_9d7ed4df4edd9b568809e297bbb3f5c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_daa6561e4d57bd9c72225c33b630cd1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_daa6561e4d57bd9c72225c33b630cd1a.jpg not downloaded yet
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_f006c001bfbda8458ead51ba45a7d749.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_f006c001bfbda8458ead51ba45a7d749.jpg not downloaded yet
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefe2750>
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_bbfbe6b51ea61b4dbdba957dfe686290.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_bbfbe6b51ea61b4dbdba957dfe686290.jpg saved to cache
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7a20d77-beb6-5943-864b-24480fa9b17d
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee759d0>
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F3e%252Fa93e18c32db322c7f00931fc14054af1%252Fpa%252FNX05190_cd23d27759adb68e2267dfe830df4012.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_cd23d27759adb68e2267dfe830df4012.jpg saved to cache
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7a20d77-beb6-5943-864b-24480fa9b17d
2026-03-30 10:35:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7a20d77-beb6-5943-864b-24480fa9b17d, skipping ID generation
2026-03-30 10:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7a20d77-beb6-5943-864b-24480fa9b17d with scrape type 1
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7a20d77-beb6-5943-864b-24480fa9b17d sending to next pipeline
2026-03-30 10:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7a20d77-beb6-5943-864b-24480fa9b17d, identifier: NX05190
2026-03-30 10:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7a20d77-beb6-5943-864b-24480fa9b17d with identifier: NX05190
2026-03-30 10:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7a20d77-beb6-5943-864b-24480fa9b17d with identifier: NX05190
2026-03-30 10:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7a20d77-beb6-5943-864b-24480fa9b17d with identifier: NX05190 to the API
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_cd23d27759adb68e2267dfe830df4012.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:18:34Z',
 'fuel_type': 'petrol',
 'id': 'd7a20d77-beb6-5943-864b-24480fa9b17d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX05190',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 72055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_bbfbe6b51ea61b4dbdba957dfe686290.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_cd23d27759adb68e2267dfe830df4012.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_a42f31e02e11a5ab63e684b489cc437c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_a5a31d93970aa95a6ddc208ce9112558.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_0dc5098346092409363d560b3cbf7f30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_8208c59fe2ae87f0ca43affa6e95ddcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_bf95bc0cabad7a32c3502889136b8a99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_a8258b0069e5796734b233b7abf84ec4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_094f6f48f9f76dde4fe90dc3f4c27165.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a20d77-beb6-5943-864b-24480fa9b17d/d7a20d77-beb6-5943-864b-24480fa9b17d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/3e/a93e18c32db322c7f00931fc14054af1/pa/NX05190_bf1d569a6b9083c5f75944fec1ae655c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
 'transmission': 'automatic',
 'trim': 'GTI Clubsport',
 'year': 2021}
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX05190%27 HTTP/1.1" 200 None
2026-03-30 10:35:50 [auto1.de] INFO: Saving data for NX05190: {'created_time': 1774866950.180593, 'last_price_update_time': 1774866950.180602, 'auction_closing_time': 1774970314.0}
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX05190') HTTP/1.1" 204 0
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_68546e084cbfb911b01b0bb0832d9b09.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_68546e084cbfb911b01b0bb0832d9b09.jpg not downloaded yet
2026-03-30 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_bc11e944b4934f4c54fb93c6d72994da.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_5ebd8b6466ce84298daffd6aa925d8f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419cc50>
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_01cd3305846ae0e4683bccef890b0399.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_01cd3305846ae0e4683bccef890b0399.jpg saved to cache
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96a2bc55-e87d-5f56-b5c5-516650124ea0
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee02c10>
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_9d7ed4df4edd9b568809e297bbb3f5c2.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_9d7ed4df4edd9b568809e297bbb3f5c2.jpg saved to cache
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96a2bc55-e87d-5f56-b5c5-516650124ea0
2026-03-30 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LC24532/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41665d0>
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_bc11e944b4934f4c54fb93c6d72994da.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_bc11e944b4934f4c54fb93c6d72994da.jpg saved to cache
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96a2bc55-e87d-5f56-b5c5-516650124ea0
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d9950>
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_5ebd8b6466ce84298daffd6aa925d8f4.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_5ebd8b6466ce84298daffd6aa925d8f4.jpg saved to cache
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96a2bc55-e87d-5f56-b5c5-516650124ea0
2026-03-30 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_daa6561e4d57bd9c72225c33b630cd1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_f006c001bfbda8458ead51ba45a7d749.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_68546e084cbfb911b01b0bb0832d9b09.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_71c55ea639fd9688ce681734eda49260.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_0e753c50e0439b3ff12953e776668278.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_104d0f927ffa8a33bf23db4977e0abe1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec6890>
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_daa6561e4d57bd9c72225c33b630cd1a.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_daa6561e4d57bd9c72225c33b630cd1a.jpg saved to cache
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96a2bc55-e87d-5f56-b5c5-516650124ea0
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42578d0>
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_f006c001bfbda8458ead51ba45a7d749.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_f006c001bfbda8458ead51ba45a7d749.jpg saved to cache
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96a2bc55-e87d-5f56-b5c5-516650124ea0
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419c650>
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_68546e084cbfb911b01b0bb0832d9b09.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_68546e084cbfb911b01b0bb0832d9b09.jpg saved to cache
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96a2bc55-e87d-5f56-b5c5-516650124ea0
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f2c10>
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_71c55ea639fd9688ce681734eda49260.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_71c55ea639fd9688ce681734eda49260.jpg saved to cache
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96a2bc55-e87d-5f56-b5c5-516650124ea0
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a0ad0>
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_0e753c50e0439b3ff12953e776668278.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_0e753c50e0439b3ff12953e776668278.jpg saved to cache
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96a2bc55-e87d-5f56-b5c5-516650124ea0
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e3850>
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F7e%252F967e86cebbfadf727748ecc450dc9890%252Fpa%252FHN97244_104d0f927ffa8a33bf23db4977e0abe1.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_104d0f927ffa8a33bf23db4977e0abe1.jpg saved to cache
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96a2bc55-e87d-5f56-b5c5-516650124ea0
2026-03-30 10:35:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96a2bc55-e87d-5f56-b5c5-516650124ea0, skipping ID generation
2026-03-30 10:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a2bc55-e87d-5f56-b5c5-516650124ea0 with scrape type 1
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96a2bc55-e87d-5f56-b5c5-516650124ea0 sending to next pipeline
2026-03-30 10:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96a2bc55-e87d-5f56-b5c5-516650124ea0, identifier: HN97244
2026-03-30 10:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96a2bc55-e87d-5f56-b5c5-516650124ea0 with identifier: HN97244
2026-03-30 10:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96a2bc55-e87d-5f56-b5c5-516650124ea0 with identifier: HN97244
2026-03-30 10:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96a2bc55-e87d-5f56-b5c5-516650124ea0 with identifier: HN97244 to the API
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_104d0f927ffa8a33bf23db4977e0abe1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:00:59Z',
 'fuel_type': 'diesel',
 'id': '96a2bc55-e87d-5f56-b5c5-516650124ea0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN97244',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 176763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_01cd3305846ae0e4683bccef890b0399.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_9d7ed4df4edd9b568809e297bbb3f5c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_104d0f927ffa8a33bf23db4977e0abe1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_71c55ea639fd9688ce681734eda49260.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_bc11e944b4934f4c54fb93c6d72994da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_5ebd8b6466ce84298daffd6aa925d8f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_0e753c50e0439b3ff12953e776668278.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_daa6561e4d57bd9c72225c33b630cd1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_f006c001bfbda8458ead51ba45a7d749.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a2bc55-e87d-5f56-b5c5-516650124ea0/96a2bc55-e87d-5f56-b5c5-516650124ea0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e86cebbfadf727748ecc450dc9890/pa/HN97244_68546e084cbfb911b01b0bb0832d9b09.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro S line Sportpaket plus',
 'transmission': 'automatic',
 'trim': 'quattro S line Sportpaket plus',
 'year': 2013}
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN97244%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [auto1.de] INFO: Saving data for HN97244: {'created_time': 1774866951.31793, 'last_price_update_time': 1774866951.31794, 'auction_closing_time': 1774969259.0}
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN97244') HTTP/1.1" 204 0
2026-03-30 10:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH80163> (referer: https://www.auto1.com/v1/car-details-view/PH80163/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ec1b701-1984-5c93-a7c1-950ded8be972 with identifier: PH80163
2026-03-30 10:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ec1b701-1984-5c93-a7c1-950ded8be972 with scrape type 1
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ec1b701-1984-5c93-a7c1-950ded8be972
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_b746985a5a874b3ed762dfa4d94ec83d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_b746985a5a874b3ed762dfa4d94ec83d.jpg not downloaded yet
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_65f7b342f0e13631e2d75a896724d930.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_65f7b342f0e13631e2d75a896724d930.jpg not downloaded yet
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_d848ad451d805d57768962d99cd65fa7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_d848ad451d805d57768962d99cd65fa7.jpg not downloaded yet
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_5e0335d143da7153cda7eab0df9e9441.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_5e0335d143da7153cda7eab0df9e9441.jpg not downloaded yet
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_2b432e176c61821a27ba0591fbb7c663.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_2b432e176c61821a27ba0591fbb7c663.jpg not downloaded yet
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_e541187bfdf3ae44a11eca04172b79b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_e541187bfdf3ae44a11eca04172b79b2.jpg not downloaded yet
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_1b9f9f215c50cee6d32583fa2b8cbee5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_1b9f9f215c50cee6d32583fa2b8cbee5.jpg not downloaded yet
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_41210dd6e5f357d06f467e1e86202f34.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_41210dd6e5f357d06f467e1e86202f34.jpg not downloaded yet
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_1d76c0ebbee686d34ec35e60a207a33e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_1d76c0ebbee686d34ec35e60a207a33e.jpg not downloaded yet
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_d0cf86db97531e679eb36d7a36a545de.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_d0cf86db97531e679eb36d7a36a545de.jpg not downloaded yet
2026-03-30 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC48113> (referer: https://www.auto1.com/v1/car-details-view/GC48113/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_d0cf86db97531e679eb36d7a36a545de.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cf06c10-9388-5d44-876c-447727ae62e8 with identifier: GC48113
2026-03-30 10:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cf06c10-9388-5d44-876c-447727ae62e8 with scrape type 1
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1cf06c10-9388-5d44-876c-447727ae62e8
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_c285a14537d899ddd6e8e3dedf34249f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_c285a14537d899ddd6e8e3dedf34249f.jpg not downloaded yet
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_17d5c95fae9e70a59d29c2965c8fb9d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_17d5c95fae9e70a59d29c2965c8fb9d5.jpg not downloaded yet
2026-03-30 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_1d76c0ebbee686d34ec35e60a207a33e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_3f9c09ff0d3b6a1dc08550f370d105c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_3f9c09ff0d3b6a1dc08550f370d105c8.jpg not downloaded yet
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_10649d3e4c14732603dc41c1d63c1ae0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_10649d3e4c14732603dc41c1d63c1ae0.jpg not downloaded yet
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f433c250>
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_d0cf86db97531e679eb36d7a36a545de.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_d0cf86db97531e679eb36d7a36a545de.jpg saved to cache
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ec1b701-1984-5c93-a7c1-950ded8be972
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_cabe0f7fee5a28bbf0ac57171e6bb60a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_cabe0f7fee5a28bbf0ac57171e6bb60a.jpg not downloaded yet
2026-03-30 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_c285a14537d899ddd6e8e3dedf34249f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_0fa2390706306816784eb06dac0525d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_0fa2390706306816784eb06dac0525d9.jpg not downloaded yet
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_6dd87ed2885557bda449337fc8ae4336.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_6dd87ed2885557bda449337fc8ae4336.jpg not downloaded yet
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419be90>
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_1d76c0ebbee686d34ec35e60a207a33e.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_1d76c0ebbee686d34ec35e60a207a33e.jpg saved to cache
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ec1b701-1984-5c93-a7c1-950ded8be972
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_f7d59090a751362038785348ac4039ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_f7d59090a751362038785348ac4039ab.jpg not downloaded yet
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_c09e299ac613e84de7500e55c8b9c0d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_c09e299ac613e84de7500e55c8b9c0d3.jpg not downloaded yet
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_30eecbd0c29b247dcf42349fda02a383.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_30eecbd0c29b247dcf42349fda02a383.jpg not downloaded yet
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb7650>
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_c285a14537d899ddd6e8e3dedf34249f.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_c285a14537d899ddd6e8e3dedf34249f.jpg saved to cache
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1cf06c10-9388-5d44-876c-447727ae62e8
2026-03-30 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_10649d3e4c14732603dc41c1d63c1ae0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_30eecbd0c29b247dcf42349fda02a383.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY84465> (referer: https://www.auto1.com/v1/car-details-view/UY84465/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42291d0>
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_10649d3e4c14732603dc41c1d63c1ae0.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_10649d3e4c14732603dc41c1d63c1ae0.jpg saved to cache
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1cf06c10-9388-5d44-876c-447727ae62e8
2026-03-30 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_c09e299ac613e84de7500e55c8b9c0d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD39449> (referer: https://www.auto1.com/v1/car-details-view/RD39449/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefc9d90>
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_30eecbd0c29b247dcf42349fda02a383.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_30eecbd0c29b247dcf42349fda02a383.jpg saved to cache
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1cf06c10-9388-5d44-876c-447727ae62e8
2026-03-30 10:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0461d832-123e-5998-a843-30516fbbd8a1 with identifier: UY84465
2026-03-30 10:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0461d832-123e-5998-a843-30516fbbd8a1 with scrape type 1
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0461d832-123e-5998-a843-30516fbbd8a1
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_3644dd0c1b9f0fc9d053d57a4c009dae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_3644dd0c1b9f0fc9d053d57a4c009dae.jpg not downloaded yet
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_f48f2652b97f78ca5e4f03ab71638cb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_f48f2652b97f78ca5e4f03ab71638cb2.jpg not downloaded yet
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_379b44434acec9cec6d6c0f4aa7ab626.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_379b44434acec9cec6d6c0f4aa7ab626.jpg not downloaded yet
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_7c93e23a16645394e7c19fa7809bc59f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_7c93e23a16645394e7c19fa7809bc59f.jpg not downloaded yet
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424fa50>
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_c09e299ac613e84de7500e55c8b9c0d3.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_c09e299ac613e84de7500e55c8b9c0d3.jpg saved to cache
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1cf06c10-9388-5d44-876c-447727ae62e8
2026-03-30 10:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e431bcf9-1d41-5dfa-aa92-01a06e70e91a with identifier: RD39449
2026-03-30 10:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e431bcf9-1d41-5dfa-aa92-01a06e70e91a with scrape type 1
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e431bcf9-1d41-5dfa-aa92-01a06e70e91a
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_bd44f3db6e4beeb48e7aacbea774df9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_bd44f3db6e4beeb48e7aacbea774df9f.jpg not downloaded yet
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_52ae060fe7fee391dca92a8b2095f1f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_52ae060fe7fee391dca92a8b2095f1f9.jpg not downloaded yet
2026-03-30 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_6dd87ed2885557bda449337fc8ae4336.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_f7d59090a751362038785348ac4039ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_0fa2390706306816784eb06dac0525d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_815678e1b867d341fcd412576b516029.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_815678e1b867d341fcd412576b516029.jpg not downloaded yet
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_ea0061f5c8a51ac1f4d2fa8200f66ec3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_ea0061f5c8a51ac1f4d2fa8200f66ec3.jpg not downloaded yet
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_036d55dc6de4bf48eca36973a231256f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_036d55dc6de4bf48eca36973a231256f.jpg not downloaded yet
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_338262381a1457e90d51ed1da02dd1c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_338262381a1457e90d51ed1da02dd1c8.jpg not downloaded yet
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_3cbab227cfc22d04f7c130aaff679be3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_3cbab227cfc22d04f7c130aaff679be3.jpg not downloaded yet
2026-03-30 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_7c93e23a16645394e7c19fa7809bc59f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_e73c694213de255716e079659d8c5edc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_e73c694213de255716e079659d8c5edc.jpg not downloaded yet
2026-03-30 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_bd44f3db6e4beeb48e7aacbea774df9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_379b44434acec9cec6d6c0f4aa7ab626.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_ac44e491fe58a6971294383738f53ed0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_ac44e491fe58a6971294383738f53ed0.jpg not downloaded yet
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_357b9980dcde28f1732d5a18a8c99a12.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_357b9980dcde28f1732d5a18a8c99a12.jpg not downloaded yet
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4338e90>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_6dd87ed2885557bda449337fc8ae4336.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_6dd87ed2885557bda449337fc8ae4336.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1cf06c10-9388-5d44-876c-447727ae62e8
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f425acd0>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_f7d59090a751362038785348ac4039ab.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_f7d59090a751362038785348ac4039ab.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1cf06c10-9388-5d44-876c-447727ae62e8
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeebad90>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_0fa2390706306816784eb06dac0525d9.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_0fa2390706306816784eb06dac0525d9.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1cf06c10-9388-5d44-876c-447727ae62e8
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_3dff5c4ffe5828f6fc6bc27e4eca74c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_3dff5c4ffe5828f6fc6bc27e4eca74c5.jpg not downloaded yet
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_338262381a1457e90d51ed1da02dd1c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_b26315489c12e4f695eda6ebf3e67b16.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_b26315489c12e4f695eda6ebf3e67b16.jpg not downloaded yet
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_49ccfa2995a1e159b536f225edf3959b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_49ccfa2995a1e159b536f225edf3959b.jpg not downloaded yet
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_315166dbbf5f32bddabcef27da3a265c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_315166dbbf5f32bddabcef27da3a265c.jpg not downloaded yet
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef63a10>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_7c93e23a16645394e7c19fa7809bc59f.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_7c93e23a16645394e7c19fa7809bc59f.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0461d832-123e-5998-a843-30516fbbd8a1
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41999d0>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_bd44f3db6e4beeb48e7aacbea774df9f.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_bd44f3db6e4beeb48e7aacbea774df9f.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e431bcf9-1d41-5dfa-aa92-01a06e70e91a
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef60bd0>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_379b44434acec9cec6d6c0f4aa7ab626.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_379b44434acec9cec6d6c0f4aa7ab626.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0461d832-123e-5998-a843-30516fbbd8a1
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_3cbab227cfc22d04f7c130aaff679be3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_654bc4ce463e16ff040ef9fa31bbff82.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_654bc4ce463e16ff040ef9fa31bbff82.jpg not downloaded yet
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_357b9980dcde28f1732d5a18a8c99a12.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_036d55dc6de4bf48eca36973a231256f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NJ28052/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_e7110a703a4aef61f1612b269ff2708d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_e7110a703a4aef61f1612b269ff2708d.jpg not downloaded yet
2026-03-30 10:35:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef37ad0>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_338262381a1457e90d51ed1da02dd1c8.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_338262381a1457e90d51ed1da02dd1c8.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0461d832-123e-5998-a843-30516fbbd8a1
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42b58d0>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_3cbab227cfc22d04f7c130aaff679be3.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_3cbab227cfc22d04f7c130aaff679be3.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e431bcf9-1d41-5dfa-aa92-01a06e70e91a
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_b26315489c12e4f695eda6ebf3e67b16.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3aed0>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_357b9980dcde28f1732d5a18a8c99a12.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_357b9980dcde28f1732d5a18a8c99a12.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0461d832-123e-5998-a843-30516fbbd8a1
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4256290>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_036d55dc6de4bf48eca36973a231256f.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_036d55dc6de4bf48eca36973a231256f.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e431bcf9-1d41-5dfa-aa92-01a06e70e91a
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_315166dbbf5f32bddabcef27da3a265c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42540d0>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_b26315489c12e4f695eda6ebf3e67b16.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_b26315489c12e4f695eda6ebf3e67b16.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0461d832-123e-5998-a843-30516fbbd8a1
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_654bc4ce463e16ff040ef9fa31bbff82.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_49ccfa2995a1e159b536f225edf3959b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee82ed0>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_315166dbbf5f32bddabcef27da3a265c.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_315166dbbf5f32bddabcef27da3a265c.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e431bcf9-1d41-5dfa-aa92-01a06e70e91a
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419e610>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_654bc4ce463e16ff040ef9fa31bbff82.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_654bc4ce463e16ff040ef9fa31bbff82.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e431bcf9-1d41-5dfa-aa92-01a06e70e91a
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4175c90>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_49ccfa2995a1e159b536f225edf3959b.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_49ccfa2995a1e159b536f225edf3959b.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e431bcf9-1d41-5dfa-aa92-01a06e70e91a
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_e7110a703a4aef61f1612b269ff2708d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_ac44e491fe58a6971294383738f53ed0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_3dff5c4ffe5828f6fc6bc27e4eca74c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_ea0061f5c8a51ac1f4d2fa8200f66ec3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_e73c694213de255716e079659d8c5edc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee440b90>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_e7110a703a4aef61f1612b269ff2708d.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_e7110a703a4aef61f1612b269ff2708d.jpg saved to cache
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e431bcf9-1d41-5dfa-aa92-01a06e70e91a
2026-03-30 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_52ae060fe7fee391dca92a8b2095f1f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec1090>
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_ac44e491fe58a6971294383738f53ed0.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_ac44e491fe58a6971294383738f53ed0.jpg saved to cache
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e431bcf9-1d41-5dfa-aa92-01a06e70e91a
2026-03-30 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_f48f2652b97f78ca5e4f03ab71638cb2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f426b590>
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_3dff5c4ffe5828f6fc6bc27e4eca74c5.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_3dff5c4ffe5828f6fc6bc27e4eca74c5.jpg saved to cache
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e431bcf9-1d41-5dfa-aa92-01a06e70e91a
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58d31d0>
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_ea0061f5c8a51ac1f4d2fa8200f66ec3.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_ea0061f5c8a51ac1f4d2fa8200f66ec3.jpg saved to cache
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0461d832-123e-5998-a843-30516fbbd8a1
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d9890>
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_e73c694213de255716e079659d8c5edc.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_e73c694213de255716e079659d8c5edc.jpg saved to cache
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0461d832-123e-5998-a843-30516fbbd8a1
2026-03-30 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_815678e1b867d341fcd412576b516029.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_3644dd0c1b9f0fc9d053d57a4c009dae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4228950>
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_52ae060fe7fee391dca92a8b2095f1f9.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_52ae060fe7fee391dca92a8b2095f1f9.jpg saved to cache
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0461d832-123e-5998-a843-30516fbbd8a1
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4255f50>
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_f48f2652b97f78ca5e4f03ab71638cb2.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_f48f2652b97f78ca5e4f03ab71638cb2.jpg saved to cache
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0461d832-123e-5998-a843-30516fbbd8a1
2026-03-30 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_17d5c95fae9e70a59d29c2965c8fb9d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_cabe0f7fee5a28bbf0ac57171e6bb60a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f436db90>
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F81%252Fbc816682891d8d956b8a429281e7d286%252Fpa%252FRD39449_815678e1b867d341fcd412576b516029.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_815678e1b867d341fcd412576b516029.jpg saved to cache
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e431bcf9-1d41-5dfa-aa92-01a06e70e91a
2026-03-30 10:35:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e431bcf9-1d41-5dfa-aa92-01a06e70e91a, skipping ID generation
2026-03-30 10:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e431bcf9-1d41-5dfa-aa92-01a06e70e91a with scrape type 1
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e431bcf9-1d41-5dfa-aa92-01a06e70e91a sending to next pipeline
2026-03-30 10:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e431bcf9-1d41-5dfa-aa92-01a06e70e91a, identifier: RD39449
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeebe250>
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F7d%252Fc27dd2817a9bbb0a035af3e53bd3dd0d%252Fpa%252FUY84465_3644dd0c1b9f0fc9d053d57a4c009dae.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_3644dd0c1b9f0fc9d053d57a4c009dae.jpg saved to cache
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0461d832-123e-5998-a843-30516fbbd8a1
2026-03-30 10:35:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0461d832-123e-5998-a843-30516fbbd8a1, skipping ID generation
2026-03-30 10:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0461d832-123e-5998-a843-30516fbbd8a1 with scrape type 1
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0461d832-123e-5998-a843-30516fbbd8a1 sending to next pipeline
2026-03-30 10:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0461d832-123e-5998-a843-30516fbbd8a1, identifier: UY84465
2026-03-30 10:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e431bcf9-1d41-5dfa-aa92-01a06e70e91a with identifier: RD39449
2026-03-30 10:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e431bcf9-1d41-5dfa-aa92-01a06e70e91a with identifier: RD39449
2026-03-30 10:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e431bcf9-1d41-5dfa-aa92-01a06e70e91a with identifier: RD39449 to the API
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_815678e1b867d341fcd412576b516029.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:20:44Z',
 'fuel_type': 'petrol',
 'id': 'e431bcf9-1d41-5dfa-aa92-01a06e70e91a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD39449',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 25497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_bd44f3db6e4beeb48e7aacbea774df9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_815678e1b867d341fcd412576b516029.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_036d55dc6de4bf48eca36973a231256f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_3cbab227cfc22d04f7c130aaff679be3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_ac44e491fe58a6971294383738f53ed0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_3dff5c4ffe5828f6fc6bc27e4eca74c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_49ccfa2995a1e159b536f225edf3959b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_315166dbbf5f32bddabcef27da3a265c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_654bc4ce463e16ff040ef9fa31bbff82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e431bcf9-1d41-5dfa-aa92-01a06e70e91a/e431bcf9-1d41-5dfa-aa92-01a06e70e91a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/81/bc816682891d8d956b8a429281e7d286/pa/RD39449_e7110a703a4aef61f1612b269ff2708d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake Mild-Hybrid AMG '
          'Line Edition',
 'transmission': 'automatic',
 'trim': 'AMG Line Edition',
 'year': 2024}
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD39449%27 HTTP/1.1" 200 None
2026-03-30 10:35:56 [auto1.de] INFO: Saving data for RD39449: {'created_time': 1774866956.20593, 'last_price_update_time': 1774866956.20594, 'auction_closing_time': 1774970444.0}
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD39449') HTTP/1.1" 204 0
2026-03-30 10:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0461d832-123e-5998-a843-30516fbbd8a1 with identifier: UY84465
2026-03-30 10:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0461d832-123e-5998-a843-30516fbbd8a1 with identifier: UY84465
2026-03-30 10:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0461d832-123e-5998-a843-30516fbbd8a1 with identifier: UY84465 to the API
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_3644dd0c1b9f0fc9d053d57a4c009dae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 194,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 286,
 'expiration_date': '2026-03-31T15:01:24Z',
 'fuel_type': 'diesel',
 'id': '0461d832-123e-5998-a843-30516fbbd8a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY84465',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 89847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_3644dd0c1b9f0fc9d053d57a4c009dae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_f48f2652b97f78ca5e4f03ab71638cb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_379b44434acec9cec6d6c0f4aa7ab626.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_7c93e23a16645394e7c19fa7809bc59f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_52ae060fe7fee391dca92a8b2095f1f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_ea0061f5c8a51ac1f4d2fa8200f66ec3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_338262381a1457e90d51ed1da02dd1c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_e73c694213de255716e079659d8c5edc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_357b9980dcde28f1732d5a18a8c99a12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0461d832-123e-5998-a843-30516fbbd8a1/0461d832-123e-5998-a843-30516fbbd8a1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/7d/c27dd2817a9bbb0a035af3e53bd3dd0d/pa/UY84465_b26315489c12e4f695eda6ebf3e67b16.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 50 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY84465%27 HTTP/1.1" 200 None
2026-03-30 10:35:56 [auto1.de] INFO: Saving data for UY84465: {'created_time': 1774866956.661422, 'last_price_update_time': 1774866956.661436, 'auction_closing_time': 1774969284.0}
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY84465') HTTP/1.1" 204 0
2026-03-30 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_1b9f9f215c50cee6d32583fa2b8cbee5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_3f9c09ff0d3b6a1dc08550f370d105c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL20723> (referer: https://www.auto1.com/v1/car-details-view/AL20723/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU07976> (referer: https://www.auto1.com/v1/car-details-view/AU07976/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_41210dd6e5f357d06f467e1e86202f34.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419dcd0>
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_17d5c95fae9e70a59d29c2965c8fb9d5.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_17d5c95fae9e70a59d29c2965c8fb9d5.jpg saved to cache
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1cf06c10-9388-5d44-876c-447727ae62e8
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f436fe10>
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_cabe0f7fee5a28bbf0ac57171e6bb60a.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_cabe0f7fee5a28bbf0ac57171e6bb60a.jpg saved to cache
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1cf06c10-9388-5d44-876c-447727ae62e8
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee441150>
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_1b9f9f215c50cee6d32583fa2b8cbee5.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_1b9f9f215c50cee6d32583fa2b8cbee5.jpg saved to cache
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ec1b701-1984-5c93-a7c1-950ded8be972
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42b7650>
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F4b%252F9b4b6a8029e9a6c7b51177e15ea90bea%252Fpa%252FGC48113_3f9c09ff0d3b6a1dc08550f370d105c8.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_3f9c09ff0d3b6a1dc08550f370d105c8.jpg saved to cache
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1cf06c10-9388-5d44-876c-447727ae62e8
2026-03-30 10:35:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1cf06c10-9388-5d44-876c-447727ae62e8, skipping ID generation
2026-03-30 10:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cf06c10-9388-5d44-876c-447727ae62e8 with scrape type 1
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1cf06c10-9388-5d44-876c-447727ae62e8 sending to next pipeline
2026-03-30 10:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cf06c10-9388-5d44-876c-447727ae62e8, identifier: GC48113
2026-03-30 10:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cf06c10-9388-5d44-876c-447727ae62e8 with identifier: GC48113
2026-03-30 10:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cf06c10-9388-5d44-876c-447727ae62e8 with identifier: GC48113
2026-03-30 10:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cf06c10-9388-5d44-876c-447727ae62e8 with identifier: GC48113 to the API
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_3f9c09ff0d3b6a1dc08550f370d105c8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2026-03-31T15:10:41Z',
 'fuel_type': 'diesel',
 'id': '1cf06c10-9388-5d44-876c-447727ae62e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC48113',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 50337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_c285a14537d899ddd6e8e3dedf34249f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_17d5c95fae9e70a59d29c2965c8fb9d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_3f9c09ff0d3b6a1dc08550f370d105c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_10649d3e4c14732603dc41c1d63c1ae0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_cabe0f7fee5a28bbf0ac57171e6bb60a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_0fa2390706306816784eb06dac0525d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_6dd87ed2885557bda449337fc8ae4336.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_f7d59090a751362038785348ac4039ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_c09e299ac613e84de7500e55c8b9c0d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cf06c10-9388-5d44-876c-447727ae62e8/1cf06c10-9388-5d44-876c-447727ae62e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/4b/9b4b6a8029e9a6c7b51177e15ea90bea/pa/GC48113_30eecbd0c29b247dcf42349fda02a383.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC48113%27 HTTP/1.1" 200 None
2026-03-30 10:35:57 [auto1.de] INFO: Saving data for GC48113: {'created_time': 1774866957.425251, 'last_price_update_time': 1774866957.425262, 'auction_closing_time': 1774969841.0}
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC48113') HTTP/1.1" 204 0
2026-03-30 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_65f7b342f0e13631e2d75a896724d930.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_5e0335d143da7153cda7eab0df9e9441.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_d848ad451d805d57768962d99cd65fa7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_e541187bfdf3ae44a11eca04172b79b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_2b432e176c61821a27ba0591fbb7c663.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 436283f3-df71-53be-a598-f46afd14de90 with identifier: AL20723
2026-03-30 10:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 436283f3-df71-53be-a598-f46afd14de90 with scrape type 1
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 436283f3-df71-53be-a598-f46afd14de90
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_526932de6aec67d1307e8e25eb0f92dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_526932de6aec67d1307e8e25eb0f92dc.jpg not downloaded yet
2026-03-30 10:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb660feb-3758-58c4-920a-309b7fc468ba with identifier: AU07976
2026-03-30 10:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb660feb-3758-58c4-920a-309b7fc468ba with scrape type 1
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb660feb-3758-58c4-920a-309b7fc468ba
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_4e1ed02931af2409b6c94ec2aaeb6173.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_4e1ed02931af2409b6c94ec2aaeb6173.jpg not downloaded yet
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee55b90>
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_41210dd6e5f357d06f467e1e86202f34.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_41210dd6e5f357d06f467e1e86202f34.jpg saved to cache
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ec1b701-1984-5c93-a7c1-950ded8be972
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_5d818288987bf7f6c3300564a25ea52c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_5d818288987bf7f6c3300564a25ea52c.jpg not downloaded yet
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_13970f46e074b6857f98d0e234701561.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_13970f46e074b6857f98d0e234701561.jpg not downloaded yet
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee3f2d0>
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_65f7b342f0e13631e2d75a896724d930.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_65f7b342f0e13631e2d75a896724d930.jpg saved to cache
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ec1b701-1984-5c93-a7c1-950ded8be972
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee12490>
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_5e0335d143da7153cda7eab0df9e9441.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_5e0335d143da7153cda7eab0df9e9441.jpg saved to cache
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ec1b701-1984-5c93-a7c1-950ded8be972
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee10690>
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_d848ad451d805d57768962d99cd65fa7.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_d848ad451d805d57768962d99cd65fa7.jpg saved to cache
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ec1b701-1984-5c93-a7c1-950ded8be972
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c02c50>
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_e541187bfdf3ae44a11eca04172b79b2.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_e541187bfdf3ae44a11eca04172b79b2.jpg saved to cache
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ec1b701-1984-5c93-a7c1-950ded8be972
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f432b690>
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_2b432e176c61821a27ba0591fbb7c663.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_2b432e176c61821a27ba0591fbb7c663.jpg saved to cache
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ec1b701-1984-5c93-a7c1-950ded8be972
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_6e25f6ae0291c2beb8b8cdc2a86067d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_6e25f6ae0291c2beb8b8cdc2a86067d0.jpg not downloaded yet
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_4a59548bb18d4d0137f9876c26dceafe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_4a59548bb18d4d0137f9876c26dceafe.jpg not downloaded yet
2026-03-30 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_b746985a5a874b3ed762dfa4d94ec83d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_db61060226eb670615ffecaae19485bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_db61060226eb670615ffecaae19485bc.jpg not downloaded yet
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_3f6098ed45fdb0127b95eb9623e48a93.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_3f6098ed45fdb0127b95eb9623e48a93.jpg not downloaded yet
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_e3c381edee82b0e358f122fa5e19089f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_e3c381edee82b0e358f122fa5e19089f.jpg not downloaded yet
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_87aa1105e4dab56beab71c64dbac5dcb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_87aa1105e4dab56beab71c64dbac5dcb.jpg not downloaded yet
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_e2ec25fbeb3f81f84c0af5b49d8b0641.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_e2ec25fbeb3f81f84c0af5b49d8b0641.jpg not downloaded yet
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_f9355fea44bb52558453617781067a6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_f9355fea44bb52558453617781067a6e.jpg not downloaded yet
2026-03-30 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_4a59548bb18d4d0137f9876c26dceafe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_98761bf64c7f9683a95390ba2be7857d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_98761bf64c7f9683a95390ba2be7857d.jpg not downloaded yet
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_5b69c58ff7ebce29a308c7f1fb86dac4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_5b69c58ff7ebce29a308c7f1fb86dac4.jpg not downloaded yet
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c09ed0>
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F26%252F0a26c19882d90993feac2c443e22bdf0%252Fpa%252FPH80163_b746985a5a874b3ed762dfa4d94ec83d.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_b746985a5a874b3ed762dfa4d94ec83d.jpg saved to cache
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ec1b701-1984-5c93-a7c1-950ded8be972
2026-03-30 10:35:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ec1b701-1984-5c93-a7c1-950ded8be972, skipping ID generation
2026-03-30 10:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ec1b701-1984-5c93-a7c1-950ded8be972 with scrape type 1
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ec1b701-1984-5c93-a7c1-950ded8be972 sending to next pipeline
2026-03-30 10:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ec1b701-1984-5c93-a7c1-950ded8be972, identifier: PH80163
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_790e6f4222891dd243e92c630ca4ca33.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_790e6f4222891dd243e92c630ca4ca33.jpg not downloaded yet
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_9696b88e76e5226ef6b635bf1f8d8d49.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_9696b88e76e5226ef6b635bf1f8d8d49.jpg not downloaded yet
2026-03-30 10:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ec1b701-1984-5c93-a7c1-950ded8be972 with identifier: PH80163
2026-03-30 10:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ec1b701-1984-5c93-a7c1-950ded8be972 with identifier: PH80163
2026-03-30 10:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ec1b701-1984-5c93-a7c1-950ded8be972 with identifier: PH80163 to the API
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_b746985a5a874b3ed762dfa4d94ec83d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:41:21Z',
 'fuel_type': 'petrol',
 'id': '8ec1b701-1984-5c93-a7c1-950ded8be972',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH80163',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 122271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_b746985a5a874b3ed762dfa4d94ec83d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_65f7b342f0e13631e2d75a896724d930.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_d848ad451d805d57768962d99cd65fa7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_5e0335d143da7153cda7eab0df9e9441.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_2b432e176c61821a27ba0591fbb7c663.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_e541187bfdf3ae44a11eca04172b79b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_1b9f9f215c50cee6d32583fa2b8cbee5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_41210dd6e5f357d06f467e1e86202f34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_1d76c0ebbee686d34ec35e60a207a33e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec1b701-1984-5c93-a7c1-950ded8be972/8ec1b701-1984-5c93-a7c1-950ded8be972_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/26/0a26c19882d90993feac2c443e22bdf0/pa/PH80163_d0cf86db97531e679eb36d7a36a545de.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Karoq 1.0 TSI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2020}
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH80163%27 HTTP/1.1" 200 None
2026-03-30 10:35:58 [auto1.de] INFO: Saving data for PH80163: {'created_time': 1774866958.769438, 'last_price_update_time': 1774866958.76945, 'auction_closing_time': 1774971681.0}
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH80163') HTTP/1.1" 204 0
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_fa3cfd24f86d8005e561fdef35ec285a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_fa3cfd24f86d8005e561fdef35ec285a.jpg not downloaded yet
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_6c9eb2a2ca1024c77c0db7ca6c03483d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_6c9eb2a2ca1024c77c0db7ca6c03483d.jpg not downloaded yet
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41bcfd0>
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_4a59548bb18d4d0137f9876c26dceafe.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_4a59548bb18d4d0137f9876c26dceafe.jpg saved to cache
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb660feb-3758-58c4-920a-309b7fc468ba
2026-03-30 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XM57589> (referer: https://www.auto1.com/v1/car-details-view/XM57589/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB07030/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HX91404/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_910bc5708b03ae2c851b208f32c77681.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_910bc5708b03ae2c851b208f32c77681.jpg not downloaded yet
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_f877f74227f58a7b820d339c9d8f36b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_f877f74227f58a7b820d339c9d8f36b4.jpg not downloaded yet
2026-03-30 10:35:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_f9355fea44bb52558453617781067a6e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_6c9eb2a2ca1024c77c0db7ca6c03483d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a with identifier: XM57589
2026-03-30 10:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a with scrape type 1
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_9082953b8e30c770a9c1de8390166dfd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_9082953b8e30c770a9c1de8390166dfd.jpg not downloaded yet
2026-03-30 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_9696b88e76e5226ef6b635bf1f8d8d49.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_7f2a5fea3caee30145ba3d214aabbf24.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_7f2a5fea3caee30145ba3d214aabbf24.jpg not downloaded yet
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_880aa79a944dc39183fafc1e0cce7ffd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_880aa79a944dc39183fafc1e0cce7ffd.jpg not downloaded yet
2026-03-30 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_f877f74227f58a7b820d339c9d8f36b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_cff71846c5dc38f0f76cd763216da563.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_cff71846c5dc38f0f76cd763216da563.jpg not downloaded yet
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee03550>
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_f9355fea44bb52558453617781067a6e.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_f9355fea44bb52558453617781067a6e.jpg saved to cache
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb660feb-3758-58c4-920a-309b7fc468ba
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_c5a167e97677855513446eec4e1482e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_c5a167e97677855513446eec4e1482e6.jpg not downloaded yet
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee57150>
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_6c9eb2a2ca1024c77c0db7ca6c03483d.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_6c9eb2a2ca1024c77c0db7ca6c03483d.jpg saved to cache
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb660feb-3758-58c4-920a-309b7fc468ba
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee44ca10>
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_9696b88e76e5226ef6b635bf1f8d8d49.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_9696b88e76e5226ef6b635bf1f8d8d49.jpg saved to cache
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb660feb-3758-58c4-920a-309b7fc468ba
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_6a83b2e52f4186401d2892de833eba6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_6a83b2e52f4186401d2892de833eba6e.jpg not downloaded yet
2026-03-30 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_880aa79a944dc39183fafc1e0cce7ffd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_0baf8e3488012435d22e26b1270b07da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_0baf8e3488012435d22e26b1270b07da.jpg not downloaded yet
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419bbd0>
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_f877f74227f58a7b820d339c9d8f36b4.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_f877f74227f58a7b820d339c9d8f36b4.jpg saved to cache
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb660feb-3758-58c4-920a-309b7fc468ba
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_4184d0751469dc7c82eaabe6b22b3fa0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_4184d0751469dc7c82eaabe6b22b3fa0.jpg not downloaded yet
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_01694a2c22431e0879ed475798a712a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_01694a2c22431e0879ed475798a712a2.jpg not downloaded yet
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_d05a309fc8ccfdff9f3e5af199c1dfb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_d05a309fc8ccfdff9f3e5af199c1dfb9.jpg not downloaded yet
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee443010>
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_880aa79a944dc39183fafc1e0cce7ffd.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_880aa79a944dc39183fafc1e0cce7ffd.jpg saved to cache
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a
2026-03-30 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_790e6f4222891dd243e92c630ca4ca33.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_fa3cfd24f86d8005e561fdef35ec285a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_6a83b2e52f4186401d2892de833eba6e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f2c50>
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_790e6f4222891dd243e92c630ca4ca33.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_790e6f4222891dd243e92c630ca4ca33.jpg saved to cache
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 436283f3-df71-53be-a598-f46afd14de90
2026-03-30 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_d05a309fc8ccfdff9f3e5af199c1dfb9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4291dd0>
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_fa3cfd24f86d8005e561fdef35ec285a.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_fa3cfd24f86d8005e561fdef35ec285a.jpg saved to cache
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 436283f3-df71-53be-a598-f46afd14de90
2026-03-30 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YG35577/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_9082953b8e30c770a9c1de8390166dfd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LC24532> (referer: https://www.auto1.com/v1/car-details-view/LC24532/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee459f10>
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_6a83b2e52f4186401d2892de833eba6e.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_6a83b2e52f4186401d2892de833eba6e.jpg saved to cache
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd5bd0>
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_d05a309fc8ccfdff9f3e5af199c1dfb9.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_d05a309fc8ccfdff9f3e5af199c1dfb9.jpg saved to cache
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a
2026-03-30 10:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_01694a2c22431e0879ed475798a712a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42680d0>
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_9082953b8e30c770a9c1de8390166dfd.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_9082953b8e30c770a9c1de8390166dfd.jpg saved to cache
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a
2026-03-30 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_0baf8e3488012435d22e26b1270b07da.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7067aed-2155-5376-8b01-2627c3d3eb59 with identifier: LC24532
2026-03-30 10:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7067aed-2155-5376-8b01-2627c3d3eb59 with scrape type 1
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c7067aed-2155-5376-8b01-2627c3d3eb59
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_4a1a34aac8c84227300ebff1c335b445.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_4a1a34aac8c84227300ebff1c335b445.jpg not downloaded yet
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea3c50>
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_01694a2c22431e0879ed475798a712a2.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_01694a2c22431e0879ed475798a712a2.jpg saved to cache
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a
2026-03-30 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_4184d0751469dc7c82eaabe6b22b3fa0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_cff71846c5dc38f0f76cd763216da563.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_c5a167e97677855513446eec4e1482e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_36eaa72ffb99fb868853770a79e673d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_36eaa72ffb99fb868853770a79e673d0.jpg not downloaded yet
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_eab56a6211c0a8810a214de2284e0a42.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_eab56a6211c0a8810a214de2284e0a42.jpg not downloaded yet
2026-03-30 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NJ28052> (referer: https://www.auto1.com/v1/car-details-view/NJ28052/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_86e4c9bd8faa96748e3d992ea26a2cdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_86e4c9bd8faa96748e3d992ea26a2cdf.jpg not downloaded yet
2026-03-30 10:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4173d10>
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_0baf8e3488012435d22e26b1270b07da.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_0baf8e3488012435d22e26b1270b07da.jpg saved to cache
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_458f67ee4c5de6a1490af73d6e50fe39.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_458f67ee4c5de6a1490af73d6e50fe39.jpg not downloaded yet
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee00e90>
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_4184d0751469dc7c82eaabe6b22b3fa0.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_4184d0751469dc7c82eaabe6b22b3fa0.jpg saved to cache
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_2964f828edb096cb953d3d835cf621cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_2964f828edb096cb953d3d835cf621cc.jpg not downloaded yet
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f480abd0>
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_cff71846c5dc38f0f76cd763216da563.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_cff71846c5dc38f0f76cd763216da563.jpg saved to cache
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42a95d0>
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_c5a167e97677855513446eec4e1482e6.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_c5a167e97677855513446eec4e1482e6.jpg saved to cache
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_0054df014beeb9ab4d24defbeac3af66.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_0054df014beeb9ab4d24defbeac3af66.jpg not downloaded yet
2026-03-30 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_7f2a5fea3caee30145ba3d214aabbf24.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_c048104dd35d47e7d469af6d3cba6dca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_c048104dd35d47e7d469af6d3cba6dca.jpg not downloaded yet
2026-03-30 10:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4269716-4d6d-5b53-9f34-caeea944a1d9 with identifier: NJ28052
2026-03-30 10:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4269716-4d6d-5b53-9f34-caeea944a1d9 with scrape type 1
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d4269716-4d6d-5b53-9f34-caeea944a1d9
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fdf%252Fbcdf6f2f2e06ac8a2ba0710406ed2e8c%252Fpa%252FNJ28052_3ad7ffc316a9b7c4c7220a92659c361f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_3ad7ffc316a9b7c4c7220a92659c361f.jpg not downloaded yet
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_1b61d6ca667396482685bc4cbafb2374.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_1b61d6ca667396482685bc4cbafb2374.jpg not downloaded yet
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fdf%252Fbcdf6f2f2e06ac8a2ba0710406ed2e8c%252Fpa%252FNJ28052_25890e7487ea04ffd9e346b48c2da315.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_25890e7487ea04ffd9e346b48c2da315.jpg not downloaded yet
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_512263aba3deb5a56fe3a78b98ceda3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_512263aba3deb5a56fe3a78b98ceda3b.jpg not downloaded yet
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fdf%252Fbcdf6f2f2e06ac8a2ba0710406ed2e8c%252Fpa%252FNJ28052_4c3546548d3faeb77bcd4a78f0c7f8a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_4c3546548d3faeb77bcd4a78f0c7f8a2.jpg not downloaded yet
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fdf%252Fbcdf6f2f2e06ac8a2ba0710406ed2e8c%252Fpa%252FNJ28052_244e64391c0fbc7e8c0669f989a446b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_244e64391c0fbc7e8c0669f989a446b3.jpg not downloaded yet
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee440b50>
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F1d%252F6f1d56d8b0dadef5ada5128b6c76a96a%252Fpa%252FXM57589_7f2a5fea3caee30145ba3d214aabbf24.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_7f2a5fea3caee30145ba3d214aabbf24.jpg saved to cache
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a
2026-03-30 10:36:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a, skipping ID generation
2026-03-30 10:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a with scrape type 1
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a sending to next pipeline
2026-03-30 10:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a, identifier: XM57589
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fdf%252Fbcdf6f2f2e06ac8a2ba0710406ed2e8c%252Fpa%252FNJ28052_e19c274671296dd076eb920a02b1f1e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_e19c274671296dd076eb920a02b1f1e4.jpg not downloaded yet
2026-03-30 10:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a with identifier: XM57589
2026-03-30 10:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a with identifier: XM57589
2026-03-30 10:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78dc5ac5-0fff-56ea-94ea-c3d443ccb13a with identifier: XM57589 to the API
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_7f2a5fea3caee30145ba3d214aabbf24.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-31T15:45:21Z',
 'fuel_type': 'petrol',
 'id': '78dc5ac5-0fff-56ea-94ea-c3d443ccb13a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM57589',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 112568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2779807,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_9082953b8e30c770a9c1de8390166dfd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_7f2a5fea3caee30145ba3d214aabbf24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_880aa79a944dc39183fafc1e0cce7ffd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_cff71846c5dc38f0f76cd763216da563.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_c5a167e97677855513446eec4e1482e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_6a83b2e52f4186401d2892de833eba6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_0baf8e3488012435d22e26b1270b07da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_4184d0751469dc7c82eaabe6b22b3fa0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_01694a2c22431e0879ed475798a712a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78dc5ac5-0fff-56ea-94ea-c3d443ccb13a/78dc5ac5-0fff-56ea-94ea-c3d443ccb13a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/1d/6f1d56d8b0dadef5ada5128b6c76a96a/pa/XM57589_d05a309fc8ccfdff9f3e5af199c1dfb9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Sendo 2WD',
 'transmission': 'manual',
 'trim': 'Sendo 2WD',
 'year': 2014}
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM57589%27 HTTP/1.1" 200 None
2026-03-30 10:36:01 [auto1.de] INFO: Saving data for XM57589: {'created_time': 1774866961.255044, 'last_price_update_time': 1774866961.255054, 'auction_closing_time': 1774971921.0}
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM57589') HTTP/1.1" 204 0
2026-03-30 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XP42912/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LD24624/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_910bc5708b03ae2c851b208f32c77681.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_4a1a34aac8c84227300ebff1c335b445.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_eab56a6211c0a8810a214de2284e0a42.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_0054df014beeb9ab4d24defbeac3af66.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_244e64391c0fbc7e8c0669f989a446b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_e19c274671296dd076eb920a02b1f1e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f425bb10>
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_910bc5708b03ae2c851b208f32c77681.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_910bc5708b03ae2c851b208f32c77681.jpg saved to cache
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 436283f3-df71-53be-a598-f46afd14de90
2026-03-30 10:36:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f2390>
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_4a1a34aac8c84227300ebff1c335b445.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_4a1a34aac8c84227300ebff1c335b445.jpg saved to cache
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7067aed-2155-5376-8b01-2627c3d3eb59
2026-03-30 10:36:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45ad90>
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_eab56a6211c0a8810a214de2284e0a42.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_eab56a6211c0a8810a214de2284e0a42.jpg saved to cache
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7067aed-2155-5376-8b01-2627c3d3eb59
2026-03-30 10:36:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea00d0>
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_0054df014beeb9ab4d24defbeac3af66.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_0054df014beeb9ab4d24defbeac3af66.jpg saved to cache
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c7067aed-2155-5376-8b01-2627c3d3eb59
2026-03-30 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD03906/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42b7fd0>
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4269716-4d6d-5b53-9f34-caeea944a1d9/d4269716-4d6d-5b53-9f34-caeea944a1d9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fdf%252Fbcdf6f2f2e06ac8a2ba0710406ed2e8c%252Fpa%252FNJ28052_244e64391c0fbc7e8c0669f989a446b3.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_244e64391c0fbc7e8c0669f989a446b3.jpg saved to cache
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4269716-4d6d-5b53-9f34-caeea944a1d9
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f437bf10>
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4269716-4d6d-5b53-9f34-caeea944a1d9/d4269716-4d6d-5b53-9f34-caeea944a1d9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fdf%252Fbcdf6f2f2e06ac8a2ba0710406ed2e8c%252Fpa%252FNJ28052_e19c274671296dd076eb920a02b1f1e4.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_e19c274671296dd076eb920a02b1f1e4.jpg saved to cache
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4269716-4d6d-5b53-9f34-caeea944a1d9
2026-03-30 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_3ad7ffc316a9b7c4c7220a92659c361f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_4c3546548d3faeb77bcd4a78f0c7f8a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_25890e7487ea04ffd9e346b48c2da315.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417e2d0>
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4269716-4d6d-5b53-9f34-caeea944a1d9/d4269716-4d6d-5b53-9f34-caeea944a1d9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fdf%252Fbcdf6f2f2e06ac8a2ba0710406ed2e8c%252Fpa%252FNJ28052_3ad7ffc316a9b7c4c7220a92659c361f.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_3ad7ffc316a9b7c4c7220a92659c361f.jpg saved to cache
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4269716-4d6d-5b53-9f34-caeea944a1d9
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4397ed0>
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4269716-4d6d-5b53-9f34-caeea944a1d9/d4269716-4d6d-5b53-9f34-caeea944a1d9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fdf%252Fbcdf6f2f2e06ac8a2ba0710406ed2e8c%252Fpa%252FNJ28052_4c3546548d3faeb77bcd4a78f0c7f8a2.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_4c3546548d3faeb77bcd4a78f0c7f8a2.jpg saved to cache
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4269716-4d6d-5b53-9f34-caeea944a1d9
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42b7650>
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4269716-4d6d-5b53-9f34-caeea944a1d9/d4269716-4d6d-5b53-9f34-caeea944a1d9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fdf%252Fbcdf6f2f2e06ac8a2ba0710406ed2e8c%252Fpa%252FNJ28052_25890e7487ea04ffd9e346b48c2da315.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_25890e7487ea04ffd9e346b48c2da315.jpg saved to cache
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4269716-4d6d-5b53-9f34-caeea944a1d9
2026-03-30 10:36:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4269716-4d6d-5b53-9f34-caeea944a1d9, skipping ID generation
2026-03-30 10:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4269716-4d6d-5b53-9f34-caeea944a1d9 with scrape type 1
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4269716-4d6d-5b53-9f34-caeea944a1d9 sending to next pipeline
2026-03-30 10:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4269716-4d6d-5b53-9f34-caeea944a1d9, identifier: NJ28052
2026-03-30 10:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4269716-4d6d-5b53-9f34-caeea944a1d9 with identifier: NJ28052
2026-03-30 10:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4269716-4d6d-5b53-9f34-caeea944a1d9 with identifier: NJ28052
2026-03-30 10:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4269716-4d6d-5b53-9f34-caeea944a1d9 with identifier: NJ28052 to the API
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_25890e7487ea04ffd9e346b48c2da315.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:40:13Z',
 'fuel_type': 'petrol',
 'id': 'd4269716-4d6d-5b53-9f34-caeea944a1d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ28052',
 'listing': 'auction',
 'location': 'DE, Kaarst',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 110353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4269716-4d6d-5b53-9f34-caeea944a1d9/d4269716-4d6d-5b53-9f34-caeea944a1d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_3ad7ffc316a9b7c4c7220a92659c361f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4269716-4d6d-5b53-9f34-caeea944a1d9/d4269716-4d6d-5b53-9f34-caeea944a1d9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_25890e7487ea04ffd9e346b48c2da315.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4269716-4d6d-5b53-9f34-caeea944a1d9/d4269716-4d6d-5b53-9f34-caeea944a1d9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_4c3546548d3faeb77bcd4a78f0c7f8a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4269716-4d6d-5b53-9f34-caeea944a1d9/d4269716-4d6d-5b53-9f34-caeea944a1d9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_244e64391c0fbc7e8c0669f989a446b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4269716-4d6d-5b53-9f34-caeea944a1d9/d4269716-4d6d-5b53-9f34-caeea944a1d9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/df/bcdf6f2f2e06ac8a2ba0710406ed2e8c/pa/NJ28052_e19c274671296dd076eb920a02b1f1e4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Meriva 1.6 CATCH ME Now',
 'transmission': 'automatic',
 'trim': 'CATCH ME Now',
 'year': 2007}
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ28052%27 HTTP/1.1" 200 None
2026-03-30 10:36:02 [auto1.de] INFO: Saving data for NJ28052: {'created_time': 1774866962.846628, 'last_price_update_time': 1774866962.846642, 'auction_closing_time': 1774971613.0}
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ28052') HTTP/1.1" 204 0
2026-03-30 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_1b61d6ca667396482685bc4cbafb2374.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_2964f828edb096cb953d3d835cf621cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_c048104dd35d47e7d469af6d3cba6dca.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_512263aba3deb5a56fe3a78b98ceda3b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f436d390>
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_1b61d6ca667396482685bc4cbafb2374.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_1b61d6ca667396482685bc4cbafb2374.jpg saved to cache
2026-03-30 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c7067aed-2155-5376-8b01-2627c3d3eb59
2026-03-30 10:36:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee81c50>
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_2964f828edb096cb953d3d835cf621cc.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_2964f828edb096cb953d3d835cf621cc.jpg saved to cache
2026-03-30 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7067aed-2155-5376-8b01-2627c3d3eb59
2026-03-30 10:36:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41647d0>
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_c048104dd35d47e7d469af6d3cba6dca.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_c048104dd35d47e7d469af6d3cba6dca.jpg saved to cache
2026-03-30 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c7067aed-2155-5376-8b01-2627c3d3eb59
2026-03-30 10:36:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41bc910>
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_512263aba3deb5a56fe3a78b98ceda3b.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_512263aba3deb5a56fe3a78b98ceda3b.jpg saved to cache
2026-03-30 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c7067aed-2155-5376-8b01-2627c3d3eb59
2026-03-30 10:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_5b69c58ff7ebce29a308c7f1fb86dac4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_36eaa72ffb99fb868853770a79e673d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4429d0>
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_5b69c58ff7ebce29a308c7f1fb86dac4.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_5b69c58ff7ebce29a308c7f1fb86dac4.jpg saved to cache
2026-03-30 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb660feb-3758-58c4-920a-309b7fc468ba
2026-03-30 10:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_86e4c9bd8faa96748e3d992ea26a2cdf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4338d50>
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_36eaa72ffb99fb868853770a79e673d0.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_36eaa72ffb99fb868853770a79e673d0.jpg saved to cache
2026-03-30 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7067aed-2155-5376-8b01-2627c3d3eb59
2026-03-30 10:36:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee442790>
2026-03-30 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_86e4c9bd8faa96748e3d992ea26a2cdf.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_86e4c9bd8faa96748e3d992ea26a2cdf.jpg saved to cache
2026-03-30 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7067aed-2155-5376-8b01-2627c3d3eb59
2026-03-30 10:36:04 [scrapy.extensions.logstats] INFO: Crawled 202 pages (at 63 pages/min), scraped 114 items (at 30 items/min)
2026-03-30 10:36:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_458f67ee4c5de6a1490af73d6e50fe39.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_e2ec25fbeb3f81f84c0af5b49d8b0641.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_87aa1105e4dab56beab71c64dbac5dcb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_98761bf64c7f9683a95390ba2be7857d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ED86664/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec6d50>
2026-03-30 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F73%252F1f73a8a08cda19c43cdae839644bc05d%252Fpa%252FLC24532_458f67ee4c5de6a1490af73d6e50fe39.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_458f67ee4c5de6a1490af73d6e50fe39.jpg saved to cache
2026-03-30 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7067aed-2155-5376-8b01-2627c3d3eb59
2026-03-30 10:36:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7067aed-2155-5376-8b01-2627c3d3eb59, skipping ID generation
2026-03-30 10:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7067aed-2155-5376-8b01-2627c3d3eb59 with scrape type 1
2026-03-30 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7067aed-2155-5376-8b01-2627c3d3eb59 sending to next pipeline
2026-03-30 10:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7067aed-2155-5376-8b01-2627c3d3eb59, identifier: LC24532
2026-03-30 10:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7067aed-2155-5376-8b01-2627c3d3eb59 with identifier: LC24532
2026-03-30 10:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7067aed-2155-5376-8b01-2627c3d3eb59 with identifier: LC24532
2026-03-30 10:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7067aed-2155-5376-8b01-2627c3d3eb59 with identifier: LC24532 to the API
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_458f67ee4c5de6a1490af73d6e50fe39.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:50:28Z',
 'fuel_type': 'petrol',
 'id': 'c7067aed-2155-5376-8b01-2627c3d3eb59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC24532',
 'listing': 'auction',
 'location': 'DE, Landsberg am Lech',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 135425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3012254,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_4a1a34aac8c84227300ebff1c335b445.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3156425,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_36eaa72ffb99fb868853770a79e673d0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2994856,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_eab56a6211c0a8810a214de2284e0a42.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2760269,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_86e4c9bd8faa96748e3d992ea26a2cdf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3078157,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_458f67ee4c5de6a1490af73d6e50fe39.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2932719,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_2964f828edb096cb953d3d835cf621cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2659113,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_0054df014beeb9ab4d24defbeac3af66.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3143456,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_c048104dd35d47e7d469af6d3cba6dca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2841772,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_1b61d6ca667396482685bc4cbafb2374.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7067aed-2155-5376-8b01-2627c3d3eb59/c7067aed-2155-5376-8b01-2627c3d3eb59_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3307499,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/73/1f73a8a08cda19c43cdae839644bc05d/pa/LC24532_512263aba3deb5a56fe3a78b98ceda3b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.6 TGDI GT",
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2019}
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC24532%27 HTTP/1.1" 200 None
2026-03-30 10:36:04 [auto1.de] INFO: Saving data for LC24532: {'created_time': 1774866964.897253, 'last_price_update_time': 1774866964.897264, 'auction_closing_time': 1774972228.0}
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC24532') HTTP/1.1" 204 0
2026-03-30 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CP02770/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee73290>
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_e2ec25fbeb3f81f84c0af5b49d8b0641.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_e2ec25fbeb3f81f84c0af5b49d8b0641.jpg saved to cache
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 436283f3-df71-53be-a598-f46afd14de90
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefdc490>
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_87aa1105e4dab56beab71c64dbac5dcb.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_87aa1105e4dab56beab71c64dbac5dcb.jpg saved to cache
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb660feb-3758-58c4-920a-309b7fc468ba
2026-03-30 10:36:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb2810>
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_98761bf64c7f9683a95390ba2be7857d.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_98761bf64c7f9683a95390ba2be7857d.jpg saved to cache
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 436283f3-df71-53be-a598-f46afd14de90
2026-03-30 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY18162> (referer: https://www.auto1.com/v1/car-details-view/DY18162/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_e3c381edee82b0e358f122fa5e19089f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_13970f46e074b6857f98d0e234701561.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_3f6098ed45fdb0127b95eb9623e48a93.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c665f8e9-75fb-543a-873f-7bfc7b7d3bb4 with identifier: DY18162
2026-03-30 10:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c665f8e9-75fb-543a-873f-7bfc7b7d3bb4 with scrape type 1
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c665f8e9-75fb-543a-873f-7bfc7b7d3bb4
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_1953b61cc001a74116880eb01e23ceaf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_1953b61cc001a74116880eb01e23ceaf.jpg not downloaded yet
2026-03-30 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_4e1ed02931af2409b6c94ec2aaeb6173.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_23715da6cb8575c3ba48d0faaf5b59ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_23715da6cb8575c3ba48d0faaf5b59ac.jpg not downloaded yet
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_7114b175540ecac1a6558e108950913d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_7114b175540ecac1a6558e108950913d.jpg not downloaded yet
2026-03-30 10:36:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58fbd50>
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_e3c381edee82b0e358f122fa5e19089f.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_e3c381edee82b0e358f122fa5e19089f.jpg saved to cache
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 436283f3-df71-53be-a598-f46afd14de90
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_7fc1c90a646962a7cf86763aff10834e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_7fc1c90a646962a7cf86763aff10834e.jpg not downloaded yet
2026-03-30 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_1953b61cc001a74116880eb01e23ceaf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58fb0d0>
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_13970f46e074b6857f98d0e234701561.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_13970f46e074b6857f98d0e234701561.jpg saved to cache
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb660feb-3758-58c4-920a-309b7fc468ba
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4167790>
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_3f6098ed45fdb0127b95eb9623e48a93.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_3f6098ed45fdb0127b95eb9623e48a93.jpg saved to cache
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb660feb-3758-58c4-920a-309b7fc468ba
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_10a0a7a83e14cb8f52ec266b8b6a20c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_10a0a7a83e14cb8f52ec266b8b6a20c9.jpg not downloaded yet
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_16cc3da5d6c8f799ee99c45c9083164a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_16cc3da5d6c8f799ee99c45c9083164a.jpg not downloaded yet
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4259890>
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3e%252F983ec929849234750bca0eaddf8e234f%252Fpa%252FAU07976_4e1ed02931af2409b6c94ec2aaeb6173.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_4e1ed02931af2409b6c94ec2aaeb6173.jpg saved to cache
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb660feb-3758-58c4-920a-309b7fc468ba
2026-03-30 10:36:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb660feb-3758-58c4-920a-309b7fc468ba, skipping ID generation
2026-03-30 10:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb660feb-3758-58c4-920a-309b7fc468ba with scrape type 1
2026-03-30 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb660feb-3758-58c4-920a-309b7fc468ba sending to next pipeline
2026-03-30 10:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb660feb-3758-58c4-920a-309b7fc468ba, identifier: AU07976
2026-03-30 10:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb660feb-3758-58c4-920a-309b7fc468ba with identifier: AU07976
2026-03-30 10:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb660feb-3758-58c4-920a-309b7fc468ba with identifier: AU07976
2026-03-30 10:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb660feb-3758-58c4-920a-309b7fc468ba with identifier: AU07976 to the API
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_4e1ed02931af2409b6c94ec2aaeb6173.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:30:27Z',
 'fuel_type': 'petrol',
 'id': 'eb660feb-3758-58c4-920a-309b7fc468ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU07976',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 32617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_4e1ed02931af2409b6c94ec2aaeb6173.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_13970f46e074b6857f98d0e234701561.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_4a59548bb18d4d0137f9876c26dceafe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_3f6098ed45fdb0127b95eb9623e48a93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_87aa1105e4dab56beab71c64dbac5dcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_f9355fea44bb52558453617781067a6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_5b69c58ff7ebce29a308c7f1fb86dac4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_9696b88e76e5226ef6b635bf1f8d8d49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_6c9eb2a2ca1024c77c0db7ca6c03483d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb660feb-3758-58c4-920a-309b7fc468ba/eb660feb-3758-58c4-920a-309b7fc468ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/3e/983ec929849234750bca0eaddf8e234f/pa/AU07976_f877f74227f58a7b820d339c9d8f36b4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2024}
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU07976%27 HTTP/1.1" 200 None
2026-03-30 10:36:06 [auto1.de] INFO: Saving data for AU07976: {'created_time': 1774866966.423484, 'last_price_update_time': 1774866966.423495, 'auction_closing_time': 1774971027.0}
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU07976') HTTP/1.1" 204 0
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_d84102a4c27f78ed7b5416e08f70cc1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_d84102a4c27f78ed7b5416e08f70cc1a.jpg not downloaded yet
2026-03-30 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_7114b175540ecac1a6558e108950913d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee440090>
2026-03-30 10:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_1953b61cc001a74116880eb01e23ceaf.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_1953b61cc001a74116880eb01e23ceaf.jpg saved to cache
2026-03-30 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c665f8e9-75fb-543a-873f-7bfc7b7d3bb4
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_d0a517a32a20e8cba9612c26d4f460d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_d0a517a32a20e8cba9612c26d4f460d2.jpg not downloaded yet
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_f8783597f9aedb05d45733e427547296.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_f8783597f9aedb05d45733e427547296.jpg not downloaded yet
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_8c81c840e3ccdf6b5b512f37e6df3f06.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_8c81c840e3ccdf6b5b512f37e6df3f06.jpg not downloaded yet
2026-03-30 10:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4175d50>
2026-03-30 10:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_7114b175540ecac1a6558e108950913d.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_7114b175540ecac1a6558e108950913d.jpg saved to cache
2026-03-30 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c665f8e9-75fb-543a-873f-7bfc7b7d3bb4
2026-03-30 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_16cc3da5d6c8f799ee99c45c9083164a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_5d818288987bf7f6c3300564a25ea52c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_db61060226eb670615ffecaae19485bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_6e25f6ae0291c2beb8b8cdc2a86067d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_526932de6aec67d1307e8e25eb0f92dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_8c81c840e3ccdf6b5b512f37e6df3f06.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_f8783597f9aedb05d45733e427547296.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef61010>
2026-03-30 10:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_16cc3da5d6c8f799ee99c45c9083164a.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_16cc3da5d6c8f799ee99c45c9083164a.jpg saved to cache
2026-03-30 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c665f8e9-75fb-543a-873f-7bfc7b7d3bb4
2026-03-30 10:36:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c08650>
2026-03-30 10:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_5d818288987bf7f6c3300564a25ea52c.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_5d818288987bf7f6c3300564a25ea52c.jpg saved to cache
2026-03-30 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 436283f3-df71-53be-a598-f46afd14de90
2026-03-30 10:36:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefdce90>
2026-03-30 10:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_db61060226eb670615ffecaae19485bc.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_db61060226eb670615ffecaae19485bc.jpg saved to cache
2026-03-30 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 436283f3-df71-53be-a598-f46afd14de90
2026-03-30 10:36:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd7590>
2026-03-30 10:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_6e25f6ae0291c2beb8b8cdc2a86067d0.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_6e25f6ae0291c2beb8b8cdc2a86067d0.jpg saved to cache
2026-03-30 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 436283f3-df71-53be-a598-f46afd14de90
2026-03-30 10:36:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee03350>
2026-03-30 10:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffc%252F6dfc152c71ffbe01b91469f5314eabc3%252Fpa%252FAL20723_526932de6aec67d1307e8e25eb0f92dc.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_526932de6aec67d1307e8e25eb0f92dc.jpg saved to cache
2026-03-30 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 436283f3-df71-53be-a598-f46afd14de90
2026-03-30 10:36:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 436283f3-df71-53be-a598-f46afd14de90, skipping ID generation
2026-03-30 10:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 436283f3-df71-53be-a598-f46afd14de90 with scrape type 1
2026-03-30 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 436283f3-df71-53be-a598-f46afd14de90 sending to next pipeline
2026-03-30 10:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 436283f3-df71-53be-a598-f46afd14de90, identifier: AL20723
2026-03-30 10:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 436283f3-df71-53be-a598-f46afd14de90 with identifier: AL20723
2026-03-30 10:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 436283f3-df71-53be-a598-f46afd14de90 with identifier: AL20723
2026-03-30 10:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 436283f3-df71-53be-a598-f46afd14de90 with identifier: AL20723 to the API
2026-03-30 10:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_526932de6aec67d1307e8e25eb0f92dc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:07:55Z',
 'fuel_type': 'petrol',
 'id': '436283f3-df71-53be-a598-f46afd14de90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL20723',
 'listing': 'auction',
 'location': 'DE, Augsburg',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 66286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3398365,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_526932de6aec67d1307e8e25eb0f92dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3361465,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_5d818288987bf7f6c3300564a25ea52c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3233293,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_6e25f6ae0291c2beb8b8cdc2a86067d0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3148808,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_db61060226eb670615ffecaae19485bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3194164,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_e3c381edee82b0e358f122fa5e19089f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3230927,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_e2ec25fbeb3f81f84c0af5b49d8b0641.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2997512,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_98761bf64c7f9683a95390ba2be7857d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3064821,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_790e6f4222891dd243e92c630ca4ca33.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3397153,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_fa3cfd24f86d8005e561fdef35ec285a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_436283f3-df71-53be-a598-f46afd14de90/436283f3-df71-53be-a598-f46afd14de90_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3040726,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fc/6dfc152c71ffbe01b91469f5314eabc3/pa/AL20723_910bc5708b03ae2c851b208f32c77681.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.2 TCe Luxe',
 'transmission': 'automatic',
 'trim': 'Luxe',
 'year': 2014}
2026-03-30 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL20723%27 HTTP/1.1" 200 None
2026-03-30 10:36:08 [auto1.de] INFO: Saving data for AL20723: {'created_time': 1774866968.006947, 'last_price_update_time': 1774866968.006957, 'auction_closing_time': 1774969675.0}
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL20723') HTTP/1.1" 204 0
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58d1710>
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_8c81c840e3ccdf6b5b512f37e6df3f06.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_8c81c840e3ccdf6b5b512f37e6df3f06.jpg saved to cache
2026-03-30 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c665f8e9-75fb-543a-873f-7bfc7b7d3bb4
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4291c50>
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_f8783597f9aedb05d45733e427547296.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_f8783597f9aedb05d45733e427547296.jpg saved to cache
2026-03-30 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c665f8e9-75fb-543a-873f-7bfc7b7d3bb4
2026-03-30 10:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_10a0a7a83e14cb8f52ec266b8b6a20c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_d84102a4c27f78ed7b5416e08f70cc1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_7fc1c90a646962a7cf86763aff10834e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_23715da6cb8575c3ba48d0faaf5b59ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_d0a517a32a20e8cba9612c26d4f460d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee94590>
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_10a0a7a83e14cb8f52ec266b8b6a20c9.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_10a0a7a83e14cb8f52ec266b8b6a20c9.jpg saved to cache
2026-03-30 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c665f8e9-75fb-543a-873f-7bfc7b7d3bb4
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb0150>
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_d84102a4c27f78ed7b5416e08f70cc1a.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_d84102a4c27f78ed7b5416e08f70cc1a.jpg saved to cache
2026-03-30 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c665f8e9-75fb-543a-873f-7bfc7b7d3bb4
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef2150>
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_7fc1c90a646962a7cf86763aff10834e.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_7fc1c90a646962a7cf86763aff10834e.jpg saved to cache
2026-03-30 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c665f8e9-75fb-543a-873f-7bfc7b7d3bb4
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424cf10>
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_23715da6cb8575c3ba48d0faaf5b59ac.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_23715da6cb8575c3ba48d0faaf5b59ac.jpg saved to cache
2026-03-30 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c665f8e9-75fb-543a-873f-7bfc7b7d3bb4
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef0d10>
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F33%252F18339da93ac150d56e69369da064883a%252Fpa%252FDY18162_d0a517a32a20e8cba9612c26d4f460d2.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_d0a517a32a20e8cba9612c26d4f460d2.jpg saved to cache
2026-03-30 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c665f8e9-75fb-543a-873f-7bfc7b7d3bb4
2026-03-30 10:36:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c665f8e9-75fb-543a-873f-7bfc7b7d3bb4, skipping ID generation
2026-03-30 10:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c665f8e9-75fb-543a-873f-7bfc7b7d3bb4 with scrape type 1
2026-03-30 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c665f8e9-75fb-543a-873f-7bfc7b7d3bb4 sending to next pipeline
2026-03-30 10:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c665f8e9-75fb-543a-873f-7bfc7b7d3bb4, identifier: DY18162
2026-03-30 10:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c665f8e9-75fb-543a-873f-7bfc7b7d3bb4 with identifier: DY18162
2026-03-30 10:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c665f8e9-75fb-543a-873f-7bfc7b7d3bb4 with identifier: DY18162
2026-03-30 10:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c665f8e9-75fb-543a-873f-7bfc7b7d3bb4 with identifier: DY18162 to the API
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_d0a517a32a20e8cba9612c26d4f460d2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:07:31Z',
 'fuel_type': 'petrol',
 'id': 'c665f8e9-75fb-543a-873f-7bfc7b7d3bb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY18162',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 87473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_1953b61cc001a74116880eb01e23ceaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_23715da6cb8575c3ba48d0faaf5b59ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_7114b175540ecac1a6558e108950913d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_7fc1c90a646962a7cf86763aff10834e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_10a0a7a83e14cb8f52ec266b8b6a20c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_16cc3da5d6c8f799ee99c45c9083164a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_d84102a4c27f78ed7b5416e08f70cc1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_d0a517a32a20e8cba9612c26d4f460d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_f8783597f9aedb05d45733e427547296.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c665f8e9-75fb-543a-873f-7bfc7b7d3bb4/c665f8e9-75fb-543a-873f-7bfc7b7d3bb4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/33/18339da93ac150d56e69369da064883a/pa/DY18162_8c81c840e3ccdf6b5b512f37e6df3f06.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo INNOVATION',
 'transmission': 'automatic',
 'trim': 'INNOVATION',
 'year': 2020}
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY18162%27 HTTP/1.1" 200 None
2026-03-30 10:36:08 [auto1.de] INFO: Saving data for DY18162: {'created_time': 1774866968.993043, 'last_price_update_time': 1774866968.993056, 'auction_closing_time': 1774969651.0}
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY18162') HTTP/1.1" 204 0
2026-03-30 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_96a19fb184554505a35aca1471a09fc7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_b27d842af492dd6203d8e780757c87d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_02d844f2a9ff20db71c3f58923495396.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_6c7b22947d94ee7c1f334b7cf0758cc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_2e36ecee1900a8baf8574ecf2336fe62.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f0ed0>
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_96a19fb184554505a35aca1471a09fc7.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_96a19fb184554505a35aca1471a09fc7.jpg saved to cache
2026-03-30 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44b68d5d-6d74-5f28-a732-78f2e78caed1
2026-03-30 10:36:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45a910>
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_b27d842af492dd6203d8e780757c87d1.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_b27d842af492dd6203d8e780757c87d1.jpg saved to cache
2026-03-30 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44b68d5d-6d74-5f28-a732-78f2e78caed1
2026-03-30 10:36:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee86750>
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_02d844f2a9ff20db71c3f58923495396.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_02d844f2a9ff20db71c3f58923495396.jpg saved to cache
2026-03-30 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44b68d5d-6d74-5f28-a732-78f2e78caed1
2026-03-30 10:36:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee72950>
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_6c7b22947d94ee7c1f334b7cf0758cc4.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_6c7b22947d94ee7c1f334b7cf0758cc4.jpg saved to cache
2026-03-30 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44b68d5d-6d74-5f28-a732-78f2e78caed1
2026-03-30 10:36:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd4390>
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_2e36ecee1900a8baf8574ecf2336fe62.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_2e36ecee1900a8baf8574ecf2336fe62.jpg saved to cache
2026-03-30 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44b68d5d-6d74-5f28-a732-78f2e78caed1
2026-03-30 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_02547bcd268e6c84212977736ef4cb42.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee733d0>
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_02547bcd268e6c84212977736ef4cb42.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_02547bcd268e6c84212977736ef4cb42.jpg saved to cache
2026-03-30 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44b68d5d-6d74-5f28-a732-78f2e78caed1
2026-03-30 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_985285b4cecb23bf585f13f8b839aa41.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee05410>
2026-03-30 10:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_985285b4cecb23bf585f13f8b839aa41.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_985285b4cecb23bf585f13f8b839aa41.jpg saved to cache
2026-03-30 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44b68d5d-6d74-5f28-a732-78f2e78caed1
2026-03-30 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_eb06c8a0045a8de39ad57e4c156ec253.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee57c90>
2026-03-30 10:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Ff4%252F9ef4b5ba6dd56f0e4fae2878c1e99992%252Fpa%252FJZ36451_eb06c8a0045a8de39ad57e4c156ec253.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_eb06c8a0045a8de39ad57e4c156ec253.jpg saved to cache
2026-03-30 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44b68d5d-6d74-5f28-a732-78f2e78caed1
2026-03-30 10:36:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44b68d5d-6d74-5f28-a732-78f2e78caed1, skipping ID generation
2026-03-30 10:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44b68d5d-6d74-5f28-a732-78f2e78caed1 with scrape type 1
2026-03-30 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44b68d5d-6d74-5f28-a732-78f2e78caed1 sending to next pipeline
2026-03-30 10:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44b68d5d-6d74-5f28-a732-78f2e78caed1, identifier: JZ36451
2026-03-30 10:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44b68d5d-6d74-5f28-a732-78f2e78caed1 with identifier: JZ36451
2026-03-30 10:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44b68d5d-6d74-5f28-a732-78f2e78caed1 with identifier: JZ36451
2026-03-30 10:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44b68d5d-6d74-5f28-a732-78f2e78caed1 with identifier: JZ36451 to the API
2026-03-30 10:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_eb06c8a0045a8de39ad57e4c156ec253.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:56:35Z',
 'fuel_type': 'petrol',
 'id': '44b68d5d-6d74-5f28-a732-78f2e78caed1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ36451',
 'listing': 'auction',
 'location': 'DE, Laer',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 123098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2641617,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_eb06c8a0045a8de39ad57e4c156ec253.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2467372,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_985285b4cecb23bf585f13f8b839aa41.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2628257,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_02547bcd268e6c84212977736ef4cb42.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2519824,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_6c7b22947d94ee7c1f334b7cf0758cc4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2591739,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_96a19fb184554505a35aca1471a09fc7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2537890,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_02d844f2a9ff20db71c3f58923495396.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2561385,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_b27d842af492dd6203d8e780757c87d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2619078,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_2e36ecee1900a8baf8574ecf2336fe62.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2679961,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_20cab2fa0ab888a5b740439935669728.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b68d5d-6d74-5f28-a732-78f2e78caed1/44b68d5d-6d74-5f28-a732-78f2e78caed1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/f4/9ef4b5ba6dd56f0e4fae2878c1e99992/pa/JZ36451_af699a64514ea6c968e1e6b88dcd7691.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Roomster 1.4 Active Plus Edition',
 'transmission': 'manual',
 'trim': 'Active Plus Edition',
 'year': 2013}
2026-03-30 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ36451%27 HTTP/1.1" 200 None
2026-03-30 10:36:11 [auto1.de] INFO: Saving data for JZ36451: {'created_time': 1774866971.104551, 'last_price_update_time': 1774866971.104562, 'auction_closing_time': 1774972595.0}
2026-03-30 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ36451') HTTP/1.1" 204 0
2026-03-30 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC02244/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_e6f904c7c0cad6dbb2dbc9d75f152da3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419f9d0>
2026-03-30 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2729ad5-4575-5944-801e-296d58cf625a/c2729ad5-4575-5944-801e-296d58cf625a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fd4%252Fffd4b2e425cfe7638778f75ac692e8d7%252Fpa%252FCL77227_e6f904c7c0cad6dbb2dbc9d75f152da3.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_e6f904c7c0cad6dbb2dbc9d75f152da3.jpg saved to cache
2026-03-30 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2729ad5-4575-5944-801e-296d58cf625a
2026-03-30 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_2e177f15aae4f718e9838cc422c76506.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee56bd0>
2026-03-30 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_2e177f15aae4f718e9838cc422c76506.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_2e177f15aae4f718e9838cc422c76506.jpg saved to cache
2026-03-30 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb09548c-31ca-50d7-989d-b288b7a2cdde
2026-03-30 10:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD03906> (referer: https://www.auto1.com/v1/car-details-view/MD03906/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_c0adfda8a6f469c942516ae4b19f0b84.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cef9c7b0-b9a7-55d8-9b55-f63f0958c658 with identifier: MD03906
2026-03-30 10:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cef9c7b0-b9a7-55d8-9b55-f63f0958c658 with scrape type 1
2026-03-30 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cef9c7b0-b9a7-55d8-9b55-f63f0958c658
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F01%252F6701eef7ec98eca9982a716388d78f0a%252Fpa%252FMD03906_51d3c8daa47b61f53da8f7bf87fe7eb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_51d3c8daa47b61f53da8f7bf87fe7eb3.jpg already downloaded
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F01%252F6701eef7ec98eca9982a716388d78f0a%252Fpa%252FMD03906_3c5f29f0449271fd044ca5883ad86d26.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_3c5f29f0449271fd044ca5883ad86d26.jpg already downloaded
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F01%252F6701eef7ec98eca9982a716388d78f0a%252Fpa%252FMD03906_8471bab223ba1dcc0a0d3d6f29702f2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_8471bab223ba1dcc0a0d3d6f29702f2a.jpg already downloaded
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F01%252F6701eef7ec98eca9982a716388d78f0a%252Fpa%252FMD03906_c54e90ac4d9a9eef2cca77492e3d2779.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_c54e90ac4d9a9eef2cca77492e3d2779.jpg already downloaded
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F01%252F6701eef7ec98eca9982a716388d78f0a%252Fpa%252FMD03906_2aa0242fc50f50c34f2ad61b4a416d18.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_2aa0242fc50f50c34f2ad61b4a416d18.jpg already downloaded
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F01%252F6701eef7ec98eca9982a716388d78f0a%252Fpa%252FMD03906_6fb8dd2aa59ca5e77f4f4c778cb73471.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_6fb8dd2aa59ca5e77f4f4c778cb73471.jpg already downloaded
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F01%252F6701eef7ec98eca9982a716388d78f0a%252Fpa%252FMD03906_efdceea605a4adfc3b3ec9bc76add77c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_efdceea605a4adfc3b3ec9bc76add77c.jpg already downloaded
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F01%252F6701eef7ec98eca9982a716388d78f0a%252Fpa%252FMD03906_448a8b340f0c397cb7baa0806e399295.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_448a8b340f0c397cb7baa0806e399295.jpg already downloaded
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F01%252F6701eef7ec98eca9982a716388d78f0a%252Fpa%252FMD03906_a5e9a83a0f83ae4725cf45eeee3669c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_a5e9a83a0f83ae4725cf45eeee3669c2.jpg already downloaded
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F01%252F6701eef7ec98eca9982a716388d78f0a%252Fpa%252FMD03906_b4b939a280ff840262aae34fb44ff127.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_b4b939a280ff840262aae34fb44ff127.jpg already downloaded
2026-03-30 10:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cef9c7b0-b9a7-55d8-9b55-f63f0958c658, identifier: MD03906
2026-03-30 10:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cef9c7b0-b9a7-55d8-9b55-f63f0958c658 with identifier: MD03906
2026-03-30 10:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cef9c7b0-b9a7-55d8-9b55-f63f0958c658 with identifier: MD03906
2026-03-30 10:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cef9c7b0-b9a7-55d8-9b55-f63f0958c658 with identifier: MD03906 to the API
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MD03906>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:19:35Z',
 'fuel_type': 'hybrid',
 'id': 'cef9c7b0-b9a7-55d8-9b55-f63f0958c658',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD03906',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Toyota',
 'model': 'Prius',
 'odometer': 136777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_51d3c8daa47b61f53da8f7bf87fe7eb3.jpg',
                'https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_3c5f29f0449271fd044ca5883ad86d26.jpg',
                'https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_8471bab223ba1dcc0a0d3d6f29702f2a.jpg',
                'https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_c54e90ac4d9a9eef2cca77492e3d2779.jpg',
                'https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_2aa0242fc50f50c34f2ad61b4a416d18.jpg',
                'https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_6fb8dd2aa59ca5e77f4f4c778cb73471.jpg',
                'https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_efdceea605a4adfc3b3ec9bc76add77c.jpg',
                'https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_448a8b340f0c397cb7baa0806e399295.jpg',
                'https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_a5e9a83a0f83ae4725cf45eeee3669c2.jpg',
                'https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_b4b939a280ff840262aae34fb44ff127.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef9c7b0-b9a7-55d8-9b55-f63f0958c658/cef9c7b0-b9a7-55d8-9b55-f63f0958c658_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_51d3c8daa47b61f53da8f7bf87fe7eb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef9c7b0-b9a7-55d8-9b55-f63f0958c658/cef9c7b0-b9a7-55d8-9b55-f63f0958c658_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_3c5f29f0449271fd044ca5883ad86d26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef9c7b0-b9a7-55d8-9b55-f63f0958c658/cef9c7b0-b9a7-55d8-9b55-f63f0958c658_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_8471bab223ba1dcc0a0d3d6f29702f2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef9c7b0-b9a7-55d8-9b55-f63f0958c658/cef9c7b0-b9a7-55d8-9b55-f63f0958c658_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_c54e90ac4d9a9eef2cca77492e3d2779.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef9c7b0-b9a7-55d8-9b55-f63f0958c658/cef9c7b0-b9a7-55d8-9b55-f63f0958c658_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_2aa0242fc50f50c34f2ad61b4a416d18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef9c7b0-b9a7-55d8-9b55-f63f0958c658/cef9c7b0-b9a7-55d8-9b55-f63f0958c658_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_6fb8dd2aa59ca5e77f4f4c778cb73471.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef9c7b0-b9a7-55d8-9b55-f63f0958c658/cef9c7b0-b9a7-55d8-9b55-f63f0958c658_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_efdceea605a4adfc3b3ec9bc76add77c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef9c7b0-b9a7-55d8-9b55-f63f0958c658/cef9c7b0-b9a7-55d8-9b55-f63f0958c658_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_448a8b340f0c397cb7baa0806e399295.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef9c7b0-b9a7-55d8-9b55-f63f0958c658/cef9c7b0-b9a7-55d8-9b55-f63f0958c658_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_a5e9a83a0f83ae4725cf45eeee3669c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef9c7b0-b9a7-55d8-9b55-f63f0958c658/cef9c7b0-b9a7-55d8-9b55-f63f0958c658_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/01/6701eef7ec98eca9982a716388d78f0a/pa/MD03906_b4b939a280ff840262aae34fb44ff127.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Prius 1.8 Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2010}
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD03906%27 HTTP/1.1" 200 None
2026-03-30 10:36:13 [auto1.de] INFO: Saving data for MD03906: {'created_time': 1774866973.061409, 'last_price_update_time': 1774866973.061422, 'auction_closing_time': 1774970375.0}
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD03906') HTTP/1.1" 204 0
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee55090>
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2729ad5-4575-5944-801e-296d58cf625a/c2729ad5-4575-5944-801e-296d58cf625a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fd4%252Fffd4b2e425cfe7638778f75ac692e8d7%252Fpa%252FCL77227_c0adfda8a6f469c942516ae4b19f0b84.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_c0adfda8a6f469c942516ae4b19f0b84.jpg saved to cache
2026-03-30 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2729ad5-4575-5944-801e-296d58cf625a
2026-03-30 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_c16744b5318454b52a68691deb754360.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefdd410>
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_c16744b5318454b52a68691deb754360.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_c16744b5318454b52a68691deb754360.jpg saved to cache
2026-03-30 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf
2026-03-30 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_411db2ec327be0b1f86e462c5cdb81d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_c5e70376239a07ae1f1f19cf7a6dde60.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee47ad90>
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_411db2ec327be0b1f86e462c5cdb81d9.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_411db2ec327be0b1f86e462c5cdb81d9.jpg saved to cache
2026-03-30 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb09548c-31ca-50d7-989d-b288b7a2cdde
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428c7d0>
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2729ad5-4575-5944-801e-296d58cf625a/c2729ad5-4575-5944-801e-296d58cf625a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fd4%252Fffd4b2e425cfe7638778f75ac692e8d7%252Fpa%252FCL77227_c5e70376239a07ae1f1f19cf7a6dde60.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_c5e70376239a07ae1f1f19cf7a6dde60.jpg saved to cache
2026-03-30 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2729ad5-4575-5944-801e-296d58cf625a
2026-03-30 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_c447e92c4c59e5d91065609db981e2da.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee81ed0>
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_c447e92c4c59e5d91065609db981e2da.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_c447e92c4c59e5d91065609db981e2da.jpg saved to cache
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf
2026-03-30 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_d910d20cd5a8fecda81eca8a3736d57b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_4976467ab2bc903045f2683411f47a84.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee57750>
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_d910d20cd5a8fecda81eca8a3736d57b.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_d910d20cd5a8fecda81eca8a3736d57b.jpg saved to cache
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb09548c-31ca-50d7-989d-b288b7a2cdde
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee54dd0>
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2729ad5-4575-5944-801e-296d58cf625a/c2729ad5-4575-5944-801e-296d58cf625a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fd4%252Fffd4b2e425cfe7638778f75ac692e8d7%252Fpa%252FCL77227_4976467ab2bc903045f2683411f47a84.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_4976467ab2bc903045f2683411f47a84.jpg saved to cache
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2729ad5-4575-5944-801e-296d58cf625a
2026-03-30 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_c3169392db7dd94b20e721e96d234249.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4269550>
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_c3169392db7dd94b20e721e96d234249.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_c3169392db7dd94b20e721e96d234249.jpg saved to cache
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf
2026-03-30 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_04caaeef49e3ada345aed7d15faac411.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41fcc50>
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F50%252F2b50e468823a38436d05ded0428d6c96%252Fpa%252FWX76835_04caaeef49e3ada345aed7d15faac411.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_04caaeef49e3ada345aed7d15faac411.jpg saved to cache
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb09548c-31ca-50d7-989d-b288b7a2cdde
2026-03-30 10:36:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb09548c-31ca-50d7-989d-b288b7a2cdde, skipping ID generation
2026-03-30 10:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb09548c-31ca-50d7-989d-b288b7a2cdde with scrape type 1
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb09548c-31ca-50d7-989d-b288b7a2cdde sending to next pipeline
2026-03-30 10:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb09548c-31ca-50d7-989d-b288b7a2cdde, identifier: WX76835
2026-03-30 10:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb09548c-31ca-50d7-989d-b288b7a2cdde with identifier: WX76835
2026-03-30 10:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb09548c-31ca-50d7-989d-b288b7a2cdde with identifier: WX76835
2026-03-30 10:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb09548c-31ca-50d7-989d-b288b7a2cdde with identifier: WX76835 to the API
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_04caaeef49e3ada345aed7d15faac411.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:03:53Z',
 'fuel_type': 'petrol',
 'id': 'bb09548c-31ca-50d7-989d-b288b7a2cdde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX76835',
 'listing': 'auction',
 'location': 'DE, Donaueschingen',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 137298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2684920,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_04caaeef49e3ada345aed7d15faac411.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2736174,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_d910d20cd5a8fecda81eca8a3736d57b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2552917,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_411db2ec327be0b1f86e462c5cdb81d9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2552750,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_2e177f15aae4f718e9838cc422c76506.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2570937,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_aacfcbb833209e167940438a36748be2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2620577,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_faf17caa87d8085944e90bc7ab3ee664.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2576959,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_feee07f6efb0d7178a6b009bdd54d019.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2790244,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_8ba8fa9299e634f57feb4ba9c85b5a68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2593607,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_bf8702531509f57b3f68cc50ec5b5935.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb09548c-31ca-50d7-989d-b288b7a2cdde/bb09548c-31ca-50d7-989d-b288b7a2cdde_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2853504,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/50/2b50e468823a38436d05ded0428d6c96/pa/WX76835_960f5ebe1d5ffc8f40abb70f38ee457f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI R 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'R 4Motion BlueMotion Tech',
 'year': 2016}
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX76835%27 HTTP/1.1" 200 None
2026-03-30 10:36:15 [auto1.de] INFO: Saving data for WX76835: {'created_time': 1774866975.577188, 'last_price_update_time': 1774866975.577198, 'auction_closing_time': 1774969433.0}
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX76835') HTTP/1.1" 204 0
2026-03-30 10:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ED86664> (referer: https://www.auto1.com/v1/car-details-view/ED86664/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_4ec514d238a6be3e16036614aaab8a0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a02ed368-9486-5db8-b622-43b69b6c6f58 with identifier: ED86664
2026-03-30 10:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a02ed368-9486-5db8-b622-43b69b6c6f58 with scrape type 1
2026-03-30 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a02ed368-9486-5db8-b622-43b69b6c6f58
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_3b3ae4282bc158bb645e78a98b0ddb41.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_3b3ae4282bc158bb645e78a98b0ddb41.jpg not downloaded yet
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_93058e677887065278c58ee42f88a5a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_93058e677887065278c58ee42f88a5a7.jpg not downloaded yet
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_e788cd9735cbaccf40469166e30944c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_e788cd9735cbaccf40469166e30944c8.jpg not downloaded yet
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_40629cc30b32355e57d384925d8db76b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_40629cc30b32355e57d384925d8db76b.jpg not downloaded yet
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_6aa6bd7564365565581d07b28390f3ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_6aa6bd7564365565581d07b28390f3ac.jpg not downloaded yet
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f426b9d0>
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2729ad5-4575-5944-801e-296d58cf625a/c2729ad5-4575-5944-801e-296d58cf625a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fd4%252Fffd4b2e425cfe7638778f75ac692e8d7%252Fpa%252FCL77227_4ec514d238a6be3e16036614aaab8a0e.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_4ec514d238a6be3e16036614aaab8a0e.jpg saved to cache
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2729ad5-4575-5944-801e-296d58cf625a
2026-03-30 10:36:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2729ad5-4575-5944-801e-296d58cf625a, skipping ID generation
2026-03-30 10:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2729ad5-4575-5944-801e-296d58cf625a with scrape type 1
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2729ad5-4575-5944-801e-296d58cf625a sending to next pipeline
2026-03-30 10:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2729ad5-4575-5944-801e-296d58cf625a, identifier: CL77227
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_f2b3652c1897d2dd0efecdd9e4319d1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_f2b3652c1897d2dd0efecdd9e4319d1a.jpg not downloaded yet
2026-03-30 10:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2729ad5-4575-5944-801e-296d58cf625a with identifier: CL77227
2026-03-30 10:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2729ad5-4575-5944-801e-296d58cf625a with identifier: CL77227
2026-03-30 10:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2729ad5-4575-5944-801e-296d58cf625a with identifier: CL77227 to the API
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_4ec514d238a6be3e16036614aaab8a0e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 87,
 'expiration_date': '2026-03-31T15:20:17Z',
 'fuel_type': 'petrol',
 'id': 'c2729ad5-4575-5944-801e-296d58cf625a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL77227',
 'listing': 'auction',
 'location': 'DE, Kaiserslautern',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2729ad5-4575-5944-801e-296d58cf625a/c2729ad5-4575-5944-801e-296d58cf625a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_4ec514d238a6be3e16036614aaab8a0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2729ad5-4575-5944-801e-296d58cf625a/c2729ad5-4575-5944-801e-296d58cf625a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_4976467ab2bc903045f2683411f47a84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2729ad5-4575-5944-801e-296d58cf625a/c2729ad5-4575-5944-801e-296d58cf625a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_c5e70376239a07ae1f1f19cf7a6dde60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2729ad5-4575-5944-801e-296d58cf625a/c2729ad5-4575-5944-801e-296d58cf625a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_c0adfda8a6f469c942516ae4b19f0b84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2729ad5-4575-5944-801e-296d58cf625a/c2729ad5-4575-5944-801e-296d58cf625a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_e6f904c7c0cad6dbb2dbc9d75f152da3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2729ad5-4575-5944-801e-296d58cf625a/c2729ad5-4575-5944-801e-296d58cf625a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/d4/ffd4b2e425cfe7638778f75ac692e8d7/pa/CL77227_54f862f18f625c6a51366379767e6a3e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.3 VVT-i Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2005}
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL77227%27 HTTP/1.1" 200 None
2026-03-30 10:36:17 [auto1.de] INFO: Saving data for CL77227: {'created_time': 1774866977.598842, 'last_price_update_time': 1774866977.598851, 'auction_closing_time': 1774970417.0}
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL77227') HTTP/1.1" 204 0
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_c494e5dcd62a93ca0a8eeac9c5bfe086.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_c494e5dcd62a93ca0a8eeac9c5bfe086.jpg not downloaded yet
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_03906d45c54e5e296ff21e6a74b9f1cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_03906d45c54e5e296ff21e6a74b9f1cd.jpg not downloaded yet
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_40cb8a0d64579cd12ea6ab2f22e262b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_40cb8a0d64579cd12ea6ab2f22e262b7.jpg not downloaded yet
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_55cf0e3723053200f798c07b65848149.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_55cf0e3723053200f798c07b65848149.jpg not downloaded yet
2026-03-30 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_c06d0c59b52271ca1e4522f007d1f2be.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_55cf0e3723053200f798c07b65848149.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414ded0>
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_c06d0c59b52271ca1e4522f007d1f2be.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_c06d0c59b52271ca1e4522f007d1f2be.jpg saved to cache
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf
2026-03-30 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_40cb8a0d64579cd12ea6ab2f22e262b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee47ac10>
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_55cf0e3723053200f798c07b65848149.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_55cf0e3723053200f798c07b65848149.jpg saved to cache
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a02ed368-9486-5db8-b622-43b69b6c6f58
2026-03-30 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_03906d45c54e5e296ff21e6a74b9f1cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee62990>
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_40cb8a0d64579cd12ea6ab2f22e262b7.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_40cb8a0d64579cd12ea6ab2f22e262b7.jpg saved to cache
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a02ed368-9486-5db8-b622-43b69b6c6f58
2026-03-30 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_c494e5dcd62a93ca0a8eeac9c5bfe086.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_f2b3652c1897d2dd0efecdd9e4319d1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee479090>
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_03906d45c54e5e296ff21e6a74b9f1cd.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_03906d45c54e5e296ff21e6a74b9f1cd.jpg saved to cache
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a02ed368-9486-5db8-b622-43b69b6c6f58
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f438a750>
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_c494e5dcd62a93ca0a8eeac9c5bfe086.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_c494e5dcd62a93ca0a8eeac9c5bfe086.jpg saved to cache
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a02ed368-9486-5db8-b622-43b69b6c6f58
2026-03-30 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_6aa6bd7564365565581d07b28390f3ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef35790>
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_f2b3652c1897d2dd0efecdd9e4319d1a.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_f2b3652c1897d2dd0efecdd9e4319d1a.jpg saved to cache
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a02ed368-9486-5db8-b622-43b69b6c6f58
2026-03-30 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_40629cc30b32355e57d384925d8db76b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee72b10>
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_6aa6bd7564365565581d07b28390f3ac.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_6aa6bd7564365565581d07b28390f3ac.jpg saved to cache
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a02ed368-9486-5db8-b622-43b69b6c6f58
2026-03-30 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_e788cd9735cbaccf40469166e30944c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee56910>
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_40629cc30b32355e57d384925d8db76b.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_40629cc30b32355e57d384925d8db76b.jpg saved to cache
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a02ed368-9486-5db8-b622-43b69b6c6f58
2026-03-30 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_93058e677887065278c58ee42f88a5a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef350d0>
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_e788cd9735cbaccf40469166e30944c8.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_e788cd9735cbaccf40469166e30944c8.jpg saved to cache
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a02ed368-9486-5db8-b622-43b69b6c6f58
2026-03-30 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_3b3ae4282bc158bb645e78a98b0ddb41.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee55050>
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_93058e677887065278c58ee42f88a5a7.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_93058e677887065278c58ee42f88a5a7.jpg saved to cache
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a02ed368-9486-5db8-b622-43b69b6c6f58
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefe0550>
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F57%252Ff657e814b4501e9cb8b293c6fec46176%252Fpa%252FED86664_3b3ae4282bc158bb645e78a98b0ddb41.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_3b3ae4282bc158bb645e78a98b0ddb41.jpg saved to cache
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a02ed368-9486-5db8-b622-43b69b6c6f58
2026-03-30 10:36:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a02ed368-9486-5db8-b622-43b69b6c6f58, skipping ID generation
2026-03-30 10:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a02ed368-9486-5db8-b622-43b69b6c6f58 with scrape type 1
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a02ed368-9486-5db8-b622-43b69b6c6f58 sending to next pipeline
2026-03-30 10:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a02ed368-9486-5db8-b622-43b69b6c6f58, identifier: ED86664
2026-03-30 10:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a02ed368-9486-5db8-b622-43b69b6c6f58 with identifier: ED86664
2026-03-30 10:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a02ed368-9486-5db8-b622-43b69b6c6f58 with identifier: ED86664
2026-03-30 10:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a02ed368-9486-5db8-b622-43b69b6c6f58 with identifier: ED86664 to the API
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_3b3ae4282bc158bb645e78a98b0ddb41.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:39:14Z',
 'fuel_type': 'petrol',
 'id': 'a02ed368-9486-5db8-b622-43b69b6c6f58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED86664',
 'listing': 'auction',
 'location': 'DE, Sonneberg',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 206286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51207,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_3b3ae4282bc158bb645e78a98b0ddb41.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42222,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_93058e677887065278c58ee42f88a5a7.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47713,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_e788cd9735cbaccf40469166e30944c8.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40357,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_40629cc30b32355e57d384925d8db76b.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52442,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_6aa6bd7564365565581d07b28390f3ac.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47858,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_f2b3652c1897d2dd0efecdd9e4319d1a.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43238,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_c494e5dcd62a93ca0a8eeac9c5bfe086.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46151,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_03906d45c54e5e296ff21e6a74b9f1cd.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49338,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_40cb8a0d64579cd12ea6ab2f22e262b7.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02ed368-9486-5db8-b622-43b69b6c6f58/a02ed368-9486-5db8-b622-43b69b6c6f58_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50283,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/57/f657e814b4501e9cb8b293c6fec46176/pa/ED86664_55cf0e3723053200f798c07b65848149.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED86664%27 HTTP/1.1" 200 None
2026-03-30 10:36:19 [auto1.de] INFO: Saving data for ED86664: {'created_time': 1774866979.210804, 'last_price_update_time': 1774866979.210815, 'auction_closing_time': 1774971554.0}
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED86664') HTTP/1.1" 204 0
2026-03-30 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CP02770> (referer: https://www.auto1.com/v1/car-details-view/CP02770/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_0ca33d1ab5d2dedda5590814ea9e4901.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3747c004-7e5b-5988-be7d-57376c2dd088 with identifier: CP02770
2026-03-30 10:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3747c004-7e5b-5988-be7d-57376c2dd088 with scrape type 1
2026-03-30 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3747c004-7e5b-5988-be7d-57376c2dd088
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_b9f0459ed11a6f10f32d720a90344cbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_b9f0459ed11a6f10f32d720a90344cbb.jpg not downloaded yet
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_009298c6fba1ec8a01ae41a5adf76553.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_009298c6fba1ec8a01ae41a5adf76553.jpg not downloaded yet
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_38c41ac4b8e3d8c73eb3a0d3fe7936ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_38c41ac4b8e3d8c73eb3a0d3fe7936ec.jpg not downloaded yet
2026-03-30 10:36:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee323d0>
2026-03-30 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_0ca33d1ab5d2dedda5590814ea9e4901.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_0ca33d1ab5d2dedda5590814ea9e4901.jpg saved to cache
2026-03-30 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_27f70e42eef5e246523920b5768c3ddc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_27f70e42eef5e246523920b5768c3ddc.jpg not downloaded yet
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_f95a8213fc1e7073187701a0100ddf9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_f95a8213fc1e7073187701a0100ddf9c.jpg not downloaded yet
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_d774a40a359983458c996fdbde767ee0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_d774a40a359983458c996fdbde767ee0.jpg not downloaded yet
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_54ed3ff54b32e4f749be61a6a9174936.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_54ed3ff54b32e4f749be61a6a9174936.jpg not downloaded yet
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_3bcb9efec869d3545dfb30b586d3eba0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_3bcb9efec869d3545dfb30b586d3eba0.jpg not downloaded yet
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_d843d15335226b0cb70c7c6ad1c9c211.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_d843d15335226b0cb70c7c6ad1c9c211.jpg not downloaded yet
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_9fecd8c003d3eaef5b5b029de203b376.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_9fecd8c003d3eaef5b5b029de203b376.jpg not downloaded yet
2026-03-30 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_b133c26535d6ca34002228339103d126.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_1aa774b4a9a7a0f01ef266d9bfa9f7b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_9fecd8c003d3eaef5b5b029de203b376.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d3650>
2026-03-30 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9e%252Fbb9e7e3617f0b6f77122f42c1e205295%252Fpa%252FBW18419_b133c26535d6ca34002228339103d126.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_b133c26535d6ca34002228339103d126.jpg saved to cache
2026-03-30 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf
2026-03-30 10:36:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf, skipping ID generation
2026-03-30 10:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf with scrape type 1
2026-03-30 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf sending to next pipeline
2026-03-30 10:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf, identifier: BW18419
2026-03-30 10:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf with identifier: BW18419
2026-03-30 10:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf with identifier: BW18419
2026-03-30 10:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf with identifier: BW18419 to the API
2026-03-30 10:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_b133c26535d6ca34002228339103d126.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:14:21Z',
 'fuel_type': 'petrol',
 'id': 'f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW18419',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 71875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2693969,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_9687b7f335feedf9da25e6941d67a881.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2762231,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_489d84a25ace569c81314ca5c2315699.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2576702,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_d53449b2f137fdccf76a6852a4dc3d2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2745074,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_b133c26535d6ca34002228339103d126.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2560386,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_0ca33d1ab5d2dedda5590814ea9e4901.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2641014,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_c06d0c59b52271ca1e4522f007d1f2be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2782623,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_c3169392db7dd94b20e721e96d234249.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2776601,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_c447e92c4c59e5d91065609db981e2da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2693344,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_c16744b5318454b52a68691deb754360.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf/f0fbe0a9-6894-5b9e-97c3-8a049cdeaabf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2662461,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9e/bb9e7e3617f0b6f77122f42c1e205295/pa/BW18419_e065310a51c693b8d82f765fda1cf2c1.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo 120 Jahre Start/Stop',
 'transmission': 'manual',
 'trim': '120 Jahre Start/Stop',
 'year': 2019}
2026-03-30 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18419%27 HTTP/1.1" 200 None
2026-03-30 10:36:20 [auto1.de] INFO: Saving data for BW18419: {'created_time': 1774866980.836133, 'last_price_update_time': 1774866980.836149, 'auction_closing_time': 1774970061.0}
2026-03-30 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW18419') HTTP/1.1" 204 0
2026-03-30 10:36:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee442450>
2026-03-30 10:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_1aa774b4a9a7a0f01ef266d9bfa9f7b2.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_1aa774b4a9a7a0f01ef266d9bfa9f7b2.jpg saved to cache
2026-03-30 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d63708c1-fd06-5daa-8d4b-d9f87ef758ef
2026-03-30 10:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LD24624> (referer: https://www.auto1.com/v1/car-details-view/LD24624/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f436f750>
2026-03-30 10:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_9fecd8c003d3eaef5b5b029de203b376.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_9fecd8c003d3eaef5b5b029de203b376.jpg saved to cache
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3747c004-7e5b-5988-be7d-57376c2dd088
2026-03-30 10:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1881354-acac-533f-b302-5bddf0d1f477 with identifier: LD24624
2026-03-30 10:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1881354-acac-533f-b302-5bddf0d1f477 with scrape type 1
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c1881354-acac-533f-b302-5bddf0d1f477
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_9137d11948a8da9677574233c682a78a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_9137d11948a8da9677574233c682a78a.jpg not downloaded yet
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_3bcb9efec869d3545dfb30b586d3eba0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_54ed3ff54b32e4f749be61a6a9174936.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_d843d15335226b0cb70c7c6ad1c9c211.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_70b7d4bd33b31fd738135ad5f4eb9b50.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_70b7d4bd33b31fd738135ad5f4eb9b50.jpg not downloaded yet
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_7018c3d392c3a125b20116cf8af4dae2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_7018c3d392c3a125b20116cf8af4dae2.jpg not downloaded yet
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_e22e99061df706d3e1596399908cbe90.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_e22e99061df706d3e1596399908cbe90.jpg not downloaded yet
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_7839978dd3ea6a5d9728a70c93f17230.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_7839978dd3ea6a5d9728a70c93f17230.jpg not downloaded yet
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_590565c4a1d670b381beed4ca9890791.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_590565c4a1d670b381beed4ca9890791.jpg not downloaded yet
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_f95a8213fc1e7073187701a0100ddf9c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_6fa7572d961cc671c094adc995b10e60.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_6fa7572d961cc671c094adc995b10e60.jpg not downloaded yet
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_9137d11948a8da9677574233c682a78a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_d774a40a359983458c996fdbde767ee0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee002d0>
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_3bcb9efec869d3545dfb30b586d3eba0.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_3bcb9efec869d3545dfb30b586d3eba0.jpg saved to cache
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3747c004-7e5b-5988-be7d-57376c2dd088
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef5850>
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_54ed3ff54b32e4f749be61a6a9174936.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_54ed3ff54b32e4f749be61a6a9174936.jpg saved to cache
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3747c004-7e5b-5988-be7d-57376c2dd088
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef75190>
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_d843d15335226b0cb70c7c6ad1c9c211.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_d843d15335226b0cb70c7c6ad1c9c211.jpg saved to cache
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3747c004-7e5b-5988-be7d-57376c2dd088
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_e1a8610d70434c583556b95a11c5d573.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_e1a8610d70434c583556b95a11c5d573.jpg not downloaded yet
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_41e32105d36a11205536752c3c7586ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_41e32105d36a11205536752c3c7586ab.jpg not downloaded yet
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef7b50>
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_f95a8213fc1e7073187701a0100ddf9c.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_f95a8213fc1e7073187701a0100ddf9c.jpg saved to cache
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3747c004-7e5b-5988-be7d-57376c2dd088
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41bded0>
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_9137d11948a8da9677574233c682a78a.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_9137d11948a8da9677574233c682a78a.jpg saved to cache
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1881354-acac-533f-b302-5bddf0d1f477
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4293810>
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_d774a40a359983458c996fdbde767ee0.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_d774a40a359983458c996fdbde767ee0.jpg saved to cache
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3747c004-7e5b-5988-be7d-57376c2dd088
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_dfd87b2473a2532e4369df46ad7b4c9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_dfd87b2473a2532e4369df46ad7b4c9d.jpg not downloaded yet
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_e22e99061df706d3e1596399908cbe90.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_7839978dd3ea6a5d9728a70c93f17230.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_590565c4a1d670b381beed4ca9890791.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee14350>
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_e22e99061df706d3e1596399908cbe90.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_e22e99061df706d3e1596399908cbe90.jpg saved to cache
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c1881354-acac-533f-b302-5bddf0d1f477
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429f190>
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_7839978dd3ea6a5d9728a70c93f17230.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_7839978dd3ea6a5d9728a70c93f17230.jpg saved to cache
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c1881354-acac-533f-b302-5bddf0d1f477
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee16d50>
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_590565c4a1d670b381beed4ca9890791.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_590565c4a1d670b381beed4ca9890791.jpg saved to cache
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c1881354-acac-533f-b302-5bddf0d1f477
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_e1a8610d70434c583556b95a11c5d573.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_41e32105d36a11205536752c3c7586ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_dfd87b2473a2532e4369df46ad7b4c9d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429d650>
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_e1a8610d70434c583556b95a11c5d573.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_e1a8610d70434c583556b95a11c5d573.jpg saved to cache
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c1881354-acac-533f-b302-5bddf0d1f477
2026-03-30 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_7018c3d392c3a125b20116cf8af4dae2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_70b7d4bd33b31fd738135ad5f4eb9b50.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41fe7d0>
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_41e32105d36a11205536752c3c7586ab.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_41e32105d36a11205536752c3c7586ab.jpg saved to cache
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c1881354-acac-533f-b302-5bddf0d1f477
2026-03-30 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_27f70e42eef5e246523920b5768c3ddc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee3dc10>
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_dfd87b2473a2532e4369df46ad7b4c9d.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_dfd87b2473a2532e4369df46ad7b4c9d.jpg saved to cache
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c1881354-acac-533f-b302-5bddf0d1f477
2026-03-30 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_6fa7572d961cc671c094adc995b10e60.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_38c41ac4b8e3d8c73eb3a0d3fe7936ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee459b10>
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_7018c3d392c3a125b20116cf8af4dae2.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_7018c3d392c3a125b20116cf8af4dae2.jpg saved to cache
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c1881354-acac-533f-b302-5bddf0d1f477
2026-03-30 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_009298c6fba1ec8a01ae41a5adf76553.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_b9f0459ed11a6f10f32d720a90344cbb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5bdce50>
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_70b7d4bd33b31fd738135ad5f4eb9b50.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_70b7d4bd33b31fd738135ad5f4eb9b50.jpg saved to cache
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c1881354-acac-533f-b302-5bddf0d1f477
2026-03-30 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_d1e3bfa4051466cb4e035f576b8b2ed0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee16e90>
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_27f70e42eef5e246523920b5768c3ddc.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_27f70e42eef5e246523920b5768c3ddc.jpg saved to cache
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3747c004-7e5b-5988-be7d-57376c2dd088
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefb5b10>
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F66%252Fc6663d107aad9a58e269f59556e440e0%252Fpa%252FLD24624_6fa7572d961cc671c094adc995b10e60.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_6fa7572d961cc671c094adc995b10e60.jpg saved to cache
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c1881354-acac-533f-b302-5bddf0d1f477
2026-03-30 10:36:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1881354-acac-533f-b302-5bddf0d1f477, skipping ID generation
2026-03-30 10:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1881354-acac-533f-b302-5bddf0d1f477 with scrape type 1
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1881354-acac-533f-b302-5bddf0d1f477 sending to next pipeline
2026-03-30 10:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1881354-acac-533f-b302-5bddf0d1f477, identifier: LD24624
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4395410>
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_38c41ac4b8e3d8c73eb3a0d3fe7936ec.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_38c41ac4b8e3d8c73eb3a0d3fe7936ec.jpg saved to cache
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3747c004-7e5b-5988-be7d-57376c2dd088
2026-03-30 10:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1881354-acac-533f-b302-5bddf0d1f477 with identifier: LD24624
2026-03-30 10:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1881354-acac-533f-b302-5bddf0d1f477 with identifier: LD24624
2026-03-30 10:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1881354-acac-533f-b302-5bddf0d1f477 with identifier: LD24624 to the API
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_6fa7572d961cc671c094adc995b10e60.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:36:56Z',
 'fuel_type': 'petrol',
 'id': 'c1881354-acac-533f-b302-5bddf0d1f477',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD24624',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 39830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_9137d11948a8da9677574233c682a78a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_70b7d4bd33b31fd738135ad5f4eb9b50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_7018c3d392c3a125b20116cf8af4dae2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_e22e99061df706d3e1596399908cbe90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_7839978dd3ea6a5d9728a70c93f17230.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_590565c4a1d670b381beed4ca9890791.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_6fa7572d961cc671c094adc995b10e60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_e1a8610d70434c583556b95a11c5d573.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_41e32105d36a11205536752c3c7586ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1881354-acac-533f-b302-5bddf0d1f477/c1881354-acac-533f-b302-5bddf0d1f477_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/66/c6663d107aad9a58e269f59556e440e0/pa/LD24624_dfd87b2473a2532e4369df46ad7b4c9d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2021}
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD24624%27 HTTP/1.1" 200 None
2026-03-30 10:36:23 [auto1.de] INFO: Saving data for LD24624: {'created_time': 1774866983.154874, 'last_price_update_time': 1774866983.154885, 'auction_closing_time': 1774971416.0}
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD24624') HTTP/1.1" 204 0
2026-03-30 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_207efbcddabfa6a2989b08509a5e165e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee458050>
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_009298c6fba1ec8a01ae41a5adf76553.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_009298c6fba1ec8a01ae41a5adf76553.jpg saved to cache
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3747c004-7e5b-5988-be7d-57376c2dd088
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f437ad90>
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F2d%252F202d724b6d8aab4a072360f363988200%252Fpa%252FCP02770_b9f0459ed11a6f10f32d720a90344cbb.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_b9f0459ed11a6f10f32d720a90344cbb.jpg saved to cache
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3747c004-7e5b-5988-be7d-57376c2dd088
2026-03-30 10:36:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3747c004-7e5b-5988-be7d-57376c2dd088, skipping ID generation
2026-03-30 10:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3747c004-7e5b-5988-be7d-57376c2dd088 with scrape type 1
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3747c004-7e5b-5988-be7d-57376c2dd088 sending to next pipeline
2026-03-30 10:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3747c004-7e5b-5988-be7d-57376c2dd088, identifier: CP02770
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4166e10>
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_d1e3bfa4051466cb4e035f576b8b2ed0.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_d1e3bfa4051466cb4e035f576b8b2ed0.jpg saved to cache
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8
2026-03-30 10:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3747c004-7e5b-5988-be7d-57376c2dd088 with identifier: CP02770
2026-03-30 10:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3747c004-7e5b-5988-be7d-57376c2dd088 with identifier: CP02770
2026-03-30 10:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3747c004-7e5b-5988-be7d-57376c2dd088 with identifier: CP02770 to the API
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_b9f0459ed11a6f10f32d720a90344cbb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:41:02Z',
 'fuel_type': 'petrol',
 'id': '3747c004-7e5b-5988-be7d-57376c2dd088',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP02770',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 184133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_b9f0459ed11a6f10f32d720a90344cbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_009298c6fba1ec8a01ae41a5adf76553.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_38c41ac4b8e3d8c73eb3a0d3fe7936ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_27f70e42eef5e246523920b5768c3ddc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_f95a8213fc1e7073187701a0100ddf9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_d774a40a359983458c996fdbde767ee0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_54ed3ff54b32e4f749be61a6a9174936.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_3bcb9efec869d3545dfb30b586d3eba0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_d843d15335226b0cb70c7c6ad1c9c211.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3747c004-7e5b-5988-be7d-57376c2dd088/3747c004-7e5b-5988-be7d-57376c2dd088_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/2d/202d724b6d8aab4a072360f363988200/pa/CP02770_9fecd8c003d3eaef5b5b029de203b376.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2017}
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP02770%27 HTTP/1.1" 200 None
2026-03-30 10:36:23 [auto1.de] INFO: Saving data for CP02770: {'created_time': 1774866983.851852, 'last_price_update_time': 1774866983.851863, 'auction_closing_time': 1774971662.0}
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP02770') HTTP/1.1" 204 0
2026-03-30 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_4563d5d77eaad0dea3c99e2d32ff8814.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4339090>
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_207efbcddabfa6a2989b08509a5e165e.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_207efbcddabfa6a2989b08509a5e165e.jpg saved to cache
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8
2026-03-30 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_12c18fcd0a2bc75e6515368380727220.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_8f011a16ff4a1203ccd3c1302a428e86.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58d31d0>
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_4563d5d77eaad0dea3c99e2d32ff8814.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_4563d5d77eaad0dea3c99e2d32ff8814.jpg saved to cache
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8
2026-03-30 10:36:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef72190>
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_12c18fcd0a2bc75e6515368380727220.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_12c18fcd0a2bc75e6515368380727220.jpg saved to cache
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d63708c1-fd06-5daa-8d4b-d9f87ef758ef
2026-03-30 10:36:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58d1e50>
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_8f011a16ff4a1203ccd3c1302a428e86.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_8f011a16ff4a1203ccd3c1302a428e86.jpg saved to cache
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fbd9ca6d-2eab-53cd-b404-cd1030af16c2
2026-03-30 10:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_206841a5bf11f56bc65618b0a3a632d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_b881d101588bf0d3bc8ece32bbfc7fe7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_91afaaf9b74beb21f05e515f40ced17c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7c590>
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_206841a5bf11f56bc65618b0a3a632d2.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_206841a5bf11f56bc65618b0a3a632d2.jpg saved to cache
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d63708c1-fd06-5daa-8d4b-d9f87ef758ef
2026-03-30 10:36:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee778d0>
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_b881d101588bf0d3bc8ece32bbfc7fe7.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_b881d101588bf0d3bc8ece32bbfc7fe7.jpg saved to cache
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fbd9ca6d-2eab-53cd-b404-cd1030af16c2
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5987150>
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_91afaaf9b74beb21f05e515f40ced17c.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_91afaaf9b74beb21f05e515f40ced17c.jpg saved to cache
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8
2026-03-30 10:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_a3042f7a139c25dc6a46b52e522fb3d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_4b0ea85bce0001d2d1d00f5918b00c6e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_6efe14bf48419d207772ee1b794b026f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c08890>
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_a3042f7a139c25dc6a46b52e522fb3d5.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_a3042f7a139c25dc6a46b52e522fb3d5.jpg saved to cache
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8
2026-03-30 10:36:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeef7d0>
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb0%252Fe9b07bce5c82b7d8fa8555464c1bdcda%252Fpa%252FYP09894_4b0ea85bce0001d2d1d00f5918b00c6e.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_4b0ea85bce0001d2d1d00f5918b00c6e.jpg saved to cache
2026-03-30 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fbd9ca6d-2eab-53cd-b404-cd1030af16c2
2026-03-30 10:36:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fbd9ca6d-2eab-53cd-b404-cd1030af16c2, skipping ID generation
2026-03-30 10:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbd9ca6d-2eab-53cd-b404-cd1030af16c2 with scrape type 1
2026-03-30 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fbd9ca6d-2eab-53cd-b404-cd1030af16c2 sending to next pipeline
2026-03-30 10:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbd9ca6d-2eab-53cd-b404-cd1030af16c2, identifier: YP09894
2026-03-30 10:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbd9ca6d-2eab-53cd-b404-cd1030af16c2 with identifier: YP09894
2026-03-30 10:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbd9ca6d-2eab-53cd-b404-cd1030af16c2 with identifier: YP09894
2026-03-30 10:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbd9ca6d-2eab-53cd-b404-cd1030af16c2 with identifier: YP09894 to the API
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_4b0ea85bce0001d2d1d00f5918b00c6e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 181,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:51:14Z',
 'fuel_type': 'petrol',
 'id': 'fbd9ca6d-2eab-53cd-b404-cd1030af16c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP09894',
 'listing': 'auction',
 'location': 'DE, Ulm-Senden',
 'make': 'BMW',
 'model': '3er',
 'odometer': 156727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2743974,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_4b0ea85bce0001d2d1d00f5918b00c6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2959714,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_ee3f5895d9fc5496164cbd3288dbaad8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2874425,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_4758e44ad3cb91cd98375fa102a05517.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3018182,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_b881d101588bf0d3bc8ece32bbfc7fe7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3039912,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_8f011a16ff4a1203ccd3c1302a428e86.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2751192,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_a3b2491ff41b8a2670c491f6cfb2d60c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3011622,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_f33c67e6280dfd7826f63b2fd7a20cfe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3102959,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_212872d1fca04c887c71901c53bc542a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2829903,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_b328e9cffc498fca5c9f54bf09bc4b0b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbd9ca6d-2eab-53cd-b404-cd1030af16c2/fbd9ca6d-2eab-53cd-b404-cd1030af16c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3195659,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b0/e9b07bce5c82b7d8fa8555464c1bdcda/pa/YP09894_6448d10e9d8ae94f875fcbadf0061feb.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-21',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 3er 325i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP09894%27 HTTP/1.1" 200 None
2026-03-30 10:36:25 [auto1.de] INFO: Saving data for YP09894: {'created_time': 1774866985.526726, 'last_price_update_time': 1774866985.526736, 'auction_closing_time': 1774972274.0}
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP09894') HTTP/1.1" 204 0
2026-03-30 10:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeec3d0>
2026-03-30 10:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa2%252F68a23919f74d75a9c668e9c4adaccf61%252Fpa%252FLK73650_6efe14bf48419d207772ee1b794b026f.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_6efe14bf48419d207772ee1b794b026f.jpg saved to cache
2026-03-30 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8
2026-03-30 10:36:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8, skipping ID generation
2026-03-30 10:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8 with scrape type 1
2026-03-30 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8 sending to next pipeline
2026-03-30 10:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8, identifier: LK73650
2026-03-30 10:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8 with identifier: LK73650
2026-03-30 10:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8 with identifier: LK73650
2026-03-30 10:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 003e53b0-21a9-5d5d-8a51-e2e4199d2fe8 with identifier: LK73650 to the API
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_6efe14bf48419d207772ee1b794b026f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:45:18Z',
 'fuel_type': 'petrol',
 'id': '003e53b0-21a9-5d5d-8a51-e2e4199d2fe8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK73650',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 36917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_6efe14bf48419d207772ee1b794b026f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_a3042f7a139c25dc6a46b52e522fb3d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_6fa130ecf2fbc4480deeceb0437c0c87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_d2eeb58cfdc816027d3d8a16ef69056e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_91afaaf9b74beb21f05e515f40ced17c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_4563d5d77eaad0dea3c99e2d32ff8814.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_207efbcddabfa6a2989b08509a5e165e.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_d1e3bfa4051466cb4e035f576b8b2ed0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_ed1b96f9fd581ec9ce036c3759f66dd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003e53b0-21a9-5d5d-8a51-e2e4199d2fe8/003e53b0-21a9-5d5d-8a51-e2e4199d2fe8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a2/68a23919f74d75a9c668e9c4adaccf61/pa/LK73650_6755d5decb1b175ab4aa7d8ae8fbc055.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2023}
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK73650%27 HTTP/1.1" 200 None
2026-03-30 10:36:26 [auto1.de] INFO: Saving data for LK73650: {'created_time': 1774866986.09632, 'last_price_update_time': 1774866986.09633, 'auction_closing_time': 1774971918.0}
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK73650') HTTP/1.1" 204 0
2026-03-30 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_ab31c4c016fd8b9b41a1c5a7f556ff3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_de75eee4f840910e3b449ce94123e670.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:26 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 9420 | hits on page: 40
2026-03-30 10:36:26 [auto1.de] INFO: Found listing with ID: UY84465
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY84465%27 HTTP/1.1" 200 None
2026-03-30 10:36:26 [auto1.de] INFO: Scrape type for UY84465: 0
2026-03-30 10:36:26 [auto1.de] INFO: Found listing with ID: BM81671
2026-03-30 10:36:26 [auto1.de] INFO: Found listing with ID: RS58437
2026-03-30 10:36:26 [auto1.de] INFO: Found listing with ID: RD39449
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD39449%27 HTTP/1.1" 200 None
2026-03-30 10:36:26 [auto1.de] INFO: Scrape type for RD39449: 0
2026-03-30 10:36:26 [auto1.de] INFO: Found listing with ID: KF94036
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF94036%27 HTTP/1.1" 200 None
2026-03-30 10:36:26 [auto1.de] INFO: Scrape type for KF94036: 0
2026-03-30 10:36:26 [auto1.de] INFO: Found listing with ID: FF99965
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF99965%27 HTTP/1.1" 200 None
2026-03-30 10:36:26 [auto1.de] INFO: Scrape type for FF99965: 0
2026-03-30 10:36:26 [auto1.de] INFO: Found listing with ID: JZ50172
2026-03-30 10:36:26 [auto1.de] INFO: Found listing with ID: HW82301
2026-03-30 10:36:26 [auto1.de] INFO: Found listing with ID: AU89070
2026-03-30 10:36:26 [auto1.de] INFO: Found listing with ID: FR29182
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR29182%27 HTTP/1.1" 200 None
2026-03-30 10:36:26 [auto1.de] INFO: Scrape type for FR29182: 2
2026-03-30 10:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d715a47-11b2-5bb4-aa39-0cfeb41aa504 with identifier: FR29182
2026-03-30 10:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d715a47-11b2-5bb4-aa39-0cfeb41aa504 with scrape type 2
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d715a47-11b2-5bb4-aa39-0cfeb41aa504 with scrape type 2
2026-03-30 10:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d715a47-11b2-5bb4-aa39-0cfeb41aa504, identifier: FR29182
2026-03-30 10:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d715a47-11b2-5bb4-aa39-0cfeb41aa504 with identifier: FR29182
2026-03-30 10:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d715a47-11b2-5bb4-aa39-0cfeb41aa504 with identifier: FR29182
2026-03-30 10:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d715a47-11b2-5bb4-aa39-0cfeb41aa504 with identifier: FR29182 to the API
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:20:12Z',
 'fuel_type': 'petrol',
 'id': '5d715a47-11b2-5bb4-aa39-0cfeb41aa504',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR29182',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 77910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-11',
 'seller_name': None,
 'title': 'Audi A4 40 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR29182%27 HTTP/1.1" 200 None
2026-03-30 10:36:26 [auto1.de] INFO: Saving data for FR29182: {'auction_closing_time': 1774970412.0, 'created_time': 1774294060.217316, 'last_price_update_time': 1774866986.77815}
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR29182') HTTP/1.1" 204 0
2026-03-30 10:36:26 [auto1.de] INFO: Found listing with ID: XB70310
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB70310%27 HTTP/1.1" 200 None
2026-03-30 10:36:26 [auto1.de] INFO: Scrape type for XB70310: 1
2026-03-30 10:36:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7c510>
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_ab31c4c016fd8b9b41a1c5a7f556ff3a.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_ab31c4c016fd8b9b41a1c5a7f556ff3a.jpg saved to cache
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d63708c1-fd06-5daa-8d4b-d9f87ef758ef
2026-03-30 10:36:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef63290>
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F6a%252Fba6abcb1be5997ce60734c119fa177ec%252Fpa%252FTN19858_de75eee4f840910e3b449ce94123e670.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_de75eee4f840910e3b449ce94123e670.jpg saved to cache
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d63708c1-fd06-5daa-8d4b-d9f87ef758ef
2026-03-30 10:36:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d63708c1-fd06-5daa-8d4b-d9f87ef758ef, skipping ID generation
2026-03-30 10:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d63708c1-fd06-5daa-8d4b-d9f87ef758ef with scrape type 1
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d63708c1-fd06-5daa-8d4b-d9f87ef758ef sending to next pipeline
2026-03-30 10:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d63708c1-fd06-5daa-8d4b-d9f87ef758ef, identifier: TN19858
2026-03-30 10:36:27 [auto1.de] INFO: Found listing with ID: EZ67237
2026-03-30 10:36:27 [auto1.de] INFO: Found listing with ID: EB31634
2026-03-30 10:36:27 [auto1.de] INFO: Found listing with ID: CC86665
2026-03-30 10:36:27 [auto1.de] INFO: Found listing with ID: MY16405
2026-03-30 10:36:27 [auto1.de] INFO: Found listing with ID: WJ46951
2026-03-30 10:36:27 [auto1.de] INFO: Found listing with ID: BR65337
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR65337%27 HTTP/1.1" 200 None
2026-03-30 10:36:27 [auto1.de] INFO: Scrape type for BR65337: 1
2026-03-30 10:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d63708c1-fd06-5daa-8d4b-d9f87ef758ef with identifier: TN19858
2026-03-30 10:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d63708c1-fd06-5daa-8d4b-d9f87ef758ef with identifier: TN19858
2026-03-30 10:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d63708c1-fd06-5daa-8d4b-d9f87ef758ef with identifier: TN19858 to the API
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_de75eee4f840910e3b449ce94123e670.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:12:57Z',
 'fuel_type': 'diesel',
 'id': 'd63708c1-fd06-5daa-8d4b-d9f87ef758ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN19858',
 'listing': 'auction',
 'location': 'DE, Fürth',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 178909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2890154,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_ab31c4c016fd8b9b41a1c5a7f556ff3a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2903560,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_de75eee4f840910e3b449ce94123e670.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2855690,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_8222adf16872435aedddad0d7d5612f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2733701,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_c83756ab93b21a48bfc233353f963357.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2658231,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_206841a5bf11f56bc65618b0a3a632d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2673657,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_12c18fcd0a2bc75e6515368380727220.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2746455,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_e8973bb9267d0ad0b7c510eb338b4244.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2659619,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_1aa774b4a9a7a0f01ef266d9bfa9f7b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2939899,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_0acff0cec4ac5ce6bc51e3770fc0de34.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63708c1-fd06-5daa-8d4b-d9f87ef758ef/d63708c1-fd06-5daa-8d4b-d9f87ef758ef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3225804,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/6a/ba6abcb1be5997ce60734c119fa177ec/pa/TN19858_2c8abc8dfbaf88af60dabdc330e70e16.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI One D',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN19858%27 HTTP/1.1" 200 None
2026-03-30 10:36:27 [auto1.de] INFO: Saving data for TN19858: {'created_time': 1774866987.78064, 'last_price_update_time': 1774866987.780651, 'auction_closing_time': 1774969977.0}
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN19858') HTTP/1.1" 204 0
2026-03-30 10:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC14226/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:27 [auto1.de] INFO: Found listing with ID: LB33247
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB33247%27 HTTP/1.1" 200 None
2026-03-30 10:36:27 [auto1.de] INFO: Scrape type for LB33247: 2
2026-03-30 10:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd546338-3f5f-502a-9c27-b4bfd488b856 with identifier: LB33247
2026-03-30 10:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd546338-3f5f-502a-9c27-b4bfd488b856 with scrape type 2
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd546338-3f5f-502a-9c27-b4bfd488b856 with scrape type 2
2026-03-30 10:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd546338-3f5f-502a-9c27-b4bfd488b856, identifier: LB33247
2026-03-30 10:36:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd546338-3f5f-502a-9c27-b4bfd488b856 with identifier: LB33247
2026-03-30 10:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd546338-3f5f-502a-9c27-b4bfd488b856 with identifier: LB33247
2026-03-30 10:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd546338-3f5f-502a-9c27-b4bfd488b856 with identifier: LB33247 to the API
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:46:11Z',
 'fuel_type': 'diesel',
 'id': 'cd546338-3f5f-502a-9c27-b4bfd488b856',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB33247',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 168156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-26',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB33247%27 HTTP/1.1" 200 None
2026-03-30 10:36:28 [auto1.de] INFO: Saving data for LB33247: {'auction_closing_time': 1774971971.0, 'created_time': 1773307438.30861, 'last_price_update_time': 1774866988.260507}
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB33247') HTTP/1.1" 204 0
2026-03-30 10:36:28 [auto1.de] INFO: Found listing with ID: GP91908
2026-03-30 10:36:28 [auto1.de] INFO: Found listing with ID: KL83940
2026-03-30 10:36:28 [auto1.de] INFO: Found listing with ID: BD87504
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD87504%27 HTTP/1.1" 200 None
2026-03-30 10:36:28 [auto1.de] INFO: Scrape type for BD87504: 1
2026-03-30 10:36:28 [auto1.de] INFO: Found listing with ID: RC82112
2026-03-30 10:36:28 [auto1.de] INFO: Found listing with ID: BS31363
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS31363%27 HTTP/1.1" 200 None
2026-03-30 10:36:28 [auto1.de] INFO: Scrape type for BS31363: 1
2026-03-30 10:36:28 [auto1.de] INFO: Found listing with ID: YB65730
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB65730%27 HTTP/1.1" 200 None
2026-03-30 10:36:28 [auto1.de] INFO: Scrape type for YB65730: 1
2026-03-30 10:36:28 [auto1.de] INFO: Found listing with ID: BE30085
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE30085%27 HTTP/1.1" 200 None
2026-03-30 10:36:28 [auto1.de] INFO: Scrape type for BE30085: 2
2026-03-30 10:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a82e0269-2b50-5298-8cfb-262a6a246dab with identifier: BE30085
2026-03-30 10:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a82e0269-2b50-5298-8cfb-262a6a246dab with scrape type 2
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a82e0269-2b50-5298-8cfb-262a6a246dab with scrape type 2
2026-03-30 10:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a82e0269-2b50-5298-8cfb-262a6a246dab, identifier: BE30085
2026-03-30 10:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a82e0269-2b50-5298-8cfb-262a6a246dab with identifier: BE30085
2026-03-30 10:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a82e0269-2b50-5298-8cfb-262a6a246dab with identifier: BE30085
2026-03-30 10:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a82e0269-2b50-5298-8cfb-262a6a246dab with identifier: BE30085 to the API
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:08:53Z',
 'fuel_type': 'diesel',
 'id': 'a82e0269-2b50-5298-8cfb-262a6a246dab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE30085',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 79231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-14',
 'seller_name': None,
 'title': 'Dacia Lodgy 1.5 Blue dCi Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2019}
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE30085%27 HTTP/1.1" 200 None
2026-03-30 10:36:28 [auto1.de] INFO: Saving data for BE30085: {'auction_closing_time': 1774969733.0, 'created_time': 1774264777.250002, 'last_price_update_time': 1774866988.960791}
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE30085') HTTP/1.1" 204 0
2026-03-30 10:36:29 [auto1.de] INFO: Found listing with ID: BP48504
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP48504%27 HTTP/1.1" 200 None
2026-03-30 10:36:29 [auto1.de] INFO: Scrape type for BP48504: 2
2026-03-30 10:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a9385f2-7d31-5e73-a432-163bf853f87e with identifier: BP48504
2026-03-30 10:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a9385f2-7d31-5e73-a432-163bf853f87e with scrape type 2
2026-03-30 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a9385f2-7d31-5e73-a432-163bf853f87e with scrape type 2
2026-03-30 10:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a9385f2-7d31-5e73-a432-163bf853f87e, identifier: BP48504
2026-03-30 10:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a9385f2-7d31-5e73-a432-163bf853f87e with identifier: BP48504
2026-03-30 10:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a9385f2-7d31-5e73-a432-163bf853f87e with identifier: BP48504
2026-03-30 10:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a9385f2-7d31-5e73-a432-163bf853f87e with identifier: BP48504 to the API
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:04:59Z',
 'fuel_type': 'diesel',
 'id': '0a9385f2-7d31-5e73-a432-163bf853f87e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP48504',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 225722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-19',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 111 CDI lang Tourer Edition',
 'transmission': 'manual',
 'trim': 'lang Tourer Edition',
 'year': 2018}
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP48504%27 HTTP/1.1" 200 None
2026-03-30 10:36:29 [auto1.de] INFO: Saving data for BP48504: {'auction_closing_time': 1774969499.0, 'created_time': 1774293441.475331, 'last_price_update_time': 1774866989.601768}
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP48504') HTTP/1.1" 204 0
2026-03-30 10:36:29 [auto1.de] INFO: Found listing with ID: FY06899
2026-03-30 10:36:29 [auto1.de] INFO: Found listing with ID: UW88941
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW88941%27 HTTP/1.1" 200 None
2026-03-30 10:36:29 [auto1.de] INFO: Scrape type for UW88941: 1
2026-03-30 10:36:29 [auto1.de] INFO: Found listing with ID: LZ79063
2026-03-30 10:36:29 [auto1.de] INFO: Found listing with ID: JA98582
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA98582%27 HTTP/1.1" 200 None
2026-03-30 10:36:29 [auto1.de] INFO: Scrape type for JA98582: 1
2026-03-30 10:36:29 [auto1.de] INFO: Found listing with ID: HT26975
2026-03-30 10:36:29 [auto1.de] INFO: Found listing with ID: SM57605
2026-03-30 10:36:29 [auto1.de] INFO: Found listing with ID: UC67043
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC67043%27 HTTP/1.1" 200 None
2026-03-30 10:36:29 [auto1.de] INFO: Scrape type for UC67043: 2
2026-03-30 10:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19fa7508-41a2-5aeb-82ad-3613c949b738 with identifier: UC67043
2026-03-30 10:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19fa7508-41a2-5aeb-82ad-3613c949b738 with scrape type 2
2026-03-30 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19fa7508-41a2-5aeb-82ad-3613c949b738 with scrape type 2
2026-03-30 10:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19fa7508-41a2-5aeb-82ad-3613c949b738, identifier: UC67043
2026-03-30 10:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19fa7508-41a2-5aeb-82ad-3613c949b738 with identifier: UC67043
2026-03-30 10:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19fa7508-41a2-5aeb-82ad-3613c949b738 with identifier: UC67043
2026-03-30 10:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19fa7508-41a2-5aeb-82ad-3613c949b738 with identifier: UC67043 to the API
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:15:37Z',
 'fuel_type': 'diesel',
 'id': '19fa7508-41a2-5aeb-82ad-3613c949b738',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC67043',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 182880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-28',
 'seller_name': None,
 'title': 'Mazda 3 2.2 Turbodiesel Exclusive-Line',
 'transmission': 'manual',
 'trim': 'Exclusive-Line',
 'year': 2017}
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC67043%27 HTTP/1.1" 200 None
2026-03-30 10:36:30 [auto1.de] INFO: Saving data for UC67043: {'auction_closing_time': 1774970137.0, 'created_time': 1773304838.319009, 'last_price_update_time': 1774866990.080802}
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC67043') HTTP/1.1" 204 0
2026-03-30 10:36:30 [auto1.de] INFO: Found listing with ID: MH55571
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH55571%27 HTTP/1.1" 200 None
2026-03-30 10:36:30 [auto1.de] INFO: Scrape type for MH55571: 1
2026-03-30 10:36:30 [auto1.de] INFO: Found listing with ID: HM13526
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM13526%27 HTTP/1.1" 200 None
2026-03-30 10:36:30 [auto1.de] INFO: Scrape type for HM13526: 1
2026-03-30 10:36:30 [auto1.de] INFO: Found listing with ID: MN78455
2026-03-30 10:36:30 [auto1.de] INFO: Found listing with ID: PZ62631
2026-03-30 10:36:30 [auto1.de] INFO: Found listing with ID: HH83846
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH83846%27 HTTP/1.1" 200 None
2026-03-30 10:36:30 [auto1.de] INFO: Scrape type for HH83846: 2
2026-03-30 10:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 086e5577-a2d8-5b33-bc88-f199cf0c7377 with identifier: HH83846
2026-03-30 10:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 086e5577-a2d8-5b33-bc88-f199cf0c7377 with scrape type 2
2026-03-30 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 086e5577-a2d8-5b33-bc88-f199cf0c7377 with scrape type 2
2026-03-30 10:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 086e5577-a2d8-5b33-bc88-f199cf0c7377, identifier: HH83846
2026-03-30 10:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 086e5577-a2d8-5b33-bc88-f199cf0c7377 with identifier: HH83846
2026-03-30 10:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 086e5577-a2d8-5b33-bc88-f199cf0c7377 with identifier: HH83846
2026-03-30 10:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 086e5577-a2d8-5b33-bc88-f199cf0c7377 with identifier: HH83846 to the API
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:02:29Z',
 'fuel_type': 'petrol',
 'id': '086e5577-a2d8-5b33-bc88-f199cf0c7377',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH83846',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 119527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-19',
 'seller_name': None,
 'title': 'Seat Leon 1.8 TSI Xcellence',
 'transmission': 'manual',
 'trim': 'Xcellence',
 'year': 2018}
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH83846%27 HTTP/1.1" 200 None
2026-03-30 10:36:30 [auto1.de] INFO: Saving data for HH83846: {'auction_closing_time': 1774969349.0, 'created_time': 1774379389.593298, 'last_price_update_time': 1774866990.553902}
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH83846') HTTP/1.1" 204 0
2026-03-30 10:36:30 [auto1.de] INFO: Found listing with ID: LH15693
2026-03-30 10:36:30 [auto1.de] INFO: Found listing with ID: ZM57551
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM57551%27 HTTP/1.1" 200 None
2026-03-30 10:36:30 [auto1.de] INFO: Scrape type for ZM57551: 1
2026-03-30 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_ee76aa321f0c13da40bd948585b362ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef38350>
2026-03-30 10:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_ee76aa321f0c13da40bd948585b362ef.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_ee76aa321f0c13da40bd948585b362ef.jpg saved to cache
2026-03-30 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8b4ed73-b977-51b6-9904-16b975722641
2026-03-30 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TM34763/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE74181> (referer: https://www.auto1.com/v1/car-details-view/GE74181/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 541820ba-e526-5e69-8850-8921fe0f4852 with identifier: GE74181
2026-03-30 10:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 541820ba-e526-5e69-8850-8921fe0f4852 with scrape type 1
2026-03-30 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 541820ba-e526-5e69-8850-8921fe0f4852
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff3%252Ff7f3f86eeaba6fd4878e736d5ce9a419%252Fpa%252FGE74181_0414d25299967b46dc8c3b8c2154ed22.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_0414d25299967b46dc8c3b8c2154ed22.jpg already downloaded
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff3%252Ff7f3f86eeaba6fd4878e736d5ce9a419%252Fpa%252FGE74181_424aab562f20da66ebcad68e0e3492a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_424aab562f20da66ebcad68e0e3492a4.jpg already downloaded
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff3%252Ff7f3f86eeaba6fd4878e736d5ce9a419%252Fpa%252FGE74181_eaf7d1beb0feaf7143fdd930135d6087.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_eaf7d1beb0feaf7143fdd930135d6087.jpg already downloaded
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff3%252Ff7f3f86eeaba6fd4878e736d5ce9a419%252Fpa%252FGE74181_0dd0481a1dd5886276faf95088d6cc20.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_0dd0481a1dd5886276faf95088d6cc20.jpg already downloaded
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff3%252Ff7f3f86eeaba6fd4878e736d5ce9a419%252Fpa%252FGE74181_74caf9bdc9834cc3c092d9846a876819.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_74caf9bdc9834cc3c092d9846a876819.jpg already downloaded
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff3%252Ff7f3f86eeaba6fd4878e736d5ce9a419%252Fpa%252FGE74181_a38a8cc426106c07bb86d8c4c3b89f5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_a38a8cc426106c07bb86d8c4c3b89f5c.jpg already downloaded
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff3%252Ff7f3f86eeaba6fd4878e736d5ce9a419%252Fpa%252FGE74181_b25d534f91540b4cde990516ff39f59e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_b25d534f91540b4cde990516ff39f59e.jpg already downloaded
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff3%252Ff7f3f86eeaba6fd4878e736d5ce9a419%252Fpa%252FGE74181_95d69f7216756528901bf1632a649adb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_95d69f7216756528901bf1632a649adb.jpg already downloaded
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff3%252Ff7f3f86eeaba6fd4878e736d5ce9a419%252Fpa%252FGE74181_38fd72676f1685f60ddcf66951e784d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_38fd72676f1685f60ddcf66951e784d6.jpg already downloaded
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff3%252Ff7f3f86eeaba6fd4878e736d5ce9a419%252Fpa%252FGE74181_09da83e1fb7d46398bfb2071e31de707.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_09da83e1fb7d46398bfb2071e31de707.jpg already downloaded
2026-03-30 10:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 541820ba-e526-5e69-8850-8921fe0f4852, identifier: GE74181
2026-03-30 10:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 541820ba-e526-5e69-8850-8921fe0f4852 with identifier: GE74181
2026-03-30 10:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 541820ba-e526-5e69-8850-8921fe0f4852 with identifier: GE74181
2026-03-30 10:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 541820ba-e526-5e69-8850-8921fe0f4852 with identifier: GE74181 to the API
2026-03-30 10:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GE74181>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:18:56Z',
 'fuel_type': 'petrol',
 'id': '541820ba-e526-5e69-8850-8921fe0f4852',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE74181',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 107771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_0414d25299967b46dc8c3b8c2154ed22.jpg',
                'https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_424aab562f20da66ebcad68e0e3492a4.jpg',
                'https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_eaf7d1beb0feaf7143fdd930135d6087.jpg',
                'https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_0dd0481a1dd5886276faf95088d6cc20.jpg',
                'https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_74caf9bdc9834cc3c092d9846a876819.jpg',
                'https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_a38a8cc426106c07bb86d8c4c3b89f5c.jpg',
                'https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_b25d534f91540b4cde990516ff39f59e.jpg',
                'https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_95d69f7216756528901bf1632a649adb.jpg',
                'https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_38fd72676f1685f60ddcf66951e784d6.jpg',
                'https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_09da83e1fb7d46398bfb2071e31de707.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541820ba-e526-5e69-8850-8921fe0f4852/541820ba-e526-5e69-8850-8921fe0f4852_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_0414d25299967b46dc8c3b8c2154ed22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541820ba-e526-5e69-8850-8921fe0f4852/541820ba-e526-5e69-8850-8921fe0f4852_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2664634,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_424aab562f20da66ebcad68e0e3492a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541820ba-e526-5e69-8850-8921fe0f4852/541820ba-e526-5e69-8850-8921fe0f4852_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_eaf7d1beb0feaf7143fdd930135d6087.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541820ba-e526-5e69-8850-8921fe0f4852/541820ba-e526-5e69-8850-8921fe0f4852_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2399006,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_0dd0481a1dd5886276faf95088d6cc20.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541820ba-e526-5e69-8850-8921fe0f4852/541820ba-e526-5e69-8850-8921fe0f4852_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2055197,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_74caf9bdc9834cc3c092d9846a876819.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541820ba-e526-5e69-8850-8921fe0f4852/541820ba-e526-5e69-8850-8921fe0f4852_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_a38a8cc426106c07bb86d8c4c3b89f5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541820ba-e526-5e69-8850-8921fe0f4852/541820ba-e526-5e69-8850-8921fe0f4852_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1866349,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_b25d534f91540b4cde990516ff39f59e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541820ba-e526-5e69-8850-8921fe0f4852/541820ba-e526-5e69-8850-8921fe0f4852_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2072240,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_95d69f7216756528901bf1632a649adb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541820ba-e526-5e69-8850-8921fe0f4852/541820ba-e526-5e69-8850-8921fe0f4852_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2605944,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_38fd72676f1685f60ddcf66951e784d6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541820ba-e526-5e69-8850-8921fe0f4852/541820ba-e526-5e69-8850-8921fe0f4852_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2545352,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f3/f7f3f86eeaba6fd4878e736d5ce9a419/pa/GE74181_09da83e1fb7d46398bfb2071e31de707.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Yeti 1.8 TSI Ambition Plus Edition 4x4',
 'transmission': 'manual',
 'trim': 'Ambition Plus Edition 4x4',
 'year': 2011}
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE74181%27 HTTP/1.1" 200 None
2026-03-30 10:36:40 [auto1.de] INFO: Saving data for GE74181: {'created_time': 1774867000.199245, 'last_price_update_time': 1774867000.199255, 'auction_closing_time': 1774970336.0}
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE74181') HTTP/1.1" 204 0
2026-03-30 10:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XP42912> (referer: https://www.auto1.com/v1/car-details-view/XP42912/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf4d5243-7735-59ae-bbd9-f4d68c9a7d37 with identifier: XP42912
2026-03-30 10:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf4d5243-7735-59ae-bbd9-f4d68c9a7d37 with scrape type 1
2026-03-30 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf4d5243-7735-59ae-bbd9-f4d68c9a7d37
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_44bf423ebad507f7217affa2625c1278.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_44bf423ebad507f7217affa2625c1278.jpg not downloaded yet
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_b488bf353610594e81808a3abd7ff3f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_b488bf353610594e81808a3abd7ff3f2.jpg not downloaded yet
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_39ee7dcb0881192f8714f1ac5ba823a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_39ee7dcb0881192f8714f1ac5ba823a8.jpg not downloaded yet
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_bac90ddc6a54a9b928f42496b5dccca0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_bac90ddc6a54a9b928f42496b5dccca0.jpg not downloaded yet
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_68aa225bcaa3b1d9493152442140bd5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_68aa225bcaa3b1d9493152442140bd5e.jpg not downloaded yet
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_5fc3b83dbda41c19ce4d5543ffdf4612.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_5fc3b83dbda41c19ce4d5543ffdf4612.jpg not downloaded yet
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_2ed88a8038ca95691e2af932e8fdb669.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_2ed88a8038ca95691e2af932e8fdb669.jpg not downloaded yet
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_04698d36101de270ecf1f2542e885e67.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_04698d36101de270ecf1f2542e885e67.jpg not downloaded yet
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_b00d9f4f0b4904dadaa278cf74e2fdeb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_b00d9f4f0b4904dadaa278cf74e2fdeb.jpg not downloaded yet
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_7695e5abb623a899f0e8ef686595026d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_7695e5abb623a899f0e8ef686595026d.jpg not downloaded yet
2026-03-30 10:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NB58576> (referer: https://www.auto1.com/v1/car-details-view/NB58576/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_7695e5abb623a899f0e8ef686595026d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9 with identifier: NB58576
2026-03-30 10:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9 with scrape type 1
2026-03-30 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_7dc12ff449ea6366afd5b56fd926633f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_7dc12ff449ea6366afd5b56fd926633f.jpg not downloaded yet
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_cf715a3a2c59e4598345efe4adccca5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_cf715a3a2c59e4598345efe4adccca5f.jpg not downloaded yet
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_0fc45fafdd94ba4c3cec2af0d613e773.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_0fc45fafdd94ba4c3cec2af0d613e773.jpg not downloaded yet
2026-03-30 10:36:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5987a90>
2026-03-30 10:36:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_7695e5abb623a899f0e8ef686595026d.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_7695e5abb623a899f0e8ef686595026d.jpg saved to cache
2026-03-30 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf4d5243-7735-59ae-bbd9-f4d68c9a7d37
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_d8a8c5e2333086da29940558989e7780.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_d8a8c5e2333086da29940558989e7780.jpg not downloaded yet
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_910e47e07625a1d35e1092c74b9f7bfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_910e47e07625a1d35e1092c74b9f7bfa.jpg not downloaded yet
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_93e3873fae8ede0b6a6d10aa030f47ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_93e3873fae8ede0b6a6d10aa030f47ef.jpg not downloaded yet
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_6b82bad0f6d7aa083c7010416d890ea6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_6b82bad0f6d7aa083c7010416d890ea6.jpg not downloaded yet
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_dce0e666b445c3ce4d912852207ae6e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_dce0e666b445c3ce4d912852207ae6e1.jpg not downloaded yet
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_4b4b96107789c39fb4f9d3b1a783b471.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_4b4b96107789c39fb4f9d3b1a783b471.jpg not downloaded yet
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_eb909aff2d882a754e267087a9f5610d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_eb909aff2d882a754e267087a9f5610d.jpg not downloaded yet
2026-03-30 10:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_b00d9f4f0b4904dadaa278cf74e2fdeb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8e950>
2026-03-30 10:36:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_b00d9f4f0b4904dadaa278cf74e2fdeb.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_b00d9f4f0b4904dadaa278cf74e2fdeb.jpg saved to cache
2026-03-30 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf4d5243-7735-59ae-bbd9-f4d68c9a7d37
2026-03-30 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_eb909aff2d882a754e267087a9f5610d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef38b10>
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_eb909aff2d882a754e267087a9f5610d.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_eb909aff2d882a754e267087a9f5610d.jpg saved to cache
2026-03-30 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9
2026-03-30 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_4b4b96107789c39fb4f9d3b1a783b471.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef75410>
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_4b4b96107789c39fb4f9d3b1a783b471.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_4b4b96107789c39fb4f9d3b1a783b471.jpg saved to cache
2026-03-30 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9
2026-03-30 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_dce0e666b445c3ce4d912852207ae6e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41bc8d0>
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_dce0e666b445c3ce4d912852207ae6e1.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_dce0e666b445c3ce4d912852207ae6e1.jpg saved to cache
2026-03-30 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9
2026-03-30 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_6b82bad0f6d7aa083c7010416d890ea6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f591fa90>
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_6b82bad0f6d7aa083c7010416d890ea6.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_6b82bad0f6d7aa083c7010416d890ea6.jpg saved to cache
2026-03-30 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9
2026-03-30 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC02244> (referer: https://www.auto1.com/v1/car-details-view/GC02244/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_93e3873fae8ede0b6a6d10aa030f47ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76a3c916-ad5a-5d64-befc-9cfe3178447c with identifier: GC02244
2026-03-30 10:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a3c916-ad5a-5d64-befc-9cfe3178447c with scrape type 1
2026-03-30 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76a3c916-ad5a-5d64-befc-9cfe3178447c
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_7015a86c643be92658fb720259450ef8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_7015a86c643be92658fb720259450ef8.jpg not downloaded yet
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_bf250bcce376b1b408a06902e6fb6191.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_bf250bcce376b1b408a06902e6fb6191.jpg not downloaded yet
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_2f2558612c863ce0b996305571e0c788.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_2f2558612c863ce0b996305571e0c788.jpg not downloaded yet
2026-03-30 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_d8a8c5e2333086da29940558989e7780.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_910e47e07625a1d35e1092c74b9f7bfa.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_cf2c398095a024373e1b6ffa5c3e9ea1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_cf2c398095a024373e1b6ffa5c3e9ea1.jpg not downloaded yet
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_74a0e7f1edc3c6b1b8f9a06d17e867f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_74a0e7f1edc3c6b1b8f9a06d17e867f5.jpg not downloaded yet
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_c132d9b84d7dbc6189559c7f2fcff1f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_c132d9b84d7dbc6189559c7f2fcff1f0.jpg not downloaded yet
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41bc750>
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_93e3873fae8ede0b6a6d10aa030f47ef.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_93e3873fae8ede0b6a6d10aa030f47ef.jpg saved to cache
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_bfc16807c38d5b63fe1ddf0587624b0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_bfc16807c38d5b63fe1ddf0587624b0b.jpg not downloaded yet
2026-03-30 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_7015a86c643be92658fb720259450ef8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_bf250bcce376b1b408a06902e6fb6191.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_f97c9cf9b0bd9eec712dda6ee9344e8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_f97c9cf9b0bd9eec712dda6ee9344e8b.jpg not downloaded yet
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_1509436f07dc849e74bd3cad523d670c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_1509436f07dc849e74bd3cad523d670c.jpg not downloaded yet
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4378f50>
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_d8a8c5e2333086da29940558989e7780.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_d8a8c5e2333086da29940558989e7780.jpg saved to cache
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee73190>
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_910e47e07625a1d35e1092c74b9f7bfa.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_910e47e07625a1d35e1092c74b9f7bfa.jpg saved to cache
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9
2026-03-30 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_74a0e7f1edc3c6b1b8f9a06d17e867f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_55b0d8fc7136dd8d893f615f8f731d74.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_55b0d8fc7136dd8d893f615f8f731d74.jpg not downloaded yet
2026-03-30 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_c132d9b84d7dbc6189559c7f2fcff1f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4389410>
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_7015a86c643be92658fb720259450ef8.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_7015a86c643be92658fb720259450ef8.jpg saved to cache
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76a3c916-ad5a-5d64-befc-9cfe3178447c
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef2250>
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_bf250bcce376b1b408a06902e6fb6191.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_bf250bcce376b1b408a06902e6fb6191.jpg saved to cache
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76a3c916-ad5a-5d64-befc-9cfe3178447c
2026-03-30 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_1509436f07dc849e74bd3cad523d670c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee720d0>
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_74a0e7f1edc3c6b1b8f9a06d17e867f5.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_74a0e7f1edc3c6b1b8f9a06d17e867f5.jpg saved to cache
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76a3c916-ad5a-5d64-befc-9cfe3178447c
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd5350>
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_c132d9b84d7dbc6189559c7f2fcff1f0.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_c132d9b84d7dbc6189559c7f2fcff1f0.jpg saved to cache
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76a3c916-ad5a-5d64-befc-9cfe3178447c
2026-03-30 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_f97c9cf9b0bd9eec712dda6ee9344e8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f591fa90>
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_1509436f07dc849e74bd3cad523d670c.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_1509436f07dc849e74bd3cad523d670c.jpg saved to cache
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 76a3c916-ad5a-5d64-befc-9cfe3178447c
2026-03-30 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_55b0d8fc7136dd8d893f615f8f731d74.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_bfc16807c38d5b63fe1ddf0587624b0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb1090>
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_f97c9cf9b0bd9eec712dda6ee9344e8b.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_f97c9cf9b0bd9eec712dda6ee9344e8b.jpg saved to cache
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76a3c916-ad5a-5d64-befc-9cfe3178447c
2026-03-30 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_cf2c398095a024373e1b6ffa5c3e9ea1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_2f2558612c863ce0b996305571e0c788.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefb6510>
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_55b0d8fc7136dd8d893f615f8f731d74.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_55b0d8fc7136dd8d893f615f8f731d74.jpg saved to cache
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 76a3c916-ad5a-5d64-befc-9cfe3178447c
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434e990>
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_bfc16807c38d5b63fe1ddf0587624b0b.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_bfc16807c38d5b63fe1ddf0587624b0b.jpg saved to cache
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76a3c916-ad5a-5d64-befc-9cfe3178447c
2026-03-30 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_cf715a3a2c59e4598345efe4adccca5f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_0fc45fafdd94ba4c3cec2af0d613e773.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FZ80671/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3ac90>
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_cf2c398095a024373e1b6ffa5c3e9ea1.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_cf2c398095a024373e1b6ffa5c3e9ea1.jpg saved to cache
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76a3c916-ad5a-5d64-befc-9cfe3178447c
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeed190>
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F40%252Fff4094795835a4aa3309ac5bd38717b8%252Fpa%252FGC02244_2f2558612c863ce0b996305571e0c788.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_2f2558612c863ce0b996305571e0c788.jpg saved to cache
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76a3c916-ad5a-5d64-befc-9cfe3178447c
2026-03-30 10:36:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76a3c916-ad5a-5d64-befc-9cfe3178447c, skipping ID generation
2026-03-30 10:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a3c916-ad5a-5d64-befc-9cfe3178447c with scrape type 1
2026-03-30 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76a3c916-ad5a-5d64-befc-9cfe3178447c sending to next pipeline
2026-03-30 10:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76a3c916-ad5a-5d64-befc-9cfe3178447c, identifier: GC02244
2026-03-30 10:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76a3c916-ad5a-5d64-befc-9cfe3178447c with identifier: GC02244
2026-03-30 10:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76a3c916-ad5a-5d64-befc-9cfe3178447c with identifier: GC02244
2026-03-30 10:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76a3c916-ad5a-5d64-befc-9cfe3178447c with identifier: GC02244 to the API
2026-03-30 10:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_2f2558612c863ce0b996305571e0c788.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:21:07Z',
 'fuel_type': 'petrol',
 'id': '76a3c916-ad5a-5d64-befc-9cfe3178447c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC02244',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 59979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_7015a86c643be92658fb720259450ef8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_bf250bcce376b1b408a06902e6fb6191.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_2f2558612c863ce0b996305571e0c788.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_cf2c398095a024373e1b6ffa5c3e9ea1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_74a0e7f1edc3c6b1b8f9a06d17e867f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_c132d9b84d7dbc6189559c7f2fcff1f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_bfc16807c38d5b63fe1ddf0587624b0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_f97c9cf9b0bd9eec712dda6ee9344e8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_1509436f07dc849e74bd3cad523d670c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a3c916-ad5a-5d64-befc-9cfe3178447c/76a3c916-ad5a-5d64-befc-9cfe3178447c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/40/ff4094795835a4aa3309ac5bd38717b8/pa/GC02244_55b0d8fc7136dd8d893f615f8f731d74.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport 45',
 'transmission': 'automatic',
 'trim': 'GTI Clubsport 45',
 'year': 2022}
2026-03-30 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC02244%27 HTTP/1.1" 200 None
2026-03-30 10:36:45 [auto1.de] INFO: Saving data for GC02244: {'created_time': 1774867005.586113, 'last_price_update_time': 1774867005.586125, 'auction_closing_time': 1774970467.0}
2026-03-30 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC02244') HTTP/1.1" 204 0
2026-03-30 10:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_7dc12ff449ea6366afd5b56fd926633f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_2ed88a8038ca95691e2af932e8fdb669.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_04698d36101de270ecf1f2542e885e67.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee3cd10>
2026-03-30 10:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_cf715a3a2c59e4598345efe4adccca5f.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_cf715a3a2c59e4598345efe4adccca5f.jpg saved to cache
2026-03-30 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9
2026-03-30 10:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef75690>
2026-03-30 10:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_0fc45fafdd94ba4c3cec2af0d613e773.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_0fc45fafdd94ba4c3cec2af0d613e773.jpg saved to cache
2026-03-30 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9
2026-03-30 10:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_68aa225bcaa3b1d9493152442140bd5e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef6150>
2026-03-30 10:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd6%252F9fd61f6028c697e8c9351134312a1651%252Fpa%252FNB58576_7dc12ff449ea6366afd5b56fd926633f.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_7dc12ff449ea6366afd5b56fd926633f.jpg saved to cache
2026-03-30 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9
2026-03-30 10:36:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9, skipping ID generation
2026-03-30 10:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9 with scrape type 1
2026-03-30 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9 sending to next pipeline
2026-03-30 10:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9, identifier: NB58576
2026-03-30 10:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9 with identifier: NB58576
2026-03-30 10:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9 with identifier: NB58576
2026-03-30 10:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9 with identifier: NB58576 to the API
2026-03-30 10:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_7dc12ff449ea6366afd5b56fd926633f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:39:28Z',
 'fuel_type': 'petrol',
 'id': '73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB58576',
 'listing': 'auction',
 'location': 'DE, Oldenburg',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 26080,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_7dc12ff449ea6366afd5b56fd926633f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_cf715a3a2c59e4598345efe4adccca5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_0fc45fafdd94ba4c3cec2af0d613e773.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_d8a8c5e2333086da29940558989e7780.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_910e47e07625a1d35e1092c74b9f7bfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_93e3873fae8ede0b6a6d10aa030f47ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_6b82bad0f6d7aa083c7010416d890ea6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_dce0e666b445c3ce4d912852207ae6e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_4b4b96107789c39fb4f9d3b1a783b471.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9/73c7f4a8-fb63-5b1f-8d58-b6ea25ca7be9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d6/9fd61f6028c697e8c9351134312a1651/pa/NB58576_eb909aff2d882a754e267087a9f5610d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 TSI ACT Move',
 'transmission': 'manual',
 'trim': 'Move',
 'year': 2023}
2026-03-30 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB58576%27 HTTP/1.1" 200 None
2026-03-30 10:36:46 [auto1.de] INFO: Saving data for NB58576: {'created_time': 1774867006.896098, 'last_price_update_time': 1774867006.896114, 'auction_closing_time': 1774971568.0}
2026-03-30 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB58576') HTTP/1.1" 204 0
2026-03-30 10:36:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424f890>
2026-03-30 10:36:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_2ed88a8038ca95691e2af932e8fdb669.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_2ed88a8038ca95691e2af932e8fdb669.jpg saved to cache
2026-03-30 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf4d5243-7735-59ae-bbd9-f4d68c9a7d37
2026-03-30 10:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_bac90ddc6a54a9b928f42496b5dccca0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_5fc3b83dbda41c19ce4d5543ffdf4612.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee72190>
2026-03-30 10:36:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_04698d36101de270ecf1f2542e885e67.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_04698d36101de270ecf1f2542e885e67.jpg saved to cache
2026-03-30 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf4d5243-7735-59ae-bbd9-f4d68c9a7d37
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeebc490>
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_68aa225bcaa3b1d9493152442140bd5e.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_68aa225bcaa3b1d9493152442140bd5e.jpg saved to cache
2026-03-30 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf4d5243-7735-59ae-bbd9-f4d68c9a7d37
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee3d9d0>
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_bac90ddc6a54a9b928f42496b5dccca0.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_bac90ddc6a54a9b928f42496b5dccca0.jpg saved to cache
2026-03-30 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf4d5243-7735-59ae-bbd9-f4d68c9a7d37
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea0bd0>
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_5fc3b83dbda41c19ce4d5543ffdf4612.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_5fc3b83dbda41c19ce4d5543ffdf4612.jpg saved to cache
2026-03-30 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf4d5243-7735-59ae-bbd9-f4d68c9a7d37
2026-03-30 10:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_39ee7dcb0881192f8714f1ac5ba823a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_b488bf353610594e81808a3abd7ff3f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_44bf423ebad507f7217affa2625c1278.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee4e790>
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_39ee7dcb0881192f8714f1ac5ba823a8.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_39ee7dcb0881192f8714f1ac5ba823a8.jpg saved to cache
2026-03-30 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf4d5243-7735-59ae-bbd9-f4d68c9a7d37
2026-03-30 10:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB70310/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec2a50>
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_b488bf353610594e81808a3abd7ff3f2.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_b488bf353610594e81808a3abd7ff3f2.jpg saved to cache
2026-03-30 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf4d5243-7735-59ae-bbd9-f4d68c9a7d37
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef6890>
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fba%252F1aba5f398e3c9bc4c74b3341358099db%252Fpa%252FXP42912_44bf423ebad507f7217affa2625c1278.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_44bf423ebad507f7217affa2625c1278.jpg saved to cache
2026-03-30 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf4d5243-7735-59ae-bbd9-f4d68c9a7d37
2026-03-30 10:36:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf4d5243-7735-59ae-bbd9-f4d68c9a7d37, skipping ID generation
2026-03-30 10:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf4d5243-7735-59ae-bbd9-f4d68c9a7d37 with scrape type 1
2026-03-30 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf4d5243-7735-59ae-bbd9-f4d68c9a7d37 sending to next pipeline
2026-03-30 10:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf4d5243-7735-59ae-bbd9-f4d68c9a7d37, identifier: XP42912
2026-03-30 10:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR65337/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf4d5243-7735-59ae-bbd9-f4d68c9a7d37 with identifier: XP42912
2026-03-30 10:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf4d5243-7735-59ae-bbd9-f4d68c9a7d37 with identifier: XP42912
2026-03-30 10:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf4d5243-7735-59ae-bbd9-f4d68c9a7d37 with identifier: XP42912 to the API
2026-03-30 10:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_44bf423ebad507f7217affa2625c1278.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:47:54Z',
 'fuel_type': 'petrol',
 'id': 'cf4d5243-7735-59ae-bbd9-f4d68c9a7d37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP42912',
 'listing': 'auction',
 'location': 'DE, Bretzenheim',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 124570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_44bf423ebad507f7217affa2625c1278.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2388368,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_b488bf353610594e81808a3abd7ff3f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2418346,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_39ee7dcb0881192f8714f1ac5ba823a8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_bac90ddc6a54a9b928f42496b5dccca0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_68aa225bcaa3b1d9493152442140bd5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_5fc3b83dbda41c19ce4d5543ffdf4612.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_2ed88a8038ca95691e2af932e8fdb669.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_04698d36101de270ecf1f2542e885e67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2507486,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_b00d9f4f0b4904dadaa278cf74e2fdeb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4d5243-7735-59ae-bbd9-f4d68c9a7d37/cf4d5243-7735-59ae-bbd9-f4d68c9a7d37_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ba/1aba5f398e3c9bc4c74b3341358099db/pa/XP42912_7695e5abb623a899f0e8ef686595026d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Selective - 120 Aniversario',
 'transmission': 'manual',
 'trim': 'Selective - 120 Aniversario',
 'year': 2019}
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP42912%27 HTTP/1.1" 200 None
2026-03-30 10:36:48 [auto1.de] INFO: Saving data for XP42912: {'created_time': 1774867008.280237, 'last_price_update_time': 1774867008.280246, 'auction_closing_time': 1774972074.0}
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP42912') HTTP/1.1" 204 0
2026-03-30 10:36:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC09035/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB07563> (referer: https://www.auto1.com/v1/car-details-view/GB07563/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a948c06f-e8a1-59de-a11e-17ccf7aba0c2 with identifier: GB07563
2026-03-30 10:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a948c06f-e8a1-59de-a11e-17ccf7aba0c2 with scrape type 1
2026-03-30 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a948c06f-e8a1-59de-a11e-17ccf7aba0c2
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_32d643564831b348181a71ac362cc423.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_32d643564831b348181a71ac362cc423.jpg not downloaded yet
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_6048a44875213712dece0c75496bfdb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_6048a44875213712dece0c75496bfdb9.jpg not downloaded yet
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_311cfb36547f500ddc28ef358fc1dc49.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_311cfb36547f500ddc28ef358fc1dc49.jpg not downloaded yet
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_1dabc6e21a4afb614fc256977b900651.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_1dabc6e21a4afb614fc256977b900651.jpg not downloaded yet
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_cdcc1fdc1aabfcffc836f00f9daf40fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_cdcc1fdc1aabfcffc836f00f9daf40fa.jpg not downloaded yet
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_7c14c1fca34abf78a4cd42228256d622.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_7c14c1fca34abf78a4cd42228256d622.jpg not downloaded yet
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_19f90fd74b7413f7b7152f9179b5aebc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_19f90fd74b7413f7b7152f9179b5aebc.jpg not downloaded yet
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_6a895ce1a2dc85984a53a7425cdf7585.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_6a895ce1a2dc85984a53a7425cdf7585.jpg not downloaded yet
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_a8c460f9043f6691f90d57c1efc617fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_a8c460f9043f6691f90d57c1efc617fe.jpg not downloaded yet
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_50a33f70ee65057c3c7821c1eb861d02.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_50a33f70ee65057c3c7821c1eb861d02.jpg not downloaded yet
2026-03-30 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_50a33f70ee65057c3c7821c1eb861d02.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:49 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 9421 | hits on page: 40
2026-03-30 10:36:49 [auto1.de] INFO: Found listing with ID: ZM57551
2026-03-30 10:36:49 [auto1.de] INFO: Found listing with ID: VZ64850
2026-03-30 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ64850%27 HTTP/1.1" 200 None
2026-03-30 10:36:49 [auto1.de] INFO: Scrape type for VZ64850: 1
2026-03-30 10:36:49 [auto1.de] INFO: Found listing with ID: BM75742
2026-03-30 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM75742%27 HTTP/1.1" 200 None
2026-03-30 10:36:49 [auto1.de] INFO: Scrape type for BM75742: 2
2026-03-30 10:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9226efe-7e97-5fdf-a078-1e44221e302b with identifier: BM75742
2026-03-30 10:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9226efe-7e97-5fdf-a078-1e44221e302b with scrape type 2
2026-03-30 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9226efe-7e97-5fdf-a078-1e44221e302b with scrape type 2
2026-03-30 10:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9226efe-7e97-5fdf-a078-1e44221e302b, identifier: BM75742
2026-03-30 10:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9226efe-7e97-5fdf-a078-1e44221e302b with identifier: BM75742
2026-03-30 10:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9226efe-7e97-5fdf-a078-1e44221e302b with identifier: BM75742
2026-03-30 10:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9226efe-7e97-5fdf-a078-1e44221e302b with identifier: BM75742 to the API
2026-03-30 10:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:57:02Z',
 'fuel_type': 'diesel',
 'id': 'b9226efe-7e97-5fdf-a078-1e44221e302b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM75742',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 223883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-29',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2011}
2026-03-30 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM75742%27 HTTP/1.1" 200 None
2026-03-30 10:36:49 [auto1.de] INFO: Saving data for BM75742: {'auction_closing_time': 1774972622.0, 'created_time': 1773660778.755924, 'last_price_update_time': 1774867009.744171}
2026-03-30 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM75742') HTTP/1.1" 204 0
2026-03-30 10:36:49 [auto1.de] INFO: Found listing with ID: SS17636
2026-03-30 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS17636%27 HTTP/1.1" 200 None
2026-03-30 10:36:49 [auto1.de] INFO: Scrape type for SS17636: 1
2026-03-30 10:36:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd5050>
2026-03-30 10:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_50a33f70ee65057c3c7821c1eb861d02.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_50a33f70ee65057c3c7821c1eb861d02.jpg saved to cache
2026-03-30 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a948c06f-e8a1-59de-a11e-17ccf7aba0c2
2026-03-30 10:36:49 [auto1.de] INFO: Found listing with ID: KC19039
2026-03-30 10:36:49 [auto1.de] INFO: Found listing with ID: HJ87007
2026-03-30 10:36:49 [auto1.de] INFO: Found listing with ID: EG45632
2026-03-30 10:36:49 [auto1.de] INFO: Found listing with ID: NZ38096
2026-03-30 10:36:49 [auto1.de] INFO: Found listing with ID: PG06800
2026-03-30 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG06800%27 HTTP/1.1" 200 None
2026-03-30 10:36:49 [auto1.de] INFO: Scrape type for PG06800: 2
2026-03-30 10:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00f6723d-b4ab-5746-8035-e5fcd80e9ce7 with identifier: PG06800
2026-03-30 10:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00f6723d-b4ab-5746-8035-e5fcd80e9ce7 with scrape type 2
2026-03-30 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00f6723d-b4ab-5746-8035-e5fcd80e9ce7 with scrape type 2
2026-03-30 10:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00f6723d-b4ab-5746-8035-e5fcd80e9ce7, identifier: PG06800
2026-03-30 10:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00f6723d-b4ab-5746-8035-e5fcd80e9ce7 with identifier: PG06800
2026-03-30 10:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00f6723d-b4ab-5746-8035-e5fcd80e9ce7 with identifier: PG06800
2026-03-30 10:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00f6723d-b4ab-5746-8035-e5fcd80e9ce7 with identifier: PG06800 to the API
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-31T15:30:18Z',
 'fuel_type': 'petrol',
 'id': '00f6723d-b4ab-5746-8035-e5fcd80e9ce7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG06800',
 'listing': 'auction',
 'make': 'Porsche',
 'model': '911',
 'odometer': 209465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-20',
 'seller_name': None,
 'title': 'Porsche 911 997 Carrera 4S Cabrio',
 'transmission': 'automatic',
 'trim': 'Carrera 4S Cabrio',
 'year': 2005}
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG06800%27 HTTP/1.1" 200 None
2026-03-30 10:36:50 [auto1.de] INFO: Saving data for PG06800: {'auction_closing_time': 1774971018.0, 'created_time': 1774293176.104291, 'last_price_update_time': 1774867010.360359}
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG06800') HTTP/1.1" 204 0
2026-03-30 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_a8c460f9043f6691f90d57c1efc617fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:50 [auto1.de] INFO: Found listing with ID: TS54833
2026-03-30 10:36:50 [auto1.de] INFO: Found listing with ID: UP86151
2026-03-30 10:36:50 [auto1.de] INFO: Found listing with ID: JV73978
2026-03-30 10:36:50 [auto1.de] INFO: Found listing with ID: PM17860
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM17860%27 HTTP/1.1" 200 None
2026-03-30 10:36:50 [auto1.de] INFO: Scrape type for PM17860: 1
2026-03-30 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM57551/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HM13526/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:50 [auto1.de] INFO: Found listing with ID: VV52010
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV52010%27 HTTP/1.1" 200 None
2026-03-30 10:36:50 [auto1.de] INFO: Scrape type for VV52010: 1
2026-03-30 10:36:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:50 [auto1.de] INFO: Found listing with ID: RT19134
2026-03-30 10:36:50 [auto1.de] INFO: Found listing with ID: KV63005
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV63005%27 HTTP/1.1" 200 None
2026-03-30 10:36:50 [auto1.de] INFO: Scrape type for KV63005: 1
2026-03-30 10:36:50 [auto1.de] INFO: Found listing with ID: SF81844
2026-03-30 10:36:50 [auto1.de] INFO: Found listing with ID: AZ64163
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ64163%27 HTTP/1.1" 200 None
2026-03-30 10:36:50 [auto1.de] INFO: Scrape type for AZ64163: 1
2026-03-30 10:36:50 [auto1.de] INFO: Found listing with ID: LS25004
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS25004%27 HTTP/1.1" 200 None
2026-03-30 10:36:50 [auto1.de] INFO: Scrape type for LS25004: 1
2026-03-30 10:36:50 [auto1.de] INFO: Found listing with ID: SE58467
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE58467%27 HTTP/1.1" 200 None
2026-03-30 10:36:50 [auto1.de] INFO: Scrape type for SE58467: 2
2026-03-30 10:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a240ef15-d0a1-5602-83b2-71a42df21228 with identifier: SE58467
2026-03-30 10:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a240ef15-d0a1-5602-83b2-71a42df21228 with scrape type 2
2026-03-30 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a240ef15-d0a1-5602-83b2-71a42df21228 with scrape type 2
2026-03-30 10:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a240ef15-d0a1-5602-83b2-71a42df21228, identifier: SE58467
2026-03-30 10:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a240ef15-d0a1-5602-83b2-71a42df21228 with identifier: SE58467
2026-03-30 10:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a240ef15-d0a1-5602-83b2-71a42df21228 with identifier: SE58467
2026-03-30 10:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a240ef15-d0a1-5602-83b2-71a42df21228 with identifier: SE58467 to the API
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-31T15:39:38Z',
 'fuel_type': 'hybrid',
 'id': 'a240ef15-d0a1-5602-83b2-71a42df21228',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE58467',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 26275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-13',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T4 Recharge Plug-in Hybrid Core 2WD',
 'transmission': 'automatic',
 'trim': 'Core 2WD',
 'year': 2022}
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE58467%27 HTTP/1.1" 200 None
2026-03-30 10:36:51 [auto1.de] INFO: Saving data for SE58467: {'auction_closing_time': 1774971578.0, 'created_time': 1774264674.565274, 'last_price_update_time': 1774867011.016796}
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE58467') HTTP/1.1" 204 0
2026-03-30 10:36:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4808b10>
2026-03-30 10:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_a8c460f9043f6691f90d57c1efc617fe.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_a8c460f9043f6691f90d57c1efc617fe.jpg saved to cache
2026-03-30 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a948c06f-e8a1-59de-a11e-17ccf7aba0c2
2026-03-30 10:36:51 [auto1.de] INFO: Found listing with ID: LV13893
2026-03-30 10:36:51 [auto1.de] INFO: Found listing with ID: AD08111
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD08111%27 HTTP/1.1" 200 None
2026-03-30 10:36:51 [auto1.de] INFO: Scrape type for AD08111: 1
2026-03-30 10:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TM34763> (referer: https://www.auto1.com/v1/car-details-view/TM34763/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:51 [auto1.de] INFO: Found listing with ID: XF59760
2026-03-30 10:36:51 [auto1.de] INFO: Found listing with ID: SE80616
2026-03-30 10:36:51 [auto1.de] INFO: Found listing with ID: BP47539
2026-03-30 10:36:51 [auto1.de] INFO: Found listing with ID: KK79364
2026-03-30 10:36:51 [auto1.de] INFO: Found listing with ID: WY46895
2026-03-30 10:36:51 [auto1.de] INFO: Found listing with ID: DM03841
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM03841%27 HTTP/1.1" 200 None
2026-03-30 10:36:51 [auto1.de] INFO: Scrape type for DM03841: 2
2026-03-30 10:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2164c265-23c5-535a-8d0d-9b6b763746ce with identifier: DM03841
2026-03-30 10:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2164c265-23c5-535a-8d0d-9b6b763746ce with scrape type 2
2026-03-30 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2164c265-23c5-535a-8d0d-9b6b763746ce with scrape type 2
2026-03-30 10:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2164c265-23c5-535a-8d0d-9b6b763746ce, identifier: DM03841
2026-03-30 10:36:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2164c265-23c5-535a-8d0d-9b6b763746ce with identifier: DM03841
2026-03-30 10:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2164c265-23c5-535a-8d0d-9b6b763746ce with identifier: DM03841
2026-03-30 10:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2164c265-23c5-535a-8d0d-9b6b763746ce with identifier: DM03841 to the API
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:56:31Z',
 'fuel_type': 'diesel',
 'id': '2164c265-23c5-535a-8d0d-9b6b763746ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM03841',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 315110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-10',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'manual',
 'trim': 'Ultra',
 'year': 2016}
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM03841%27 HTTP/1.1" 200 None
2026-03-30 10:36:51 [auto1.de] INFO: Saving data for DM03841: {'auction_closing_time': 1774972591.0, 'created_time': 1773741392.666888, 'last_price_update_time': 1774867011.685893}
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM03841') HTTP/1.1" 204 0
2026-03-30 10:36:51 [auto1.de] INFO: Found listing with ID: LF76097
2026-03-30 10:36:51 [auto1.de] INFO: Found listing with ID: FG13318
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG13318%27 HTTP/1.1" 200 None
2026-03-30 10:36:51 [auto1.de] INFO: Scrape type for FG13318: 1
2026-03-30 10:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MH55571/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:51 [auto1.de] INFO: Found listing with ID: NE24637
2026-03-30 10:36:51 [auto1.de] INFO: Found listing with ID: NW01824
2026-03-30 10:36:51 [auto1.de] INFO: Found listing with ID: NX53505
2026-03-30 10:36:51 [auto1.de] INFO: Found listing with ID: HH32152
2026-03-30 10:36:51 [auto1.de] INFO: Found listing with ID: AT25404
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT25404%27 HTTP/1.1" 200 None
2026-03-30 10:36:51 [auto1.de] INFO: Scrape type for AT25404: 1
2026-03-30 10:36:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0110461f-f854-55d0-904b-a8d49a64f73c with identifier: TM34763
2026-03-30 10:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0110461f-f854-55d0-904b-a8d49a64f73c with scrape type 1
2026-03-30 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0110461f-f854-55d0-904b-a8d49a64f73c
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_70ad5e01d1f82f01d0145bae1ddfdd06.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_70ad5e01d1f82f01d0145bae1ddfdd06.jpg not downloaded yet
2026-03-30 10:36:51 [auto1.de] INFO: Found listing with ID: WW29948
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW29948%27 HTTP/1.1" 200 None
2026-03-30 10:36:51 [auto1.de] INFO: Scrape type for WW29948: 1
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_93bafd19cc6584d3ceef8c1e978565ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_93bafd19cc6584d3ceef8c1e978565ea.jpg not downloaded yet
2026-03-30 10:36:51 [auto1.de] INFO: Found listing with ID: BJ85670
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ85670%27 HTTP/1.1" 200 None
2026-03-30 10:36:51 [auto1.de] INFO: Scrape type for BJ85670: 1
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_ad567bc9bc3354f26e87984a25c80db4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_ad567bc9bc3354f26e87984a25c80db4.jpg not downloaded yet
2026-03-30 10:36:51 [auto1.de] INFO: Found listing with ID: XW43246
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW43246%27 HTTP/1.1" 200 None
2026-03-30 10:36:51 [auto1.de] INFO: Scrape type for XW43246: 1
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_27085e60c0f1e34b2630aa62dd1e4adb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_27085e60c0f1e34b2630aa62dd1e4adb.jpg not downloaded yet
2026-03-30 10:36:52 [auto1.de] INFO: Found listing with ID: HK17634
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK17634%27 HTTP/1.1" 200 None
2026-03-30 10:36:52 [auto1.de] INFO: Scrape type for HK17634: 2
2026-03-30 10:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74fdafa6-b800-596e-b8b5-de9f6e452882 with identifier: HK17634
2026-03-30 10:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74fdafa6-b800-596e-b8b5-de9f6e452882 with scrape type 2
2026-03-30 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74fdafa6-b800-596e-b8b5-de9f6e452882 with scrape type 2
2026-03-30 10:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74fdafa6-b800-596e-b8b5-de9f6e452882, identifier: HK17634
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_878a6067848a664249d653b608219d52.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_878a6067848a664249d653b608219d52.jpg not downloaded yet
2026-03-30 10:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74fdafa6-b800-596e-b8b5-de9f6e452882 with identifier: HK17634
2026-03-30 10:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74fdafa6-b800-596e-b8b5-de9f6e452882 with identifier: HK17634
2026-03-30 10:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74fdafa6-b800-596e-b8b5-de9f6e452882 with identifier: HK17634 to the API
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:39:25Z',
 'fuel_type': 'diesel',
 'id': '74fdafa6-b800-596e-b8b5-de9f6e452882',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK17634',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 174897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-03',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK17634%27 HTTP/1.1" 200 None
2026-03-30 10:36:52 [auto1.de] INFO: Saving data for HK17634: {'auction_closing_time': 1774971565.0, 'created_time': 1773775968.381622, 'last_price_update_time': 1774867012.464722}
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK17634') HTTP/1.1" 204 0
2026-03-30 10:36:52 [auto1.de] INFO: Found listing with ID: ZW86653
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW86653%27 HTTP/1.1" 200 None
2026-03-30 10:36:52 [auto1.de] INFO: Scrape type for ZW86653: 1
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_dc3829f12c176cf01afc0a98dec8d3bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_dc3829f12c176cf01afc0a98dec8d3bd.jpg not downloaded yet
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_eebf90e145526059e84daf30870db913.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_eebf90e145526059e84daf30870db913.jpg not downloaded yet
2026-03-30 10:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA98582/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FZ80671> (referer: https://www.auto1.com/v1/car-details-view/FZ80671/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_1202c9898160113329ebcb89db02263a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_1202c9898160113329ebcb89db02263a.jpg not downloaded yet
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_d60810d1accdce3dab9f0a586dee81e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_d60810d1accdce3dab9f0a586dee81e3.jpg not downloaded yet
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_9a6e84db695d9cbe0504f61a7805bbfb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_9a6e84db695d9cbe0504f61a7805bbfb.jpg not downloaded yet
2026-03-30 10:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_dc3829f12c176cf01afc0a98dec8d3bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_eebf90e145526059e84daf30870db913.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 890fcd6a-079a-548a-a6a0-ebc0b7668932 with identifier: FZ80671
2026-03-30 10:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 890fcd6a-079a-548a-a6a0-ebc0b7668932 with scrape type 1
2026-03-30 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 890fcd6a-079a-548a-a6a0-ebc0b7668932
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fdb%252Fdedb69a5ec84577501ed61c0e0cd6b86%252Fpa%252FFZ80671_d2e3abd8cfaa002d4305aedff24bedb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_d2e3abd8cfaa002d4305aedff24bedb7.jpg not downloaded yet
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fdb%252Fdedb69a5ec84577501ed61c0e0cd6b86%252Fpa%252FFZ80671_5bfbe4b52e35b45d3ae58244b91f6ce0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_5bfbe4b52e35b45d3ae58244b91f6ce0.jpg not downloaded yet
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fdb%252Fdedb69a5ec84577501ed61c0e0cd6b86%252Fpa%252FFZ80671_9cdd3708a2700b83318a8eb3f75b4a9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_9cdd3708a2700b83318a8eb3f75b4a9d.jpg not downloaded yet
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fdb%252Fdedb69a5ec84577501ed61c0e0cd6b86%252Fpa%252FFZ80671_9a15403837919b21ebccebea8421caa1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_9a15403837919b21ebccebea8421caa1.jpg not downloaded yet
2026-03-30 10:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_9a6e84db695d9cbe0504f61a7805bbfb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_d60810d1accdce3dab9f0a586dee81e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fdb%252Fdedb69a5ec84577501ed61c0e0cd6b86%252Fpa%252FFZ80671_b511b441f286b34d464bbe3c923055a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_b511b441f286b34d464bbe3c923055a9.jpg not downloaded yet
2026-03-30 10:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef751d0>
2026-03-30 10:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_dc3829f12c176cf01afc0a98dec8d3bd.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_dc3829f12c176cf01afc0a98dec8d3bd.jpg saved to cache
2026-03-30 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0110461f-f854-55d0-904b-a8d49a64f73c
2026-03-30 10:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f438b310>
2026-03-30 10:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_eebf90e145526059e84daf30870db913.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_eebf90e145526059e84daf30870db913.jpg saved to cache
2026-03-30 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0110461f-f854-55d0-904b-a8d49a64f73c
2026-03-30 10:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_9cdd3708a2700b83318a8eb3f75b4a9d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee95dd0>
2026-03-30 10:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_9a6e84db695d9cbe0504f61a7805bbfb.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_9a6e84db695d9cbe0504f61a7805bbfb.jpg saved to cache
2026-03-30 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0110461f-f854-55d0-904b-a8d49a64f73c
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef4590>
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_d60810d1accdce3dab9f0a586dee81e3.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_d60810d1accdce3dab9f0a586dee81e3.jpg saved to cache
2026-03-30 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0110461f-f854-55d0-904b-a8d49a64f73c
2026-03-30 10:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_9a15403837919b21ebccebea8421caa1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8f850>
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_890fcd6a-079a-548a-a6a0-ebc0b7668932/890fcd6a-079a-548a-a6a0-ebc0b7668932_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fdb%252Fdedb69a5ec84577501ed61c0e0cd6b86%252Fpa%252FFZ80671_9cdd3708a2700b83318a8eb3f75b4a9d.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_9cdd3708a2700b83318a8eb3f75b4a9d.jpg saved to cache
2026-03-30 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 890fcd6a-079a-548a-a6a0-ebc0b7668932
2026-03-30 10:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_5bfbe4b52e35b45d3ae58244b91f6ce0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_b511b441f286b34d464bbe3c923055a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee478ed0>
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_890fcd6a-079a-548a-a6a0-ebc0b7668932/890fcd6a-079a-548a-a6a0-ebc0b7668932_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fdb%252Fdedb69a5ec84577501ed61c0e0cd6b86%252Fpa%252FFZ80671_9a15403837919b21ebccebea8421caa1.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_9a15403837919b21ebccebea8421caa1.jpg saved to cache
2026-03-30 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 890fcd6a-079a-548a-a6a0-ebc0b7668932
2026-03-30 10:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_d2e3abd8cfaa002d4305aedff24bedb7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb7c10>
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_890fcd6a-079a-548a-a6a0-ebc0b7668932/890fcd6a-079a-548a-a6a0-ebc0b7668932_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fdb%252Fdedb69a5ec84577501ed61c0e0cd6b86%252Fpa%252FFZ80671_5bfbe4b52e35b45d3ae58244b91f6ce0.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_5bfbe4b52e35b45d3ae58244b91f6ce0.jpg saved to cache
2026-03-30 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 890fcd6a-079a-548a-a6a0-ebc0b7668932
2026-03-30 10:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_1202c9898160113329ebcb89db02263a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef70fd0>
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_890fcd6a-079a-548a-a6a0-ebc0b7668932/890fcd6a-079a-548a-a6a0-ebc0b7668932_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fdb%252Fdedb69a5ec84577501ed61c0e0cd6b86%252Fpa%252FFZ80671_b511b441f286b34d464bbe3c923055a9.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_b511b441f286b34d464bbe3c923055a9.jpg saved to cache
2026-03-30 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 890fcd6a-079a-548a-a6a0-ebc0b7668932
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4291d10>
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_890fcd6a-079a-548a-a6a0-ebc0b7668932/890fcd6a-079a-548a-a6a0-ebc0b7668932_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fdb%252Fdedb69a5ec84577501ed61c0e0cd6b86%252Fpa%252FFZ80671_d2e3abd8cfaa002d4305aedff24bedb7.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_d2e3abd8cfaa002d4305aedff24bedb7.jpg saved to cache
2026-03-30 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 890fcd6a-079a-548a-a6a0-ebc0b7668932
2026-03-30 10:36:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 890fcd6a-079a-548a-a6a0-ebc0b7668932, skipping ID generation
2026-03-30 10:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 890fcd6a-079a-548a-a6a0-ebc0b7668932 with scrape type 1
2026-03-30 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 890fcd6a-079a-548a-a6a0-ebc0b7668932 sending to next pipeline
2026-03-30 10:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 890fcd6a-079a-548a-a6a0-ebc0b7668932, identifier: FZ80671
2026-03-30 10:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 890fcd6a-079a-548a-a6a0-ebc0b7668932 with identifier: FZ80671
2026-03-30 10:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 890fcd6a-079a-548a-a6a0-ebc0b7668932 with identifier: FZ80671
2026-03-30 10:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 890fcd6a-079a-548a-a6a0-ebc0b7668932 with identifier: FZ80671 to the API
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_d2e3abd8cfaa002d4305aedff24bedb7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:00:28Z',
 'fuel_type': 'petrol',
 'id': '890fcd6a-079a-548a-a6a0-ebc0b7668932',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ80671',
 'listing': 'auction',
 'location': 'DE, Fürth',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 48198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_890fcd6a-079a-548a-a6a0-ebc0b7668932/890fcd6a-079a-548a-a6a0-ebc0b7668932_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_d2e3abd8cfaa002d4305aedff24bedb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_890fcd6a-079a-548a-a6a0-ebc0b7668932/890fcd6a-079a-548a-a6a0-ebc0b7668932_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_5bfbe4b52e35b45d3ae58244b91f6ce0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_890fcd6a-079a-548a-a6a0-ebc0b7668932/890fcd6a-079a-548a-a6a0-ebc0b7668932_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_9cdd3708a2700b83318a8eb3f75b4a9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_890fcd6a-079a-548a-a6a0-ebc0b7668932/890fcd6a-079a-548a-a6a0-ebc0b7668932_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_9a15403837919b21ebccebea8421caa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_890fcd6a-079a-548a-a6a0-ebc0b7668932/890fcd6a-079a-548a-a6a0-ebc0b7668932_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/db/dedb69a5ec84577501ed61c0e0cd6b86/pa/FZ80671_b511b441f286b34d464bbe3c923055a9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2005}
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ80671%27 HTTP/1.1" 200 None
2026-03-30 10:36:53 [auto1.de] INFO: Saving data for FZ80671: {'created_time': 1774867013.889605, 'last_price_update_time': 1774867013.889613, 'auction_closing_time': 1774969228.0}
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ80671') HTTP/1.1" 204 0
2026-03-30 10:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB65730/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UW88941/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VN28198/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef6190>
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_1202c9898160113329ebcb89db02263a.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_1202c9898160113329ebcb89db02263a.jpg saved to cache
2026-03-30 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0110461f-f854-55d0-904b-a8d49a64f73c
2026-03-30 10:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_878a6067848a664249d653b608219d52.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_27085e60c0f1e34b2630aa62dd1e4adb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4172890>
2026-03-30 10:36:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_878a6067848a664249d653b608219d52.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_878a6067848a664249d653b608219d52.jpg saved to cache
2026-03-30 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0110461f-f854-55d0-904b-a8d49a64f73c
2026-03-30 10:36:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424d410>
2026-03-30 10:36:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_27085e60c0f1e34b2630aa62dd1e4adb.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_27085e60c0f1e34b2630aa62dd1e4adb.jpg saved to cache
2026-03-30 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0110461f-f854-55d0-904b-a8d49a64f73c
2026-03-30 10:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS31363/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM17860/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC14226> (referer: https://www.auto1.com/v1/car-details-view/JC14226/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aa25b8b-7672-5072-913e-f770fa6d9065 with identifier: JC14226
2026-03-30 10:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aa25b8b-7672-5072-913e-f770fa6d9065 with scrape type 1
2026-03-30 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4aa25b8b-7672-5072-913e-f770fa6d9065
2026-03-30 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd9%252Ff2d949ac41029ba55ce9c32c8a003d16%252Fpa%252FJC14226_35095d0d67fd76a990026c2b3feee017.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_35095d0d67fd76a990026c2b3feee017.jpg not downloaded yet
2026-03-30 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd9%252Ff2d949ac41029ba55ce9c32c8a003d16%252Fpa%252FJC14226_7af4ea69aa962f242eff416948998a5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_7af4ea69aa962f242eff416948998a5d.jpg not downloaded yet
2026-03-30 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd9%252Ff2d949ac41029ba55ce9c32c8a003d16%252Fpa%252FJC14226_752605f7bdf7a6d5617d24b59d0241fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_752605f7bdf7a6d5617d24b59d0241fc.jpg not downloaded yet
2026-03-30 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd9%252Ff2d949ac41029ba55ce9c32c8a003d16%252Fpa%252FJC14226_b641e5450cca35852897c6eb280eb1b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_b641e5450cca35852897c6eb280eb1b7.jpg not downloaded yet
2026-03-30 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd9%252Ff2d949ac41029ba55ce9c32c8a003d16%252Fpa%252FJC14226_529705676299037b3de47cd2f3b4806b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_529705676299037b3de47cd2f3b4806b.jpg not downloaded yet
2026-03-30 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd9%252Ff2d949ac41029ba55ce9c32c8a003d16%252Fpa%252FJC14226_bbe183104cc7939e221172f4b56cfbeb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_bbe183104cc7939e221172f4b56cfbeb.jpg not downloaded yet
2026-03-30 10:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG13318/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_bbe183104cc7939e221172f4b56cfbeb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_529705676299037b3de47cd2f3b4806b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41704d0>
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4aa25b8b-7672-5072-913e-f770fa6d9065/4aa25b8b-7672-5072-913e-f770fa6d9065_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd9%252Ff2d949ac41029ba55ce9c32c8a003d16%252Fpa%252FJC14226_bbe183104cc7939e221172f4b56cfbeb.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_bbe183104cc7939e221172f4b56cfbeb.jpg saved to cache
2026-03-30 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4aa25b8b-7672-5072-913e-f770fa6d9065
2026-03-30 10:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AD08111/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f438a810>
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4aa25b8b-7672-5072-913e-f770fa6d9065/4aa25b8b-7672-5072-913e-f770fa6d9065_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd9%252Ff2d949ac41029ba55ce9c32c8a003d16%252Fpa%252FJC14226_529705676299037b3de47cd2f3b4806b.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_529705676299037b3de47cd2f3b4806b.jpg saved to cache
2026-03-30 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4aa25b8b-7672-5072-913e-f770fa6d9065
2026-03-30 10:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BD87504/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_752605f7bdf7a6d5617d24b59d0241fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS17636/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_7af4ea69aa962f242eff416948998a5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef75650>
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4aa25b8b-7672-5072-913e-f770fa6d9065/4aa25b8b-7672-5072-913e-f770fa6d9065_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd9%252Ff2d949ac41029ba55ce9c32c8a003d16%252Fpa%252FJC14226_752605f7bdf7a6d5617d24b59d0241fc.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_752605f7bdf7a6d5617d24b59d0241fc.jpg saved to cache
2026-03-30 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4aa25b8b-7672-5072-913e-f770fa6d9065
2026-03-30 10:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_b641e5450cca35852897c6eb280eb1b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4809cd0>
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4aa25b8b-7672-5072-913e-f770fa6d9065/4aa25b8b-7672-5072-913e-f770fa6d9065_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd9%252Ff2d949ac41029ba55ce9c32c8a003d16%252Fpa%252FJC14226_7af4ea69aa962f242eff416948998a5d.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_7af4ea69aa962f242eff416948998a5d.jpg saved to cache
2026-03-30 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4aa25b8b-7672-5072-913e-f770fa6d9065
2026-03-30 10:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_35095d0d67fd76a990026c2b3feee017.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3af10>
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4aa25b8b-7672-5072-913e-f770fa6d9065/4aa25b8b-7672-5072-913e-f770fa6d9065_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd9%252Ff2d949ac41029ba55ce9c32c8a003d16%252Fpa%252FJC14226_b641e5450cca35852897c6eb280eb1b7.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_b641e5450cca35852897c6eb280eb1b7.jpg saved to cache
2026-03-30 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4aa25b8b-7672-5072-913e-f770fa6d9065
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414f250>
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4aa25b8b-7672-5072-913e-f770fa6d9065/4aa25b8b-7672-5072-913e-f770fa6d9065_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd9%252Ff2d949ac41029ba55ce9c32c8a003d16%252Fpa%252FJC14226_35095d0d67fd76a990026c2b3feee017.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_35095d0d67fd76a990026c2b3feee017.jpg saved to cache
2026-03-30 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4aa25b8b-7672-5072-913e-f770fa6d9065
2026-03-30 10:37:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4aa25b8b-7672-5072-913e-f770fa6d9065, skipping ID generation
2026-03-30 10:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aa25b8b-7672-5072-913e-f770fa6d9065 with scrape type 1
2026-03-30 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4aa25b8b-7672-5072-913e-f770fa6d9065 sending to next pipeline
2026-03-30 10:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4aa25b8b-7672-5072-913e-f770fa6d9065, identifier: JC14226
2026-03-30 10:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4aa25b8b-7672-5072-913e-f770fa6d9065 with identifier: JC14226
2026-03-30 10:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4aa25b8b-7672-5072-913e-f770fa6d9065 with identifier: JC14226
2026-03-30 10:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4aa25b8b-7672-5072-913e-f770fa6d9065 with identifier: JC14226 to the API
2026-03-30 10:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_35095d0d67fd76a990026c2b3feee017.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:50:15Z',
 'fuel_type': 'petrol',
 'id': '4aa25b8b-7672-5072-913e-f770fa6d9065',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC14226',
 'listing': 'auction',
 'location': 'DE, Eschwege',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 80018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4aa25b8b-7672-5072-913e-f770fa6d9065/4aa25b8b-7672-5072-913e-f770fa6d9065_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_35095d0d67fd76a990026c2b3feee017.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4aa25b8b-7672-5072-913e-f770fa6d9065/4aa25b8b-7672-5072-913e-f770fa6d9065_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_7af4ea69aa962f242eff416948998a5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4aa25b8b-7672-5072-913e-f770fa6d9065/4aa25b8b-7672-5072-913e-f770fa6d9065_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_752605f7bdf7a6d5617d24b59d0241fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4aa25b8b-7672-5072-913e-f770fa6d9065/4aa25b8b-7672-5072-913e-f770fa6d9065_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_b641e5450cca35852897c6eb280eb1b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4aa25b8b-7672-5072-913e-f770fa6d9065/4aa25b8b-7672-5072-913e-f770fa6d9065_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_529705676299037b3de47cd2f3b4806b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4aa25b8b-7672-5072-913e-f770fa6d9065/4aa25b8b-7672-5072-913e-f770fa6d9065_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/d9/f2d949ac41029ba55ce9c32c8a003d16/pa/JC14226_bbe183104cc7939e221172f4b56cfbeb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.0 Selection "110 Jahre"',
 'transmission': 'manual',
 'trim': 'Selection "110 Jahre"',
 'year': 2009}
2026-03-30 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC14226%27 HTTP/1.1" 200 None
2026-03-30 10:37:01 [auto1.de] INFO: Saving data for JC14226: {'created_time': 1774867021.46675, 'last_price_update_time': 1774867021.466761, 'auction_closing_time': 1774972215.0}
2026-03-30 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC14226') HTTP/1.1" 204 0
2026-03-30 10:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ64850/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZW86653/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UW88941> (referer: https://www.auto1.com/v1/car-details-view/UW88941/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b22f29d-4a12-590d-a12c-d57ed5359dee with identifier: UW88941
2026-03-30 10:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b22f29d-4a12-590d-a12c-d57ed5359dee with scrape type 1
2026-03-30 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1b22f29d-4a12-590d-a12c-d57ed5359dee
2026-03-30 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556397302f6aea3d5dc35bd37f7d390%252Fpa%252FUW88941_c3be1e4257f7c8961f2afed48fb89808.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_c3be1e4257f7c8961f2afed48fb89808.jpg not downloaded yet
2026-03-30 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556397302f6aea3d5dc35bd37f7d390%252Fpa%252FUW88941_a59207920a5b80bf29cfb9f1826fcd2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_a59207920a5b80bf29cfb9f1826fcd2d.jpg not downloaded yet
2026-03-30 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556397302f6aea3d5dc35bd37f7d390%252Fpa%252FUW88941_af9b9f3b4991afe2e4c90c9f57d4afa5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_af9b9f3b4991afe2e4c90c9f57d4afa5.jpg not downloaded yet
2026-03-30 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556397302f6aea3d5dc35bd37f7d390%252Fpa%252FUW88941_8290b148f7628ce7050638bbc3bd48e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_8290b148f7628ce7050638bbc3bd48e9.jpg not downloaded yet
2026-03-30 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556397302f6aea3d5dc35bd37f7d390%252Fpa%252FUW88941_922862f0569cefc2f0638851d5f237e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_922862f0569cefc2f0638851d5f237e2.jpg not downloaded yet
2026-03-30 10:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MH55571> (referer: https://www.auto1.com/v1/car-details-view/MH55571/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_922862f0569cefc2f0638851d5f237e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e08934f0-f49d-58cc-829c-8f77f16c6d37 with identifier: MH55571
2026-03-30 10:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e08934f0-f49d-58cc-829c-8f77f16c6d37 with scrape type 1
2026-03-30 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e08934f0-f49d-58cc-829c-8f77f16c6d37
2026-03-30 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F46%252Fb4469120878b4f9ec66340e09aca93da%252Fpa%252FMH55571_66b0b0e27cbeb1780ae1a431d3b010c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_66b0b0e27cbeb1780ae1a431d3b010c3.jpg already downloaded
2026-03-30 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F46%252Fb4469120878b4f9ec66340e09aca93da%252Fpa%252FMH55571_0554a774a107e863adc8c551c1ddd83e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_0554a774a107e863adc8c551c1ddd83e.jpg already downloaded
2026-03-30 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F46%252Fb4469120878b4f9ec66340e09aca93da%252Fpa%252FMH55571_0d87b19a2b517b9fef0e6718648c12eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_0d87b19a2b517b9fef0e6718648c12eb.jpg already downloaded
2026-03-30 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F46%252Fb4469120878b4f9ec66340e09aca93da%252Fpa%252FMH55571_e0a48e9928759f2cffaecb62b02eee0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_e0a48e9928759f2cffaecb62b02eee0f.jpg already downloaded
2026-03-30 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F46%252Fb4469120878b4f9ec66340e09aca93da%252Fpa%252FMH55571_8bc1d9add9b6200fc352877beb6ac886.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_8bc1d9add9b6200fc352877beb6ac886.jpg already downloaded
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F46%252Fb4469120878b4f9ec66340e09aca93da%252Fpa%252FMH55571_18062dcf0cd6791892d52c0bc289e3f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_18062dcf0cd6791892d52c0bc289e3f6.jpg already downloaded
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F46%252Fb4469120878b4f9ec66340e09aca93da%252Fpa%252FMH55571_e6cef107faab44df0e522594e467f6c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_e6cef107faab44df0e522594e467f6c3.jpg already downloaded
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F46%252Fb4469120878b4f9ec66340e09aca93da%252Fpa%252FMH55571_08886dbe78161f6321fba51fea8c8b46.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_08886dbe78161f6321fba51fea8c8b46.jpg already downloaded
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F46%252Fb4469120878b4f9ec66340e09aca93da%252Fpa%252FMH55571_409da628f28d3cb47000b051a059aa4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_409da628f28d3cb47000b051a059aa4c.jpg already downloaded
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F46%252Fb4469120878b4f9ec66340e09aca93da%252Fpa%252FMH55571_b3362c2af58da7df07fedf6c411c658b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_b3362c2af58da7df07fedf6c411c658b.jpg already downloaded
2026-03-30 10:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e08934f0-f49d-58cc-829c-8f77f16c6d37, identifier: MH55571
2026-03-30 10:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e08934f0-f49d-58cc-829c-8f77f16c6d37 with identifier: MH55571
2026-03-30 10:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e08934f0-f49d-58cc-829c-8f77f16c6d37 with identifier: MH55571
2026-03-30 10:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e08934f0-f49d-58cc-829c-8f77f16c6d37 with identifier: MH55571 to the API
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MH55571>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:41:25Z',
 'fuel_type': 'petrol',
 'id': 'e08934f0-f49d-58cc-829c-8f77f16c6d37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH55571',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 91878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_66b0b0e27cbeb1780ae1a431d3b010c3.jpg',
                'https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_0554a774a107e863adc8c551c1ddd83e.jpg',
                'https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_0d87b19a2b517b9fef0e6718648c12eb.jpg',
                'https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_e0a48e9928759f2cffaecb62b02eee0f.jpg',
                'https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_8bc1d9add9b6200fc352877beb6ac886.jpg',
                'https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_18062dcf0cd6791892d52c0bc289e3f6.jpg',
                'https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_e6cef107faab44df0e522594e467f6c3.jpg',
                'https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_08886dbe78161f6321fba51fea8c8b46.jpg',
                'https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_409da628f28d3cb47000b051a059aa4c.jpg',
                'https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_b3362c2af58da7df07fedf6c411c658b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e08934f0-f49d-58cc-829c-8f77f16c6d37/e08934f0-f49d-58cc-829c-8f77f16c6d37_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_66b0b0e27cbeb1780ae1a431d3b010c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e08934f0-f49d-58cc-829c-8f77f16c6d37/e08934f0-f49d-58cc-829c-8f77f16c6d37_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3451418,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_0554a774a107e863adc8c551c1ddd83e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e08934f0-f49d-58cc-829c-8f77f16c6d37/e08934f0-f49d-58cc-829c-8f77f16c6d37_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_0d87b19a2b517b9fef0e6718648c12eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e08934f0-f49d-58cc-829c-8f77f16c6d37/e08934f0-f49d-58cc-829c-8f77f16c6d37_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3345661,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_e0a48e9928759f2cffaecb62b02eee0f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e08934f0-f49d-58cc-829c-8f77f16c6d37/e08934f0-f49d-58cc-829c-8f77f16c6d37_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_8bc1d9add9b6200fc352877beb6ac886.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e08934f0-f49d-58cc-829c-8f77f16c6d37/e08934f0-f49d-58cc-829c-8f77f16c6d37_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3315798,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_18062dcf0cd6791892d52c0bc289e3f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e08934f0-f49d-58cc-829c-8f77f16c6d37/e08934f0-f49d-58cc-829c-8f77f16c6d37_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_e6cef107faab44df0e522594e467f6c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e08934f0-f49d-58cc-829c-8f77f16c6d37/e08934f0-f49d-58cc-829c-8f77f16c6d37_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_08886dbe78161f6321fba51fea8c8b46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e08934f0-f49d-58cc-829c-8f77f16c6d37/e08934f0-f49d-58cc-829c-8f77f16c6d37_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3378702,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_409da628f28d3cb47000b051a059aa4c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e08934f0-f49d-58cc-829c-8f77f16c6d37/e08934f0-f49d-58cc-829c-8f77f16c6d37_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/46/b4469120878b4f9ec66340e09aca93da/pa/MH55571_b3362c2af58da7df07fedf6c411c658b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-23',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500C 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2020}
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH55571%27 HTTP/1.1" 200 None
2026-03-30 10:37:03 [auto1.de] INFO: Saving data for MH55571: {'created_time': 1774867023.563123, 'last_price_update_time': 1774867023.563131, 'auction_closing_time': 1774971685.0}
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH55571') HTTP/1.1" 204 0
2026-03-30 10:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_8290b148f7628ce7050638bbc3bd48e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3dd90>
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b22f29d-4a12-590d-a12c-d57ed5359dee/1b22f29d-4a12-590d-a12c-d57ed5359dee_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556397302f6aea3d5dc35bd37f7d390%252Fpa%252FUW88941_922862f0569cefc2f0638851d5f237e2.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_922862f0569cefc2f0638851d5f237e2.jpg saved to cache
2026-03-30 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b22f29d-4a12-590d-a12c-d57ed5359dee
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414ccd0>
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b22f29d-4a12-590d-a12c-d57ed5359dee/1b22f29d-4a12-590d-a12c-d57ed5359dee_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556397302f6aea3d5dc35bd37f7d390%252Fpa%252FUW88941_8290b148f7628ce7050638bbc3bd48e9.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_8290b148f7628ce7050638bbc3bd48e9.jpg saved to cache
2026-03-30 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b22f29d-4a12-590d-a12c-d57ed5359dee
2026-03-30 10:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_af9b9f3b4991afe2e4c90c9f57d4afa5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_a59207920a5b80bf29cfb9f1826fcd2d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42939d0>
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b22f29d-4a12-590d-a12c-d57ed5359dee/1b22f29d-4a12-590d-a12c-d57ed5359dee_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556397302f6aea3d5dc35bd37f7d390%252Fpa%252FUW88941_af9b9f3b4991afe2e4c90c9f57d4afa5.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_af9b9f3b4991afe2e4c90c9f57d4afa5.jpg saved to cache
2026-03-30 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b22f29d-4a12-590d-a12c-d57ed5359dee
2026-03-30 10:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_c3be1e4257f7c8961f2afed48fb89808.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f438b750>
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b22f29d-4a12-590d-a12c-d57ed5359dee/1b22f29d-4a12-590d-a12c-d57ed5359dee_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556397302f6aea3d5dc35bd37f7d390%252Fpa%252FUW88941_a59207920a5b80bf29cfb9f1826fcd2d.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_a59207920a5b80bf29cfb9f1826fcd2d.jpg saved to cache
2026-03-30 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b22f29d-4a12-590d-a12c-d57ed5359dee
2026-03-30 10:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_ad567bc9bc3354f26e87984a25c80db4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef62d0>
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b22f29d-4a12-590d-a12c-d57ed5359dee/1b22f29d-4a12-590d-a12c-d57ed5359dee_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556397302f6aea3d5dc35bd37f7d390%252Fpa%252FUW88941_c3be1e4257f7c8961f2afed48fb89808.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_c3be1e4257f7c8961f2afed48fb89808.jpg saved to cache
2026-03-30 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b22f29d-4a12-590d-a12c-d57ed5359dee
2026-03-30 10:37:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b22f29d-4a12-590d-a12c-d57ed5359dee, skipping ID generation
2026-03-30 10:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b22f29d-4a12-590d-a12c-d57ed5359dee with scrape type 1
2026-03-30 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b22f29d-4a12-590d-a12c-d57ed5359dee sending to next pipeline
2026-03-30 10:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b22f29d-4a12-590d-a12c-d57ed5359dee, identifier: UW88941
2026-03-30 10:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b22f29d-4a12-590d-a12c-d57ed5359dee with identifier: UW88941
2026-03-30 10:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b22f29d-4a12-590d-a12c-d57ed5359dee with identifier: UW88941
2026-03-30 10:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b22f29d-4a12-590d-a12c-d57ed5359dee with identifier: UW88941 to the API
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_c3be1e4257f7c8961f2afed48fb89808.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:10:22Z',
 'fuel_type': 'petrol',
 'id': '1b22f29d-4a12-590d-a12c-d57ed5359dee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW88941',
 'listing': 'auction',
 'location': 'DE, Kleve',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 201489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b22f29d-4a12-590d-a12c-d57ed5359dee/1b22f29d-4a12-590d-a12c-d57ed5359dee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_c3be1e4257f7c8961f2afed48fb89808.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b22f29d-4a12-590d-a12c-d57ed5359dee/1b22f29d-4a12-590d-a12c-d57ed5359dee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_a59207920a5b80bf29cfb9f1826fcd2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b22f29d-4a12-590d-a12c-d57ed5359dee/1b22f29d-4a12-590d-a12c-d57ed5359dee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_af9b9f3b4991afe2e4c90c9f57d4afa5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b22f29d-4a12-590d-a12c-d57ed5359dee/1b22f29d-4a12-590d-a12c-d57ed5359dee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_8290b148f7628ce7050638bbc3bd48e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b22f29d-4a12-590d-a12c-d57ed5359dee/1b22f29d-4a12-590d-a12c-d57ed5359dee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/56/8556397302f6aea3d5dc35bd37f7d390/pa/UW88941_922862f0569cefc2f0638851d5f237e2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-02-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2009}
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW88941%27 HTTP/1.1" 200 None
2026-03-30 10:37:04 [auto1.de] INFO: Saving data for UW88941: {'created_time': 1774867024.507742, 'last_price_update_time': 1774867024.507752, 'auction_closing_time': 1774969822.0}
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW88941') HTTP/1.1" 204 0
2026-03-30 10:37:04 [scrapy.extensions.logstats] INFO: Crawled 244 pages (at 42 pages/min), scraped 148 items (at 34 items/min)
2026-03-30 10:37:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XW43246/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee70bd0>
2026-03-30 10:37:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_ad567bc9bc3354f26e87984a25c80db4.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_ad567bc9bc3354f26e87984a25c80db4.jpg saved to cache
2026-03-30 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0110461f-f854-55d0-904b-a8d49a64f73c
2026-03-30 10:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB65730> (referer: https://www.auto1.com/v1/car-details-view/YB65730/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_93bafd19cc6584d3ceef8c1e978565ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc99f406-df1b-5173-bd5a-8759ccb33474 with identifier: YB65730
2026-03-30 10:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc99f406-df1b-5173-bd5a-8759ccb33474 with scrape type 1
2026-03-30 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc99f406-df1b-5173-bd5a-8759ccb33474
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf33dc0d182dc159bfc644a8249246%252Fpa%252FYB65730_9a083f9fe66c7aabc54f10aa72a3ba5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_9a083f9fe66c7aabc54f10aa72a3ba5a.jpg already downloaded
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf33dc0d182dc159bfc644a8249246%252Fpa%252FYB65730_88c5a52ea96d06f50998cf830b3f877d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_88c5a52ea96d06f50998cf830b3f877d.jpg already downloaded
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf33dc0d182dc159bfc644a8249246%252Fpa%252FYB65730_5fae955d44505dbf7142cabb33791cc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_5fae955d44505dbf7142cabb33791cc7.jpg already downloaded
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf33dc0d182dc159bfc644a8249246%252Fpa%252FYB65730_f46d9480b71f4cef16ea9503092686e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_f46d9480b71f4cef16ea9503092686e2.jpg already downloaded
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf33dc0d182dc159bfc644a8249246%252Fpa%252FYB65730_3e467766381447a6f728feb0ea6aa20a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_3e467766381447a6f728feb0ea6aa20a.jpg already downloaded
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf33dc0d182dc159bfc644a8249246%252Fpa%252FYB65730_522889931819dcafb14bdda087f5004a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_522889931819dcafb14bdda087f5004a.jpg already downloaded
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf33dc0d182dc159bfc644a8249246%252Fpa%252FYB65730_80c55d449a576a5d0bb78d3c782854e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_80c55d449a576a5d0bb78d3c782854e0.jpg already downloaded
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf33dc0d182dc159bfc644a8249246%252Fpa%252FYB65730_31736151b0a5c79702c6014e9637e869.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_31736151b0a5c79702c6014e9637e869.jpg already downloaded
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf33dc0d182dc159bfc644a8249246%252Fpa%252FYB65730_41186bbd378c4c5894a1b5ffeb025fb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_41186bbd378c4c5894a1b5ffeb025fb8.jpg already downloaded
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf33dc0d182dc159bfc644a8249246%252Fpa%252FYB65730_a553ec27f2542bdd1aa096efeab77ff4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_a553ec27f2542bdd1aa096efeab77ff4.jpg already downloaded
2026-03-30 10:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc99f406-df1b-5173-bd5a-8759ccb33474, identifier: YB65730
2026-03-30 10:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc99f406-df1b-5173-bd5a-8759ccb33474 with identifier: YB65730
2026-03-30 10:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc99f406-df1b-5173-bd5a-8759ccb33474 with identifier: YB65730
2026-03-30 10:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc99f406-df1b-5173-bd5a-8759ccb33474 with identifier: YB65730 to the API
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YB65730>
{'auction_title': '',
 'c_o_2_emission_value': 204,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 239,
 'expiration_date': '2026-03-31T15:00:14Z',
 'fuel_type': 'diesel',
 'id': 'cc99f406-df1b-5173-bd5a-8759ccb33474',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB65730',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 229303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_9a083f9fe66c7aabc54f10aa72a3ba5a.jpg',
                'https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_88c5a52ea96d06f50998cf830b3f877d.jpg',
                'https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_5fae955d44505dbf7142cabb33791cc7.jpg',
                'https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_f46d9480b71f4cef16ea9503092686e2.jpg',
                'https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_3e467766381447a6f728feb0ea6aa20a.jpg',
                'https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_522889931819dcafb14bdda087f5004a.jpg',
                'https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_80c55d449a576a5d0bb78d3c782854e0.jpg',
                'https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_31736151b0a5c79702c6014e9637e869.jpg',
                'https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_41186bbd378c4c5894a1b5ffeb025fb8.jpg',
                'https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_a553ec27f2542bdd1aa096efeab77ff4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc99f406-df1b-5173-bd5a-8759ccb33474/cc99f406-df1b-5173-bd5a-8759ccb33474_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_9a083f9fe66c7aabc54f10aa72a3ba5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc99f406-df1b-5173-bd5a-8759ccb33474/cc99f406-df1b-5173-bd5a-8759ccb33474_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_88c5a52ea96d06f50998cf830b3f877d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc99f406-df1b-5173-bd5a-8759ccb33474/cc99f406-df1b-5173-bd5a-8759ccb33474_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_5fae955d44505dbf7142cabb33791cc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc99f406-df1b-5173-bd5a-8759ccb33474/cc99f406-df1b-5173-bd5a-8759ccb33474_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_f46d9480b71f4cef16ea9503092686e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc99f406-df1b-5173-bd5a-8759ccb33474/cc99f406-df1b-5173-bd5a-8759ccb33474_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_3e467766381447a6f728feb0ea6aa20a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc99f406-df1b-5173-bd5a-8759ccb33474/cc99f406-df1b-5173-bd5a-8759ccb33474_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_522889931819dcafb14bdda087f5004a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc99f406-df1b-5173-bd5a-8759ccb33474/cc99f406-df1b-5173-bd5a-8759ccb33474_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_80c55d449a576a5d0bb78d3c782854e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc99f406-df1b-5173-bd5a-8759ccb33474/cc99f406-df1b-5173-bd5a-8759ccb33474_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_31736151b0a5c79702c6014e9637e869.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc99f406-df1b-5173-bd5a-8759ccb33474/cc99f406-df1b-5173-bd5a-8759ccb33474_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_41186bbd378c4c5894a1b5ffeb025fb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc99f406-df1b-5173-bd5a-8759ccb33474/cc99f406-df1b-5173-bd5a-8759ccb33474_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf33dc0d182dc159bfc644a8249246/pa/YB65730_a553ec27f2542bdd1aa096efeab77ff4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-11',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 300 d AVANTGARDE extralang',
 'transmission': 'automatic',
 'trim': 'AVANTGARDE extralang',
 'year': 2020}
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB65730%27 HTTP/1.1" 200 None
2026-03-30 10:37:05 [auto1.de] INFO: Saving data for YB65730: {'created_time': 1774867025.375223, 'last_price_update_time': 1774867025.375237, 'auction_closing_time': 1774969214.0}
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB65730') HTTP/1.1" 204 0
2026-03-30 10:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VN28198> (referer: https://www.auto1.com/v1/car-details-view/VN28198/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f597f050>
2026-03-30 10:37:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_93bafd19cc6584d3ceef8c1e978565ea.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_93bafd19cc6584d3ceef8c1e978565ea.jpg saved to cache
2026-03-30 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0110461f-f854-55d0-904b-a8d49a64f73c
2026-03-30 10:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ce5ec48-ec5a-5442-abe2-12a62613fc54 with identifier: VN28198
2026-03-30 10:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ce5ec48-ec5a-5442-abe2-12a62613fc54 with scrape type 1
2026-03-30 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1ce5ec48-ec5a-5442-abe2-12a62613fc54
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_181dc052ce1e6c9f8019701447104de0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_181dc052ce1e6c9f8019701447104de0.jpg not downloaded yet
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_70aa2c220d57e268e3ff51925d0f3179.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_70aa2c220d57e268e3ff51925d0f3179.jpg not downloaded yet
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_0757282384810d56dcff8bb4ab1eab6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_0757282384810d56dcff8bb4ab1eab6d.jpg not downloaded yet
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_9a47374905469907515428e71670212f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_9a47374905469907515428e71670212f.jpg not downloaded yet
2026-03-30 10:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_70ad5e01d1f82f01d0145bae1ddfdd06.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_bec31dd6579972ae11674409c048ef05.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_bec31dd6579972ae11674409c048ef05.jpg not downloaded yet
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_7bfbc093e69191cd70c4540c9aac0cb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_7bfbc093e69191cd70c4540c9aac0cb6.jpg not downloaded yet
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_ff17034cecf8cceb38176fec77a28720.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_ff17034cecf8cceb38176fec77a28720.jpg not downloaded yet
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_6c97e1f1a9fcf2f958353174974d683e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_6c97e1f1a9fcf2f958353174974d683e.jpg not downloaded yet
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_f678febf5dd5bc55ff83315e80f368c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_f678febf5dd5bc55ff83315e80f368c2.jpg not downloaded yet
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_871fb7add7d8813feb3f30d6abc0efe5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_871fb7add7d8813feb3f30d6abc0efe5.jpg not downloaded yet
2026-03-30 10:37:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee77410>
2026-03-30 10:37:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F79%252F6279e0a0bab650d89306a8a65bfbf756%252Fpa%252FTM34763_70ad5e01d1f82f01d0145bae1ddfdd06.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_70ad5e01d1f82f01d0145bae1ddfdd06.jpg saved to cache
2026-03-30 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0110461f-f854-55d0-904b-a8d49a64f73c
2026-03-30 10:37:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0110461f-f854-55d0-904b-a8d49a64f73c, skipping ID generation
2026-03-30 10:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0110461f-f854-55d0-904b-a8d49a64f73c with scrape type 1
2026-03-30 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0110461f-f854-55d0-904b-a8d49a64f73c sending to next pipeline
2026-03-30 10:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0110461f-f854-55d0-904b-a8d49a64f73c, identifier: TM34763
2026-03-30 10:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0110461f-f854-55d0-904b-a8d49a64f73c with identifier: TM34763
2026-03-30 10:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0110461f-f854-55d0-904b-a8d49a64f73c with identifier: TM34763
2026-03-30 10:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0110461f-f854-55d0-904b-a8d49a64f73c with identifier: TM34763 to the API
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_70ad5e01d1f82f01d0145bae1ddfdd06.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:44:42Z',
 'fuel_type': 'diesel',
 'id': '0110461f-f854-55d0-904b-a8d49a64f73c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM34763',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 172671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_70ad5e01d1f82f01d0145bae1ddfdd06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_93bafd19cc6584d3ceef8c1e978565ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_ad567bc9bc3354f26e87984a25c80db4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_27085e60c0f1e34b2630aa62dd1e4adb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_878a6067848a664249d653b608219d52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_dc3829f12c176cf01afc0a98dec8d3bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_eebf90e145526059e84daf30870db913.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_1202c9898160113329ebcb89db02263a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_d60810d1accdce3dab9f0a586dee81e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0110461f-f854-55d0-904b-a8d49a64f73c/0110461f-f854-55d0-904b-a8d49a64f73c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/79/6279e0a0bab650d89306a8a65bfbf756/pa/TM34763_9a6e84db695d9cbe0504f61a7805bbfb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM34763%27 HTTP/1.1" 200 None
2026-03-30 10:37:06 [auto1.de] INFO: Saving data for TM34763: {'created_time': 1774867026.196549, 'last_price_update_time': 1774867026.196561, 'auction_closing_time': 1774971882.0}
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM34763') HTTP/1.1" 204 0
2026-03-30 10:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_9a47374905469907515428e71670212f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4172710>
2026-03-30 10:37:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_9a47374905469907515428e71670212f.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_9a47374905469907515428e71670212f.jpg saved to cache
2026-03-30 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1ce5ec48-ec5a-5442-abe2-12a62613fc54
2026-03-30 10:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_871fb7add7d8813feb3f30d6abc0efe5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3af90>
2026-03-30 10:37:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_871fb7add7d8813feb3f30d6abc0efe5.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_871fb7add7d8813feb3f30d6abc0efe5.jpg saved to cache
2026-03-30 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1ce5ec48-ec5a-5442-abe2-12a62613fc54
2026-03-30 10:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_f678febf5dd5bc55ff83315e80f368c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a7d90>
2026-03-30 10:37:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_f678febf5dd5bc55ff83315e80f368c2.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_f678febf5dd5bc55ff83315e80f368c2.jpg saved to cache
2026-03-30 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1ce5ec48-ec5a-5442-abe2-12a62613fc54
2026-03-30 10:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_6c97e1f1a9fcf2f958353174974d683e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefb7ad0>
2026-03-30 10:37:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_6c97e1f1a9fcf2f958353174974d683e.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_6c97e1f1a9fcf2f958353174974d683e.jpg saved to cache
2026-03-30 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1ce5ec48-ec5a-5442-abe2-12a62613fc54
2026-03-30 10:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_ff17034cecf8cceb38176fec77a28720.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef76810>
2026-03-30 10:37:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_ff17034cecf8cceb38176fec77a28720.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_ff17034cecf8cceb38176fec77a28720.jpg saved to cache
2026-03-30 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1ce5ec48-ec5a-5442-abe2-12a62613fc54
2026-03-30 10:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_7bfbc093e69191cd70c4540c9aac0cb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4221810>
2026-03-30 10:37:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_7bfbc093e69191cd70c4540c9aac0cb6.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_7bfbc093e69191cd70c4540c9aac0cb6.jpg saved to cache
2026-03-30 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1ce5ec48-ec5a-5442-abe2-12a62613fc54
2026-03-30 10:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_bec31dd6579972ae11674409c048ef05.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4172110>
2026-03-30 10:37:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_bec31dd6579972ae11674409c048ef05.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_bec31dd6579972ae11674409c048ef05.jpg saved to cache
2026-03-30 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1ce5ec48-ec5a-5442-abe2-12a62613fc54
2026-03-30 10:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HX91404> (referer: https://www.auto1.com/v1/car-details-view/HX91404/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_0757282384810d56dcff8bb4ab1eab6d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12d55d2b-c382-529b-95d7-ec7f3106cbfb with identifier: HX91404
2026-03-30 10:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12d55d2b-c382-529b-95d7-ec7f3106cbfb with scrape type 1
2026-03-30 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 12d55d2b-c382-529b-95d7-ec7f3106cbfb
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_626420c5f15e439513ed17982bac2757.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_626420c5f15e439513ed17982bac2757.jpg not downloaded yet
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_607b03216dbf5c2cf73f91b288a658c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_607b03216dbf5c2cf73f91b288a658c9.jpg not downloaded yet
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_e47d9c86bb2e3893af912ad83f2dc349.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_e47d9c86bb2e3893af912ad83f2dc349.jpg not downloaded yet
2026-03-30 10:37:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea09d0>
2026-03-30 10:37:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_0757282384810d56dcff8bb4ab1eab6d.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_0757282384810d56dcff8bb4ab1eab6d.jpg saved to cache
2026-03-30 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1ce5ec48-ec5a-5442-abe2-12a62613fc54
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_bf1f69ddfb42578a900a4fb4ad8aa130.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_bf1f69ddfb42578a900a4fb4ad8aa130.jpg not downloaded yet
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_2c8c7e5e7bb504acc3548f49d3e0110b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_2c8c7e5e7bb504acc3548f49d3e0110b.jpg not downloaded yet
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_d1f548d1437b51953089a071cb37cb9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_d1f548d1437b51953089a071cb37cb9d.jpg not downloaded yet
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_e5fa3e434e8e274358534af87417d278.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_e5fa3e434e8e274358534af87417d278.jpg not downloaded yet
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_a3c2086c6e608b278f62683270237607.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_a3c2086c6e608b278f62683270237607.jpg not downloaded yet
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_33152abfdd9813d45140f41a54dcb1aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_33152abfdd9813d45140f41a54dcb1aa.jpg not downloaded yet
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_6f3533df3bbf204f1391ef96d1d7ca9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_6f3533df3bbf204f1391ef96d1d7ca9a.jpg not downloaded yet
2026-03-30 10:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_70aa2c220d57e268e3ff51925d0f3179.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_181dc052ce1e6c9f8019701447104de0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417e910>
2026-03-30 10:37:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_70aa2c220d57e268e3ff51925d0f3179.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_70aa2c220d57e268e3ff51925d0f3179.jpg saved to cache
2026-03-30 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ce5ec48-ec5a-5442-abe2-12a62613fc54
2026-03-30 10:37:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb7590>
2026-03-30 10:37:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F20%252Fe3209578bd4fc8562884456b7183e763%252Fpa%252FVN28198_181dc052ce1e6c9f8019701447104de0.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_181dc052ce1e6c9f8019701447104de0.jpg saved to cache
2026-03-30 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ce5ec48-ec5a-5442-abe2-12a62613fc54
2026-03-30 10:37:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ce5ec48-ec5a-5442-abe2-12a62613fc54, skipping ID generation
2026-03-30 10:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ce5ec48-ec5a-5442-abe2-12a62613fc54 with scrape type 1
2026-03-30 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ce5ec48-ec5a-5442-abe2-12a62613fc54 sending to next pipeline
2026-03-30 10:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ce5ec48-ec5a-5442-abe2-12a62613fc54, identifier: VN28198
2026-03-30 10:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ce5ec48-ec5a-5442-abe2-12a62613fc54 with identifier: VN28198
2026-03-30 10:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ce5ec48-ec5a-5442-abe2-12a62613fc54 with identifier: VN28198
2026-03-30 10:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ce5ec48-ec5a-5442-abe2-12a62613fc54 with identifier: VN28198 to the API
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_181dc052ce1e6c9f8019701447104de0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:44:10Z',
 'fuel_type': 'petrol',
 'id': '1ce5ec48-ec5a-5442-abe2-12a62613fc54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN28198',
 'listing': 'auction',
 'location': 'DE, Blankenfelde-Mahlow',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 60578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2833093,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_181dc052ce1e6c9f8019701447104de0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2979073,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_70aa2c220d57e268e3ff51925d0f3179.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2923924,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_0757282384810d56dcff8bb4ab1eab6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2884035,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_9a47374905469907515428e71670212f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2866433,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_bec31dd6579972ae11674409c048ef05.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2973335,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_7bfbc093e69191cd70c4540c9aac0cb6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2993495,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_ff17034cecf8cceb38176fec77a28720.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2900333,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_6c97e1f1a9fcf2f958353174974d683e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2911124,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_f678febf5dd5bc55ff83315e80f368c2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ce5ec48-ec5a-5442-abe2-12a62613fc54/1ce5ec48-ec5a-5442-abe2-12a62613fc54_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3015931,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/20/e3209578bd4fc8562884456b7183e763/pa/VN28198_871fb7add7d8813feb3f30d6abc0efe5.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN28198%27 HTTP/1.1" 200 None
2026-03-30 10:37:09 [auto1.de] INFO: Saving data for VN28198: {'created_time': 1774867029.960702, 'last_price_update_time': 1774867029.960717, 'auction_closing_time': 1774971850.0}
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN28198') HTTP/1.1" 204 0
2026-03-30 10:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_6f3533df3bbf204f1391ef96d1d7ca9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_33152abfdd9813d45140f41a54dcb1aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417f750>
2026-03-30 10:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_6f3533df3bbf204f1391ef96d1d7ca9a.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_6f3533df3bbf204f1391ef96d1d7ca9a.jpg saved to cache
2026-03-30 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 12d55d2b-c382-529b-95d7-ec7f3106cbfb
2026-03-30 10:37:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4173ed0>
2026-03-30 10:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_33152abfdd9813d45140f41a54dcb1aa.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_33152abfdd9813d45140f41a54dcb1aa.jpg saved to cache
2026-03-30 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 12d55d2b-c382-529b-95d7-ec7f3106cbfb
2026-03-30 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_a3c2086c6e608b278f62683270237607.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee3c910>
2026-03-30 10:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_a3c2086c6e608b278f62683270237607.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_a3c2086c6e608b278f62683270237607.jpg saved to cache
2026-03-30 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 12d55d2b-c382-529b-95d7-ec7f3106cbfb
2026-03-30 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_e5fa3e434e8e274358534af87417d278.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef39650>
2026-03-30 10:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_e5fa3e434e8e274358534af87417d278.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_e5fa3e434e8e274358534af87417d278.jpg saved to cache
2026-03-30 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 12d55d2b-c382-529b-95d7-ec7f3106cbfb
2026-03-30 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_d1f548d1437b51953089a071cb37cb9d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_2c8c7e5e7bb504acc3548f49d3e0110b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee44d5d0>
2026-03-30 10:37:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_d1f548d1437b51953089a071cb37cb9d.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_d1f548d1437b51953089a071cb37cb9d.jpg saved to cache
2026-03-30 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12d55d2b-c382-529b-95d7-ec7f3106cbfb
2026-03-30 10:37:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4194350>
2026-03-30 10:37:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_2c8c7e5e7bb504acc3548f49d3e0110b.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_2c8c7e5e7bb504acc3548f49d3e0110b.jpg saved to cache
2026-03-30 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12d55d2b-c382-529b-95d7-ec7f3106cbfb
2026-03-30 10:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_bf1f69ddfb42578a900a4fb4ad8aa130.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3b090>
2026-03-30 10:37:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_bf1f69ddfb42578a900a4fb4ad8aa130.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_bf1f69ddfb42578a900a4fb4ad8aa130.jpg saved to cache
2026-03-30 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12d55d2b-c382-529b-95d7-ec7f3106cbfb
2026-03-30 10:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_e47d9c86bb2e3893af912ad83f2dc349.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_607b03216dbf5c2cf73f91b288a658c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee561d0>
2026-03-30 10:37:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_e47d9c86bb2e3893af912ad83f2dc349.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_e47d9c86bb2e3893af912ad83f2dc349.jpg saved to cache
2026-03-30 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12d55d2b-c382-529b-95d7-ec7f3106cbfb
2026-03-30 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA98582> (referer: https://www.auto1.com/v1/car-details-view/JA98582/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefb6e90>
2026-03-30 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_607b03216dbf5c2cf73f91b288a658c9.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_607b03216dbf5c2cf73f91b288a658c9.jpg saved to cache
2026-03-30 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12d55d2b-c382-529b-95d7-ec7f3106cbfb
2026-03-30 10:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a528c9e9-4308-53c3-8296-9f33d9989574 with identifier: JA98582
2026-03-30 10:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a528c9e9-4308-53c3-8296-9f33d9989574 with scrape type 1
2026-03-30 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a528c9e9-4308-53c3-8296-9f33d9989574
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F6b%252F3f6b81667ca49f5e5fcc4756dde0b057%252Fpa%252FJA98582_596a4c1859d10cac54f79a3f1f56870b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_596a4c1859d10cac54f79a3f1f56870b.jpg not downloaded yet
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F6b%252F3f6b81667ca49f5e5fcc4756dde0b057%252Fpa%252FJA98582_cba72226a632fe31105860e16a229e11.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_cba72226a632fe31105860e16a229e11.jpg not downloaded yet
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F6b%252F3f6b81667ca49f5e5fcc4756dde0b057%252Fpa%252FJA98582_aa6074900e0ad436ceefd572b85bfd24.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_aa6074900e0ad436ceefd572b85bfd24.jpg not downloaded yet
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F6b%252F3f6b81667ca49f5e5fcc4756dde0b057%252Fpa%252FJA98582_fffef68c4f854c4418e41ccccb76bad8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_fffef68c4f854c4418e41ccccb76bad8.jpg not downloaded yet
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F6b%252F3f6b81667ca49f5e5fcc4756dde0b057%252Fpa%252FJA98582_3bb3af794ab68c5914e57686bb5748a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_3bb3af794ab68c5914e57686bb5748a5.jpg not downloaded yet
2026-03-30 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_626420c5f15e439513ed17982bac2757.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_3bb3af794ab68c5914e57686bb5748a5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3ea9d0>
2026-03-30 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F3f%252Fac3f07151f0995d8243c302e8eff1175%252Fpa%252FHX91404_626420c5f15e439513ed17982bac2757.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_626420c5f15e439513ed17982bac2757.jpg saved to cache
2026-03-30 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12d55d2b-c382-529b-95d7-ec7f3106cbfb
2026-03-30 10:37:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12d55d2b-c382-529b-95d7-ec7f3106cbfb, skipping ID generation
2026-03-30 10:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12d55d2b-c382-529b-95d7-ec7f3106cbfb with scrape type 1
2026-03-30 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12d55d2b-c382-529b-95d7-ec7f3106cbfb sending to next pipeline
2026-03-30 10:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12d55d2b-c382-529b-95d7-ec7f3106cbfb, identifier: HX91404
2026-03-30 10:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12d55d2b-c382-529b-95d7-ec7f3106cbfb with identifier: HX91404
2026-03-30 10:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12d55d2b-c382-529b-95d7-ec7f3106cbfb with identifier: HX91404
2026-03-30 10:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12d55d2b-c382-529b-95d7-ec7f3106cbfb with identifier: HX91404 to the API
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_626420c5f15e439513ed17982bac2757.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:59:32Z',
 'fuel_type': 'petrol',
 'id': '12d55d2b-c382-529b-95d7-ec7f3106cbfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX91404',
 'listing': 'auction',
 'location': 'DE, Laatzen',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 39444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2985122,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_626420c5f15e439513ed17982bac2757.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2991887,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_607b03216dbf5c2cf73f91b288a658c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3050547,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_e47d9c86bb2e3893af912ad83f2dc349.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3115798,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_bf1f69ddfb42578a900a4fb4ad8aa130.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3010794,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_2c8c7e5e7bb504acc3548f49d3e0110b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2991850,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_d1f548d1437b51953089a071cb37cb9d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3096243,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_e5fa3e434e8e274358534af87417d278.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2957953,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_a3c2086c6e608b278f62683270237607.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2801608,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_33152abfdd9813d45140f41a54dcb1aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12d55d2b-c382-529b-95d7-ec7f3106cbfb/12d55d2b-c382-529b-95d7-ec7f3106cbfb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3109162,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/3f/ac3f07151f0995d8243c302e8eff1175/pa/HX91404_6f3533df3bbf204f1391ef96d1d7ca9a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Clever',
 'transmission': 'automatic',
 'trim': 'Clever',
 'year': 2022}
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX91404%27 HTTP/1.1" 200 None
2026-03-30 10:37:13 [auto1.de] INFO: Saving data for HX91404: {'created_time': 1774867033.049114, 'last_price_update_time': 1774867033.049125, 'auction_closing_time': 1774972772.0}
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX91404') HTTP/1.1" 204 0
2026-03-30 10:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_fffef68c4f854c4418e41ccccb76bad8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS17636> (referer: https://www.auto1.com/v1/car-details-view/SS17636/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4395790>
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a528c9e9-4308-53c3-8296-9f33d9989574/a528c9e9-4308-53c3-8296-9f33d9989574_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F6b%252F3f6b81667ca49f5e5fcc4756dde0b057%252Fpa%252FJA98582_3bb3af794ab68c5914e57686bb5748a5.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_3bb3af794ab68c5914e57686bb5748a5.jpg saved to cache
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a528c9e9-4308-53c3-8296-9f33d9989574
2026-03-30 10:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_aa6074900e0ad436ceefd572b85bfd24.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e9d10>
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a528c9e9-4308-53c3-8296-9f33d9989574/a528c9e9-4308-53c3-8296-9f33d9989574_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F6b%252F3f6b81667ca49f5e5fcc4756dde0b057%252Fpa%252FJA98582_fffef68c4f854c4418e41ccccb76bad8.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_fffef68c4f854c4418e41ccccb76bad8.jpg saved to cache
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a528c9e9-4308-53c3-8296-9f33d9989574
2026-03-30 10:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_596a4c1859d10cac54f79a3f1f56870b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 789a741e-7348-5fb1-ade4-13244719ab84 with identifier: SS17636
2026-03-30 10:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 789a741e-7348-5fb1-ade4-13244719ab84 with scrape type 1
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 789a741e-7348-5fb1-ade4-13244719ab84
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_08558f278e116aad6c1b96fd4a6f2964.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_08558f278e116aad6c1b96fd4a6f2964.jpg not downloaded yet
2026-03-30 10:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_cba72226a632fe31105860e16a229e11.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_4f0dbc93001e3ca105befe4963d2ecec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_4f0dbc93001e3ca105befe4963d2ecec.jpg not downloaded yet
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_003e721b895caa886f8fec2541524f43.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_003e721b895caa886f8fec2541524f43.jpg not downloaded yet
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_1cc0bf9ece445f11f6a118c1d4d0d735.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_1cc0bf9ece445f11f6a118c1d4d0d735.jpg not downloaded yet
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea0050>
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a528c9e9-4308-53c3-8296-9f33d9989574/a528c9e9-4308-53c3-8296-9f33d9989574_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F6b%252F3f6b81667ca49f5e5fcc4756dde0b057%252Fpa%252FJA98582_aa6074900e0ad436ceefd572b85bfd24.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_aa6074900e0ad436ceefd572b85bfd24.jpg saved to cache
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a528c9e9-4308-53c3-8296-9f33d9989574
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_29e5152cebd8efaa32c68f8ba316cdf9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_29e5152cebd8efaa32c68f8ba316cdf9.jpg not downloaded yet
2026-03-30 10:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_08558f278e116aad6c1b96fd4a6f2964.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_ec90e029289b8db0d24932efbd343255.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_ec90e029289b8db0d24932efbd343255.jpg not downloaded yet
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee44fa90>
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a528c9e9-4308-53c3-8296-9f33d9989574/a528c9e9-4308-53c3-8296-9f33d9989574_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F6b%252F3f6b81667ca49f5e5fcc4756dde0b057%252Fpa%252FJA98582_596a4c1859d10cac54f79a3f1f56870b.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_596a4c1859d10cac54f79a3f1f56870b.jpg saved to cache
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a528c9e9-4308-53c3-8296-9f33d9989574
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeebe750>
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a528c9e9-4308-53c3-8296-9f33d9989574/a528c9e9-4308-53c3-8296-9f33d9989574_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F6b%252F3f6b81667ca49f5e5fcc4756dde0b057%252Fpa%252FJA98582_cba72226a632fe31105860e16a229e11.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_cba72226a632fe31105860e16a229e11.jpg saved to cache
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a528c9e9-4308-53c3-8296-9f33d9989574
2026-03-30 10:37:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a528c9e9-4308-53c3-8296-9f33d9989574, skipping ID generation
2026-03-30 10:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a528c9e9-4308-53c3-8296-9f33d9989574 with scrape type 1
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a528c9e9-4308-53c3-8296-9f33d9989574 sending to next pipeline
2026-03-30 10:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a528c9e9-4308-53c3-8296-9f33d9989574, identifier: JA98582
2026-03-30 10:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a528c9e9-4308-53c3-8296-9f33d9989574 with identifier: JA98582
2026-03-30 10:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a528c9e9-4308-53c3-8296-9f33d9989574 with identifier: JA98582
2026-03-30 10:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a528c9e9-4308-53c3-8296-9f33d9989574 with identifier: JA98582 to the API
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_cba72226a632fe31105860e16a229e11.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:33:43Z',
 'fuel_type': 'petrol',
 'id': 'a528c9e9-4308-53c3-8296-9f33d9989574',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA98582',
 'listing': 'auction',
 'location': 'DE, Augsburg',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 142849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a528c9e9-4308-53c3-8296-9f33d9989574/a528c9e9-4308-53c3-8296-9f33d9989574_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_596a4c1859d10cac54f79a3f1f56870b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a528c9e9-4308-53c3-8296-9f33d9989574/a528c9e9-4308-53c3-8296-9f33d9989574_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_cba72226a632fe31105860e16a229e11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a528c9e9-4308-53c3-8296-9f33d9989574/a528c9e9-4308-53c3-8296-9f33d9989574_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_aa6074900e0ad436ceefd572b85bfd24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a528c9e9-4308-53c3-8296-9f33d9989574/a528c9e9-4308-53c3-8296-9f33d9989574_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_fffef68c4f854c4418e41ccccb76bad8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a528c9e9-4308-53c3-8296-9f33d9989574/a528c9e9-4308-53c3-8296-9f33d9989574_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/6b/3f6b81667ca49f5e5fcc4756dde0b057/pa/JA98582_3bb3af794ab68c5914e57686bb5748a5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Kangoo 1.6 Be Bop',
 'transmission': 'manual',
 'trim': 'Be Bop',
 'year': 2010}
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA98582%27 HTTP/1.1" 200 None
2026-03-30 10:37:14 [auto1.de] INFO: Saving data for JA98582: {'created_time': 1774867034.003991, 'last_price_update_time': 1774867034.004002, 'auction_closing_time': 1774971223.0}
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA98582') HTTP/1.1" 204 0
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_94dc0343257ab3d15f0994e8b4b11e3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_94dc0343257ab3d15f0994e8b4b11e3a.jpg not downloaded yet
2026-03-30 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_1cc0bf9ece445f11f6a118c1d4d0d735.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_755761e56c513940a2de83512b431e00.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_755761e56c513940a2de83512b431e00.jpg not downloaded yet
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee02350>
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_08558f278e116aad6c1b96fd4a6f2964.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_08558f278e116aad6c1b96fd4a6f2964.jpg saved to cache
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 789a741e-7348-5fb1-ade4-13244719ab84
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_20c4978f2c2219397797adc0d7e57a80.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_20c4978f2c2219397797adc0d7e57a80.jpg not downloaded yet
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_51a6acaa5c350357423e947f6c77e572.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_51a6acaa5c350357423e947f6c77e572.jpg not downloaded yet
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef72a50>
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_1cc0bf9ece445f11f6a118c1d4d0d735.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_1cc0bf9ece445f11f6a118c1d4d0d735.jpg saved to cache
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 789a741e-7348-5fb1-ade4-13244719ab84
2026-03-30 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_94dc0343257ab3d15f0994e8b4b11e3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_51a6acaa5c350357423e947f6c77e572.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec4ed0>
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_94dc0343257ab3d15f0994e8b4b11e3a.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_94dc0343257ab3d15f0994e8b4b11e3a.jpg saved to cache
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 789a741e-7348-5fb1-ade4-13244719ab84
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f3d90>
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_51a6acaa5c350357423e947f6c77e572.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_51a6acaa5c350357423e947f6c77e572.jpg saved to cache
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 789a741e-7348-5fb1-ade4-13244719ab84
2026-03-30 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_20c4978f2c2219397797adc0d7e57a80.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_755761e56c513940a2de83512b431e00.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f422bf50>
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_20c4978f2c2219397797adc0d7e57a80.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_20c4978f2c2219397797adc0d7e57a80.jpg saved to cache
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 789a741e-7348-5fb1-ade4-13244719ab84
2026-03-30 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_ec90e029289b8db0d24932efbd343255.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4584d0>
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_755761e56c513940a2de83512b431e00.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_755761e56c513940a2de83512b431e00.jpg saved to cache
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 789a741e-7348-5fb1-ade4-13244719ab84
2026-03-30 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_29e5152cebd8efaa32c68f8ba316cdf9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ64850> (referer: https://www.auto1.com/v1/car-details-view/VZ64850/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43786d0>
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_ec90e029289b8db0d24932efbd343255.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_ec90e029289b8db0d24932efbd343255.jpg saved to cache
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 789a741e-7348-5fb1-ade4-13244719ab84
2026-03-30 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_003e721b895caa886f8fec2541524f43.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_4f0dbc93001e3ca105befe4963d2ecec.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec16d0>
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_29e5152cebd8efaa32c68f8ba316cdf9.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_29e5152cebd8efaa32c68f8ba316cdf9.jpg saved to cache
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 789a741e-7348-5fb1-ade4-13244719ab84
2026-03-30 10:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ce9228d-8d6f-5e0e-be00-88a18dd121d7 with identifier: VZ64850
2026-03-30 10:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ce9228d-8d6f-5e0e-be00-88a18dd121d7 with scrape type 1
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ce9228d-8d6f-5e0e-be00-88a18dd121d7
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fbf%252F83bf588b91c4ea5bf28993bbb59339ce%252Fpa%252FVZ64850_4986f1ec6dd6303277a777635c12525f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_4986f1ec6dd6303277a777635c12525f.jpg already downloaded
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fbf%252F83bf588b91c4ea5bf28993bbb59339ce%252Fpa%252FVZ64850_fe5aa371cb3ada373e82f7e67740cde6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_fe5aa371cb3ada373e82f7e67740cde6.jpg already downloaded
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fbf%252F83bf588b91c4ea5bf28993bbb59339ce%252Fpa%252FVZ64850_62c1b343cea792011b32dd38bcfcfe81.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_62c1b343cea792011b32dd38bcfcfe81.jpg already downloaded
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fbf%252F83bf588b91c4ea5bf28993bbb59339ce%252Fpa%252FVZ64850_ebd5a2845494f39b780cba91c42a9f64.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_ebd5a2845494f39b780cba91c42a9f64.jpg already downloaded
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fbf%252F83bf588b91c4ea5bf28993bbb59339ce%252Fpa%252FVZ64850_8364043687547795600df83b3acf080c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_8364043687547795600df83b3acf080c.jpg already downloaded
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fbf%252F83bf588b91c4ea5bf28993bbb59339ce%252Fpa%252FVZ64850_37f277e92f06bfacd109a0580c430319.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_37f277e92f06bfacd109a0580c430319.jpg already downloaded
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fbf%252F83bf588b91c4ea5bf28993bbb59339ce%252Fpa%252FVZ64850_009abb8c05b8910869b290f998c68e99.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_009abb8c05b8910869b290f998c68e99.jpg already downloaded
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fbf%252F83bf588b91c4ea5bf28993bbb59339ce%252Fpa%252FVZ64850_534d951286834454566f66d2541052e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_534d951286834454566f66d2541052e6.jpg already downloaded
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fbf%252F83bf588b91c4ea5bf28993bbb59339ce%252Fpa%252FVZ64850_07f20f7e6d9fbcf551e0d2f6da28fd7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_07f20f7e6d9fbcf551e0d2f6da28fd7a.jpg already downloaded
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fbf%252F83bf588b91c4ea5bf28993bbb59339ce%252Fpa%252FVZ64850_b1dbe18a7034b16c257f7b06468c2abf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_b1dbe18a7034b16c257f7b06468c2abf.jpg already downloaded
2026-03-30 10:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ce9228d-8d6f-5e0e-be00-88a18dd121d7, identifier: VZ64850
2026-03-30 10:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ce9228d-8d6f-5e0e-be00-88a18dd121d7 with identifier: VZ64850
2026-03-30 10:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ce9228d-8d6f-5e0e-be00-88a18dd121d7 with identifier: VZ64850
2026-03-30 10:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ce9228d-8d6f-5e0e-be00-88a18dd121d7 with identifier: VZ64850 to the API
2026-03-30 10:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VZ64850>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 272,
 'expiration_date': '2026-03-31T15:24:15Z',
 'fuel_type': 'petrol',
 'id': '7ce9228d-8d6f-5e0e-be00-88a18dd121d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ64850',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 56573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_4986f1ec6dd6303277a777635c12525f.jpg',
                'https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_fe5aa371cb3ada373e82f7e67740cde6.jpg',
                'https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_62c1b343cea792011b32dd38bcfcfe81.jpg',
                'https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_ebd5a2845494f39b780cba91c42a9f64.jpg',
                'https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_8364043687547795600df83b3acf080c.jpg',
                'https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_37f277e92f06bfacd109a0580c430319.jpg',
                'https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_009abb8c05b8910869b290f998c68e99.jpg',
                'https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_534d951286834454566f66d2541052e6.jpg',
                'https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_07f20f7e6d9fbcf551e0d2f6da28fd7a.jpg',
                'https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_b1dbe18a7034b16c257f7b06468c2abf.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce9228d-8d6f-5e0e-be00-88a18dd121d7/7ce9228d-8d6f-5e0e-be00-88a18dd121d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_4986f1ec6dd6303277a777635c12525f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce9228d-8d6f-5e0e-be00-88a18dd121d7/7ce9228d-8d6f-5e0e-be00-88a18dd121d7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_fe5aa371cb3ada373e82f7e67740cde6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce9228d-8d6f-5e0e-be00-88a18dd121d7/7ce9228d-8d6f-5e0e-be00-88a18dd121d7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_62c1b343cea792011b32dd38bcfcfe81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce9228d-8d6f-5e0e-be00-88a18dd121d7/7ce9228d-8d6f-5e0e-be00-88a18dd121d7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_ebd5a2845494f39b780cba91c42a9f64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce9228d-8d6f-5e0e-be00-88a18dd121d7/7ce9228d-8d6f-5e0e-be00-88a18dd121d7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_8364043687547795600df83b3acf080c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce9228d-8d6f-5e0e-be00-88a18dd121d7/7ce9228d-8d6f-5e0e-be00-88a18dd121d7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_37f277e92f06bfacd109a0580c430319.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce9228d-8d6f-5e0e-be00-88a18dd121d7/7ce9228d-8d6f-5e0e-be00-88a18dd121d7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_009abb8c05b8910869b290f998c68e99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce9228d-8d6f-5e0e-be00-88a18dd121d7/7ce9228d-8d6f-5e0e-be00-88a18dd121d7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_534d951286834454566f66d2541052e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce9228d-8d6f-5e0e-be00-88a18dd121d7/7ce9228d-8d6f-5e0e-be00-88a18dd121d7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3226791,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_07f20f7e6d9fbcf551e0d2f6da28fd7a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce9228d-8d6f-5e0e-be00-88a18dd121d7/7ce9228d-8d6f-5e0e-be00-88a18dd121d7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/bf/83bf588b91c4ea5bf28993bbb59339ce/pa/VZ64850_b1dbe18a7034b16c257f7b06468c2abf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 Mild-Hybrid T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2021}
2026-03-30 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ64850%27 HTTP/1.1" 200 None
2026-03-30 10:37:15 [auto1.de] INFO: Saving data for VZ64850: {'created_time': 1774867035.581284, 'last_price_update_time': 1774867035.581294, 'auction_closing_time': 1774970655.0}
2026-03-30 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ64850') HTTP/1.1" 204 0
2026-03-30 10:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS31363> (referer: https://www.auto1.com/v1/car-details-view/BS31363/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f422b1d0>
2026-03-30 10:37:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_003e721b895caa886f8fec2541524f43.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_003e721b895caa886f8fec2541524f43.jpg saved to cache
2026-03-30 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 789a741e-7348-5fb1-ade4-13244719ab84
2026-03-30 10:37:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417f790>
2026-03-30 10:37:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1b%252F091bf7135bb4a5af26c1705c5e9660fc%252Fpa%252FSS17636_4f0dbc93001e3ca105befe4963d2ecec.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_4f0dbc93001e3ca105befe4963d2ecec.jpg saved to cache
2026-03-30 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 789a741e-7348-5fb1-ade4-13244719ab84
2026-03-30 10:37:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 789a741e-7348-5fb1-ade4-13244719ab84, skipping ID generation
2026-03-30 10:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 789a741e-7348-5fb1-ade4-13244719ab84 with scrape type 1
2026-03-30 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 789a741e-7348-5fb1-ade4-13244719ab84 sending to next pipeline
2026-03-30 10:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 789a741e-7348-5fb1-ade4-13244719ab84, identifier: SS17636
2026-03-30 10:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 789a741e-7348-5fb1-ade4-13244719ab84 with identifier: SS17636
2026-03-30 10:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 789a741e-7348-5fb1-ade4-13244719ab84 with identifier: SS17636
2026-03-30 10:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 789a741e-7348-5fb1-ade4-13244719ab84 with identifier: SS17636 to the API
2026-03-30 10:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_4f0dbc93001e3ca105befe4963d2ecec.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:00:22Z',
 'fuel_type': 'diesel',
 'id': '789a741e-7348-5fb1-ade4-13244719ab84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS17636',
 'listing': 'auction',
 'location': 'DE, Kempten (Allgäu)',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 184896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_08558f278e116aad6c1b96fd4a6f2964.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_4f0dbc93001e3ca105befe4963d2ecec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_003e721b895caa886f8fec2541524f43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_1cc0bf9ece445f11f6a118c1d4d0d735.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_29e5152cebd8efaa32c68f8ba316cdf9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_ec90e029289b8db0d24932efbd343255.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_94dc0343257ab3d15f0994e8b4b11e3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_755761e56c513940a2de83512b431e00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_20c4978f2c2219397797adc0d7e57a80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_789a741e-7348-5fb1-ade4-13244719ab84/789a741e-7348-5fb1-ade4-13244719ab84_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1b/091bf7135bb4a5af26c1705c5e9660fc/pa/SS17636_51a6acaa5c350357423e947f6c77e572.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-24',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi 300 L2 Tourneo Titanium',
 'transmission': 'manual',
 'trim': '300 L2 Tourneo Titanium',
 'year': 2013}
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS17636%27 HTTP/1.1" 200 None
2026-03-30 10:37:16 [auto1.de] INFO: Saving data for SS17636: {'created_time': 1774867036.547482, 'last_price_update_time': 1774867036.547492, 'auction_closing_time': 1774969222.0}
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS17636') HTTP/1.1" 204 0
2026-03-30 10:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13a416b9-0e4c-5837-9181-8d2e283c8f5e with identifier: BS31363
2026-03-30 10:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13a416b9-0e4c-5837-9181-8d2e283c8f5e with scrape type 1
2026-03-30 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13a416b9-0e4c-5837-9181-8d2e283c8f5e
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F48%252F904813dee9a648977682d7730fe720b9%252Fpa%252FBS31363_f0034b1af25a35f646140ddbb0dc3a05.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_f0034b1af25a35f646140ddbb0dc3a05.jpg already downloaded
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F48%252F904813dee9a648977682d7730fe720b9%252Fpa%252FBS31363_9edc760917ea8e7c26a6e4bdf8588965.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_9edc760917ea8e7c26a6e4bdf8588965.jpg already downloaded
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F48%252F904813dee9a648977682d7730fe720b9%252Fpa%252FBS31363_b65ff985165b2685520dbb9e435f9f8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_b65ff985165b2685520dbb9e435f9f8c.jpg already downloaded
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F48%252F904813dee9a648977682d7730fe720b9%252Fpa%252FBS31363_beb7bedf83de6a02de82ed11dac10af8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_beb7bedf83de6a02de82ed11dac10af8.jpg already downloaded
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F48%252F904813dee9a648977682d7730fe720b9%252Fpa%252FBS31363_4a1cd2c074b6922b71f0d0568f5bb457.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_4a1cd2c074b6922b71f0d0568f5bb457.jpg already downloaded
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F48%252F904813dee9a648977682d7730fe720b9%252Fpa%252FBS31363_0eeb333ccb9eb269230d75c1f69cac29.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_0eeb333ccb9eb269230d75c1f69cac29.jpg already downloaded
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F48%252F904813dee9a648977682d7730fe720b9%252Fpa%252FBS31363_f8fa3d637809f6732dc7f97d50b51ae2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_f8fa3d637809f6732dc7f97d50b51ae2.jpg already downloaded
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F48%252F904813dee9a648977682d7730fe720b9%252Fpa%252FBS31363_3e8df80eb3c5041b3af81960649c56d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_3e8df80eb3c5041b3af81960649c56d4.jpg already downloaded
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F48%252F904813dee9a648977682d7730fe720b9%252Fpa%252FBS31363_36c16d00b11ad37b6be7a1d6936b711c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_36c16d00b11ad37b6be7a1d6936b711c.jpg already downloaded
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F48%252F904813dee9a648977682d7730fe720b9%252Fpa%252FBS31363_4d5b62e325c14200b99e8b7beb133b22.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_4d5b62e325c14200b99e8b7beb133b22.jpg already downloaded
2026-03-30 10:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13a416b9-0e4c-5837-9181-8d2e283c8f5e, identifier: BS31363
2026-03-30 10:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13a416b9-0e4c-5837-9181-8d2e283c8f5e with identifier: BS31363
2026-03-30 10:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13a416b9-0e4c-5837-9181-8d2e283c8f5e with identifier: BS31363
2026-03-30 10:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13a416b9-0e4c-5837-9181-8d2e283c8f5e with identifier: BS31363 to the API
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BS31363>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:04:06Z',
 'fuel_type': 'diesel',
 'id': '13a416b9-0e4c-5837-9181-8d2e283c8f5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS31363',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 85051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_f0034b1af25a35f646140ddbb0dc3a05.jpg',
                'https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_9edc760917ea8e7c26a6e4bdf8588965.jpg',
                'https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_b65ff985165b2685520dbb9e435f9f8c.jpg',
                'https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_beb7bedf83de6a02de82ed11dac10af8.jpg',
                'https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_4a1cd2c074b6922b71f0d0568f5bb457.jpg',
                'https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_0eeb333ccb9eb269230d75c1f69cac29.jpg',
                'https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_f8fa3d637809f6732dc7f97d50b51ae2.jpg',
                'https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_3e8df80eb3c5041b3af81960649c56d4.jpg',
                'https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_36c16d00b11ad37b6be7a1d6936b711c.jpg',
                'https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_4d5b62e325c14200b99e8b7beb133b22.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a416b9-0e4c-5837-9181-8d2e283c8f5e/13a416b9-0e4c-5837-9181-8d2e283c8f5e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_f0034b1af25a35f646140ddbb0dc3a05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a416b9-0e4c-5837-9181-8d2e283c8f5e/13a416b9-0e4c-5837-9181-8d2e283c8f5e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_9edc760917ea8e7c26a6e4bdf8588965.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a416b9-0e4c-5837-9181-8d2e283c8f5e/13a416b9-0e4c-5837-9181-8d2e283c8f5e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_b65ff985165b2685520dbb9e435f9f8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a416b9-0e4c-5837-9181-8d2e283c8f5e/13a416b9-0e4c-5837-9181-8d2e283c8f5e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_beb7bedf83de6a02de82ed11dac10af8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a416b9-0e4c-5837-9181-8d2e283c8f5e/13a416b9-0e4c-5837-9181-8d2e283c8f5e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_4a1cd2c074b6922b71f0d0568f5bb457.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a416b9-0e4c-5837-9181-8d2e283c8f5e/13a416b9-0e4c-5837-9181-8d2e283c8f5e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_0eeb333ccb9eb269230d75c1f69cac29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a416b9-0e4c-5837-9181-8d2e283c8f5e/13a416b9-0e4c-5837-9181-8d2e283c8f5e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_f8fa3d637809f6732dc7f97d50b51ae2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a416b9-0e4c-5837-9181-8d2e283c8f5e/13a416b9-0e4c-5837-9181-8d2e283c8f5e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_3e8df80eb3c5041b3af81960649c56d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a416b9-0e4c-5837-9181-8d2e283c8f5e/13a416b9-0e4c-5837-9181-8d2e283c8f5e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_36c16d00b11ad37b6be7a1d6936b711c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a416b9-0e4c-5837-9181-8d2e283c8f5e/13a416b9-0e4c-5837-9181-8d2e283c8f5e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/48/904813dee9a648977682d7730fe720b9/pa/BS31363_4d5b62e325c14200b99e8b7beb133b22.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2017}
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS31363%27 HTTP/1.1" 200 None
2026-03-30 10:37:17 [auto1.de] INFO: Saving data for BS31363: {'created_time': 1774867037.23339, 'last_price_update_time': 1774867037.233401, 'auction_closing_time': 1774969446.0}
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS31363') HTTP/1.1" 204 0
2026-03-30 10:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM17860> (referer: https://www.auto1.com/v1/car-details-view/PM17860/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 818a5351-51ea-5530-8daf-16278144cfcb with identifier: PM17860
2026-03-30 10:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 818a5351-51ea-5530-8daf-16278144cfcb with scrape type 1
2026-03-30 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 818a5351-51ea-5530-8daf-16278144cfcb
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_2ff20100902d435e1dc053d2e7da9883.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_2ff20100902d435e1dc053d2e7da9883.jpg not downloaded yet
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_72817b606781739040b1a6686243f4c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_72817b606781739040b1a6686243f4c3.jpg not downloaded yet
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_cb4c3b09d98a0201d4f6652d2bc3569f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_cb4c3b09d98a0201d4f6652d2bc3569f.jpg not downloaded yet
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_447dbece201516b63434d50e836e2811.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_447dbece201516b63434d50e836e2811.jpg not downloaded yet
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_eb61ce6d0239963819faf6f1bec46c71.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_eb61ce6d0239963819faf6f1bec46c71.jpg not downloaded yet
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_2d612557ddce5b7652850b37a5331df3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_2d612557ddce5b7652850b37a5331df3.jpg not downloaded yet
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_1ea66c5934a87cd28e0a5daf586c34a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_1ea66c5934a87cd28e0a5daf586c34a6.jpg not downloaded yet
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_620b1391bdd500bded3b69ceead0ad20.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_620b1391bdd500bded3b69ceead0ad20.jpg not downloaded yet
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_b3dbaeafb695b37bf80958b65a90367c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_b3dbaeafb695b37bf80958b65a90367c.jpg not downloaded yet
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_92131ff8c17d2c35ef245d0d28b4f766.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_92131ff8c17d2c35ef245d0d28b4f766.jpg not downloaded yet
2026-03-30 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW29948/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_92131ff8c17d2c35ef245d0d28b4f766.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4397c90>
2026-03-30 10:37:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_92131ff8c17d2c35ef245d0d28b4f766.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_92131ff8c17d2c35ef245d0d28b4f766.jpg saved to cache
2026-03-30 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 818a5351-51ea-5530-8daf-16278144cfcb
2026-03-30 10:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XW43246> (referer: https://www.auto1.com/v1/car-details-view/XW43246/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b5fa4f8-702b-516e-bf8b-fafe7910213b with identifier: XW43246
2026-03-30 10:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b5fa4f8-702b-516e-bf8b-fafe7910213b with scrape type 1
2026-03-30 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b5fa4f8-702b-516e-bf8b-fafe7910213b
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa3%252Feaa392727f0f5401713de691ce1fcaac%252Fpa%252FXW43246_129097006993fe02a67d3f4d2b8b6c2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_129097006993fe02a67d3f4d2b8b6c2a.jpg already downloaded
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa3%252Feaa392727f0f5401713de691ce1fcaac%252Fpa%252FXW43246_55f346942d54ea8f07d13b06a91c5515.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_55f346942d54ea8f07d13b06a91c5515.jpg already downloaded
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa3%252Feaa392727f0f5401713de691ce1fcaac%252Fpa%252FXW43246_7fe7f6251d0501594c792cc87c5729f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_7fe7f6251d0501594c792cc87c5729f5.jpg already downloaded
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa3%252Feaa392727f0f5401713de691ce1fcaac%252Fpa%252FXW43246_9927f41110a2765e11221aa208fc0b09.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_9927f41110a2765e11221aa208fc0b09.jpg already downloaded
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa3%252Feaa392727f0f5401713de691ce1fcaac%252Fpa%252FXW43246_24b5eabc8657ddaa55eb9a1be0d51b2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_24b5eabc8657ddaa55eb9a1be0d51b2d.jpg already downloaded
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa3%252Feaa392727f0f5401713de691ce1fcaac%252Fpa%252FXW43246_911e18049acd01184ac6a62425c14dff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_911e18049acd01184ac6a62425c14dff.jpg already downloaded
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa3%252Feaa392727f0f5401713de691ce1fcaac%252Fpa%252FXW43246_dd3548b4f28f9a349e038af0ff958555.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_dd3548b4f28f9a349e038af0ff958555.jpg already downloaded
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa3%252Feaa392727f0f5401713de691ce1fcaac%252Fpa%252FXW43246_3c87492003a034227ac4e31f5e7d3630.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_3c87492003a034227ac4e31f5e7d3630.jpg already downloaded
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa3%252Feaa392727f0f5401713de691ce1fcaac%252Fpa%252FXW43246_9569002ad105f4041f6cb40c7aec1511.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_9569002ad105f4041f6cb40c7aec1511.jpg already downloaded
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa3%252Feaa392727f0f5401713de691ce1fcaac%252Fpa%252FXW43246_b56e42a7f5e4d68afde1687ed5102cfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_b56e42a7f5e4d68afde1687ed5102cfe.jpg already downloaded
2026-03-30 10:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b5fa4f8-702b-516e-bf8b-fafe7910213b, identifier: XW43246
2026-03-30 10:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b5fa4f8-702b-516e-bf8b-fafe7910213b with identifier: XW43246
2026-03-30 10:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b5fa4f8-702b-516e-bf8b-fafe7910213b with identifier: XW43246
2026-03-30 10:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b5fa4f8-702b-516e-bf8b-fafe7910213b with identifier: XW43246 to the API
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XW43246>
{'auction_title': '',
 'c_o_2_emission_value': 193,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 272,
 'expiration_date': '2026-03-31T15:23:57Z',
 'fuel_type': 'petrol',
 'id': '4b5fa4f8-702b-516e-bf8b-fafe7910213b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW43246',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 18646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_129097006993fe02a67d3f4d2b8b6c2a.jpg',
                'https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_55f346942d54ea8f07d13b06a91c5515.jpg',
                'https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_7fe7f6251d0501594c792cc87c5729f5.jpg',
                'https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_9927f41110a2765e11221aa208fc0b09.jpg',
                'https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_24b5eabc8657ddaa55eb9a1be0d51b2d.jpg',
                'https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_911e18049acd01184ac6a62425c14dff.jpg',
                'https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_dd3548b4f28f9a349e038af0ff958555.jpg',
                'https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_3c87492003a034227ac4e31f5e7d3630.jpg',
                'https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_9569002ad105f4041f6cb40c7aec1511.jpg',
                'https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_b56e42a7f5e4d68afde1687ed5102cfe.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b5fa4f8-702b-516e-bf8b-fafe7910213b/4b5fa4f8-702b-516e-bf8b-fafe7910213b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_129097006993fe02a67d3f4d2b8b6c2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b5fa4f8-702b-516e-bf8b-fafe7910213b/4b5fa4f8-702b-516e-bf8b-fafe7910213b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_55f346942d54ea8f07d13b06a91c5515.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b5fa4f8-702b-516e-bf8b-fafe7910213b/4b5fa4f8-702b-516e-bf8b-fafe7910213b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_7fe7f6251d0501594c792cc87c5729f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b5fa4f8-702b-516e-bf8b-fafe7910213b/4b5fa4f8-702b-516e-bf8b-fafe7910213b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_9927f41110a2765e11221aa208fc0b09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b5fa4f8-702b-516e-bf8b-fafe7910213b/4b5fa4f8-702b-516e-bf8b-fafe7910213b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_24b5eabc8657ddaa55eb9a1be0d51b2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b5fa4f8-702b-516e-bf8b-fafe7910213b/4b5fa4f8-702b-516e-bf8b-fafe7910213b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_911e18049acd01184ac6a62425c14dff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b5fa4f8-702b-516e-bf8b-fafe7910213b/4b5fa4f8-702b-516e-bf8b-fafe7910213b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_dd3548b4f28f9a349e038af0ff958555.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b5fa4f8-702b-516e-bf8b-fafe7910213b/4b5fa4f8-702b-516e-bf8b-fafe7910213b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_3c87492003a034227ac4e31f5e7d3630.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b5fa4f8-702b-516e-bf8b-fafe7910213b/4b5fa4f8-702b-516e-bf8b-fafe7910213b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_9569002ad105f4041f6cb40c7aec1511.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b5fa4f8-702b-516e-bf8b-fafe7910213b/4b5fa4f8-702b-516e-bf8b-fafe7910213b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a3/eaa392727f0f5401713de691ce1fcaac/pa/XW43246_b56e42a7f5e4d68afde1687ed5102cfe.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300 Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW43246%27 HTTP/1.1" 200 None
2026-03-30 10:37:26 [auto1.de] INFO: Saving data for XW43246: {'created_time': 1774867046.355321, 'last_price_update_time': 1774867046.355334, 'auction_closing_time': 1774970637.0}
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW43246') HTTP/1.1" 204 0
2026-03-30 10:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AD08111> (referer: https://www.auto1.com/v1/car-details-view/AD08111/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_b3dbaeafb695b37bf80958b65a90367c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11ed3d49-cc4e-56ca-9d97-8267a4725e6d with identifier: AD08111
2026-03-30 10:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11ed3d49-cc4e-56ca-9d97-8267a4725e6d with scrape type 1
2026-03-30 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 11ed3d49-cc4e-56ca-9d97-8267a4725e6d
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_f0ec8161f58d2afddd4b52e88399e144.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_f0ec8161f58d2afddd4b52e88399e144.jpg not downloaded yet
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_b9cdc8fe7492b247dda5a68eedc63a6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_b9cdc8fe7492b247dda5a68eedc63a6c.jpg not downloaded yet
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_a02f7e3fd7f78ede5e6b40a5c1846853.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_a02f7e3fd7f78ede5e6b40a5c1846853.jpg not downloaded yet
2026-03-30 10:37:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb3390>
2026-03-30 10:37:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_b3dbaeafb695b37bf80958b65a90367c.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_b3dbaeafb695b37bf80958b65a90367c.jpg saved to cache
2026-03-30 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 818a5351-51ea-5530-8daf-16278144cfcb
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_505792fb21a1d0c6e03ece9482d79732.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_505792fb21a1d0c6e03ece9482d79732.jpg not downloaded yet
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_220af5d0d3e6b766517cfcf66d3fc4e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_220af5d0d3e6b766517cfcf66d3fc4e0.jpg not downloaded yet
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_1b772bb27dd9fdda1ac4b3bb8d7dbf12.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_1b772bb27dd9fdda1ac4b3bb8d7dbf12.jpg not downloaded yet
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_48db0819cc24acde3e1f8043f5fa3210.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_48db0819cc24acde3e1f8043f5fa3210.jpg not downloaded yet
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_c20b94595710ab5d2b3b15d87470b98b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_c20b94595710ab5d2b3b15d87470b98b.jpg not downloaded yet
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_28af1cf03b69b8801180356f384fa3d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_28af1cf03b69b8801180356f384fa3d3.jpg not downloaded yet
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_8ff5506244a13f4635b218c328b937e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_8ff5506244a13f4635b218c328b937e9.jpg not downloaded yet
2026-03-30 10:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_1ea66c5934a87cd28e0a5daf586c34a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_620b1391bdd500bded3b69ceead0ad20.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef2f90>
2026-03-30 10:37:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_1ea66c5934a87cd28e0a5daf586c34a6.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_1ea66c5934a87cd28e0a5daf586c34a6.jpg saved to cache
2026-03-30 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 818a5351-51ea-5530-8daf-16278144cfcb
2026-03-30 10:37:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef50d0>
2026-03-30 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_620b1391bdd500bded3b69ceead0ad20.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_620b1391bdd500bded3b69ceead0ad20.jpg saved to cache
2026-03-30 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 818a5351-51ea-5530-8daf-16278144cfcb
2026-03-30 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_8ff5506244a13f4635b218c328b937e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_28af1cf03b69b8801180356f384fa3d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417d490>
2026-03-30 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_8ff5506244a13f4635b218c328b937e9.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_8ff5506244a13f4635b218c328b937e9.jpg saved to cache
2026-03-30 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 11ed3d49-cc4e-56ca-9d97-8267a4725e6d
2026-03-30 10:37:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417e590>
2026-03-30 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_28af1cf03b69b8801180356f384fa3d3.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_28af1cf03b69b8801180356f384fa3d3.jpg saved to cache
2026-03-30 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 11ed3d49-cc4e-56ca-9d97-8267a4725e6d
2026-03-30 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_c20b94595710ab5d2b3b15d87470b98b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f437ae50>
2026-03-30 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_c20b94595710ab5d2b3b15d87470b98b.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_c20b94595710ab5d2b3b15d87470b98b.jpg saved to cache
2026-03-30 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 11ed3d49-cc4e-56ca-9d97-8267a4725e6d
2026-03-30 10:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_48db0819cc24acde3e1f8043f5fa3210.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_1b772bb27dd9fdda1ac4b3bb8d7dbf12.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f480b650>
2026-03-30 10:37:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_48db0819cc24acde3e1f8043f5fa3210.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_48db0819cc24acde3e1f8043f5fa3210.jpg saved to cache
2026-03-30 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 11ed3d49-cc4e-56ca-9d97-8267a4725e6d
2026-03-30 10:37:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb6110>
2026-03-30 10:37:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_1b772bb27dd9fdda1ac4b3bb8d7dbf12.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_1b772bb27dd9fdda1ac4b3bb8d7dbf12.jpg saved to cache
2026-03-30 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11ed3d49-cc4e-56ca-9d97-8267a4725e6d
2026-03-30 10:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_220af5d0d3e6b766517cfcf66d3fc4e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41bc4d0>
2026-03-30 10:37:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_220af5d0d3e6b766517cfcf66d3fc4e0.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_220af5d0d3e6b766517cfcf66d3fc4e0.jpg saved to cache
2026-03-30 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11ed3d49-cc4e-56ca-9d97-8267a4725e6d
2026-03-30 10:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_a02f7e3fd7f78ede5e6b40a5c1846853.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_505792fb21a1d0c6e03ece9482d79732.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee80190>
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_a02f7e3fd7f78ede5e6b40a5c1846853.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_a02f7e3fd7f78ede5e6b40a5c1846853.jpg saved to cache
2026-03-30 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11ed3d49-cc4e-56ca-9d97-8267a4725e6d
2026-03-30 10:37:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec5650>
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_505792fb21a1d0c6e03ece9482d79732.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_505792fb21a1d0c6e03ece9482d79732.jpg saved to cache
2026-03-30 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11ed3d49-cc4e-56ca-9d97-8267a4725e6d
2026-03-30 10:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_b9cdc8fe7492b247dda5a68eedc63a6c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee83cd0>
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_b9cdc8fe7492b247dda5a68eedc63a6c.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_b9cdc8fe7492b247dda5a68eedc63a6c.jpg saved to cache
2026-03-30 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11ed3d49-cc4e-56ca-9d97-8267a4725e6d
2026-03-30 10:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_f0ec8161f58d2afddd4b52e88399e144.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef39d50>
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8a%252F1c8ac8f92701c5c3ddd091213dfc6cc4%252Fpa%252FAD08111_f0ec8161f58d2afddd4b52e88399e144.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_f0ec8161f58d2afddd4b52e88399e144.jpg saved to cache
2026-03-30 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11ed3d49-cc4e-56ca-9d97-8267a4725e6d
2026-03-30 10:37:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11ed3d49-cc4e-56ca-9d97-8267a4725e6d, skipping ID generation
2026-03-30 10:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11ed3d49-cc4e-56ca-9d97-8267a4725e6d with scrape type 1
2026-03-30 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11ed3d49-cc4e-56ca-9d97-8267a4725e6d sending to next pipeline
2026-03-30 10:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11ed3d49-cc4e-56ca-9d97-8267a4725e6d, identifier: AD08111
2026-03-30 10:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11ed3d49-cc4e-56ca-9d97-8267a4725e6d with identifier: AD08111
2026-03-30 10:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11ed3d49-cc4e-56ca-9d97-8267a4725e6d with identifier: AD08111
2026-03-30 10:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11ed3d49-cc4e-56ca-9d97-8267a4725e6d with identifier: AD08111 to the API
2026-03-30 10:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_f0ec8161f58d2afddd4b52e88399e144.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:46:25Z',
 'fuel_type': 'petrol',
 'id': '11ed3d49-cc4e-56ca-9d97-8267a4725e6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD08111',
 'listing': 'auction',
 'location': 'DE, Leipzig',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 107154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3080810,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_f0ec8161f58d2afddd4b52e88399e144.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3106106,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_b9cdc8fe7492b247dda5a68eedc63a6c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3075838,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_a02f7e3fd7f78ede5e6b40a5c1846853.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2852301,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_505792fb21a1d0c6e03ece9482d79732.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2972450,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_220af5d0d3e6b766517cfcf66d3fc4e0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2988117,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_1b772bb27dd9fdda1ac4b3bb8d7dbf12.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2803241,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_48db0819cc24acde3e1f8043f5fa3210.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3067082,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_c20b94595710ab5d2b3b15d87470b98b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3040958,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_28af1cf03b69b8801180356f384fa3d3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11ed3d49-cc4e-56ca-9d97-8267a4725e6d/11ed3d49-cc4e-56ca-9d97-8267a4725e6d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3083627,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8a/1c8ac8f92701c5c3ddd091213dfc6cc4/pa/AD08111_8ff5506244a13f4635b218c328b937e9.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-01',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Suzuki Swift 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2012}
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD08111%27 HTTP/1.1" 200 None
2026-03-30 10:37:32 [auto1.de] INFO: Saving data for AD08111: {'created_time': 1774867052.071242, 'last_price_update_time': 1774867052.071254, 'auction_closing_time': 1774971985.0}
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD08111') HTTP/1.1" 204 0
2026-03-30 10:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_2d612557ddce5b7652850b37a5331df3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_eb61ce6d0239963819faf6f1bec46c71.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee769d0>
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_2d612557ddce5b7652850b37a5331df3.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_2d612557ddce5b7652850b37a5331df3.jpg saved to cache
2026-03-30 10:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 818a5351-51ea-5530-8daf-16278144cfcb
2026-03-30 10:37:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef63dd0>
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_eb61ce6d0239963819faf6f1bec46c71.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_eb61ce6d0239963819faf6f1bec46c71.jpg saved to cache
2026-03-30 10:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 818a5351-51ea-5530-8daf-16278144cfcb
2026-03-30 10:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_447dbece201516b63434d50e836e2811.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41fc5d0>
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_447dbece201516b63434d50e836e2811.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_447dbece201516b63434d50e836e2811.jpg saved to cache
2026-03-30 10:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 818a5351-51ea-5530-8daf-16278144cfcb
2026-03-30 10:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_cb4c3b09d98a0201d4f6652d2bc3569f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_72817b606781739040b1a6686243f4c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f480b450>
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_cb4c3b09d98a0201d4f6652d2bc3569f.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_cb4c3b09d98a0201d4f6652d2bc3569f.jpg saved to cache
2026-03-30 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 818a5351-51ea-5530-8daf-16278144cfcb
2026-03-30 10:37:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec60d0>
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_72817b606781739040b1a6686243f4c3.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_72817b606781739040b1a6686243f4c3.jpg saved to cache
2026-03-30 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 818a5351-51ea-5530-8daf-16278144cfcb
2026-03-30 10:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_2ff20100902d435e1dc053d2e7da9883.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_6a895ce1a2dc85984a53a7425cdf7585.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee74d10>
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F50%252F0050b15fedb2f7faa86b81af35ecf121%252Fpa%252FPM17860_2ff20100902d435e1dc053d2e7da9883.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_2ff20100902d435e1dc053d2e7da9883.jpg saved to cache
2026-03-30 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 818a5351-51ea-5530-8daf-16278144cfcb
2026-03-30 10:37:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 818a5351-51ea-5530-8daf-16278144cfcb, skipping ID generation
2026-03-30 10:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 818a5351-51ea-5530-8daf-16278144cfcb with scrape type 1
2026-03-30 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 818a5351-51ea-5530-8daf-16278144cfcb sending to next pipeline
2026-03-30 10:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 818a5351-51ea-5530-8daf-16278144cfcb, identifier: PM17860
2026-03-30 10:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 818a5351-51ea-5530-8daf-16278144cfcb with identifier: PM17860
2026-03-30 10:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 818a5351-51ea-5530-8daf-16278144cfcb with identifier: PM17860
2026-03-30 10:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 818a5351-51ea-5530-8daf-16278144cfcb with identifier: PM17860 to the API
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_2ff20100902d435e1dc053d2e7da9883.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 179,
 'expiration_date': '2026-03-31T15:13:49Z',
 'fuel_type': 'diesel',
 'id': '818a5351-51ea-5530-8daf-16278144cfcb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM17860',
 'listing': 'auction',
 'location': 'DE, Bielefeld',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 57988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2854014,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_2ff20100902d435e1dc053d2e7da9883.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2797727,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_72817b606781739040b1a6686243f4c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2728472,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_cb4c3b09d98a0201d4f6652d2bc3569f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2709933,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_447dbece201516b63434d50e836e2811.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2857584,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_eb61ce6d0239963819faf6f1bec46c71.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2952354,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_2d612557ddce5b7652850b37a5331df3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2863557,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_1ea66c5934a87cd28e0a5daf586c34a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3039546,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_620b1391bdd500bded3b69ceead0ad20.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3089320,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_b3dbaeafb695b37bf80958b65a90367c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_818a5351-51ea-5530-8daf-16278144cfcb/818a5351-51ea-5530-8daf-16278144cfcb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2515827,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/50/0050b15fedb2f7faa86b81af35ecf121/pa/PM17860_92131ff8c17d2c35ef245d0d28b4f766.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 2.0 Blue-HDi Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2019}
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM17860%27 HTTP/1.1" 200 None
2026-03-30 10:37:34 [auto1.de] INFO: Saving data for PM17860: {'created_time': 1774867054.423848, 'last_price_update_time': 1774867054.423859, 'auction_closing_time': 1774970029.0}
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM17860') HTTP/1.1" 204 0
2026-03-30 10:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT25404/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f27d0>
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_6a895ce1a2dc85984a53a7425cdf7585.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_6a895ce1a2dc85984a53a7425cdf7585.jpg saved to cache
2026-03-30 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a948c06f-e8a1-59de-a11e-17ccf7aba0c2
2026-03-30 10:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_19f90fd74b7413f7b7152f9179b5aebc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_7c14c1fca34abf78a4cd42228256d622.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_cdcc1fdc1aabfcffc836f00f9daf40fa.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4301d10>
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_19f90fd74b7413f7b7152f9179b5aebc.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_19f90fd74b7413f7b7152f9179b5aebc.jpg saved to cache
2026-03-30 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a948c06f-e8a1-59de-a11e-17ccf7aba0c2
2026-03-30 10:37:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef76310>
2026-03-30 10:37:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_7c14c1fca34abf78a4cd42228256d622.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_7c14c1fca34abf78a4cd42228256d622.jpg saved to cache
2026-03-30 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a948c06f-e8a1-59de-a11e-17ccf7aba0c2
2026-03-30 10:37:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58d1650>
2026-03-30 10:37:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_cdcc1fdc1aabfcffc836f00f9daf40fa.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_cdcc1fdc1aabfcffc836f00f9daf40fa.jpg saved to cache
2026-03-30 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a948c06f-e8a1-59de-a11e-17ccf7aba0c2
2026-03-30 10:37:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_1dabc6e21a4afb614fc256977b900651.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_311cfb36547f500ddc28ef358fc1dc49.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef3c10>
2026-03-30 10:37:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_1dabc6e21a4afb614fc256977b900651.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_1dabc6e21a4afb614fc256977b900651.jpg saved to cache
2026-03-30 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a948c06f-e8a1-59de-a11e-17ccf7aba0c2
2026-03-30 10:37:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee94050>
2026-03-30 10:37:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_311cfb36547f500ddc28ef358fc1dc49.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_311cfb36547f500ddc28ef358fc1dc49.jpg saved to cache
2026-03-30 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a948c06f-e8a1-59de-a11e-17ccf7aba0c2
2026-03-30 10:37:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_6048a44875213712dece0c75496bfdb9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_32d643564831b348181a71ac362cc423.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417c390>
2026-03-30 10:37:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_6048a44875213712dece0c75496bfdb9.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_6048a44875213712dece0c75496bfdb9.jpg saved to cache
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a948c06f-e8a1-59de-a11e-17ccf7aba0c2
2026-03-30 10:37:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee606d0>
2026-03-30 10:37:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F96%252F519653c1dae0b38ea2c20782f7644b9d%252Fpa%252FGB07563_32d643564831b348181a71ac362cc423.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_32d643564831b348181a71ac362cc423.jpg saved to cache
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a948c06f-e8a1-59de-a11e-17ccf7aba0c2
2026-03-30 10:37:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a948c06f-e8a1-59de-a11e-17ccf7aba0c2, skipping ID generation
2026-03-30 10:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a948c06f-e8a1-59de-a11e-17ccf7aba0c2 with scrape type 1
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a948c06f-e8a1-59de-a11e-17ccf7aba0c2 sending to next pipeline
2026-03-30 10:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a948c06f-e8a1-59de-a11e-17ccf7aba0c2, identifier: GB07563
2026-03-30 10:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a948c06f-e8a1-59de-a11e-17ccf7aba0c2 with identifier: GB07563
2026-03-30 10:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a948c06f-e8a1-59de-a11e-17ccf7aba0c2 with identifier: GB07563
2026-03-30 10:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a948c06f-e8a1-59de-a11e-17ccf7aba0c2 with identifier: GB07563 to the API
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_32d643564831b348181a71ac362cc423.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:00:03Z',
 'fuel_type': 'petrol',
 'id': 'a948c06f-e8a1-59de-a11e-17ccf7aba0c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB07563',
 'listing': 'auction',
 'location': 'DE, Darmstadt',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 108935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330177,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_32d643564831b348181a71ac362cc423.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289764,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_6048a44875213712dece0c75496bfdb9.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320546,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_311cfb36547f500ddc28ef358fc1dc49.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266518,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_1dabc6e21a4afb614fc256977b900651.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303567,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_cdcc1fdc1aabfcffc836f00f9daf40fa.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310515,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_7c14c1fca34abf78a4cd42228256d622.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273771,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_19f90fd74b7413f7b7152f9179b5aebc.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318027,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_6a895ce1a2dc85984a53a7425cdf7585.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295321,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_a8c460f9043f6691f90d57c1efc617fe.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a948c06f-e8a1-59de-a11e-17ccf7aba0c2/a948c06f-e8a1-59de-a11e-17ccf7aba0c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320817,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/96/519653c1dae0b38ea2c20782f7644b9d/pa/GB07563_50a33f70ee65057c3c7821c1eb861d02.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Rio 1.2 Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2016}
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB07563%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [auto1.de] INFO: Saving data for GB07563: {'created_time': 1774867057.720416, 'last_price_update_time': 1774867057.720428, 'auction_closing_time': 1774969203.0}
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB07563') HTTP/1.1" 204 0
2026-03-30 10:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG13318> (referer: https://www.auto1.com/v1/car-details-view/FG13318/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7dc6a74-535e-5f08-a6ff-5a23346539a7 with identifier: FG13318
2026-03-30 10:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7dc6a74-535e-5f08-a6ff-5a23346539a7 with scrape type 1
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7dc6a74-535e-5f08-a6ff-5a23346539a7
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_dbbb08202fd64087270a0f37067f776b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_dbbb08202fd64087270a0f37067f776b.jpg not downloaded yet
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_9d7080c016d02167f8becdcad4bc3735.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_9d7080c016d02167f8becdcad4bc3735.jpg not downloaded yet
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_18977ea3e8427f18a227d2b4f490db6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_18977ea3e8427f18a227d2b4f490db6d.jpg not downloaded yet
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_8a846474218866bac9c02b15b9957cdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_8a846474218866bac9c02b15b9957cdc.jpg not downloaded yet
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_b7792ed667dff5927a2f94d51ae252a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_b7792ed667dff5927a2f94d51ae252a0.jpg not downloaded yet
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_057fa489cc36e79fc7c58fb238ae4500.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_057fa489cc36e79fc7c58fb238ae4500.jpg not downloaded yet
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_4b5eec7b245ec1ca89667b4e13b041d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_4b5eec7b245ec1ca89667b4e13b041d4.jpg not downloaded yet
2026-03-30 10:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HM13526> (referer: https://www.auto1.com/v1/car-details-view/HM13526/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_20ced2d321509b130620bd3004b02e7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_20ced2d321509b130620bd3004b02e7a.jpg not downloaded yet
2026-03-30 10:37:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_4c32b49339a3493e48a4876992710a0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_4c32b49339a3493e48a4876992710a0d.jpg not downloaded yet
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_3d25f2bd948ace37e099b655e503749b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_3d25f2bd948ace37e099b655e503749b.jpg not downloaded yet
2026-03-30 10:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 943b24ba-0b9e-5914-b86b-85cc38d9d6dc with identifier: HM13526
2026-03-30 10:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 943b24ba-0b9e-5914-b86b-85cc38d9d6dc with scrape type 1
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 943b24ba-0b9e-5914-b86b-85cc38d9d6dc
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_4ff0b7a6899338038113640ebd9597d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_4ff0b7a6899338038113640ebd9597d4.jpg not downloaded yet
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_524ef1d1a835fcb6d06da07cd5f2e881.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_524ef1d1a835fcb6d06da07cd5f2e881.jpg not downloaded yet
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_8deb5cee885ef6daf8c34bb829bc6fae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_8deb5cee885ef6daf8c34bb829bc6fae.jpg not downloaded yet
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_407ea3990193695f52fef17d6bed3b1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_407ea3990193695f52fef17d6bed3b1b.jpg not downloaded yet
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_0912e65351cf273cf4cab1a7aa9b6140.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_0912e65351cf273cf4cab1a7aa9b6140.jpg not downloaded yet
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_85c012dd3f55848be634b566ebeb75f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_85c012dd3f55848be634b566ebeb75f1.jpg not downloaded yet
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_ccced308b84f70b3c2f28739893eab49.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_ccced308b84f70b3c2f28739893eab49.jpg not downloaded yet
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_a0bb45d797a133a369c23b31064381b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_a0bb45d797a133a369c23b31064381b1.jpg not downloaded yet
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_7afb3e6bcb5c630a57d7e315f1753e9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_7afb3e6bcb5c630a57d7e315f1753e9b.jpg not downloaded yet
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_be5aae1fb86fbee76b83dde91b0b2d54.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_be5aae1fb86fbee76b83dde91b0b2d54.jpg not downloaded yet
2026-03-30 10:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_4b5eec7b245ec1ca89667b4e13b041d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434c3d0>
2026-03-30 10:37:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_4b5eec7b245ec1ca89667b4e13b041d4.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_4b5eec7b245ec1ca89667b4e13b041d4.jpg saved to cache
2026-03-30 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f7dc6a74-535e-5f08-a6ff-5a23346539a7
2026-03-30 10:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_be5aae1fb86fbee76b83dde91b0b2d54.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee77110>
2026-03-30 10:37:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_be5aae1fb86fbee76b83dde91b0b2d54.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_be5aae1fb86fbee76b83dde91b0b2d54.jpg saved to cache
2026-03-30 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 943b24ba-0b9e-5914-b86b-85cc38d9d6dc
2026-03-30 10:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LS25004/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_7afb3e6bcb5c630a57d7e315f1753e9b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58d1550>
2026-03-30 10:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_7afb3e6bcb5c630a57d7e315f1753e9b.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_7afb3e6bcb5c630a57d7e315f1753e9b.jpg saved to cache
2026-03-30 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 943b24ba-0b9e-5914-b86b-85cc38d9d6dc
2026-03-30 10:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_a0bb45d797a133a369c23b31064381b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef74750>
2026-03-30 10:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_a0bb45d797a133a369c23b31064381b1.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_a0bb45d797a133a369c23b31064381b1.jpg saved to cache
2026-03-30 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 943b24ba-0b9e-5914-b86b-85cc38d9d6dc
2026-03-30 10:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_ccced308b84f70b3c2f28739893eab49.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee77d90>
2026-03-30 10:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_ccced308b84f70b3c2f28739893eab49.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_ccced308b84f70b3c2f28739893eab49.jpg saved to cache
2026-03-30 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 943b24ba-0b9e-5914-b86b-85cc38d9d6dc
2026-03-30 10:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_85c012dd3f55848be634b566ebeb75f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58d28d0>
2026-03-30 10:37:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_85c012dd3f55848be634b566ebeb75f1.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_85c012dd3f55848be634b566ebeb75f1.jpg saved to cache
2026-03-30 10:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 943b24ba-0b9e-5914-b86b-85cc38d9d6dc
2026-03-30 10:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_0912e65351cf273cf4cab1a7aa9b6140.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4292310>
2026-03-30 10:37:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_0912e65351cf273cf4cab1a7aa9b6140.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_0912e65351cf273cf4cab1a7aa9b6140.jpg saved to cache
2026-03-30 10:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 943b24ba-0b9e-5914-b86b-85cc38d9d6dc
2026-03-30 10:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_407ea3990193695f52fef17d6bed3b1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee55390>
2026-03-30 10:37:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_407ea3990193695f52fef17d6bed3b1b.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_407ea3990193695f52fef17d6bed3b1b.jpg saved to cache
2026-03-30 10:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 943b24ba-0b9e-5914-b86b-85cc38d9d6dc
2026-03-30 10:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_8deb5cee885ef6daf8c34bb829bc6fae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee744d0>
2026-03-30 10:37:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_8deb5cee885ef6daf8c34bb829bc6fae.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_8deb5cee885ef6daf8c34bb829bc6fae.jpg saved to cache
2026-03-30 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 943b24ba-0b9e-5914-b86b-85cc38d9d6dc
2026-03-30 10:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_524ef1d1a835fcb6d06da07cd5f2e881.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee44cf10>
2026-03-30 10:37:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_524ef1d1a835fcb6d06da07cd5f2e881.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_524ef1d1a835fcb6d06da07cd5f2e881.jpg saved to cache
2026-03-30 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 943b24ba-0b9e-5914-b86b-85cc38d9d6dc
2026-03-30 10:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_4ff0b7a6899338038113640ebd9597d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef36d0>
2026-03-30 10:37:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F15%252F8e151cf6f24e1780fa1e64f8879c659d%252Fpa%252FHM13526_4ff0b7a6899338038113640ebd9597d4.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_4ff0b7a6899338038113640ebd9597d4.jpg saved to cache
2026-03-30 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 943b24ba-0b9e-5914-b86b-85cc38d9d6dc
2026-03-30 10:37:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 943b24ba-0b9e-5914-b86b-85cc38d9d6dc, skipping ID generation
2026-03-30 10:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 943b24ba-0b9e-5914-b86b-85cc38d9d6dc with scrape type 1
2026-03-30 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 943b24ba-0b9e-5914-b86b-85cc38d9d6dc sending to next pipeline
2026-03-30 10:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 943b24ba-0b9e-5914-b86b-85cc38d9d6dc, identifier: HM13526
2026-03-30 10:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 943b24ba-0b9e-5914-b86b-85cc38d9d6dc with identifier: HM13526
2026-03-30 10:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 943b24ba-0b9e-5914-b86b-85cc38d9d6dc with identifier: HM13526
2026-03-30 10:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 943b24ba-0b9e-5914-b86b-85cc38d9d6dc with identifier: HM13526 to the API
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_4ff0b7a6899338038113640ebd9597d4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:39:33Z',
 'fuel_type': 'diesel',
 'id': '943b24ba-0b9e-5914-b86b-85cc38d9d6dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM13526',
 'listing': 'auction',
 'location': 'DE, Friedrichsdorf',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 199273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3251112,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_4ff0b7a6899338038113640ebd9597d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3439206,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_524ef1d1a835fcb6d06da07cd5f2e881.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3263297,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_8deb5cee885ef6daf8c34bb829bc6fae.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2840025,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_407ea3990193695f52fef17d6bed3b1b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3335964,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_0912e65351cf273cf4cab1a7aa9b6140.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3043373,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_85c012dd3f55848be634b566ebeb75f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2619764,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_ccced308b84f70b3c2f28739893eab49.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2877613,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_a0bb45d797a133a369c23b31064381b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3388728,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_7afb3e6bcb5c630a57d7e315f1753e9b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_943b24ba-0b9e-5914-b86b-85cc38d9d6dc/943b24ba-0b9e-5914-b86b-85cc38d9d6dc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608684,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/15/8e151cf6f24e1780fa1e64f8879c659d/pa/HM13526_be5aae1fb86fbee76b83dde91b0b2d54.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.8 DI-D Instyle 4WD',
 'transmission': 'manual',
 'trim': 'Instyle 4WD',
 'year': 2013}
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM13526%27 HTTP/1.1" 200 None
2026-03-30 10:37:43 [auto1.de] INFO: Saving data for HM13526: {'created_time': 1774867063.920621, 'last_price_update_time': 1774867063.920632, 'auction_closing_time': 1774971573.0}
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM13526') HTTP/1.1" 204 0
2026-03-30 10:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_3d25f2bd948ace37e099b655e503749b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef63750>
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_3d25f2bd948ace37e099b655e503749b.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_3d25f2bd948ace37e099b655e503749b.jpg saved to cache
2026-03-30 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f7dc6a74-535e-5f08-a6ff-5a23346539a7
2026-03-30 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_4c32b49339a3493e48a4876992710a0d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee604d0>
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_4c32b49339a3493e48a4876992710a0d.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_4c32b49339a3493e48a4876992710a0d.jpg saved to cache
2026-03-30 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f7dc6a74-535e-5f08-a6ff-5a23346539a7
2026-03-30 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_20ced2d321509b130620bd3004b02e7a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4395790>
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_20ced2d321509b130620bd3004b02e7a.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_20ced2d321509b130620bd3004b02e7a.jpg saved to cache
2026-03-30 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f7dc6a74-535e-5f08-a6ff-5a23346539a7
2026-03-30 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_057fa489cc36e79fc7c58fb238ae4500.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424d7d0>
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_057fa489cc36e79fc7c58fb238ae4500.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_057fa489cc36e79fc7c58fb238ae4500.jpg saved to cache
2026-03-30 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f7dc6a74-535e-5f08-a6ff-5a23346539a7
2026-03-30 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_b7792ed667dff5927a2f94d51ae252a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f436edd0>
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_b7792ed667dff5927a2f94d51ae252a0.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_b7792ed667dff5927a2f94d51ae252a0.jpg saved to cache
2026-03-30 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f7dc6a74-535e-5f08-a6ff-5a23346539a7
2026-03-30 10:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_8a846474218866bac9c02b15b9957cdc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4394650>
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_8a846474218866bac9c02b15b9957cdc.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_8a846474218866bac9c02b15b9957cdc.jpg saved to cache
2026-03-30 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f7dc6a74-535e-5f08-a6ff-5a23346539a7
2026-03-30 10:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_18977ea3e8427f18a227d2b4f490db6d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef62390>
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_18977ea3e8427f18a227d2b4f490db6d.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_18977ea3e8427f18a227d2b4f490db6d.jpg saved to cache
2026-03-30 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f7dc6a74-535e-5f08-a6ff-5a23346539a7
2026-03-30 10:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AZ64163/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_9d7080c016d02167f8becdcad4bc3735.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41ff050>
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_9d7080c016d02167f8becdcad4bc3735.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_9d7080c016d02167f8becdcad4bc3735.jpg saved to cache
2026-03-30 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f7dc6a74-535e-5f08-a6ff-5a23346539a7
2026-03-30 10:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_dbbb08202fd64087270a0f37067f776b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4302bd0>
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe1%252F79e1e98b2476612eaf89a044454c4d82%252Fpa%252FFG13318_dbbb08202fd64087270a0f37067f776b.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_dbbb08202fd64087270a0f37067f776b.jpg saved to cache
2026-03-30 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7dc6a74-535e-5f08-a6ff-5a23346539a7
2026-03-30 10:37:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7dc6a74-535e-5f08-a6ff-5a23346539a7, skipping ID generation
2026-03-30 10:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7dc6a74-535e-5f08-a6ff-5a23346539a7 with scrape type 1
2026-03-30 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7dc6a74-535e-5f08-a6ff-5a23346539a7 sending to next pipeline
2026-03-30 10:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7dc6a74-535e-5f08-a6ff-5a23346539a7, identifier: FG13318
2026-03-30 10:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7dc6a74-535e-5f08-a6ff-5a23346539a7 with identifier: FG13318
2026-03-30 10:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7dc6a74-535e-5f08-a6ff-5a23346539a7 with identifier: FG13318
2026-03-30 10:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7dc6a74-535e-5f08-a6ff-5a23346539a7 with identifier: FG13318 to the API
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_dbbb08202fd64087270a0f37067f776b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:57:45Z',
 'fuel_type': 'petrol',
 'id': 'f7dc6a74-535e-5f08-a6ff-5a23346539a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG13318',
 'listing': 'auction',
 'location': 'DE, Gummersbach',
 'make': 'Ford',
 'model': 'Fusion',
 'odometer': 46247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2573985,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_dbbb08202fd64087270a0f37067f776b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2423300,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_9d7080c016d02167f8becdcad4bc3735.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2656627,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_18977ea3e8427f18a227d2b4f490db6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2364356,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_8a846474218866bac9c02b15b9957cdc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2604972,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_b7792ed667dff5927a2f94d51ae252a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2183933,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_057fa489cc36e79fc7c58fb238ae4500.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1784707,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_4b5eec7b245ec1ca89667b4e13b041d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2129443,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_20ced2d321509b130620bd3004b02e7a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2642005,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_4c32b49339a3493e48a4876992710a0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7dc6a74-535e-5f08-a6ff-5a23346539a7/f7dc6a74-535e-5f08-a6ff-5a23346539a7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2827908,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e1/79e1e98b2476612eaf89a044454c4d82/pa/FG13318_3d25f2bd948ace37e099b655e503749b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fusion 1.6 Plus',
 'transmission': 'automatic',
 'trim': 'Plus',
 'year': 2010}
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG13318%27 HTTP/1.1" 200 None
2026-03-30 10:37:46 [auto1.de] INFO: Saving data for FG13318: {'created_time': 1774867066.868154, 'last_price_update_time': 1774867066.868167, 'auction_closing_time': 1774972665.0}
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG13318') HTTP/1.1" 204 0
2026-03-30 10:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV52010/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_d31414a2b65164cf41e9a9232f8413f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434c750>
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_d31414a2b65164cf41e9a9232f8413f2.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_d31414a2b65164cf41e9a9232f8413f2.jpg saved to cache
2026-03-30 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b40d5609-d44e-587d-bcb0-68c5a8db35eb
2026-03-30 10:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ85670/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_1f94bb342cde16604b388995000b069d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434f350>
2026-03-30 10:37:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_1f94bb342cde16604b388995000b069d.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_1f94bb342cde16604b388995000b069d.jpg saved to cache
2026-03-30 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7f97e5e-8884-55f3-8ccf-af7c698e0fa6
2026-03-30 10:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM57551> (referer: https://www.auto1.com/v1/car-details-view/ZM57551/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ea0a72e-d5f0-5b90-b8f5-0df030a292a5 with identifier: ZM57551
2026-03-30 10:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ea0a72e-d5f0-5b90-b8f5-0df030a292a5 with scrape type 1
2026-03-30 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2ea0a72e-d5f0-5b90-b8f5-0df030a292a5
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F02%252F6b02537162876dc48c548c7f35350277%252Fpa%252FZM57551_ea649158f8640b2eb6d5d7ce8f70bc37.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/02/6b02537162876dc48c548c7f35350277/pa/ZM57551_ea649158f8640b2eb6d5d7ce8f70bc37.jpg already downloaded
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F02%252F6b02537162876dc48c548c7f35350277%252Fpa%252FZM57551_bd034b872613fcb06bdf76908251f4e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/02/6b02537162876dc48c548c7f35350277/pa/ZM57551_bd034b872613fcb06bdf76908251f4e3.jpg already downloaded
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F02%252F6b02537162876dc48c548c7f35350277%252Fpa%252FZM57551_2666ea1ab86c79a1370609140f490df6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/02/6b02537162876dc48c548c7f35350277/pa/ZM57551_2666ea1ab86c79a1370609140f490df6.jpg already downloaded
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F02%252F6b02537162876dc48c548c7f35350277%252Fpa%252FZM57551_a63a65fd48fee7a1d03315f1bd71d572.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/02/6b02537162876dc48c548c7f35350277/pa/ZM57551_a63a65fd48fee7a1d03315f1bd71d572.jpg already downloaded
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F02%252F6b02537162876dc48c548c7f35350277%252Fpa%252FZM57551_4e4241a10893be3a202ff1460b6a23db.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/02/6b02537162876dc48c548c7f35350277/pa/ZM57551_4e4241a10893be3a202ff1460b6a23db.jpg already downloaded
2026-03-30 10:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ea0a72e-d5f0-5b90-b8f5-0df030a292a5, identifier: ZM57551
2026-03-30 10:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ea0a72e-d5f0-5b90-b8f5-0df030a292a5 with identifier: ZM57551
2026-03-30 10:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ea0a72e-d5f0-5b90-b8f5-0df030a292a5 with identifier: ZM57551
2026-03-30 10:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ea0a72e-d5f0-5b90-b8f5-0df030a292a5 with identifier: ZM57551 to the API
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZM57551>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:46:38Z',
 'fuel_type': 'petrol',
 'id': '2ea0a72e-d5f0-5b90-b8f5-0df030a292a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM57551',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 131075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img6b/02/6b02537162876dc48c548c7f35350277/pa/ZM57551_ea649158f8640b2eb6d5d7ce8f70bc37.jpg',
                'https://img-pa.auto1.com/img6b/02/6b02537162876dc48c548c7f35350277/pa/ZM57551_bd034b872613fcb06bdf76908251f4e3.jpg',
                'https://img-pa.auto1.com/img6b/02/6b02537162876dc48c548c7f35350277/pa/ZM57551_2666ea1ab86c79a1370609140f490df6.jpg',
                'https://img-pa.auto1.com/img6b/02/6b02537162876dc48c548c7f35350277/pa/ZM57551_a63a65fd48fee7a1d03315f1bd71d572.jpg',
                'https://img-pa.auto1.com/img6b/02/6b02537162876dc48c548c7f35350277/pa/ZM57551_4e4241a10893be3a202ff1460b6a23db.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea0a72e-d5f0-5b90-b8f5-0df030a292a5/2ea0a72e-d5f0-5b90-b8f5-0df030a292a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/02/6b02537162876dc48c548c7f35350277/pa/ZM57551_ea649158f8640b2eb6d5d7ce8f70bc37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea0a72e-d5f0-5b90-b8f5-0df030a292a5/2ea0a72e-d5f0-5b90-b8f5-0df030a292a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/02/6b02537162876dc48c548c7f35350277/pa/ZM57551_bd034b872613fcb06bdf76908251f4e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea0a72e-d5f0-5b90-b8f5-0df030a292a5/2ea0a72e-d5f0-5b90-b8f5-0df030a292a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/02/6b02537162876dc48c548c7f35350277/pa/ZM57551_2666ea1ab86c79a1370609140f490df6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea0a72e-d5f0-5b90-b8f5-0df030a292a5/2ea0a72e-d5f0-5b90-b8f5-0df030a292a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/02/6b02537162876dc48c548c7f35350277/pa/ZM57551_a63a65fd48fee7a1d03315f1bd71d572.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea0a72e-d5f0-5b90-b8f5-0df030a292a5/2ea0a72e-d5f0-5b90-b8f5-0df030a292a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/02/6b02537162876dc48c548c7f35350277/pa/ZM57551_4e4241a10893be3a202ff1460b6a23db.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 GLS',
 'transmission': 'manual',
 'trim': 'GLS',
 'year': 2008}
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM57551%27 HTTP/1.1" 200 None
2026-03-30 10:37:55 [auto1.de] INFO: Saving data for ZM57551: {'created_time': 1774867075.099926, 'last_price_update_time': 1774867075.099988, 'auction_closing_time': 1774971998.0}
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM57551') HTTP/1.1" 204 0
2026-03-30 10:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_9215b8294d788276143c26da10d72e6b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef4c10>
2026-03-30 10:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_9215b8294d788276143c26da10d72e6b.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_9215b8294d788276143c26da10d72e6b.jpg saved to cache
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8b4ed73-b977-51b6-9904-16b975722641
2026-03-30 10:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_45d35d725db3ad4a994d1277aebbf9f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV63005/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4301d10>
2026-03-30 10:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_45d35d725db3ad4a994d1277aebbf9f0.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_45d35d725db3ad4a994d1277aebbf9f0.jpg saved to cache
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b40d5609-d44e-587d-bcb0-68c5a8db35eb
2026-03-30 10:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW29948> (referer: https://www.auto1.com/v1/car-details-view/WW29948/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e049d29-d9e5-5ea2-a88b-27625cbf2cdd with identifier: WW29948
2026-03-30 10:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e049d29-d9e5-5ea2-a88b-27625cbf2cdd with scrape type 1
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e049d29-d9e5-5ea2-a88b-27625cbf2cdd
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F60%252F9260aafd23724be97dfc444f2e7d260a%252Fpa%252FWW29948_020af8d947a17d6a1a6f1b8e83ca87f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_020af8d947a17d6a1a6f1b8e83ca87f6.jpg already downloaded
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F60%252F9260aafd23724be97dfc444f2e7d260a%252Fpa%252FWW29948_d5c0db1391775922b8e893b4601e437b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_d5c0db1391775922b8e893b4601e437b.jpg already downloaded
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F60%252F9260aafd23724be97dfc444f2e7d260a%252Fpa%252FWW29948_48edd2bfb888df5017a0a64afdb7a793.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_48edd2bfb888df5017a0a64afdb7a793.jpg already downloaded
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F60%252F9260aafd23724be97dfc444f2e7d260a%252Fpa%252FWW29948_1e63c3e79d02714bd7c0c00d6440a8be.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_1e63c3e79d02714bd7c0c00d6440a8be.jpg already downloaded
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F60%252F9260aafd23724be97dfc444f2e7d260a%252Fpa%252FWW29948_0dc8d2d71f930758d678b7b75e8058ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_0dc8d2d71f930758d678b7b75e8058ec.jpg already downloaded
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F60%252F9260aafd23724be97dfc444f2e7d260a%252Fpa%252FWW29948_bd95667ef01d8863b4f66e1d3241b11c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_bd95667ef01d8863b4f66e1d3241b11c.jpg already downloaded
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F60%252F9260aafd23724be97dfc444f2e7d260a%252Fpa%252FWW29948_1d9f223c9cac1f92dc62804737c2f101.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_1d9f223c9cac1f92dc62804737c2f101.jpg already downloaded
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F60%252F9260aafd23724be97dfc444f2e7d260a%252Fpa%252FWW29948_df6c28cb18986881f192d3932f7a2ef5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_df6c28cb18986881f192d3932f7a2ef5.jpg already downloaded
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F60%252F9260aafd23724be97dfc444f2e7d260a%252Fpa%252FWW29948_a7cff11714e2d88b40bb55b03ef6b29c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_a7cff11714e2d88b40bb55b03ef6b29c.jpg already downloaded
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F60%252F9260aafd23724be97dfc444f2e7d260a%252Fpa%252FWW29948_2b9bc2341d9080148f1db2aacd7ce998.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_2b9bc2341d9080148f1db2aacd7ce998.jpg already downloaded
2026-03-30 10:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e049d29-d9e5-5ea2-a88b-27625cbf2cdd, identifier: WW29948
2026-03-30 10:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e049d29-d9e5-5ea2-a88b-27625cbf2cdd with identifier: WW29948
2026-03-30 10:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e049d29-d9e5-5ea2-a88b-27625cbf2cdd with identifier: WW29948
2026-03-30 10:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e049d29-d9e5-5ea2-a88b-27625cbf2cdd with identifier: WW29948 to the API
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WW29948>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:20:19Z',
 'fuel_type': 'petrol',
 'id': '5e049d29-d9e5-5ea2-a88b-27625cbf2cdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW29948',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 49991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_020af8d947a17d6a1a6f1b8e83ca87f6.jpg',
                'https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_d5c0db1391775922b8e893b4601e437b.jpg',
                'https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_48edd2bfb888df5017a0a64afdb7a793.jpg',
                'https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_1e63c3e79d02714bd7c0c00d6440a8be.jpg',
                'https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_0dc8d2d71f930758d678b7b75e8058ec.jpg',
                'https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_bd95667ef01d8863b4f66e1d3241b11c.jpg',
                'https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_1d9f223c9cac1f92dc62804737c2f101.jpg',
                'https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_df6c28cb18986881f192d3932f7a2ef5.jpg',
                'https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_a7cff11714e2d88b40bb55b03ef6b29c.jpg',
                'https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_2b9bc2341d9080148f1db2aacd7ce998.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e049d29-d9e5-5ea2-a88b-27625cbf2cdd/5e049d29-d9e5-5ea2-a88b-27625cbf2cdd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_020af8d947a17d6a1a6f1b8e83ca87f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e049d29-d9e5-5ea2-a88b-27625cbf2cdd/5e049d29-d9e5-5ea2-a88b-27625cbf2cdd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_d5c0db1391775922b8e893b4601e437b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e049d29-d9e5-5ea2-a88b-27625cbf2cdd/5e049d29-d9e5-5ea2-a88b-27625cbf2cdd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_48edd2bfb888df5017a0a64afdb7a793.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e049d29-d9e5-5ea2-a88b-27625cbf2cdd/5e049d29-d9e5-5ea2-a88b-27625cbf2cdd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_1e63c3e79d02714bd7c0c00d6440a8be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e049d29-d9e5-5ea2-a88b-27625cbf2cdd/5e049d29-d9e5-5ea2-a88b-27625cbf2cdd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_0dc8d2d71f930758d678b7b75e8058ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e049d29-d9e5-5ea2-a88b-27625cbf2cdd/5e049d29-d9e5-5ea2-a88b-27625cbf2cdd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_bd95667ef01d8863b4f66e1d3241b11c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e049d29-d9e5-5ea2-a88b-27625cbf2cdd/5e049d29-d9e5-5ea2-a88b-27625cbf2cdd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_1d9f223c9cac1f92dc62804737c2f101.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e049d29-d9e5-5ea2-a88b-27625cbf2cdd/5e049d29-d9e5-5ea2-a88b-27625cbf2cdd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_df6c28cb18986881f192d3932f7a2ef5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e049d29-d9e5-5ea2-a88b-27625cbf2cdd/5e049d29-d9e5-5ea2-a88b-27625cbf2cdd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_a7cff11714e2d88b40bb55b03ef6b29c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e049d29-d9e5-5ea2-a88b-27625cbf2cdd/5e049d29-d9e5-5ea2-a88b-27625cbf2cdd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_2b9bc2341d9080148f1db2aacd7ce998.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Maxi Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Maxi Comfortline BlueMotion',
 'year': 2019}
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW29948%27 HTTP/1.1" 200 None
2026-03-30 10:37:56 [auto1.de] INFO: Saving data for WW29948: {'created_time': 1774867076.591504, 'last_price_update_time': 1774867076.591517, 'auction_closing_time': 1774970419.0}
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW29948') HTTP/1.1" 204 0
2026-03-30 10:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_f6975209ae3be432f4b4068b3886062d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT25404> (referer: https://www.auto1.com/v1/car-details-view/AT25404/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_505345bbff0fe788187cd31626566c5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee479b50>
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_f6975209ae3be432f4b4068b3886062d.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_f6975209ae3be432f4b4068b3886062d.jpg saved to cache
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7f97e5e-8884-55f3-8ccf-af7c698e0fa6
2026-03-30 10:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7149142e-10a5-5bad-9670-fb362996066e with identifier: AT25404
2026-03-30 10:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7149142e-10a5-5bad-9670-fb362996066e with scrape type 1
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7149142e-10a5-5bad-9670-fb362996066e
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_c6926e7ad64c7f78dcf9793a0b0054a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_c6926e7ad64c7f78dcf9793a0b0054a0.jpg not downloaded yet
2026-03-30 10:37:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef06d0>
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_505345bbff0fe788187cd31626566c5a.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_505345bbff0fe788187cd31626566c5a.jpg saved to cache
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8b4ed73-b977-51b6-9904-16b975722641
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_3281f809564b68ed82c8001a22f65360.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_3281f809564b68ed82c8001a22f65360.jpg not downloaded yet
2026-03-30 10:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_71f5bbebfbbf3a794fb608a74f71af35.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_4657b17b910ac36d146dd583040f98bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_4657b17b910ac36d146dd583040f98bc.jpg not downloaded yet
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_28bbf4cd9e7648beee7a57a252ad926e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_28bbf4cd9e7648beee7a57a252ad926e.jpg not downloaded yet
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_6e66c781b6049463bd67d038aec5e5a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_6e66c781b6049463bd67d038aec5e5a2.jpg not downloaded yet
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_6cc3f40f186c8988fd903c53fa34771f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_6cc3f40f186c8988fd903c53fa34771f.jpg not downloaded yet
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_4a3eecabcdeabecd0c818a8190b558a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_4a3eecabcdeabecd0c818a8190b558a7.jpg not downloaded yet
2026-03-30 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_c6926e7ad64c7f78dcf9793a0b0054a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_660933f3980658ea4fe08c83a99f2b6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_660933f3980658ea4fe08c83a99f2b6f.jpg not downloaded yet
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7ef90>
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_71f5bbebfbbf3a794fb608a74f71af35.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_71f5bbebfbbf3a794fb608a74f71af35.jpg saved to cache
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7f97e5e-8884-55f3-8ccf-af7c698e0fa6
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_9bea0ce591b138e707a6aa43f37a5ce1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_9bea0ce591b138e707a6aa43f37a5ce1.jpg not downloaded yet
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_a6a376f2a549bac043279a591df9984a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_a6a376f2a549bac043279a591df9984a.jpg not downloaded yet
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58d3750>
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_c6926e7ad64c7f78dcf9793a0b0054a0.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_c6926e7ad64c7f78dcf9793a0b0054a0.jpg saved to cache
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7149142e-10a5-5bad-9670-fb362996066e
2026-03-30 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_d2dc510dcff875b8290c95454eca120a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_4a3eecabcdeabecd0c818a8190b558a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_a6a376f2a549bac043279a591df9984a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_9bea0ce591b138e707a6aa43f37a5ce1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3b810>
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_d2dc510dcff875b8290c95454eca120a.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_d2dc510dcff875b8290c95454eca120a.jpg saved to cache
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b40d5609-d44e-587d-bcb0-68c5a8db35eb
2026-03-30 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_660933f3980658ea4fe08c83a99f2b6f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_6cc3f40f186c8988fd903c53fa34771f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a7b10>
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_4a3eecabcdeabecd0c818a8190b558a7.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_4a3eecabcdeabecd0c818a8190b558a7.jpg saved to cache
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7149142e-10a5-5bad-9670-fb362996066e
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8fa50>
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_a6a376f2a549bac043279a591df9984a.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_a6a376f2a549bac043279a591df9984a.jpg saved to cache
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7149142e-10a5-5bad-9670-fb362996066e
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414f850>
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_9bea0ce591b138e707a6aa43f37a5ce1.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_9bea0ce591b138e707a6aa43f37a5ce1.jpg saved to cache
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7149142e-10a5-5bad-9670-fb362996066e
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeef9d0>
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_660933f3980658ea4fe08c83a99f2b6f.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_660933f3980658ea4fe08c83a99f2b6f.jpg saved to cache
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7149142e-10a5-5bad-9670-fb362996066e
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a6290>
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_6cc3f40f186c8988fd903c53fa34771f.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_6cc3f40f186c8988fd903c53fa34771f.jpg saved to cache
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7149142e-10a5-5bad-9670-fb362996066e
2026-03-30 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_28bbf4cd9e7648beee7a57a252ad926e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_6e66c781b6049463bd67d038aec5e5a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_3281f809564b68ed82c8001a22f65360.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_4657b17b910ac36d146dd583040f98bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41bc410>
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_28bbf4cd9e7648beee7a57a252ad926e.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_28bbf4cd9e7648beee7a57a252ad926e.jpg saved to cache
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7149142e-10a5-5bad-9670-fb362996066e
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f480a210>
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_6e66c781b6049463bd67d038aec5e5a2.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_6e66c781b6049463bd67d038aec5e5a2.jpg saved to cache
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7149142e-10a5-5bad-9670-fb362996066e
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee54290>
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_3281f809564b68ed82c8001a22f65360.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_3281f809564b68ed82c8001a22f65360.jpg saved to cache
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7149142e-10a5-5bad-9670-fb362996066e
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef756d0>
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F3f%252F3f3fd7b826c4c97efb8dde7739da393a%252Fpa%252FAT25404_4657b17b910ac36d146dd583040f98bc.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_4657b17b910ac36d146dd583040f98bc.jpg saved to cache
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7149142e-10a5-5bad-9670-fb362996066e
2026-03-30 10:37:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7149142e-10a5-5bad-9670-fb362996066e, skipping ID generation
2026-03-30 10:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7149142e-10a5-5bad-9670-fb362996066e with scrape type 1
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7149142e-10a5-5bad-9670-fb362996066e sending to next pipeline
2026-03-30 10:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7149142e-10a5-5bad-9670-fb362996066e, identifier: AT25404
2026-03-30 10:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7149142e-10a5-5bad-9670-fb362996066e with identifier: AT25404
2026-03-30 10:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7149142e-10a5-5bad-9670-fb362996066e with identifier: AT25404
2026-03-30 10:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7149142e-10a5-5bad-9670-fb362996066e with identifier: AT25404 to the API
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_4657b17b910ac36d146dd583040f98bc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:35:29Z',
 'fuel_type': 'diesel',
 'id': '7149142e-10a5-5bad-9670-fb362996066e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT25404',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 184623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_c6926e7ad64c7f78dcf9793a0b0054a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_3281f809564b68ed82c8001a22f65360.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_4657b17b910ac36d146dd583040f98bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_28bbf4cd9e7648beee7a57a252ad926e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_6e66c781b6049463bd67d038aec5e5a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_6cc3f40f186c8988fd903c53fa34771f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_4a3eecabcdeabecd0c818a8190b558a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_660933f3980658ea4fe08c83a99f2b6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_9bea0ce591b138e707a6aa43f37a5ce1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7149142e-10a5-5bad-9670-fb362996066e/7149142e-10a5-5bad-9670-fb362996066e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/3f/3f3fd7b826c4c97efb8dde7739da393a/pa/AT25404_a6a376f2a549bac043279a591df9984a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-24',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Life BlueMotion',
 'transmission': 'manual',
 'trim': 'Life BlueMotion',
 'year': 2013}
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT25404%27 HTTP/1.1" 200 None
2026-03-30 10:37:58 [auto1.de] INFO: Saving data for AT25404: {'created_time': 1774867078.661058, 'last_price_update_time': 1774867078.661077, 'auction_closing_time': 1774971329.0}
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT25404') HTTP/1.1" 204 0
2026-03-30 10:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_e4df7ad28efc4b639fa4ea34b9d09b67.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_fbbdf1135d9ce11e5fb8cd828ba604f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LS25004> (referer: https://www.auto1.com/v1/car-details-view/LS25004/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef2510>
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_e4df7ad28efc4b639fa4ea34b9d09b67.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_e4df7ad28efc4b639fa4ea34b9d09b67.jpg saved to cache
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b40d5609-d44e-587d-bcb0-68c5a8db35eb
2026-03-30 10:37:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef13d0>
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_fbbdf1135d9ce11e5fb8cd828ba604f1.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_fbbdf1135d9ce11e5fb8cd828ba604f1.jpg saved to cache
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8b4ed73-b977-51b6-9904-16b975722641
2026-03-30 10:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e52babf9-7462-5646-aba4-b6e2d270fd56 with identifier: LS25004
2026-03-30 10:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e52babf9-7462-5646-aba4-b6e2d270fd56 with scrape type 1
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e52babf9-7462-5646-aba4-b6e2d270fd56
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fbe%252Ff4be91939272c25869a00f6219fa8027%252Fpa%252FLS25004_cab922e1384c1912a251079e32498cc8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/be/f4be91939272c25869a00f6219fa8027/pa/LS25004_cab922e1384c1912a251079e32498cc8.jpg already downloaded
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fbe%252Ff4be91939272c25869a00f6219fa8027%252Fpa%252FLS25004_43fd72684dfe5e5dd025b2986f000e79.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/be/f4be91939272c25869a00f6219fa8027/pa/LS25004_43fd72684dfe5e5dd025b2986f000e79.jpg already downloaded
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fbe%252Ff4be91939272c25869a00f6219fa8027%252Fpa%252FLS25004_778a54dd6f86a17bc336821050a162e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/be/f4be91939272c25869a00f6219fa8027/pa/LS25004_778a54dd6f86a17bc336821050a162e5.jpg already downloaded
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fbe%252Ff4be91939272c25869a00f6219fa8027%252Fpa%252FLS25004_9c47c10fc438239078d51e611872e17c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/be/f4be91939272c25869a00f6219fa8027/pa/LS25004_9c47c10fc438239078d51e611872e17c.jpg already downloaded
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fbe%252Ff4be91939272c25869a00f6219fa8027%252Fpa%252FLS25004_c9a7d18616ef1afd15c87e6e7e9b88c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/be/f4be91939272c25869a00f6219fa8027/pa/LS25004_c9a7d18616ef1afd15c87e6e7e9b88c5.jpg already downloaded
2026-03-30 10:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e52babf9-7462-5646-aba4-b6e2d270fd56, identifier: LS25004
2026-03-30 10:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e52babf9-7462-5646-aba4-b6e2d270fd56 with identifier: LS25004
2026-03-30 10:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e52babf9-7462-5646-aba4-b6e2d270fd56 with identifier: LS25004
2026-03-30 10:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e52babf9-7462-5646-aba4-b6e2d270fd56 with identifier: LS25004 to the API
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LS25004>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:31:42Z',
 'fuel_type': 'petrol',
 'id': 'e52babf9-7462-5646-aba4-b6e2d270fd56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS25004',
 'listing': 'auction',
 'location': 'DE, Schweitenkirchen',
 'make': 'Fiat',
 'model': '500',
 'odometer': 230741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgf4/be/f4be91939272c25869a00f6219fa8027/pa/LS25004_cab922e1384c1912a251079e32498cc8.jpg',
                'https://img-pa.auto1.com/imgf4/be/f4be91939272c25869a00f6219fa8027/pa/LS25004_43fd72684dfe5e5dd025b2986f000e79.jpg',
                'https://img-pa.auto1.com/imgf4/be/f4be91939272c25869a00f6219fa8027/pa/LS25004_778a54dd6f86a17bc336821050a162e5.jpg',
                'https://img-pa.auto1.com/imgf4/be/f4be91939272c25869a00f6219fa8027/pa/LS25004_9c47c10fc438239078d51e611872e17c.jpg',
                'https://img-pa.auto1.com/imgf4/be/f4be91939272c25869a00f6219fa8027/pa/LS25004_c9a7d18616ef1afd15c87e6e7e9b88c5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52babf9-7462-5646-aba4-b6e2d270fd56/e52babf9-7462-5646-aba4-b6e2d270fd56_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/be/f4be91939272c25869a00f6219fa8027/pa/LS25004_cab922e1384c1912a251079e32498cc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52babf9-7462-5646-aba4-b6e2d270fd56/e52babf9-7462-5646-aba4-b6e2d270fd56_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/be/f4be91939272c25869a00f6219fa8027/pa/LS25004_43fd72684dfe5e5dd025b2986f000e79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52babf9-7462-5646-aba4-b6e2d270fd56/e52babf9-7462-5646-aba4-b6e2d270fd56_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/be/f4be91939272c25869a00f6219fa8027/pa/LS25004_778a54dd6f86a17bc336821050a162e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52babf9-7462-5646-aba4-b6e2d270fd56/e52babf9-7462-5646-aba4-b6e2d270fd56_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/be/f4be91939272c25869a00f6219fa8027/pa/LS25004_9c47c10fc438239078d51e611872e17c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52babf9-7462-5646-aba4-b6e2d270fd56/e52babf9-7462-5646-aba4-b6e2d270fd56_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/be/f4be91939272c25869a00f6219fa8027/pa/LS25004_c9a7d18616ef1afd15c87e6e7e9b88c5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2009}
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS25004%27 HTTP/1.1" 200 None
2026-03-30 10:37:59 [auto1.de] INFO: Saving data for LS25004: {'created_time': 1774867079.856509, 'last_price_update_time': 1774867079.856522, 'auction_closing_time': 1774971102.0}
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS25004') HTTP/1.1" 204 0
2026-03-30 10:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_28329be8eb800af1e078ff674c52229c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42215d0>
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_28329be8eb800af1e078ff674c52229c.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_28329be8eb800af1e078ff674c52229c.jpg saved to cache
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7f97e5e-8884-55f3-8ccf-af7c698e0fa6
2026-03-30 10:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_8c827a4a1f24e087780aa57c3e027aa7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_6194179781bc708bbdef25c4db842c23.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee55a90>
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_8c827a4a1f24e087780aa57c3e027aa7.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_8c827a4a1f24e087780aa57c3e027aa7.jpg saved to cache
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b40d5609-d44e-587d-bcb0-68c5a8db35eb
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee55ed0>
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_6194179781bc708bbdef25c4db842c23.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_6194179781bc708bbdef25c4db842c23.jpg saved to cache
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7f97e5e-8884-55f3-8ccf-af7c698e0fa6
2026-03-30 10:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_a147bb05929c4e778b9e49cc824abb0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_e7f2a851f50a1a81a9ce4580295771ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3a7d0>
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_a147bb05929c4e778b9e49cc824abb0c.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_a147bb05929c4e778b9e49cc824abb0c.jpg saved to cache
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8b4ed73-b977-51b6-9904-16b975722641
2026-03-30 10:38:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4588d0>
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_e7f2a851f50a1a81a9ce4580295771ae.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_e7f2a851f50a1a81a9ce4580295771ae.jpg saved to cache
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8b4ed73-b977-51b6-9904-16b975722641
2026-03-30 10:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_0757987ad11c9e4e05c54f57bee559a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:00 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 9426 | hits on page: 40
2026-03-30 10:38:00 [auto1.de] INFO: Found listing with ID: WW29948
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW29948%27 HTTP/1.1" 200 None
2026-03-30 10:38:00 [auto1.de] INFO: Scrape type for WW29948: 0
2026-03-30 10:38:00 [auto1.de] INFO: Found listing with ID: BJ85670
2026-03-30 10:38:00 [auto1.de] INFO: Found listing with ID: XW43246
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW43246%27 HTTP/1.1" 200 None
2026-03-30 10:38:00 [auto1.de] INFO: Scrape type for XW43246: 0
2026-03-30 10:38:00 [auto1.de] INFO: Found listing with ID: HK17634
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK17634%27 HTTP/1.1" 200 None
2026-03-30 10:38:00 [auto1.de] INFO: Scrape type for HK17634: 0
2026-03-30 10:38:00 [auto1.de] INFO: Found listing with ID: ZW86653
2026-03-30 10:38:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef3510>
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_0757987ad11c9e4e05c54f57bee559a1.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_0757987ad11c9e4e05c54f57bee559a1.jpg saved to cache
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b40d5609-d44e-587d-bcb0-68c5a8db35eb
2026-03-30 10:38:01 [auto1.de] INFO: Found listing with ID: CF13358
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF13358%27 HTTP/1.1" 200 None
2026-03-30 10:38:01 [auto1.de] INFO: Scrape type for CF13358: 1
2026-03-30 10:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_8219d245dbc968ffa33431834cc23161.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC09035> (referer: https://www.auto1.com/v1/car-details-view/EC09035/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:01 [auto1.de] INFO: Found listing with ID: FD73568
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD73568%27 HTTP/1.1" 200 None
2026-03-30 10:38:01 [auto1.de] INFO: Scrape type for FD73568: 1
2026-03-30 10:38:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:01 [auto1.de] INFO: Found listing with ID: SU59543
2026-03-30 10:38:01 [auto1.de] INFO: Found listing with ID: FV99442
2026-03-30 10:38:01 [auto1.de] INFO: Found listing with ID: YC82095
2026-03-30 10:38:01 [auto1.de] INFO: Found listing with ID: SK17684
2026-03-30 10:38:01 [auto1.de] INFO: Found listing with ID: EK25155
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK25155%27 HTTP/1.1" 200 None
2026-03-30 10:38:01 [auto1.de] INFO: Scrape type for EK25155: 1
2026-03-30 10:38:01 [auto1.de] INFO: Found listing with ID: UD42563
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD42563%27 HTTP/1.1" 200 None
2026-03-30 10:38:01 [auto1.de] INFO: Scrape type for UD42563: 1
2026-03-30 10:38:01 [auto1.de] INFO: Found listing with ID: FC77029
2026-03-30 10:38:01 [auto1.de] INFO: Found listing with ID: LK62819
2026-03-30 10:38:01 [auto1.de] INFO: Found listing with ID: RH77590
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH77590%27 HTTP/1.1" 200 None
2026-03-30 10:38:01 [auto1.de] INFO: Scrape type for RH77590: 2
2026-03-30 10:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0752661-0c97-57c1-9caa-667e254cf34b with identifier: RH77590
2026-03-30 10:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0752661-0c97-57c1-9caa-667e254cf34b with scrape type 2
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0752661-0c97-57c1-9caa-667e254cf34b with scrape type 2
2026-03-30 10:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0752661-0c97-57c1-9caa-667e254cf34b, identifier: RH77590
2026-03-30 10:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0752661-0c97-57c1-9caa-667e254cf34b with identifier: RH77590
2026-03-30 10:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0752661-0c97-57c1-9caa-667e254cf34b with identifier: RH77590
2026-03-30 10:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0752661-0c97-57c1-9caa-667e254cf34b with identifier: RH77590 to the API
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:13:05Z',
 'fuel_type': 'petrol',
 'id': 'a0752661-0c97-57c1-9caa-667e254cf34b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH77590',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 83582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-26',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH77590%27 HTTP/1.1" 200 None
2026-03-30 10:38:01 [auto1.de] INFO: Saving data for RH77590: {'auction_closing_time': 1774969985.0, 'created_time': 1773775832.94825, 'last_price_update_time': 1774867081.660373}
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RH77590') HTTP/1.1" 204 0
2026-03-30 10:38:01 [auto1.de] INFO: Found listing with ID: BE37921
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE37921%27 HTTP/1.1" 200 None
2026-03-30 10:38:01 [auto1.de] INFO: Scrape type for BE37921: 1
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef5710>
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_8219d245dbc968ffa33431834cc23161.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_8219d245dbc968ffa33431834cc23161.jpg saved to cache
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7f97e5e-8884-55f3-8ccf-af7c698e0fa6
2026-03-30 10:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19020d7c-c4b0-5816-9fdc-168b420f6f06 with identifier: EC09035
2026-03-30 10:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19020d7c-c4b0-5816-9fdc-168b420f6f06 with scrape type 1
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 19020d7c-c4b0-5816-9fdc-168b420f6f06
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_8ccf84f0424a779b696f79531c37ad63.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_8ccf84f0424a779b696f79531c37ad63.jpg not downloaded yet
2026-03-30 10:38:01 [auto1.de] INFO: Found listing with ID: HA59022
2026-03-30 10:38:01 [auto1.de] INFO: Found listing with ID: GL86487
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL86487%27 HTTP/1.1" 200 None
2026-03-30 10:38:01 [auto1.de] INFO: Scrape type for GL86487: 2
2026-03-30 10:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61e2311a-1199-577a-ad03-d36c11075ea6 with identifier: GL86487
2026-03-30 10:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61e2311a-1199-577a-ad03-d36c11075ea6 with scrape type 2
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61e2311a-1199-577a-ad03-d36c11075ea6 with scrape type 2
2026-03-30 10:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61e2311a-1199-577a-ad03-d36c11075ea6, identifier: GL86487
2026-03-30 10:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61e2311a-1199-577a-ad03-d36c11075ea6 with identifier: GL86487
2026-03-30 10:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61e2311a-1199-577a-ad03-d36c11075ea6 with identifier: GL86487
2026-03-30 10:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61e2311a-1199-577a-ad03-d36c11075ea6 with identifier: GL86487 to the API
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:42:13Z',
 'fuel_type': 'diesel',
 'id': '61e2311a-1199-577a-ad03-d36c11075ea6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL86487',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 142061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-21',
 'seller_name': None,
 'title': 'Ford Ranger 3.2 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2017}
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL86487%27 HTTP/1.1" 200 None
2026-03-30 10:38:02 [auto1.de] INFO: Saving data for GL86487: {'auction_closing_time': 1774971733.0, 'created_time': 1773308271.920912, 'last_price_update_time': 1774867082.364304}
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL86487') HTTP/1.1" 204 0
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_e266a34b00f7c60702d65883ee42f182.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_e266a34b00f7c60702d65883ee42f182.jpg not downloaded yet
2026-03-30 10:38:02 [auto1.de] INFO: Found listing with ID: BA43176
2026-03-30 10:38:02 [auto1.de] INFO: Found listing with ID: XA33716
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA33716%27 HTTP/1.1" 200 None
2026-03-30 10:38:02 [auto1.de] INFO: Scrape type for XA33716: 2
2026-03-30 10:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cd8c5eb-030b-55d2-b41b-4a8d6522940f with identifier: XA33716
2026-03-30 10:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cd8c5eb-030b-55d2-b41b-4a8d6522940f with scrape type 2
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cd8c5eb-030b-55d2-b41b-4a8d6522940f with scrape type 2
2026-03-30 10:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7cd8c5eb-030b-55d2-b41b-4a8d6522940f, identifier: XA33716
2026-03-30 10:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7cd8c5eb-030b-55d2-b41b-4a8d6522940f with identifier: XA33716
2026-03-30 10:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7cd8c5eb-030b-55d2-b41b-4a8d6522940f with identifier: XA33716
2026-03-30 10:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7cd8c5eb-030b-55d2-b41b-4a8d6522940f with identifier: XA33716 to the API
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:45:45Z',
 'fuel_type': 'petrol',
 'id': '7cd8c5eb-030b-55d2-b41b-4a8d6522940f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA33716',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 14574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-23',
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 200 Mild-Hybrid Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2023}
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA33716%27 HTTP/1.1" 200 None
2026-03-30 10:38:02 [auto1.de] INFO: Saving data for XA33716: {'auction_closing_time': 1774971945.0, 'created_time': 1774262655.653474, 'last_price_update_time': 1774867082.825102}
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA33716') HTTP/1.1" 204 0
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_e6b7f8625c02af26602cc1899ed3b12b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_e6b7f8625c02af26602cc1899ed3b12b.jpg not downloaded yet
2026-03-30 10:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AZ64163> (referer: https://www.auto1.com/v1/car-details-view/AZ64163/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:02 [auto1.de] INFO: Found listing with ID: UE99004
2026-03-30 10:38:02 [auto1.de] INFO: Found listing with ID: SD73357
2026-03-30 10:38:02 [auto1.de] INFO: Found listing with ID: CH19368
2026-03-30 10:38:02 [auto1.de] INFO: Found listing with ID: YG04546
2026-03-30 10:38:02 [auto1.de] INFO: Found listing with ID: CL70294
2026-03-30 10:38:02 [auto1.de] INFO: Found listing with ID: MN62141
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN62141%27 HTTP/1.1" 200 None
2026-03-30 10:38:02 [auto1.de] INFO: Scrape type for MN62141: 2
2026-03-30 10:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4ed2be2-1362-569d-89e0-845aba52bc99 with identifier: MN62141
2026-03-30 10:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4ed2be2-1362-569d-89e0-845aba52bc99 with scrape type 2
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4ed2be2-1362-569d-89e0-845aba52bc99 with scrape type 2
2026-03-30 10:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4ed2be2-1362-569d-89e0-845aba52bc99, identifier: MN62141
2026-03-30 10:38:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4ed2be2-1362-569d-89e0-845aba52bc99 with identifier: MN62141
2026-03-30 10:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4ed2be2-1362-569d-89e0-845aba52bc99 with identifier: MN62141
2026-03-30 10:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4ed2be2-1362-569d-89e0-845aba52bc99 with identifier: MN62141 to the API
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:58:20Z',
 'fuel_type': 'diesel',
 'id': 'b4ed2be2-1362-569d-89e0-845aba52bc99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN62141',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 228560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-22',
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive Luxury Line',
 'transmission': 'automatic',
 'trim': 'xDrive Luxury Line',
 'year': 2018}
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN62141%27 HTTP/1.1" 200 None
2026-03-30 10:38:03 [auto1.de] INFO: Saving data for MN62141: {'auction_closing_time': 1774972700.0, 'created_time': 1774379955.642868, 'last_price_update_time': 1774867083.297471}
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN62141') HTTP/1.1" 204 0
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_6ef06145c53e76ee964d184375ef6a97.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_6ef06145c53e76ee964d184375ef6a97.jpg not downloaded yet
2026-03-30 10:38:03 [auto1.de] INFO: Found listing with ID: BN03804
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN03804%27 HTTP/1.1" 200 None
2026-03-30 10:38:03 [auto1.de] INFO: Scrape type for BN03804: 1
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_a8e75479245cf54a0485c793d65c3fbe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_a8e75479245cf54a0485c793d65c3fbe.jpg not downloaded yet
2026-03-30 10:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6ab68f9-30b0-5f74-a8a5-80a37fa87348 with identifier: AZ64163
2026-03-30 10:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6ab68f9-30b0-5f74-a8a5-80a37fa87348 with scrape type 1
2026-03-30 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b6ab68f9-30b0-5f74-a8a5-80a37fa87348
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F40%252F3a40674fbc31d98e3354b17e34694624%252Fpa%252FAZ64163_c18502ab37473ba2d8bbc7c40ba5ece9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_c18502ab37473ba2d8bbc7c40ba5ece9.jpg not downloaded yet
2026-03-30 10:38:03 [auto1.de] INFO: Found listing with ID: KM94418
2026-03-30 10:38:03 [auto1.de] INFO: Found listing with ID: ZS80574
2026-03-30 10:38:03 [auto1.de] INFO: Found listing with ID: DL81432
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL81432%27 HTTP/1.1" 200 None
2026-03-30 10:38:03 [auto1.de] INFO: Scrape type for DL81432: 2
2026-03-30 10:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de01664a-9bb6-5aba-ab68-e3c0a98c23d3 with identifier: DL81432
2026-03-30 10:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de01664a-9bb6-5aba-ab68-e3c0a98c23d3 with scrape type 2
2026-03-30 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de01664a-9bb6-5aba-ab68-e3c0a98c23d3 with scrape type 2
2026-03-30 10:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de01664a-9bb6-5aba-ab68-e3c0a98c23d3, identifier: DL81432
2026-03-30 10:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de01664a-9bb6-5aba-ab68-e3c0a98c23d3 with identifier: DL81432
2026-03-30 10:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de01664a-9bb6-5aba-ab68-e3c0a98c23d3 with identifier: DL81432
2026-03-30 10:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de01664a-9bb6-5aba-ab68-e3c0a98c23d3 with identifier: DL81432 to the API
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-31T15:00:48Z',
 'fuel_type': 'petrol',
 'id': 'de01664a-9bb6-5aba-ab68-e3c0a98c23d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL81432',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 125264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-09',
 'seller_name': None,
 'title': 'Mazda CX-5 2.5 Sports-Line AWD',
 'transmission': 'automatic',
 'trim': 'Sports-Line AWD',
 'year': 2019}
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL81432%27 HTTP/1.1" 200 None
2026-03-30 10:38:03 [auto1.de] INFO: Saving data for DL81432: {'auction_closing_time': 1774969248.0, 'created_time': 1773687957.683895, 'last_price_update_time': 1774867083.937561}
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL81432') HTTP/1.1" 204 0
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_e0a5b9457547230b67315de065ebad57.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_e0a5b9457547230b67315de065ebad57.jpg not downloaded yet
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F40%252F3a40674fbc31d98e3354b17e34694624%252Fpa%252FAZ64163_b68d65c79e8ac5aa3ae279b8df3ed315.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_b68d65c79e8ac5aa3ae279b8df3ed315.jpg not downloaded yet
2026-03-30 10:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_e266a34b00f7c60702d65883ee42f182.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:03 [auto1.de] INFO: Found listing with ID: SE21529
2026-03-30 10:38:03 [auto1.de] INFO: Found listing with ID: FF53328
2026-03-30 10:38:03 [auto1.de] INFO: Found listing with ID: KD18794
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD18794%27 HTTP/1.1" 200 None
2026-03-30 10:38:04 [auto1.de] INFO: Scrape type for KD18794: 1
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_e6c1549499a8292b00f9ae6559ba8b74.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_e6c1549499a8292b00f9ae6559ba8b74.jpg not downloaded yet
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F40%252F3a40674fbc31d98e3354b17e34694624%252Fpa%252FAZ64163_a3e9593f293baf4fa0136f3501939299.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_a3e9593f293baf4fa0136f3501939299.jpg not downloaded yet
2026-03-30 10:38:04 [auto1.de] INFO: Found listing with ID: PE68373
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE68373%27 HTTP/1.1" 200 None
2026-03-30 10:38:04 [auto1.de] INFO: Scrape type for PE68373: 2
2026-03-30 10:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32236615-b3b1-5ce8-84af-15e8d8e8a74b with identifier: PE68373
2026-03-30 10:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32236615-b3b1-5ce8-84af-15e8d8e8a74b with scrape type 2
2026-03-30 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32236615-b3b1-5ce8-84af-15e8d8e8a74b with scrape type 2
2026-03-30 10:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32236615-b3b1-5ce8-84af-15e8d8e8a74b, identifier: PE68373
2026-03-30 10:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32236615-b3b1-5ce8-84af-15e8d8e8a74b with identifier: PE68373
2026-03-30 10:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32236615-b3b1-5ce8-84af-15e8d8e8a74b with identifier: PE68373
2026-03-30 10:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32236615-b3b1-5ce8-84af-15e8d8e8a74b with identifier: PE68373 to the API
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-31T15:23:36Z',
 'fuel_type': 'petrol',
 'id': '32236615-b3b1-5ce8-84af-15e8d8e8a74b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE68373',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 300498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1983-07-14',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse SE 500',
 'transmission': 'automatic',
 'trim': '',
 'year': 1983}
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE68373%27 HTTP/1.1" 200 None
2026-03-30 10:38:04 [auto1.de] INFO: Saving data for PE68373: {'auction_closing_time': 1774970616.0, 'created_time': 1774292111.520423, 'last_price_update_time': 1774867084.46004}
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE68373') HTTP/1.1" 204 0
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_277cd25144fc70bf7e28d3086b42bbbe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_277cd25144fc70bf7e28d3086b42bbbe.jpg not downloaded yet
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F40%252F3a40674fbc31d98e3354b17e34694624%252Fpa%252FAZ64163_c71be7e1d40e0ee3af237af813291e29.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_c71be7e1d40e0ee3af237af813291e29.jpg not downloaded yet
2026-03-30 10:38:04 [scrapy.extensions.logstats] INFO: Crawled 271 pages (at 27 pages/min), scraped 172 items (at 24 items/min)
2026-03-30 10:38:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:38:04 [auto1.de] INFO: Found listing with ID: EW16881
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW16881%27 HTTP/1.1" 200 None
2026-03-30 10:38:04 [auto1.de] INFO: Scrape type for EW16881: 2
2026-03-30 10:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ed7692d-9438-5282-b429-42a74eb6070e with identifier: EW16881
2026-03-30 10:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed7692d-9438-5282-b429-42a74eb6070e with scrape type 2
2026-03-30 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ed7692d-9438-5282-b429-42a74eb6070e with scrape type 2
2026-03-30 10:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ed7692d-9438-5282-b429-42a74eb6070e, identifier: EW16881
2026-03-30 10:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ed7692d-9438-5282-b429-42a74eb6070e with identifier: EW16881
2026-03-30 10:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ed7692d-9438-5282-b429-42a74eb6070e with identifier: EW16881
2026-03-30 10:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ed7692d-9438-5282-b429-42a74eb6070e with identifier: EW16881 to the API
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:07:35Z',
 'fuel_type': 'petrol',
 'id': '8ed7692d-9438-5282-b429-42a74eb6070e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW16881',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 252517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-23',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor T BlueEfficiency Classic',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Classic',
 'year': 2009}
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW16881%27 HTTP/1.1" 200 None
2026-03-30 10:38:04 [auto1.de] INFO: Saving data for EW16881: {'auction_closing_time': 1774969655.0, 'created_time': 1773687288.609867, 'last_price_update_time': 1774867084.935364}
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW16881') HTTP/1.1" 204 0
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_1a8523001326cd2537a641b5105f6c4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_1a8523001326cd2537a641b5105f6c4f.jpg not downloaded yet
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F40%252F3a40674fbc31d98e3354b17e34694624%252Fpa%252FAZ64163_f0658e950f7bd1970559fc2d86babcac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_f0658e950f7bd1970559fc2d86babcac.jpg not downloaded yet
2026-03-30 10:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_b68d65c79e8ac5aa3ae279b8df3ed315.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:04 [auto1.de] INFO: Found listing with ID: FL29012
2026-03-30 10:38:04 [auto1.de] INFO: Found listing with ID: DZ14257
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ14257%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [auto1.de] INFO: Scrape type for DZ14257: 1
2026-03-30 10:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f433d250>
2026-03-30 10:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_e266a34b00f7c60702d65883ee42f182.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_e266a34b00f7c60702d65883ee42f182.jpg saved to cache
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 19020d7c-c4b0-5816-9fdc-168b420f6f06
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_07602dee06fec5e06d14e4a54f13673a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_07602dee06fec5e06d14e4a54f13673a.jpg not downloaded yet
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F40%252F3a40674fbc31d98e3354b17e34694624%252Fpa%252FAZ64163_2daff7a6460737ca2f4880d058f8ec7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_2daff7a6460737ca2f4880d058f8ec7c.jpg not downloaded yet
2026-03-30 10:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB70310> (referer: https://www.auto1.com/v1/car-details-view/XB70310/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:05 [auto1.de] INFO: Found listing with ID: MR66589
2026-03-30 10:38:05 [auto1.de] INFO: Found listing with ID: RA69083
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA69083%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [auto1.de] INFO: Scrape type for RA69083: 1
2026-03-30 10:38:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ85670> (referer: https://www.auto1.com/v1/car-details-view/BJ85670/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR65337> (referer: https://www.auto1.com/v1/car-details-view/BR65337/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4165c50>
2026-03-30 10:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6ab68f9-30b0-5f74-a8a5-80a37fa87348/b6ab68f9-30b0-5f74-a8a5-80a37fa87348_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F40%252F3a40674fbc31d98e3354b17e34694624%252Fpa%252FAZ64163_b68d65c79e8ac5aa3ae279b8df3ed315.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_b68d65c79e8ac5aa3ae279b8df3ed315.jpg saved to cache
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6ab68f9-30b0-5f74-a8a5-80a37fa87348
2026-03-30 10:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_2daff7a6460737ca2f4880d058f8ec7c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_c71be7e1d40e0ee3af237af813291e29.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_07602dee06fec5e06d14e4a54f13673a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85d787f3-782d-5756-ab1b-753084ebee5b with identifier: XB70310
2026-03-30 10:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85d787f3-782d-5756-ab1b-753084ebee5b with scrape type 1
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85d787f3-782d-5756-ab1b-753084ebee5b
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0f%252F550f5e3242029e1b5e3fd127270b556f%252Fpa%252FXB70310_1cf09cca4cb3883839d57626e870f7b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_1cf09cca4cb3883839d57626e870f7b4.jpg already downloaded
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0f%252F550f5e3242029e1b5e3fd127270b556f%252Fpa%252FXB70310_70ec9b02d3b821293967a6ea51b55a7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_70ec9b02d3b821293967a6ea51b55a7f.jpg already downloaded
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0f%252F550f5e3242029e1b5e3fd127270b556f%252Fpa%252FXB70310_636ddd56c9c456c025cb8b4915732263.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_636ddd56c9c456c025cb8b4915732263.jpg already downloaded
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0f%252F550f5e3242029e1b5e3fd127270b556f%252Fpa%252FXB70310_32dbecd09e706e7ff81c5c8343895f35.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_32dbecd09e706e7ff81c5c8343895f35.jpg already downloaded
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0f%252F550f5e3242029e1b5e3fd127270b556f%252Fpa%252FXB70310_09eef932f31216bda0b51f760b0ffe1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_09eef932f31216bda0b51f760b0ffe1b.jpg already downloaded
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0f%252F550f5e3242029e1b5e3fd127270b556f%252Fpa%252FXB70310_b662e63a442a86b6bd3f2b0f62e9c230.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_b662e63a442a86b6bd3f2b0f62e9c230.jpg already downloaded
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0f%252F550f5e3242029e1b5e3fd127270b556f%252Fpa%252FXB70310_a9aa8c45c0c2ee3b3f429734beb0b880.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_a9aa8c45c0c2ee3b3f429734beb0b880.jpg already downloaded
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0f%252F550f5e3242029e1b5e3fd127270b556f%252Fpa%252FXB70310_f02bdf537b3baf1615da803fca21bd7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_f02bdf537b3baf1615da803fca21bd7e.jpg already downloaded
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0f%252F550f5e3242029e1b5e3fd127270b556f%252Fpa%252FXB70310_eab641931203225368e269660d80f71b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_eab641931203225368e269660d80f71b.jpg already downloaded
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0f%252F550f5e3242029e1b5e3fd127270b556f%252Fpa%252FXB70310_dfb1c5e673e7f449b85f84f81fa7db06.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_dfb1c5e673e7f449b85f84f81fa7db06.jpg already downloaded
2026-03-30 10:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85d787f3-782d-5756-ab1b-753084ebee5b, identifier: XB70310
2026-03-30 10:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93360394-20dd-5b03-8964-1bfa038e6685 with identifier: BJ85670
2026-03-30 10:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93360394-20dd-5b03-8964-1bfa038e6685 with scrape type 1
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 93360394-20dd-5b03-8964-1bfa038e6685
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fc1%252F76c1a15891abc24238ca773e6936c8eb%252Fpa%252FBJ85670_59d02ec8f62885eff70ac8d9cd5641c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/c1/76c1a15891abc24238ca773e6936c8eb/pa/BJ85670_59d02ec8f62885eff70ac8d9cd5641c1.jpg already downloaded
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fc1%252F76c1a15891abc24238ca773e6936c8eb%252Fpa%252FBJ85670_cd73ac70253901a1ecc6ac09da62ab45.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/c1/76c1a15891abc24238ca773e6936c8eb/pa/BJ85670_cd73ac70253901a1ecc6ac09da62ab45.jpg already downloaded
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fc1%252F76c1a15891abc24238ca773e6936c8eb%252Fpa%252FBJ85670_75b81a1f148a077b906647e98b4fd9a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/c1/76c1a15891abc24238ca773e6936c8eb/pa/BJ85670_75b81a1f148a077b906647e98b4fd9a8.jpg already downloaded
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fc1%252F76c1a15891abc24238ca773e6936c8eb%252Fpa%252FBJ85670_9e6178049c2c08dfcd44b635819a6a53.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/c1/76c1a15891abc24238ca773e6936c8eb/pa/BJ85670_9e6178049c2c08dfcd44b635819a6a53.jpg already downloaded
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fc1%252F76c1a15891abc24238ca773e6936c8eb%252Fpa%252FBJ85670_c1184583b39a1845bfa53b46631e2c68.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/c1/76c1a15891abc24238ca773e6936c8eb/pa/BJ85670_c1184583b39a1845bfa53b46631e2c68.jpg already downloaded
2026-03-30 10:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93360394-20dd-5b03-8964-1bfa038e6685, identifier: BJ85670
2026-03-30 10:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8c01e6d-e005-5861-81a3-befb0c2b93af with identifier: BR65337
2026-03-30 10:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c01e6d-e005-5861-81a3-befb0c2b93af with scrape type 1
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 3 photos for item f8c01e6d-e005-5861-81a3-befb0c2b93af
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F19%252F211948461edbd1b4159c712b88835d39%252Fpa%252FBR65337_db9eed43e0c2ce11cbe1c035fb5f0255.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/19/211948461edbd1b4159c712b88835d39/pa/BR65337_db9eed43e0c2ce11cbe1c035fb5f0255.jpg not downloaded yet
2026-03-30 10:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85d787f3-782d-5756-ab1b-753084ebee5b with identifier: XB70310
2026-03-30 10:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85d787f3-782d-5756-ab1b-753084ebee5b with identifier: XB70310
2026-03-30 10:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85d787f3-782d-5756-ab1b-753084ebee5b with identifier: XB70310 to the API
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XB70310>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:50:08Z',
 'fuel_type': 'diesel',
 'id': '85d787f3-782d-5756-ab1b-753084ebee5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB70310',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 168287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_1cf09cca4cb3883839d57626e870f7b4.jpg',
                'https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_70ec9b02d3b821293967a6ea51b55a7f.jpg',
                'https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_636ddd56c9c456c025cb8b4915732263.jpg',
                'https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_32dbecd09e706e7ff81c5c8343895f35.jpg',
                'https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_09eef932f31216bda0b51f760b0ffe1b.jpg',
                'https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_b662e63a442a86b6bd3f2b0f62e9c230.jpg',
                'https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_a9aa8c45c0c2ee3b3f429734beb0b880.jpg',
                'https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_f02bdf537b3baf1615da803fca21bd7e.jpg',
                'https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_eab641931203225368e269660d80f71b.jpg',
                'https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_dfb1c5e673e7f449b85f84f81fa7db06.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d787f3-782d-5756-ab1b-753084ebee5b/85d787f3-782d-5756-ab1b-753084ebee5b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_1cf09cca4cb3883839d57626e870f7b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d787f3-782d-5756-ab1b-753084ebee5b/85d787f3-782d-5756-ab1b-753084ebee5b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_70ec9b02d3b821293967a6ea51b55a7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d787f3-782d-5756-ab1b-753084ebee5b/85d787f3-782d-5756-ab1b-753084ebee5b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_636ddd56c9c456c025cb8b4915732263.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d787f3-782d-5756-ab1b-753084ebee5b/85d787f3-782d-5756-ab1b-753084ebee5b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_32dbecd09e706e7ff81c5c8343895f35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d787f3-782d-5756-ab1b-753084ebee5b/85d787f3-782d-5756-ab1b-753084ebee5b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2296026,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_09eef932f31216bda0b51f760b0ffe1b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d787f3-782d-5756-ab1b-753084ebee5b/85d787f3-782d-5756-ab1b-753084ebee5b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_b662e63a442a86b6bd3f2b0f62e9c230.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d787f3-782d-5756-ab1b-753084ebee5b/85d787f3-782d-5756-ab1b-753084ebee5b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_a9aa8c45c0c2ee3b3f429734beb0b880.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d787f3-782d-5756-ab1b-753084ebee5b/85d787f3-782d-5756-ab1b-753084ebee5b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_f02bdf537b3baf1615da803fca21bd7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d787f3-782d-5756-ab1b-753084ebee5b/85d787f3-782d-5756-ab1b-753084ebee5b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_eab641931203225368e269660d80f71b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d787f3-782d-5756-ab1b-753084ebee5b/85d787f3-782d-5756-ab1b-753084ebee5b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/0f/550f5e3242029e1b5e3fd127270b556f/pa/XB70310_dfb1c5e673e7f449b85f84f81fa7db06.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB70310%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [auto1.de] INFO: Saving data for XB70310: {'created_time': 1774867086.15522, 'last_price_update_time': 1774867086.155231, 'auction_closing_time': 1774972208.0}
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB70310') HTTP/1.1" 204 0
2026-03-30 10:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93360394-20dd-5b03-8964-1bfa038e6685 with identifier: BJ85670
2026-03-30 10:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93360394-20dd-5b03-8964-1bfa038e6685 with identifier: BJ85670
2026-03-30 10:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93360394-20dd-5b03-8964-1bfa038e6685 with identifier: BJ85670 to the API
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BJ85670>
{'auction_title': '',
 'c_o_2_emission_value': 240,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.2L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:17:14Z',
 'fuel_type': 'diesel',
 'id': '93360394-20dd-5b03-8964-1bfa038e6685',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ85670',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 243120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img76/c1/76c1a15891abc24238ca773e6936c8eb/pa/BJ85670_59d02ec8f62885eff70ac8d9cd5641c1.jpg',
                'https://img-pa.auto1.com/img76/c1/76c1a15891abc24238ca773e6936c8eb/pa/BJ85670_cd73ac70253901a1ecc6ac09da62ab45.jpg',
                'https://img-pa.auto1.com/img76/c1/76c1a15891abc24238ca773e6936c8eb/pa/BJ85670_75b81a1f148a077b906647e98b4fd9a8.jpg',
                'https://img-pa.auto1.com/img76/c1/76c1a15891abc24238ca773e6936c8eb/pa/BJ85670_9e6178049c2c08dfcd44b635819a6a53.jpg',
                'https://img-pa.auto1.com/img76/c1/76c1a15891abc24238ca773e6936c8eb/pa/BJ85670_c1184583b39a1845bfa53b46631e2c68.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93360394-20dd-5b03-8964-1bfa038e6685/93360394-20dd-5b03-8964-1bfa038e6685_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/c1/76c1a15891abc24238ca773e6936c8eb/pa/BJ85670_59d02ec8f62885eff70ac8d9cd5641c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93360394-20dd-5b03-8964-1bfa038e6685/93360394-20dd-5b03-8964-1bfa038e6685_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/c1/76c1a15891abc24238ca773e6936c8eb/pa/BJ85670_cd73ac70253901a1ecc6ac09da62ab45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93360394-20dd-5b03-8964-1bfa038e6685/93360394-20dd-5b03-8964-1bfa038e6685_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/c1/76c1a15891abc24238ca773e6936c8eb/pa/BJ85670_75b81a1f148a077b906647e98b4fd9a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93360394-20dd-5b03-8964-1bfa038e6685/93360394-20dd-5b03-8964-1bfa038e6685_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/c1/76c1a15891abc24238ca773e6936c8eb/pa/BJ85670_9e6178049c2c08dfcd44b635819a6a53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93360394-20dd-5b03-8964-1bfa038e6685/93360394-20dd-5b03-8964-1bfa038e6685_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/c1/76c1a15891abc24238ca773e6936c8eb/pa/BJ85670_c1184583b39a1845bfa53b46631e2c68.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-08-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Jumper 2.2 HDi 35 L2H1 Heavy',
 'transmission': 'manual',
 'trim': '35 L2H1 Heavy',
 'year': 2009}
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ85670%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [auto1.de] INFO: Saving data for BJ85670: {'created_time': 1774867086.643924, 'last_price_update_time': 1774867086.643954, 'auction_closing_time': 1774970234.0}
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ85670') HTTP/1.1" 204 0
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F19%252F211948461edbd1b4159c712b88835d39%252Fpa%252FBR65337_2407f31e8f582686a108beaa959d96a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/19/211948461edbd1b4159c712b88835d39/pa/BR65337_2407f31e8f582686a108beaa959d96a6.jpg not downloaded yet
2026-03-30 10:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV52010> (referer: https://www.auto1.com/v1/car-details-view/VV52010/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee95f50>
2026-03-30 10:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6ab68f9-30b0-5f74-a8a5-80a37fa87348/b6ab68f9-30b0-5f74-a8a5-80a37fa87348_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F40%252F3a40674fbc31d98e3354b17e34694624%252Fpa%252FAZ64163_2daff7a6460737ca2f4880d058f8ec7c.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_2daff7a6460737ca2f4880d058f8ec7c.jpg saved to cache
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6ab68f9-30b0-5f74-a8a5-80a37fa87348
2026-03-30 10:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428a090>
2026-03-30 10:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6ab68f9-30b0-5f74-a8a5-80a37fa87348/b6ab68f9-30b0-5f74-a8a5-80a37fa87348_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F40%252F3a40674fbc31d98e3354b17e34694624%252Fpa%252FAZ64163_c71be7e1d40e0ee3af237af813291e29.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_c71be7e1d40e0ee3af237af813291e29.jpg saved to cache
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6ab68f9-30b0-5f74-a8a5-80a37fa87348
2026-03-30 10:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a0090>
2026-03-30 10:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_07602dee06fec5e06d14e4a54f13673a.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_07602dee06fec5e06d14e4a54f13673a.jpg saved to cache
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 19020d7c-c4b0-5816-9fdc-168b420f6f06
2026-03-30 10:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_5698031e2e05a154b1e4c6738b15b400.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F19%252F211948461edbd1b4159c712b88835d39%252Fpa%252FBR65337_b2ef20b3bd93d15c846fa0d7f0fae017.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/19/211948461edbd1b4159c712b88835d39/pa/BR65337_b2ef20b3bd93d15c846fa0d7f0fae017.jpg not downloaded yet
2026-03-30 10:38:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_1a8523001326cd2537a641b5105f6c4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_f0658e950f7bd1970559fc2d86babcac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e2d8179-52ed-567d-b913-24c0a492ddae with identifier: VV52010
2026-03-30 10:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e2d8179-52ed-567d-b913-24c0a492ddae with scrape type 1
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e2d8179-52ed-567d-b913-24c0a492ddae
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F37%252F5537da343d6399d28428138ebe172095%252Fpa%252FVV52010_d3cac1c18a1cc84073b082dd91645824.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_d3cac1c18a1cc84073b082dd91645824.jpg already downloaded
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F37%252F5537da343d6399d28428138ebe172095%252Fpa%252FVV52010_6dd1f943291ac8e61db95df3d6c91fdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_6dd1f943291ac8e61db95df3d6c91fdc.jpg already downloaded
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F37%252F5537da343d6399d28428138ebe172095%252Fpa%252FVV52010_27c8d505f8af63d96856385eff69af7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_27c8d505f8af63d96856385eff69af7d.jpg already downloaded
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F37%252F5537da343d6399d28428138ebe172095%252Fpa%252FVV52010_ef8f5c7f1e58bf5284415197aa624a6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_ef8f5c7f1e58bf5284415197aa624a6c.jpg already downloaded
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F37%252F5537da343d6399d28428138ebe172095%252Fpa%252FVV52010_8ef3daa567dbc9e112322b2a6a7dfee5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_8ef3daa567dbc9e112322b2a6a7dfee5.jpg already downloaded
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F37%252F5537da343d6399d28428138ebe172095%252Fpa%252FVV52010_915f8c41a241ee4b270d3397821e37b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_915f8c41a241ee4b270d3397821e37b8.jpg already downloaded
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F37%252F5537da343d6399d28428138ebe172095%252Fpa%252FVV52010_09dc74e452a2817cb5e4d3b721065610.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_09dc74e452a2817cb5e4d3b721065610.jpg already downloaded
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F37%252F5537da343d6399d28428138ebe172095%252Fpa%252FVV52010_32729e9b7b8aaf4557d97937b47716d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_32729e9b7b8aaf4557d97937b47716d1.jpg already downloaded
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F37%252F5537da343d6399d28428138ebe172095%252Fpa%252FVV52010_91bf162ea6510ea0b319c4b902d835a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_91bf162ea6510ea0b319c4b902d835a3.jpg already downloaded
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F37%252F5537da343d6399d28428138ebe172095%252Fpa%252FVV52010_2a63a9562b217b0165f0fba9714ef009.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_2a63a9562b217b0165f0fba9714ef009.jpg already downloaded
2026-03-30 10:38:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e2d8179-52ed-567d-b913-24c0a492ddae, identifier: VV52010
2026-03-30 10:38:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e2d8179-52ed-567d-b913-24c0a492ddae with identifier: VV52010
2026-03-30 10:38:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e2d8179-52ed-567d-b913-24c0a492ddae with identifier: VV52010
2026-03-30 10:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e2d8179-52ed-567d-b913-24c0a492ddae with identifier: VV52010 to the API
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VV52010>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:41:32Z',
 'fuel_type': 'diesel',
 'id': '3e2d8179-52ed-567d-b913-24c0a492ddae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV52010',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 366816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_d3cac1c18a1cc84073b082dd91645824.jpg',
                'https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_6dd1f943291ac8e61db95df3d6c91fdc.jpg',
                'https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_27c8d505f8af63d96856385eff69af7d.jpg',
                'https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_ef8f5c7f1e58bf5284415197aa624a6c.jpg',
                'https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_8ef3daa567dbc9e112322b2a6a7dfee5.jpg',
                'https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_915f8c41a241ee4b270d3397821e37b8.jpg',
                'https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_09dc74e452a2817cb5e4d3b721065610.jpg',
                'https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_32729e9b7b8aaf4557d97937b47716d1.jpg',
                'https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_91bf162ea6510ea0b319c4b902d835a3.jpg',
                'https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_2a63a9562b217b0165f0fba9714ef009.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e2d8179-52ed-567d-b913-24c0a492ddae/3e2d8179-52ed-567d-b913-24c0a492ddae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_d3cac1c18a1cc84073b082dd91645824.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e2d8179-52ed-567d-b913-24c0a492ddae/3e2d8179-52ed-567d-b913-24c0a492ddae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_6dd1f943291ac8e61db95df3d6c91fdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e2d8179-52ed-567d-b913-24c0a492ddae/3e2d8179-52ed-567d-b913-24c0a492ddae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_27c8d505f8af63d96856385eff69af7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e2d8179-52ed-567d-b913-24c0a492ddae/3e2d8179-52ed-567d-b913-24c0a492ddae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_ef8f5c7f1e58bf5284415197aa624a6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e2d8179-52ed-567d-b913-24c0a492ddae/3e2d8179-52ed-567d-b913-24c0a492ddae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_8ef3daa567dbc9e112322b2a6a7dfee5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e2d8179-52ed-567d-b913-24c0a492ddae/3e2d8179-52ed-567d-b913-24c0a492ddae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_915f8c41a241ee4b270d3397821e37b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e2d8179-52ed-567d-b913-24c0a492ddae/3e2d8179-52ed-567d-b913-24c0a492ddae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_09dc74e452a2817cb5e4d3b721065610.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e2d8179-52ed-567d-b913-24c0a492ddae/3e2d8179-52ed-567d-b913-24c0a492ddae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_32729e9b7b8aaf4557d97937b47716d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e2d8179-52ed-567d-b913-24c0a492ddae/3e2d8179-52ed-567d-b913-24c0a492ddae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_91bf162ea6510ea0b319c4b902d835a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e2d8179-52ed-567d-b913-24c0a492ddae/3e2d8179-52ed-567d-b913-24c0a492ddae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/37/5537da343d6399d28428138ebe172095/pa/VV52010_2a63a9562b217b0165f0fba9714ef009.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2017}
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV52010%27 HTTP/1.1" 200 None
2026-03-30 10:38:07 [auto1.de] INFO: Saving data for VV52010: {'created_time': 1774867087.487487, 'last_price_update_time': 1774867087.487498, 'auction_closing_time': 1774971692.0}
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV52010') HTTP/1.1" 204 0
2026-03-30 10:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/19/211948461edbd1b4159c712b88835d39/pa/BR65337_b2ef20b3bd93d15c846fa0d7f0fae017.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/19/211948461edbd1b4159c712b88835d39/pa/BR65337_db9eed43e0c2ce11cbe1c035fb5f0255.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/19/211948461edbd1b4159c712b88835d39/pa/BR65337_2407f31e8f582686a108beaa959d96a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_277cd25144fc70bf7e28d3086b42bbbe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428a350>
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_5698031e2e05a154b1e4c6738b15b400.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_5698031e2e05a154b1e4c6738b15b400.jpg saved to cache
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8b4ed73-b977-51b6-9904-16b975722641
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee44ff10>
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_1a8523001326cd2537a641b5105f6c4f.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_1a8523001326cd2537a641b5105f6c4f.jpg saved to cache
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 19020d7c-c4b0-5816-9fdc-168b420f6f06
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4279110>
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6ab68f9-30b0-5f74-a8a5-80a37fa87348/b6ab68f9-30b0-5f74-a8a5-80a37fa87348_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F40%252F3a40674fbc31d98e3354b17e34694624%252Fpa%252FAZ64163_f0658e950f7bd1970559fc2d86babcac.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_f0658e950f7bd1970559fc2d86babcac.jpg saved to cache
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6ab68f9-30b0-5f74-a8a5-80a37fa87348
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefb7cd0>
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c01e6d-e005-5861-81a3-befb0c2b93af/f8c01e6d-e005-5861-81a3-befb0c2b93af_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F19%252F211948461edbd1b4159c712b88835d39%252Fpa%252FBR65337_b2ef20b3bd93d15c846fa0d7f0fae017.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/19/211948461edbd1b4159c712b88835d39/pa/BR65337_b2ef20b3bd93d15c846fa0d7f0fae017.jpg saved to cache
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8c01e6d-e005-5861-81a3-befb0c2b93af
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9c990>
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c01e6d-e005-5861-81a3-befb0c2b93af/f8c01e6d-e005-5861-81a3-befb0c2b93af_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F19%252F211948461edbd1b4159c712b88835d39%252Fpa%252FBR65337_db9eed43e0c2ce11cbe1c035fb5f0255.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/19/211948461edbd1b4159c712b88835d39/pa/BR65337_db9eed43e0c2ce11cbe1c035fb5f0255.jpg saved to cache
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8c01e6d-e005-5861-81a3-befb0c2b93af
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f426ab10>
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c01e6d-e005-5861-81a3-befb0c2b93af/f8c01e6d-e005-5861-81a3-befb0c2b93af_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F19%252F211948461edbd1b4159c712b88835d39%252Fpa%252FBR65337_2407f31e8f582686a108beaa959d96a6.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/19/211948461edbd1b4159c712b88835d39/pa/BR65337_2407f31e8f582686a108beaa959d96a6.jpg saved to cache
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8c01e6d-e005-5861-81a3-befb0c2b93af
2026-03-30 10:38:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8c01e6d-e005-5861-81a3-befb0c2b93af, skipping ID generation
2026-03-30 10:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c01e6d-e005-5861-81a3-befb0c2b93af with scrape type 1
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8c01e6d-e005-5861-81a3-befb0c2b93af sending to next pipeline
2026-03-30 10:38:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8c01e6d-e005-5861-81a3-befb0c2b93af, identifier: BR65337
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee72a10>
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_277cd25144fc70bf7e28d3086b42bbbe.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_277cd25144fc70bf7e28d3086b42bbbe.jpg saved to cache
2026-03-30 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 19020d7c-c4b0-5816-9fdc-168b420f6f06
2026-03-30 10:38:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8c01e6d-e005-5861-81a3-befb0c2b93af with identifier: BR65337
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=other HTTP/1.1" 200 None
2026-03-30 10:38:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:38:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8c01e6d-e005-5861-81a3-befb0c2b93af with identifier: BR65337
2026-03-30 10:38:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8c01e6d-e005-5861-81a3-befb0c2b93af with identifier: BR65337 to the API
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img21/19/211948461edbd1b4159c712b88835d39/pa/BR65337_2407f31e8f582686a108beaa959d96a6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'other',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:51:28Z',
 'fuel_type': 'petrol',
 'id': 'f8c01e6d-e005-5861-81a3-befb0c2b93af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR65337',
 'listing': 'auction',
 'location': 'DE, Bochum',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 37282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 3,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c01e6d-e005-5861-81a3-befb0c2b93af/f8c01e6d-e005-5861-81a3-befb0c2b93af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/19/211948461edbd1b4159c712b88835d39/pa/BR65337_db9eed43e0c2ce11cbe1c035fb5f0255.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c01e6d-e005-5861-81a3-befb0c2b93af/f8c01e6d-e005-5861-81a3-befb0c2b93af_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/19/211948461edbd1b4159c712b88835d39/pa/BR65337_2407f31e8f582686a108beaa959d96a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c01e6d-e005-5861-81a3-befb0c2b93af/f8c01e6d-e005-5861-81a3-befb0c2b93af_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/19/211948461edbd1b4159c712b88835d39/pa/BR65337_b2ef20b3bd93d15c846fa0d7f0fae017.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-13',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2021}
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR65337%27 HTTP/1.1" 200 None
2026-03-30 10:38:08 [auto1.de] INFO: Saving data for BR65337: {'created_time': 1774867088.604371, 'last_price_update_time': 1774867088.604382, 'auction_closing_time': 1774972288.0}
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR65337') HTTP/1.1" 204 0
2026-03-30 10:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_e6c1549499a8292b00f9ae6559ba8b74.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_e0a5b9457547230b67315de065ebad57.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_a3e9593f293baf4fa0136f3501939299.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV63005> (referer: https://www.auto1.com/v1/car-details-view/KV63005/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_6ef06145c53e76ee964d184375ef6a97.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_c18502ab37473ba2d8bbc7c40ba5ece9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14035c3110>
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_e6c1549499a8292b00f9ae6559ba8b74.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_e6c1549499a8292b00f9ae6559ba8b74.jpg saved to cache
2026-03-30 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 19020d7c-c4b0-5816-9fdc-168b420f6f06
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43393d0>
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_e0a5b9457547230b67315de065ebad57.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_e0a5b9457547230b67315de065ebad57.jpg saved to cache
2026-03-30 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 19020d7c-c4b0-5816-9fdc-168b420f6f06
2026-03-30 10:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_e6b7f8625c02af26602cc1899ed3b12b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3fd7d0>
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6ab68f9-30b0-5f74-a8a5-80a37fa87348/b6ab68f9-30b0-5f74-a8a5-80a37fa87348_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F40%252F3a40674fbc31d98e3354b17e34694624%252Fpa%252FAZ64163_a3e9593f293baf4fa0136f3501939299.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_a3e9593f293baf4fa0136f3501939299.jpg saved to cache
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6ab68f9-30b0-5f74-a8a5-80a37fa87348
2026-03-30 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_8ccf84f0424a779b696f79531c37ad63.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_a8e75479245cf54a0485c793d65c3fbe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93c93b6f-c11a-5ee4-ab34-a080b76d7a8a with identifier: KV63005
2026-03-30 10:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93c93b6f-c11a-5ee4-ab34-a080b76d7a8a with scrape type 1
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 93c93b6f-c11a-5ee4-ab34-a080b76d7a8a
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F82%252F5482325150020152de237e4c57ef923d%252Fpa%252FKV63005_c94c8a9912bbbf4a8aa5b567d7656441.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_c94c8a9912bbbf4a8aa5b567d7656441.jpg already downloaded
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F82%252F5482325150020152de237e4c57ef923d%252Fpa%252FKV63005_87b713ce6d7bfea493a2325090135fc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_87b713ce6d7bfea493a2325090135fc3.jpg already downloaded
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F82%252F5482325150020152de237e4c57ef923d%252Fpa%252FKV63005_cd58203022f39fc60ea76147c4f7865a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_cd58203022f39fc60ea76147c4f7865a.jpg already downloaded
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F82%252F5482325150020152de237e4c57ef923d%252Fpa%252FKV63005_3af6954f911b56ef990ebdea67e11983.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_3af6954f911b56ef990ebdea67e11983.jpg already downloaded
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F82%252F5482325150020152de237e4c57ef923d%252Fpa%252FKV63005_9ad9e2631d8e8a9e5319b447ea13fae4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_9ad9e2631d8e8a9e5319b447ea13fae4.jpg already downloaded
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F82%252F5482325150020152de237e4c57ef923d%252Fpa%252FKV63005_1e01ea55a412d766bf94b52dc3d78f79.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_1e01ea55a412d766bf94b52dc3d78f79.jpg already downloaded
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F82%252F5482325150020152de237e4c57ef923d%252Fpa%252FKV63005_f214336adfa302e901a1f5711ba4c793.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_f214336adfa302e901a1f5711ba4c793.jpg already downloaded
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F82%252F5482325150020152de237e4c57ef923d%252Fpa%252FKV63005_c1cb2ca2512e0963afbfa67f0e425005.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_c1cb2ca2512e0963afbfa67f0e425005.jpg already downloaded
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F82%252F5482325150020152de237e4c57ef923d%252Fpa%252FKV63005_4bef089907c1f42dc08ecb889dbc5f78.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_4bef089907c1f42dc08ecb889dbc5f78.jpg already downloaded
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F82%252F5482325150020152de237e4c57ef923d%252Fpa%252FKV63005_de4cbcf462da2158f0ecbec6f472055d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_de4cbcf462da2158f0ecbec6f472055d.jpg already downloaded
2026-03-30 10:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93c93b6f-c11a-5ee4-ab34-a080b76d7a8a, identifier: KV63005
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef733d0>
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_6ef06145c53e76ee964d184375ef6a97.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_6ef06145c53e76ee964d184375ef6a97.jpg saved to cache
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 19020d7c-c4b0-5816-9fdc-168b420f6f06
2026-03-30 10:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93c93b6f-c11a-5ee4-ab34-a080b76d7a8a with identifier: KV63005
2026-03-30 10:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93c93b6f-c11a-5ee4-ab34-a080b76d7a8a with identifier: KV63005
2026-03-30 10:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93c93b6f-c11a-5ee4-ab34-a080b76d7a8a with identifier: KV63005 to the API
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KV63005>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:46:27Z',
 'fuel_type': 'diesel',
 'id': '93c93b6f-c11a-5ee4-ab34-a080b76d7a8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV63005',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 123943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_c94c8a9912bbbf4a8aa5b567d7656441.jpg',
                'https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_87b713ce6d7bfea493a2325090135fc3.jpg',
                'https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_cd58203022f39fc60ea76147c4f7865a.jpg',
                'https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_3af6954f911b56ef990ebdea67e11983.jpg',
                'https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_9ad9e2631d8e8a9e5319b447ea13fae4.jpg',
                'https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_1e01ea55a412d766bf94b52dc3d78f79.jpg',
                'https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_f214336adfa302e901a1f5711ba4c793.jpg',
                'https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_c1cb2ca2512e0963afbfa67f0e425005.jpg',
                'https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_4bef089907c1f42dc08ecb889dbc5f78.jpg',
                'https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_de4cbcf462da2158f0ecbec6f472055d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93c93b6f-c11a-5ee4-ab34-a080b76d7a8a/93c93b6f-c11a-5ee4-ab34-a080b76d7a8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2616523,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_c94c8a9912bbbf4a8aa5b567d7656441.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93c93b6f-c11a-5ee4-ab34-a080b76d7a8a/93c93b6f-c11a-5ee4-ab34-a080b76d7a8a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2655951,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_87b713ce6d7bfea493a2325090135fc3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93c93b6f-c11a-5ee4-ab34-a080b76d7a8a/93c93b6f-c11a-5ee4-ab34-a080b76d7a8a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2773697,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_cd58203022f39fc60ea76147c4f7865a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93c93b6f-c11a-5ee4-ab34-a080b76d7a8a/93c93b6f-c11a-5ee4-ab34-a080b76d7a8a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_3af6954f911b56ef990ebdea67e11983.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93c93b6f-c11a-5ee4-ab34-a080b76d7a8a/93c93b6f-c11a-5ee4-ab34-a080b76d7a8a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_9ad9e2631d8e8a9e5319b447ea13fae4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93c93b6f-c11a-5ee4-ab34-a080b76d7a8a/93c93b6f-c11a-5ee4-ab34-a080b76d7a8a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_1e01ea55a412d766bf94b52dc3d78f79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93c93b6f-c11a-5ee4-ab34-a080b76d7a8a/93c93b6f-c11a-5ee4-ab34-a080b76d7a8a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_f214336adfa302e901a1f5711ba4c793.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93c93b6f-c11a-5ee4-ab34-a080b76d7a8a/93c93b6f-c11a-5ee4-ab34-a080b76d7a8a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2693594,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_c1cb2ca2512e0963afbfa67f0e425005.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93c93b6f-c11a-5ee4-ab34-a080b76d7a8a/93c93b6f-c11a-5ee4-ab34-a080b76d7a8a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2548261,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_4bef089907c1f42dc08ecb889dbc5f78.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93c93b6f-c11a-5ee4-ab34-a080b76d7a8a/93c93b6f-c11a-5ee4-ab34-a080b76d7a8a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2500318,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/82/5482325150020152de237e4c57ef923d/pa/KV63005_de4cbcf462da2158f0ecbec6f472055d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2016}
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV63005%27 HTTP/1.1" 200 None
2026-03-30 10:38:09 [auto1.de] INFO: Saving data for KV63005: {'created_time': 1774867089.725885, 'last_price_update_time': 1774867089.725896, 'auction_closing_time': 1774971987.0}
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV63005') HTTP/1.1" 204 0
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41c7850>
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6ab68f9-30b0-5f74-a8a5-80a37fa87348/b6ab68f9-30b0-5f74-a8a5-80a37fa87348_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F40%252F3a40674fbc31d98e3354b17e34694624%252Fpa%252FAZ64163_c18502ab37473ba2d8bbc7c40ba5ece9.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_c18502ab37473ba2d8bbc7c40ba5ece9.jpg saved to cache
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6ab68f9-30b0-5f74-a8a5-80a37fa87348
2026-03-30 10:38:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6ab68f9-30b0-5f74-a8a5-80a37fa87348, skipping ID generation
2026-03-30 10:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6ab68f9-30b0-5f74-a8a5-80a37fa87348 with scrape type 1
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6ab68f9-30b0-5f74-a8a5-80a37fa87348 sending to next pipeline
2026-03-30 10:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6ab68f9-30b0-5f74-a8a5-80a37fa87348, identifier: AZ64163
2026-03-30 10:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6ab68f9-30b0-5f74-a8a5-80a37fa87348 with identifier: AZ64163
2026-03-30 10:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6ab68f9-30b0-5f74-a8a5-80a37fa87348 with identifier: AZ64163
2026-03-30 10:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6ab68f9-30b0-5f74-a8a5-80a37fa87348 with identifier: AZ64163 to the API
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_c18502ab37473ba2d8bbc7c40ba5ece9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:06:27Z',
 'fuel_type': 'diesel',
 'id': 'b6ab68f9-30b0-5f74-a8a5-80a37fa87348',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ64163',
 'listing': 'auction',
 'location': 'DE, Bruchsal',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6ab68f9-30b0-5f74-a8a5-80a37fa87348/b6ab68f9-30b0-5f74-a8a5-80a37fa87348_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_c18502ab37473ba2d8bbc7c40ba5ece9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6ab68f9-30b0-5f74-a8a5-80a37fa87348/b6ab68f9-30b0-5f74-a8a5-80a37fa87348_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_b68d65c79e8ac5aa3ae279b8df3ed315.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6ab68f9-30b0-5f74-a8a5-80a37fa87348/b6ab68f9-30b0-5f74-a8a5-80a37fa87348_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_a3e9593f293baf4fa0136f3501939299.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6ab68f9-30b0-5f74-a8a5-80a37fa87348/b6ab68f9-30b0-5f74-a8a5-80a37fa87348_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_c71be7e1d40e0ee3af237af813291e29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6ab68f9-30b0-5f74-a8a5-80a37fa87348/b6ab68f9-30b0-5f74-a8a5-80a37fa87348_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_f0658e950f7bd1970559fc2d86babcac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6ab68f9-30b0-5f74-a8a5-80a37fa87348/b6ab68f9-30b0-5f74-a8a5-80a37fa87348_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/40/3a40674fbc31d98e3354b17e34694624/pa/AZ64163_2daff7a6460737ca2f4880d058f8ec7c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-28',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L1 Trend',
 'transmission': 'manual',
 'trim': '310 L1 Trend',
 'year': 2016}
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ64163%27 HTTP/1.1" 200 None
2026-03-30 10:38:10 [auto1.de] INFO: Saving data for AZ64163: {'created_time': 1774867090.242338, 'last_price_update_time': 1774867090.242399, 'auction_closing_time': 1774969587.0}
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ64163') HTTP/1.1" 204 0
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45b650>
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_e6b7f8625c02af26602cc1899ed3b12b.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_e6b7f8625c02af26602cc1899ed3b12b.jpg saved to cache
2026-03-30 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 19020d7c-c4b0-5816-9fdc-168b420f6f06
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429ce90>
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_8ccf84f0424a779b696f79531c37ad63.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_8ccf84f0424a779b696f79531c37ad63.jpg saved to cache
2026-03-30 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19020d7c-c4b0-5816-9fdc-168b420f6f06
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a1d10>
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fd5%252Fc7d5074c2faed7d259d1a14f0e182e84%252Fpa%252FEC09035_a8e75479245cf54a0485c793d65c3fbe.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_a8e75479245cf54a0485c793d65c3fbe.jpg saved to cache
2026-03-30 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 19020d7c-c4b0-5816-9fdc-168b420f6f06
2026-03-30 10:38:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19020d7c-c4b0-5816-9fdc-168b420f6f06, skipping ID generation
2026-03-30 10:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19020d7c-c4b0-5816-9fdc-168b420f6f06 with scrape type 1
2026-03-30 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19020d7c-c4b0-5816-9fdc-168b420f6f06 sending to next pipeline
2026-03-30 10:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19020d7c-c4b0-5816-9fdc-168b420f6f06, identifier: EC09035
2026-03-30 10:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19020d7c-c4b0-5816-9fdc-168b420f6f06 with identifier: EC09035
2026-03-30 10:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19020d7c-c4b0-5816-9fdc-168b420f6f06 with identifier: EC09035
2026-03-30 10:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19020d7c-c4b0-5816-9fdc-168b420f6f06 with identifier: EC09035 to the API
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_a8e75479245cf54a0485c793d65c3fbe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:03:49Z',
 'fuel_type': 'diesel',
 'id': '19020d7c-c4b0-5816-9fdc-168b420f6f06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC09035',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 34250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_8ccf84f0424a779b696f79531c37ad63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_e266a34b00f7c60702d65883ee42f182.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_e6b7f8625c02af26602cc1899ed3b12b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_6ef06145c53e76ee964d184375ef6a97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_a8e75479245cf54a0485c793d65c3fbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_e0a5b9457547230b67315de065ebad57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_e6c1549499a8292b00f9ae6559ba8b74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_277cd25144fc70bf7e28d3086b42bbbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_1a8523001326cd2537a641b5105f6c4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19020d7c-c4b0-5816-9fdc-168b420f6f06/19020d7c-c4b0-5816-9fdc-168b420f6f06_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/d5/c7d5074c2faed7d259d1a14f0e182e84/pa/EC09035_07602dee06fec5e06d14e4a54f13673a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi',
 'transmission': 'manual',
 'trim': 'Maxi',
 'year': 2023}
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC09035%27 HTTP/1.1" 200 None
2026-03-30 10:38:10 [auto1.de] INFO: Saving data for EC09035: {'created_time': 1774867090.90808, 'last_price_update_time': 1774867090.90809, 'auction_closing_time': 1774969429.0}
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC09035') HTTP/1.1" 204 0
2026-03-30 10:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:11 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 9426 | hits on page: 40
2026-03-30 10:38:11 [auto1.de] INFO: Found listing with ID: SB38553
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB38553%27 HTTP/1.1" 200 None
2026-03-30 10:38:11 [auto1.de] INFO: Scrape type for SB38553: 1
2026-03-30 10:38:11 [auto1.de] INFO: Found listing with ID: HB76846
2026-03-30 10:38:11 [auto1.de] INFO: Found listing with ID: KP41876
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP41876%27 HTTP/1.1" 200 None
2026-03-30 10:38:11 [auto1.de] INFO: Scrape type for KP41876: 2
2026-03-30 10:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61a533fd-b24a-502a-95b8-8277bdbb2dca with identifier: KP41876
2026-03-30 10:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61a533fd-b24a-502a-95b8-8277bdbb2dca with scrape type 2
2026-03-30 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61a533fd-b24a-502a-95b8-8277bdbb2dca with scrape type 2
2026-03-30 10:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61a533fd-b24a-502a-95b8-8277bdbb2dca, identifier: KP41876
2026-03-30 10:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61a533fd-b24a-502a-95b8-8277bdbb2dca with identifier: KP41876
2026-03-30 10:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61a533fd-b24a-502a-95b8-8277bdbb2dca with identifier: KP41876
2026-03-30 10:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61a533fd-b24a-502a-95b8-8277bdbb2dca with identifier: KP41876 to the API
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:18:45Z',
 'fuel_type': 'diesel',
 'id': '61a533fd-b24a-502a-95b8-8277bdbb2dca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP41876',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 195328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-29',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 350 CDI BlueTEC Edition 1',
 'transmission': 'automatic',
 'trim': 'BlueTEC Edition 1',
 'year': 2012}
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP41876%27 HTTP/1.1" 200 None
2026-03-30 10:38:12 [auto1.de] INFO: Saving data for KP41876: {'auction_closing_time': 1774970325.0, 'created_time': 1773307530.140919, 'last_price_update_time': 1774867092.408089}
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP41876') HTTP/1.1" 204 0
2026-03-30 10:38:12 [auto1.de] INFO: Found listing with ID: WV73920
2026-03-30 10:38:12 [auto1.de] INFO: Found listing with ID: NS06519
2026-03-30 10:38:12 [auto1.de] INFO: Found listing with ID: RW87494
2026-03-30 10:38:12 [auto1.de] INFO: Found listing with ID: YF04765
2026-03-30 10:38:12 [auto1.de] INFO: Found listing with ID: CV02833
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV02833%27 HTTP/1.1" 200 None
2026-03-30 10:38:12 [auto1.de] INFO: Scrape type for CV02833: 1
2026-03-30 10:38:12 [auto1.de] INFO: Found listing with ID: BB05879
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB05879%27 HTTP/1.1" 200 None
2026-03-30 10:38:12 [auto1.de] INFO: Scrape type for BB05879: 1
2026-03-30 10:38:12 [auto1.de] INFO: Found listing with ID: UA15697
2026-03-30 10:38:12 [auto1.de] INFO: Found listing with ID: AN11349
2026-03-30 10:38:12 [auto1.de] INFO: Found listing with ID: GG08526
2026-03-30 10:38:12 [auto1.de] INFO: Found listing with ID: YN03957
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN03957%27 HTTP/1.1" 200 None
2026-03-30 10:38:12 [auto1.de] INFO: Scrape type for YN03957: 2
2026-03-30 10:38:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e78c7f62-8934-5ba0-8b2f-73289b965eb2 with identifier: YN03957
2026-03-30 10:38:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e78c7f62-8934-5ba0-8b2f-73289b965eb2 with scrape type 2
2026-03-30 10:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e78c7f62-8934-5ba0-8b2f-73289b965eb2 with scrape type 2
2026-03-30 10:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e78c7f62-8934-5ba0-8b2f-73289b965eb2, identifier: YN03957
2026-03-30 10:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e78c7f62-8934-5ba0-8b2f-73289b965eb2 with identifier: YN03957
2026-03-30 10:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e78c7f62-8934-5ba0-8b2f-73289b965eb2 with identifier: YN03957
2026-03-30 10:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e78c7f62-8934-5ba0-8b2f-73289b965eb2 with identifier: YN03957 to the API
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:01:10Z',
 'fuel_type': 'diesel',
 'id': 'e78c7f62-8934-5ba0-8b2f-73289b965eb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN03957',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 207233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-31',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Match BlueMotion',
 'transmission': 'automatic',
 'trim': 'Match BlueMotion',
 'year': 2013}
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN03957%27 HTTP/1.1" 200 None
2026-03-30 10:38:12 [auto1.de] INFO: Saving data for YN03957: {'auction_closing_time': 1774969270.0, 'created_time': 1773688341.988766, 'last_price_update_time': 1774867092.907647}
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN03957') HTTP/1.1" 204 0
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: FK59829
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: HA20586
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: RB42350
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: WL33179
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: KX41187
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX41187%27 HTTP/1.1" 200 None
2026-03-30 10:38:13 [auto1.de] INFO: Scrape type for KX41187: 1
2026-03-30 10:38:13 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.112(s), this was the 1st time calling it.
2026-03-30 10:38:13 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.07846800685395 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: YB72682
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: VP46996
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP46996%27 HTTP/1.1" 200 None
2026-03-30 10:38:13 [auto1.de] INFO: Scrape type for VP46996: 1
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: TB89261
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: XT31239
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: XB84962
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: YT13051
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT13051%27 HTTP/1.1" 200 None
2026-03-30 10:38:13 [auto1.de] INFO: Scrape type for YT13051: 2
2026-03-30 10:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdb74679-16e7-5a6c-91d3-906503b37be0 with identifier: YT13051
2026-03-30 10:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdb74679-16e7-5a6c-91d3-906503b37be0 with scrape type 2
2026-03-30 10:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdb74679-16e7-5a6c-91d3-906503b37be0 with scrape type 2
2026-03-30 10:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdb74679-16e7-5a6c-91d3-906503b37be0, identifier: YT13051
2026-03-30 10:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdb74679-16e7-5a6c-91d3-906503b37be0 with identifier: YT13051
2026-03-30 10:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdb74679-16e7-5a6c-91d3-906503b37be0 with identifier: YT13051
2026-03-30 10:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdb74679-16e7-5a6c-91d3-906503b37be0 with identifier: YT13051 to the API
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:02:22Z',
 'fuel_type': 'diesel',
 'id': 'cdb74679-16e7-5a6c-91d3-906503b37be0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT13051',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 97998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-27',
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi Bi-Turbo Vignale 4x4',
 'transmission': 'automatic',
 'trim': 'Vignale 4x4',
 'year': 2018}
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT13051%27 HTTP/1.1" 200 None
2026-03-30 10:38:13 [auto1.de] INFO: Saving data for YT13051: {'auction_closing_time': 1774969342.0, 'created_time': 1774292070.253076, 'last_price_update_time': 1774867093.521933}
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT13051') HTTP/1.1" 204 0
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: RE55796
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE55796%27 HTTP/1.1" 200 None
2026-03-30 10:38:13 [auto1.de] INFO: Scrape type for RE55796: 1
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: FE09717
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: HR51580
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR51580%27 HTTP/1.1" 200 None
2026-03-30 10:38:13 [auto1.de] INFO: Scrape type for HR51580: 1
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: JS21761
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: LU37241
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: FM54313
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: HD00097
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD00097%27 HTTP/1.1" 200 None
2026-03-30 10:38:13 [auto1.de] INFO: Scrape type for HD00097: 1
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: AA95512
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: GG34958
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: ZM89950
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: BL10422
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: SK87421
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK87421%27 HTTP/1.1" 200 None
2026-03-30 10:38:13 [auto1.de] INFO: Scrape type for SK87421: 1
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: HU92055
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: GE83879
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: MT85534
2026-03-30 10:38:13 [auto1.de] INFO: Found listing with ID: RE68011
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE68011%27 HTTP/1.1" 200 None
2026-03-30 10:38:13 [auto1.de] INFO: Scrape type for RE68011: 2
2026-03-30 10:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02cd0557-6437-5397-aba7-57303c1a8c1e with identifier: RE68011
2026-03-30 10:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02cd0557-6437-5397-aba7-57303c1a8c1e with scrape type 2
2026-03-30 10:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02cd0557-6437-5397-aba7-57303c1a8c1e with scrape type 2
2026-03-30 10:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02cd0557-6437-5397-aba7-57303c1a8c1e, identifier: RE68011
2026-03-30 10:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02cd0557-6437-5397-aba7-57303c1a8c1e with identifier: RE68011
2026-03-30 10:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02cd0557-6437-5397-aba7-57303c1a8c1e with identifier: RE68011
2026-03-30 10:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02cd0557-6437-5397-aba7-57303c1a8c1e with identifier: RE68011 to the API
2026-03-30 10:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:23:01Z',
 'fuel_type': 'diesel',
 'id': '02cd0557-6437-5397-aba7-57303c1a8c1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE68011',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Caravelle',
 'odometer': 339043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-09',
 'seller_name': None,
 'title': 'Volkswagen T5 Caravelle 2.0 TDI Comfortline lang',
 'transmission': 'manual',
 'trim': 'Comfortline lang',
 'year': 2010}
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE68011%27 HTTP/1.1" 200 None
2026-03-30 10:38:14 [auto1.de] INFO: Saving data for RE68011: {'auction_closing_time': 1774970581.0, 'created_time': 1773660284.672865, 'last_price_update_time': 1774867094.120437}
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE68011') HTTP/1.1" 204 0
2026-03-30 10:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF13358/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.790(s), this was the 1st time calling it.
2026-03-30 10:38:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.7971654802201553 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZX44823/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA69083/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD18794/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN03804/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YG35577> (referer: https://www.auto1.com/v1/car-details-view/YG35577/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4201ab37-5c35-57ca-96e1-504336d6003f with identifier: YG35577
2026-03-30 10:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4201ab37-5c35-57ca-96e1-504336d6003f with scrape type 1
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4201ab37-5c35-57ca-96e1-504336d6003f
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F25%252F3425c78e712feb411c9e9cf699fb170e%252Fpa%252FYG35577_a45fc0a015e024120fa51caef357ecd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/25/3425c78e712feb411c9e9cf699fb170e/pa/YG35577_a45fc0a015e024120fa51caef357ecd6.jpg already downloaded
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F25%252F3425c78e712feb411c9e9cf699fb170e%252Fpa%252FYG35577_7dd1af8dd48bf0ad32e92765f9449cf7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/25/3425c78e712feb411c9e9cf699fb170e/pa/YG35577_7dd1af8dd48bf0ad32e92765f9449cf7.jpg already downloaded
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F25%252F3425c78e712feb411c9e9cf699fb170e%252Fpa%252FYG35577_3a86623999b9d1d6c0932f5e1027b298.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/25/3425c78e712feb411c9e9cf699fb170e/pa/YG35577_3a86623999b9d1d6c0932f5e1027b298.jpg already downloaded
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F25%252F3425c78e712feb411c9e9cf699fb170e%252Fpa%252FYG35577_ab7960212684863205c74f003ec80014.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/25/3425c78e712feb411c9e9cf699fb170e/pa/YG35577_ab7960212684863205c74f003ec80014.jpg already downloaded
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F25%252F3425c78e712feb411c9e9cf699fb170e%252Fpa%252FYG35577_c986ebcca625f0f60d20f231915fd604.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/25/3425c78e712feb411c9e9cf699fb170e/pa/YG35577_c986ebcca625f0f60d20f231915fd604.jpg already downloaded
2026-03-30 10:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4201ab37-5c35-57ca-96e1-504336d6003f, identifier: YG35577
2026-03-30 10:38:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4201ab37-5c35-57ca-96e1-504336d6003f with identifier: YG35577
2026-03-30 10:38:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4201ab37-5c35-57ca-96e1-504336d6003f with identifier: YG35577
2026-03-30 10:38:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4201ab37-5c35-57ca-96e1-504336d6003f with identifier: YG35577 to the API
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YG35577>
{'auction_title': '',
 'c_o_2_emission_value': 292,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '3.2L',
 'engine_horse_power': 240,
 'expiration_date': '2026-03-31T15:00:03Z',
 'fuel_type': 'petrol',
 'id': '4201ab37-5c35-57ca-96e1-504336d6003f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG35577',
 'listing': 'auction',
 'location': 'DE, Kippenheim',
 'make': 'Volkswagen',
 'model': 'Phaeton',
 'odometer': 155357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img34/25/3425c78e712feb411c9e9cf699fb170e/pa/YG35577_a45fc0a015e024120fa51caef357ecd6.jpg',
                'https://img-pa.auto1.com/img34/25/3425c78e712feb411c9e9cf699fb170e/pa/YG35577_7dd1af8dd48bf0ad32e92765f9449cf7.jpg',
                'https://img-pa.auto1.com/img34/25/3425c78e712feb411c9e9cf699fb170e/pa/YG35577_3a86623999b9d1d6c0932f5e1027b298.jpg',
                'https://img-pa.auto1.com/img34/25/3425c78e712feb411c9e9cf699fb170e/pa/YG35577_ab7960212684863205c74f003ec80014.jpg',
                'https://img-pa.auto1.com/img34/25/3425c78e712feb411c9e9cf699fb170e/pa/YG35577_c986ebcca625f0f60d20f231915fd604.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4201ab37-5c35-57ca-96e1-504336d6003f/4201ab37-5c35-57ca-96e1-504336d6003f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/25/3425c78e712feb411c9e9cf699fb170e/pa/YG35577_a45fc0a015e024120fa51caef357ecd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4201ab37-5c35-57ca-96e1-504336d6003f/4201ab37-5c35-57ca-96e1-504336d6003f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/25/3425c78e712feb411c9e9cf699fb170e/pa/YG35577_7dd1af8dd48bf0ad32e92765f9449cf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4201ab37-5c35-57ca-96e1-504336d6003f/4201ab37-5c35-57ca-96e1-504336d6003f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/25/3425c78e712feb411c9e9cf699fb170e/pa/YG35577_3a86623999b9d1d6c0932f5e1027b298.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4201ab37-5c35-57ca-96e1-504336d6003f/4201ab37-5c35-57ca-96e1-504336d6003f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/25/3425c78e712feb411c9e9cf699fb170e/pa/YG35577_ab7960212684863205c74f003ec80014.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4201ab37-5c35-57ca-96e1-504336d6003f/4201ab37-5c35-57ca-96e1-504336d6003f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/25/3425c78e712feb411c9e9cf699fb170e/pa/YG35577_c986ebcca625f0f60d20f231915fd604.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Phaeton 3.2 V6',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG35577%27 HTTP/1.1" 200 None
2026-03-30 10:38:21 [auto1.de] INFO: Saving data for YG35577: {'created_time': 1774867101.49069, 'last_price_update_time': 1774867101.490702, 'auction_closing_time': 1774969203.0}
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YG35577') HTTP/1.1" 204 0
2026-03-30 10:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE37921/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DZ14257/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD42563/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB07030> (referer: https://www.auto1.com/v1/car-details-view/GB07030/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 835978c0-86bf-523b-af8f-bdd0bfde3491 with identifier: GB07030
2026-03-30 10:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 835978c0-86bf-523b-af8f-bdd0bfde3491 with scrape type 1
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 835978c0-86bf-523b-af8f-bdd0bfde3491
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_6db9ddc9a63dbca65dcf3785063fc37b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_6db9ddc9a63dbca65dcf3785063fc37b.jpg not downloaded yet
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_35e8b3ffe0df04864af1d27a024804dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_35e8b3ffe0df04864af1d27a024804dd.jpg not downloaded yet
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_1b7ce5af3574fce72f21b85a98415ba2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_1b7ce5af3574fce72f21b85a98415ba2.jpg not downloaded yet
2026-03-30 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK25155/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_41f40b498a03984b172302c982541695.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_41f40b498a03984b172302c982541695.jpg not downloaded yet
2026-03-30 10:38:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_878e1d64fd189db3be26f2059c8b07b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_878e1d64fd189db3be26f2059c8b07b2.jpg not downloaded yet
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_b429b221f5849b62b8e3a13374ed87d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_b429b221f5849b62b8e3a13374ed87d0.jpg not downloaded yet
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_d57104bf47e7851551644b1b5d0e2a7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_d57104bf47e7851551644b1b5d0e2a7a.jpg not downloaded yet
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_47461695c63c20b3df5e3e349fb96ec2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_47461695c63c20b3df5e3e349fb96ec2.jpg not downloaded yet
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_92ca2e6f9627a2c5bf6ffd363c3b60e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_92ca2e6f9627a2c5bf6ffd363c3b60e1.jpg not downloaded yet
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_b069818681e71a287c2327797b05db95.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_b069818681e71a287c2327797b05db95.jpg not downloaded yet
2026-03-30 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_1b7ce5af3574fce72f21b85a98415ba2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f427a2d0>
2026-03-30 10:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_1b7ce5af3574fce72f21b85a98415ba2.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_1b7ce5af3574fce72f21b85a98415ba2.jpg saved to cache
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 835978c0-86bf-523b-af8f-bdd0bfde3491
2026-03-30 10:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZW86653> (referer: https://www.auto1.com/v1/car-details-view/ZW86653/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68545b95-b1ff-522b-870a-d13f8a9065ae with identifier: ZW86653
2026-03-30 10:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68545b95-b1ff-522b-870a-d13f8a9065ae with scrape type 1
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68545b95-b1ff-522b-870a-d13f8a9065ae
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_ea3d5abd4dd9e826dd6fd61246e32d99.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_ea3d5abd4dd9e826dd6fd61246e32d99.jpg not downloaded yet
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_57144790f8a6da897bf09117b1de8387.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_57144790f8a6da897bf09117b1de8387.jpg not downloaded yet
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_4013f31f6695d2626368cb96862d9413.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_4013f31f6695d2626368cb96862d9413.jpg not downloaded yet
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_1683668d2647ad4673df9ddf76662939.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_1683668d2647ad4673df9ddf76662939.jpg not downloaded yet
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_5fae656b4b333c668d7da7cce62d5c19.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_5fae656b4b333c668d7da7cce62d5c19.jpg not downloaded yet
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_9dc4582438d6f859348eb063467777c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_9dc4582438d6f859348eb063467777c6.jpg not downloaded yet
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_d538998ba239a401792d151210079081.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_d538998ba239a401792d151210079081.jpg not downloaded yet
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_8514baffea1b7ce220cf2133dea9800e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_8514baffea1b7ce220cf2133dea9800e.jpg not downloaded yet
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_cdbdb2917c4ce17bedf2bb64c8153b7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_cdbdb2917c4ce17bedf2bb64c8153b7e.jpg not downloaded yet
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_93a5b310a3cda8ecd857cab58ef4f2eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_93a5b310a3cda8ecd857cab58ef4f2eb.jpg not downloaded yet
2026-03-30 10:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_b069818681e71a287c2327797b05db95.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_93a5b310a3cda8ecd857cab58ef4f2eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414f250>
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_b069818681e71a287c2327797b05db95.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_b069818681e71a287c2327797b05db95.jpg saved to cache
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 835978c0-86bf-523b-af8f-bdd0bfde3491
2026-03-30 10:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_cdbdb2917c4ce17bedf2bb64c8153b7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee82810>
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_93a5b310a3cda8ecd857cab58ef4f2eb.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_93a5b310a3cda8ecd857cab58ef4f2eb.jpg saved to cache
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 68545b95-b1ff-522b-870a-d13f8a9065ae
2026-03-30 10:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_8514baffea1b7ce220cf2133dea9800e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee17750>
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_cdbdb2917c4ce17bedf2bb64c8153b7e.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_cdbdb2917c4ce17bedf2bb64c8153b7e.jpg saved to cache
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 68545b95-b1ff-522b-870a-d13f8a9065ae
2026-03-30 10:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_d538998ba239a401792d151210079081.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4339d50>
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_8514baffea1b7ce220cf2133dea9800e.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_8514baffea1b7ce220cf2133dea9800e.jpg saved to cache
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 68545b95-b1ff-522b-870a-d13f8a9065ae
2026-03-30 10:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_9dc4582438d6f859348eb063467777c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TH79589/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee16810>
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_d538998ba239a401792d151210079081.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_d538998ba239a401792d151210079081.jpg saved to cache
2026-03-30 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 68545b95-b1ff-522b-870a-d13f8a9065ae
2026-03-30 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_5fae656b4b333c668d7da7cce62d5c19.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_1683668d2647ad4673df9ddf76662939.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f433a350>
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_9dc4582438d6f859348eb063467777c6.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_9dc4582438d6f859348eb063467777c6.jpg saved to cache
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68545b95-b1ff-522b-870a-d13f8a9065ae
2026-03-30 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_4013f31f6695d2626368cb96862d9413.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_57144790f8a6da897bf09117b1de8387.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefb7410>
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_5fae656b4b333c668d7da7cce62d5c19.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_5fae656b4b333c668d7da7cce62d5c19.jpg saved to cache
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68545b95-b1ff-522b-870a-d13f8a9065ae
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3ea190>
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_1683668d2647ad4673df9ddf76662939.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_1683668d2647ad4673df9ddf76662939.jpg saved to cache
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68545b95-b1ff-522b-870a-d13f8a9065ae
2026-03-30 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_ea3d5abd4dd9e826dd6fd61246e32d99.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5bfcf90>
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_4013f31f6695d2626368cb96862d9413.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_4013f31f6695d2626368cb96862d9413.jpg saved to cache
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68545b95-b1ff-522b-870a-d13f8a9065ae
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee72810>
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_57144790f8a6da897bf09117b1de8387.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_57144790f8a6da897bf09117b1de8387.jpg saved to cache
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68545b95-b1ff-522b-870a-d13f8a9065ae
2026-03-30 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG72078/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417f090>
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F79%252F5a79028200ee6cbd0e487d3eedbf10f1%252Fpa%252FZW86653_ea3d5abd4dd9e826dd6fd61246e32d99.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_ea3d5abd4dd9e826dd6fd61246e32d99.jpg saved to cache
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68545b95-b1ff-522b-870a-d13f8a9065ae
2026-03-30 10:38:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68545b95-b1ff-522b-870a-d13f8a9065ae, skipping ID generation
2026-03-30 10:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68545b95-b1ff-522b-870a-d13f8a9065ae with scrape type 1
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68545b95-b1ff-522b-870a-d13f8a9065ae sending to next pipeline
2026-03-30 10:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68545b95-b1ff-522b-870a-d13f8a9065ae, identifier: ZW86653
2026-03-30 10:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68545b95-b1ff-522b-870a-d13f8a9065ae with identifier: ZW86653
2026-03-30 10:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68545b95-b1ff-522b-870a-d13f8a9065ae with identifier: ZW86653
2026-03-30 10:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68545b95-b1ff-522b-870a-d13f8a9065ae with identifier: ZW86653 to the API
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_ea3d5abd4dd9e826dd6fd61246e32d99.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:09:22Z',
 'fuel_type': 'diesel',
 'id': '68545b95-b1ff-522b-870a-d13f8a9065ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW86653',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 107169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_ea3d5abd4dd9e826dd6fd61246e32d99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_57144790f8a6da897bf09117b1de8387.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_4013f31f6695d2626368cb96862d9413.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_1683668d2647ad4673df9ddf76662939.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_5fae656b4b333c668d7da7cce62d5c19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_9dc4582438d6f859348eb063467777c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_d538998ba239a401792d151210079081.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_8514baffea1b7ce220cf2133dea9800e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_cdbdb2917c4ce17bedf2bb64c8153b7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68545b95-b1ff-522b-870a-d13f8a9065ae/68545b95-b1ff-522b-870a-d13f8a9065ae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/79/5a79028200ee6cbd0e487d3eedbf10f1/pa/ZW86653_93a5b310a3cda8ecd857cab58ef4f2eb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW86653%27 HTTP/1.1" 200 None
2026-03-30 10:38:24 [auto1.de] INFO: Saving data for ZW86653: {'created_time': 1774867104.955994, 'last_price_update_time': 1774867104.95601, 'auction_closing_time': 1774969762.0}
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW86653') HTTP/1.1" 204 0
2026-03-30 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA69083> (referer: https://www.auto1.com/v1/car-details-view/RA69083/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_92ca2e6f9627a2c5bf6ffd363c3b60e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_47461695c63c20b3df5e3e349fb96ec2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1df5a047-46b4-5954-aa6b-da39eef37453 with identifier: RA69083
2026-03-30 10:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1df5a047-46b4-5954-aa6b-da39eef37453 with scrape type 1
2026-03-30 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1df5a047-46b4-5954-aa6b-da39eef37453
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F3b%252F3a3bf348bdfd19d55f55a17426f684f7%252Fpa%252FRA69083_d1537fe2ac4223857d5de1e3a5173547.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_d1537fe2ac4223857d5de1e3a5173547.jpg already downloaded
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F3b%252F3a3bf348bdfd19d55f55a17426f684f7%252Fpa%252FRA69083_0c6359845b9b5a96ef3762535b14aaa1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_0c6359845b9b5a96ef3762535b14aaa1.jpg already downloaded
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F3b%252F3a3bf348bdfd19d55f55a17426f684f7%252Fpa%252FRA69083_bf2d056511c366a45266f0fa9f602e6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_bf2d056511c366a45266f0fa9f602e6c.jpg already downloaded
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F3b%252F3a3bf348bdfd19d55f55a17426f684f7%252Fpa%252FRA69083_38ec2c2e5a06ce1f680462c819c1c80f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_38ec2c2e5a06ce1f680462c819c1c80f.jpg already downloaded
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F3b%252F3a3bf348bdfd19d55f55a17426f684f7%252Fpa%252FRA69083_62b4fdb788b3a1e92e857d6273ce3fc8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_62b4fdb788b3a1e92e857d6273ce3fc8.jpg already downloaded
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F3b%252F3a3bf348bdfd19d55f55a17426f684f7%252Fpa%252FRA69083_9883c3a5328b897744a668942d5ec591.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_9883c3a5328b897744a668942d5ec591.jpg already downloaded
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F3b%252F3a3bf348bdfd19d55f55a17426f684f7%252Fpa%252FRA69083_ce0234fc90841d631f9b86f97ec35a68.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_ce0234fc90841d631f9b86f97ec35a68.jpg already downloaded
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F3b%252F3a3bf348bdfd19d55f55a17426f684f7%252Fpa%252FRA69083_f60826212e6fbbc3161fdcaef473861b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_f60826212e6fbbc3161fdcaef473861b.jpg already downloaded
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F3b%252F3a3bf348bdfd19d55f55a17426f684f7%252Fpa%252FRA69083_e20733e42125379045884128b05998e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_e20733e42125379045884128b05998e3.jpg already downloaded
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F3b%252F3a3bf348bdfd19d55f55a17426f684f7%252Fpa%252FRA69083_44dc0ec252df39cbab375530e3011c3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_44dc0ec252df39cbab375530e3011c3f.jpg already downloaded
2026-03-30 10:38:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1df5a047-46b4-5954-aa6b-da39eef37453, identifier: RA69083
2026-03-30 10:38:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1df5a047-46b4-5954-aa6b-da39eef37453 with identifier: RA69083
2026-03-30 10:38:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1df5a047-46b4-5954-aa6b-da39eef37453 with identifier: RA69083
2026-03-30 10:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1df5a047-46b4-5954-aa6b-da39eef37453 with identifier: RA69083 to the API
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RA69083>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:48:54Z',
 'fuel_type': 'petrol',
 'id': '1df5a047-46b4-5954-aa6b-da39eef37453',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA69083',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 100069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_d1537fe2ac4223857d5de1e3a5173547.jpg',
                'https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_0c6359845b9b5a96ef3762535b14aaa1.jpg',
                'https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_bf2d056511c366a45266f0fa9f602e6c.jpg',
                'https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_38ec2c2e5a06ce1f680462c819c1c80f.jpg',
                'https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_62b4fdb788b3a1e92e857d6273ce3fc8.jpg',
                'https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_9883c3a5328b897744a668942d5ec591.jpg',
                'https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_ce0234fc90841d631f9b86f97ec35a68.jpg',
                'https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_f60826212e6fbbc3161fdcaef473861b.jpg',
                'https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_e20733e42125379045884128b05998e3.jpg',
                'https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_44dc0ec252df39cbab375530e3011c3f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df5a047-46b4-5954-aa6b-da39eef37453/1df5a047-46b4-5954-aa6b-da39eef37453_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_d1537fe2ac4223857d5de1e3a5173547.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df5a047-46b4-5954-aa6b-da39eef37453/1df5a047-46b4-5954-aa6b-da39eef37453_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_0c6359845b9b5a96ef3762535b14aaa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df5a047-46b4-5954-aa6b-da39eef37453/1df5a047-46b4-5954-aa6b-da39eef37453_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_bf2d056511c366a45266f0fa9f602e6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df5a047-46b4-5954-aa6b-da39eef37453/1df5a047-46b4-5954-aa6b-da39eef37453_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_38ec2c2e5a06ce1f680462c819c1c80f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df5a047-46b4-5954-aa6b-da39eef37453/1df5a047-46b4-5954-aa6b-da39eef37453_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_62b4fdb788b3a1e92e857d6273ce3fc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df5a047-46b4-5954-aa6b-da39eef37453/1df5a047-46b4-5954-aa6b-da39eef37453_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_9883c3a5328b897744a668942d5ec591.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df5a047-46b4-5954-aa6b-da39eef37453/1df5a047-46b4-5954-aa6b-da39eef37453_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_ce0234fc90841d631f9b86f97ec35a68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df5a047-46b4-5954-aa6b-da39eef37453/1df5a047-46b4-5954-aa6b-da39eef37453_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_f60826212e6fbbc3161fdcaef473861b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df5a047-46b4-5954-aa6b-da39eef37453/1df5a047-46b4-5954-aa6b-da39eef37453_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_e20733e42125379045884128b05998e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df5a047-46b4-5954-aa6b-da39eef37453/1df5a047-46b4-5954-aa6b-da39eef37453_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/3b/3a3bf348bdfd19d55f55a17426f684f7/pa/RA69083_44dc0ec252df39cbab375530e3011c3f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Individual',
 'transmission': 'manual',
 'trim': 'Individual',
 'year': 2013}
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA69083%27 HTTP/1.1" 200 None
2026-03-30 10:38:25 [auto1.de] INFO: Saving data for RA69083: {'created_time': 1774867105.704848, 'last_price_update_time': 1774867105.70486, 'auction_closing_time': 1774972134.0}
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA69083') HTTP/1.1" 204 0
2026-03-30 10:38:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef6d50>
2026-03-30 10:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_92ca2e6f9627a2c5bf6ffd363c3b60e1.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_92ca2e6f9627a2c5bf6ffd363c3b60e1.jpg saved to cache
2026-03-30 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 835978c0-86bf-523b-af8f-bdd0bfde3491
2026-03-30 10:38:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefb6690>
2026-03-30 10:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_47461695c63c20b3df5e3e349fb96ec2.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_47461695c63c20b3df5e3e349fb96ec2.jpg saved to cache
2026-03-30 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 835978c0-86bf-523b-af8f-bdd0bfde3491
2026-03-30 10:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_d57104bf47e7851551644b1b5d0e2a7a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c03390>
2026-03-30 10:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_d57104bf47e7851551644b1b5d0e2a7a.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_d57104bf47e7851551644b1b5d0e2a7a.jpg saved to cache
2026-03-30 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 835978c0-86bf-523b-af8f-bdd0bfde3491
2026-03-30 10:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_878e1d64fd189db3be26f2059c8b07b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_b429b221f5849b62b8e3a13374ed87d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef4210>
2026-03-30 10:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_878e1d64fd189db3be26f2059c8b07b2.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_878e1d64fd189db3be26f2059c8b07b2.jpg saved to cache
2026-03-30 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 835978c0-86bf-523b-af8f-bdd0bfde3491
2026-03-30 10:38:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee877d0>
2026-03-30 10:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_b429b221f5849b62b8e3a13374ed87d0.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_b429b221f5849b62b8e3a13374ed87d0.jpg saved to cache
2026-03-30 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 835978c0-86bf-523b-af8f-bdd0bfde3491
2026-03-30 10:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN03804> (referer: https://www.auto1.com/v1/car-details-view/BN03804/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HD00097/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d with identifier: BN03804
2026-03-30 10:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d with scrape type 1
2026-03-30 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_2e49501bbfc9fdee93e4556f9bfeefb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_2e49501bbfc9fdee93e4556f9bfeefb0.jpg not downloaded yet
2026-03-30 10:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_41f40b498a03984b172302c982541695.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_41bdc514fbcd80414a4090240f4a0fa3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_41bdc514fbcd80414a4090240f4a0fa3.jpg not downloaded yet
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_704b87388df0682a930825dd7a049364.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_704b87388df0682a930825dd7a049364.jpg not downloaded yet
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_93d60c1324db8cd823680957a0672ce9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_93d60c1324db8cd823680957a0672ce9.jpg not downloaded yet
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_0aa330022a80765f031cffb2bd9c9fae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_0aa330022a80765f031cffb2bd9c9fae.jpg not downloaded yet
2026-03-30 10:38:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef5b10>
2026-03-30 10:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_41f40b498a03984b172302c982541695.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_41f40b498a03984b172302c982541695.jpg saved to cache
2026-03-30 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 835978c0-86bf-523b-af8f-bdd0bfde3491
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_9ba7a55602b8721ca67dbd4b58c68f16.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_9ba7a55602b8721ca67dbd4b58c68f16.jpg not downloaded yet
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_081b3b8c91bdf57b712a3728582fe167.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_081b3b8c91bdf57b712a3728582fe167.jpg not downloaded yet
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_7e868a1e45eaed10fc525df5ca88ed2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_7e868a1e45eaed10fc525df5ca88ed2b.jpg not downloaded yet
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_ea10951001e9662f81499c9b2e1db8a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_ea10951001e9662f81499c9b2e1db8a7.jpg not downloaded yet
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_393eab954290f662567f09a71bfdea27.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_393eab954290f662567f09a71bfdea27.jpg not downloaded yet
2026-03-30 10:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_6db9ddc9a63dbca65dcf3785063fc37b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_35e8b3ffe0df04864af1d27a024804dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_2e49501bbfc9fdee93e4556f9bfeefb0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefb72d0>
2026-03-30 10:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_6db9ddc9a63dbca65dcf3785063fc37b.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_6db9ddc9a63dbca65dcf3785063fc37b.jpg saved to cache
2026-03-30 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 835978c0-86bf-523b-af8f-bdd0bfde3491
2026-03-30 10:38:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd4750>
2026-03-30 10:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F62%252F2d62a3fba9977a26d8d7d461fd957eba%252Fpa%252FGB07030_35e8b3ffe0df04864af1d27a024804dd.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_35e8b3ffe0df04864af1d27a024804dd.jpg saved to cache
2026-03-30 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 835978c0-86bf-523b-af8f-bdd0bfde3491
2026-03-30 10:38:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 835978c0-86bf-523b-af8f-bdd0bfde3491, skipping ID generation
2026-03-30 10:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 835978c0-86bf-523b-af8f-bdd0bfde3491 with scrape type 1
2026-03-30 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 835978c0-86bf-523b-af8f-bdd0bfde3491 sending to next pipeline
2026-03-30 10:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 835978c0-86bf-523b-af8f-bdd0bfde3491, identifier: GB07030
2026-03-30 10:38:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef70510>
2026-03-30 10:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_2e49501bbfc9fdee93e4556f9bfeefb0.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_2e49501bbfc9fdee93e4556f9bfeefb0.jpg saved to cache
2026-03-30 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d
2026-03-30 10:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 835978c0-86bf-523b-af8f-bdd0bfde3491 with identifier: GB07030
2026-03-30 10:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 835978c0-86bf-523b-af8f-bdd0bfde3491 with identifier: GB07030
2026-03-30 10:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 835978c0-86bf-523b-af8f-bdd0bfde3491 with identifier: GB07030 to the API
2026-03-30 10:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_35e8b3ffe0df04864af1d27a024804dd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:03:45Z',
 'fuel_type': 'petrol',
 'id': '835978c0-86bf-523b-af8f-bdd0bfde3491',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB07030',
 'listing': 'auction',
 'location': 'DE, Böblingen',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 187568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2977453,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_6db9ddc9a63dbca65dcf3785063fc37b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2980489,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_35e8b3ffe0df04864af1d27a024804dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2963086,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_1b7ce5af3574fce72f21b85a98415ba2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2891014,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_41f40b498a03984b172302c982541695.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2810576,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_878e1d64fd189db3be26f2059c8b07b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2971580,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_b429b221f5849b62b8e3a13374ed87d0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2754589,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_d57104bf47e7851551644b1b5d0e2a7a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3047112,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_47461695c63c20b3df5e3e349fb96ec2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2807466,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_92ca2e6f9627a2c5bf6ffd363c3b60e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835978c0-86bf-523b-af8f-bdd0bfde3491/835978c0-86bf-523b-af8f-bdd0bfde3491_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3263993,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/62/2d62a3fba9977a26d8d7d461fd957eba/pa/GB07030_b069818681e71a287c2327797b05db95.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 Style AWD',
 'transmission': 'manual',
 'trim': 'Style AWD',
 'year': 2011}
2026-03-30 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB07030%27 HTTP/1.1" 200 None
2026-03-30 10:38:28 [auto1.de] INFO: Saving data for GB07030: {'created_time': 1774867108.24769, 'last_price_update_time': 1774867108.247701, 'auction_closing_time': 1774969425.0}
2026-03-30 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB07030') HTTP/1.1" 204 0
2026-03-30 10:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_393eab954290f662567f09a71bfdea27.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef73910>
2026-03-30 10:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_393eab954290f662567f09a71bfdea27.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_393eab954290f662567f09a71bfdea27.jpg saved to cache
2026-03-30 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d
2026-03-30 10:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_ea10951001e9662f81499c9b2e1db8a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_7e868a1e45eaed10fc525df5ca88ed2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_081b3b8c91bdf57b712a3728582fe167.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef5350>
2026-03-30 10:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_ea10951001e9662f81499c9b2e1db8a7.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_ea10951001e9662f81499c9b2e1db8a7.jpg saved to cache
2026-03-30 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d
2026-03-30 10:38:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee443d50>
2026-03-30 10:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_7e868a1e45eaed10fc525df5ca88ed2b.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_7e868a1e45eaed10fc525df5ca88ed2b.jpg saved to cache
2026-03-30 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d
2026-03-30 10:38:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee54490>
2026-03-30 10:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_081b3b8c91bdf57b712a3728582fe167.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_081b3b8c91bdf57b712a3728582fe167.jpg saved to cache
2026-03-30 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d
2026-03-30 10:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HR51580/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_9ba7a55602b8721ca67dbd4b58c68f16.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_0aa330022a80765f031cffb2bd9c9fae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef45b90>
2026-03-30 10:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_9ba7a55602b8721ca67dbd4b58c68f16.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_9ba7a55602b8721ca67dbd4b58c68f16.jpg saved to cache
2026-03-30 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d
2026-03-30 10:38:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef77390>
2026-03-30 10:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_0aa330022a80765f031cffb2bd9c9fae.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_0aa330022a80765f031cffb2bd9c9fae.jpg saved to cache
2026-03-30 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d
2026-03-30 10:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_704b87388df0682a930825dd7a049364.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_93d60c1324db8cd823680957a0672ce9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f433e910>
2026-03-30 10:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_704b87388df0682a930825dd7a049364.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_704b87388df0682a930825dd7a049364.jpg saved to cache
2026-03-30 10:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d
2026-03-30 10:38:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef77690>
2026-03-30 10:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_93d60c1324db8cd823680957a0672ce9.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_93d60c1324db8cd823680957a0672ce9.jpg saved to cache
2026-03-30 10:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d
2026-03-30 10:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_41bdc514fbcd80414a4090240f4a0fa3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SK87421/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41fd050>
2026-03-30 10:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa7%252Ff1a752271bd3a4d5ce8dc39f4ed06f03%252Fpa%252FBN03804_41bdc514fbcd80414a4090240f4a0fa3.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_41bdc514fbcd80414a4090240f4a0fa3.jpg saved to cache
2026-03-30 10:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d
2026-03-30 10:38:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d, skipping ID generation
2026-03-30 10:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d with scrape type 1
2026-03-30 10:38:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d sending to next pipeline
2026-03-30 10:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d, identifier: BN03804
2026-03-30 10:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d with identifier: BN03804
2026-03-30 10:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d with identifier: BN03804
2026-03-30 10:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d with identifier: BN03804 to the API
2026-03-30 10:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_41bdc514fbcd80414a4090240f4a0fa3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:05:11Z',
 'fuel_type': 'petrol',
 'id': '8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN03804',
 'listing': 'auction',
 'location': 'DE, Kaiserslautern',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 60480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3236802,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_2e49501bbfc9fdee93e4556f9bfeefb0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3202942,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_41bdc514fbcd80414a4090240f4a0fa3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3261908,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_704b87388df0682a930825dd7a049364.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3114458,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_93d60c1324db8cd823680957a0672ce9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2820116,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_0aa330022a80765f031cffb2bd9c9fae.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3129417,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_9ba7a55602b8721ca67dbd4b58c68f16.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2977503,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_081b3b8c91bdf57b712a3728582fe167.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3232615,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_7e868a1e45eaed10fc525df5ca88ed2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3162040,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_ea10951001e9662f81499c9b2e1db8a7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d/8110d5c8-a7a1-5a7d-8b00-bc30b3e66e4d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3188707,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a7/f1a752271bd3a4d5ce8dc39f4ed06f03/pa/BN03804_393eab954290f662567f09a71bfdea27.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2014}
2026-03-30 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN03804%27 HTTP/1.1" 200 None
2026-03-30 10:38:31 [auto1.de] INFO: Saving data for BN03804: {'created_time': 1774867111.158593, 'last_price_update_time': 1774867111.158606, 'auction_closing_time': 1774969511.0}
2026-03-30 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN03804') HTTP/1.1" 204 0
2026-03-30 10:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD18794> (referer: https://www.auto1.com/v1/car-details-view/KD18794/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b34e2845-5567-540c-9e19-1356d8ef5629 with identifier: KD18794
2026-03-30 10:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b34e2845-5567-540c-9e19-1356d8ef5629 with scrape type 1
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_0df8764f0d4e192a0171a510c4a94513.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_0df8764f0d4e192a0171a510c4a94513.jpg not downloaded yet
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_374aaa781bb2ae09b7c1fa6899d1e257.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_374aaa781bb2ae09b7c1fa6899d1e257.jpg not downloaded yet
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_8552c193036ef200cbfb167e957deca4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_8552c193036ef200cbfb167e957deca4.jpg not downloaded yet
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_ec813eb6182b70bf22037ed1ed5aac13.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_ec813eb6182b70bf22037ed1ed5aac13.jpg not downloaded yet
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_97c3abe6a5dd2e512ca887796f2974ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_97c3abe6a5dd2e512ca887796f2974ad.jpg not downloaded yet
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_9092872112c6696f1a27d22584d623b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_9092872112c6696f1a27d22584d623b8.jpg not downloaded yet
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_a2a0264e8ec783e4a9752038d857c89b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_a2a0264e8ec783e4a9752038d857c89b.jpg not downloaded yet
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_9c3493cccebb0c1d142bbf0fba1f4496.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_9c3493cccebb0c1d142bbf0fba1f4496.jpg not downloaded yet
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_ba8583810dca3287396faac47c3da013.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_ba8583810dca3287396faac47c3da013.jpg not downloaded yet
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_b3092d220c8419996681ce5e9dff73cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_b3092d220c8419996681ce5e9dff73cf.jpg not downloaded yet
2026-03-30 10:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE37921> (referer: https://www.auto1.com/v1/car-details-view/BE37921/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_b3092d220c8419996681ce5e9dff73cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68e6814c-0f4c-5af0-a7c1-2026b69bf7da with identifier: BE37921
2026-03-30 10:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68e6814c-0f4c-5af0-a7c1-2026b69bf7da with scrape type 1
2026-03-30 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68e6814c-0f4c-5af0-a7c1-2026b69bf7da
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fcb%252F32cb5e8a2448def6681d081a8b91a62c%252Fpa%252FBE37921_5bd9f22670ead3b811cb1b6d94241268.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_5bd9f22670ead3b811cb1b6d94241268.jpg already downloaded
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fcb%252F32cb5e8a2448def6681d081a8b91a62c%252Fpa%252FBE37921_1cc5c9d3d8922f2f02dc43f885a4b8f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_1cc5c9d3d8922f2f02dc43f885a4b8f6.jpg already downloaded
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fcb%252F32cb5e8a2448def6681d081a8b91a62c%252Fpa%252FBE37921_8b46e54373cee77b99b0a65e3e874d2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_8b46e54373cee77b99b0a65e3e874d2b.jpg already downloaded
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fcb%252F32cb5e8a2448def6681d081a8b91a62c%252Fpa%252FBE37921_10fe408677bbd5a07e953ed8b00f7020.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_10fe408677bbd5a07e953ed8b00f7020.jpg already downloaded
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fcb%252F32cb5e8a2448def6681d081a8b91a62c%252Fpa%252FBE37921_9c49d2147668ed725fbed94147058208.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_9c49d2147668ed725fbed94147058208.jpg already downloaded
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fcb%252F32cb5e8a2448def6681d081a8b91a62c%252Fpa%252FBE37921_28ad6b72c018fa5fe120b58e8bf23c18.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_28ad6b72c018fa5fe120b58e8bf23c18.jpg already downloaded
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fcb%252F32cb5e8a2448def6681d081a8b91a62c%252Fpa%252FBE37921_11749d84acb321db41f34d2c64016483.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_11749d84acb321db41f34d2c64016483.jpg already downloaded
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fcb%252F32cb5e8a2448def6681d081a8b91a62c%252Fpa%252FBE37921_c2ba4a94660801a95f4712d29934e89f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_c2ba4a94660801a95f4712d29934e89f.jpg already downloaded
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fcb%252F32cb5e8a2448def6681d081a8b91a62c%252Fpa%252FBE37921_d856fee52fcbae3b4f4a8b248ea5472a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_d856fee52fcbae3b4f4a8b248ea5472a.jpg already downloaded
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fcb%252F32cb5e8a2448def6681d081a8b91a62c%252Fpa%252FBE37921_7ff706eaced3f1966206994b061d39db.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_7ff706eaced3f1966206994b061d39db.jpg already downloaded
2026-03-30 10:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68e6814c-0f4c-5af0-a7c1-2026b69bf7da, identifier: BE37921
2026-03-30 10:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68e6814c-0f4c-5af0-a7c1-2026b69bf7da with identifier: BE37921
2026-03-30 10:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68e6814c-0f4c-5af0-a7c1-2026b69bf7da with identifier: BE37921
2026-03-30 10:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68e6814c-0f4c-5af0-a7c1-2026b69bf7da with identifier: BE37921 to the API
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BE37921>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:08:27Z',
 'fuel_type': 'petrol',
 'id': '68e6814c-0f4c-5af0-a7c1-2026b69bf7da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE37921',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 96777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_5bd9f22670ead3b811cb1b6d94241268.jpg',
                'https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_1cc5c9d3d8922f2f02dc43f885a4b8f6.jpg',
                'https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_8b46e54373cee77b99b0a65e3e874d2b.jpg',
                'https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_10fe408677bbd5a07e953ed8b00f7020.jpg',
                'https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_9c49d2147668ed725fbed94147058208.jpg',
                'https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_28ad6b72c018fa5fe120b58e8bf23c18.jpg',
                'https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_11749d84acb321db41f34d2c64016483.jpg',
                'https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_c2ba4a94660801a95f4712d29934e89f.jpg',
                'https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_d856fee52fcbae3b4f4a8b248ea5472a.jpg',
                'https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_7ff706eaced3f1966206994b061d39db.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68e6814c-0f4c-5af0-a7c1-2026b69bf7da/68e6814c-0f4c-5af0-a7c1-2026b69bf7da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_5bd9f22670ead3b811cb1b6d94241268.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68e6814c-0f4c-5af0-a7c1-2026b69bf7da/68e6814c-0f4c-5af0-a7c1-2026b69bf7da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_1cc5c9d3d8922f2f02dc43f885a4b8f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68e6814c-0f4c-5af0-a7c1-2026b69bf7da/68e6814c-0f4c-5af0-a7c1-2026b69bf7da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_8b46e54373cee77b99b0a65e3e874d2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68e6814c-0f4c-5af0-a7c1-2026b69bf7da/68e6814c-0f4c-5af0-a7c1-2026b69bf7da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_10fe408677bbd5a07e953ed8b00f7020.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68e6814c-0f4c-5af0-a7c1-2026b69bf7da/68e6814c-0f4c-5af0-a7c1-2026b69bf7da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_9c49d2147668ed725fbed94147058208.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68e6814c-0f4c-5af0-a7c1-2026b69bf7da/68e6814c-0f4c-5af0-a7c1-2026b69bf7da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_28ad6b72c018fa5fe120b58e8bf23c18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68e6814c-0f4c-5af0-a7c1-2026b69bf7da/68e6814c-0f4c-5af0-a7c1-2026b69bf7da_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_11749d84acb321db41f34d2c64016483.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68e6814c-0f4c-5af0-a7c1-2026b69bf7da/68e6814c-0f4c-5af0-a7c1-2026b69bf7da_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_c2ba4a94660801a95f4712d29934e89f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68e6814c-0f4c-5af0-a7c1-2026b69bf7da/68e6814c-0f4c-5af0-a7c1-2026b69bf7da_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_d856fee52fcbae3b4f4a8b248ea5472a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68e6814c-0f4c-5af0-a7c1-2026b69bf7da/68e6814c-0f4c-5af0-a7c1-2026b69bf7da_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/cb/32cb5e8a2448def6681d081a8b91a62c/pa/BE37921_7ff706eaced3f1966206994b061d39db.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.4 M-Air Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2015}
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE37921%27 HTTP/1.1" 200 None
2026-03-30 10:38:34 [auto1.de] INFO: Saving data for BE37921: {'created_time': 1774867114.591837, 'last_price_update_time': 1774867114.591848, 'auction_closing_time': 1774969707.0}
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE37921') HTTP/1.1" 204 0
2026-03-30 10:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_ba8583810dca3287396faac47c3da013.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CF13358> (referer: https://www.auto1.com/v1/car-details-view/CF13358/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef75090>
2026-03-30 10:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_b3092d220c8419996681ce5e9dff73cf.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_b3092d220c8419996681ce5e9dff73cf.jpg saved to cache
2026-03-30 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-30 10:38:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419c5d0>
2026-03-30 10:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_ba8583810dca3287396faac47c3da013.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_ba8583810dca3287396faac47c3da013.jpg saved to cache
2026-03-30 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-30 10:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e55ab0ea-5bf1-5af8-979e-c9f7951bda27 with identifier: CF13358
2026-03-30 10:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e55ab0ea-5bf1-5af8-979e-c9f7951bda27 with scrape type 1
2026-03-30 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e55ab0ea-5bf1-5af8-979e-c9f7951bda27
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fba%252Fb0ba3ef2a7fd8cbc9aadf3b676090683%252Fpa%252FCF13358_0d6aef4f6a0061ae2381ecf7e95920e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/ba/b0ba3ef2a7fd8cbc9aadf3b676090683/pa/CF13358_0d6aef4f6a0061ae2381ecf7e95920e8.jpg already downloaded
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fba%252Fb0ba3ef2a7fd8cbc9aadf3b676090683%252Fpa%252FCF13358_5f8abf09c97cdb7b13bddc75337a3ceb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/ba/b0ba3ef2a7fd8cbc9aadf3b676090683/pa/CF13358_5f8abf09c97cdb7b13bddc75337a3ceb.jpg already downloaded
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fba%252Fb0ba3ef2a7fd8cbc9aadf3b676090683%252Fpa%252FCF13358_0106a08e0c7ff0b193a1843d870988bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/ba/b0ba3ef2a7fd8cbc9aadf3b676090683/pa/CF13358_0106a08e0c7ff0b193a1843d870988bc.jpg already downloaded
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fba%252Fb0ba3ef2a7fd8cbc9aadf3b676090683%252Fpa%252FCF13358_dff3132ed4e757fd0ad83aa349eb7f46.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/ba/b0ba3ef2a7fd8cbc9aadf3b676090683/pa/CF13358_dff3132ed4e757fd0ad83aa349eb7f46.jpg already downloaded
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fba%252Fb0ba3ef2a7fd8cbc9aadf3b676090683%252Fpa%252FCF13358_17c35da09dfa964f72c024ad4dd25fde.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/ba/b0ba3ef2a7fd8cbc9aadf3b676090683/pa/CF13358_17c35da09dfa964f72c024ad4dd25fde.jpg already downloaded
2026-03-30 10:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e55ab0ea-5bf1-5af8-979e-c9f7951bda27, identifier: CF13358
2026-03-30 10:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e55ab0ea-5bf1-5af8-979e-c9f7951bda27 with identifier: CF13358
2026-03-30 10:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e55ab0ea-5bf1-5af8-979e-c9f7951bda27 with identifier: CF13358
2026-03-30 10:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e55ab0ea-5bf1-5af8-979e-c9f7951bda27 with identifier: CF13358 to the API
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CF13358>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:08:33Z',
 'fuel_type': 'petrol',
 'id': 'e55ab0ea-5bf1-5af8-979e-c9f7951bda27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF13358',
 'listing': 'auction',
 'location': 'DE, Fockbek',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 101144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgb0/ba/b0ba3ef2a7fd8cbc9aadf3b676090683/pa/CF13358_0d6aef4f6a0061ae2381ecf7e95920e8.jpg',
                'https://img-pa.auto1.com/imgb0/ba/b0ba3ef2a7fd8cbc9aadf3b676090683/pa/CF13358_5f8abf09c97cdb7b13bddc75337a3ceb.jpg',
                'https://img-pa.auto1.com/imgb0/ba/b0ba3ef2a7fd8cbc9aadf3b676090683/pa/CF13358_0106a08e0c7ff0b193a1843d870988bc.jpg',
                'https://img-pa.auto1.com/imgb0/ba/b0ba3ef2a7fd8cbc9aadf3b676090683/pa/CF13358_dff3132ed4e757fd0ad83aa349eb7f46.jpg',
                'https://img-pa.auto1.com/imgb0/ba/b0ba3ef2a7fd8cbc9aadf3b676090683/pa/CF13358_17c35da09dfa964f72c024ad4dd25fde.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55ab0ea-5bf1-5af8-979e-c9f7951bda27/e55ab0ea-5bf1-5af8-979e-c9f7951bda27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/ba/b0ba3ef2a7fd8cbc9aadf3b676090683/pa/CF13358_0d6aef4f6a0061ae2381ecf7e95920e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55ab0ea-5bf1-5af8-979e-c9f7951bda27/e55ab0ea-5bf1-5af8-979e-c9f7951bda27_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/ba/b0ba3ef2a7fd8cbc9aadf3b676090683/pa/CF13358_5f8abf09c97cdb7b13bddc75337a3ceb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55ab0ea-5bf1-5af8-979e-c9f7951bda27/e55ab0ea-5bf1-5af8-979e-c9f7951bda27_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/ba/b0ba3ef2a7fd8cbc9aadf3b676090683/pa/CF13358_0106a08e0c7ff0b193a1843d870988bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55ab0ea-5bf1-5af8-979e-c9f7951bda27/e55ab0ea-5bf1-5af8-979e-c9f7951bda27_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/ba/b0ba3ef2a7fd8cbc9aadf3b676090683/pa/CF13358_dff3132ed4e757fd0ad83aa349eb7f46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55ab0ea-5bf1-5af8-979e-c9f7951bda27/e55ab0ea-5bf1-5af8-979e-c9f7951bda27_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/ba/b0ba3ef2a7fd8cbc9aadf3b676090683/pa/CF13358_17c35da09dfa964f72c024ad4dd25fde.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-10-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.6 Stepway II',
 'transmission': 'manual',
 'trim': 'Stepway II',
 'year': 2012}
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF13358%27 HTTP/1.1" 200 None
2026-03-30 10:38:35 [auto1.de] INFO: Saving data for CF13358: {'created_time': 1774867115.321506, 'last_price_update_time': 1774867115.321516, 'auction_closing_time': 1774969713.0}
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF13358') HTTP/1.1" 204 0
2026-03-30 10:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_9c3493cccebb0c1d142bbf0fba1f4496.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_a2a0264e8ec783e4a9752038d857c89b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_9092872112c6696f1a27d22584d623b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_97c3abe6a5dd2e512ca887796f2974ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee84790>
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_9c3493cccebb0c1d142bbf0fba1f4496.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_9c3493cccebb0c1d142bbf0fba1f4496.jpg saved to cache
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e95d0>
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_a2a0264e8ec783e4a9752038d857c89b.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_a2a0264e8ec783e4a9752038d857c89b.jpg saved to cache
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-30 10:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_8552c193036ef200cbfb167e957deca4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_ec813eb6182b70bf22037ed1ed5aac13.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4409d0>
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_9092872112c6696f1a27d22584d623b8.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_9092872112c6696f1a27d22584d623b8.jpg saved to cache
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c01a50>
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_97c3abe6a5dd2e512ca887796f2974ad.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_97c3abe6a5dd2e512ca887796f2974ad.jpg saved to cache
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-30 10:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG72078> (referer: https://www.auto1.com/v1/car-details-view/NG72078/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f427b010>
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_8552c193036ef200cbfb167e957deca4.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_8552c193036ef200cbfb167e957deca4.jpg saved to cache
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f433a010>
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_ec813eb6182b70bf22037ed1ed5aac13.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_ec813eb6182b70bf22037ed1ed5aac13.jpg saved to cache
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-30 10:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_374aaa781bb2ae09b7c1fa6899d1e257.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bdfb13c-5990-5f94-8f4b-163154b2857f with identifier: NG72078
2026-03-30 10:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bdfb13c-5990-5f94-8f4b-163154b2857f with scrape type 1
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4bdfb13c-5990-5f94-8f4b-163154b2857f
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_b667168a983ffc5137054e5aeb454d20.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_b667168a983ffc5137054e5aeb454d20.jpg not downloaded yet
2026-03-30 10:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_0df8764f0d4e192a0171a510c4a94513.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_92e4cf464bd6ceb7b365bb171213032c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_92e4cf464bd6ceb7b365bb171213032c.jpg not downloaded yet
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_3562d824b682be2cdec29b27a0768534.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_3562d824b682be2cdec29b27a0768534.jpg not downloaded yet
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_e2b65e3c6332a14ebdd0c405fe717772.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_e2b65e3c6332a14ebdd0c405fe717772.jpg not downloaded yet
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_62a51a6d4123a199c33bc91294b8b315.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_62a51a6d4123a199c33bc91294b8b315.jpg not downloaded yet
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4194f90>
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_374aaa781bb2ae09b7c1fa6899d1e257.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_374aaa781bb2ae09b7c1fa6899d1e257.jpg saved to cache
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_f072825d464ab3bfcf3d3198db76eead.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_f072825d464ab3bfcf3d3198db76eead.jpg not downloaded yet
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414f390>
2026-03-30 10:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Faf%252Fc9afc644e3d65edd0e22ce60c9b3d92e%252Fpa%252FKD18794_0df8764f0d4e192a0171a510c4a94513.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_0df8764f0d4e192a0171a510c4a94513.jpg saved to cache
2026-03-30 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-30 10:38:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b34e2845-5567-540c-9e19-1356d8ef5629, skipping ID generation
2026-03-30 10:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b34e2845-5567-540c-9e19-1356d8ef5629 with scrape type 1
2026-03-30 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b34e2845-5567-540c-9e19-1356d8ef5629 sending to next pipeline
2026-03-30 10:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b34e2845-5567-540c-9e19-1356d8ef5629, identifier: KD18794
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_87d6d2a55c037e9039eae20a1a36c203.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_87d6d2a55c037e9039eae20a1a36c203.jpg not downloaded yet
2026-03-30 10:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b34e2845-5567-540c-9e19-1356d8ef5629 with identifier: KD18794
2026-03-30 10:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b34e2845-5567-540c-9e19-1356d8ef5629 with identifier: KD18794
2026-03-30 10:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b34e2845-5567-540c-9e19-1356d8ef5629 with identifier: KD18794 to the API
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_0df8764f0d4e192a0171a510c4a94513.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:22:12Z',
 'fuel_type': 'electro',
 'id': 'b34e2845-5567-540c-9e19-1356d8ef5629',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD18794',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 11,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_0df8764f0d4e192a0171a510c4a94513.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_374aaa781bb2ae09b7c1fa6899d1e257.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_8552c193036ef200cbfb167e957deca4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_ec813eb6182b70bf22037ed1ed5aac13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_97c3abe6a5dd2e512ca887796f2974ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_9092872112c6696f1a27d22584d623b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_a2a0264e8ec783e4a9752038d857c89b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_9c3493cccebb0c1d142bbf0fba1f4496.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_ba8583810dca3287396faac47c3da013.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/af/c9afc644e3d65edd0e22ce60c9b3d92e/pa/KD18794_b3092d220c8419996681ce5e9dff73cf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-12-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD18794%27 HTTP/1.1" 200 None
2026-03-30 10:38:36 [auto1.de] INFO: Saving data for KD18794: {'created_time': 1774867116.512015, 'last_price_update_time': 1774867116.512031, 'auction_closing_time': 1774970532.0}
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD18794') HTTP/1.1" 204 0
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_ba4369490a0c9ab3cb86b547844ce674.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_ba4369490a0c9ab3cb86b547844ce674.jpg not downloaded yet
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_f2619bdc674cab44c12f07e221646fa3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_f2619bdc674cab44c12f07e221646fa3.jpg not downloaded yet
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_c235e1fac6b851b7139bdba3d9766d32.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_c235e1fac6b851b7139bdba3d9766d32.jpg not downloaded yet
2026-03-30 10:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_b667168a983ffc5137054e5aeb454d20.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb3650>
2026-03-30 10:38:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_b667168a983ffc5137054e5aeb454d20.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_b667168a983ffc5137054e5aeb454d20.jpg saved to cache
2026-03-30 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4bdfb13c-5990-5f94-8f4b-163154b2857f
2026-03-30 10:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TH79589> (referer: https://www.auto1.com/v1/car-details-view/TH79589/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK25155> (referer: https://www.auto1.com/v1/car-details-view/EK25155/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_c235e1fac6b851b7139bdba3d9766d32.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62eaf1f0-9076-57d3-9c16-14aa07452a40 with identifier: TH79589
2026-03-30 10:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62eaf1f0-9076-57d3-9c16-14aa07452a40 with scrape type 1
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 62eaf1f0-9076-57d3-9c16-14aa07452a40
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_9a202d6a61acf2bfe5669a82f23d5ba0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_9a202d6a61acf2bfe5669a82f23d5ba0.jpg not downloaded yet
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_8b1f12906953f91b90943845629b7336.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_8b1f12906953f91b90943845629b7336.jpg not downloaded yet
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_7cdd8524507038f69920e5ef29929108.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_7cdd8524507038f69920e5ef29929108.jpg not downloaded yet
2026-03-30 10:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e81ba5a5-eca6-59bd-8f11-cfe2643e9512 with identifier: EK25155
2026-03-30 10:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e81ba5a5-eca6-59bd-8f11-cfe2643e9512 with scrape type 1
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e81ba5a5-eca6-59bd-8f11-cfe2643e9512
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F4f%252F044fcf84aea9a92603dc6b58d04d63a6%252Fpa%252FEK25155_d3ac5fc524f91191c20f2cfef8cd35e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_d3ac5fc524f91191c20f2cfef8cd35e6.jpg not downloaded yet
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_3bdc4ebc877f8a473a3f95e5451ba228.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_3bdc4ebc877f8a473a3f95e5451ba228.jpg not downloaded yet
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F4f%252F044fcf84aea9a92603dc6b58d04d63a6%252Fpa%252FEK25155_35bc8143b25551f610d87565b8f73a2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_35bc8143b25551f610d87565b8f73a2f.jpg not downloaded yet
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_6e9841119e7e8c661f8e862025bb185c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_6e9841119e7e8c661f8e862025bb185c.jpg not downloaded yet
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F4f%252F044fcf84aea9a92603dc6b58d04d63a6%252Fpa%252FEK25155_d2a721977f3b7671e0cc42a36c139f5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_d2a721977f3b7671e0cc42a36c139f5d.jpg not downloaded yet
2026-03-30 10:38:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee71ad0>
2026-03-30 10:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_c235e1fac6b851b7139bdba3d9766d32.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_c235e1fac6b851b7139bdba3d9766d32.jpg saved to cache
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4bdfb13c-5990-5f94-8f4b-163154b2857f
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_44f56c5e2489fe1042f6144c41aa426f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_44f56c5e2489fe1042f6144c41aa426f.jpg not downloaded yet
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F4f%252F044fcf84aea9a92603dc6b58d04d63a6%252Fpa%252FEK25155_150250ee4e71134913c9fd79bb442c71.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_150250ee4e71134913c9fd79bb442c71.jpg not downloaded yet
2026-03-30 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DZ14257> (referer: https://www.auto1.com/v1/car-details-view/DZ14257/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_9c89a7ed9785cd174c93d4e32ae243de.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_9c89a7ed9785cd174c93d4e32ae243de.jpg not downloaded yet
2026-03-30 10:38:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F4f%252F044fcf84aea9a92603dc6b58d04d63a6%252Fpa%252FEK25155_84c7b73aa3e321642e6aedee1e2542a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_84c7b73aa3e321642e6aedee1e2542a5.jpg not downloaded yet
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_3f0868deafeb294c60ef8ffc4a013fec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_3f0868deafeb294c60ef8ffc4a013fec.jpg not downloaded yet
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_4d376c9ee51576cd943a6a077dfe76ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_4d376c9ee51576cd943a6a077dfe76ce.jpg not downloaded yet
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_7206f3ec1a016f0c51deef1c343a1b42.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_7206f3ec1a016f0c51deef1c343a1b42.jpg not downloaded yet
2026-03-30 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD42563> (referer: https://www.auto1.com/v1/car-details-view/UD42563/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03001415-09c4-5a56-b4a7-87d45355b620 with identifier: DZ14257
2026-03-30 10:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03001415-09c4-5a56-b4a7-87d45355b620 with scrape type 1
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 03001415-09c4-5a56-b4a7-87d45355b620
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F95%252F9d958fb5caf7b66c191364aa5b3d9771%252Fpa%252FDZ14257_21bcf4b120ab3d97d02dda6f35f6f002.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_21bcf4b120ab3d97d02dda6f35f6f002.jpg not downloaded yet
2026-03-30 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_44f56c5e2489fe1042f6144c41aa426f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F95%252F9d958fb5caf7b66c191364aa5b3d9771%252Fpa%252FDZ14257_ceb1c18c07500fbdfb1d18bf1ba3396c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_ceb1c18c07500fbdfb1d18bf1ba3396c.jpg not downloaded yet
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F95%252F9d958fb5caf7b66c191364aa5b3d9771%252Fpa%252FDZ14257_ad5d1debef4636afb064597113f6d023.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_ad5d1debef4636afb064597113f6d023.jpg not downloaded yet
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F95%252F9d958fb5caf7b66c191364aa5b3d9771%252Fpa%252FDZ14257_af7ab8937df18eff073b4b13c38f2d71.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_af7ab8937df18eff073b4b13c38f2d71.jpg not downloaded yet
2026-03-30 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_7206f3ec1a016f0c51deef1c343a1b42.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F95%252F9d958fb5caf7b66c191364aa5b3d9771%252Fpa%252FDZ14257_5d5f350ad39cf7d47ae2ea8cad86acb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_5d5f350ad39cf7d47ae2ea8cad86acb9.jpg not downloaded yet
2026-03-30 10:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18b75280-61c5-5b67-a07d-9a838a157f01 with identifier: UD42563
2026-03-30 10:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18b75280-61c5-5b67-a07d-9a838a157f01 with scrape type 1
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18b75280-61c5-5b67-a07d-9a838a157f01
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fdd%252F54dddc339add45fec2f003cf20a0f85e%252Fpa%252FUD42563_2f62f0629f65998fd0d2e2c207cd4703.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_2f62f0629f65998fd0d2e2c207cd4703.jpg already downloaded
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fdd%252F54dddc339add45fec2f003cf20a0f85e%252Fpa%252FUD42563_c1f045390ea35fd9d3f70fa3a43e1ca4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_c1f045390ea35fd9d3f70fa3a43e1ca4.jpg already downloaded
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fdd%252F54dddc339add45fec2f003cf20a0f85e%252Fpa%252FUD42563_1b5921b412d408fe9e36e558788eeeb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_1b5921b412d408fe9e36e558788eeeb2.jpg already downloaded
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fdd%252F54dddc339add45fec2f003cf20a0f85e%252Fpa%252FUD42563_eecc17ed9594092bef959db5216b5011.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_eecc17ed9594092bef959db5216b5011.jpg already downloaded
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fdd%252F54dddc339add45fec2f003cf20a0f85e%252Fpa%252FUD42563_bd86aaa78c153ec2ab88b29876235556.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_bd86aaa78c153ec2ab88b29876235556.jpg already downloaded
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fdd%252F54dddc339add45fec2f003cf20a0f85e%252Fpa%252FUD42563_be2516ab6f107c9fc47a92aa4d5c9eb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_be2516ab6f107c9fc47a92aa4d5c9eb7.jpg already downloaded
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fdd%252F54dddc339add45fec2f003cf20a0f85e%252Fpa%252FUD42563_6de49d4235feeef26f806ccce96d0aad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_6de49d4235feeef26f806ccce96d0aad.jpg already downloaded
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fdd%252F54dddc339add45fec2f003cf20a0f85e%252Fpa%252FUD42563_6f669eb34bc830972096508c82406e74.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_6f669eb34bc830972096508c82406e74.jpg already downloaded
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fdd%252F54dddc339add45fec2f003cf20a0f85e%252Fpa%252FUD42563_366c571f18f816e32ed17e62bc9d51fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_366c571f18f816e32ed17e62bc9d51fc.jpg already downloaded
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fdd%252F54dddc339add45fec2f003cf20a0f85e%252Fpa%252FUD42563_bfb0b2be0eb4aa9be8a6bb5507cafedd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_bfb0b2be0eb4aa9be8a6bb5507cafedd.jpg already downloaded
2026-03-30 10:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18b75280-61c5-5b67-a07d-9a838a157f01, identifier: UD42563
2026-03-30 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_f2619bdc674cab44c12f07e221646fa3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18b75280-61c5-5b67-a07d-9a838a157f01 with identifier: UD42563
2026-03-30 10:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18b75280-61c5-5b67-a07d-9a838a157f01 with identifier: UD42563
2026-03-30 10:38:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18b75280-61c5-5b67-a07d-9a838a157f01 with identifier: UD42563 to the API
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UD42563>
{'auction_title': '',
 'c_o_2_emission_value': 194,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:18:16Z',
 'fuel_type': 'petrol',
 'id': '18b75280-61c5-5b67-a07d-9a838a157f01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD42563',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 102050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_2f62f0629f65998fd0d2e2c207cd4703.jpg',
                'https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_c1f045390ea35fd9d3f70fa3a43e1ca4.jpg',
                'https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_1b5921b412d408fe9e36e558788eeeb2.jpg',
                'https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_eecc17ed9594092bef959db5216b5011.jpg',
                'https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_bd86aaa78c153ec2ab88b29876235556.jpg',
                'https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_be2516ab6f107c9fc47a92aa4d5c9eb7.jpg',
                'https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_6de49d4235feeef26f806ccce96d0aad.jpg',
                'https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_6f669eb34bc830972096508c82406e74.jpg',
                'https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_366c571f18f816e32ed17e62bc9d51fc.jpg',
                'https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_bfb0b2be0eb4aa9be8a6bb5507cafedd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b75280-61c5-5b67-a07d-9a838a157f01/18b75280-61c5-5b67-a07d-9a838a157f01_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_2f62f0629f65998fd0d2e2c207cd4703.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b75280-61c5-5b67-a07d-9a838a157f01/18b75280-61c5-5b67-a07d-9a838a157f01_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_c1f045390ea35fd9d3f70fa3a43e1ca4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b75280-61c5-5b67-a07d-9a838a157f01/18b75280-61c5-5b67-a07d-9a838a157f01_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_1b5921b412d408fe9e36e558788eeeb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b75280-61c5-5b67-a07d-9a838a157f01/18b75280-61c5-5b67-a07d-9a838a157f01_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2297984,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_eecc17ed9594092bef959db5216b5011.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b75280-61c5-5b67-a07d-9a838a157f01/18b75280-61c5-5b67-a07d-9a838a157f01_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_bd86aaa78c153ec2ab88b29876235556.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b75280-61c5-5b67-a07d-9a838a157f01/18b75280-61c5-5b67-a07d-9a838a157f01_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_be2516ab6f107c9fc47a92aa4d5c9eb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b75280-61c5-5b67-a07d-9a838a157f01/18b75280-61c5-5b67-a07d-9a838a157f01_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_6de49d4235feeef26f806ccce96d0aad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b75280-61c5-5b67-a07d-9a838a157f01/18b75280-61c5-5b67-a07d-9a838a157f01_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_6f669eb34bc830972096508c82406e74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b75280-61c5-5b67-a07d-9a838a157f01/18b75280-61c5-5b67-a07d-9a838a157f01_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_366c571f18f816e32ed17e62bc9d51fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b75280-61c5-5b67-a07d-9a838a157f01/18b75280-61c5-5b67-a07d-9a838a157f01_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2915285,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/dd/54dddc339add45fec2f003cf20a0f85e/pa/UD42563_bfb0b2be0eb4aa9be8a6bb5507cafedd.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TFSI / TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2006}
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD42563%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [auto1.de] INFO: Saving data for UD42563: {'created_time': 1774867118.242978, 'last_price_update_time': 1774867118.242988, 'auction_closing_time': 1774970296.0}
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD42563') HTTP/1.1" 204 0
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_21bcf4b120ab3d97d02dda6f35f6f002.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_af7ab8937df18eff073b4b13c38f2d71.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HD00097> (referer: https://www.auto1.com/v1/car-details-view/HD00097/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE55796/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9c8d0>
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_44f56c5e2489fe1042f6144c41aa426f.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_44f56c5e2489fe1042f6144c41aa426f.jpg saved to cache
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 62eaf1f0-9076-57d3-9c16-14aa07452a40
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419da90>
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_7206f3ec1a016f0c51deef1c343a1b42.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_7206f3ec1a016f0c51deef1c343a1b42.jpg saved to cache
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 62eaf1f0-9076-57d3-9c16-14aa07452a40
2026-03-30 10:38:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41fdc90>
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_f2619bdc674cab44c12f07e221646fa3.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_f2619bdc674cab44c12f07e221646fa3.jpg saved to cache
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4bdfb13c-5990-5f94-8f4b-163154b2857f
2026-03-30 10:38:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD73568/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HR51580> (referer: https://www.auto1.com/v1/car-details-view/HR51580/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee441290>
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03001415-09c4-5a56-b4a7-87d45355b620/03001415-09c4-5a56-b4a7-87d45355b620_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F95%252F9d958fb5caf7b66c191364aa5b3d9771%252Fpa%252FDZ14257_21bcf4b120ab3d97d02dda6f35f6f002.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_21bcf4b120ab3d97d02dda6f35f6f002.jpg saved to cache
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03001415-09c4-5a56-b4a7-87d45355b620
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7fe10>
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03001415-09c4-5a56-b4a7-87d45355b620/03001415-09c4-5a56-b4a7-87d45355b620_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F95%252F9d958fb5caf7b66c191364aa5b3d9771%252Fpa%252FDZ14257_af7ab8937df18eff073b4b13c38f2d71.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_af7ab8937df18eff073b4b13c38f2d71.jpg saved to cache
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03001415-09c4-5a56-b4a7-87d45355b620
2026-03-30 10:38:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e72f5750-f89a-5109-80b4-fa3bf2b61131 with identifier: HD00097
2026-03-30 10:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e72f5750-f89a-5109-80b4-fa3bf2b61131 with scrape type 1
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e72f5750-f89a-5109-80b4-fa3bf2b61131
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_d3f4223970df95d995c1808994e8667e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_d3f4223970df95d995c1808994e8667e.jpg not downloaded yet
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_5d5f350ad39cf7d47ae2ea8cad86acb9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_0f02ea944a38f9b9db4acc81a9d04350.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_0f02ea944a38f9b9db4acc81a9d04350.jpg not downloaded yet
2026-03-30 10:38:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_ceb1c18c07500fbdfb1d18bf1ba3396c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_4d376c9ee51576cd943a6a077dfe76ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_ad5d1debef4636afb064597113f6d023.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_ba4369490a0c9ab3cb86b547844ce674.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_3f0868deafeb294c60ef8ffc4a013fec.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_d5d773b5bf43ad26177cd1d41c9afefc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_d5d773b5bf43ad26177cd1d41c9afefc.jpg not downloaded yet
2026-03-30 10:38:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4420e236-ab7c-596e-93b6-09a8b21c2e93 with identifier: HR51580
2026-03-30 10:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4420e236-ab7c-596e-93b6-09a8b21c2e93 with scrape type 1
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4420e236-ab7c-596e-93b6-09a8b21c2e93
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb9%252F74b90de5ff9fa32ff0eea1f671bc3b1b%252Fpa%252FHR51580_68706b77423c96e69b505451a1275458.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_68706b77423c96e69b505451a1275458.jpg not downloaded yet
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_87d6d2a55c037e9039eae20a1a36c203.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_6fac81bda4d635a2a2b61cb0d07e723c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_6fac81bda4d635a2a2b61cb0d07e723c.jpg not downloaded yet
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb9%252F74b90de5ff9fa32ff0eea1f671bc3b1b%252Fpa%252FHR51580_7525934a21e3da1a84c393ddf65b8c88.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_7525934a21e3da1a84c393ddf65b8c88.jpg not downloaded yet
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_84c7b73aa3e321642e6aedee1e2542a5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_150250ee4e71134913c9fd79bb442c71.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_c71813c52d1f96f977cf895b070fde08.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_c71813c52d1f96f977cf895b070fde08.jpg not downloaded yet
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb9%252F74b90de5ff9fa32ff0eea1f671bc3b1b%252Fpa%252FHR51580_9efea75fe6c40a6fdad4d84969062d01.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_9efea75fe6c40a6fdad4d84969062d01.jpg not downloaded yet
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d7010>
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03001415-09c4-5a56-b4a7-87d45355b620/03001415-09c4-5a56-b4a7-87d45355b620_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F95%252F9d958fb5caf7b66c191364aa5b3d9771%252Fpa%252FDZ14257_5d5f350ad39cf7d47ae2ea8cad86acb9.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_5d5f350ad39cf7d47ae2ea8cad86acb9.jpg saved to cache
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 03001415-09c4-5a56-b4a7-87d45355b620
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_9c89a7ed9785cd174c93d4e32ae243de.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_d2a721977f3b7671e0cc42a36c139f5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_cc8519799276d54bfb0d2cb0b41093db.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_cc8519799276d54bfb0d2cb0b41093db.jpg not downloaded yet
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb9%252F74b90de5ff9fa32ff0eea1f671bc3b1b%252Fpa%252FHR51580_911ffb2e57286d65030b16e012f9bc87.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_911ffb2e57286d65030b16e012f9bc87.jpg not downloaded yet
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_6e9841119e7e8c661f8e862025bb185c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_11cad6f420ed1a07aef61ad3e6eec3b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_11cad6f420ed1a07aef61ad3e6eec3b8.jpg not downloaded yet
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb9%252F74b90de5ff9fa32ff0eea1f671bc3b1b%252Fpa%252FHR51580_de8dc9077333905149addad8f76e3618.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_de8dc9077333905149addad8f76e3618.jpg not downloaded yet
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f433c910>
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03001415-09c4-5a56-b4a7-87d45355b620/03001415-09c4-5a56-b4a7-87d45355b620_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F95%252F9d958fb5caf7b66c191364aa5b3d9771%252Fpa%252FDZ14257_ceb1c18c07500fbdfb1d18bf1ba3396c.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_ceb1c18c07500fbdfb1d18bf1ba3396c.jpg saved to cache
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03001415-09c4-5a56-b4a7-87d45355b620
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45b510>
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_4d376c9ee51576cd943a6a077dfe76ce.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_4d376c9ee51576cd943a6a077dfe76ce.jpg saved to cache
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 62eaf1f0-9076-57d3-9c16-14aa07452a40
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb1210>
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03001415-09c4-5a56-b4a7-87d45355b620/03001415-09c4-5a56-b4a7-87d45355b620_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F95%252F9d958fb5caf7b66c191364aa5b3d9771%252Fpa%252FDZ14257_ad5d1debef4636afb064597113f6d023.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_ad5d1debef4636afb064597113f6d023.jpg saved to cache
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03001415-09c4-5a56-b4a7-87d45355b620
2026-03-30 10:38:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03001415-09c4-5a56-b4a7-87d45355b620, skipping ID generation
2026-03-30 10:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03001415-09c4-5a56-b4a7-87d45355b620 with scrape type 1
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03001415-09c4-5a56-b4a7-87d45355b620 sending to next pipeline
2026-03-30 10:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03001415-09c4-5a56-b4a7-87d45355b620, identifier: DZ14257
2026-03-30 10:38:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4269490>
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_ba4369490a0c9ab3cb86b547844ce674.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_ba4369490a0c9ab3cb86b547844ce674.jpg saved to cache
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4bdfb13c-5990-5f94-8f4b-163154b2857f
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f47fbe10>
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_3f0868deafeb294c60ef8ffc4a013fec.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_3f0868deafeb294c60ef8ffc4a013fec.jpg saved to cache
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 62eaf1f0-9076-57d3-9c16-14aa07452a40
2026-03-30 10:38:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee44ca10>
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_87d6d2a55c037e9039eae20a1a36c203.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_87d6d2a55c037e9039eae20a1a36c203.jpg saved to cache
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4bdfb13c-5990-5f94-8f4b-163154b2857f
2026-03-30 10:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03001415-09c4-5a56-b4a7-87d45355b620 with identifier: DZ14257
2026-03-30 10:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03001415-09c4-5a56-b4a7-87d45355b620 with identifier: DZ14257
2026-03-30 10:38:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03001415-09c4-5a56-b4a7-87d45355b620 with identifier: DZ14257 to the API
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_ad5d1debef4636afb064597113f6d023.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:52:57Z',
 'fuel_type': 'diesel',
 'id': '03001415-09c4-5a56-b4a7-87d45355b620',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ14257',
 'listing': 'auction',
 'location': 'DE, Gießen',
 'make': 'BMW',
 'model': '1er',
 'odometer': 180772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03001415-09c4-5a56-b4a7-87d45355b620/03001415-09c4-5a56-b4a7-87d45355b620_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_21bcf4b120ab3d97d02dda6f35f6f002.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03001415-09c4-5a56-b4a7-87d45355b620/03001415-09c4-5a56-b4a7-87d45355b620_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_ceb1c18c07500fbdfb1d18bf1ba3396c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03001415-09c4-5a56-b4a7-87d45355b620/03001415-09c4-5a56-b4a7-87d45355b620_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_ad5d1debef4636afb064597113f6d023.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03001415-09c4-5a56-b4a7-87d45355b620/03001415-09c4-5a56-b4a7-87d45355b620_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_af7ab8937df18eff073b4b13c38f2d71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03001415-09c4-5a56-b4a7-87d45355b620/03001415-09c4-5a56-b4a7-87d45355b620_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/95/9d958fb5caf7b66c191364aa5b3d9771/pa/DZ14257_5d5f350ad39cf7d47ae2ea8cad86acb9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ14257%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [auto1.de] INFO: Saving data for DZ14257: {'created_time': 1774867120.367651, 'last_price_update_time': 1774867120.367662, 'auction_closing_time': 1774972377.0}
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ14257') HTTP/1.1" 204 0
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_80066d47657f3b10e333098b9b1f2526.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_80066d47657f3b10e333098b9b1f2526.jpg not downloaded yet
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c06c10>
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e81ba5a5-eca6-59bd-8f11-cfe2643e9512/e81ba5a5-eca6-59bd-8f11-cfe2643e9512_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F4f%252F044fcf84aea9a92603dc6b58d04d63a6%252Fpa%252FEK25155_84c7b73aa3e321642e6aedee1e2542a5.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_84c7b73aa3e321642e6aedee1e2542a5.jpg saved to cache
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e81ba5a5-eca6-59bd-8f11-cfe2643e9512
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f420ce50>
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e81ba5a5-eca6-59bd-8f11-cfe2643e9512/e81ba5a5-eca6-59bd-8f11-cfe2643e9512_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F4f%252F044fcf84aea9a92603dc6b58d04d63a6%252Fpa%252FEK25155_150250ee4e71134913c9fd79bb442c71.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_150250ee4e71134913c9fd79bb442c71.jpg saved to cache
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e81ba5a5-eca6-59bd-8f11-cfe2643e9512
2026-03-30 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB05879/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX41187/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP46996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV02833/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SK87421> (referer: https://www.auto1.com/v1/car-details-view/SK87421/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZX44823> (referer: https://www.auto1.com/v1/car-details-view/ZX44823/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_591bc061d4d48fac34dd42ca36434ff0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_591bc061d4d48fac34dd42ca36434ff0.jpg not downloaded yet
2026-03-30 10:38:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f420c950>
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_9c89a7ed9785cd174c93d4e32ae243de.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_9c89a7ed9785cd174c93d4e32ae243de.jpg saved to cache
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 62eaf1f0-9076-57d3-9c16-14aa07452a40
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4142bd0>
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e81ba5a5-eca6-59bd-8f11-cfe2643e9512/e81ba5a5-eca6-59bd-8f11-cfe2643e9512_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F4f%252F044fcf84aea9a92603dc6b58d04d63a6%252Fpa%252FEK25155_d2a721977f3b7671e0cc42a36c139f5d.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_d2a721977f3b7671e0cc42a36c139f5d.jpg saved to cache
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e81ba5a5-eca6-59bd-8f11-cfe2643e9512
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef7c4d0>
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_6e9841119e7e8c661f8e862025bb185c.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_6e9841119e7e8c661f8e862025bb185c.jpg saved to cache
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 62eaf1f0-9076-57d3-9c16-14aa07452a40
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_31c3a4437fbaddd442e8726b293bedc6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_31c3a4437fbaddd442e8726b293bedc6.jpg not downloaded yet
2026-03-30 10:38:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2d58ba2-bb37-528c-85f5-a9baafa392e4 with identifier: SK87421
2026-03-30 10:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2d58ba2-bb37-528c-85f5-a9baafa392e4 with scrape type 1
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2d58ba2-bb37-528c-85f5-a9baafa392e4
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_141e056e256fae66fd667d24f35686ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_141e056e256fae66fd667d24f35686ea.jpg not downloaded yet
2026-03-30 10:38:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9efda910-5b08-5123-9496-4c332a2b1d13 with identifier: ZX44823
2026-03-30 10:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9efda910-5b08-5123-9496-4c332a2b1d13 with scrape type 1
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9efda910-5b08-5123-9496-4c332a2b1d13
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_3db6d9c9affcd162e4336f73f66ba43a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_3db6d9c9affcd162e4336f73f66ba43a.jpg not downloaded yet
2026-03-30 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_911ffb2e57286d65030b16e012f9bc87.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_94a396b1b49d9d9fc9fed1fecd39262b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_94a396b1b49d9d9fc9fed1fecd39262b.jpg not downloaded yet
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_a4fd8747c5ba3639f0a88f71d35c98de.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_a4fd8747c5ba3639f0a88f71d35c98de.jpg not downloaded yet
2026-03-30 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_9efea75fe6c40a6fdad4d84969062d01.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_de8dc9077333905149addad8f76e3618.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_e66069d2542a86144217db9d008b28e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_e66069d2542a86144217db9d008b28e3.jpg not downloaded yet
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_cdcf9d80c59cf92281b7f12af2141172.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_cdcf9d80c59cf92281b7f12af2141172.jpg not downloaded yet
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_235d72343e5cfb00d1c5722bcf44da48.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_235d72343e5cfb00d1c5722bcf44da48.jpg not downloaded yet
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_ee028e552bc3a0068ddf9fb5046c9f42.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_ee028e552bc3a0068ddf9fb5046c9f42.jpg not downloaded yet
2026-03-30 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_7525934a21e3da1a84c393ddf65b8c88.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_56fe1cbb6d8bab9c31b1f85b5664fca1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_56fe1cbb6d8bab9c31b1f85b5664fca1.jpg not downloaded yet
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_9c9a3fbb5be5eb7ed4a36c5ec01772c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_9c9a3fbb5be5eb7ed4a36c5ec01772c6.jpg not downloaded yet
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f47dd990>
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4420e236-ab7c-596e-93b6-09a8b21c2e93/4420e236-ab7c-596e-93b6-09a8b21c2e93_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb9%252F74b90de5ff9fa32ff0eea1f671bc3b1b%252Fpa%252FHR51580_911ffb2e57286d65030b16e012f9bc87.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_911ffb2e57286d65030b16e012f9bc87.jpg saved to cache
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4420e236-ab7c-596e-93b6-09a8b21c2e93
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_84dcd65cbf7fdf0ee16f8f3d731e878a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_84dcd65cbf7fdf0ee16f8f3d731e878a.jpg not downloaded yet
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_da1ea89ee93378901b8c9f33127247d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_da1ea89ee93378901b8c9f33127247d5.jpg not downloaded yet
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_68706b77423c96e69b505451a1275458.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee61e90>
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4420e236-ab7c-596e-93b6-09a8b21c2e93/4420e236-ab7c-596e-93b6-09a8b21c2e93_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb9%252F74b90de5ff9fa32ff0eea1f671bc3b1b%252Fpa%252FHR51580_9efea75fe6c40a6fdad4d84969062d01.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_9efea75fe6c40a6fdad4d84969062d01.jpg saved to cache
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4420e236-ab7c-596e-93b6-09a8b21c2e93
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f427b8d0>
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4420e236-ab7c-596e-93b6-09a8b21c2e93/4420e236-ab7c-596e-93b6-09a8b21c2e93_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb9%252F74b90de5ff9fa32ff0eea1f671bc3b1b%252Fpa%252FHR51580_de8dc9077333905149addad8f76e3618.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_de8dc9077333905149addad8f76e3618.jpg saved to cache
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4420e236-ab7c-596e-93b6-09a8b21c2e93
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_94f4d45d2f7243f5669b6e4606746267.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_94f4d45d2f7243f5669b6e4606746267.jpg not downloaded yet
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_c7a15c5e642df7d4fca304438c9aa503.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_c7a15c5e642df7d4fca304438c9aa503.jpg not downloaded yet
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_bcb4221039455e9eea596e7799db5ea6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_bcb4221039455e9eea596e7799db5ea6.jpg not downloaded yet
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_aa1ee70381cf4fd55c8bf81b26f8dafc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_aa1ee70381cf4fd55c8bf81b26f8dafc.jpg not downloaded yet
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a7150>
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4420e236-ab7c-596e-93b6-09a8b21c2e93/4420e236-ab7c-596e-93b6-09a8b21c2e93_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb9%252F74b90de5ff9fa32ff0eea1f671bc3b1b%252Fpa%252FHR51580_7525934a21e3da1a84c393ddf65b8c88.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_7525934a21e3da1a84c393ddf65b8c88.jpg saved to cache
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4420e236-ab7c-596e-93b6-09a8b21c2e93
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_95dceff56d31749e45afb2540b6b9e55.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_95dceff56d31749e45afb2540b6b9e55.jpg not downloaded yet
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_db6684ee4138638b007bc9cdd3b058cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_db6684ee4138638b007bc9cdd3b058cb.jpg not downloaded yet
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef19050>
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4420e236-ab7c-596e-93b6-09a8b21c2e93/4420e236-ab7c-596e-93b6-09a8b21c2e93_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb9%252F74b90de5ff9fa32ff0eea1f671bc3b1b%252Fpa%252FHR51580_68706b77423c96e69b505451a1275458.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_68706b77423c96e69b505451a1275458.jpg saved to cache
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4420e236-ab7c-596e-93b6-09a8b21c2e93
2026-03-30 10:38:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4420e236-ab7c-596e-93b6-09a8b21c2e93, skipping ID generation
2026-03-30 10:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4420e236-ab7c-596e-93b6-09a8b21c2e93 with scrape type 1
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4420e236-ab7c-596e-93b6-09a8b21c2e93 sending to next pipeline
2026-03-30 10:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4420e236-ab7c-596e-93b6-09a8b21c2e93, identifier: HR51580
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_7279ef578fa4118c0f1ae6899287d425.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_7279ef578fa4118c0f1ae6899287d425.jpg not downloaded yet
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_47acec79f9664f51307cd759ba6148b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_47acec79f9664f51307cd759ba6148b5.jpg not downloaded yet
2026-03-30 10:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4420e236-ab7c-596e-93b6-09a8b21c2e93 with identifier: HR51580
2026-03-30 10:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4420e236-ab7c-596e-93b6-09a8b21c2e93 with identifier: HR51580
2026-03-30 10:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4420e236-ab7c-596e-93b6-09a8b21c2e93 with identifier: HR51580 to the API
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_68706b77423c96e69b505451a1275458.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:39:20Z',
 'fuel_type': 'diesel',
 'id': '4420e236-ab7c-596e-93b6-09a8b21c2e93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR51580',
 'listing': 'auction',
 'location': 'DE, Ellwangen (Jagst)',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 360556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4420e236-ab7c-596e-93b6-09a8b21c2e93/4420e236-ab7c-596e-93b6-09a8b21c2e93_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_68706b77423c96e69b505451a1275458.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4420e236-ab7c-596e-93b6-09a8b21c2e93/4420e236-ab7c-596e-93b6-09a8b21c2e93_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_7525934a21e3da1a84c393ddf65b8c88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4420e236-ab7c-596e-93b6-09a8b21c2e93/4420e236-ab7c-596e-93b6-09a8b21c2e93_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_9efea75fe6c40a6fdad4d84969062d01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4420e236-ab7c-596e-93b6-09a8b21c2e93/4420e236-ab7c-596e-93b6-09a8b21c2e93_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_911ffb2e57286d65030b16e012f9bc87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4420e236-ab7c-596e-93b6-09a8b21c2e93/4420e236-ab7c-596e-93b6-09a8b21c2e93_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b9/74b90de5ff9fa32ff0eea1f671bc3b1b/pa/HR51580_de8dc9077333905149addad8f76e3618.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-08-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.9 TDI Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2010}
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR51580%27 HTTP/1.1" 200 None
2026-03-30 10:38:41 [auto1.de] INFO: Saving data for HR51580: {'created_time': 1774867121.862565, 'last_price_update_time': 1774867121.862575, 'auction_closing_time': 1774971560.0}
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR51580') HTTP/1.1" 204 0
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_d3f4223970df95d995c1808994e8667e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_0f02ea944a38f9b9db4acc81a9d04350.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_11cad6f420ed1a07aef61ad3e6eec3b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_cc8519799276d54bfb0d2cb0b41093db.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_80066d47657f3b10e333098b9b1f2526.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_c71813c52d1f96f977cf895b070fde08.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_6fac81bda4d635a2a2b61cb0d07e723c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_cdcf9d80c59cf92281b7f12af2141172.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_9c9a3fbb5be5eb7ed4a36c5ec01772c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD73568> (referer: https://www.auto1.com/v1/car-details-view/FD73568/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_3db6d9c9affcd162e4336f73f66ba43a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_a4fd8747c5ba3639f0a88f71d35c98de.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_47acec79f9664f51307cd759ba6148b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4254b50>
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_d3f4223970df95d995c1808994e8667e.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_d3f4223970df95d995c1808994e8667e.jpg saved to cache
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e72f5750-f89a-5109-80b4-fa3bf2b61131
2026-03-30 10:38:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb2510>
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_0f02ea944a38f9b9db4acc81a9d04350.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_0f02ea944a38f9b9db4acc81a9d04350.jpg saved to cache
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e72f5750-f89a-5109-80b4-fa3bf2b61131
2026-03-30 10:38:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f2010>
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_11cad6f420ed1a07aef61ad3e6eec3b8.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_11cad6f420ed1a07aef61ad3e6eec3b8.jpg saved to cache
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e72f5750-f89a-5109-80b4-fa3bf2b61131
2026-03-30 10:38:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee450dd0>
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_cc8519799276d54bfb0d2cb0b41093db.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_cc8519799276d54bfb0d2cb0b41093db.jpg saved to cache
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e72f5750-f89a-5109-80b4-fa3bf2b61131
2026-03-30 10:38:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3fb290>
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_80066d47657f3b10e333098b9b1f2526.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_80066d47657f3b10e333098b9b1f2526.jpg saved to cache
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e72f5750-f89a-5109-80b4-fa3bf2b61131
2026-03-30 10:38:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeebee50>
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_c71813c52d1f96f977cf895b070fde08.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_c71813c52d1f96f977cf895b070fde08.jpg saved to cache
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e72f5750-f89a-5109-80b4-fa3bf2b61131
2026-03-30 10:38:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee486b10>
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_6fac81bda4d635a2a2b61cb0d07e723c.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_6fac81bda4d635a2a2b61cb0d07e723c.jpg saved to cache
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e72f5750-f89a-5109-80b4-fa3bf2b61131
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4903d0>
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_cdcf9d80c59cf92281b7f12af2141172.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_cdcf9d80c59cf92281b7f12af2141172.jpg saved to cache
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9efda910-5b08-5123-9496-4c332a2b1d13
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3fb6d0>
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_9c9a3fbb5be5eb7ed4a36c5ec01772c6.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_9c9a3fbb5be5eb7ed4a36c5ec01772c6.jpg saved to cache
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9efda910-5b08-5123-9496-4c332a2b1d13
2026-03-30 10:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 622721a1-444e-5077-922f-a6ceed9f8c60 with identifier: FD73568
2026-03-30 10:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 622721a1-444e-5077-922f-a6ceed9f8c60 with scrape type 1
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 622721a1-444e-5077-922f-a6ceed9f8c60
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fad%252F09ad2aee3da7a39eb5eafd6294718761%252Fpa%252FFD73568_64ca59e648cff47eabc4921f541d51f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_64ca59e648cff47eabc4921f541d51f2.jpg not downloaded yet
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4532d0>
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_3db6d9c9affcd162e4336f73f66ba43a.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_3db6d9c9affcd162e4336f73f66ba43a.jpg saved to cache
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9efda910-5b08-5123-9496-4c332a2b1d13
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee491b50>
2026-03-30 10:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_a4fd8747c5ba3639f0a88f71d35c98de.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_a4fd8747c5ba3639f0a88f71d35c98de.jpg saved to cache
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9efda910-5b08-5123-9496-4c332a2b1d13
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f9410>
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_47acec79f9664f51307cd759ba6148b5.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_47acec79f9664f51307cd759ba6148b5.jpg saved to cache
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9efda910-5b08-5123-9496-4c332a2b1d13
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fad%252F09ad2aee3da7a39eb5eafd6294718761%252Fpa%252FFD73568_69133ecb3ae26d5e57540f5e3aa1abf1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_69133ecb3ae26d5e57540f5e3aa1abf1.jpg not downloaded yet
2026-03-30 10:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE55796> (referer: https://www.auto1.com/v1/car-details-view/RE55796/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fad%252F09ad2aee3da7a39eb5eafd6294718761%252Fpa%252FFD73568_f52ac7dcd5f1d35176c30a1b4a0b20f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_f52ac7dcd5f1d35176c30a1b4a0b20f9.jpg not downloaded yet
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fad%252F09ad2aee3da7a39eb5eafd6294718761%252Fpa%252FFD73568_b9916bb71817866d59dc553fa1ce8944.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_b9916bb71817866d59dc553fa1ce8944.jpg not downloaded yet
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fad%252F09ad2aee3da7a39eb5eafd6294718761%252Fpa%252FFD73568_4fd4f62da52be756a82772f439e9efe0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_4fd4f62da52be756a82772f439e9efe0.jpg not downloaded yet
2026-03-30 10:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_64ca59e648cff47eabc4921f541d51f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_db6684ee4138638b007bc9cdd3b058cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_aa1ee70381cf4fd55c8bf81b26f8dafc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_d5d773b5bf43ad26177cd1d41c9afefc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_141e056e256fae66fd667d24f35686ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38818c43-d29c-568d-a8ea-53e5abdab369 with identifier: RE55796
2026-03-30 10:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38818c43-d29c-568d-a8ea-53e5abdab369 with scrape type 1
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 38818c43-d29c-568d-a8ea-53e5abdab369
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fac%252F58ac83d60c2e1328c95b48d4a722e72f%252Fpa%252FRE55796_9463239778781874562c567f9cf107c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_9463239778781874562c567f9cf107c6.jpg not downloaded yet
2026-03-30 10:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_c7a15c5e642df7d4fca304438c9aa503.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fac%252F58ac83d60c2e1328c95b48d4a722e72f%252Fpa%252FRE55796_bb5e32da729cd2376e7b8af62a793cd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_bb5e32da729cd2376e7b8af62a793cd7.jpg not downloaded yet
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fac%252F58ac83d60c2e1328c95b48d4a722e72f%252Fpa%252FRE55796_9815c89dd689f463c1869781d84ee366.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_9815c89dd689f463c1869781d84ee366.jpg not downloaded yet
2026-03-30 10:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_da1ea89ee93378901b8c9f33127247d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_ee028e552bc3a0068ddf9fb5046c9f42.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fac%252F58ac83d60c2e1328c95b48d4a722e72f%252Fpa%252FRE55796_3e26c303ce09b8691d1b419cb607adde.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_3e26c303ce09b8691d1b419cb607adde.jpg not downloaded yet
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fac%252F58ac83d60c2e1328c95b48d4a722e72f%252Fpa%252FRE55796_b0d30e108eff6df8cfdd9d1aa189c1cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_b0d30e108eff6df8cfdd9d1aa189c1cd.jpg not downloaded yet
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42314d0>
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622721a1-444e-5077-922f-a6ceed9f8c60/622721a1-444e-5077-922f-a6ceed9f8c60_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fad%252F09ad2aee3da7a39eb5eafd6294718761%252Fpa%252FFD73568_64ca59e648cff47eabc4921f541d51f2.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_64ca59e648cff47eabc4921f541d51f2.jpg saved to cache
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 622721a1-444e-5077-922f-a6ceed9f8c60
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeedd1d0>
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_db6684ee4138638b007bc9cdd3b058cb.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_db6684ee4138638b007bc9cdd3b058cb.jpg saved to cache
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9efda910-5b08-5123-9496-4c332a2b1d13
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4177b10>
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_aa1ee70381cf4fd55c8bf81b26f8dafc.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_aa1ee70381cf4fd55c8bf81b26f8dafc.jpg saved to cache
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9efda910-5b08-5123-9496-4c332a2b1d13
2026-03-30 10:38:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef62550>
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_d5d773b5bf43ad26177cd1d41c9afefc.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_d5d773b5bf43ad26177cd1d41c9afefc.jpg saved to cache
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e72f5750-f89a-5109-80b4-fa3bf2b61131
2026-03-30 10:38:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4172bd0>
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_141e056e256fae66fd667d24f35686ea.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_141e056e256fae66fd667d24f35686ea.jpg saved to cache
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2d58ba2-bb37-528c-85f5-a9baafa392e4
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fac%252F58ac83d60c2e1328c95b48d4a722e72f%252Fpa%252FRE55796_7dc8b81323836f66577d238175fe66b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_7dc8b81323836f66577d238175fe66b6.jpg not downloaded yet
2026-03-30 10:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_69133ecb3ae26d5e57540f5e3aa1abf1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefb7d90>
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_c7a15c5e642df7d4fca304438c9aa503.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_c7a15c5e642df7d4fca304438c9aa503.jpg saved to cache
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9efda910-5b08-5123-9496-4c332a2b1d13
2026-03-30 10:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_4fd4f62da52be756a82772f439e9efe0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41f3c10>
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_da1ea89ee93378901b8c9f33127247d5.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_da1ea89ee93378901b8c9f33127247d5.jpg saved to cache
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9efda910-5b08-5123-9496-4c332a2b1d13
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee485d0>
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fa5%252Fb0a5f8f8e520e3d6da92fd4c746512d2%252Fpa%252FZX44823_ee028e552bc3a0068ddf9fb5046c9f42.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_ee028e552bc3a0068ddf9fb5046c9f42.jpg saved to cache
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9efda910-5b08-5123-9496-4c332a2b1d13
2026-03-30 10:38:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9efda910-5b08-5123-9496-4c332a2b1d13, skipping ID generation
2026-03-30 10:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9efda910-5b08-5123-9496-4c332a2b1d13 with scrape type 1
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9efda910-5b08-5123-9496-4c332a2b1d13 sending to next pipeline
2026-03-30 10:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9efda910-5b08-5123-9496-4c332a2b1d13, identifier: ZX44823
2026-03-30 10:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9efda910-5b08-5123-9496-4c332a2b1d13 with identifier: ZX44823
2026-03-30 10:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9efda910-5b08-5123-9496-4c332a2b1d13 with identifier: ZX44823
2026-03-30 10:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9efda910-5b08-5123-9496-4c332a2b1d13 with identifier: ZX44823 to the API
2026-03-30 10:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_ee028e552bc3a0068ddf9fb5046c9f42.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:37:03Z',
 'fuel_type': 'diesel',
 'id': '9efda910-5b08-5123-9496-4c332a2b1d13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX44823',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 87276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_3db6d9c9affcd162e4336f73f66ba43a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_a4fd8747c5ba3639f0a88f71d35c98de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_cdcf9d80c59cf92281b7f12af2141172.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_ee028e552bc3a0068ddf9fb5046c9f42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_9c9a3fbb5be5eb7ed4a36c5ec01772c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_da1ea89ee93378901b8c9f33127247d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_c7a15c5e642df7d4fca304438c9aa503.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_aa1ee70381cf4fd55c8bf81b26f8dafc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_db6684ee4138638b007bc9cdd3b058cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9efda910-5b08-5123-9496-4c332a2b1d13/9efda910-5b08-5123-9496-4c332a2b1d13_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/a5/b0a5f8f8e520e3d6da92fd4c746512d2/pa/ZX44823_47acec79f9664f51307cd759ba6148b5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2021}
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX44823%27 HTTP/1.1" 200 None
2026-03-30 10:38:45 [auto1.de] INFO: Saving data for ZX44823: {'created_time': 1774867125.180418, 'last_price_update_time': 1774867125.180429, 'auction_closing_time': 1774971423.0}
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX44823') HTTP/1.1" 204 0
2026-03-30 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_f52ac7dcd5f1d35176c30a1b4a0b20f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_b9916bb71817866d59dc553fa1ce8944.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41774d0>
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622721a1-444e-5077-922f-a6ceed9f8c60/622721a1-444e-5077-922f-a6ceed9f8c60_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fad%252F09ad2aee3da7a39eb5eafd6294718761%252Fpa%252FFD73568_69133ecb3ae26d5e57540f5e3aa1abf1.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_69133ecb3ae26d5e57540f5e3aa1abf1.jpg saved to cache
2026-03-30 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 622721a1-444e-5077-922f-a6ceed9f8c60
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee87d50>
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622721a1-444e-5077-922f-a6ceed9f8c60/622721a1-444e-5077-922f-a6ceed9f8c60_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fad%252F09ad2aee3da7a39eb5eafd6294718761%252Fpa%252FFD73568_4fd4f62da52be756a82772f439e9efe0.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_4fd4f62da52be756a82772f439e9efe0.jpg saved to cache
2026-03-30 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 622721a1-444e-5077-922f-a6ceed9f8c60
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43a9890>
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622721a1-444e-5077-922f-a6ceed9f8c60/622721a1-444e-5077-922f-a6ceed9f8c60_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fad%252F09ad2aee3da7a39eb5eafd6294718761%252Fpa%252FFD73568_f52ac7dcd5f1d35176c30a1b4a0b20f9.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_f52ac7dcd5f1d35176c30a1b4a0b20f9.jpg saved to cache
2026-03-30 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 622721a1-444e-5077-922f-a6ceed9f8c60
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee3dbd0>
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622721a1-444e-5077-922f-a6ceed9f8c60/622721a1-444e-5077-922f-a6ceed9f8c60_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fad%252F09ad2aee3da7a39eb5eafd6294718761%252Fpa%252FFD73568_b9916bb71817866d59dc553fa1ce8944.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_b9916bb71817866d59dc553fa1ce8944.jpg saved to cache
2026-03-30 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 622721a1-444e-5077-922f-a6ceed9f8c60
2026-03-30 10:38:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 622721a1-444e-5077-922f-a6ceed9f8c60, skipping ID generation
2026-03-30 10:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 622721a1-444e-5077-922f-a6ceed9f8c60 with scrape type 1
2026-03-30 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 622721a1-444e-5077-922f-a6ceed9f8c60 sending to next pipeline
2026-03-30 10:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 622721a1-444e-5077-922f-a6ceed9f8c60, identifier: FD73568
2026-03-30 10:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 622721a1-444e-5077-922f-a6ceed9f8c60 with identifier: FD73568
2026-03-30 10:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 622721a1-444e-5077-922f-a6ceed9f8c60 with identifier: FD73568
2026-03-30 10:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 622721a1-444e-5077-922f-a6ceed9f8c60 with identifier: FD73568 to the API
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_b9916bb71817866d59dc553fa1ce8944.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 88,
 'expiration_date': '2026-03-31T15:28:12Z',
 'fuel_type': 'petrol',
 'id': '622721a1-444e-5077-922f-a6ceed9f8c60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD73568',
 'listing': 'auction',
 'location': 'DE, Pforzheim',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 176736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622721a1-444e-5077-922f-a6ceed9f8c60/622721a1-444e-5077-922f-a6ceed9f8c60_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_64ca59e648cff47eabc4921f541d51f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622721a1-444e-5077-922f-a6ceed9f8c60/622721a1-444e-5077-922f-a6ceed9f8c60_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_69133ecb3ae26d5e57540f5e3aa1abf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622721a1-444e-5077-922f-a6ceed9f8c60/622721a1-444e-5077-922f-a6ceed9f8c60_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_f52ac7dcd5f1d35176c30a1b4a0b20f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622721a1-444e-5077-922f-a6ceed9f8c60/622721a1-444e-5077-922f-a6ceed9f8c60_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_b9916bb71817866d59dc553fa1ce8944.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622721a1-444e-5077-922f-a6ceed9f8c60/622721a1-444e-5077-922f-a6ceed9f8c60_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/ad/09ad2aee3da7a39eb5eafd6294718761/pa/FD73568_4fd4f62da52be756a82772f439e9efe0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 207 1.4 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2006}
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD73568%27 HTTP/1.1" 200 None
2026-03-30 10:38:45 [auto1.de] INFO: Saving data for FD73568: {'created_time': 1774867125.89352, 'last_price_update_time': 1774867125.893531, 'auction_closing_time': 1774970892.0}
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD73568') HTTP/1.1" 204 0
2026-03-30 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_7dc8b81323836f66577d238175fe66b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_95dceff56d31749e45afb2540b6b9e55.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_7279ef578fa4118c0f1ae6899287d425.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_94f4d45d2f7243f5669b6e4606746267.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_bcb4221039455e9eea596e7799db5ea6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_84dcd65cbf7fdf0ee16f8f3d731e878a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_56fe1cbb6d8bab9c31b1f85b5664fca1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_235d72343e5cfb00d1c5722bcf44da48.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_b0d30e108eff6df8cfdd9d1aa189c1cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_9815c89dd689f463c1869781d84ee366.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_bb5e32da729cd2376e7b8af62a793cd7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_9463239778781874562c567f9cf107c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_3e26c303ce09b8691d1b419cb607adde.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f433a650>
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fac%252F58ac83d60c2e1328c95b48d4a722e72f%252Fpa%252FRE55796_7dc8b81323836f66577d238175fe66b6.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_7dc8b81323836f66577d238175fe66b6.jpg saved to cache
2026-03-30 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38818c43-d29c-568d-a8ea-53e5abdab369
2026-03-30 10:38:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee95290>
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_95dceff56d31749e45afb2540b6b9e55.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_95dceff56d31749e45afb2540b6b9e55.jpg saved to cache
2026-03-30 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2d58ba2-bb37-528c-85f5-a9baafa392e4
2026-03-30 10:38:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4141850>
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_7279ef578fa4118c0f1ae6899287d425.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_7279ef578fa4118c0f1ae6899287d425.jpg saved to cache
2026-03-30 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2d58ba2-bb37-528c-85f5-a9baafa392e4
2026-03-30 10:38:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f425a810>
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_94f4d45d2f7243f5669b6e4606746267.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_94f4d45d2f7243f5669b6e4606746267.jpg saved to cache
2026-03-30 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2d58ba2-bb37-528c-85f5-a9baafa392e4
2026-03-30 10:38:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee32810>
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_bcb4221039455e9eea596e7799db5ea6.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_bcb4221039455e9eea596e7799db5ea6.jpg saved to cache
2026-03-30 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2d58ba2-bb37-528c-85f5-a9baafa392e4
2026-03-30 10:38:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f425aa10>
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_84dcd65cbf7fdf0ee16f8f3d731e878a.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_84dcd65cbf7fdf0ee16f8f3d731e878a.jpg saved to cache
2026-03-30 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2d58ba2-bb37-528c-85f5-a9baafa392e4
2026-03-30 10:38:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f436fe50>
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_56fe1cbb6d8bab9c31b1f85b5664fca1.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_56fe1cbb6d8bab9c31b1f85b5664fca1.jpg saved to cache
2026-03-30 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2d58ba2-bb37-528c-85f5-a9baafa392e4
2026-03-30 10:38:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45c050>
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_235d72343e5cfb00d1c5722bcf44da48.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_235d72343e5cfb00d1c5722bcf44da48.jpg saved to cache
2026-03-30 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2d58ba2-bb37-528c-85f5-a9baafa392e4
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f425bd50>
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fac%252F58ac83d60c2e1328c95b48d4a722e72f%252Fpa%252FRE55796_b0d30e108eff6df8cfdd9d1aa189c1cd.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_b0d30e108eff6df8cfdd9d1aa189c1cd.jpg saved to cache
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38818c43-d29c-568d-a8ea-53e5abdab369
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45ef90>
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fac%252F58ac83d60c2e1328c95b48d4a722e72f%252Fpa%252FRE55796_9815c89dd689f463c1869781d84ee366.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_9815c89dd689f463c1869781d84ee366.jpg saved to cache
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38818c43-d29c-568d-a8ea-53e5abdab369
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45d290>
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fac%252F58ac83d60c2e1328c95b48d4a722e72f%252Fpa%252FRE55796_bb5e32da729cd2376e7b8af62a793cd7.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_bb5e32da729cd2376e7b8af62a793cd7.jpg saved to cache
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38818c43-d29c-568d-a8ea-53e5abdab369
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4259a50>
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fac%252F58ac83d60c2e1328c95b48d4a722e72f%252Fpa%252FRE55796_9463239778781874562c567f9cf107c6.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_9463239778781874562c567f9cf107c6.jpg saved to cache
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38818c43-d29c-568d-a8ea-53e5abdab369
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec8510>
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fac%252F58ac83d60c2e1328c95b48d4a722e72f%252Fpa%252FRE55796_3e26c303ce09b8691d1b419cb607adde.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_3e26c303ce09b8691d1b419cb607adde.jpg saved to cache
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38818c43-d29c-568d-a8ea-53e5abdab369
2026-03-30 10:38:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38818c43-d29c-568d-a8ea-53e5abdab369, skipping ID generation
2026-03-30 10:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38818c43-d29c-568d-a8ea-53e5abdab369 with scrape type 1
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38818c43-d29c-568d-a8ea-53e5abdab369 sending to next pipeline
2026-03-30 10:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38818c43-d29c-568d-a8ea-53e5abdab369, identifier: RE55796
2026-03-30 10:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38818c43-d29c-568d-a8ea-53e5abdab369 with identifier: RE55796
2026-03-30 10:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38818c43-d29c-568d-a8ea-53e5abdab369 with identifier: RE55796
2026-03-30 10:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38818c43-d29c-568d-a8ea-53e5abdab369 with identifier: RE55796 to the API
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_3e26c303ce09b8691d1b419cb607adde.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-31T15:32:16Z',
 'fuel_type': 'diesel',
 'id': '38818c43-d29c-568d-a8ea-53e5abdab369',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE55796',
 'listing': 'auction',
 'location': 'DE, Neustadt an der Weinstraße',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 234080,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_9463239778781874562c567f9cf107c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_bb5e32da729cd2376e7b8af62a793cd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_9815c89dd689f463c1869781d84ee366.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_3e26c303ce09b8691d1b419cb607adde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_b0d30e108eff6df8cfdd9d1aa189c1cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_7dc8b81323836f66577d238175fe66b6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 2.0 CDTI 150 Jahre Opel',
 'transmission': 'manual',
 'trim': '150 Jahre',
 'year': 2012}
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE55796%27 HTTP/1.1" 200 None
2026-03-30 10:38:47 [auto1.de] INFO: Saving data for RE55796: {'created_time': 1774867127.736554, 'last_price_update_time': 1774867127.736564, 'auction_closing_time': 1774971136.0}
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE55796') HTTP/1.1" 204 0
2026-03-30 10:38:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_94a396b1b49d9d9fc9fed1fecd39262b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_e66069d2542a86144217db9d008b28e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_35bc8143b25551f610d87565b8f73a2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_d3ac5fc524f91191c20f2cfef8cd35e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_3bdc4ebc877f8a473a3f95e5451ba228.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_7cdd8524507038f69920e5ef29929108.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_9a202d6a61acf2bfe5669a82f23d5ba0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_8b1f12906953f91b90943845629b7336.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d6ed0>
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_94a396b1b49d9d9fc9fed1fecd39262b.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_94a396b1b49d9d9fc9fed1fecd39262b.jpg saved to cache
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2d58ba2-bb37-528c-85f5-a9baafa392e4
2026-03-30 10:38:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417d110>
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fbc%252Fefbc250e750e48dca44275bf133bce77%252Fpa%252FSK87421_e66069d2542a86144217db9d008b28e3.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_e66069d2542a86144217db9d008b28e3.jpg saved to cache
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2d58ba2-bb37-528c-85f5-a9baafa392e4
2026-03-30 10:38:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2d58ba2-bb37-528c-85f5-a9baafa392e4, skipping ID generation
2026-03-30 10:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2d58ba2-bb37-528c-85f5-a9baafa392e4 with scrape type 1
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2d58ba2-bb37-528c-85f5-a9baafa392e4 sending to next pipeline
2026-03-30 10:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2d58ba2-bb37-528c-85f5-a9baafa392e4, identifier: SK87421
2026-03-30 10:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2d58ba2-bb37-528c-85f5-a9baafa392e4 with identifier: SK87421
2026-03-30 10:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2d58ba2-bb37-528c-85f5-a9baafa392e4 with identifier: SK87421
2026-03-30 10:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2d58ba2-bb37-528c-85f5-a9baafa392e4 with identifier: SK87421 to the API
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_e66069d2542a86144217db9d008b28e3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:41:45Z',
 'fuel_type': 'diesel',
 'id': 'a2d58ba2-bb37-528c-85f5-a9baafa392e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK87421',
 'listing': 'auction',
 'location': 'DE, Hof',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 117252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2231424,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_141e056e256fae66fd667d24f35686ea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2248553,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_94a396b1b49d9d9fc9fed1fecd39262b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2302645,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_e66069d2542a86144217db9d008b28e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2279882,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_235d72343e5cfb00d1c5722bcf44da48.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2441956,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_56fe1cbb6d8bab9c31b1f85b5664fca1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2246114,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_84dcd65cbf7fdf0ee16f8f3d731e878a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2312106,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_94f4d45d2f7243f5669b6e4606746267.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2640981,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_bcb4221039455e9eea596e7799db5ea6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2349392,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_95dceff56d31749e45afb2540b6b9e55.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d58ba2-bb37-528c-85f5-a9baafa392e4/a2d58ba2-bb37-528c-85f5-a9baafa392e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2372826,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/bc/efbc250e750e48dca44275bf133bce77/pa/SK87421_7279ef578fa4118c0f1ae6899287d425.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2016}
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK87421%27 HTTP/1.1" 200 None
2026-03-30 10:38:48 [auto1.de] INFO: Saving data for SK87421: {'created_time': 1774867128.587585, 'last_price_update_time': 1774867128.587594, 'auction_closing_time': 1774971705.0}
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK87421') HTTP/1.1" 204 0
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee55090>
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e81ba5a5-eca6-59bd-8f11-cfe2643e9512/e81ba5a5-eca6-59bd-8f11-cfe2643e9512_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F4f%252F044fcf84aea9a92603dc6b58d04d63a6%252Fpa%252FEK25155_35bc8143b25551f610d87565b8f73a2f.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_35bc8143b25551f610d87565b8f73a2f.jpg saved to cache
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e81ba5a5-eca6-59bd-8f11-cfe2643e9512
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef4ead0>
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e81ba5a5-eca6-59bd-8f11-cfe2643e9512/e81ba5a5-eca6-59bd-8f11-cfe2643e9512_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F4f%252F044fcf84aea9a92603dc6b58d04d63a6%252Fpa%252FEK25155_d3ac5fc524f91191c20f2cfef8cd35e6.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_d3ac5fc524f91191c20f2cfef8cd35e6.jpg saved to cache
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e81ba5a5-eca6-59bd-8f11-cfe2643e9512
2026-03-30 10:38:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e81ba5a5-eca6-59bd-8f11-cfe2643e9512, skipping ID generation
2026-03-30 10:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e81ba5a5-eca6-59bd-8f11-cfe2643e9512 with scrape type 1
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e81ba5a5-eca6-59bd-8f11-cfe2643e9512 sending to next pipeline
2026-03-30 10:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e81ba5a5-eca6-59bd-8f11-cfe2643e9512, identifier: EK25155
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec2150>
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_3bdc4ebc877f8a473a3f95e5451ba228.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_3bdc4ebc877f8a473a3f95e5451ba228.jpg saved to cache
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 62eaf1f0-9076-57d3-9c16-14aa07452a40
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef4e690>
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_7cdd8524507038f69920e5ef29929108.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_7cdd8524507038f69920e5ef29929108.jpg saved to cache
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 62eaf1f0-9076-57d3-9c16-14aa07452a40
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefeb490>
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_9a202d6a61acf2bfe5669a82f23d5ba0.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_9a202d6a61acf2bfe5669a82f23d5ba0.jpg saved to cache
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62eaf1f0-9076-57d3-9c16-14aa07452a40
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeedfe10>
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb6%252Faeb67101c723a999848891c35b6bbaf2%252Fpa%252FTH79589_8b1f12906953f91b90943845629b7336.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_8b1f12906953f91b90943845629b7336.jpg saved to cache
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 62eaf1f0-9076-57d3-9c16-14aa07452a40
2026-03-30 10:38:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62eaf1f0-9076-57d3-9c16-14aa07452a40, skipping ID generation
2026-03-30 10:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62eaf1f0-9076-57d3-9c16-14aa07452a40 with scrape type 1
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62eaf1f0-9076-57d3-9c16-14aa07452a40 sending to next pipeline
2026-03-30 10:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62eaf1f0-9076-57d3-9c16-14aa07452a40, identifier: TH79589
2026-03-30 10:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e81ba5a5-eca6-59bd-8f11-cfe2643e9512 with identifier: EK25155
2026-03-30 10:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e81ba5a5-eca6-59bd-8f11-cfe2643e9512 with identifier: EK25155
2026-03-30 10:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e81ba5a5-eca6-59bd-8f11-cfe2643e9512 with identifier: EK25155 to the API
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_d3ac5fc524f91191c20f2cfef8cd35e6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:54:21Z',
 'fuel_type': 'petrol',
 'id': 'e81ba5a5-eca6-59bd-8f11-cfe2643e9512',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK25155',
 'listing': 'auction',
 'location': 'DE, Mainz',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 167620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e81ba5a5-eca6-59bd-8f11-cfe2643e9512/e81ba5a5-eca6-59bd-8f11-cfe2643e9512_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_d3ac5fc524f91191c20f2cfef8cd35e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e81ba5a5-eca6-59bd-8f11-cfe2643e9512/e81ba5a5-eca6-59bd-8f11-cfe2643e9512_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_35bc8143b25551f610d87565b8f73a2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e81ba5a5-eca6-59bd-8f11-cfe2643e9512/e81ba5a5-eca6-59bd-8f11-cfe2643e9512_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_d2a721977f3b7671e0cc42a36c139f5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e81ba5a5-eca6-59bd-8f11-cfe2643e9512/e81ba5a5-eca6-59bd-8f11-cfe2643e9512_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_150250ee4e71134913c9fd79bb442c71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e81ba5a5-eca6-59bd-8f11-cfe2643e9512/e81ba5a5-eca6-59bd-8f11-cfe2643e9512_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/4f/044fcf84aea9a92603dc6b58d04d63a6/pa/EK25155_84c7b73aa3e321642e6aedee1e2542a5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2012}
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK25155%27 HTTP/1.1" 200 None
2026-03-30 10:38:49 [auto1.de] INFO: Saving data for EK25155: {'created_time': 1774867129.410129, 'last_price_update_time': 1774867129.410142, 'auction_closing_time': 1774972461.0}
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK25155') HTTP/1.1" 204 0
2026-03-30 10:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62eaf1f0-9076-57d3-9c16-14aa07452a40 with identifier: TH79589
2026-03-30 10:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62eaf1f0-9076-57d3-9c16-14aa07452a40 with identifier: TH79589
2026-03-30 10:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62eaf1f0-9076-57d3-9c16-14aa07452a40 with identifier: TH79589 to the API
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_8b1f12906953f91b90943845629b7336.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:11:43Z',
 'fuel_type': 'electro',
 'id': '62eaf1f0-9076-57d3-9c16-14aa07452a40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH79589',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 17,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_9a202d6a61acf2bfe5669a82f23d5ba0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_8b1f12906953f91b90943845629b7336.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_7cdd8524507038f69920e5ef29929108.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_3bdc4ebc877f8a473a3f95e5451ba228.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_6e9841119e7e8c661f8e862025bb185c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_44f56c5e2489fe1042f6144c41aa426f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_9c89a7ed9785cd174c93d4e32ae243de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_3f0868deafeb294c60ef8ffc4a013fec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_4d376c9ee51576cd943a6a077dfe76ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62eaf1f0-9076-57d3-9c16-14aa07452a40/62eaf1f0-9076-57d3-9c16-14aa07452a40_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b6/aeb67101c723a999848891c35b6bbaf2/pa/TH79589_7206f3ec1a016f0c51deef1c343a1b42.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-12-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH79589%27 HTTP/1.1" 200 None
2026-03-30 10:38:49 [auto1.de] INFO: Saving data for TH79589: {'created_time': 1774867129.757594, 'last_price_update_time': 1774867129.757606, 'auction_closing_time': 1774969903.0}
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH79589') HTTP/1.1" 204 0
2026-03-30 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX41187> (referer: https://www.auto1.com/v1/car-details-view/KX41187/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP46996> (referer: https://www.auto1.com/v1/car-details-view/VP46996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB05879> (referer: https://www.auto1.com/v1/car-details-view/BB05879/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_31c3a4437fbaddd442e8726b293bedc6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_f072825d464ab3bfcf3d3198db76eead.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_591bc061d4d48fac34dd42ca36434ff0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_e2b65e3c6332a14ebdd0c405fe717772.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_dfe22d4642b59893aecf69fe4aa1c1b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_62a51a6d4123a199c33bc91294b8b315.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_3562d824b682be2cdec29b27a0768534.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_92e4cf464bd6ceb7b365bb171213032c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae1c9ed5-947f-5456-8b52-dc5c154a4326 with identifier: KX41187
2026-03-30 10:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae1c9ed5-947f-5456-8b52-dc5c154a4326 with scrape type 1
2026-03-30 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ae1c9ed5-947f-5456-8b52-dc5c154a4326
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F69%252F2b69c20fc926486ee89c37a748def1e3%252Fpa%252FKX41187_8eafb4ef7080165cd4c45b2694cbfecb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_8eafb4ef7080165cd4c45b2694cbfecb.jpg not downloaded yet
2026-03-30 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_58df5e2d83d98ad75abff2e10f6f136c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F69%252F2b69c20fc926486ee89c37a748def1e3%252Fpa%252FKX41187_0a7e1d9524673c5da3218dd694ef8239.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_0a7e1d9524673c5da3218dd694ef8239.jpg not downloaded yet
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F69%252F2b69c20fc926486ee89c37a748def1e3%252Fpa%252FKX41187_d6a03da897456b54473f668ce8953192.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_d6a03da897456b54473f668ce8953192.jpg not downloaded yet
2026-03-30 10:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f27306ca-34aa-5c47-b545-b3b9a411ef70 with identifier: VP46996
2026-03-30 10:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f27306ca-34aa-5c47-b545-b3b9a411ef70 with scrape type 1
2026-03-30 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f27306ca-34aa-5c47-b545-b3b9a411ef70
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4b%252Ff64b564548aab66e825a3fef3c939857%252Fpa%252FVP46996_ff1ab81e1a24f7abcee2fb6327ad6a00.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_ff1ab81e1a24f7abcee2fb6327ad6a00.jpg already downloaded
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4b%252Ff64b564548aab66e825a3fef3c939857%252Fpa%252FVP46996_30a13917cfbbdb35bcc1fafdc37abd04.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_30a13917cfbbdb35bcc1fafdc37abd04.jpg already downloaded
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4b%252Ff64b564548aab66e825a3fef3c939857%252Fpa%252FVP46996_4849797fa966710e37fc4c2d94278b0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_4849797fa966710e37fc4c2d94278b0e.jpg already downloaded
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4b%252Ff64b564548aab66e825a3fef3c939857%252Fpa%252FVP46996_44d473b51968abf438b75cc2be4ddc4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_44d473b51968abf438b75cc2be4ddc4f.jpg already downloaded
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4b%252Ff64b564548aab66e825a3fef3c939857%252Fpa%252FVP46996_9c5767c730f3b99cdb5744eda094c4b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_9c5767c730f3b99cdb5744eda094c4b1.jpg already downloaded
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4b%252Ff64b564548aab66e825a3fef3c939857%252Fpa%252FVP46996_a46460e9a07bee8bd22bb905fe9f0df7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_a46460e9a07bee8bd22bb905fe9f0df7.jpg already downloaded
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4b%252Ff64b564548aab66e825a3fef3c939857%252Fpa%252FVP46996_4efbdd73e828cf4c80f426f8b76789fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_4efbdd73e828cf4c80f426f8b76789fd.jpg already downloaded
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4b%252Ff64b564548aab66e825a3fef3c939857%252Fpa%252FVP46996_45a6fa962366d8714b323241bb50a39f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_45a6fa962366d8714b323241bb50a39f.jpg already downloaded
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4b%252Ff64b564548aab66e825a3fef3c939857%252Fpa%252FVP46996_d91d9271cd78e010bbde2c743b6add73.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_d91d9271cd78e010bbde2c743b6add73.jpg already downloaded
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4b%252Ff64b564548aab66e825a3fef3c939857%252Fpa%252FVP46996_cc5df0a51992bf088cfbd5608a4bf334.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_cc5df0a51992bf088cfbd5608a4bf334.jpg already downloaded
2026-03-30 10:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f27306ca-34aa-5c47-b545-b3b9a411ef70, identifier: VP46996
2026-03-30 10:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 934ce49c-e687-5cb6-b170-186088eaa12f with identifier: BB05879
2026-03-30 10:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 934ce49c-e687-5cb6-b170-186088eaa12f with scrape type 1
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 934ce49c-e687-5cb6-b170-186088eaa12f
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd7%252Fa5d77be0a634c8ab53888d97a0db1d98%252Fpa%252FBB05879_9009d70e8ed927e61efdafe15d5ee607.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_9009d70e8ed927e61efdafe15d5ee607.jpg not downloaded yet
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F69%252F2b69c20fc926486ee89c37a748def1e3%252Fpa%252FKX41187_c38b535511fc672afac4ca10c9f2bc3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_c38b535511fc672afac4ca10c9f2bc3e.jpg not downloaded yet
2026-03-30 10:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f27306ca-34aa-5c47-b545-b3b9a411ef70 with identifier: VP46996
2026-03-30 10:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f27306ca-34aa-5c47-b545-b3b9a411ef70 with identifier: VP46996
2026-03-30 10:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f27306ca-34aa-5c47-b545-b3b9a411ef70 with identifier: VP46996 to the API
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VP46996>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:19:30Z',
 'fuel_type': 'diesel',
 'id': 'f27306ca-34aa-5c47-b545-b3b9a411ef70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP46996',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 48870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_ff1ab81e1a24f7abcee2fb6327ad6a00.jpg',
                'https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_30a13917cfbbdb35bcc1fafdc37abd04.jpg',
                'https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_4849797fa966710e37fc4c2d94278b0e.jpg',
                'https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_44d473b51968abf438b75cc2be4ddc4f.jpg',
                'https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_9c5767c730f3b99cdb5744eda094c4b1.jpg',
                'https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_a46460e9a07bee8bd22bb905fe9f0df7.jpg',
                'https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_4efbdd73e828cf4c80f426f8b76789fd.jpg',
                'https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_45a6fa962366d8714b323241bb50a39f.jpg',
                'https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_d91d9271cd78e010bbde2c743b6add73.jpg',
                'https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_cc5df0a51992bf088cfbd5608a4bf334.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27306ca-34aa-5c47-b545-b3b9a411ef70/f27306ca-34aa-5c47-b545-b3b9a411ef70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_ff1ab81e1a24f7abcee2fb6327ad6a00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27306ca-34aa-5c47-b545-b3b9a411ef70/f27306ca-34aa-5c47-b545-b3b9a411ef70_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_30a13917cfbbdb35bcc1fafdc37abd04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27306ca-34aa-5c47-b545-b3b9a411ef70/f27306ca-34aa-5c47-b545-b3b9a411ef70_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3253122,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_4849797fa966710e37fc4c2d94278b0e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27306ca-34aa-5c47-b545-b3b9a411ef70/f27306ca-34aa-5c47-b545-b3b9a411ef70_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_44d473b51968abf438b75cc2be4ddc4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27306ca-34aa-5c47-b545-b3b9a411ef70/f27306ca-34aa-5c47-b545-b3b9a411ef70_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3417216,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_9c5767c730f3b99cdb5744eda094c4b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27306ca-34aa-5c47-b545-b3b9a411ef70/f27306ca-34aa-5c47-b545-b3b9a411ef70_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_a46460e9a07bee8bd22bb905fe9f0df7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27306ca-34aa-5c47-b545-b3b9a411ef70/f27306ca-34aa-5c47-b545-b3b9a411ef70_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3314914,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_4efbdd73e828cf4c80f426f8b76789fd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27306ca-34aa-5c47-b545-b3b9a411ef70/f27306ca-34aa-5c47-b545-b3b9a411ef70_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_45a6fa962366d8714b323241bb50a39f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27306ca-34aa-5c47-b545-b3b9a411ef70/f27306ca-34aa-5c47-b545-b3b9a411ef70_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_d91d9271cd78e010bbde2c743b6add73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27306ca-34aa-5c47-b545-b3b9a411ef70/f27306ca-34aa-5c47-b545-b3b9a411ef70_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4b/f64b564548aab66e825a3fef3c939857/pa/VP46996_cc5df0a51992bf088cfbd5608a4bf334.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 35 TDI Mild-Hybrid advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2021}
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP46996%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [auto1.de] INFO: Saving data for VP46996: {'created_time': 1774867130.659753, 'last_price_update_time': 1774867130.659766, 'auction_closing_time': 1774970370.0}
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VP46996') HTTP/1.1" 204 0
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd7%252Fa5d77be0a634c8ab53888d97a0db1d98%252Fpa%252FBB05879_459efcd8817fce42516006f41e28bddd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_459efcd8817fce42516006f41e28bddd.jpg not downloaded yet
2026-03-30 10:38:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14035aa310>
2026-03-30 10:38:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_31c3a4437fbaddd442e8726b293bedc6.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_31c3a4437fbaddd442e8726b293bedc6.jpg saved to cache
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e72f5750-f89a-5109-80b4-fa3bf2b61131
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F69%252F2b69c20fc926486ee89c37a748def1e3%252Fpa%252FKX41187_e2f4a19ef3ff516e293a4a9fc8e899e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_e2f4a19ef3ff516e293a4a9fc8e899e7.jpg not downloaded yet
2026-03-30 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV02833> (referer: https://www.auto1.com/v1/car-details-view/CV02833/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd7%252Fa5d77be0a634c8ab53888d97a0db1d98%252Fpa%252FBB05879_695d3fe3d76f9ba7d89c043a2b06d21e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_695d3fe3d76f9ba7d89c043a2b06d21e.jpg not downloaded yet
2026-03-30 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB38553/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f425b2d0>
2026-03-30 10:38:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_f072825d464ab3bfcf3d3198db76eead.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_f072825d464ab3bfcf3d3198db76eead.jpg saved to cache
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4bdfb13c-5990-5f94-8f4b-163154b2857f
2026-03-30 10:38:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee400e10>
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe3%252F1de3dc01de402bde5f8cb80213f4c7bf%252Fpa%252FHD00097_591bc061d4d48fac34dd42ca36434ff0.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_591bc061d4d48fac34dd42ca36434ff0.jpg saved to cache
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e72f5750-f89a-5109-80b4-fa3bf2b61131
2026-03-30 10:38:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e72f5750-f89a-5109-80b4-fa3bf2b61131, skipping ID generation
2026-03-30 10:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e72f5750-f89a-5109-80b4-fa3bf2b61131 with scrape type 1
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e72f5750-f89a-5109-80b4-fa3bf2b61131 sending to next pipeline
2026-03-30 10:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e72f5750-f89a-5109-80b4-fa3bf2b61131, identifier: HD00097
2026-03-30 10:38:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4174710>
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_e2b65e3c6332a14ebdd0c405fe717772.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_e2b65e3c6332a14ebdd0c405fe717772.jpg saved to cache
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4bdfb13c-5990-5f94-8f4b-163154b2857f
2026-03-30 10:38:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee400a10>
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_dfe22d4642b59893aecf69fe4aa1c1b4.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_dfe22d4642b59893aecf69fe4aa1c1b4.jpg saved to cache
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b40d5609-d44e-587d-bcb0-68c5a8db35eb
2026-03-30 10:38:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee47b2d0>
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_62a51a6d4123a199c33bc91294b8b315.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_62a51a6d4123a199c33bc91294b8b315.jpg saved to cache
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4bdfb13c-5990-5f94-8f4b-163154b2857f
2026-03-30 10:38:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef4c350>
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_3562d824b682be2cdec29b27a0768534.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_3562d824b682be2cdec29b27a0768534.jpg saved to cache
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4bdfb13c-5990-5f94-8f4b-163154b2857f
2026-03-30 10:38:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee3fdd0>
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F42%252F83429bd093f42d42b14c094905a3970f%252Fpa%252FNG72078_92e4cf464bd6ceb7b365bb171213032c.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_92e4cf464bd6ceb7b365bb171213032c.jpg saved to cache
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4bdfb13c-5990-5f94-8f4b-163154b2857f
2026-03-30 10:38:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4bdfb13c-5990-5f94-8f4b-163154b2857f, skipping ID generation
2026-03-30 10:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bdfb13c-5990-5f94-8f4b-163154b2857f with scrape type 1
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4bdfb13c-5990-5f94-8f4b-163154b2857f sending to next pipeline
2026-03-30 10:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bdfb13c-5990-5f94-8f4b-163154b2857f, identifier: NG72078
2026-03-30 10:38:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42a98d0>
2026-03-30 10:38:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F2c%252Fdc2c70d68429b94ab0a70a61182629cb%252Fpa%252FWD03646_58df5e2d83d98ad75abff2e10f6f136c.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_58df5e2d83d98ad75abff2e10f6f136c.jpg saved to cache
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7f97e5e-8884-55f3-8ccf-af7c698e0fa6
2026-03-30 10:38:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7f97e5e-8884-55f3-8ccf-af7c698e0fa6, skipping ID generation
2026-03-30 10:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7f97e5e-8884-55f3-8ccf-af7c698e0fa6 with scrape type 1
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7f97e5e-8884-55f3-8ccf-af7c698e0fa6 sending to next pipeline
2026-03-30 10:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7f97e5e-8884-55f3-8ccf-af7c698e0fa6, identifier: WD03646
2026-03-30 10:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e72f5750-f89a-5109-80b4-fa3bf2b61131 with identifier: HD00097
2026-03-30 10:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e72f5750-f89a-5109-80b4-fa3bf2b61131 with identifier: HD00097
2026-03-30 10:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e72f5750-f89a-5109-80b4-fa3bf2b61131 with identifier: HD00097 to the API
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_591bc061d4d48fac34dd42ca36434ff0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 394,
 'expiration_date': '2026-03-31T15:35:32Z',
 'fuel_type': 'hybrid',
 'id': 'e72f5750-f89a-5109-80b4-fa3bf2b61131',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD00097',
 'listing': 'auction',
 'location': 'DE, Hamburg',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 249855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3062546,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_d3f4223970df95d995c1808994e8667e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3074640,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_0f02ea944a38f9b9db4acc81a9d04350.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3132703,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_d5d773b5bf43ad26177cd1d41c9afefc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3000037,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_6fac81bda4d635a2a2b61cb0d07e723c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3062633,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_c71813c52d1f96f977cf895b070fde08.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2542413,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_cc8519799276d54bfb0d2cb0b41093db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2319967,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_11cad6f420ed1a07aef61ad3e6eec3b8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2385846,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_80066d47657f3b10e333098b9b1f2526.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3008532,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_591bc061d4d48fac34dd42ca36434ff0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72f5750-f89a-5109-80b4-fa3bf2b61131/e72f5750-f89a-5109-80b4-fa3bf2b61131_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2929860,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e3/1de3dc01de402bde5f8cb80213f4c7bf/pa/HD00097_31c3a4437fbaddd442e8726b293bedc6.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD00097%27 HTTP/1.1" 200 None
2026-03-30 10:38:52 [auto1.de] INFO: Saving data for HD00097: {'created_time': 1774867132.603141, 'last_price_update_time': 1774867132.603152, 'auction_closing_time': 1774971332.0}
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD00097') HTTP/1.1" 204 0
2026-03-30 10:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bdfb13c-5990-5f94-8f4b-163154b2857f with identifier: NG72078
2026-03-30 10:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bdfb13c-5990-5f94-8f4b-163154b2857f with identifier: NG72078
2026-03-30 10:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bdfb13c-5990-5f94-8f4b-163154b2857f with identifier: NG72078 to the API
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_92e4cf464bd6ceb7b365bb171213032c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:03:08Z',
 'fuel_type': 'petrol',
 'id': '4bdfb13c-5990-5f94-8f4b-163154b2857f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG72078',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 178603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3196957,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_b667168a983ffc5137054e5aeb454d20.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3055091,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_92e4cf464bd6ceb7b365bb171213032c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3059197,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_3562d824b682be2cdec29b27a0768534.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3032789,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_e2b65e3c6332a14ebdd0c405fe717772.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3010751,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_62a51a6d4123a199c33bc91294b8b315.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2942999,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_f072825d464ab3bfcf3d3198db76eead.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2772382,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_87d6d2a55c037e9039eae20a1a36c203.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3021282,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_ba4369490a0c9ab3cb86b547844ce674.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3125470,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_f2619bdc674cab44c12f07e221646fa3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bdfb13c-5990-5f94-8f4b-163154b2857f/4bdfb13c-5990-5f94-8f4b-163154b2857f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3069958,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/42/83429bd093f42d42b14c094905a3970f/pa/NG72078_c235e1fac6b851b7139bdba3d9766d32.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2019}
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG72078%27 HTTP/1.1" 200 None
2026-03-30 10:38:53 [auto1.de] INFO: Saving data for NG72078: {'created_time': 1774867133.200675, 'last_price_update_time': 1774867133.200687, 'auction_closing_time': 1774969388.0}
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG72078') HTTP/1.1" 204 0
2026-03-30 10:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7f97e5e-8884-55f3-8ccf-af7c698e0fa6 with identifier: WD03646
2026-03-30 10:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7f97e5e-8884-55f3-8ccf-af7c698e0fa6 with identifier: WD03646
2026-03-30 10:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7f97e5e-8884-55f3-8ccf-af7c698e0fa6 with identifier: WD03646 to the API
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_58df5e2d83d98ad75abff2e10f6f136c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:54:31Z',
 'fuel_type': 'petrol',
 'id': 'd7f97e5e-8884-55f3-8ccf-af7c698e0fa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD03646',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 45098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_58df5e2d83d98ad75abff2e10f6f136c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_8219d245dbc968ffa33431834cc23161.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_6194179781bc708bbdef25c4db842c23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_28329be8eb800af1e078ff674c52229c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_71f5bbebfbbf3a794fb608a74f71af35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_f6975209ae3be432f4b4068b3886062d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_1f94bb342cde16604b388995000b069d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_b8f8fa3265c87623ae971e4864de9ab9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_6faef50dddb5889a75b7290fea24d759.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f97e5e-8884-55f3-8ccf-af7c698e0fa6/d7f97e5e-8884-55f3-8ccf-af7c698e0fa6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/2c/dc2c70d68429b94ab0a70a61182629cb/pa/WD03646_20812345e6c0c07766901ce8091dd512.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD03646%27 HTTP/1.1" 200 None
2026-03-30 10:38:53 [auto1.de] INFO: Saving data for WD03646: {'created_time': 1774867133.604417, 'last_price_update_time': 1774867133.604429, 'auction_closing_time': 1774972471.0}
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD03646') HTTP/1.1" 204 0
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd7%252Fa5d77be0a634c8ab53888d97a0db1d98%252Fpa%252FBB05879_90fb60bf88cd12c09610daa393005ca7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_90fb60bf88cd12c09610daa393005ca7.jpg not downloaded yet
2026-03-30 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA21775> (referer: https://www.auto1.com/v1/car-details-view/JA21775/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WL02580> (referer: https://www.auto1.com/v1/car-details-view/WL02580/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3654fb31-e3a6-5db9-a661-5d8b36abb97c with identifier: CV02833
2026-03-30 10:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3654fb31-e3a6-5db9-a661-5d8b36abb97c with scrape type 1
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3654fb31-e3a6-5db9-a661-5d8b36abb97c
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_d974fff76d7941e7358b9db0cbb9650a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_d974fff76d7941e7358b9db0cbb9650a.jpg not downloaded yet
2026-03-30 10:38:53 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 9429 | hits on page: 40
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd7%252Fa5d77be0a634c8ab53888d97a0db1d98%252Fpa%252FBB05879_e82da02c0d0a9d494f47efb150bb9a26.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_e82da02c0d0a9d494f47efb150bb9a26.jpg not downloaded yet
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_25b810b930d16ccbb99d01c2226e7cb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_25b810b930d16ccbb99d01c2226e7cb0.jpg not downloaded yet
2026-03-30 10:38:53 [auto1.de] INFO: Found listing with ID: GE83879
2026-03-30 10:38:53 [auto1.de] INFO: Found listing with ID: MT85534
2026-03-30 10:38:53 [auto1.de] INFO: Found listing with ID: RE68011
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE68011%27 HTTP/1.1" 200 None
2026-03-30 10:38:53 [auto1.de] INFO: Scrape type for RE68011: 0
2026-03-30 10:38:53 [auto1.de] INFO: Found listing with ID: DH10613
2026-03-30 10:38:53 [auto1.de] INFO: Found listing with ID: KR19122
2026-03-30 10:38:53 [auto1.de] INFO: Found listing with ID: AE02185
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE02185%27 HTTP/1.1" 200 None
2026-03-30 10:38:53 [auto1.de] INFO: Scrape type for AE02185: 1
2026-03-30 10:38:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_9f32e7703e3bec3860be9b6b6fd7ce02.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_9f32e7703e3bec3860be9b6b6fd7ce02.jpg not downloaded yet
2026-03-30 10:38:53 [auto1.de] INFO: Found listing with ID: TB03254
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB03254%27 HTTP/1.1" 200 None
2026-03-30 10:38:53 [auto1.de] INFO: Scrape type for TB03254: 2
2026-03-30 10:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f59441d-466b-5463-855e-2f3bec257b06 with identifier: TB03254
2026-03-30 10:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f59441d-466b-5463-855e-2f3bec257b06 with scrape type 2
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f59441d-466b-5463-855e-2f3bec257b06 with scrape type 2
2026-03-30 10:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f59441d-466b-5463-855e-2f3bec257b06, identifier: TB03254
2026-03-30 10:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f59441d-466b-5463-855e-2f3bec257b06 with identifier: TB03254
2026-03-30 10:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f59441d-466b-5463-855e-2f3bec257b06 with identifier: TB03254
2026-03-30 10:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f59441d-466b-5463-855e-2f3bec257b06 with identifier: TB03254 to the API
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:16:46Z',
 'fuel_type': 'diesel',
 'id': '6f59441d-466b-5463-855e-2f3bec257b06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB03254',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 27250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-17',
 'seller_name': None,
 'title': 'Renault Master 2.3 BLUE dCi L3H2 HKa 3,5t',
 'transmission': 'manual',
 'trim': 'L3H2 HKa 3,5t',
 'year': 2023}
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB03254%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [auto1.de] INFO: Saving data for TB03254: {'auction_closing_time': 1774970206.0, 'created_time': 1774522300.949883, 'last_price_update_time': 1774867134.278895}
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB03254') HTTP/1.1" 204 0
2026-03-30 10:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f with identifier: JA21775
2026-03-30 10:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f with scrape type 1
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F82%252F28820d62f7dd09346486aa28ae45faaf%252Fpa%252FJA21775_415e17ce2e6c2d9da0f6ef13e5a44458.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_415e17ce2e6c2d9da0f6ef13e5a44458.jpg already downloaded
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F82%252F28820d62f7dd09346486aa28ae45faaf%252Fpa%252FJA21775_ce41d7fb7d4505fa769f53ce49b2a577.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_ce41d7fb7d4505fa769f53ce49b2a577.jpg already downloaded
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F82%252F28820d62f7dd09346486aa28ae45faaf%252Fpa%252FJA21775_3b62a00226109ffad084157906fa5283.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_3b62a00226109ffad084157906fa5283.jpg already downloaded
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F82%252F28820d62f7dd09346486aa28ae45faaf%252Fpa%252FJA21775_33c7ef0004665f468207b1913531c0f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_33c7ef0004665f468207b1913531c0f4.jpg already downloaded
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F82%252F28820d62f7dd09346486aa28ae45faaf%252Fpa%252FJA21775_fb295ba84cd5c36b63c83ad205205693.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_fb295ba84cd5c36b63c83ad205205693.jpg already downloaded
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F82%252F28820d62f7dd09346486aa28ae45faaf%252Fpa%252FJA21775_d4b5895ec1b15761cf35075487e7db97.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_d4b5895ec1b15761cf35075487e7db97.jpg already downloaded
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F82%252F28820d62f7dd09346486aa28ae45faaf%252Fpa%252FJA21775_c80a9fa191439ec828eb9880c5a58c21.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_c80a9fa191439ec828eb9880c5a58c21.jpg already downloaded
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F82%252F28820d62f7dd09346486aa28ae45faaf%252Fpa%252FJA21775_9e46208dcc92552589f13f318edcb064.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_9e46208dcc92552589f13f318edcb064.jpg already downloaded
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F82%252F28820d62f7dd09346486aa28ae45faaf%252Fpa%252FJA21775_a4c16bfbab38ab60984112685a6eb5c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_a4c16bfbab38ab60984112685a6eb5c3.jpg already downloaded
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F82%252F28820d62f7dd09346486aa28ae45faaf%252Fpa%252FJA21775_5a98f2a7754e187922d013cbab9e27c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_5a98f2a7754e187922d013cbab9e27c8.jpg already downloaded
2026-03-30 10:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f, identifier: JA21775
2026-03-30 10:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40d7c578-c4b1-55ed-bc33-15175e40b0d2 with identifier: WL02580
2026-03-30 10:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40d7c578-c4b1-55ed-bc33-15175e40b0d2 with scrape type 1
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40d7c578-c4b1-55ed-bc33-15175e40b0d2
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_74114a446c5bb8d2fd8f02695dd2c4c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_74114a446c5bb8d2fd8f02695dd2c4c8.jpg not downloaded yet
2026-03-30 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_695d3fe3d76f9ba7d89c043a2b06d21e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_90fb60bf88cd12c09610daa393005ca7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_9dfb6eec1a7447be9897a336815d0bca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_9dfb6eec1a7447be9897a336815d0bca.jpg not downloaded yet
2026-03-30 10:38:54 [auto1.de] INFO: Found listing with ID: LM89418
2026-03-30 10:38:54 [auto1.de] INFO: Found listing with ID: WZ57217
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ57217%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [auto1.de] INFO: Scrape type for WZ57217: 2
2026-03-30 10:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb83d477-a986-51be-bcde-50a204cf5b3b with identifier: WZ57217
2026-03-30 10:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb83d477-a986-51be-bcde-50a204cf5b3b with scrape type 2
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb83d477-a986-51be-bcde-50a204cf5b3b with scrape type 2
2026-03-30 10:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb83d477-a986-51be-bcde-50a204cf5b3b, identifier: WZ57217
2026-03-30 10:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f with identifier: JA21775
2026-03-30 10:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f with identifier: JA21775
2026-03-30 10:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f with identifier: JA21775 to the API
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JA21775>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:38:52Z',
 'fuel_type': 'petrol',
 'id': '1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA21775',
 'listing': 'auction',
 'location': 'DE, Fockbek',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 84687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_415e17ce2e6c2d9da0f6ef13e5a44458.jpg',
                'https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_ce41d7fb7d4505fa769f53ce49b2a577.jpg',
                'https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_3b62a00226109ffad084157906fa5283.jpg',
                'https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_33c7ef0004665f468207b1913531c0f4.jpg',
                'https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_fb295ba84cd5c36b63c83ad205205693.jpg',
                'https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_d4b5895ec1b15761cf35075487e7db97.jpg',
                'https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_c80a9fa191439ec828eb9880c5a58c21.jpg',
                'https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_9e46208dcc92552589f13f318edcb064.jpg',
                'https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_a4c16bfbab38ab60984112685a6eb5c3.jpg',
                'https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_5a98f2a7754e187922d013cbab9e27c8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f/1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_415e17ce2e6c2d9da0f6ef13e5a44458.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f/1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_ce41d7fb7d4505fa769f53ce49b2a577.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f/1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_3b62a00226109ffad084157906fa5283.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f/1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_33c7ef0004665f468207b1913531c0f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f/1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_fb295ba84cd5c36b63c83ad205205693.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f/1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_d4b5895ec1b15761cf35075487e7db97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f/1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_c80a9fa191439ec828eb9880c5a58c21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f/1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_9e46208dcc92552589f13f318edcb064.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f/1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_a4c16bfbab38ab60984112685a6eb5c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f/1f2e3f5f-4a77-5e8a-8fef-d4d8ba1b962f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/82/28820d62f7dd09346486aa28ae45faaf/pa/JA21775_5a98f2a7754e187922d013cbab9e27c8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA21775%27 HTTP/1.1" 200 None
2026-03-30 10:38:55 [auto1.de] INFO: Saving data for JA21775: {'created_time': 1774867135.087706, 'last_price_update_time': 1774867135.087719, 'auction_closing_time': 1774971532.0}
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA21775') HTTP/1.1" 204 0
2026-03-30 10:38:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_c38b535511fc672afac4ca10c9f2bc3e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_459efcd8817fce42516006f41e28bddd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_e2f4a19ef3ff516e293a4a9fc8e899e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb83d477-a986-51be-bcde-50a204cf5b3b with identifier: WZ57217
2026-03-30 10:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb83d477-a986-51be-bcde-50a204cf5b3b with identifier: WZ57217
2026-03-30 10:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb83d477-a986-51be-bcde-50a204cf5b3b with identifier: WZ57217 to the API
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:55:54Z',
 'fuel_type': 'diesel',
 'id': 'cb83d477-a986-51be-bcde-50a204cf5b3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ57217',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 153244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-10',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Feel XL',
 'transmission': 'manual',
 'trim': 'Feel XL',
 'year': 2020}
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ57217%27 HTTP/1.1" 200 None
2026-03-30 10:38:55 [auto1.de] INFO: Saving data for WZ57217: {'auction_closing_time': 1774972554.0, 'created_time': 1774379810.485355, 'last_price_update_time': 1774867135.438839}
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ57217') HTTP/1.1" 204 0
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_15bbbe851bae93193b3810cfd490281f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_15bbbe851bae93193b3810cfd490281f.jpg not downloaded yet
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_fa9d6a0257a0040bac7d034bc5b83146.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_fa9d6a0257a0040bac7d034bc5b83146.jpg not downloaded yet
2026-03-30 10:38:55 [auto1.de] INFO: Found listing with ID: BJ56368
2026-03-30 10:38:55 [auto1.de] INFO: Found listing with ID: UU86547
2026-03-30 10:38:55 [auto1.de] INFO: Found listing with ID: ZG67358
2026-03-30 10:38:55 [auto1.de] INFO: Found listing with ID: ZF87994
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF87994%27 HTTP/1.1" 200 None
2026-03-30 10:38:55 [auto1.de] INFO: Scrape type for ZF87994: 2
2026-03-30 10:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80131c6b-0c49-5352-8491-a87b87e49e3f with identifier: ZF87994
2026-03-30 10:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80131c6b-0c49-5352-8491-a87b87e49e3f with scrape type 2
2026-03-30 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80131c6b-0c49-5352-8491-a87b87e49e3f with scrape type 2
2026-03-30 10:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80131c6b-0c49-5352-8491-a87b87e49e3f, identifier: ZF87994
2026-03-30 10:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80131c6b-0c49-5352-8491-a87b87e49e3f with identifier: ZF87994
2026-03-30 10:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80131c6b-0c49-5352-8491-a87b87e49e3f with identifier: ZF87994
2026-03-30 10:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80131c6b-0c49-5352-8491-a87b87e49e3f with identifier: ZF87994 to the API
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:10:00Z',
 'fuel_type': 'petrol',
 'id': '80131c6b-0c49-5352-8491-a87b87e49e3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF87994',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 81023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2014}
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF87994%27 HTTP/1.1" 200 None
2026-03-30 10:38:55 [auto1.de] INFO: Saving data for ZF87994: {'auction_closing_time': 1774969800.0, 'created_time': 1774290981.453057, 'last_price_update_time': 1774867135.973176}
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF87994') HTTP/1.1" 204 0
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_b80ef353ac68dc22e1833eb2a7e88be6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_b80ef353ac68dc22e1833eb2a7e88be6.jpg not downloaded yet
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee319d0>
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_934ce49c-e687-5cb6-b170-186088eaa12f/934ce49c-e687-5cb6-b170-186088eaa12f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd7%252Fa5d77be0a634c8ab53888d97a0db1d98%252Fpa%252FBB05879_695d3fe3d76f9ba7d89c043a2b06d21e.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_695d3fe3d76f9ba7d89c043a2b06d21e.jpg saved to cache
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 934ce49c-e687-5cb6-b170-186088eaa12f
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea2e90>
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_934ce49c-e687-5cb6-b170-186088eaa12f/934ce49c-e687-5cb6-b170-186088eaa12f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd7%252Fa5d77be0a634c8ab53888d97a0db1d98%252Fpa%252FBB05879_90fb60bf88cd12c09610daa393005ca7.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_90fb60bf88cd12c09610daa393005ca7.jpg saved to cache
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 934ce49c-e687-5cb6-b170-186088eaa12f
2026-03-30 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_9009d70e8ed927e61efdafe15d5ee607.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_d6a03da897456b54473f668ce8953192.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_0c6ee395e951b4b431369b3214f32de1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_0c6ee395e951b4b431369b3214f32de1.jpg not downloaded yet
2026-03-30 10:38:56 [auto1.de] INFO: Found listing with ID: NT58972
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT58972%27 HTTP/1.1" 200 None
2026-03-30 10:38:56 [auto1.de] INFO: Scrape type for NT58972: 1
2026-03-30 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_0a7e1d9524673c5da3218dd694ef8239.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_8eafb4ef7080165cd4c45b2694cbfecb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_9f32e7703e3bec3860be9b6b6fd7ce02.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_93e39bfc046915c0632e111e5a10b0b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_93e39bfc046915c0632e111e5a10b0b7.jpg not downloaded yet
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_f36ebcd13382b4f82ebf6b69900ba504.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_f36ebcd13382b4f82ebf6b69900ba504.jpg not downloaded yet
2026-03-30 10:38:56 [auto1.de] INFO: Found listing with ID: UF92317
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF92317%27 HTTP/1.1" 200 None
2026-03-30 10:38:56 [auto1.de] INFO: Scrape type for UF92317: 2
2026-03-30 10:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ebe2cb6-083a-52a8-b4d4-05d2268ddc74 with identifier: UF92317
2026-03-30 10:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ebe2cb6-083a-52a8-b4d4-05d2268ddc74 with scrape type 2
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ebe2cb6-083a-52a8-b4d4-05d2268ddc74 with scrape type 2
2026-03-30 10:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ebe2cb6-083a-52a8-b4d4-05d2268ddc74, identifier: UF92317
2026-03-30 10:38:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4303450>
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae1c9ed5-947f-5456-8b52-dc5c154a4326/ae1c9ed5-947f-5456-8b52-dc5c154a4326_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F69%252F2b69c20fc926486ee89c37a748def1e3%252Fpa%252FKX41187_c38b535511fc672afac4ca10c9f2bc3e.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_c38b535511fc672afac4ca10c9f2bc3e.jpg saved to cache
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae1c9ed5-947f-5456-8b52-dc5c154a4326
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4285890>
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_934ce49c-e687-5cb6-b170-186088eaa12f/934ce49c-e687-5cb6-b170-186088eaa12f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd7%252Fa5d77be0a634c8ab53888d97a0db1d98%252Fpa%252FBB05879_459efcd8817fce42516006f41e28bddd.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_459efcd8817fce42516006f41e28bddd.jpg saved to cache
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 934ce49c-e687-5cb6-b170-186088eaa12f
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee32490>
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae1c9ed5-947f-5456-8b52-dc5c154a4326/ae1c9ed5-947f-5456-8b52-dc5c154a4326_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F69%252F2b69c20fc926486ee89c37a748def1e3%252Fpa%252FKX41187_e2f4a19ef3ff516e293a4a9fc8e899e7.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_e2f4a19ef3ff516e293a4a9fc8e899e7.jpg saved to cache
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ae1c9ed5-947f-5456-8b52-dc5c154a4326
2026-03-30 10:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ebe2cb6-083a-52a8-b4d4-05d2268ddc74 with identifier: UF92317
2026-03-30 10:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ebe2cb6-083a-52a8-b4d4-05d2268ddc74 with identifier: UF92317
2026-03-30 10:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ebe2cb6-083a-52a8-b4d4-05d2268ddc74 with identifier: UF92317 to the API
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:06:33Z',
 'fuel_type': 'diesel',
 'id': '5ebe2cb6-083a-52a8-b4d4-05d2268ddc74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF92317',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 101871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-29',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 dCi Tekna 4x4',
 'transmission': 'manual',
 'trim': 'Tekna 4x4',
 'year': 2017}
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF92317%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [auto1.de] INFO: Saving data for UF92317: {'auction_closing_time': 1774969593.0, 'created_time': 1773686593.827467, 'last_price_update_time': 1774867137.089494}
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF92317') HTTP/1.1" 204 0
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_a2024db1443ffa9484e5e897b493a5ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_a2024db1443ffa9484e5e897b493a5ba.jpg not downloaded yet
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_d642d43bf921dc31677e711db74bd5f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_d642d43bf921dc31677e711db74bd5f8.jpg not downloaded yet
2026-03-30 10:38:57 [auto1.de] INFO: Found listing with ID: LP80912
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP80912%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [auto1.de] INFO: Scrape type for LP80912: 1
2026-03-30 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_e82da02c0d0a9d494f47efb150bb9a26.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_25b810b930d16ccbb99d01c2226e7cb0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_c84f9b875d6c28523dbd3f21affe2b1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_c84f9b875d6c28523dbd3f21affe2b1f.jpg not downloaded yet
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee400850>
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_934ce49c-e687-5cb6-b170-186088eaa12f/934ce49c-e687-5cb6-b170-186088eaa12f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd7%252Fa5d77be0a634c8ab53888d97a0db1d98%252Fpa%252FBB05879_9009d70e8ed927e61efdafe15d5ee607.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_9009d70e8ed927e61efdafe15d5ee607.jpg saved to cache
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 934ce49c-e687-5cb6-b170-186088eaa12f
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef5bd0>
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae1c9ed5-947f-5456-8b52-dc5c154a4326/ae1c9ed5-947f-5456-8b52-dc5c154a4326_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F69%252F2b69c20fc926486ee89c37a748def1e3%252Fpa%252FKX41187_d6a03da897456b54473f668ce8953192.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_d6a03da897456b54473f668ce8953192.jpg saved to cache
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ae1c9ed5-947f-5456-8b52-dc5c154a4326
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef1b490>
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae1c9ed5-947f-5456-8b52-dc5c154a4326/ae1c9ed5-947f-5456-8b52-dc5c154a4326_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F69%252F2b69c20fc926486ee89c37a748def1e3%252Fpa%252FKX41187_0a7e1d9524673c5da3218dd694ef8239.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_0a7e1d9524673c5da3218dd694ef8239.jpg saved to cache
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae1c9ed5-947f-5456-8b52-dc5c154a4326
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4338f10>
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae1c9ed5-947f-5456-8b52-dc5c154a4326/ae1c9ed5-947f-5456-8b52-dc5c154a4326_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F69%252F2b69c20fc926486ee89c37a748def1e3%252Fpa%252FKX41187_8eafb4ef7080165cd4c45b2694cbfecb.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_8eafb4ef7080165cd4c45b2694cbfecb.jpg saved to cache
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae1c9ed5-947f-5456-8b52-dc5c154a4326
2026-03-30 10:38:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae1c9ed5-947f-5456-8b52-dc5c154a4326, skipping ID generation
2026-03-30 10:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae1c9ed5-947f-5456-8b52-dc5c154a4326 with scrape type 1
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae1c9ed5-947f-5456-8b52-dc5c154a4326 sending to next pipeline
2026-03-30 10:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae1c9ed5-947f-5456-8b52-dc5c154a4326, identifier: KX41187
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41c4bd0>
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_9f32e7703e3bec3860be9b6b6fd7ce02.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_9f32e7703e3bec3860be9b6b6fd7ce02.jpg saved to cache
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3654fb31-e3a6-5db9-a661-5d8b36abb97c
2026-03-30 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_fa9d6a0257a0040bac7d034bc5b83146.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_5657e8457c75507b72396d697207d791.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_5657e8457c75507b72396d697207d791.jpg not downloaded yet
2026-03-30 10:38:57 [auto1.de] INFO: Found listing with ID: YH22570
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH22570%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [auto1.de] INFO: Scrape type for YH22570: 1
2026-03-30 10:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae1c9ed5-947f-5456-8b52-dc5c154a4326 with identifier: KX41187
2026-03-30 10:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae1c9ed5-947f-5456-8b52-dc5c154a4326 with identifier: KX41187
2026-03-30 10:38:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae1c9ed5-947f-5456-8b52-dc5c154a4326 with identifier: KX41187 to the API
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_8eafb4ef7080165cd4c45b2694cbfecb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:00:40Z',
 'fuel_type': 'petrol',
 'id': 'ae1c9ed5-947f-5456-8b52-dc5c154a4326',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX41187',
 'listing': 'auction',
 'location': 'DE, Dresden',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 145615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1c9ed5-947f-5456-8b52-dc5c154a4326/ae1c9ed5-947f-5456-8b52-dc5c154a4326_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_8eafb4ef7080165cd4c45b2694cbfecb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1c9ed5-947f-5456-8b52-dc5c154a4326/ae1c9ed5-947f-5456-8b52-dc5c154a4326_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_0a7e1d9524673c5da3218dd694ef8239.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1c9ed5-947f-5456-8b52-dc5c154a4326/ae1c9ed5-947f-5456-8b52-dc5c154a4326_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_d6a03da897456b54473f668ce8953192.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1c9ed5-947f-5456-8b52-dc5c154a4326/ae1c9ed5-947f-5456-8b52-dc5c154a4326_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_c38b535511fc672afac4ca10c9f2bc3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1c9ed5-947f-5456-8b52-dc5c154a4326/ae1c9ed5-947f-5456-8b52-dc5c154a4326_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/69/2b69c20fc926486ee89c37a748def1e3/pa/KX41187_e2f4a19ef3ff516e293a4a9fc8e899e7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-07-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2008}
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX41187%27 HTTP/1.1" 200 None
2026-03-30 10:38:58 [auto1.de] INFO: Saving data for KX41187: {'created_time': 1774867138.061006, 'last_price_update_time': 1774867138.061021, 'auction_closing_time': 1774969240.0}
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX41187') HTTP/1.1" 204 0
2026-03-30 10:38:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_71dc275cfdeff60f8dcbccd9751b8ff6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_71dc275cfdeff60f8dcbccd9751b8ff6.jpg not downloaded yet
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_cb757e76838911ae127a1e133eba5d37.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_cb757e76838911ae127a1e133eba5d37.jpg not downloaded yet
2026-03-30 10:38:58 [auto1.de] INFO: Found listing with ID: JB82984
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB82984%27 HTTP/1.1" 200 None
2026-03-30 10:38:58 [auto1.de] INFO: Scrape type for JB82984: 2
2026-03-30 10:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8373a845-25b3-52a1-80da-9b7997b6bd20 with identifier: JB82984
2026-03-30 10:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8373a845-25b3-52a1-80da-9b7997b6bd20 with scrape type 2
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8373a845-25b3-52a1-80da-9b7997b6bd20 with scrape type 2
2026-03-30 10:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8373a845-25b3-52a1-80da-9b7997b6bd20, identifier: JB82984
2026-03-30 10:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec5410>
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_934ce49c-e687-5cb6-b170-186088eaa12f/934ce49c-e687-5cb6-b170-186088eaa12f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd7%252Fa5d77be0a634c8ab53888d97a0db1d98%252Fpa%252FBB05879_e82da02c0d0a9d494f47efb150bb9a26.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_e82da02c0d0a9d494f47efb150bb9a26.jpg saved to cache
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 934ce49c-e687-5cb6-b170-186088eaa12f
2026-03-30 10:38:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 934ce49c-e687-5cb6-b170-186088eaa12f, skipping ID generation
2026-03-30 10:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 934ce49c-e687-5cb6-b170-186088eaa12f with scrape type 1
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 934ce49c-e687-5cb6-b170-186088eaa12f sending to next pipeline
2026-03-30 10:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 934ce49c-e687-5cb6-b170-186088eaa12f, identifier: BB05879
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e4410>
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_25b810b930d16ccbb99d01c2226e7cb0.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_25b810b930d16ccbb99d01c2226e7cb0.jpg saved to cache
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3654fb31-e3a6-5db9-a661-5d8b36abb97c
2026-03-30 10:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_0c6ee395e951b4b431369b3214f32de1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8373a845-25b3-52a1-80da-9b7997b6bd20 with identifier: JB82984
2026-03-30 10:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8373a845-25b3-52a1-80da-9b7997b6bd20 with identifier: JB82984
2026-03-30 10:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8373a845-25b3-52a1-80da-9b7997b6bd20 with identifier: JB82984 to the API
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:51:42Z',
 'fuel_type': 'diesel',
 'id': '8373a845-25b3-52a1-80da-9b7997b6bd20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB82984',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 169292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-11',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB82984%27 HTTP/1.1" 200 None
2026-03-30 10:38:58 [auto1.de] INFO: Saving data for JB82984: {'auction_closing_time': 1774972302.0, 'created_time': 1773685918.365542, 'last_price_update_time': 1774867138.792782}
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB82984') HTTP/1.1" 204 0
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_4c19d6ecbdf2dc72023d0957f1e7268b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_4c19d6ecbdf2dc72023d0957f1e7268b.jpg not downloaded yet
2026-03-30 10:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 934ce49c-e687-5cb6-b170-186088eaa12f with identifier: BB05879
2026-03-30 10:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 934ce49c-e687-5cb6-b170-186088eaa12f with identifier: BB05879
2026-03-30 10:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 934ce49c-e687-5cb6-b170-186088eaa12f with identifier: BB05879 to the API
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_e82da02c0d0a9d494f47efb150bb9a26.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:09:30Z',
 'fuel_type': 'petrol',
 'id': '934ce49c-e687-5cb6-b170-186088eaa12f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB05879',
 'listing': 'auction',
 'location': 'DE, Wuppertal',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 129754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934ce49c-e687-5cb6-b170-186088eaa12f/934ce49c-e687-5cb6-b170-186088eaa12f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_9009d70e8ed927e61efdafe15d5ee607.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934ce49c-e687-5cb6-b170-186088eaa12f/934ce49c-e687-5cb6-b170-186088eaa12f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_459efcd8817fce42516006f41e28bddd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934ce49c-e687-5cb6-b170-186088eaa12f/934ce49c-e687-5cb6-b170-186088eaa12f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_695d3fe3d76f9ba7d89c043a2b06d21e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934ce49c-e687-5cb6-b170-186088eaa12f/934ce49c-e687-5cb6-b170-186088eaa12f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_90fb60bf88cd12c09610daa393005ca7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934ce49c-e687-5cb6-b170-186088eaa12f/934ce49c-e687-5cb6-b170-186088eaa12f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/d7/a5d77be0a634c8ab53888d97a0db1d98/pa/BB05879_e82da02c0d0a9d494f47efb150bb9a26.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 150 Jahre Opel',
 'transmission': 'manual',
 'trim': '150 Jahre',
 'year': 2012}
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB05879%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [auto1.de] INFO: Saving data for BB05879: {'created_time': 1774867139.203605, 'last_price_update_time': 1774867139.203616, 'auction_closing_time': 1774969770.0}
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB05879') HTTP/1.1" 204 0
2026-03-30 10:38:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:59 [auto1.de] INFO: Found listing with ID: FS39177
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS39177%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [auto1.de] INFO: Scrape type for FS39177: 1
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434d390>
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_fa9d6a0257a0040bac7d034bc5b83146.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_fa9d6a0257a0040bac7d034bc5b83146.jpg saved to cache
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3654fb31-e3a6-5db9-a661-5d8b36abb97c
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_f84a477cf28616a8247f24d3cec318ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_f84a477cf28616a8247f24d3cec318ae.jpg not downloaded yet
2026-03-30 10:38:59 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 9429 | hits on page: 40
2026-03-30 10:38:59 [auto1.de] INFO: Found listing with ID: BF55628
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF55628%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [auto1.de] INFO: Scrape type for BF55628: 1
2026-03-30 10:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AE02185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_f36ebcd13382b4f82ebf6b69900ba504.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_83dee00d8c6cfdb52d43016f83433375.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_83dee00d8c6cfdb52d43016f83433375.jpg not downloaded yet
2026-03-30 10:38:59 [auto1.de] INFO: Found listing with ID: RU61041
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU61041%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [auto1.de] INFO: Scrape type for RU61041: 1
2026-03-30 10:38:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee459750>
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_0c6ee395e951b4b431369b3214f32de1.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_0c6ee395e951b4b431369b3214f32de1.jpg saved to cache
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3654fb31-e3a6-5db9-a661-5d8b36abb97c
2026-03-30 10:38:59 [auto1.de] INFO: Found listing with ID: RU80356
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU80356%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [auto1.de] INFO: Scrape type for RU80356: 1
2026-03-30 10:38:59 [auto1.de] INFO: Found listing with ID: AE13145
2026-03-30 10:38:59 [auto1.de] INFO: Found listing with ID: FJ23052
2026-03-30 10:38:59 [auto1.de] INFO: Found listing with ID: WS77371
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS77371%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [auto1.de] INFO: Scrape type for WS77371: 1
2026-03-30 10:38:59 [auto1.de] INFO: Found listing with ID: FR25339
2026-03-30 10:38:59 [auto1.de] INFO: Found listing with ID: NE66153
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE66153%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [auto1.de] INFO: Scrape type for NE66153: 2
2026-03-30 10:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b7963ed-97a4-51fd-8563-042d00015959 with identifier: NE66153
2026-03-30 10:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b7963ed-97a4-51fd-8563-042d00015959 with scrape type 2
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b7963ed-97a4-51fd-8563-042d00015959 with scrape type 2
2026-03-30 10:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b7963ed-97a4-51fd-8563-042d00015959, identifier: NE66153
2026-03-30 10:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b7963ed-97a4-51fd-8563-042d00015959 with identifier: NE66153
2026-03-30 10:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b7963ed-97a4-51fd-8563-042d00015959 with identifier: NE66153
2026-03-30 10:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b7963ed-97a4-51fd-8563-042d00015959 with identifier: NE66153 to the API
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:50:18Z',
 'fuel_type': 'petrol',
 'id': '4b7963ed-97a4-51fd-8563-042d00015959',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE66153',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 56759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-23',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Trend blue',
 'transmission': 'manual',
 'trim': 'Trend blue',
 'year': 2017}
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE66153%27 HTTP/1.1" 200 None
2026-03-30 10:39:00 [auto1.de] INFO: Saving data for NE66153: {'auction_closing_time': 1774972218.0, 'created_time': 1774262652.428039, 'last_price_update_time': 1774867140.419091}
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE66153') HTTP/1.1" 204 0
2026-03-30 10:39:00 [auto1.de] INFO: Found listing with ID: CK72706
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72706%27 HTTP/1.1" 200 None
2026-03-30 10:39:00 [auto1.de] INFO: Scrape type for CK72706: 2
2026-03-30 10:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34c72606-c2d4-56ee-b99d-7c8a27d83b98 with identifier: CK72706
2026-03-30 10:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34c72606-c2d4-56ee-b99d-7c8a27d83b98 with scrape type 2
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34c72606-c2d4-56ee-b99d-7c8a27d83b98 with scrape type 2
2026-03-30 10:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34c72606-c2d4-56ee-b99d-7c8a27d83b98, identifier: CK72706
2026-03-30 10:39:00 [auto1.de] INFO: Found listing with ID: MF98789
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF98789%27 HTTP/1.1" 200 None
2026-03-30 10:39:00 [auto1.de] INFO: Scrape type for MF98789: 1
2026-03-30 10:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34c72606-c2d4-56ee-b99d-7c8a27d83b98 with identifier: CK72706
2026-03-30 10:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34c72606-c2d4-56ee-b99d-7c8a27d83b98 with identifier: CK72706
2026-03-30 10:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34c72606-c2d4-56ee-b99d-7c8a27d83b98 with identifier: CK72706 to the API
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:18:37Z',
 'fuel_type': 'diesel',
 'id': '34c72606-c2d4-56ee-b99d-7c8a27d83b98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK72706',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 51646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-06',
 'seller_name': None,
 'title': 'Audi A4 40 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2020}
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72706%27 HTTP/1.1" 200 None
2026-03-30 10:39:01 [auto1.de] INFO: Saving data for CK72706: {'auction_closing_time': 1774970317.0, 'created_time': 1773344415.113027, 'last_price_update_time': 1774867141.04185}
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK72706') HTTP/1.1" 204 0
2026-03-30 10:39:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f432e0d0>
2026-03-30 10:39:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_f36ebcd13382b4f82ebf6b69900ba504.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_f36ebcd13382b4f82ebf6b69900ba504.jpg saved to cache
2026-03-30 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3654fb31-e3a6-5db9-a661-5d8b36abb97c
2026-03-30 10:39:01 [auto1.de] INFO: Found listing with ID: TM60818
2026-03-30 10:39:01 [auto1.de] INFO: Found listing with ID: GN56413
2026-03-30 10:39:01 [auto1.de] INFO: Found listing with ID: SE98527
2026-03-30 10:39:01 [auto1.de] INFO: Found listing with ID: UJ24923
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ24923%27 HTTP/1.1" 200 None
2026-03-30 10:39:01 [auto1.de] INFO: Scrape type for UJ24923: 1
2026-03-30 10:39:01 [auto1.de] INFO: Found listing with ID: LF89175
2026-03-30 10:39:01 [auto1.de] INFO: Found listing with ID: SE64605
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE64605%27 HTTP/1.1" 200 None
2026-03-30 10:39:01 [auto1.de] INFO: Scrape type for SE64605: 2
2026-03-30 10:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fd7fcc9-7f2a-5bae-aa5a-f0054f98b3f1 with identifier: SE64605
2026-03-30 10:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fd7fcc9-7f2a-5bae-aa5a-f0054f98b3f1 with scrape type 2
2026-03-30 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fd7fcc9-7f2a-5bae-aa5a-f0054f98b3f1 with scrape type 2
2026-03-30 10:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fd7fcc9-7f2a-5bae-aa5a-f0054f98b3f1, identifier: SE64605
2026-03-30 10:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NT58972/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fd7fcc9-7f2a-5bae-aa5a-f0054f98b3f1 with identifier: SE64605
2026-03-30 10:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fd7fcc9-7f2a-5bae-aa5a-f0054f98b3f1 with identifier: SE64605
2026-03-30 10:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fd7fcc9-7f2a-5bae-aa5a-f0054f98b3f1 with identifier: SE64605 to the API
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:14:48Z',
 'fuel_type': 'petrol',
 'id': '4fd7fcc9-7f2a-5bae-aa5a-f0054f98b3f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE64605',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 82159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-27',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2014}
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE64605%27 HTTP/1.1" 200 None
2026-03-30 10:39:01 [auto1.de] INFO: Saving data for SE64605: {'auction_closing_time': 1774970088.0, 'created_time': 1773343648.533171, 'last_price_update_time': 1774867141.633442}
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE64605') HTTP/1.1" 204 0
2026-03-30 10:39:01 [auto1.de] INFO: Found listing with ID: VS32434
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS32434%27 HTTP/1.1" 200 None
2026-03-30 10:39:01 [auto1.de] INFO: Scrape type for VS32434: 1
2026-03-30 10:39:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:01 [auto1.de] INFO: Found listing with ID: BP66204
2026-03-30 10:39:01 [auto1.de] INFO: Found listing with ID: LT56720
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT56720%27 HTTP/1.1" 200 None
2026-03-30 10:39:01 [auto1.de] INFO: Scrape type for LT56720: 2
2026-03-30 10:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01f8164a-51ba-5702-825c-8833b3ed8662 with identifier: LT56720
2026-03-30 10:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01f8164a-51ba-5702-825c-8833b3ed8662 with scrape type 2
2026-03-30 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01f8164a-51ba-5702-825c-8833b3ed8662 with scrape type 2
2026-03-30 10:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01f8164a-51ba-5702-825c-8833b3ed8662, identifier: LT56720
2026-03-30 10:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01f8164a-51ba-5702-825c-8833b3ed8662 with identifier: LT56720
2026-03-30 10:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01f8164a-51ba-5702-825c-8833b3ed8662 with identifier: LT56720
2026-03-30 10:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01f8164a-51ba-5702-825c-8833b3ed8662 with identifier: LT56720 to the API
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-31T15:54:17Z',
 'fuel_type': 'diesel',
 'id': '01f8164a-51ba-5702-825c-8833b3ed8662',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT56720',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 166218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-29',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2012}
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT56720%27 HTTP/1.1" 200 None
2026-03-30 10:39:02 [auto1.de] INFO: Saving data for LT56720: {'auction_closing_time': 1774972457.0, 'created_time': 1773426645.012682, 'last_price_update_time': 1774867142.665959}
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT56720') HTTP/1.1" 204 0
2026-03-30 10:39:02 [auto1.de] INFO: Found listing with ID: CS60894
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS60894%27 HTTP/1.1" 200 None
2026-03-30 10:39:02 [auto1.de] INFO: Scrape type for CS60894: 2
2026-03-30 10:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ab26116-0796-59ce-822d-36db04bbda38 with identifier: CS60894
2026-03-30 10:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ab26116-0796-59ce-822d-36db04bbda38 with scrape type 2
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ab26116-0796-59ce-822d-36db04bbda38 with scrape type 2
2026-03-30 10:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ab26116-0796-59ce-822d-36db04bbda38, identifier: CS60894
2026-03-30 10:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB38553> (referer: https://www.auto1.com/v1/car-details-view/SB38553/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_f146909702ed0bfafe4b355e16896a4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:02 [auto1.de] INFO: Found listing with ID: CF26327
2026-03-30 10:39:02 [auto1.de] INFO: Found listing with ID: UT28191
2026-03-30 10:39:02 [auto1.de] INFO: Found listing with ID: VS83622
2026-03-30 10:39:02 [auto1.de] INFO: Found listing with ID: GJ55737
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ55737%27 HTTP/1.1" 200 None
2026-03-30 10:39:02 [auto1.de] INFO: Scrape type for GJ55737: 2
2026-03-30 10:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cdf6c78-5afc-5b24-ad0f-0b3d8419f208 with identifier: GJ55737
2026-03-30 10:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cdf6c78-5afc-5b24-ad0f-0b3d8419f208 with scrape type 2
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cdf6c78-5afc-5b24-ad0f-0b3d8419f208 with scrape type 2
2026-03-30 10:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7cdf6c78-5afc-5b24-ad0f-0b3d8419f208, identifier: GJ55737
2026-03-30 10:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ab26116-0796-59ce-822d-36db04bbda38 with identifier: CS60894
2026-03-30 10:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ab26116-0796-59ce-822d-36db04bbda38 with identifier: CS60894
2026-03-30 10:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ab26116-0796-59ce-822d-36db04bbda38 with identifier: CS60894 to the API
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:55:00Z',
 'fuel_type': 'diesel',
 'id': '1ab26116-0796-59ce-822d-36db04bbda38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS60894',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 323650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2011}
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS60894%27 HTTP/1.1" 200 None
2026-03-30 10:39:03 [auto1.de] INFO: Saving data for CS60894: {'auction_closing_time': 1774972500.0, 'created_time': 1774292137.884812, 'last_price_update_time': 1774867143.393154}
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS60894') HTTP/1.1" 204 0
2026-03-30 10:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP80912/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RM21186/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7cdf6c78-5afc-5b24-ad0f-0b3d8419f208 with identifier: GJ55737
2026-03-30 10:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7cdf6c78-5afc-5b24-ad0f-0b3d8419f208 with identifier: GJ55737
2026-03-30 10:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7cdf6c78-5afc-5b24-ad0f-0b3d8419f208 with identifier: GJ55737 to the API
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:00:40Z',
 'fuel_type': 'petrol',
 'id': '7cdf6c78-5afc-5b24-ad0f-0b3d8419f208',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ55737',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 88445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-13',
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2011}
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ55737%27 HTTP/1.1" 200 None
2026-03-30 10:39:03 [auto1.de] INFO: Saving data for GJ55737: {'auction_closing_time': 1774969240.0, 'created_time': 1773308187.478553, 'last_price_update_time': 1774867143.768188}
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ55737') HTTP/1.1" 204 0
2026-03-30 10:39:03 [auto1.de] INFO: Found listing with ID: MX32778
2026-03-30 10:39:03 [auto1.de] INFO: Found listing with ID: SN55790
2026-03-30 10:39:03 [auto1.de] INFO: Found listing with ID: MZ56747
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ56747%27 HTTP/1.1" 200 None
2026-03-30 10:39:03 [auto1.de] INFO: Scrape type for MZ56747: 1
2026-03-30 10:39:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_9eae36ec492b3b1cae25397a4d4dc524.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:03 [auto1.de] INFO: Found listing with ID: XK64077
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK64077%27 HTTP/1.1" 200 None
2026-03-30 10:39:03 [auto1.de] INFO: Scrape type for XK64077: 2
2026-03-30 10:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bb408a0-7583-502c-86e1-69a0dbcd27c7 with identifier: XK64077
2026-03-30 10:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bb408a0-7583-502c-86e1-69a0dbcd27c7 with scrape type 2
2026-03-30 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bb408a0-7583-502c-86e1-69a0dbcd27c7 with scrape type 2
2026-03-30 10:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bb408a0-7583-502c-86e1-69a0dbcd27c7, identifier: XK64077
2026-03-30 10:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bb408a0-7583-502c-86e1-69a0dbcd27c7 with identifier: XK64077
2026-03-30 10:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bb408a0-7583-502c-86e1-69a0dbcd27c7 with identifier: XK64077
2026-03-30 10:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bb408a0-7583-502c-86e1-69a0dbcd27c7 with identifier: XK64077 to the API
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:54:10Z',
 'fuel_type': 'diesel',
 'id': '0bb408a0-7583-502c-86e1-69a0dbcd27c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK64077',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 136809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-22',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK64077%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [auto1.de] INFO: Saving data for XK64077: {'auction_closing_time': 1774972450.0, 'created_time': 1774522420.618119, 'last_price_update_time': 1774867144.280625}
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK64077') HTTP/1.1" 204 0
2026-03-30 10:39:04 [auto1.de] INFO: Found listing with ID: UR76017
2026-03-30 10:39:04 [auto1.de] INFO: Found listing with ID: PA34245
2026-03-30 10:39:04 [auto1.de] INFO: Found listing with ID: JP72611
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP72611%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [auto1.de] INFO: Scrape type for JP72611: 1
2026-03-30 10:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60812389-82e3-54c2-bc65-39fbb8443718 with identifier: SB38553
2026-03-30 10:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60812389-82e3-54c2-bc65-39fbb8443718 with scrape type 1
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 60812389-82e3-54c2-bc65-39fbb8443718
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F08%252Fa0086ded281eed395e5bc08a6df62225%252Fpa%252FSB38553_96e069cf4ee7134a2d9f472a604e8e5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_96e069cf4ee7134a2d9f472a604e8e5f.jpg not downloaded yet
2026-03-30 10:39:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef762d0>
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F56%252F0e56877984360623ce6af18ea782d13d%252Fpa%252FVY67471_f146909702ed0bfafe4b355e16896a4e.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_f146909702ed0bfafe4b355e16896a4e.jpg saved to cache
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b40d5609-d44e-587d-bcb0-68c5a8db35eb
2026-03-30 10:39:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b40d5609-d44e-587d-bcb0-68c5a8db35eb, skipping ID generation
2026-03-30 10:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b40d5609-d44e-587d-bcb0-68c5a8db35eb with scrape type 1
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b40d5609-d44e-587d-bcb0-68c5a8db35eb sending to next pipeline
2026-03-30 10:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b40d5609-d44e-587d-bcb0-68c5a8db35eb, identifier: VY67471
2026-03-30 10:39:04 [auto1.de] INFO: Found listing with ID: XJ81537
2026-03-30 10:39:04 [auto1.de] INFO: Found listing with ID: DA23365
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA23365%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [auto1.de] INFO: Scrape type for DA23365: 1
2026-03-30 10:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH22570/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b40d5609-d44e-587d-bcb0-68c5a8db35eb with identifier: VY67471
2026-03-30 10:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b40d5609-d44e-587d-bcb0-68c5a8db35eb with identifier: VY67471
2026-03-30 10:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b40d5609-d44e-587d-bcb0-68c5a8db35eb with identifier: VY67471 to the API
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_f146909702ed0bfafe4b355e16896a4e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-31T15:00:41Z',
 'fuel_type': 'petrol',
 'id': 'b40d5609-d44e-587d-bcb0-68c5a8db35eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY67471',
 'listing': 'auction',
 'location': 'DE, Köln',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 124816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2787236,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_fae298b09fd16704817c3dbbd28eb4f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2777245,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_f146909702ed0bfafe4b355e16896a4e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2495780,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_dfe22d4642b59893aecf69fe4aa1c1b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2486745,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_0757987ad11c9e4e05c54f57bee559a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2425544,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_8c827a4a1f24e087780aa57c3e027aa7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2612499,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_e4df7ad28efc4b639fa4ea34b9d09b67.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2457333,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_d2dc510dcff875b8290c95454eca120a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2762875,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_45d35d725db3ad4a994d1277aebbf9f0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2686030,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_d31414a2b65164cf41e9a9232f8413f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b40d5609-d44e-587d-bcb0-68c5a8db35eb/b40d5609-d44e-587d-bcb0-68c5a8db35eb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2680553,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/56/0e56877984360623ce6af18ea782d13d/pa/VY67471_239ebc4e9097261ea94fd30c6b50c6eb.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TFSI GTI "Performance" BlueMotion',
 'transmission': 'manual',
 'trim': 'GTI "Performance" BlueMotion',
 'year': 2015}
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67471%27 HTTP/1.1" 200 None
2026-03-30 10:39:05 [auto1.de] INFO: Saving data for VY67471: {'created_time': 1774867145.165676, 'last_price_update_time': 1774867145.165686, 'auction_closing_time': 1774969241.0}
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY67471') HTTP/1.1" 204 0
2026-03-30 10:39:05 [scrapy.extensions.logstats] INFO: Crawled 331 pages (at 60 pages/min), scraped 221 items (at 49 items/min)
2026-03-30 10:39:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:39:05 [auto1.de] INFO: Found listing with ID: SB79116
2026-03-30 10:39:05 [auto1.de] INFO: Found listing with ID: XY94240
2026-03-30 10:39:05 [auto1.de] INFO: Found listing with ID: PT50052
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT50052%27 HTTP/1.1" 200 None
2026-03-30 10:39:05 [auto1.de] INFO: Scrape type for PT50052: 2
2026-03-30 10:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38b7e7a7-cb0f-5025-b704-0ce52c3216ae with identifier: PT50052
2026-03-30 10:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b7e7a7-cb0f-5025-b704-0ce52c3216ae with scrape type 2
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38b7e7a7-cb0f-5025-b704-0ce52c3216ae with scrape type 2
2026-03-30 10:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38b7e7a7-cb0f-5025-b704-0ce52c3216ae, identifier: PT50052
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F08%252Fa0086ded281eed395e5bc08a6df62225%252Fpa%252FSB38553_5ade24142e824b04c9d0829ab2280298.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_5ade24142e824b04c9d0829ab2280298.jpg not downloaded yet
2026-03-30 10:39:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefdf010>
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Ff8%252F6bf87da625b1e9d0e3d04e18ce53e9e8%252Fpa%252FTU30152_9eae36ec492b3b1cae25397a4d4dc524.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_9eae36ec492b3b1cae25397a4d4dc524.jpg saved to cache
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8b4ed73-b977-51b6-9904-16b975722641
2026-03-30 10:39:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8b4ed73-b977-51b6-9904-16b975722641, skipping ID generation
2026-03-30 10:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8b4ed73-b977-51b6-9904-16b975722641 with scrape type 1
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8b4ed73-b977-51b6-9904-16b975722641 sending to next pipeline
2026-03-30 10:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8b4ed73-b977-51b6-9904-16b975722641, identifier: TU30152
2026-03-30 10:39:05 [auto1.de] INFO: Found listing with ID: YC26029
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC26029%27 HTTP/1.1" 200 None
2026-03-30 10:39:05 [auto1.de] INFO: Scrape type for YC26029: 1
2026-03-30 10:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38b7e7a7-cb0f-5025-b704-0ce52c3216ae with identifier: PT50052
2026-03-30 10:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38b7e7a7-cb0f-5025-b704-0ce52c3216ae with identifier: PT50052
2026-03-30 10:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38b7e7a7-cb0f-5025-b704-0ce52c3216ae with identifier: PT50052 to the API
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:55:15Z',
 'fuel_type': 'petrol',
 'id': '38b7e7a7-cb0f-5025-b704-0ce52c3216ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT50052',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 124370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-30',
 'seller_name': None,
 'title': 'Mazda 2 1.5 Nakama',
 'transmission': 'manual',
 'trim': 'Nakama',
 'year': 2016}
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT50052%27 HTTP/1.1" 200 None
2026-03-30 10:39:06 [auto1.de] INFO: Saving data for PT50052: {'auction_closing_time': 1774972515.0, 'created_time': 1774291639.846245, 'last_price_update_time': 1774867146.074745}
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT50052') HTTP/1.1" 204 0
2026-03-30 10:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8b4ed73-b977-51b6-9904-16b975722641 with identifier: TU30152
2026-03-30 10:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8b4ed73-b977-51b6-9904-16b975722641 with identifier: TU30152
2026-03-30 10:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8b4ed73-b977-51b6-9904-16b975722641 with identifier: TU30152 to the API
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_9eae36ec492b3b1cae25397a4d4dc524.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:23:52Z',
 'fuel_type': 'diesel',
 'id': 'e8b4ed73-b977-51b6-9904-16b975722641',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU30152',
 'listing': 'auction',
 'location': 'DE, Friedrichsdorf',
 'make': 'Mazda',
 'model': '6',
 'odometer': 110854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2986758,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_7dc0859ee05c36bac832a269057c38bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2978927,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_9eae36ec492b3b1cae25397a4d4dc524.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2931096,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_5698031e2e05a154b1e4c6738b15b400.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2521552,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_a147bb05929c4e778b9e49cc824abb0c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2933454,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_e7f2a851f50a1a81a9ce4580295771ae.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2785384,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_fbbdf1135d9ce11e5fb8cd828ba604f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2567892,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_505345bbff0fe788187cd31626566c5a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2778713,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_9215b8294d788276143c26da10d72e6b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3135840,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_ee76aa321f0c13da40bd948585b362ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b4ed73-b977-51b6-9904-16b975722641/e8b4ed73-b977-51b6-9904-16b975722641_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2814063,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/f8/6bf87da625b1e9d0e3d04e18ce53e9e8/pa/TU30152_6ffb85db7d1c103dd5c2bd407cbbbd50.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Nakama',
 'transmission': 'manual',
 'trim': 'Nakama',
 'year': 2016}
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU30152%27 HTTP/1.1" 200 None
2026-03-30 10:39:06 [auto1.de] INFO: Saving data for TU30152: {'created_time': 1774867146.579064, 'last_price_update_time': 1774867146.579075, 'auction_closing_time': 1774970632.0}
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU30152') HTTP/1.1" 204 0
2026-03-30 10:39:06 [auto1.de] INFO: Found listing with ID: WK68540
2026-03-30 10:39:06 [auto1.de] INFO: Found listing with ID: NZ13044
2026-03-30 10:39:06 [auto1.de] INFO: Found listing with ID: WS16596
2026-03-30 10:39:06 [auto1.de] INFO: Found listing with ID: WS95832
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS95832%27 HTTP/1.1" 200 None
2026-03-30 10:39:06 [auto1.de] INFO: Scrape type for WS95832: 2
2026-03-30 10:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 270f76e4-1176-5204-96bf-0da2fa76e28f with identifier: WS95832
2026-03-30 10:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 270f76e4-1176-5204-96bf-0da2fa76e28f with scrape type 2
2026-03-30 10:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 270f76e4-1176-5204-96bf-0da2fa76e28f with scrape type 2
2026-03-30 10:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 270f76e4-1176-5204-96bf-0da2fa76e28f, identifier: WS95832
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F08%252Fa0086ded281eed395e5bc08a6df62225%252Fpa%252FSB38553_855236425e94444ccf1f751e901e5a43.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_855236425e94444ccf1f751e901e5a43.jpg not downloaded yet
2026-03-30 10:39:06 [auto1.de] INFO: Found listing with ID: CN26761
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN26761%27 HTTP/1.1" 200 None
2026-03-30 10:39:06 [auto1.de] INFO: Scrape type for CN26761: 1
2026-03-30 10:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 270f76e4-1176-5204-96bf-0da2fa76e28f with identifier: WS95832
2026-03-30 10:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 270f76e4-1176-5204-96bf-0da2fa76e28f with identifier: WS95832
2026-03-30 10:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 270f76e4-1176-5204-96bf-0da2fa76e28f with identifier: WS95832 to the API
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-31T15:51:18Z',
 'fuel_type': 'petrol',
 'id': '270f76e4-1176-5204-96bf-0da2fa76e28f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS95832',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 117022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-07',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 SUV-Star+ 2WD',
 'transmission': 'manual',
 'trim': 'SUV-Star+ 2WD',
 'year': 2016}
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS95832%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [auto1.de] INFO: Saving data for WS95832: {'auction_closing_time': 1774972278.0, 'created_time': 1774380376.30483, 'last_price_update_time': 1774867147.087923}
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS95832') HTTP/1.1" 204 0
2026-03-30 10:39:07 [auto1.de] INFO: Found listing with ID: JF28410
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF28410%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [auto1.de] INFO: Scrape type for JF28410: 2
2026-03-30 10:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1522e2e7-0a85-5cad-9e3b-254521dae421 with identifier: JF28410
2026-03-30 10:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1522e2e7-0a85-5cad-9e3b-254521dae421 with scrape type 2
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1522e2e7-0a85-5cad-9e3b-254521dae421 with scrape type 2
2026-03-30 10:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1522e2e7-0a85-5cad-9e3b-254521dae421, identifier: JF28410
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F08%252Fa0086ded281eed395e5bc08a6df62225%252Fpa%252FSB38553_9f5ba9639f03e74d695535c653813a84.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_9f5ba9639f03e74d695535c653813a84.jpg not downloaded yet
2026-03-30 10:39:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:07 [auto1.de] INFO: Found listing with ID: GG38022
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG38022%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [auto1.de] INFO: Scrape type for GG38022: 1
2026-03-30 10:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1522e2e7-0a85-5cad-9e3b-254521dae421 with identifier: JF28410
2026-03-30 10:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1522e2e7-0a85-5cad-9e3b-254521dae421 with identifier: JF28410
2026-03-30 10:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1522e2e7-0a85-5cad-9e3b-254521dae421 with identifier: JF28410 to the API
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:04:59Z',
 'fuel_type': 'diesel',
 'id': '1522e2e7-0a85-5cad-9e3b-254521dae421',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF28410',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 235588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-15',
 'seller_name': None,
 'title': 'BMW X1 xDrive 25d',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF28410%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [auto1.de] INFO: Saving data for JF28410: {'auction_closing_time': 1774969499.0, 'created_time': 1773773813.665291, 'last_price_update_time': 1774867147.589313}
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JF28410') HTTP/1.1" 204 0
2026-03-30 10:39:07 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 9430 | hits on page: 40
2026-03-30 10:39:07 [auto1.de] INFO: Found listing with ID: UY77162
2026-03-30 10:39:07 [auto1.de] INFO: Found listing with ID: WV54187
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV54187%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [auto1.de] INFO: Scrape type for WV54187: 1
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F08%252Fa0086ded281eed395e5bc08a6df62225%252Fpa%252FSB38553_39481a4424f5065a276421c24ad0097a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_39481a4424f5065a276421c24ad0097a.jpg not downloaded yet
2026-03-30 10:39:07 [auto1.de] INFO: Found listing with ID: ZF27503
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF27503%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [auto1.de] INFO: Scrape type for ZF27503: 2
2026-03-30 10:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7553e8c2-bad5-50cc-a649-b875915241c0 with identifier: ZF27503
2026-03-30 10:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7553e8c2-bad5-50cc-a649-b875915241c0 with scrape type 2
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7553e8c2-bad5-50cc-a649-b875915241c0 with scrape type 2
2026-03-30 10:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7553e8c2-bad5-50cc-a649-b875915241c0, identifier: ZF27503
2026-03-30 10:39:07 [auto1.de] INFO: Found listing with ID: XE37827
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE37827%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [auto1.de] INFO: Scrape type for XE37827: 1
2026-03-30 10:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7553e8c2-bad5-50cc-a649-b875915241c0 with identifier: ZF27503
2026-03-30 10:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7553e8c2-bad5-50cc-a649-b875915241c0 with identifier: ZF27503
2026-03-30 10:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7553e8c2-bad5-50cc-a649-b875915241c0 with identifier: ZF27503 to the API
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:20:39Z',
 'fuel_type': 'diesel',
 'id': '7553e8c2-bad5-50cc-a649-b875915241c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF27503',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 82719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-10',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi L2 Proline',
 'transmission': 'manual',
 'trim': 'L2 Proline',
 'year': 2017}
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF27503%27 HTTP/1.1" 200 None
2026-03-30 10:39:08 [auto1.de] INFO: Saving data for ZF27503: {'auction_closing_time': 1774970439.0, 'created_time': 1773307667.812501, 'last_price_update_time': 1774867148.225383}
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF27503') HTTP/1.1" 204 0
2026-03-30 10:39:08 [auto1.de] INFO: Found listing with ID: ZE83569
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE83569%27 HTTP/1.1" 200 None
2026-03-30 10:39:08 [auto1.de] INFO: Scrape type for ZE83569: 1
2026-03-30 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_855236425e94444ccf1f751e901e5a43.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:08 [auto1.de] INFO: Found listing with ID: WR30114
2026-03-30 10:39:08 [auto1.de] INFO: Found listing with ID: ZE58561
2026-03-30 10:39:08 [auto1.de] INFO: Found listing with ID: ZD15817
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD15817%27 HTTP/1.1" 200 None
2026-03-30 10:39:08 [auto1.de] INFO: Scrape type for ZD15817: 2
2026-03-30 10:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b826860d-6d1c-5664-a09b-d6e7c846c534 with identifier: ZD15817
2026-03-30 10:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b826860d-6d1c-5664-a09b-d6e7c846c534 with scrape type 2
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b826860d-6d1c-5664-a09b-d6e7c846c534 with scrape type 2
2026-03-30 10:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b826860d-6d1c-5664-a09b-d6e7c846c534, identifier: ZD15817
2026-03-30 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_d974fff76d7941e7358b9db0cbb9650a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:08 [auto1.de] INFO: Found listing with ID: CS21706
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS21706%27 HTTP/1.1" 200 None
2026-03-30 10:39:08 [auto1.de] INFO: Scrape type for CS21706: 2
2026-03-30 10:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bef4b2ff-093e-5d33-b2de-ac895908db7f with identifier: CS21706
2026-03-30 10:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bef4b2ff-093e-5d33-b2de-ac895908db7f with scrape type 2
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bef4b2ff-093e-5d33-b2de-ac895908db7f with scrape type 2
2026-03-30 10:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bef4b2ff-093e-5d33-b2de-ac895908db7f, identifier: CS21706
2026-03-30 10:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b826860d-6d1c-5664-a09b-d6e7c846c534 with identifier: ZD15817
2026-03-30 10:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b826860d-6d1c-5664-a09b-d6e7c846c534 with identifier: ZD15817
2026-03-30 10:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b826860d-6d1c-5664-a09b-d6e7c846c534 with identifier: ZD15817 to the API
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 350,
 'expiration_date': '2026-03-31T15:43:52Z',
 'fuel_type': 'petrol',
 'id': 'b826860d-6d1c-5664-a09b-d6e7c846c534',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD15817',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 194037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-11',
 'seller_name': None,
 'title': 'Audi A6 4.2 V8 FSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2006}
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD15817%27 HTTP/1.1" 200 None
2026-03-30 10:39:08 [auto1.de] INFO: Saving data for ZD15817: {'auction_closing_time': 1774971832.0, 'created_time': 1774263161.804891, 'last_price_update_time': 1774867148.89961}
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD15817') HTTP/1.1" 204 0
2026-03-30 10:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bef4b2ff-093e-5d33-b2de-ac895908db7f with identifier: CS21706
2026-03-30 10:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bef4b2ff-093e-5d33-b2de-ac895908db7f with identifier: CS21706
2026-03-30 10:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bef4b2ff-093e-5d33-b2de-ac895908db7f with identifier: CS21706 to the API
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:49:28Z',
 'fuel_type': 'petrol',
 'id': 'bef4b2ff-093e-5d33-b2de-ac895908db7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS21706',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 116385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-27',
 'seller_name': None,
 'title': 'Skoda Yeti 1.4 TSI Elegance Outdoor',
 'transmission': 'manual',
 'trim': 'Elegance Outdoor',
 'year': 2014}
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS21706%27 HTTP/1.1" 200 None
2026-03-30 10:39:09 [auto1.de] INFO: Saving data for CS21706: {'auction_closing_time': 1774972168.0, 'created_time': 1773775414.339246, 'last_price_update_time': 1774867149.246129}
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS21706') HTTP/1.1" 204 0
2026-03-30 10:39:09 [auto1.de] INFO: Found listing with ID: PA09004
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA09004%27 HTTP/1.1" 200 None
2026-03-30 10:39:09 [auto1.de] INFO: Scrape type for PA09004: 2
2026-03-30 10:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2de3ba1b-ec65-5b7c-a9e6-ff4087faf566 with identifier: PA09004
2026-03-30 10:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2de3ba1b-ec65-5b7c-a9e6-ff4087faf566 with scrape type 2
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2de3ba1b-ec65-5b7c-a9e6-ff4087faf566 with scrape type 2
2026-03-30 10:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2de3ba1b-ec65-5b7c-a9e6-ff4087faf566, identifier: PA09004
2026-03-30 10:39:09 [auto1.de] INFO: Found listing with ID: YY05397
2026-03-30 10:39:09 [auto1.de] INFO: Found listing with ID: HR01670
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR01670%27 HTTP/1.1" 200 None
2026-03-30 10:39:09 [auto1.de] INFO: Scrape type for HR01670: 1
2026-03-30 10:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2de3ba1b-ec65-5b7c-a9e6-ff4087faf566 with identifier: PA09004
2026-03-30 10:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2de3ba1b-ec65-5b7c-a9e6-ff4087faf566 with identifier: PA09004
2026-03-30 10:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2de3ba1b-ec65-5b7c-a9e6-ff4087faf566 with identifier: PA09004 to the API
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:46:02Z',
 'fuel_type': 'diesel',
 'id': '2de3ba1b-ec65-5b7c-a9e6-ff4087faf566',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA09004',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 227961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-08',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA09004%27 HTTP/1.1" 200 None
2026-03-30 10:39:09 [auto1.de] INFO: Saving data for PA09004: {'auction_closing_time': 1774971962.0, 'created_time': 1774552943.147175, 'last_price_update_time': 1774867149.719187}
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA09004') HTTP/1.1" 204 0
2026-03-30 10:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VS32434/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f65dee90>
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60812389-82e3-54c2-bc65-39fbb8443718/60812389-82e3-54c2-bc65-39fbb8443718_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F08%252Fa0086ded281eed395e5bc08a6df62225%252Fpa%252FSB38553_855236425e94444ccf1f751e901e5a43.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_855236425e94444ccf1f751e901e5a43.jpg saved to cache
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60812389-82e3-54c2-bc65-39fbb8443718
2026-03-30 10:39:09 [auto1.de] INFO: Found listing with ID: SY18278
2026-03-30 10:39:09 [auto1.de] INFO: Found listing with ID: RM37791
2026-03-30 10:39:09 [auto1.de] INFO: Found listing with ID: HB77071
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB77071%27 HTTP/1.1" 200 None
2026-03-30 10:39:09 [auto1.de] INFO: Scrape type for HB77071: 1
2026-03-30 10:39:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 10:39:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 10:39:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 10:39:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 10:39:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee958d0>
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_d974fff76d7941e7358b9db0cbb9650a.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_d974fff76d7941e7358b9db0cbb9650a.jpg saved to cache
2026-03-30 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3654fb31-e3a6-5db9-a661-5d8b36abb97c
2026-03-30 10:39:10 [auto1.de] INFO: Found listing with ID: KF93104
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF93104%27 HTTP/1.1" 200 None
2026-03-30 10:39:10 [auto1.de] INFO: Scrape type for KF93104: 2
2026-03-30 10:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c580cc8-f849-5749-b1f8-0ac54887d6a4 with identifier: KF93104
2026-03-30 10:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c580cc8-f849-5749-b1f8-0ac54887d6a4 with scrape type 2
2026-03-30 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c580cc8-f849-5749-b1f8-0ac54887d6a4 with scrape type 2
2026-03-30 10:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c580cc8-f849-5749-b1f8-0ac54887d6a4, identifier: KF93104
2026-03-30 10:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c580cc8-f849-5749-b1f8-0ac54887d6a4 with identifier: KF93104
2026-03-30 10:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c580cc8-f849-5749-b1f8-0ac54887d6a4 with identifier: KF93104
2026-03-30 10:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c580cc8-f849-5749-b1f8-0ac54887d6a4 with identifier: KF93104 to the API
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-31T15:51:52Z',
 'fuel_type': 'diesel',
 'id': '1c580cc8-f849-5749-b1f8-0ac54887d6a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF93104',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 115245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-25',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 109 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2019}
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF93104%27 HTTP/1.1" 200 None
2026-03-30 10:39:10 [auto1.de] INFO: Saving data for KF93104: {'auction_closing_time': 1774972312.0, 'created_time': 1774157711.387091, 'last_price_update_time': 1774867150.461376}
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF93104') HTTP/1.1" 204 0
2026-03-30 10:39:10 [auto1.de] INFO: Found listing with ID: ZA75332
2026-03-30 10:39:10 [auto1.de] INFO: Found listing with ID: AA14040
2026-03-30 10:39:10 [auto1.de] INFO: Found listing with ID: MF97779
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF97779%27 HTTP/1.1" 200 None
2026-03-30 10:39:10 [auto1.de] INFO: Scrape type for MF97779: 1
2026-03-30 10:39:10 [auto1.de] INFO: Found listing with ID: WZ29509
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ29509%27 HTTP/1.1" 200 None
2026-03-30 10:39:10 [auto1.de] INFO: Scrape type for WZ29509: 1
2026-03-30 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_39481a4424f5065a276421c24ad0097a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:10 [auto1.de] INFO: Found listing with ID: DY24892
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY24892%27 HTTP/1.1" 200 None
2026-03-30 10:39:10 [auto1.de] INFO: Scrape type for DY24892: 1
2026-03-30 10:39:10 [auto1.de] INFO: Found listing with ID: AN42226
2026-03-30 10:39:10 [auto1.de] INFO: Found listing with ID: UB07132
2026-03-30 10:39:10 [auto1.de] INFO: Found listing with ID: FG55708
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG55708%27 HTTP/1.1" 200 None
2026-03-30 10:39:10 [auto1.de] INFO: Scrape type for FG55708: 1
2026-03-30 10:39:10 [auto1.de] INFO: Found listing with ID: GH80135
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH80135%27 HTTP/1.1" 200 None
2026-03-30 10:39:10 [auto1.de] INFO: Scrape type for GH80135: 1
2026-03-30 10:39:10 [auto1.de] INFO: Found listing with ID: NG28539
2026-03-30 10:39:10 [auto1.de] INFO: Found listing with ID: HA37625
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA37625%27 HTTP/1.1" 200 None
2026-03-30 10:39:10 [auto1.de] INFO: Scrape type for HA37625: 1
2026-03-30 10:39:10 [auto1.de] INFO: Found listing with ID: MK76692
2026-03-30 10:39:10 [auto1.de] INFO: Found listing with ID: FZ11767
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ11767%27 HTTP/1.1" 200 None
2026-03-30 10:39:10 [auto1.de] INFO: Scrape type for FZ11767: 1
2026-03-30 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_15bbbe851bae93193b3810cfd490281f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:10 [auto1.de] INFO: Found listing with ID: TJ26559
2026-03-30 10:39:10 [auto1.de] INFO: Found listing with ID: XE37827
2026-03-30 10:39:10 [auto1.de] INFO: Found listing with ID: NL99287
2026-03-30 10:39:10 [auto1.de] INFO: Found listing with ID: AD94410
2026-03-30 10:39:10 [auto1.de] INFO: Found listing with ID: ZN17495
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN17495%27 HTTP/1.1" 200 None
2026-03-30 10:39:10 [auto1.de] INFO: Scrape type for ZN17495: 2
2026-03-30 10:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09e11b6b-7f42-5769-b8f8-93c619890d96 with identifier: ZN17495
2026-03-30 10:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09e11b6b-7f42-5769-b8f8-93c619890d96 with scrape type 2
2026-03-30 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09e11b6b-7f42-5769-b8f8-93c619890d96 with scrape type 2
2026-03-30 10:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09e11b6b-7f42-5769-b8f8-93c619890d96, identifier: ZN17495
2026-03-30 10:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09e11b6b-7f42-5769-b8f8-93c619890d96 with identifier: ZN17495
2026-03-30 10:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09e11b6b-7f42-5769-b8f8-93c619890d96 with identifier: ZN17495
2026-03-30 10:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09e11b6b-7f42-5769-b8f8-93c619890d96 with identifier: ZN17495 to the API
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:24:04Z',
 'fuel_type': 'petrol',
 'id': '09e11b6b-7f42-5769-b8f8-93c619890d96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN17495',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 77695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-20',
 'seller_name': None,
 'title': 'Suzuki Swift 1.4 BoosterJet Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2019}
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN17495%27 HTTP/1.1" 200 None
2026-03-30 10:39:11 [auto1.de] INFO: Saving data for ZN17495: {'auction_closing_time': 1774970644.0, 'created_time': 1774262808.764953, 'last_price_update_time': 1774867151.082775}
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN17495') HTTP/1.1" 204 0
2026-03-30 10:39:11 [auto1.de] INFO: Found listing with ID: ZL04476
2026-03-30 10:39:11 [auto1.de] INFO: Found listing with ID: JG35280
2026-03-30 10:39:11 [auto1.de] INFO: Found listing with ID: TS24409
2026-03-30 10:39:11 [auto1.de] INFO: Found listing with ID: CK66212
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK66212%27 HTTP/1.1" 200 None
2026-03-30 10:39:11 [auto1.de] INFO: Scrape type for CK66212: 2
2026-03-30 10:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd07d33f-a81a-5ea4-92bb-4b4bc2ced19c with identifier: CK66212
2026-03-30 10:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd07d33f-a81a-5ea4-92bb-4b4bc2ced19c with scrape type 2
2026-03-30 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd07d33f-a81a-5ea4-92bb-4b4bc2ced19c with scrape type 2
2026-03-30 10:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd07d33f-a81a-5ea4-92bb-4b4bc2ced19c, identifier: CK66212
2026-03-30 10:39:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4902d0>
2026-03-30 10:39:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60812389-82e3-54c2-bc65-39fbb8443718/60812389-82e3-54c2-bc65-39fbb8443718_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F08%252Fa0086ded281eed395e5bc08a6df62225%252Fpa%252FSB38553_39481a4424f5065a276421c24ad0097a.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_39481a4424f5065a276421c24ad0097a.jpg saved to cache
2026-03-30 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60812389-82e3-54c2-bc65-39fbb8443718
2026-03-30 10:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_74114a446c5bb8d2fd8f02695dd2c4c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd07d33f-a81a-5ea4-92bb-4b4bc2ced19c with identifier: CK66212
2026-03-30 10:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd07d33f-a81a-5ea4-92bb-4b4bc2ced19c with identifier: CK66212
2026-03-30 10:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd07d33f-a81a-5ea4-92bb-4b4bc2ced19c with identifier: CK66212 to the API
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:05:17Z',
 'fuel_type': 'diesel',
 'id': 'fd07d33f-a81a-5ea4-92bb-4b4bc2ced19c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK66212',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 125712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2022}
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK66212%27 HTTP/1.1" 200 None
2026-03-30 10:39:11 [auto1.de] INFO: Saving data for CK66212: {'auction_closing_time': 1774969517.0, 'created_time': 1773829836.512345, 'last_price_update_time': 1774867151.671162}
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK66212') HTTP/1.1" 204 0
2026-03-30 10:39:11 [auto1.de] INFO: Found listing with ID: AF66532
2026-03-30 10:39:11 [auto1.de] INFO: Found listing with ID: MR40804
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR40804%27 HTTP/1.1" 200 None
2026-03-30 10:39:11 [auto1.de] INFO: Scrape type for MR40804: 2
2026-03-30 10:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f44924c8-ef9b-502b-b280-c09504bd067e with identifier: MR40804
2026-03-30 10:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f44924c8-ef9b-502b-b280-c09504bd067e with scrape type 2
2026-03-30 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f44924c8-ef9b-502b-b280-c09504bd067e with scrape type 2
2026-03-30 10:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f44924c8-ef9b-502b-b280-c09504bd067e, identifier: MR40804
2026-03-30 10:39:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeed2550>
2026-03-30 10:39:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_15bbbe851bae93193b3810cfd490281f.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_15bbbe851bae93193b3810cfd490281f.jpg saved to cache
2026-03-30 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40d7c578-c4b1-55ed-bc33-15175e40b0d2
2026-03-30 10:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_a2024db1443ffa9484e5e897b493a5ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f44924c8-ef9b-502b-b280-c09504bd067e with identifier: MR40804
2026-03-30 10:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f44924c8-ef9b-502b-b280-c09504bd067e with identifier: MR40804
2026-03-30 10:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f44924c8-ef9b-502b-b280-c09504bd067e with identifier: MR40804 to the API
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:17:08Z',
 'fuel_type': 'petrol',
 'id': 'f44924c8-ef9b-502b-b280-c09504bd067e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR40804',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 218967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-14',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2017}
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR40804%27 HTTP/1.1" 200 None
2026-03-30 10:39:12 [auto1.de] INFO: Saving data for MR40804: {'auction_closing_time': 1774970228.0, 'created_time': 1773687491.740026, 'last_price_update_time': 1774867152.363756}
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR40804') HTTP/1.1" 204 0
2026-03-30 10:39:12 [auto1.de] INFO: Found listing with ID: FK20948
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK20948%27 HTTP/1.1" 200 None
2026-03-30 10:39:12 [auto1.de] INFO: Scrape type for FK20948: 2
2026-03-30 10:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 186b0765-92c1-51a6-9416-731b701163a9 with identifier: FK20948
2026-03-30 10:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 186b0765-92c1-51a6-9416-731b701163a9 with scrape type 2
2026-03-30 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 186b0765-92c1-51a6-9416-731b701163a9 with scrape type 2
2026-03-30 10:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 186b0765-92c1-51a6-9416-731b701163a9, identifier: FK20948
2026-03-30 10:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RM21186> (referer: https://www.auto1.com/v1/car-details-view/RM21186/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 186b0765-92c1-51a6-9416-731b701163a9 with identifier: FK20948
2026-03-30 10:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 186b0765-92c1-51a6-9416-731b701163a9 with identifier: FK20948
2026-03-30 10:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 186b0765-92c1-51a6-9416-731b701163a9 with identifier: FK20948 to the API
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:00:38Z',
 'fuel_type': 'petrol',
 'id': '186b0765-92c1-51a6-9416-731b701163a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK20948',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 151356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-19',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2018}
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK20948%27 HTTP/1.1" 200 None
2026-03-30 10:39:13 [auto1.de] INFO: Saving data for FK20948: {'auction_closing_time': 1774969238.0, 'created_time': 1774348621.410481, 'last_price_update_time': 1774867153.144284}
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK20948') HTTP/1.1" 204 0
2026-03-30 10:39:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d3a90>
2026-03-30 10:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_74114a446c5bb8d2fd8f02695dd2c4c8.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_74114a446c5bb8d2fd8f02695dd2c4c8.jpg saved to cache
2026-03-30 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40d7c578-c4b1-55ed-bc33-15175e40b0d2
2026-03-30 10:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_71dc275cfdeff60f8dcbccd9751b8ff6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:13 [auto1.de] INFO: Found listing with ID: JJ21697
2026-03-30 10:39:13 [auto1.de] INFO: Found listing with ID: MH00767
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH00767%27 HTTP/1.1" 200 None
2026-03-30 10:39:13 [auto1.de] INFO: Scrape type for MH00767: 1
2026-03-30 10:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_b80ef353ac68dc22e1833eb2a7e88be6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f47fb350>
2026-03-30 10:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_a2024db1443ffa9484e5e897b493a5ba.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_a2024db1443ffa9484e5e897b493a5ba.jpg saved to cache
2026-03-30 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40d7c578-c4b1-55ed-bc33-15175e40b0d2
2026-03-30 10:39:13 [auto1.de] INFO: Found listing with ID: XU85928
2026-03-30 10:39:13 [auto1.de] INFO: Found listing with ID: VW39600
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW39600%27 HTTP/1.1" 200 None
2026-03-30 10:39:13 [auto1.de] INFO: Scrape type for VW39600: 1
2026-03-30 10:39:13 [auto1.de] INFO: Found listing with ID: TL94146
2026-03-30 10:39:13 [auto1.de] INFO: Found listing with ID: UG74460
2026-03-30 10:39:13 [auto1.de] INFO: Found listing with ID: LM16436
2026-03-30 10:39:13 [auto1.de] INFO: Found listing with ID: PP68012
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP68012%27 HTTP/1.1" 200 None
2026-03-30 10:39:13 [auto1.de] INFO: Scrape type for PP68012: 2
2026-03-30 10:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5377543e-8ccf-5464-8851-93104df7f8e9 with identifier: PP68012
2026-03-30 10:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5377543e-8ccf-5464-8851-93104df7f8e9 with scrape type 2
2026-03-30 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5377543e-8ccf-5464-8851-93104df7f8e9 with scrape type 2
2026-03-30 10:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5377543e-8ccf-5464-8851-93104df7f8e9, identifier: PP68012
2026-03-30 10:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69190766-5f1c-5fb5-a126-b2de256ad98b with identifier: RM21186
2026-03-30 10:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69190766-5f1c-5fb5-a126-b2de256ad98b with scrape type 1
2026-03-30 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 69190766-5f1c-5fb5-a126-b2de256ad98b
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_87c6eb122410fa92f8e9372f02503260.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_87c6eb122410fa92f8e9372f02503260.jpg not downloaded yet
2026-03-30 10:39:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5ce2a50>
2026-03-30 10:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_71dc275cfdeff60f8dcbccd9751b8ff6.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_71dc275cfdeff60f8dcbccd9751b8ff6.jpg saved to cache
2026-03-30 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40d7c578-c4b1-55ed-bc33-15175e40b0d2
2026-03-30 10:39:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43466d0>
2026-03-30 10:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_b80ef353ac68dc22e1833eb2a7e88be6.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_b80ef353ac68dc22e1833eb2a7e88be6.jpg saved to cache
2026-03-30 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40d7c578-c4b1-55ed-bc33-15175e40b0d2
2026-03-30 10:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5377543e-8ccf-5464-8851-93104df7f8e9 with identifier: PP68012
2026-03-30 10:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5377543e-8ccf-5464-8851-93104df7f8e9 with identifier: PP68012
2026-03-30 10:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5377543e-8ccf-5464-8851-93104df7f8e9 with identifier: PP68012 to the API
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:32:29Z',
 'fuel_type': 'petrol',
 'id': '5377543e-8ccf-5464-8851-93104df7f8e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP68012',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 13350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-25',
 'seller_name': None,
 'title': 'Seat Arona 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2024}
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP68012%27 HTTP/1.1" 200 None
2026-03-30 10:39:14 [auto1.de] INFO: Saving data for PP68012: {'auction_closing_time': 1774971149.0, 'created_time': 1773686562.965042, 'last_price_update_time': 1774867154.294427}
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP68012') HTTP/1.1" 204 0
2026-03-30 10:39:14 [auto1.de] INFO: Found listing with ID: WL31000
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL31000%27 HTTP/1.1" 200 None
2026-03-30 10:39:14 [auto1.de] INFO: Scrape type for WL31000: 2
2026-03-30 10:39:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5196fbf5-0328-5524-af66-3c205805441c with identifier: WL31000
2026-03-30 10:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5196fbf5-0328-5524-af66-3c205805441c with scrape type 2
2026-03-30 10:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5196fbf5-0328-5524-af66-3c205805441c with scrape type 2
2026-03-30 10:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5196fbf5-0328-5524-af66-3c205805441c, identifier: WL31000
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_f5a5f97ed66c7e9426a0e4337dbefbca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_f5a5f97ed66c7e9426a0e4337dbefbca.jpg not downloaded yet
2026-03-30 10:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5196fbf5-0328-5524-af66-3c205805441c with identifier: WL31000
2026-03-30 10:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5196fbf5-0328-5524-af66-3c205805441c with identifier: WL31000
2026-03-30 10:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5196fbf5-0328-5524-af66-3c205805441c with identifier: WL31000 to the API
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:39:09Z',
 'fuel_type': 'diesel',
 'id': '5196fbf5-0328-5524-af66-3c205805441c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL31000',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 142617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-07',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI T BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2013}
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL31000%27 HTTP/1.1" 200 None
2026-03-30 10:39:14 [auto1.de] INFO: Saving data for WL31000: {'auction_closing_time': 1774971549.0, 'created_time': 1773688358.545673, 'last_price_update_time': 1774867154.981635}
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL31000') HTTP/1.1" 204 0
2026-03-30 10:39:15 [auto1.de] INFO: Found listing with ID: GV79461
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV79461%27 HTTP/1.1" 200 None
2026-03-30 10:39:15 [auto1.de] INFO: Scrape type for GV79461: 1
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_5b79d369f83c19b39f2f3091fe993ccf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_5b79d369f83c19b39f2f3091fe993ccf.jpg not downloaded yet
2026-03-30 10:39:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.453(s), this was the 1st time calling it.
2026-03-30 10:39:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.426879448740005 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:39:15 [auto1.de] INFO: Found listing with ID: MT60714
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT60714%27 HTTP/1.1" 200 None
2026-03-30 10:39:15 [auto1.de] INFO: Scrape type for MT60714: 1
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_989d43b4acee03aaaa3fb72f31b38c39.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_989d43b4acee03aaaa3fb72f31b38c39.jpg not downloaded yet
2026-03-30 10:39:15 [auto1.de] INFO: Found listing with ID: JD61379
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD61379%27 HTTP/1.1" 200 None
2026-03-30 10:39:15 [auto1.de] INFO: Scrape type for JD61379: 1
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_42770c72307408f72f63db875055218a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_42770c72307408f72f63db875055218a.jpg not downloaded yet
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_f84a477cf28616a8247f24d3cec318ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:15 [auto1.de] INFO: Found listing with ID: HH61076
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH61076%27 HTTP/1.1" 200 None
2026-03-30 10:39:15 [auto1.de] INFO: Scrape type for HH61076: 1
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_61406e46d1ad62e5e4efa62e571bf75f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_61406e46d1ad62e5e4efa62e571bf75f.jpg not downloaded yet
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_87c6eb122410fa92f8e9372f02503260.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_f5a5f97ed66c7e9426a0e4337dbefbca.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:15 [auto1.de] INFO: Found listing with ID: VK27516
2026-03-30 10:39:15 [auto1.de] INFO: Found listing with ID: FG83238
2026-03-30 10:39:15 [auto1.de] INFO: Found listing with ID: GS63094
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_6b3b3024ef6ccd0b1d91817ccbf88fc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_6b3b3024ef6ccd0b1d91817ccbf88fc9.jpg not downloaded yet
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_3602aca89b5dd18ece42d6da7ebb44ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_3602aca89b5dd18ece42d6da7ebb44ef.jpg not downloaded yet
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_37fc0828098feffd8b59119b065124e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_37fc0828098feffd8b59119b065124e4.jpg not downloaded yet
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_27f8b70f6c46124ae0b429c772c9190c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_27f8b70f6c46124ae0b429c772c9190c.jpg not downloaded yet
2026-03-30 10:39:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef4c910>
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_f84a477cf28616a8247f24d3cec318ae.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_f84a477cf28616a8247f24d3cec318ae.jpg saved to cache
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40d7c578-c4b1-55ed-bc33-15175e40b0d2
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_42770c72307408f72f63db875055218a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_61406e46d1ad62e5e4efa62e571bf75f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee17390>
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_87c6eb122410fa92f8e9372f02503260.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_87c6eb122410fa92f8e9372f02503260.jpg saved to cache
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69190766-5f1c-5fb5-a126-b2de256ad98b
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec7310>
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_f5a5f97ed66c7e9426a0e4337dbefbca.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_f5a5f97ed66c7e9426a0e4337dbefbca.jpg saved to cache
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 69190766-5f1c-5fb5-a126-b2de256ad98b
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_27f8b70f6c46124ae0b429c772c9190c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee492790>
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_42770c72307408f72f63db875055218a.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_42770c72307408f72f63db875055218a.jpg saved to cache
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 69190766-5f1c-5fb5-a126-b2de256ad98b
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3ee990>
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_61406e46d1ad62e5e4efa62e571bf75f.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_61406e46d1ad62e5e4efa62e571bf75f.jpg saved to cache
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 69190766-5f1c-5fb5-a126-b2de256ad98b
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_37fc0828098feffd8b59119b065124e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43446d0>
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_27f8b70f6c46124ae0b429c772c9190c.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_27f8b70f6c46124ae0b429c772c9190c.jpg saved to cache
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 69190766-5f1c-5fb5-a126-b2de256ad98b
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_3602aca89b5dd18ece42d6da7ebb44ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_6b3b3024ef6ccd0b1d91817ccbf88fc9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UJ24923/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec78d0>
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_37fc0828098feffd8b59119b065124e4.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_37fc0828098feffd8b59119b065124e4.jpg saved to cache
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 69190766-5f1c-5fb5-a126-b2de256ad98b
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_989d43b4acee03aaaa3fb72f31b38c39.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XE37827/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5987690>
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_3602aca89b5dd18ece42d6da7ebb44ef.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_3602aca89b5dd18ece42d6da7ebb44ef.jpg saved to cache
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 69190766-5f1c-5fb5-a126-b2de256ad98b
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_5b79d369f83c19b39f2f3091fe993ccf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e68d0>
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_6b3b3024ef6ccd0b1d91817ccbf88fc9.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_6b3b3024ef6ccd0b1d91817ccbf88fc9.jpg saved to cache
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 69190766-5f1c-5fb5-a126-b2de256ad98b
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MF98789/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419eed0>
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_989d43b4acee03aaaa3fb72f31b38c39.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_989d43b4acee03aaaa3fb72f31b38c39.jpg saved to cache
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 69190766-5f1c-5fb5-a126-b2de256ad98b
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE83569/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WS77371/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58d0950>
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F50%252Fcb508d29976013cec2379fdd3a273e33%252Fpa%252FRM21186_5b79d369f83c19b39f2f3091fe993ccf.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_5b79d369f83c19b39f2f3091fe993ccf.jpg saved to cache
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 69190766-5f1c-5fb5-a126-b2de256ad98b
2026-03-30 10:39:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69190766-5f1c-5fb5-a126-b2de256ad98b, skipping ID generation
2026-03-30 10:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69190766-5f1c-5fb5-a126-b2de256ad98b with scrape type 1
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69190766-5f1c-5fb5-a126-b2de256ad98b sending to next pipeline
2026-03-30 10:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69190766-5f1c-5fb5-a126-b2de256ad98b, identifier: RM21186
2026-03-30 10:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69190766-5f1c-5fb5-a126-b2de256ad98b with identifier: RM21186
2026-03-30 10:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69190766-5f1c-5fb5-a126-b2de256ad98b with identifier: RM21186
2026-03-30 10:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69190766-5f1c-5fb5-a126-b2de256ad98b with identifier: RM21186 to the API
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_5b79d369f83c19b39f2f3091fe993ccf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 192,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:08:59Z',
 'fuel_type': 'petrol',
 'id': '69190766-5f1c-5fb5-a126-b2de256ad98b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM21186',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Mitsubishi',
 'model': 'Eclipse Cross',
 'odometer': 84690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_87c6eb122410fa92f8e9372f02503260.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_f5a5f97ed66c7e9426a0e4337dbefbca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_5b79d369f83c19b39f2f3091fe993ccf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_989d43b4acee03aaaa3fb72f31b38c39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_42770c72307408f72f63db875055218a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_61406e46d1ad62e5e4efa62e571bf75f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_6b3b3024ef6ccd0b1d91817ccbf88fc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_3602aca89b5dd18ece42d6da7ebb44ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_37fc0828098feffd8b59119b065124e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69190766-5f1c-5fb5-a126-b2de256ad98b/69190766-5f1c-5fb5-a126-b2de256ad98b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/50/cb508d29976013cec2379fdd3a273e33/pa/RM21186_27f8b70f6c46124ae0b429c772c9190c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Eclipse Cross 1.5 T-MIVEC Diamant Edition 2WD',
 'transmission': 'automatic',
 'trim': 'Diamant Edition 2WD',
 'year': 2019}
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM21186%27 HTTP/1.1" 200 None
2026-03-30 10:39:16 [auto1.de] INFO: Saving data for RM21186: {'created_time': 1774867156.4514, 'last_price_update_time': 1774867156.451412, 'auction_closing_time': 1774969739.0}
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM21186') HTTP/1.1" 204 0
2026-03-30 10:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC26029/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AE02185> (referer: https://www.auto1.com/v1/car-details-view/AE02185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baba2564-b755-5527-9ceb-21db65979543 with identifier: AE02185
2026-03-30 10:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baba2564-b755-5527-9ceb-21db65979543 with scrape type 1
2026-03-30 10:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item baba2564-b755-5527-9ceb-21db65979543
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fcf%252F4acf93cac8427d350d7b5145a5547bd1%252Fpa%252FAE02185_55ffc3c429211728b842de2700a9fa9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_55ffc3c429211728b842de2700a9fa9a.jpg not downloaded yet
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fcf%252F4acf93cac8427d350d7b5145a5547bd1%252Fpa%252FAE02185_9d0426af46c07bb9f6fa2181279e0b44.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_9d0426af46c07bb9f6fa2181279e0b44.jpg not downloaded yet
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fcf%252F4acf93cac8427d350d7b5145a5547bd1%252Fpa%252FAE02185_285ecf088dd813d719810fad767ab17f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_285ecf088dd813d719810fad767ab17f.jpg not downloaded yet
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fcf%252F4acf93cac8427d350d7b5145a5547bd1%252Fpa%252FAE02185_347f0df5243a6158789e277a8a24402c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_347f0df5243a6158789e277a8a24402c.jpg not downloaded yet
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fcf%252F4acf93cac8427d350d7b5145a5547bd1%252Fpa%252FAE02185_dc7c810ea5f8dfbcc20b2ce63db5de15.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_dc7c810ea5f8dfbcc20b2ce63db5de15.jpg not downloaded yet
2026-03-30 10:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH61076/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_dc7c810ea5f8dfbcc20b2ce63db5de15.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_347f0df5243a6158789e277a8a24402c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4288c90>
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baba2564-b755-5527-9ceb-21db65979543/baba2564-b755-5527-9ceb-21db65979543_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fcf%252F4acf93cac8427d350d7b5145a5547bd1%252Fpa%252FAE02185_dc7c810ea5f8dfbcc20b2ce63db5de15.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_dc7c810ea5f8dfbcc20b2ce63db5de15.jpg saved to cache
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item baba2564-b755-5527-9ceb-21db65979543
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee42b6d0>
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baba2564-b755-5527-9ceb-21db65979543/baba2564-b755-5527-9ceb-21db65979543_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fcf%252F4acf93cac8427d350d7b5145a5547bd1%252Fpa%252FAE02185_347f0df5243a6158789e277a8a24402c.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_347f0df5243a6158789e277a8a24402c.jpg saved to cache
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item baba2564-b755-5527-9ceb-21db65979543
2026-03-30 10:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA37625/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_285ecf088dd813d719810fad767ab17f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_9d0426af46c07bb9f6fa2181279e0b44.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef2d10>
2026-03-30 10:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baba2564-b755-5527-9ceb-21db65979543/baba2564-b755-5527-9ceb-21db65979543_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fcf%252F4acf93cac8427d350d7b5145a5547bd1%252Fpa%252FAE02185_285ecf088dd813d719810fad767ab17f.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_285ecf088dd813d719810fad767ab17f.jpg saved to cache
2026-03-30 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item baba2564-b755-5527-9ceb-21db65979543
2026-03-30 10:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428b0d0>
2026-03-30 10:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baba2564-b755-5527-9ceb-21db65979543/baba2564-b755-5527-9ceb-21db65979543_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fcf%252F4acf93cac8427d350d7b5145a5547bd1%252Fpa%252FAE02185_9d0426af46c07bb9f6fa2181279e0b44.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_9d0426af46c07bb9f6fa2181279e0b44.jpg saved to cache
2026-03-30 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item baba2564-b755-5527-9ceb-21db65979543
2026-03-30 10:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GV79461/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VW39600/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_55ffc3c429211728b842de2700a9fa9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec12d0>
2026-03-30 10:39:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baba2564-b755-5527-9ceb-21db65979543/baba2564-b755-5527-9ceb-21db65979543_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fcf%252F4acf93cac8427d350d7b5145a5547bd1%252Fpa%252FAE02185_55ffc3c429211728b842de2700a9fa9a.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_55ffc3c429211728b842de2700a9fa9a.jpg saved to cache
2026-03-30 10:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item baba2564-b755-5527-9ceb-21db65979543
2026-03-30 10:39:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: baba2564-b755-5527-9ceb-21db65979543, skipping ID generation
2026-03-30 10:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baba2564-b755-5527-9ceb-21db65979543 with scrape type 1
2026-03-30 10:39:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item baba2564-b755-5527-9ceb-21db65979543 sending to next pipeline
2026-03-30 10:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: baba2564-b755-5527-9ceb-21db65979543, identifier: AE02185
2026-03-30 10:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: baba2564-b755-5527-9ceb-21db65979543 with identifier: AE02185
2026-03-30 10:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: baba2564-b755-5527-9ceb-21db65979543 with identifier: AE02185
2026-03-30 10:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: baba2564-b755-5527-9ceb-21db65979543 with identifier: AE02185 to the API
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_55ffc3c429211728b842de2700a9fa9a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:08:32Z',
 'fuel_type': 'petrol',
 'id': 'baba2564-b755-5527-9ceb-21db65979543',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE02185',
 'listing': 'auction',
 'location': 'DE, Darmstadt',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 177649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baba2564-b755-5527-9ceb-21db65979543/baba2564-b755-5527-9ceb-21db65979543_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_55ffc3c429211728b842de2700a9fa9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baba2564-b755-5527-9ceb-21db65979543/baba2564-b755-5527-9ceb-21db65979543_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_9d0426af46c07bb9f6fa2181279e0b44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baba2564-b755-5527-9ceb-21db65979543/baba2564-b755-5527-9ceb-21db65979543_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_285ecf088dd813d719810fad767ab17f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baba2564-b755-5527-9ceb-21db65979543/baba2564-b755-5527-9ceb-21db65979543_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_347f0df5243a6158789e277a8a24402c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baba2564-b755-5527-9ceb-21db65979543/baba2564-b755-5527-9ceb-21db65979543_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/cf/4acf93cac8427d350d7b5145a5547bd1/pa/AE02185_dc7c810ea5f8dfbcc20b2ce63db5de15.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2011}
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE02185%27 HTTP/1.1" 200 None
2026-03-30 10:39:21 [auto1.de] INFO: Saving data for AE02185: {'created_time': 1774867161.112579, 'last_price_update_time': 1774867161.112591, 'auction_closing_time': 1774969712.0}
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE02185') HTTP/1.1" 204 0
2026-03-30 10:39:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH80135/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UJ24923> (referer: https://www.auto1.com/v1/car-details-view/UJ24923/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7245ac46-6452-596c-a22f-a6d44b5a61ce with identifier: UJ24923
2026-03-30 10:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7245ac46-6452-596c-a22f-a6d44b5a61ce with scrape type 1
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7245ac46-6452-596c-a22f-a6d44b5a61ce
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_6c01c1d956bbff1c50f6a5c97b9a084f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_6c01c1d956bbff1c50f6a5c97b9a084f.jpg not downloaded yet
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_01196d87d02c4a9955fb6ef5c9695c66.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_01196d87d02c4a9955fb6ef5c9695c66.jpg not downloaded yet
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_0083e3cb54ffae2b89952816e9387e97.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_0083e3cb54ffae2b89952816e9387e97.jpg not downloaded yet
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_256fdcc2ac2f48cf949d1b552a81a6dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_256fdcc2ac2f48cf949d1b552a81a6dd.jpg not downloaded yet
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_49a0df314a558bd8aeb2d83f53350951.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_49a0df314a558bd8aeb2d83f53350951.jpg not downloaded yet
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_515b892a19869cb55b9b5bbb0db6eea8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_515b892a19869cb55b9b5bbb0db6eea8.jpg not downloaded yet
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_b33eee31add5abc5e4d9f9cd78f5c669.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_b33eee31add5abc5e4d9f9cd78f5c669.jpg not downloaded yet
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_3c6acd75dc3d72b847abcb34d511fe5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_3c6acd75dc3d72b847abcb34d511fe5d.jpg not downloaded yet
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_8ffdc8a6cf41cb606a47e569a072508a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_8ffdc8a6cf41cb606a47e569a072508a.jpg not downloaded yet
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_f486853de3f10ebc1bf5bc5d30c884b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_f486853de3f10ebc1bf5bc5d30c884b0.jpg not downloaded yet
2026-03-30 10:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VS32434> (referer: https://www.auto1.com/v1/car-details-view/VS32434/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_f486853de3f10ebc1bf5bc5d30c884b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b139b1a-efe3-5304-a03a-8785c2c304ab with identifier: VS32434
2026-03-30 10:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b139b1a-efe3-5304-a03a-8785c2c304ab with scrape type 1
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b139b1a-efe3-5304-a03a-8785c2c304ab
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_c78139685780c967267a61dccf898664.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_c78139685780c967267a61dccf898664.jpg not downloaded yet
2026-03-30 10:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_8ffdc8a6cf41cb606a47e569a072508a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_eb6f176bba503c7cb98c4fe5143bdf8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_eb6f176bba503c7cb98c4fe5143bdf8e.jpg not downloaded yet
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_a0559b23ad0d55f5fedc51dc0bf4d4ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_a0559b23ad0d55f5fedc51dc0bf4d4ad.jpg not downloaded yet
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_697f323979255a50393555d420fa483f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_697f323979255a50393555d420fa483f.jpg not downloaded yet
2026-03-30 10:39:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41bcc50>
2026-03-30 10:39:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_f486853de3f10ebc1bf5bc5d30c884b0.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_f486853de3f10ebc1bf5bc5d30c884b0.jpg saved to cache
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7245ac46-6452-596c-a22f-a6d44b5a61ce
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_2d84dec35ff90695d6035a450004081b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_2d84dec35ff90695d6035a450004081b.jpg not downloaded yet
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_b548fb71a6037869ccdc0a7067815188.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_b548fb71a6037869ccdc0a7067815188.jpg not downloaded yet
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee92e10>
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_8ffdc8a6cf41cb606a47e569a072508a.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_8ffdc8a6cf41cb606a47e569a072508a.jpg saved to cache
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7245ac46-6452-596c-a22f-a6d44b5a61ce
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_3249bfdd0de1556a88896b6b6594165d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_3249bfdd0de1556a88896b6b6594165d.jpg not downloaded yet
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_79c23a8f151664db2907566ba42eafad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_79c23a8f151664db2907566ba42eafad.jpg not downloaded yet
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_f7036f8afe4022bf90fd6b26fca3b644.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_f7036f8afe4022bf90fd6b26fca3b644.jpg not downloaded yet
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_b4f0888f9b8ec556c220d255ddee7869.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_b4f0888f9b8ec556c220d255ddee7869.jpg not downloaded yet
2026-03-30 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_c78139685780c967267a61dccf898664.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4345610>
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_c78139685780c967267a61dccf898664.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_c78139685780c967267a61dccf898664.jpg saved to cache
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b139b1a-efe3-5304-a03a-8785c2c304ab
2026-03-30 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_b4f0888f9b8ec556c220d255ddee7869.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee809d0>
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_b4f0888f9b8ec556c220d255ddee7869.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_b4f0888f9b8ec556c220d255ddee7869.jpg saved to cache
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b139b1a-efe3-5304-a03a-8785c2c304ab
2026-03-30 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_f7036f8afe4022bf90fd6b26fca3b644.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MH00767/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee70a10>
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_f7036f8afe4022bf90fd6b26fca3b644.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_f7036f8afe4022bf90fd6b26fca3b644.jpg saved to cache
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b139b1a-efe3-5304-a03a-8785c2c304ab
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_3249bfdd0de1556a88896b6b6594165d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef2210>
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_3249bfdd0de1556a88896b6b6594165d.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_3249bfdd0de1556a88896b6b6594165d.jpg saved to cache
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b139b1a-efe3-5304-a03a-8785c2c304ab
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_79c23a8f151664db2907566ba42eafad.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee82250>
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_79c23a8f151664db2907566ba42eafad.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_79c23a8f151664db2907566ba42eafad.jpg saved to cache
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b139b1a-efe3-5304-a03a-8785c2c304ab
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_b548fb71a6037869ccdc0a7067815188.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e44d0>
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_b548fb71a6037869ccdc0a7067815188.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_b548fb71a6037869ccdc0a7067815188.jpg saved to cache
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b139b1a-efe3-5304-a03a-8785c2c304ab
2026-03-30 10:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC26029> (referer: https://www.auto1.com/v1/car-details-view/YC26029/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WS77371> (referer: https://www.auto1.com/v1/car-details-view/WS77371/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0655dc4-3c20-51c8-9d1e-851a59d9c3bc with identifier: YC26029
2026-03-30 10:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0655dc4-3c20-51c8-9d1e-851a59d9c3bc with scrape type 1
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0655dc4-3c20-51c8-9d1e-851a59d9c3bc
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_215429c52a87828730b6e58d854bd304.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_215429c52a87828730b6e58d854bd304.jpg not downloaded yet
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_94c38fc0d4b72555411b674108740e9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_94c38fc0d4b72555411b674108740e9a.jpg not downloaded yet
2026-03-30 10:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_2d84dec35ff90695d6035a450004081b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_25719dd21cd3cc65350a397d1f6e6697.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_25719dd21cd3cc65350a397d1f6e6697.jpg not downloaded yet
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_23356c4117a931e44142b4612fea57bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_23356c4117a931e44142b4612fea57bc.jpg not downloaded yet
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_1fe5fbf16260470e81421da524892e89.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_1fe5fbf16260470e81421da524892e89.jpg not downloaded yet
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_242da946ae4dea37adf41669483f45e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_242da946ae4dea37adf41669483f45e2.jpg not downloaded yet
2026-03-30 10:39:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a043e4f-0c15-5573-a559-f297402c1315 with identifier: WS77371
2026-03-30 10:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a043e4f-0c15-5573-a559-f297402c1315 with scrape type 1
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a043e4f-0c15-5573-a559-f297402c1315
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_2b0f51b4728730d213f609cd2d1e22d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_2b0f51b4728730d213f609cd2d1e22d9.jpg not downloaded yet
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_6f470935d4ea9883c849833f077ab19e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_6f470935d4ea9883c849833f077ab19e.jpg not downloaded yet
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_bc5dcf5a1f432b37e92dbf3e32dcab60.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_bc5dcf5a1f432b37e92dbf3e32dcab60.jpg not downloaded yet
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_471c0e8d5545667cde13c3563cd39c8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_471c0e8d5545667cde13c3563cd39c8b.jpg not downloaded yet
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_e69470e151ce5a8ba8283af954d48ee7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_e69470e151ce5a8ba8283af954d48ee7.jpg not downloaded yet
2026-03-30 10:39:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefea190>
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_2d84dec35ff90695d6035a450004081b.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_2d84dec35ff90695d6035a450004081b.jpg saved to cache
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b139b1a-efe3-5304-a03a-8785c2c304ab
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_f29eb9308ae014bb5a987e1db0a81b9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_f29eb9308ae014bb5a987e1db0a81b9d.jpg not downloaded yet
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_2306c436b0e4dc9df522ea44410338ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_2306c436b0e4dc9df522ea44410338ad.jpg not downloaded yet
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_3c14d8896bd425903e7fec5175c08fb4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_3c14d8896bd425903e7fec5175c08fb4.jpg not downloaded yet
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_449459356204b73006c527d271f5f025.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_449459356204b73006c527d271f5f025.jpg not downloaded yet
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_ae881ff2d0015adc65b35b8a905c4711.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_ae881ff2d0015adc65b35b8a905c4711.jpg not downloaded yet
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_8c1d394031671113e6624ebcf047c016.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_8c1d394031671113e6624ebcf047c016.jpg not downloaded yet
2026-03-30 10:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BD87504> (referer: https://www.auto1.com/v1/car-details-view/BD87504/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_d64986d0aab24d85ffd759a920fbddb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_d64986d0aab24d85ffd759a920fbddb6.jpg not downloaded yet
2026-03-30 10:39:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MT60714/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_7682ec86aeada4d7d5271b122829dde6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_7682ec86aeada4d7d5271b122829dde6.jpg not downloaded yet
2026-03-30 10:39:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_362d0cc27f9758744738a0312d52f481.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_362d0cc27f9758744738a0312d52f481.jpg not downloaded yet
2026-03-30 10:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_697f323979255a50393555d420fa483f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_a0559b23ad0d55f5fedc51dc0bf4d4ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_94c38fc0d4b72555411b674108740e9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_d64986d0aab24d85ffd759a920fbddb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ece66ec8-c2cd-56c3-8742-2dc83c0dbed1 with identifier: BD87504
2026-03-30 10:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ece66ec8-c2cd-56c3-8742-2dc83c0dbed1 with scrape type 1
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ece66ec8-c2cd-56c3-8742-2dc83c0dbed1
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_ac2bd0e05ec3746ce6cc471c88535af4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_ac2bd0e05ec3746ce6cc471c88535af4.jpg not downloaded yet
2026-03-30 10:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_8c1d394031671113e6624ebcf047c016.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_710d9e8186afc5b513142780b2fb362a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_710d9e8186afc5b513142780b2fb362a.jpg not downloaded yet
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_edb8f9fb80980be40ab3a9af0b647289.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_edb8f9fb80980be40ab3a9af0b647289.jpg not downloaded yet
2026-03-30 10:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_362d0cc27f9758744738a0312d52f481.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_0869219e9d53ba9db84199e65481c6b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_0869219e9d53ba9db84199e65481c6b5.jpg not downloaded yet
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_5ac06c0194c8b4217731e7fb10bcd1ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_5ac06c0194c8b4217731e7fb10bcd1ce.jpg not downloaded yet
2026-03-30 10:39:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7eb90>
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_697f323979255a50393555d420fa483f.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_697f323979255a50393555d420fa483f.jpg saved to cache
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b139b1a-efe3-5304-a03a-8785c2c304ab
2026-03-30 10:39:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a6050>
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_a0559b23ad0d55f5fedc51dc0bf4d4ad.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_a0559b23ad0d55f5fedc51dc0bf4d4ad.jpg saved to cache
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b139b1a-efe3-5304-a03a-8785c2c304ab
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_1116b8f83d8383bfed5bf1c788d36e38.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_1116b8f83d8383bfed5bf1c788d36e38.jpg not downloaded yet
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_af63ebc95b6d954047f7bf10c918d9e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_af63ebc95b6d954047f7bf10c918d9e5.jpg not downloaded yet
2026-03-30 10:39:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f425aa10>
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_94c38fc0d4b72555411b674108740e9a.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_94c38fc0d4b72555411b674108740e9a.jpg saved to cache
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0655dc4-3c20-51c8-9d1e-851a59d9c3bc
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeee3ed0>
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_d64986d0aab24d85ffd759a920fbddb6.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_d64986d0aab24d85ffd759a920fbddb6.jpg saved to cache
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a043e4f-0c15-5573-a559-f297402c1315
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e5390>
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_8c1d394031671113e6624ebcf047c016.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_8c1d394031671113e6624ebcf047c016.jpg saved to cache
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a043e4f-0c15-5573-a559-f297402c1315
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee42a590>
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_362d0cc27f9758744738a0312d52f481.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_362d0cc27f9758744738a0312d52f481.jpg saved to cache
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a043e4f-0c15-5573-a559-f297402c1315
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_ea19d8588c4bd02628e232caebff021c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_ea19d8588c4bd02628e232caebff021c.jpg not downloaded yet
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_f0d4081fa9e213d2f536ba1ff19e3ddd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_f0d4081fa9e213d2f536ba1ff19e3ddd.jpg not downloaded yet
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_24c852c5a1d631266ef3512d48f8f439.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_24c852c5a1d631266ef3512d48f8f439.jpg not downloaded yet
2026-03-30 10:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_edb8f9fb80980be40ab3a9af0b647289.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_0869219e9d53ba9db84199e65481c6b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_1116b8f83d8383bfed5bf1c788d36e38.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f674e6d0>
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_edb8f9fb80980be40ab3a9af0b647289.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_edb8f9fb80980be40ab3a9af0b647289.jpg saved to cache
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ece66ec8-c2cd-56c3-8742-2dc83c0dbed1
2026-03-30 10:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE83569> (referer: https://www.auto1.com/v1/car-details-view/ZE83569/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef77cd0>
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_0869219e9d53ba9db84199e65481c6b5.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_0869219e9d53ba9db84199e65481c6b5.jpg saved to cache
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ece66ec8-c2cd-56c3-8742-2dc83c0dbed1
2026-03-30 10:39:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434d150>
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_1116b8f83d8383bfed5bf1c788d36e38.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_1116b8f83d8383bfed5bf1c788d36e38.jpg saved to cache
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ece66ec8-c2cd-56c3-8742-2dc83c0dbed1
2026-03-30 10:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_5ac06c0194c8b4217731e7fb10bcd1ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XE37827> (referer: https://www.auto1.com/v1/car-details-view/XE37827/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 502e109e-9f20-5c81-b511-d0b76dfb84ff with identifier: ZE83569
2026-03-30 10:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 502e109e-9f20-5c81-b511-d0b76dfb84ff with scrape type 1
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 502e109e-9f20-5c81-b511-d0b76dfb84ff
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_177a7161ebf4b8da699cb7edf761e4dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_177a7161ebf4b8da699cb7edf761e4dd.jpg not downloaded yet
2026-03-30 10:39:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_dbae140d8831aa62235b277889eef7b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_dbae140d8831aa62235b277889eef7b0.jpg not downloaded yet
2026-03-30 10:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH61076> (referer: https://www.auto1.com/v1/car-details-view/HH61076/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_809c657f36acbc1fdf83e0b1036ad519.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_809c657f36acbc1fdf83e0b1036ad519.jpg not downloaded yet
2026-03-30 10:39:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_ef954e2706eed34655ad54fa52d6d62a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_ef954e2706eed34655ad54fa52d6d62a.jpg not downloaded yet
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_55598393aa0350966f618ab4e6e5dcb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_55598393aa0350966f618ab4e6e5dcb1.jpg not downloaded yet
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_e06c133937c79c5669037e45385e5f42.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_e06c133937c79c5669037e45385e5f42.jpg not downloaded yet
2026-03-30 10:39:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f9290>
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_5ac06c0194c8b4217731e7fb10bcd1ce.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_5ac06c0194c8b4217731e7fb10bcd1ce.jpg saved to cache
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ece66ec8-c2cd-56c3-8742-2dc83c0dbed1
2026-03-30 10:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 214d9f57-0895-505f-9602-56610af348cf with identifier: XE37827
2026-03-30 10:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 214d9f57-0895-505f-9602-56610af348cf with scrape type 1
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 214d9f57-0895-505f-9602-56610af348cf
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2c%252Fad2c1df241bf85da2ac7f06239118d80%252Fpa%252FXE37827_a25fc9a978a1e6cde90ccdee312ccd98.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_a25fc9a978a1e6cde90ccdee312ccd98.jpg not downloaded yet
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_f226f12847e10b3f03698145066539fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_f226f12847e10b3f03698145066539fb.jpg not downloaded yet
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2c%252Fad2c1df241bf85da2ac7f06239118d80%252Fpa%252FXE37827_0436a3fa6a4222615b06cd1ad221e90c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_0436a3fa6a4222615b06cd1ad221e90c.jpg not downloaded yet
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_070b7df32a7077603b8e3f363b1e8176.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_070b7df32a7077603b8e3f363b1e8176.jpg not downloaded yet
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2c%252Fad2c1df241bf85da2ac7f06239118d80%252Fpa%252FXE37827_9bc5ffd6ed952e0a7d272049bfaeeea7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_9bc5ffd6ed952e0a7d272049bfaeeea7.jpg not downloaded yet
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_3bb118e67c185c437c505fc44bdd8b8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_3bb118e67c185c437c505fc44bdd8b8a.jpg not downloaded yet
2026-03-30 10:39:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e584019f-07a1-573a-aaf0-6dbcaa2f3d0b with identifier: HH61076
2026-03-30 10:39:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e584019f-07a1-573a-aaf0-6dbcaa2f3d0b with scrape type 1
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e584019f-07a1-573a-aaf0-6dbcaa2f3d0b
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff6%252F65f6793a6f56915e015a082d36d230af%252Fpa%252FHH61076_ce7ddfa1950f1fd9f2888788ceaf6ef6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_ce7ddfa1950f1fd9f2888788ceaf6ef6.jpg not downloaded yet
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2c%252Fad2c1df241bf85da2ac7f06239118d80%252Fpa%252FXE37827_ac463d76b9189f236ed2eadcb9dcacc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_ac463d76b9189f236ed2eadcb9dcacc7.jpg not downloaded yet
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_0bb3d51b85d2dbca408b489c36c0d9d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_0bb3d51b85d2dbca408b489c36c0d9d4.jpg not downloaded yet
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff6%252F65f6793a6f56915e015a082d36d230af%252Fpa%252FHH61076_32854993accc028b9e68203e5bb2134b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_32854993accc028b9e68203e5bb2134b.jpg not downloaded yet
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2c%252Fad2c1df241bf85da2ac7f06239118d80%252Fpa%252FXE37827_5b18184541d9c09ac78685d09f5c2eed.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_5b18184541d9c09ac78685d09f5c2eed.jpg not downloaded yet
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff6%252F65f6793a6f56915e015a082d36d230af%252Fpa%252FHH61076_60622e2bac2b2f6d2a704b3eb62e3a70.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_60622e2bac2b2f6d2a704b3eb62e3a70.jpg not downloaded yet
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2c%252Fad2c1df241bf85da2ac7f06239118d80%252Fpa%252FXE37827_0c4305dafa6d21d4e8cd1105534ce36a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_0c4305dafa6d21d4e8cd1105534ce36a.jpg not downloaded yet
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff6%252F65f6793a6f56915e015a082d36d230af%252Fpa%252FHH61076_e80a9c2d11a17938d514d1ce821b3785.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_e80a9c2d11a17938d514d1ce821b3785.jpg not downloaded yet
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff6%252F65f6793a6f56915e015a082d36d230af%252Fpa%252FHH61076_2c29a1aaf781bc1bb0fec165cce347c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_2c29a1aaf781bc1bb0fec165cce347c9.jpg not downloaded yet
2026-03-30 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_24c852c5a1d631266ef3512d48f8f439.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_af63ebc95b6d954047f7bf10c918d9e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_ea19d8588c4bd02628e232caebff021c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_ac2bd0e05ec3746ce6cc471c88535af4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_dbae140d8831aa62235b277889eef7b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_f0d4081fa9e213d2f536ba1ff19e3ddd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_710d9e8186afc5b513142780b2fb362a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f591b650>
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_24c852c5a1d631266ef3512d48f8f439.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_24c852c5a1d631266ef3512d48f8f439.jpg saved to cache
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ece66ec8-c2cd-56c3-8742-2dc83c0dbed1
2026-03-30 10:39:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef4f350>
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_af63ebc95b6d954047f7bf10c918d9e5.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_af63ebc95b6d954047f7bf10c918d9e5.jpg saved to cache
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ece66ec8-c2cd-56c3-8742-2dc83c0dbed1
2026-03-30 10:39:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee00c90>
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_ea19d8588c4bd02628e232caebff021c.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_ea19d8588c4bd02628e232caebff021c.jpg saved to cache
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ece66ec8-c2cd-56c3-8742-2dc83c0dbed1
2026-03-30 10:39:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeebd590>
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_ac2bd0e05ec3746ce6cc471c88535af4.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_ac2bd0e05ec3746ce6cc471c88535af4.jpg saved to cache
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ece66ec8-c2cd-56c3-8742-2dc83c0dbed1
2026-03-30 10:39:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee41e10>
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_dbae140d8831aa62235b277889eef7b0.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_dbae140d8831aa62235b277889eef7b0.jpg saved to cache
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 502e109e-9f20-5c81-b511-d0b76dfb84ff
2026-03-30 10:39:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee02410>
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_f0d4081fa9e213d2f536ba1ff19e3ddd.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_f0d4081fa9e213d2f536ba1ff19e3ddd.jpg saved to cache
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ece66ec8-c2cd-56c3-8742-2dc83c0dbed1
2026-03-30 10:39:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43a9510>
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F55%252F9655e4d0af303f8f115f1f7a4baca7bc%252Fpa%252FBD87504_710d9e8186afc5b513142780b2fb362a.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_710d9e8186afc5b513142780b2fb362a.jpg saved to cache
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ece66ec8-c2cd-56c3-8742-2dc83c0dbed1
2026-03-30 10:39:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ece66ec8-c2cd-56c3-8742-2dc83c0dbed1, skipping ID generation
2026-03-30 10:39:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ece66ec8-c2cd-56c3-8742-2dc83c0dbed1 with scrape type 1
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ece66ec8-c2cd-56c3-8742-2dc83c0dbed1 sending to next pipeline
2026-03-30 10:39:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ece66ec8-c2cd-56c3-8742-2dc83c0dbed1, identifier: BD87504
2026-03-30 10:39:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ece66ec8-c2cd-56c3-8742-2dc83c0dbed1 with identifier: BD87504
2026-03-30 10:39:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ece66ec8-c2cd-56c3-8742-2dc83c0dbed1 with identifier: BD87504
2026-03-30 10:39:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ece66ec8-c2cd-56c3-8742-2dc83c0dbed1 with identifier: BD87504 to the API
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_710d9e8186afc5b513142780b2fb362a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:06:52Z',
 'fuel_type': 'petrol',
 'id': 'ece66ec8-c2cd-56c3-8742-2dc83c0dbed1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD87504',
 'listing': 'auction',
 'location': 'DE, Saarbrücken',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 144257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2678451,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_ac2bd0e05ec3746ce6cc471c88535af4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2751211,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_710d9e8186afc5b513142780b2fb362a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2638570,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_edb8f9fb80980be40ab3a9af0b647289.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2724891,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_0869219e9d53ba9db84199e65481c6b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2790871,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_5ac06c0194c8b4217731e7fb10bcd1ce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2230498,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_1116b8f83d8383bfed5bf1c788d36e38.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2190358,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_af63ebc95b6d954047f7bf10c918d9e5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2241105,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_ea19d8588c4bd02628e232caebff021c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2809548,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_f0d4081fa9e213d2f536ba1ff19e3ddd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece66ec8-c2cd-56c3-8742-2dc83c0dbed1/ece66ec8-c2cd-56c3-8742-2dc83c0dbed1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2890974,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/55/9655e4d0af303f8f115f1f7a4baca7bc/pa/BD87504_24c852c5a1d631266ef3512d48f8f439.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-04-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A1 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2011}
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD87504%27 HTTP/1.1" 200 None
2026-03-30 10:39:30 [auto1.de] INFO: Saving data for BD87504: {'created_time': 1774867170.09172, 'last_price_update_time': 1774867170.091732, 'auction_closing_time': 1774969612.0}
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD87504') HTTP/1.1" 204 0
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_2c29a1aaf781bc1bb0fec165cce347c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD61379/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VW39600> (referer: https://www.auto1.com/v1/car-details-view/VW39600/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_ac463d76b9189f236ed2eadcb9dcacc7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_5b18184541d9c09ac78685d09f5c2eed.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_0c4305dafa6d21d4e8cd1105534ce36a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_ce7ddfa1950f1fd9f2888788ceaf6ef6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee56190>
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e584019f-07a1-573a-aaf0-6dbcaa2f3d0b/e584019f-07a1-573a-aaf0-6dbcaa2f3d0b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff6%252F65f6793a6f56915e015a082d36d230af%252Fpa%252FHH61076_2c29a1aaf781bc1bb0fec165cce347c9.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_2c29a1aaf781bc1bb0fec165cce347c9.jpg saved to cache
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e584019f-07a1-573a-aaf0-6dbcaa2f3d0b
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_9bc5ffd6ed952e0a7d272049bfaeeea7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_0436a3fa6a4222615b06cd1ad221e90c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c63a484-7662-5e5b-9717-18ac9679e2c9 with identifier: VW39600
2026-03-30 10:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c63a484-7662-5e5b-9717-18ac9679e2c9 with scrape type 1
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3c63a484-7662-5e5b-9717-18ac9679e2c9
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd9%252Facd9ebe4157d41fe88283d0d5fc33c04%252Fpa%252FVW39600_6a759920ca2c8c1318f5afe278051f71.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_6a759920ca2c8c1318f5afe278051f71.jpg not downloaded yet
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd9%252Facd9ebe4157d41fe88283d0d5fc33c04%252Fpa%252FVW39600_6c944fbd426e0fb6d8592d4a0ebc6385.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_6c944fbd426e0fb6d8592d4a0ebc6385.jpg not downloaded yet
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_60622e2bac2b2f6d2a704b3eb62e3a70.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd9%252Facd9ebe4157d41fe88283d0d5fc33c04%252Fpa%252FVW39600_ace84d855350c1fe9f90727cc9e064d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_ace84d855350c1fe9f90727cc9e064d2.jpg not downloaded yet
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c00f10>
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_214d9f57-0895-505f-9602-56610af348cf/214d9f57-0895-505f-9602-56610af348cf_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2c%252Fad2c1df241bf85da2ac7f06239118d80%252Fpa%252FXE37827_ac463d76b9189f236ed2eadcb9dcacc7.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_ac463d76b9189f236ed2eadcb9dcacc7.jpg saved to cache
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 214d9f57-0895-505f-9602-56610af348cf
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee555d0>
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_214d9f57-0895-505f-9602-56610af348cf/214d9f57-0895-505f-9602-56610af348cf_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2c%252Fad2c1df241bf85da2ac7f06239118d80%252Fpa%252FXE37827_5b18184541d9c09ac78685d09f5c2eed.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_5b18184541d9c09ac78685d09f5c2eed.jpg saved to cache
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 214d9f57-0895-505f-9602-56610af348cf
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeca010>
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_214d9f57-0895-505f-9602-56610af348cf/214d9f57-0895-505f-9602-56610af348cf_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2c%252Fad2c1df241bf85da2ac7f06239118d80%252Fpa%252FXE37827_0c4305dafa6d21d4e8cd1105534ce36a.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_0c4305dafa6d21d4e8cd1105534ce36a.jpg saved to cache
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 214d9f57-0895-505f-9602-56610af348cf
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e7a10>
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e584019f-07a1-573a-aaf0-6dbcaa2f3d0b/e584019f-07a1-573a-aaf0-6dbcaa2f3d0b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff6%252F65f6793a6f56915e015a082d36d230af%252Fpa%252FHH61076_ce7ddfa1950f1fd9f2888788ceaf6ef6.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_ce7ddfa1950f1fd9f2888788ceaf6ef6.jpg saved to cache
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e584019f-07a1-573a-aaf0-6dbcaa2f3d0b
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_e80a9c2d11a17938d514d1ce821b3785.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_32854993accc028b9e68203e5bb2134b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd9%252Facd9ebe4157d41fe88283d0d5fc33c04%252Fpa%252FVW39600_57e8a603dbc6a99b53cc50a9e2785382.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_57e8a603dbc6a99b53cc50a9e2785382.jpg not downloaded yet
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_a25fc9a978a1e6cde90ccdee312ccd98.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd9%252Facd9ebe4157d41fe88283d0d5fc33c04%252Fpa%252FVW39600_65e7d2ae15282e6cf3c15b2d6ecd1fbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_65e7d2ae15282e6cf3c15b2d6ecd1fbf.jpg not downloaded yet
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec9190>
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_214d9f57-0895-505f-9602-56610af348cf/214d9f57-0895-505f-9602-56610af348cf_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2c%252Fad2c1df241bf85da2ac7f06239118d80%252Fpa%252FXE37827_9bc5ffd6ed952e0a7d272049bfaeeea7.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_9bc5ffd6ed952e0a7d272049bfaeeea7.jpg saved to cache
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 214d9f57-0895-505f-9602-56610af348cf
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec2f10>
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_214d9f57-0895-505f-9602-56610af348cf/214d9f57-0895-505f-9602-56610af348cf_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2c%252Fad2c1df241bf85da2ac7f06239118d80%252Fpa%252FXE37827_0436a3fa6a4222615b06cd1ad221e90c.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_0436a3fa6a4222615b06cd1ad221e90c.jpg saved to cache
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 214d9f57-0895-505f-9602-56610af348cf
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef4ed90>
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e584019f-07a1-573a-aaf0-6dbcaa2f3d0b/e584019f-07a1-573a-aaf0-6dbcaa2f3d0b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff6%252F65f6793a6f56915e015a082d36d230af%252Fpa%252FHH61076_60622e2bac2b2f6d2a704b3eb62e3a70.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_60622e2bac2b2f6d2a704b3eb62e3a70.jpg saved to cache
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e584019f-07a1-573a-aaf0-6dbcaa2f3d0b
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_6c944fbd426e0fb6d8592d4a0ebc6385.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_6a759920ca2c8c1318f5afe278051f71.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_ace84d855350c1fe9f90727cc9e064d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417cc50>
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e584019f-07a1-573a-aaf0-6dbcaa2f3d0b/e584019f-07a1-573a-aaf0-6dbcaa2f3d0b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff6%252F65f6793a6f56915e015a082d36d230af%252Fpa%252FHH61076_e80a9c2d11a17938d514d1ce821b3785.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_e80a9c2d11a17938d514d1ce821b3785.jpg saved to cache
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e584019f-07a1-573a-aaf0-6dbcaa2f3d0b
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee70350>
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e584019f-07a1-573a-aaf0-6dbcaa2f3d0b/e584019f-07a1-573a-aaf0-6dbcaa2f3d0b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff6%252F65f6793a6f56915e015a082d36d230af%252Fpa%252FHH61076_32854993accc028b9e68203e5bb2134b.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_32854993accc028b9e68203e5bb2134b.jpg saved to cache
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e584019f-07a1-573a-aaf0-6dbcaa2f3d0b
2026-03-30 10:39:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e584019f-07a1-573a-aaf0-6dbcaa2f3d0b, skipping ID generation
2026-03-30 10:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e584019f-07a1-573a-aaf0-6dbcaa2f3d0b with scrape type 1
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e584019f-07a1-573a-aaf0-6dbcaa2f3d0b sending to next pipeline
2026-03-30 10:39:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e584019f-07a1-573a-aaf0-6dbcaa2f3d0b, identifier: HH61076
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4808a10>
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_214d9f57-0895-505f-9602-56610af348cf/214d9f57-0895-505f-9602-56610af348cf_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2c%252Fad2c1df241bf85da2ac7f06239118d80%252Fpa%252FXE37827_a25fc9a978a1e6cde90ccdee312ccd98.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_a25fc9a978a1e6cde90ccdee312ccd98.jpg saved to cache
2026-03-30 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 214d9f57-0895-505f-9602-56610af348cf
2026-03-30 10:39:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 214d9f57-0895-505f-9602-56610af348cf, skipping ID generation
2026-03-30 10:39:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 214d9f57-0895-505f-9602-56610af348cf with scrape type 1
2026-03-30 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 214d9f57-0895-505f-9602-56610af348cf sending to next pipeline
2026-03-30 10:39:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 214d9f57-0895-505f-9602-56610af348cf, identifier: XE37827
2026-03-30 10:39:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e584019f-07a1-573a-aaf0-6dbcaa2f3d0b with identifier: HH61076
2026-03-30 10:39:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e584019f-07a1-573a-aaf0-6dbcaa2f3d0b with identifier: HH61076
2026-03-30 10:39:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e584019f-07a1-573a-aaf0-6dbcaa2f3d0b with identifier: HH61076 to the API
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_32854993accc028b9e68203e5bb2134b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:15:18Z',
 'fuel_type': 'petrol',
 'id': 'e584019f-07a1-573a-aaf0-6dbcaa2f3d0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH61076',
 'listing': 'auction',
 'location': 'DE, Gera',
 'make': 'Opel',
 'model': 'Vectra',
 'odometer': 188565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e584019f-07a1-573a-aaf0-6dbcaa2f3d0b/e584019f-07a1-573a-aaf0-6dbcaa2f3d0b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_ce7ddfa1950f1fd9f2888788ceaf6ef6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e584019f-07a1-573a-aaf0-6dbcaa2f3d0b/e584019f-07a1-573a-aaf0-6dbcaa2f3d0b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_32854993accc028b9e68203e5bb2134b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e584019f-07a1-573a-aaf0-6dbcaa2f3d0b/e584019f-07a1-573a-aaf0-6dbcaa2f3d0b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_60622e2bac2b2f6d2a704b3eb62e3a70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e584019f-07a1-573a-aaf0-6dbcaa2f3d0b/e584019f-07a1-573a-aaf0-6dbcaa2f3d0b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_e80a9c2d11a17938d514d1ce821b3785.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e584019f-07a1-573a-aaf0-6dbcaa2f3d0b/e584019f-07a1-573a-aaf0-6dbcaa2f3d0b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 150158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/f6/65f6793a6f56915e015a082d36d230af/pa/HH61076_2c29a1aaf781bc1bb0fec165cce347c9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Vectra 1.8 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2007}
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH61076%27 HTTP/1.1" 200 None
2026-03-30 10:39:31 [auto1.de] INFO: Saving data for HH61076: {'created_time': 1774867171.836794, 'last_price_update_time': 1774867171.836805, 'auction_closing_time': 1774970118.0}
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH61076') HTTP/1.1" 204 0
2026-03-30 10:39:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 214d9f57-0895-505f-9602-56610af348cf with identifier: XE37827
2026-03-30 10:39:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 214d9f57-0895-505f-9602-56610af348cf with identifier: XE37827
2026-03-30 10:39:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 214d9f57-0895-505f-9602-56610af348cf with identifier: XE37827 to the API
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_a25fc9a978a1e6cde90ccdee312ccd98.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:44:17Z',
 'fuel_type': 'petrol',
 'id': '214d9f57-0895-505f-9602-56610af348cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE37827',
 'listing': 'auction',
 'location': 'DE, Neufahrn',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 103010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_214d9f57-0895-505f-9602-56610af348cf/214d9f57-0895-505f-9602-56610af348cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_a25fc9a978a1e6cde90ccdee312ccd98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_214d9f57-0895-505f-9602-56610af348cf/214d9f57-0895-505f-9602-56610af348cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_0436a3fa6a4222615b06cd1ad221e90c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_214d9f57-0895-505f-9602-56610af348cf/214d9f57-0895-505f-9602-56610af348cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_9bc5ffd6ed952e0a7d272049bfaeeea7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_214d9f57-0895-505f-9602-56610af348cf/214d9f57-0895-505f-9602-56610af348cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_ac463d76b9189f236ed2eadcb9dcacc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_214d9f57-0895-505f-9602-56610af348cf/214d9f57-0895-505f-9602-56610af348cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 138127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_5b18184541d9c09ac78685d09f5c2eed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_214d9f57-0895-505f-9602-56610af348cf/214d9f57-0895-505f-9602-56610af348cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/2c/ad2c1df241bf85da2ac7f06239118d80/pa/XE37827_0c4305dafa6d21d4e8cd1105534ce36a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-09-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Kia Picanto 1.1 Vision',
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2009}
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE37827%27 HTTP/1.1" 200 None
2026-03-30 10:39:32 [auto1.de] INFO: Saving data for XE37827: {'created_time': 1774867172.24288, 'last_price_update_time': 1774867172.242892, 'auction_closing_time': 1774971857.0}
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE37827') HTTP/1.1" 204 0
2026-03-30 10:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG55708/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_57e8a603dbc6a99b53cc50a9e2785382.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_65e7d2ae15282e6cf3c15b2d6ecd1fbf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef44790>
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c63a484-7662-5e5b-9717-18ac9679e2c9/3c63a484-7662-5e5b-9717-18ac9679e2c9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd9%252Facd9ebe4157d41fe88283d0d5fc33c04%252Fpa%252FVW39600_6c944fbd426e0fb6d8592d4a0ebc6385.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_6c944fbd426e0fb6d8592d4a0ebc6385.jpg saved to cache
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c63a484-7662-5e5b-9717-18ac9679e2c9
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef74f50>
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c63a484-7662-5e5b-9717-18ac9679e2c9/3c63a484-7662-5e5b-9717-18ac9679e2c9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd9%252Facd9ebe4157d41fe88283d0d5fc33c04%252Fpa%252FVW39600_6a759920ca2c8c1318f5afe278051f71.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_6a759920ca2c8c1318f5afe278051f71.jpg saved to cache
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c63a484-7662-5e5b-9717-18ac9679e2c9
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeddb90>
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c63a484-7662-5e5b-9717-18ac9679e2c9/3c63a484-7662-5e5b-9717-18ac9679e2c9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd9%252Facd9ebe4157d41fe88283d0d5fc33c04%252Fpa%252FVW39600_ace84d855350c1fe9f90727cc9e064d2.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_ace84d855350c1fe9f90727cc9e064d2.jpg saved to cache
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c63a484-7662-5e5b-9717-18ac9679e2c9
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9fa90>
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c63a484-7662-5e5b-9717-18ac9679e2c9/3c63a484-7662-5e5b-9717-18ac9679e2c9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd9%252Facd9ebe4157d41fe88283d0d5fc33c04%252Fpa%252FVW39600_57e8a603dbc6a99b53cc50a9e2785382.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_57e8a603dbc6a99b53cc50a9e2785382.jpg saved to cache
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c63a484-7662-5e5b-9717-18ac9679e2c9
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42a8890>
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c63a484-7662-5e5b-9717-18ac9679e2c9/3c63a484-7662-5e5b-9717-18ac9679e2c9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd9%252Facd9ebe4157d41fe88283d0d5fc33c04%252Fpa%252FVW39600_65e7d2ae15282e6cf3c15b2d6ecd1fbf.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_65e7d2ae15282e6cf3c15b2d6ecd1fbf.jpg saved to cache
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c63a484-7662-5e5b-9717-18ac9679e2c9
2026-03-30 10:39:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c63a484-7662-5e5b-9717-18ac9679e2c9, skipping ID generation
2026-03-30 10:39:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c63a484-7662-5e5b-9717-18ac9679e2c9 with scrape type 1
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c63a484-7662-5e5b-9717-18ac9679e2c9 sending to next pipeline
2026-03-30 10:39:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c63a484-7662-5e5b-9717-18ac9679e2c9, identifier: VW39600
2026-03-30 10:39:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c63a484-7662-5e5b-9717-18ac9679e2c9 with identifier: VW39600
2026-03-30 10:39:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c63a484-7662-5e5b-9717-18ac9679e2c9 with identifier: VW39600
2026-03-30 10:39:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c63a484-7662-5e5b-9717-18ac9679e2c9 with identifier: VW39600 to the API
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_65e7d2ae15282e6cf3c15b2d6ecd1fbf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:06:21Z',
 'fuel_type': 'petrol',
 'id': '3c63a484-7662-5e5b-9717-18ac9679e2c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW39600',
 'listing': 'auction',
 'location': 'DE, Gießen',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 121954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c63a484-7662-5e5b-9717-18ac9679e2c9/3c63a484-7662-5e5b-9717-18ac9679e2c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_6a759920ca2c8c1318f5afe278051f71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c63a484-7662-5e5b-9717-18ac9679e2c9/3c63a484-7662-5e5b-9717-18ac9679e2c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_6c944fbd426e0fb6d8592d4a0ebc6385.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c63a484-7662-5e5b-9717-18ac9679e2c9/3c63a484-7662-5e5b-9717-18ac9679e2c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_ace84d855350c1fe9f90727cc9e064d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c63a484-7662-5e5b-9717-18ac9679e2c9/3c63a484-7662-5e5b-9717-18ac9679e2c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_57e8a603dbc6a99b53cc50a9e2785382.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c63a484-7662-5e5b-9717-18ac9679e2c9/3c63a484-7662-5e5b-9717-18ac9679e2c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/d9/acd9ebe4157d41fe88283d0d5fc33c04/pa/VW39600_65e7d2ae15282e6cf3c15b2d6ecd1fbf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Energy',
 'transmission': 'manual',
 'trim': 'Energy',
 'year': 2013}
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW39600%27 HTTP/1.1" 200 None
2026-03-30 10:39:32 [auto1.de] INFO: Saving data for VW39600: {'created_time': 1774867172.980773, 'last_price_update_time': 1774867172.980785, 'auction_closing_time': 1774969581.0}
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW39600') HTTP/1.1" 204 0
2026-03-30 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_3bb118e67c185c437c505fc44bdd8b8a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_070b7df32a7077603b8e3f363b1e8176.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_0bb3d51b85d2dbca408b489c36c0d9d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_f226f12847e10b3f03698145066539fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_e06c133937c79c5669037e45385e5f42.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_55598393aa0350966f618ab4e6e5dcb1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_ef954e2706eed34655ad54fa52d6d62a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_809c657f36acbc1fdf83e0b1036ad519.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_7682ec86aeada4d7d5271b122829dde6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42a8390>
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_3bb118e67c185c437c505fc44bdd8b8a.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_3bb118e67c185c437c505fc44bdd8b8a.jpg saved to cache
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 502e109e-9f20-5c81-b511-d0b76dfb84ff
2026-03-30 10:39:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4346f90>
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_070b7df32a7077603b8e3f363b1e8176.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_070b7df32a7077603b8e3f363b1e8176.jpg saved to cache
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 502e109e-9f20-5c81-b511-d0b76dfb84ff
2026-03-30 10:39:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee459290>
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_0bb3d51b85d2dbca408b489c36c0d9d4.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_0bb3d51b85d2dbca408b489c36c0d9d4.jpg saved to cache
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 502e109e-9f20-5c81-b511-d0b76dfb84ff
2026-03-30 10:39:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43963d0>
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_f226f12847e10b3f03698145066539fb.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_f226f12847e10b3f03698145066539fb.jpg saved to cache
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 502e109e-9f20-5c81-b511-d0b76dfb84ff
2026-03-30 10:39:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee453310>
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_e06c133937c79c5669037e45385e5f42.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_e06c133937c79c5669037e45385e5f42.jpg saved to cache
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 502e109e-9f20-5c81-b511-d0b76dfb84ff
2026-03-30 10:39:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4167d50>
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_55598393aa0350966f618ab4e6e5dcb1.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_55598393aa0350966f618ab4e6e5dcb1.jpg saved to cache
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 502e109e-9f20-5c81-b511-d0b76dfb84ff
2026-03-30 10:39:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45a4d0>
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_ef954e2706eed34655ad54fa52d6d62a.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_ef954e2706eed34655ad54fa52d6d62a.jpg saved to cache
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 502e109e-9f20-5c81-b511-d0b76dfb84ff
2026-03-30 10:39:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4598d0>
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_809c657f36acbc1fdf83e0b1036ad519.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_809c657f36acbc1fdf83e0b1036ad519.jpg saved to cache
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 502e109e-9f20-5c81-b511-d0b76dfb84ff
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4165c90>
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_7682ec86aeada4d7d5271b122829dde6.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_7682ec86aeada4d7d5271b122829dde6.jpg saved to cache
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a043e4f-0c15-5573-a559-f297402c1315
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD61379> (referer: https://www.auto1.com/v1/car-details-view/JD61379/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MH00767> (referer: https://www.auto1.com/v1/car-details-view/MH00767/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_177a7161ebf4b8da699cb7edf761e4dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_449459356204b73006c527d271f5f025.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_bc5dcf5a1f432b37e92dbf3e32dcab60.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_ae881ff2d0015adc65b35b8a905c4711.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_2306c436b0e4dc9df522ea44410338ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_e69470e151ce5a8ba8283af954d48ee7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_2b0f51b4728730d213f609cd2d1e22d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecac2567-3be3-5b55-b73d-5eb705a1dc54 with identifier: JD61379
2026-03-30 10:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecac2567-3be3-5b55-b73d-5eb705a1dc54 with scrape type 1
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_3032d05360fd9ee32fb1c6d025c2a816.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_3032d05360fd9ee32fb1c6d025c2a816.jpg not downloaded yet
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_2b294970d9c33073afc4621bdd3a368d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_2b294970d9c33073afc4621bdd3a368d.jpg not downloaded yet
2026-03-30 10:39:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5cebf46-4937-59df-aea8-5bf0a2bdaa62 with identifier: MH00767
2026-03-30 10:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5cebf46-4937-59df-aea8-5bf0a2bdaa62 with scrape type 1
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a5cebf46-4937-59df-aea8-5bf0a2bdaa62
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_34b4f634b5b7b9317c3e46ac822b5b7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_34b4f634b5b7b9317c3e46ac822b5b7b.jpg not downloaded yet
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_0c9b94abdeb9be1735065aabdc0641a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_0c9b94abdeb9be1735065aabdc0641a7.jpg not downloaded yet
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_de57bd0efc148fd9fdf5911d29a8bf9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_de57bd0efc148fd9fdf5911d29a8bf9b.jpg not downloaded yet
2026-03-30 10:39:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4291590>
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb2%252Fd1b2f30148920aadcc3cfd08308f1e13%252Fpa%252FZE83569_177a7161ebf4b8da699cb7edf761e4dd.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_177a7161ebf4b8da699cb7edf761e4dd.jpg saved to cache
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 502e109e-9f20-5c81-b511-d0b76dfb84ff
2026-03-30 10:39:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 502e109e-9f20-5c81-b511-d0b76dfb84ff, skipping ID generation
2026-03-30 10:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 502e109e-9f20-5c81-b511-d0b76dfb84ff with scrape type 1
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 502e109e-9f20-5c81-b511-d0b76dfb84ff sending to next pipeline
2026-03-30 10:39:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 502e109e-9f20-5c81-b511-d0b76dfb84ff, identifier: ZE83569
2026-03-30 10:39:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 502e109e-9f20-5c81-b511-d0b76dfb84ff with identifier: ZE83569
2026-03-30 10:39:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 502e109e-9f20-5c81-b511-d0b76dfb84ff with identifier: ZE83569
2026-03-30 10:39:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 502e109e-9f20-5c81-b511-d0b76dfb84ff with identifier: ZE83569 to the API
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_177a7161ebf4b8da699cb7edf761e4dd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:35:28Z',
 'fuel_type': 'petrol',
 'id': '502e109e-9f20-5c81-b511-d0b76dfb84ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE83569',
 'listing': 'auction',
 'location': 'DE, Essen',
 'make': 'Skoda',
 'model': 'Citigo',
 'odometer': 54071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2631125,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_177a7161ebf4b8da699cb7edf761e4dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2613888,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_dbae140d8831aa62235b277889eef7b0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2489402,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_809c657f36acbc1fdf83e0b1036ad519.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2244644,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_ef954e2706eed34655ad54fa52d6d62a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2478370,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_55598393aa0350966f618ab4e6e5dcb1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2464217,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_e06c133937c79c5669037e45385e5f42.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2469724,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_f226f12847e10b3f03698145066539fb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2486194,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_070b7df32a7077603b8e3f363b1e8176.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2469062,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_3bb118e67c185c437c505fc44bdd8b8a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e109e-9f20-5c81-b511-d0b76dfb84ff/502e109e-9f20-5c81-b511-d0b76dfb84ff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3045247,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/b2/d1b2f30148920aadcc3cfd08308f1e13/pa/ZE83569_0bb3d51b85d2dbca408b489c36c0d9d4.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Skoda Citigo 1.0 MPI Clever',
 'transmission': 'manual',
 'trim': 'Clever',
 'year': 2019}
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE83569%27 HTTP/1.1" 200 None
2026-03-30 10:39:35 [auto1.de] INFO: Saving data for ZE83569: {'created_time': 1774867175.13295, 'last_price_update_time': 1774867175.13296, 'auction_closing_time': 1774971328.0}
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE83569') HTTP/1.1" 204 0
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_4ae4273b90b19ec125a2c782cea69c62.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_4ae4273b90b19ec125a2c782cea69c62.jpg not downloaded yet
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_52f551ab5ae5ec4cf4d8c9a5eb06a105.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_52f551ab5ae5ec4cf4d8c9a5eb06a105.jpg not downloaded yet
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef44dd0>
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_449459356204b73006c527d271f5f025.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_449459356204b73006c527d271f5f025.jpg saved to cache
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a043e4f-0c15-5573-a559-f297402c1315
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f593d210>
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_bc5dcf5a1f432b37e92dbf3e32dcab60.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_bc5dcf5a1f432b37e92dbf3e32dcab60.jpg saved to cache
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a043e4f-0c15-5573-a559-f297402c1315
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee479e10>
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_ae881ff2d0015adc65b35b8a905c4711.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_ae881ff2d0015adc65b35b8a905c4711.jpg saved to cache
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a043e4f-0c15-5573-a559-f297402c1315
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424ed50>
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_2306c436b0e4dc9df522ea44410338ad.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_2306c436b0e4dc9df522ea44410338ad.jpg saved to cache
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a043e4f-0c15-5573-a559-f297402c1315
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4149d0>
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_e69470e151ce5a8ba8283af954d48ee7.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_e69470e151ce5a8ba8283af954d48ee7.jpg saved to cache
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a043e4f-0c15-5573-a559-f297402c1315
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_8bcaaeb95d5394634ed1690547119964.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_8bcaaeb95d5394634ed1690547119964.jpg not downloaded yet
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_99d3b01263f51fb5b082d306ca47ae63.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_99d3b01263f51fb5b082d306ca47ae63.jpg not downloaded yet
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee308d0>
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F6f%252F036ff5b8c1b95ebd6963aa1ecf6702e7%252Fpa%252FWS77371_2b0f51b4728730d213f609cd2d1e22d9.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_2b0f51b4728730d213f609cd2d1e22d9.jpg saved to cache
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a043e4f-0c15-5573-a559-f297402c1315
2026-03-30 10:39:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a043e4f-0c15-5573-a559-f297402c1315, skipping ID generation
2026-03-30 10:39:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a043e4f-0c15-5573-a559-f297402c1315 with scrape type 1
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a043e4f-0c15-5573-a559-f297402c1315 sending to next pipeline
2026-03-30 10:39:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a043e4f-0c15-5573-a559-f297402c1315, identifier: WS77371
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_8f33f05c3f4b5d7bf41b73d60a05738e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_8f33f05c3f4b5d7bf41b73d60a05738e.jpg not downloaded yet
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_ba43bdff2aadb13a4422d09b76862db9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_ba43bdff2aadb13a4422d09b76862db9.jpg not downloaded yet
2026-03-30 10:39:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a043e4f-0c15-5573-a559-f297402c1315 with identifier: WS77371
2026-03-30 10:39:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a043e4f-0c15-5573-a559-f297402c1315 with identifier: WS77371
2026-03-30 10:39:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a043e4f-0c15-5573-a559-f297402c1315 with identifier: WS77371 to the API
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_2b0f51b4728730d213f609cd2d1e22d9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:11:15Z',
 'fuel_type': 'diesel',
 'id': '5a043e4f-0c15-5573-a559-f297402c1315',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS77371',
 'listing': 'auction',
 'location': 'DE, Landau in der Pfalz',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 201281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_2b0f51b4728730d213f609cd2d1e22d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_bc5dcf5a1f432b37e92dbf3e32dcab60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_e69470e151ce5a8ba8283af954d48ee7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_2306c436b0e4dc9df522ea44410338ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_449459356204b73006c527d271f5f025.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_ae881ff2d0015adc65b35b8a905c4711.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_8c1d394031671113e6624ebcf047c016.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_d64986d0aab24d85ffd759a920fbddb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_7682ec86aeada4d7d5271b122829dde6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a043e4f-0c15-5573-a559-f297402c1315/5a043e4f-0c15-5573-a559-f297402c1315_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/6f/036ff5b8c1b95ebd6963aa1ecf6702e7/pa/WS77371_362d0cc27f9758744738a0312d52f481.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI CrossTouran',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2011}
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS77371%27 HTTP/1.1" 200 None
2026-03-30 10:39:36 [auto1.de] INFO: Saving data for WS77371: {'created_time': 1774867176.004915, 'last_price_update_time': 1774867176.004926, 'auction_closing_time': 1774969875.0}
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS77371') HTTP/1.1" 204 0
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_eddbea2d40b182c49416671729297247.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_eddbea2d40b182c49416671729297247.jpg not downloaded yet
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_94a2fc13a063d55c4ff1b66b69731cde.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_94a2fc13a063d55c4ff1b66b69731cde.jpg not downloaded yet
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_1e43b146da9e45152942c9ed7ccba410.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_1e43b146da9e45152942c9ed7ccba410.jpg not downloaded yet
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_0c36dcd2830c98e813f609f5bf473dff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_0c36dcd2830c98e813f609f5bf473dff.jpg not downloaded yet
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_559364d75b3606248f5a879665e37f6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_559364d75b3606248f5a879665e37f6c.jpg not downloaded yet
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_3a98f897802ee03e63db598ab027aae3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_3a98f897802ee03e63db598ab027aae3.jpg not downloaded yet
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_d72c1694c9cfbe47e310434190cd14ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_d72c1694c9cfbe47e310434190cd14ec.jpg not downloaded yet
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_fe5899e222d57087bb9ceefc18cda3d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_fe5899e222d57087bb9ceefc18cda3d9.jpg not downloaded yet
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_fe81a18cb2d5cf7825a820f3d98eea33.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_fe81a18cb2d5cf7825a820f3d98eea33.jpg not downloaded yet
2026-03-30 10:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_3c14d8896bd425903e7fec5175c08fb4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_f29eb9308ae014bb5a987e1db0a81b9d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_471c0e8d5545667cde13c3563cd39c8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_242da946ae4dea37adf41669483f45e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_6f470935d4ea9883c849833f077ab19e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_1fe5fbf16260470e81421da524892e89.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_25719dd21cd3cc65350a397d1f6e6697.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_23356c4117a931e44142b4612fea57bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3eaa50>
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_3c14d8896bd425903e7fec5175c08fb4.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_3c14d8896bd425903e7fec5175c08fb4.jpg saved to cache
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0655dc4-3c20-51c8-9d1e-851a59d9c3bc
2026-03-30 10:39:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefec050>
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_f29eb9308ae014bb5a987e1db0a81b9d.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_f29eb9308ae014bb5a987e1db0a81b9d.jpg saved to cache
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0655dc4-3c20-51c8-9d1e-851a59d9c3bc
2026-03-30 10:39:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee71050>
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_471c0e8d5545667cde13c3563cd39c8b.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_471c0e8d5545667cde13c3563cd39c8b.jpg saved to cache
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0655dc4-3c20-51c8-9d1e-851a59d9c3bc
2026-03-30 10:39:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef47e50>
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_242da946ae4dea37adf41669483f45e2.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_242da946ae4dea37adf41669483f45e2.jpg saved to cache
2026-03-30 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0655dc4-3c20-51c8-9d1e-851a59d9c3bc
2026-03-30 10:39:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee72b10>
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_6f470935d4ea9883c849833f077ab19e.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_6f470935d4ea9883c849833f077ab19e.jpg saved to cache
2026-03-30 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0655dc4-3c20-51c8-9d1e-851a59d9c3bc
2026-03-30 10:39:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8e750>
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_1fe5fbf16260470e81421da524892e89.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_1fe5fbf16260470e81421da524892e89.jpg saved to cache
2026-03-30 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0655dc4-3c20-51c8-9d1e-851a59d9c3bc
2026-03-30 10:39:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef47290>
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_25719dd21cd3cc65350a397d1f6e6697.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_25719dd21cd3cc65350a397d1f6e6697.jpg saved to cache
2026-03-30 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0655dc4-3c20-51c8-9d1e-851a59d9c3bc
2026-03-30 10:39:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42b5b10>
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_23356c4117a931e44142b4612fea57bc.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_23356c4117a931e44142b4612fea57bc.jpg saved to cache
2026-03-30 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0655dc4-3c20-51c8-9d1e-851a59d9c3bc
2026-03-30 10:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_eb6f176bba503c7cb98c4fe5143bdf8e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_215429c52a87828730b6e58d854bd304.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_fe81a18cb2d5cf7825a820f3d98eea33.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_d72c1694c9cfbe47e310434190cd14ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_559364d75b3606248f5a879665e37f6c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_eddbea2d40b182c49416671729297247.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_1e43b146da9e45152942c9ed7ccba410.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e1d10>
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F34%252Feb34443e08dc41099e083e2ba4a0d97b%252Fpa%252FVS32434_eb6f176bba503c7cb98c4fe5143bdf8e.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_eb6f176bba503c7cb98c4fe5143bdf8e.jpg saved to cache
2026-03-30 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b139b1a-efe3-5304-a03a-8785c2c304ab
2026-03-30 10:39:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b139b1a-efe3-5304-a03a-8785c2c304ab, skipping ID generation
2026-03-30 10:39:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b139b1a-efe3-5304-a03a-8785c2c304ab with scrape type 1
2026-03-30 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b139b1a-efe3-5304-a03a-8785c2c304ab sending to next pipeline
2026-03-30 10:39:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b139b1a-efe3-5304-a03a-8785c2c304ab, identifier: VS32434
2026-03-30 10:39:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b139b1a-efe3-5304-a03a-8785c2c304ab with identifier: VS32434
2026-03-30 10:39:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b139b1a-efe3-5304-a03a-8785c2c304ab with identifier: VS32434
2026-03-30 10:39:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b139b1a-efe3-5304-a03a-8785c2c304ab with identifier: VS32434 to the API
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_eb6f176bba503c7cb98c4fe5143bdf8e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:42:43Z',
 'fuel_type': 'petrol',
 'id': '9b139b1a-efe3-5304-a03a-8785c2c304ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS32434',
 'listing': 'auction',
 'location': 'DE, Tradein',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 89256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3100953,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_c78139685780c967267a61dccf898664.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3070290,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_eb6f176bba503c7cb98c4fe5143bdf8e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3163137,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_a0559b23ad0d55f5fedc51dc0bf4d4ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3167354,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_697f323979255a50393555d420fa483f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3091270,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_2d84dec35ff90695d6035a450004081b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3084982,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_b548fb71a6037869ccdc0a7067815188.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3040620,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_3249bfdd0de1556a88896b6b6594165d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3195699,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_79c23a8f151664db2907566ba42eafad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3026125,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_f7036f8afe4022bf90fd6b26fca3b644.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b139b1a-efe3-5304-a03a-8785c2c304ab/9b139b1a-efe3-5304-a03a-8785c2c304ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3208376,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/34/eb34443e08dc41099e083e2ba4a0d97b/pa/VS32434_b4f0888f9b8ec556c220d255ddee7869.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-07',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Basis Prime',
 'transmission': 'automatic',
 'trim': 'Basis Prime',
 'year': 2015}
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS32434%27 HTTP/1.1" 200 None
2026-03-30 10:39:38 [auto1.de] INFO: Saving data for VS32434: {'created_time': 1774867178.493075, 'last_price_update_time': 1774867178.493085, 'auction_closing_time': 1774971763.0}
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS32434') HTTP/1.1" 204 0
2026-03-30 10:39:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeee3a90>
2026-03-30 10:39:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fb0%252F7bb0c825b0265695fc419a6eec243001%252Fpa%252FYC26029_215429c52a87828730b6e58d854bd304.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_215429c52a87828730b6e58d854bd304.jpg saved to cache
2026-03-30 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0655dc4-3c20-51c8-9d1e-851a59d9c3bc
2026-03-30 10:39:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0655dc4-3c20-51c8-9d1e-851a59d9c3bc, skipping ID generation
2026-03-30 10:39:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0655dc4-3c20-51c8-9d1e-851a59d9c3bc with scrape type 1
2026-03-30 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0655dc4-3c20-51c8-9d1e-851a59d9c3bc sending to next pipeline
2026-03-30 10:39:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0655dc4-3c20-51c8-9d1e-851a59d9c3bc, identifier: YC26029
2026-03-30 10:39:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8d950>
2026-03-30 10:39:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_fe81a18cb2d5cf7825a820f3d98eea33.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_fe81a18cb2d5cf7825a820f3d98eea33.jpg saved to cache
2026-03-30 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a5cebf46-4937-59df-aea8-5bf0a2bdaa62
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8c510>
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_d72c1694c9cfbe47e310434190cd14ec.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_d72c1694c9cfbe47e310434190cd14ec.jpg saved to cache
2026-03-30 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee567d0>
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_559364d75b3606248f5a879665e37f6c.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_559364d75b3606248f5a879665e37f6c.jpg saved to cache
2026-03-30 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414fe50>
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_eddbea2d40b182c49416671729297247.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_eddbea2d40b182c49416671729297247.jpg saved to cache
2026-03-30 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f426a250>
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_1e43b146da9e45152942c9ed7ccba410.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_1e43b146da9e45152942c9ed7ccba410.jpg saved to cache
2026-03-30 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:39:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0655dc4-3c20-51c8-9d1e-851a59d9c3bc with identifier: YC26029
2026-03-30 10:39:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0655dc4-3c20-51c8-9d1e-851a59d9c3bc with identifier: YC26029
2026-03-30 10:39:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0655dc4-3c20-51c8-9d1e-851a59d9c3bc with identifier: YC26029 to the API
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_215429c52a87828730b6e58d854bd304.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:02:21Z',
 'fuel_type': 'petrol',
 'id': 'a0655dc4-3c20-51c8-9d1e-851a59d9c3bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC26029',
 'listing': 'auction',
 'location': 'DE, Lüdenscheid',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 124726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3293985,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_215429c52a87828730b6e58d854bd304.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3145937,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_94c38fc0d4b72555411b674108740e9a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3243205,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_25719dd21cd3cc65350a397d1f6e6697.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3636982,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_23356c4117a931e44142b4612fea57bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3109982,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_1fe5fbf16260470e81421da524892e89.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3052173,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_242da946ae4dea37adf41669483f45e2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3214026,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_6f470935d4ea9883c849833f077ab19e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3151113,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_471c0e8d5545667cde13c3563cd39c8b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3248605,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_f29eb9308ae014bb5a987e1db0a81b9d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0655dc4-3c20-51c8-9d1e-851a59d9c3bc/a0655dc4-3c20-51c8-9d1e-851a59d9c3bc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2998251,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/b0/7bb0c825b0265695fc419a6eec243001/pa/YC26029_3c14d8896bd425903e7fec5175c08fb4.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2011}
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC26029%27 HTTP/1.1" 200 None
2026-03-30 10:39:39 [auto1.de] INFO: Saving data for YC26029: {'created_time': 1774867179.600518, 'last_price_update_time': 1774867179.600528, 'auction_closing_time': 1774969341.0}
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC26029') HTTP/1.1" 204 0
2026-03-30 10:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GV79461> (referer: https://www.auto1.com/v1/car-details-view/GV79461/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_fe5899e222d57087bb9ceefc18cda3d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_3a98f897802ee03e63db598ab027aae3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_94a2fc13a063d55c4ff1b66b69731cde.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_0c36dcd2830c98e813f609f5bf473dff.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_8f33f05c3f4b5d7bf41b73d60a05738e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_8bcaaeb95d5394634ed1690547119964.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_4ae4273b90b19ec125a2c782cea69c62.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_0c9b94abdeb9be1735065aabdc0641a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb783ed2-0876-5b28-b569-7f8fb4d89fc4 with identifier: GV79461
2026-03-30 10:39:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb783ed2-0876-5b28-b569-7f8fb4d89fc4 with scrape type 1
2026-03-30 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb783ed2-0876-5b28-b569-7f8fb4d89fc4
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_4b8a39c0f71ed0c5993050b26088aa51.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_4b8a39c0f71ed0c5993050b26088aa51.jpg not downloaded yet
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_6d471fa16a45b320308c70faf0d29ea9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_6d471fa16a45b320308c70faf0d29ea9.jpg not downloaded yet
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_3b83cda1ce1f649eb67794126b211680.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_3b83cda1ce1f649eb67794126b211680.jpg not downloaded yet
2026-03-30 10:39:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefdd810>
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_fe5899e222d57087bb9ceefc18cda3d9.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_fe5899e222d57087bb9ceefc18cda3d9.jpg saved to cache
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a5cebf46-4937-59df-aea8-5bf0a2bdaa62
2026-03-30 10:39:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4231e10>
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_3a98f897802ee03e63db598ab027aae3.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_3a98f897802ee03e63db598ab027aae3.jpg saved to cache
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a5cebf46-4937-59df-aea8-5bf0a2bdaa62
2026-03-30 10:39:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e30d0>
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_94a2fc13a063d55c4ff1b66b69731cde.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_94a2fc13a063d55c4ff1b66b69731cde.jpg saved to cache
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5cebf46-4937-59df-aea8-5bf0a2bdaa62
2026-03-30 10:39:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee77790>
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_0c36dcd2830c98e813f609f5bf473dff.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_0c36dcd2830c98e813f609f5bf473dff.jpg saved to cache
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a5cebf46-4937-59df-aea8-5bf0a2bdaa62
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_7c60d10f09a46dd1ac519c763bb5910a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_7c60d10f09a46dd1ac519c763bb5910a.jpg not downloaded yet
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_b21ffd5a667fff7b96c95e3b2daa9eff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_b21ffd5a667fff7b96c95e3b2daa9eff.jpg not downloaded yet
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4166050>
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_8f33f05c3f4b5d7bf41b73d60a05738e.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_8f33f05c3f4b5d7bf41b73d60a05738e.jpg saved to cache
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee33790>
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_8bcaaeb95d5394634ed1690547119964.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_8bcaaeb95d5394634ed1690547119964.jpg saved to cache
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee491f90>
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_4ae4273b90b19ec125a2c782cea69c62.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_4ae4273b90b19ec125a2c782cea69c62.jpg saved to cache
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee31d10>
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_0c9b94abdeb9be1735065aabdc0641a7.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_0c9b94abdeb9be1735065aabdc0641a7.jpg saved to cache
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_c852447addc4eddbf35f4a32bdb855e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_c852447addc4eddbf35f4a32bdb855e0.jpg not downloaded yet
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_f3632dfac52eb4756d8a09f1f43a84bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_f3632dfac52eb4756d8a09f1f43a84bd.jpg not downloaded yet
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_ebfa56ce1f1fe005a533148ca473dcf1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_ebfa56ce1f1fe005a533148ca473dcf1.jpg not downloaded yet
2026-03-30 10:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_7c60d10f09a46dd1ac519c763bb5910a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_3b83cda1ce1f649eb67794126b211680.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_6d471fa16a45b320308c70faf0d29ea9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_f5d58778753c3528ada9017243f30c29.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_f5d58778753c3528ada9017243f30c29.jpg not downloaded yet
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_36c22d172a6123c8d64679100b5b6c5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_36c22d172a6123c8d64679100b5b6c5f.jpg not downloaded yet
2026-03-30 10:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_ba43bdff2aadb13a4422d09b76862db9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_52f551ab5ae5ec4cf4d8c9a5eb06a105.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_3032d05360fd9ee32fb1c6d025c2a816.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_de57bd0efc148fd9fdf5911d29a8bf9b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_2b294970d9c33073afc4621bdd3a368d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_99d3b01263f51fb5b082d306ca47ae63.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee06c90>
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_7c60d10f09a46dd1ac519c763bb5910a.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_7c60d10f09a46dd1ac519c763bb5910a.jpg saved to cache
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb783ed2-0876-5b28-b569-7f8fb4d89fc4
2026-03-30 10:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_f3632dfac52eb4756d8a09f1f43a84bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_ebfa56ce1f1fe005a533148ca473dcf1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_c852447addc4eddbf35f4a32bdb855e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_36c22d172a6123c8d64679100b5b6c5f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424f210>
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_3b83cda1ce1f649eb67794126b211680.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_3b83cda1ce1f649eb67794126b211680.jpg saved to cache
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb783ed2-0876-5b28-b569-7f8fb4d89fc4
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef77a50>
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_6d471fa16a45b320308c70faf0d29ea9.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_6d471fa16a45b320308c70faf0d29ea9.jpg saved to cache
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb783ed2-0876-5b28-b569-7f8fb4d89fc4
2026-03-30 10:39:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee44c0d0>
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_ba43bdff2aadb13a4422d09b76862db9.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_ba43bdff2aadb13a4422d09b76862db9.jpg saved to cache
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5cebf46-4937-59df-aea8-5bf0a2bdaa62
2026-03-30 10:39:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4335a50>
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_52f551ab5ae5ec4cf4d8c9a5eb06a105.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_52f551ab5ae5ec4cf4d8c9a5eb06a105.jpg saved to cache
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5cebf46-4937-59df-aea8-5bf0a2bdaa62
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41ea810>
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_3032d05360fd9ee32fb1c6d025c2a816.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_3032d05360fd9ee32fb1c6d025c2a816.jpg saved to cache
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:39:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4389250>
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_de57bd0efc148fd9fdf5911d29a8bf9b.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_de57bd0efc148fd9fdf5911d29a8bf9b.jpg saved to cache
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5cebf46-4937-59df-aea8-5bf0a2bdaa62
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4236a50>
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ffe%252F2bfe7c0156eb092553fba852e3747378%252Fpa%252FJD61379_2b294970d9c33073afc4621bdd3a368d.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_2b294970d9c33073afc4621bdd3a368d.jpg saved to cache
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:39:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ecac2567-3be3-5b55-b73d-5eb705a1dc54, skipping ID generation
2026-03-30 10:39:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecac2567-3be3-5b55-b73d-5eb705a1dc54 with scrape type 1
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ecac2567-3be3-5b55-b73d-5eb705a1dc54 sending to next pipeline
2026-03-30 10:39:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecac2567-3be3-5b55-b73d-5eb705a1dc54, identifier: JD61379
2026-03-30 10:39:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4258750>
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_99d3b01263f51fb5b082d306ca47ae63.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_99d3b01263f51fb5b082d306ca47ae63.jpg saved to cache
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5cebf46-4937-59df-aea8-5bf0a2bdaa62
2026-03-30 10:39:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecac2567-3be3-5b55-b73d-5eb705a1dc54 with identifier: JD61379
2026-03-30 10:39:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecac2567-3be3-5b55-b73d-5eb705a1dc54 with identifier: JD61379
2026-03-30 10:39:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecac2567-3be3-5b55-b73d-5eb705a1dc54 with identifier: JD61379 to the API
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_2b294970d9c33073afc4621bdd3a368d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:11:27Z',
 'fuel_type': 'electro',
 'id': 'ecac2567-3be3-5b55-b73d-5eb705a1dc54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD61379',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 14,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_3032d05360fd9ee32fb1c6d025c2a816.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_2b294970d9c33073afc4621bdd3a368d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_0c9b94abdeb9be1735065aabdc0641a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_4ae4273b90b19ec125a2c782cea69c62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_8bcaaeb95d5394634ed1690547119964.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_8f33f05c3f4b5d7bf41b73d60a05738e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_eddbea2d40b182c49416671729297247.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_1e43b146da9e45152942c9ed7ccba410.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_559364d75b3606248f5a879665e37f6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/fe/2bfe7c0156eb092553fba852e3747378/pa/JD61379_d72c1694c9cfbe47e310434190cd14ec.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-12-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD61379%27 HTTP/1.1" 200 None
2026-03-30 10:39:42 [auto1.de] INFO: Saving data for JD61379: {'created_time': 1774867182.364407, 'last_price_update_time': 1774867182.364419, 'auction_closing_time': 1774969887.0}
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD61379') HTTP/1.1" 204 0
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee418090>
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_f3632dfac52eb4756d8a09f1f43a84bd.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_f3632dfac52eb4756d8a09f1f43a84bd.jpg saved to cache
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb783ed2-0876-5b28-b569-7f8fb4d89fc4
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f674e6d0>
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_ebfa56ce1f1fe005a533148ca473dcf1.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_ebfa56ce1f1fe005a533148ca473dcf1.jpg saved to cache
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb783ed2-0876-5b28-b569-7f8fb4d89fc4
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee458bd0>
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_c852447addc4eddbf35f4a32bdb855e0.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_c852447addc4eddbf35f4a32bdb855e0.jpg saved to cache
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb783ed2-0876-5b28-b569-7f8fb4d89fc4
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeecacd0>
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_36c22d172a6123c8d64679100b5b6c5f.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_36c22d172a6123c8d64679100b5b6c5f.jpg saved to cache
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb783ed2-0876-5b28-b569-7f8fb4d89fc4
2026-03-30 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_4b8a39c0f71ed0c5993050b26088aa51.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_34b4f634b5b7b9317c3e46ac822b5b7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_3c6acd75dc3d72b847abcb34d511fe5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_0083e3cb54ffae2b89952816e9387e97.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_f5d58778753c3528ada9017243f30c29.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_b21ffd5a667fff7b96c95e3b2daa9eff.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_515b892a19869cb55b9b5bbb0db6eea8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_49a0df314a558bd8aeb2d83f53350951.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_256fdcc2ac2f48cf949d1b552a81a6dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_01196d87d02c4a9955fb6ef5c9695c66.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_6c01c1d956bbff1c50f6a5c97b9a084f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3eced0>
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_4b8a39c0f71ed0c5993050b26088aa51.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_4b8a39c0f71ed0c5993050b26088aa51.jpg saved to cache
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb783ed2-0876-5b28-b569-7f8fb4d89fc4
2026-03-30 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_b33eee31add5abc5e4d9f9cd78f5c669.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f432d750>
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F87%252F4087145a3401f1d75c1c3b977d48af37%252Fpa%252FMH00767_34b4f634b5b7b9317c3e46ac822b5b7b.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_34b4f634b5b7b9317c3e46ac822b5b7b.jpg saved to cache
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5cebf46-4937-59df-aea8-5bf0a2bdaa62
2026-03-30 10:39:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5cebf46-4937-59df-aea8-5bf0a2bdaa62, skipping ID generation
2026-03-30 10:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5cebf46-4937-59df-aea8-5bf0a2bdaa62 with scrape type 1
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5cebf46-4937-59df-aea8-5bf0a2bdaa62 sending to next pipeline
2026-03-30 10:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5cebf46-4937-59df-aea8-5bf0a2bdaa62, identifier: MH00767
2026-03-30 10:39:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MF98789> (referer: https://www.auto1.com/v1/car-details-view/MF98789/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5cebf46-4937-59df-aea8-5bf0a2bdaa62 with identifier: MH00767
2026-03-30 10:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5cebf46-4937-59df-aea8-5bf0a2bdaa62 with identifier: MH00767
2026-03-30 10:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5cebf46-4937-59df-aea8-5bf0a2bdaa62 with identifier: MH00767 to the API
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_34b4f634b5b7b9317c3e46ac822b5b7b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 207,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:38:17Z',
 'fuel_type': 'diesel',
 'id': 'a5cebf46-4937-59df-aea8-5bf0a2bdaa62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH00767',
 'listing': 'auction',
 'location': 'DE, Halle',
 'make': 'Mercedes-Benz',
 'model': 'X-Klasse',
 'odometer': 81302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3165287,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_34b4f634b5b7b9317c3e46ac822b5b7b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3137844,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_de57bd0efc148fd9fdf5911d29a8bf9b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3248054,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_52f551ab5ae5ec4cf4d8c9a5eb06a105.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3371126,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_99d3b01263f51fb5b082d306ca47ae63.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3150525,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_ba43bdff2aadb13a4422d09b76862db9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3196668,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_94a2fc13a063d55c4ff1b66b69731cde.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3335970,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_0c36dcd2830c98e813f609f5bf473dff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3357363,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_3a98f897802ee03e63db598ab027aae3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3008634,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_fe5899e222d57087bb9ceefc18cda3d9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cebf46-4937-59df-aea8-5bf0a2bdaa62/a5cebf46-4937-59df-aea8-5bf0a2bdaa62_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3272609,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/87/4087145a3401f1d75c1c3b977d48af37/pa/MH00767_fe81a18cb2d5cf7825a820f3d98eea33.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz X-Klasse X 250 d 4Matic Doppelkabine Edition '
          'Progressive',
 'transmission': 'automatic',
 'trim': '4Matic Doppelkabine Edition Progressive',
 'year': 2018}
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH00767%27 HTTP/1.1" 200 None
2026-03-30 10:39:43 [auto1.de] INFO: Saving data for MH00767: {'created_time': 1774867183.475478, 'last_price_update_time': 1774867183.475487, 'auction_closing_time': 1774971497.0}
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH00767') HTTP/1.1" 204 0
2026-03-30 10:39:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd7e90>
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_3c6acd75dc3d72b847abcb34d511fe5d.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_3c6acd75dc3d72b847abcb34d511fe5d.jpg saved to cache
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7245ac46-6452-596c-a22f-a6d44b5a61ce
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4379a90>
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_0083e3cb54ffae2b89952816e9387e97.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_0083e3cb54ffae2b89952816e9387e97.jpg saved to cache
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7245ac46-6452-596c-a22f-a6d44b5a61ce
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f436f5d0>
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_f5d58778753c3528ada9017243f30c29.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_f5d58778753c3528ada9017243f30c29.jpg saved to cache
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb783ed2-0876-5b28-b569-7f8fb4d89fc4
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f437b610>
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F4a%252F8d4a8ef181c1a8750d9f7524cd85e7ad%252Fpa%252FGV79461_b21ffd5a667fff7b96c95e3b2daa9eff.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_b21ffd5a667fff7b96c95e3b2daa9eff.jpg saved to cache
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb783ed2-0876-5b28-b569-7f8fb4d89fc4
2026-03-30 10:39:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb783ed2-0876-5b28-b569-7f8fb4d89fc4, skipping ID generation
2026-03-30 10:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb783ed2-0876-5b28-b569-7f8fb4d89fc4 with scrape type 1
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb783ed2-0876-5b28-b569-7f8fb4d89fc4 sending to next pipeline
2026-03-30 10:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb783ed2-0876-5b28-b569-7f8fb4d89fc4, identifier: GV79461
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c0a310>
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_515b892a19869cb55b9b5bbb0db6eea8.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_515b892a19869cb55b9b5bbb0db6eea8.jpg saved to cache
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7245ac46-6452-596c-a22f-a6d44b5a61ce
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f437a090>
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_49a0df314a558bd8aeb2d83f53350951.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_49a0df314a558bd8aeb2d83f53350951.jpg saved to cache
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7245ac46-6452-596c-a22f-a6d44b5a61ce
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f47dc690>
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_256fdcc2ac2f48cf949d1b552a81a6dd.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_256fdcc2ac2f48cf949d1b552a81a6dd.jpg saved to cache
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7245ac46-6452-596c-a22f-a6d44b5a61ce
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefe1990>
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_01196d87d02c4a9955fb6ef5c9695c66.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_01196d87d02c4a9955fb6ef5c9695c66.jpg saved to cache
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7245ac46-6452-596c-a22f-a6d44b5a61ce
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4289fd0>
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_6c01c1d956bbff1c50f6a5c97b9a084f.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_6c01c1d956bbff1c50f6a5c97b9a084f.jpg saved to cache
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7245ac46-6452-596c-a22f-a6d44b5a61ce
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f432fad0>
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fd1%252F4cd1311e1680f5cae3af62f3896803d4%252Fpa%252FUJ24923_b33eee31add5abc5e4d9f9cd78f5c669.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_b33eee31add5abc5e4d9f9cd78f5c669.jpg saved to cache
2026-03-30 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7245ac46-6452-596c-a22f-a6d44b5a61ce
2026-03-30 10:39:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7245ac46-6452-596c-a22f-a6d44b5a61ce, skipping ID generation
2026-03-30 10:39:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7245ac46-6452-596c-a22f-a6d44b5a61ce with scrape type 1
2026-03-30 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7245ac46-6452-596c-a22f-a6d44b5a61ce sending to next pipeline
2026-03-30 10:39:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7245ac46-6452-596c-a22f-a6d44b5a61ce, identifier: UJ24923
2026-03-30 10:39:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb783ed2-0876-5b28-b569-7f8fb4d89fc4 with identifier: GV79461
2026-03-30 10:39:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb783ed2-0876-5b28-b569-7f8fb4d89fc4 with identifier: GV79461
2026-03-30 10:39:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb783ed2-0876-5b28-b569-7f8fb4d89fc4 with identifier: GV79461 to the API
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_b21ffd5a667fff7b96c95e3b2daa9eff.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:59:14Z',
 'fuel_type': 'petrol',
 'id': 'cb783ed2-0876-5b28-b569-7f8fb4d89fc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV79461',
 'listing': 'auction',
 'location': 'DE, Norderstedt',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 118767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2802564,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_4b8a39c0f71ed0c5993050b26088aa51.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_6d471fa16a45b320308c70faf0d29ea9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_3b83cda1ce1f649eb67794126b211680.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_7c60d10f09a46dd1ac519c763bb5910a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_b21ffd5a667fff7b96c95e3b2daa9eff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_c852447addc4eddbf35f4a32bdb855e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_f3632dfac52eb4756d8a09f1f43a84bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_ebfa56ce1f1fe005a533148ca473dcf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_f5d58778753c3528ada9017243f30c29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb783ed2-0876-5b28-b569-7f8fb4d89fc4/cb783ed2-0876-5b28-b569-7f8fb4d89fc4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/4a/8d4a8ef181c1a8750d9f7524cd85e7ad/pa/GV79461_36c22d172a6123c8d64679100b5b6c5f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV79461%27 HTTP/1.1" 200 None
2026-03-30 10:39:45 [auto1.de] INFO: Saving data for GV79461: {'created_time': 1774867185.064894, 'last_price_update_time': 1774867185.064907, 'auction_closing_time': 1774972754.0}
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV79461') HTTP/1.1" 204 0
2026-03-30 10:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7245ac46-6452-596c-a22f-a6d44b5a61ce with identifier: UJ24923
2026-03-30 10:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7245ac46-6452-596c-a22f-a6d44b5a61ce with identifier: UJ24923
2026-03-30 10:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7245ac46-6452-596c-a22f-a6d44b5a61ce with identifier: UJ24923 to the API
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_b33eee31add5abc5e4d9f9cd78f5c669.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:01:38Z',
 'fuel_type': 'petrol',
 'id': '7245ac46-6452-596c-a22f-a6d44b5a61ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ24923',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 33377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_6c01c1d956bbff1c50f6a5c97b9a084f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_01196d87d02c4a9955fb6ef5c9695c66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_0083e3cb54ffae2b89952816e9387e97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_256fdcc2ac2f48cf949d1b552a81a6dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_49a0df314a558bd8aeb2d83f53350951.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_515b892a19869cb55b9b5bbb0db6eea8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_b33eee31add5abc5e4d9f9cd78f5c669.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_3c6acd75dc3d72b847abcb34d511fe5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_8ffdc8a6cf41cb606a47e569a072508a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7245ac46-6452-596c-a22f-a6d44b5a61ce/7245ac46-6452-596c-a22f-a6d44b5a61ce_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/d1/4cd1311e1680f5cae3af62f3896803d4/pa/UJ24923_f486853de3f10ebc1bf5bc5d30c884b0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 IQ.DRIVE',
 'transmission': 'manual',
 'trim': 'IQ.DRIVE',
 'year': 2019}
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ24923%27 HTTP/1.1" 200 None
2026-03-30 10:39:45 [auto1.de] INFO: Saving data for UJ24923: {'created_time': 1774867185.47012, 'last_price_update_time': 1774867185.470131, 'auction_closing_time': 1774969298.0}
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ24923') HTTP/1.1" 204 0
2026-03-30 10:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_9f5ba9639f03e74d695535c653813a84.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce147cb4-5733-5711-9256-32d2e36da4d5 with identifier: MF98789
2026-03-30 10:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce147cb4-5733-5711-9256-32d2e36da4d5 with scrape type 1
2026-03-30 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ce147cb4-5733-5711-9256-32d2e36da4d5
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fd0%252F50d0702f048ccab9105a421f00caa11e%252Fpa%252FMF98789_c86b54fdff1d2f2c2e1153b35050e191.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_c86b54fdff1d2f2c2e1153b35050e191.jpg not downloaded yet
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fd0%252F50d0702f048ccab9105a421f00caa11e%252Fpa%252FMF98789_e664e9422404dcb867e867e455343839.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_e664e9422404dcb867e867e455343839.jpg not downloaded yet
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fd0%252F50d0702f048ccab9105a421f00caa11e%252Fpa%252FMF98789_2128d66c165d87d007322b7288fdbac5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_2128d66c165d87d007322b7288fdbac5.jpg not downloaded yet
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fd0%252F50d0702f048ccab9105a421f00caa11e%252Fpa%252FMF98789_41f6b8f9cd6e3d6aa27cecbace013e1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_41f6b8f9cd6e3d6aa27cecbace013e1b.jpg not downloaded yet
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fd0%252F50d0702f048ccab9105a421f00caa11e%252Fpa%252FMF98789_6ce9c7250c987c68b71617f5e036ecb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_6ce9c7250c987c68b71617f5e036ecb0.jpg not downloaded yet
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fd0%252F50d0702f048ccab9105a421f00caa11e%252Fpa%252FMF98789_d227fa2788fbc688b60feb84fa2cb7ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_d227fa2788fbc688b60feb84fa2cb7ef.jpg not downloaded yet
2026-03-30 10:39:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8df90>
2026-03-30 10:39:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60812389-82e3-54c2-bc65-39fbb8443718/60812389-82e3-54c2-bc65-39fbb8443718_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F08%252Fa0086ded281eed395e5bc08a6df62225%252Fpa%252FSB38553_9f5ba9639f03e74d695535c653813a84.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_9f5ba9639f03e74d695535c653813a84.jpg saved to cache
2026-03-30 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60812389-82e3-54c2-bc65-39fbb8443718
2026-03-30 10:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY24892/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH80135> (referer: https://www.auto1.com/v1/car-details-view/GH80135/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_d227fa2788fbc688b60feb84fa2cb7ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_41f6b8f9cd6e3d6aa27cecbace013e1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_6ce9c7250c987c68b71617f5e036ecb0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acf3fe72-685e-5977-bfa5-b98614339b1c with identifier: GH80135
2026-03-30 10:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acf3fe72-685e-5977-bfa5-b98614339b1c with scrape type 1
2026-03-30 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item acf3fe72-685e-5977-bfa5-b98614339b1c
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_75c718f3cf50b5978866f1d72ee8e073.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_75c718f3cf50b5978866f1d72ee8e073.jpg not downloaded yet
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_a0c3e23b3d7a72dd58c5c21acfaedde7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_a0c3e23b3d7a72dd58c5c21acfaedde7.jpg not downloaded yet
2026-03-30 10:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_2128d66c165d87d007322b7288fdbac5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_58c6c73dc2c6ffbf450d8d7ed4e8a60b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_58c6c73dc2c6ffbf450d8d7ed4e8a60b.jpg not downloaded yet
2026-03-30 10:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefb6f50>
2026-03-30 10:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce147cb4-5733-5711-9256-32d2e36da4d5/ce147cb4-5733-5711-9256-32d2e36da4d5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fd0%252F50d0702f048ccab9105a421f00caa11e%252Fpa%252FMF98789_d227fa2788fbc688b60feb84fa2cb7ef.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_d227fa2788fbc688b60feb84fa2cb7ef.jpg saved to cache
2026-03-30 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ce147cb4-5733-5711-9256-32d2e36da4d5
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_d4ba1622d43079c383cad22f1378e79d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_d4ba1622d43079c383cad22f1378e79d.jpg not downloaded yet
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_d4a6068af3855640ebf3b0c5ec0d2e3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_d4a6068af3855640ebf3b0c5ec0d2e3c.jpg not downloaded yet
2026-03-30 10:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG55708> (referer: https://www.auto1.com/v1/car-details-view/FG55708/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee3d2d0>
2026-03-30 10:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce147cb4-5733-5711-9256-32d2e36da4d5/ce147cb4-5733-5711-9256-32d2e36da4d5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fd0%252F50d0702f048ccab9105a421f00caa11e%252Fpa%252FMF98789_41f6b8f9cd6e3d6aa27cecbace013e1b.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_41f6b8f9cd6e3d6aa27cecbace013e1b.jpg saved to cache
2026-03-30 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce147cb4-5733-5711-9256-32d2e36da4d5
2026-03-30 10:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee490150>
2026-03-30 10:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce147cb4-5733-5711-9256-32d2e36da4d5/ce147cb4-5733-5711-9256-32d2e36da4d5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fd0%252F50d0702f048ccab9105a421f00caa11e%252Fpa%252FMF98789_6ce9c7250c987c68b71617f5e036ecb0.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_6ce9c7250c987c68b71617f5e036ecb0.jpg saved to cache
2026-03-30 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce147cb4-5733-5711-9256-32d2e36da4d5
2026-03-30 10:39:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_ec382b076c82cd622b2fbd6ec980515f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_ec382b076c82cd622b2fbd6ec980515f.jpg not downloaded yet
2026-03-30 10:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef0d690>
2026-03-30 10:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce147cb4-5733-5711-9256-32d2e36da4d5/ce147cb4-5733-5711-9256-32d2e36da4d5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fd0%252F50d0702f048ccab9105a421f00caa11e%252Fpa%252FMF98789_2128d66c165d87d007322b7288fdbac5.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_2128d66c165d87d007322b7288fdbac5.jpg saved to cache
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce147cb4-5733-5711-9256-32d2e36da4d5
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_c8035cf6c20dd05f81751f06b429f518.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_c8035cf6c20dd05f81751f06b429f518.jpg not downloaded yet
2026-03-30 10:39:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1 with identifier: FG55708
2026-03-30 10:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1 with scrape type 1
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_97f6eb65711e078cc564aad590bafc00.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_97f6eb65711e078cc564aad590bafc00.jpg not downloaded yet
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_a5d36300b52e074b7e135a8f2e7d4459.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_a5d36300b52e074b7e135a8f2e7d4459.jpg not downloaded yet
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_d1299cb0b546795013f78f384fdf3753.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_d1299cb0b546795013f78f384fdf3753.jpg not downloaded yet
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_2a8b6070f0922f2b049ab9c24d4b8f3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_2a8b6070f0922f2b049ab9c24d4b8f3a.jpg not downloaded yet
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_fd998f9e0a619fe685b7f9518c1765db.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_fd998f9e0a619fe685b7f9518c1765db.jpg not downloaded yet
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_96ec4feb2b9bdd862bfa06556784767f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_96ec4feb2b9bdd862bfa06556784767f.jpg not downloaded yet
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_b27b10648efdb61fa84a33410f8318af.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_b27b10648efdb61fa84a33410f8318af.jpg not downloaded yet
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_0d6b9f523066e0724f40639c006e132b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_0d6b9f523066e0724f40639c006e132b.jpg not downloaded yet
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_fe1615453f66b5a5f0f267175bd255a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_fe1615453f66b5a5f0f267175bd255a6.jpg not downloaded yet
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_c046fe80326773c4574b1a7f4a5f8adf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_c046fe80326773c4574b1a7f4a5f8adf.jpg not downloaded yet
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_27ebbb6d691b8542a6311f9322bc0875.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_27ebbb6d691b8542a6311f9322bc0875.jpg not downloaded yet
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_bc8485a0de44e3b639207360928625de.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_bc8485a0de44e3b639207360928625de.jpg not downloaded yet
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_41eae1907a5532d23fb814b58ac571b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_41eae1907a5532d23fb814b58ac571b6.jpg not downloaded yet
2026-03-30 10:39:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_a0c3e23b3d7a72dd58c5c21acfaedde7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_d4a6068af3855640ebf3b0c5ec0d2e3c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3eb90>
2026-03-30 10:39:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_a0c3e23b3d7a72dd58c5c21acfaedde7.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_a0c3e23b3d7a72dd58c5c21acfaedde7.jpg saved to cache
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item acf3fe72-685e-5977-bfa5-b98614339b1c
2026-03-30 10:39:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee490d90>
2026-03-30 10:39:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_d4a6068af3855640ebf3b0c5ec0d2e3c.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_d4a6068af3855640ebf3b0c5ec0d2e3c.jpg saved to cache
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item acf3fe72-685e-5977-bfa5-b98614339b1c
2026-03-30 10:39:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_41eae1907a5532d23fb814b58ac571b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WZ29509/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef843d0>
2026-03-30 10:39:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_41eae1907a5532d23fb814b58ac571b6.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_41eae1907a5532d23fb814b58ac571b6.jpg saved to cache
2026-03-30 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1
2026-03-30 10:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_c046fe80326773c4574b1a7f4a5f8adf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_bc8485a0de44e3b639207360928625de.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58d07d0>
2026-03-30 10:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_c046fe80326773c4574b1a7f4a5f8adf.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_c046fe80326773c4574b1a7f4a5f8adf.jpg saved to cache
2026-03-30 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1
2026-03-30 10:39:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee491f50>
2026-03-30 10:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_bc8485a0de44e3b639207360928625de.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_bc8485a0de44e3b639207360928625de.jpg saved to cache
2026-03-30 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1
2026-03-30 10:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_27ebbb6d691b8542a6311f9322bc0875.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef35bd0>
2026-03-30 10:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_27ebbb6d691b8542a6311f9322bc0875.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_27ebbb6d691b8542a6311f9322bc0875.jpg saved to cache
2026-03-30 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1
2026-03-30 10:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_fe1615453f66b5a5f0f267175bd255a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_0d6b9f523066e0724f40639c006e132b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef2350>
2026-03-30 10:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_fe1615453f66b5a5f0f267175bd255a6.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_fe1615453f66b5a5f0f267175bd255a6.jpg saved to cache
2026-03-30 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1
2026-03-30 10:39:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41c5410>
2026-03-30 10:39:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_0d6b9f523066e0724f40639c006e132b.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_0d6b9f523066e0724f40639c006e132b.jpg saved to cache
2026-03-30 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1
2026-03-30 10:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_b27b10648efdb61fa84a33410f8318af.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeef950>
2026-03-30 10:39:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_b27b10648efdb61fa84a33410f8318af.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_b27b10648efdb61fa84a33410f8318af.jpg saved to cache
2026-03-30 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1
2026-03-30 10:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_96ec4feb2b9bdd862bfa06556784767f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_fd998f9e0a619fe685b7f9518c1765db.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58d2090>
2026-03-30 10:39:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_96ec4feb2b9bdd862bfa06556784767f.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_96ec4feb2b9bdd862bfa06556784767f.jpg saved to cache
2026-03-30 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item acf3fe72-685e-5977-bfa5-b98614339b1c
2026-03-30 10:39:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeef190>
2026-03-30 10:39:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_fd998f9e0a619fe685b7f9518c1765db.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_fd998f9e0a619fe685b7f9518c1765db.jpg saved to cache
2026-03-30 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1
2026-03-30 10:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_2a8b6070f0922f2b049ab9c24d4b8f3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:50 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 9436 | hits on page: 40
2026-03-30 10:39:50 [auto1.de] INFO: Found listing with ID: MT60714
2026-03-30 10:39:50 [auto1.de] INFO: Found listing with ID: JD61379
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD61379%27 HTTP/1.1" 200 None
2026-03-30 10:39:50 [auto1.de] INFO: Scrape type for JD61379: 0
2026-03-30 10:39:50 [auto1.de] INFO: Found listing with ID: HH61076
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH61076%27 HTTP/1.1" 200 None
2026-03-30 10:39:50 [auto1.de] INFO: Scrape type for HH61076: 0
2026-03-30 10:39:50 [auto1.de] INFO: Found listing with ID: VK27516
2026-03-30 10:39:50 [auto1.de] INFO: Found listing with ID: FG83238
2026-03-30 10:39:50 [auto1.de] INFO: Found listing with ID: GS63094
2026-03-30 10:39:50 [auto1.de] INFO: Found listing with ID: FC96399
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC96399%27 HTTP/1.1" 200 None
2026-03-30 10:39:50 [auto1.de] INFO: Scrape type for FC96399: 2
2026-03-30 10:39:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a67f334-faad-5ca5-8b38-8bfadc4c6fc8 with identifier: FC96399
2026-03-30 10:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a67f334-faad-5ca5-8b38-8bfadc4c6fc8 with scrape type 2
2026-03-30 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a67f334-faad-5ca5-8b38-8bfadc4c6fc8 with scrape type 2
2026-03-30 10:39:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a67f334-faad-5ca5-8b38-8bfadc4c6fc8, identifier: FC96399
2026-03-30 10:39:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a67f334-faad-5ca5-8b38-8bfadc4c6fc8 with identifier: FC96399
2026-03-30 10:39:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a67f334-faad-5ca5-8b38-8bfadc4c6fc8 with identifier: FC96399
2026-03-30 10:39:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a67f334-faad-5ca5-8b38-8bfadc4c6fc8 with identifier: FC96399 to the API
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:44:05Z',
 'fuel_type': 'diesel',
 'id': '5a67f334-faad-5ca5-8b38-8bfadc4c6fc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC96399',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 246750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-31',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC96399%27 HTTP/1.1" 200 None
2026-03-30 10:39:50 [auto1.de] INFO: Saving data for FC96399: {'auction_closing_time': 1774971845.0, 'created_time': 1773303799.737891, 'last_price_update_time': 1774867190.601476}
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC96399') HTTP/1.1" 204 0
2026-03-30 10:39:50 [auto1.de] INFO: Found listing with ID: DB06170
2026-03-30 10:39:50 [auto1.de] INFO: Found listing with ID: XE05713
2026-03-30 10:39:50 [auto1.de] INFO: Found listing with ID: MM13759
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM13759%27 HTTP/1.1" 200 None
2026-03-30 10:39:50 [auto1.de] INFO: Scrape type for MM13759: 1
2026-03-30 10:39:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4228150>
2026-03-30 10:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_2a8b6070f0922f2b049ab9c24d4b8f3a.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_2a8b6070f0922f2b049ab9c24d4b8f3a.jpg saved to cache
2026-03-30 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item acf3fe72-685e-5977-bfa5-b98614339b1c
2026-03-30 10:39:50 [auto1.de] INFO: Found listing with ID: CC81161
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC81161%27 HTTP/1.1" 200 None
2026-03-30 10:39:50 [auto1.de] INFO: Scrape type for CC81161: 1
2026-03-30 10:39:50 [auto1.de] INFO: Found listing with ID: KE34822
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE34822%27 HTTP/1.1" 200 None
2026-03-30 10:39:50 [auto1.de] INFO: Scrape type for KE34822: 1
2026-03-30 10:39:50 [auto1.de] INFO: Found listing with ID: YL30393
2026-03-30 10:39:50 [auto1.de] INFO: Found listing with ID: VY48423
2026-03-30 10:39:50 [auto1.de] INFO: Found listing with ID: MN14132
2026-03-30 10:39:50 [auto1.de] INFO: Found listing with ID: EW71270
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW71270%27 HTTP/1.1" 200 None
2026-03-30 10:39:50 [auto1.de] INFO: Scrape type for EW71270: 1
2026-03-30 10:39:50 [auto1.de] INFO: Found listing with ID: UW97572
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW97572%27 HTTP/1.1" 200 None
2026-03-30 10:39:50 [auto1.de] INFO: Scrape type for UW97572: 1
2026-03-30 10:39:50 [auto1.de] INFO: Found listing with ID: ZY80626
2026-03-30 10:39:50 [auto1.de] INFO: Found listing with ID: GZ32446
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ32446%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [auto1.de] INFO: Scrape type for GZ32446: 1
2026-03-30 10:39:51 [auto1.de] INFO: Found listing with ID: DH22433
2026-03-30 10:39:51 [auto1.de] INFO: Found listing with ID: PJ15817
2026-03-30 10:39:51 [auto1.de] INFO: Found listing with ID: UA78695
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA78695%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [auto1.de] INFO: Scrape type for UA78695: 1
2026-03-30 10:39:51 [auto1.de] INFO: Found listing with ID: RP16081
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP16081%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [auto1.de] INFO: Scrape type for RP16081: 2
2026-03-30 10:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 414a56e1-615a-589c-a989-48af48fbf0c4 with identifier: RP16081
2026-03-30 10:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 414a56e1-615a-589c-a989-48af48fbf0c4 with scrape type 2
2026-03-30 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 414a56e1-615a-589c-a989-48af48fbf0c4 with scrape type 2
2026-03-30 10:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 414a56e1-615a-589c-a989-48af48fbf0c4, identifier: RP16081
2026-03-30 10:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 414a56e1-615a-589c-a989-48af48fbf0c4 with identifier: RP16081
2026-03-30 10:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 414a56e1-615a-589c-a989-48af48fbf0c4 with identifier: RP16081
2026-03-30 10:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 414a56e1-615a-589c-a989-48af48fbf0c4 with identifier: RP16081 to the API
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:07:35Z',
 'fuel_type': 'petrol',
 'id': '414a56e1-615a-589c-a989-48af48fbf0c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP16081',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 164114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-13',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2011}
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP16081%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [auto1.de] INFO: Saving data for RP16081: {'auction_closing_time': 1774969655.0, 'created_time': 1773687002.089922, 'last_price_update_time': 1774867191.469248}
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP16081') HTTP/1.1" 204 0
2026-03-30 10:39:51 [auto1.de] INFO: Found listing with ID: MR77046
2026-03-30 10:39:51 [auto1.de] INFO: Found listing with ID: HK11659
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK11659%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [auto1.de] INFO: Scrape type for HK11659: 2
2026-03-30 10:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e15901c6-a38e-5178-a3ef-d0ccec16e70f with identifier: HK11659
2026-03-30 10:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e15901c6-a38e-5178-a3ef-d0ccec16e70f with scrape type 2
2026-03-30 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e15901c6-a38e-5178-a3ef-d0ccec16e70f with scrape type 2
2026-03-30 10:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e15901c6-a38e-5178-a3ef-d0ccec16e70f, identifier: HK11659
2026-03-30 10:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e15901c6-a38e-5178-a3ef-d0ccec16e70f with identifier: HK11659
2026-03-30 10:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e15901c6-a38e-5178-a3ef-d0ccec16e70f with identifier: HK11659
2026-03-30 10:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e15901c6-a38e-5178-a3ef-d0ccec16e70f with identifier: HK11659 to the API
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:23:18Z',
 'fuel_type': 'diesel',
 'id': 'e15901c6-a38e-5178-a3ef-d0ccec16e70f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK11659',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 160484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-07',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2012}
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK11659%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [auto1.de] INFO: Saving data for HK11659: {'auction_closing_time': 1774970598.0, 'created_time': 1774293437.202783, 'last_price_update_time': 1774867191.966449}
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK11659') HTTP/1.1" 204 0
2026-03-30 10:39:51 [auto1.de] INFO: Found listing with ID: GF15006
2026-03-30 10:39:51 [auto1.de] INFO: Found listing with ID: TC02406
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC02406%27 HTTP/1.1" 200 None
2026-03-30 10:39:52 [auto1.de] INFO: Scrape type for TC02406: 1
2026-03-30 10:39:52 [auto1.de] INFO: Found listing with ID: MU06450
2026-03-30 10:39:52 [auto1.de] INFO: Found listing with ID: CS99643
2026-03-30 10:39:52 [auto1.de] INFO: Found listing with ID: EL22398
2026-03-30 10:39:52 [auto1.de] INFO: Found listing with ID: CL94836
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL94836%27 HTTP/1.1" 200 None
2026-03-30 10:39:52 [auto1.de] INFO: Scrape type for CL94836: 2
2026-03-30 10:39:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd420c20-8a9b-52e4-a8af-e77d4f9b3189 with identifier: CL94836
2026-03-30 10:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd420c20-8a9b-52e4-a8af-e77d4f9b3189 with scrape type 2
2026-03-30 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd420c20-8a9b-52e4-a8af-e77d4f9b3189 with scrape type 2
2026-03-30 10:39:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd420c20-8a9b-52e4-a8af-e77d4f9b3189, identifier: CL94836
2026-03-30 10:39:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd420c20-8a9b-52e4-a8af-e77d4f9b3189 with identifier: CL94836
2026-03-30 10:39:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd420c20-8a9b-52e4-a8af-e77d4f9b3189 with identifier: CL94836
2026-03-30 10:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd420c20-8a9b-52e4-a8af-e77d4f9b3189 with identifier: CL94836 to the API
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:41:53Z',
 'fuel_type': 'petrol',
 'id': 'bd420c20-8a9b-52e4-a8af-e77d4f9b3189',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL94836',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 154266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-26',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Signature',
 'transmission': 'manual',
 'trim': 'Signature',
 'year': 2018}
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL94836%27 HTTP/1.1" 200 None
2026-03-30 10:39:52 [auto1.de] INFO: Saving data for CL94836: {'auction_closing_time': 1774971713.0, 'created_time': 1774262951.973582, 'last_price_update_time': 1774867192.414222}
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL94836') HTTP/1.1" 204 0
2026-03-30 10:39:52 [auto1.de] INFO: Found listing with ID: RA51445
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA51445%27 HTTP/1.1" 200 None
2026-03-30 10:39:52 [auto1.de] INFO: Scrape type for RA51445: 1
2026-03-30 10:39:52 [auto1.de] INFO: Found listing with ID: ZA71283
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA71283%27 HTTP/1.1" 200 None
2026-03-30 10:39:52 [auto1.de] INFO: Scrape type for ZA71283: 2
2026-03-30 10:39:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ba885eb-3724-5968-ae98-919fa796d3c1 with identifier: ZA71283
2026-03-30 10:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ba885eb-3724-5968-ae98-919fa796d3c1 with scrape type 2
2026-03-30 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ba885eb-3724-5968-ae98-919fa796d3c1 with scrape type 2
2026-03-30 10:39:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ba885eb-3724-5968-ae98-919fa796d3c1, identifier: ZA71283
2026-03-30 10:39:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ba885eb-3724-5968-ae98-919fa796d3c1 with identifier: ZA71283
2026-03-30 10:39:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ba885eb-3724-5968-ae98-919fa796d3c1 with identifier: ZA71283
2026-03-30 10:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ba885eb-3724-5968-ae98-919fa796d3c1 with identifier: ZA71283 to the API
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-31T15:06:15Z',
 'fuel_type': 'petrol',
 'id': '9ba885eb-3724-5968-ae98-919fa796d3c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA71283',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 113899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-08',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 Turbo',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA71283%27 HTTP/1.1" 200 None
2026-03-30 10:39:53 [auto1.de] INFO: Saving data for ZA71283: {'auction_closing_time': 1774969575.0, 'created_time': 1774294149.266281, 'last_price_update_time': 1774867193.011419}
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA71283') HTTP/1.1" 204 0
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: WS06409
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: DV57732
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: BR36713
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR36713%27 HTTP/1.1" 200 None
2026-03-30 10:39:53 [auto1.de] INFO: Scrape type for BR36713: 2
2026-03-30 10:39:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c742fc5e-7b2a-58e2-8114-ccc5bbfc7e6f with identifier: BR36713
2026-03-30 10:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c742fc5e-7b2a-58e2-8114-ccc5bbfc7e6f with scrape type 2
2026-03-30 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c742fc5e-7b2a-58e2-8114-ccc5bbfc7e6f with scrape type 2
2026-03-30 10:39:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c742fc5e-7b2a-58e2-8114-ccc5bbfc7e6f, identifier: BR36713
2026-03-30 10:39:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c742fc5e-7b2a-58e2-8114-ccc5bbfc7e6f with identifier: BR36713
2026-03-30 10:39:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c742fc5e-7b2a-58e2-8114-ccc5bbfc7e6f with identifier: BR36713
2026-03-30 10:39:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c742fc5e-7b2a-58e2-8114-ccc5bbfc7e6f with identifier: BR36713 to the API
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:17:09Z',
 'fuel_type': 'diesel',
 'id': 'c742fc5e-7b2a-58e2-8114-ccc5bbfc7e6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR36713',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 107347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-27',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Sd4 HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2016}
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR36713%27 HTTP/1.1" 200 None
2026-03-30 10:39:53 [auto1.de] INFO: Saving data for BR36713: {'auction_closing_time': 1774970229.0, 'created_time': 1774262459.855591, 'last_price_update_time': 1774867193.463855}
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR36713') HTTP/1.1" 204 0
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: DV69567
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: EY94852
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: PV13293
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: PU16523
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU16523%27 HTTP/1.1" 200 None
2026-03-30 10:39:53 [auto1.de] INFO: Scrape type for PU16523: 2
2026-03-30 10:39:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25b265a8-1cf8-5842-aae9-0f2f275cbb8c with identifier: PU16523
2026-03-30 10:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25b265a8-1cf8-5842-aae9-0f2f275cbb8c with scrape type 2
2026-03-30 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25b265a8-1cf8-5842-aae9-0f2f275cbb8c with scrape type 2
2026-03-30 10:39:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25b265a8-1cf8-5842-aae9-0f2f275cbb8c, identifier: PU16523
2026-03-30 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WV54187/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25b265a8-1cf8-5842-aae9-0f2f275cbb8c with identifier: PU16523
2026-03-30 10:39:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25b265a8-1cf8-5842-aae9-0f2f275cbb8c with identifier: PU16523
2026-03-30 10:39:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25b265a8-1cf8-5842-aae9-0f2f275cbb8c with identifier: PU16523 to the API
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:26:59Z',
 'fuel_type': 'diesel',
 'id': '25b265a8-1cf8-5842-aae9-0f2f275cbb8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU16523',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 202603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-24',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2012}
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU16523%27 HTTP/1.1" 200 None
2026-03-30 10:39:54 [auto1.de] INFO: Saving data for PU16523: {'auction_closing_time': 1774970819.0, 'created_time': 1774262943.355736, 'last_price_update_time': 1774867194.001961}
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU16523') HTTP/1.1" 204 0
2026-03-30 10:39:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GG38022/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_d1299cb0b546795013f78f384fdf3753.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_97f6eb65711e078cc564aad590bafc00.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_a5d36300b52e074b7e135a8f2e7d4459.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8d390>
2026-03-30 10:39:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_d1299cb0b546795013f78f384fdf3753.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_d1299cb0b546795013f78f384fdf3753.jpg saved to cache
2026-03-30 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1
2026-03-30 10:39:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef37e90>
2026-03-30 10:39:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fbf%252Fe7bf58eda8d1c8f9a8a331348519bc10%252Fpa%252FFG55708_97f6eb65711e078cc564aad590bafc00.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_97f6eb65711e078cc564aad590bafc00.jpg saved to cache
2026-03-30 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1
2026-03-30 10:39:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1, skipping ID generation
2026-03-30 10:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1 with scrape type 1
2026-03-30 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1 sending to next pipeline
2026-03-30 10:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1, identifier: FG55708
2026-03-30 10:39:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef35d90>
2026-03-30 10:39:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_a5d36300b52e074b7e135a8f2e7d4459.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_a5d36300b52e074b7e135a8f2e7d4459.jpg saved to cache
2026-03-30 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item acf3fe72-685e-5977-bfa5-b98614339b1c
2026-03-30 10:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1 with identifier: FG55708
2026-03-30 10:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1 with identifier: FG55708
2026-03-30 10:39:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1 with identifier: FG55708 to the API
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_97f6eb65711e078cc564aad590bafc00.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 267,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.8L',
 'engine_horse_power': 193,
 'expiration_date': '2026-03-31T15:25:30Z',
 'fuel_type': 'petrol',
 'id': '1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG55708',
 'listing': 'auction',
 'location': 'DE, Stuttgart',
 'make': 'BMW',
 'model': '7er',
 'odometer': 219932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3137149,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_97f6eb65711e078cc564aad590bafc00.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3048370,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_d1299cb0b546795013f78f384fdf3753.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3109636,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_fd998f9e0a619fe685b7f9518c1765db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3142872,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_b27b10648efdb61fa84a33410f8318af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2922166,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_0d6b9f523066e0724f40639c006e132b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2939640,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_fe1615453f66b5a5f0f267175bd255a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3052591,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_c046fe80326773c4574b1a7f4a5f8adf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2825216,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_27ebbb6d691b8542a6311f9322bc0875.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2756059,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_bc8485a0de44e3b639207360928625de.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1/1acb5a6b-7a1c-5eea-bdd2-eca5c8bb05f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2935990,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/bf/e7bf58eda8d1c8f9a8a331348519bc10/pa/FG55708_41eae1907a5532d23fb814b58ac571b6.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1999-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 7er 728i',
 'transmission': 'automatic',
 'trim': '',
 'year': 1999}
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG55708%27 HTTP/1.1" 200 None
2026-03-30 10:39:55 [auto1.de] INFO: Saving data for FG55708: {'created_time': 1774867195.089544, 'last_price_update_time': 1774867195.089555, 'auction_closing_time': 1774970730.0}
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG55708') HTTP/1.1" 204 0
2026-03-30 10:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HR01670/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MF97779/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB77071/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FZ11767/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH22570> (referer: https://www.auto1.com/v1/car-details-view/YH22570/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 886e482f-bde3-5334-91b0-0266a6eb64cc with identifier: YH22570
2026-03-30 10:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 886e482f-bde3-5334-91b0-0266a6eb64cc with scrape type 1
2026-03-30 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 886e482f-bde3-5334-91b0-0266a6eb64cc
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F84%252Fcd84800b760dda7eee82cdc129253d79%252Fpa%252FYH22570_e8b0398831ebe12f0f938f15eba6c0f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/84/cd84800b760dda7eee82cdc129253d79/pa/YH22570_e8b0398831ebe12f0f938f15eba6c0f0.jpg already downloaded
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F84%252Fcd84800b760dda7eee82cdc129253d79%252Fpa%252FYH22570_97e7f3caa20126f0e0bd51f2b096eeb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/84/cd84800b760dda7eee82cdc129253d79/pa/YH22570_97e7f3caa20126f0e0bd51f2b096eeb7.jpg already downloaded
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F84%252Fcd84800b760dda7eee82cdc129253d79%252Fpa%252FYH22570_0bcba37f70d134bad8a5e41a54158dc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/84/cd84800b760dda7eee82cdc129253d79/pa/YH22570_0bcba37f70d134bad8a5e41a54158dc2.jpg already downloaded
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F84%252Fcd84800b760dda7eee82cdc129253d79%252Fpa%252FYH22570_7ae145d7c4dd5f020bffa29097994a42.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/84/cd84800b760dda7eee82cdc129253d79/pa/YH22570_7ae145d7c4dd5f020bffa29097994a42.jpg already downloaded
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F84%252Fcd84800b760dda7eee82cdc129253d79%252Fpa%252FYH22570_83645ab30321bcd307dc84c281f82427.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/84/cd84800b760dda7eee82cdc129253d79/pa/YH22570_83645ab30321bcd307dc84c281f82427.jpg already downloaded
2026-03-30 10:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 886e482f-bde3-5334-91b0-0266a6eb64cc, identifier: YH22570
2026-03-30 10:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 886e482f-bde3-5334-91b0-0266a6eb64cc with identifier: YH22570
2026-03-30 10:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 886e482f-bde3-5334-91b0-0266a6eb64cc with identifier: YH22570
2026-03-30 10:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 886e482f-bde3-5334-91b0-0266a6eb64cc with identifier: YH22570 to the API
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YH22570>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.8L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:37:59Z',
 'fuel_type': 'petrol',
 'id': '886e482f-bde3-5334-91b0-0266a6eb64cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH22570',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Audi',
 'model': '80',
 'odometer': 216600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgcd/84/cd84800b760dda7eee82cdc129253d79/pa/YH22570_e8b0398831ebe12f0f938f15eba6c0f0.jpg',
                'https://img-pa.auto1.com/imgcd/84/cd84800b760dda7eee82cdc129253d79/pa/YH22570_97e7f3caa20126f0e0bd51f2b096eeb7.jpg',
                'https://img-pa.auto1.com/imgcd/84/cd84800b760dda7eee82cdc129253d79/pa/YH22570_0bcba37f70d134bad8a5e41a54158dc2.jpg',
                'https://img-pa.auto1.com/imgcd/84/cd84800b760dda7eee82cdc129253d79/pa/YH22570_7ae145d7c4dd5f020bffa29097994a42.jpg',
                'https://img-pa.auto1.com/imgcd/84/cd84800b760dda7eee82cdc129253d79/pa/YH22570_83645ab30321bcd307dc84c281f82427.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886e482f-bde3-5334-91b0-0266a6eb64cc/886e482f-bde3-5334-91b0-0266a6eb64cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/84/cd84800b760dda7eee82cdc129253d79/pa/YH22570_e8b0398831ebe12f0f938f15eba6c0f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886e482f-bde3-5334-91b0-0266a6eb64cc/886e482f-bde3-5334-91b0-0266a6eb64cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/84/cd84800b760dda7eee82cdc129253d79/pa/YH22570_97e7f3caa20126f0e0bd51f2b096eeb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886e482f-bde3-5334-91b0-0266a6eb64cc/886e482f-bde3-5334-91b0-0266a6eb64cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/84/cd84800b760dda7eee82cdc129253d79/pa/YH22570_0bcba37f70d134bad8a5e41a54158dc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886e482f-bde3-5334-91b0-0266a6eb64cc/886e482f-bde3-5334-91b0-0266a6eb64cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/84/cd84800b760dda7eee82cdc129253d79/pa/YH22570_7ae145d7c4dd5f020bffa29097994a42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886e482f-bde3-5334-91b0-0266a6eb64cc/886e482f-bde3-5334-91b0-0266a6eb64cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/84/cd84800b760dda7eee82cdc129253d79/pa/YH22570_83645ab30321bcd307dc84c281f82427.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1990-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi 80 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 1990}
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH22570%27 HTTP/1.1" 200 None
2026-03-30 10:39:56 [auto1.de] INFO: Saving data for YH22570: {'created_time': 1774867196.080786, 'last_price_update_time': 1774867196.080796, 'auction_closing_time': 1774971479.0}
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH22570') HTTP/1.1" 204 0
2026-03-30 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA37625> (referer: https://www.auto1.com/v1/car-details-view/HA37625/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a4e2712-3b9d-5853-99e5-4606f0dd39b0 with identifier: HA37625
2026-03-30 10:39:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a4e2712-3b9d-5853-99e5-4606f0dd39b0 with scrape type 1
2026-03-30 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a4e2712-3b9d-5853-99e5-4606f0dd39b0
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F7b%252F927b95bf4c7b56d36e12a7758dd1f03f%252Fpa%252FHA37625_c14fd88d6ccc0483ed9ec47e0e0f79ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_c14fd88d6ccc0483ed9ec47e0e0f79ad.jpg already downloaded
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F7b%252F927b95bf4c7b56d36e12a7758dd1f03f%252Fpa%252FHA37625_556b29d7c27401f330381fd1c4853365.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_556b29d7c27401f330381fd1c4853365.jpg already downloaded
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F7b%252F927b95bf4c7b56d36e12a7758dd1f03f%252Fpa%252FHA37625_69d98b8cbfa2003b8868b67a88937f78.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_69d98b8cbfa2003b8868b67a88937f78.jpg already downloaded
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F7b%252F927b95bf4c7b56d36e12a7758dd1f03f%252Fpa%252FHA37625_9dd33dfb73f1a15b38442b21127600f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_9dd33dfb73f1a15b38442b21127600f3.jpg already downloaded
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F7b%252F927b95bf4c7b56d36e12a7758dd1f03f%252Fpa%252FHA37625_b11a0348cfa4bd847379ba5e380b4ba1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_b11a0348cfa4bd847379ba5e380b4ba1.jpg already downloaded
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F7b%252F927b95bf4c7b56d36e12a7758dd1f03f%252Fpa%252FHA37625_7c14fe2a817b0c7d131a3e81446e2450.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_7c14fe2a817b0c7d131a3e81446e2450.jpg already downloaded
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F7b%252F927b95bf4c7b56d36e12a7758dd1f03f%252Fpa%252FHA37625_51b7ec71710e23baa385feedbd90fae7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_51b7ec71710e23baa385feedbd90fae7.jpg already downloaded
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F7b%252F927b95bf4c7b56d36e12a7758dd1f03f%252Fpa%252FHA37625_e7c289fd6d353c16cd63fe0542a56f2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_e7c289fd6d353c16cd63fe0542a56f2b.jpg already downloaded
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F7b%252F927b95bf4c7b56d36e12a7758dd1f03f%252Fpa%252FHA37625_4b20bcb21be44e49d5386f8ab17583f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_4b20bcb21be44e49d5386f8ab17583f3.jpg already downloaded
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F7b%252F927b95bf4c7b56d36e12a7758dd1f03f%252Fpa%252FHA37625_24015098c2a72550798f3720345f6a72.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_24015098c2a72550798f3720345f6a72.jpg already downloaded
2026-03-30 10:39:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a4e2712-3b9d-5853-99e5-4606f0dd39b0, identifier: HA37625
2026-03-30 10:39:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a4e2712-3b9d-5853-99e5-4606f0dd39b0 with identifier: HA37625
2026-03-30 10:39:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a4e2712-3b9d-5853-99e5-4606f0dd39b0 with identifier: HA37625
2026-03-30 10:39:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a4e2712-3b9d-5853-99e5-4606f0dd39b0 with identifier: HA37625 to the API
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HA37625>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:33:52Z',
 'fuel_type': 'petrol',
 'id': '3a4e2712-3b9d-5853-99e5-4606f0dd39b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA37625',
 'listing': 'auction',
 'location': 'DE, Hodenhagen',
 'make': 'BMW',
 'model': '1er',
 'odometer': 108835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_c14fd88d6ccc0483ed9ec47e0e0f79ad.jpg',
                'https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_556b29d7c27401f330381fd1c4853365.jpg',
                'https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_69d98b8cbfa2003b8868b67a88937f78.jpg',
                'https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_9dd33dfb73f1a15b38442b21127600f3.jpg',
                'https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_b11a0348cfa4bd847379ba5e380b4ba1.jpg',
                'https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_7c14fe2a817b0c7d131a3e81446e2450.jpg',
                'https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_51b7ec71710e23baa385feedbd90fae7.jpg',
                'https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_e7c289fd6d353c16cd63fe0542a56f2b.jpg',
                'https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_4b20bcb21be44e49d5386f8ab17583f3.jpg',
                'https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_24015098c2a72550798f3720345f6a72.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4e2712-3b9d-5853-99e5-4606f0dd39b0/3a4e2712-3b9d-5853-99e5-4606f0dd39b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_c14fd88d6ccc0483ed9ec47e0e0f79ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4e2712-3b9d-5853-99e5-4606f0dd39b0/3a4e2712-3b9d-5853-99e5-4606f0dd39b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_556b29d7c27401f330381fd1c4853365.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4e2712-3b9d-5853-99e5-4606f0dd39b0/3a4e2712-3b9d-5853-99e5-4606f0dd39b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_69d98b8cbfa2003b8868b67a88937f78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4e2712-3b9d-5853-99e5-4606f0dd39b0/3a4e2712-3b9d-5853-99e5-4606f0dd39b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2205310,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_9dd33dfb73f1a15b38442b21127600f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4e2712-3b9d-5853-99e5-4606f0dd39b0/3a4e2712-3b9d-5853-99e5-4606f0dd39b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2292908,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_b11a0348cfa4bd847379ba5e380b4ba1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4e2712-3b9d-5853-99e5-4606f0dd39b0/3a4e2712-3b9d-5853-99e5-4606f0dd39b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_7c14fe2a817b0c7d131a3e81446e2450.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4e2712-3b9d-5853-99e5-4606f0dd39b0/3a4e2712-3b9d-5853-99e5-4606f0dd39b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2371832,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_51b7ec71710e23baa385feedbd90fae7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4e2712-3b9d-5853-99e5-4606f0dd39b0/3a4e2712-3b9d-5853-99e5-4606f0dd39b0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_e7c289fd6d353c16cd63fe0542a56f2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4e2712-3b9d-5853-99e5-4606f0dd39b0/3a4e2712-3b9d-5853-99e5-4606f0dd39b0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_4b20bcb21be44e49d5386f8ab17583f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4e2712-3b9d-5853-99e5-4606f0dd39b0/3a4e2712-3b9d-5853-99e5-4606f0dd39b0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/7b/927b95bf4c7b56d36e12a7758dd1f03f/pa/HA37625_24015098c2a72550798f3720345f6a72.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA37625%27 HTTP/1.1" 200 None
2026-03-30 10:39:58 [auto1.de] INFO: Saving data for HA37625: {'created_time': 1774867198.533829, 'last_price_update_time': 1774867198.533838, 'auction_closing_time': 1774971232.0}
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA37625') HTTP/1.1" 204 0
2026-03-30 10:39:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN26761/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TC02406/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GG38022> (referer: https://www.auto1.com/v1/car-details-view/GG38022/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c514d878-bb14-5703-b4c7-b8d45e7b0326 with identifier: GG38022
2026-03-30 10:40:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c514d878-bb14-5703-b4c7-b8d45e7b0326 with scrape type 1
2026-03-30 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c514d878-bb14-5703-b4c7-b8d45e7b0326
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2f%252F422fe42bffb1b39bd37f451a37dbc5a5%252Fpa%252FGG38022_29ac9f9c19c47eaa933c07e2b85397e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_29ac9f9c19c47eaa933c07e2b85397e1.jpg already downloaded
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2f%252F422fe42bffb1b39bd37f451a37dbc5a5%252Fpa%252FGG38022_a1fc547f3c8d43a0427418c71b08ecf4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_a1fc547f3c8d43a0427418c71b08ecf4.jpg already downloaded
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2f%252F422fe42bffb1b39bd37f451a37dbc5a5%252Fpa%252FGG38022_a516123a2f9dd9e451b813b826dd1cc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_a516123a2f9dd9e451b813b826dd1cc1.jpg already downloaded
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2f%252F422fe42bffb1b39bd37f451a37dbc5a5%252Fpa%252FGG38022_f4625e9459120697b6fa44707ed04abe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_f4625e9459120697b6fa44707ed04abe.jpg already downloaded
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2f%252F422fe42bffb1b39bd37f451a37dbc5a5%252Fpa%252FGG38022_3ee2d311385bc25880cb29d470d89b90.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_3ee2d311385bc25880cb29d470d89b90.jpg already downloaded
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2f%252F422fe42bffb1b39bd37f451a37dbc5a5%252Fpa%252FGG38022_cd138eb8a4cb92e956041db6794aa017.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_cd138eb8a4cb92e956041db6794aa017.jpg already downloaded
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2f%252F422fe42bffb1b39bd37f451a37dbc5a5%252Fpa%252FGG38022_9c6685a5215d80c36e8c32e117db8a33.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_9c6685a5215d80c36e8c32e117db8a33.jpg already downloaded
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2f%252F422fe42bffb1b39bd37f451a37dbc5a5%252Fpa%252FGG38022_63ac1c30d6244521569450887f76f637.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_63ac1c30d6244521569450887f76f637.jpg already downloaded
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2f%252F422fe42bffb1b39bd37f451a37dbc5a5%252Fpa%252FGG38022_fa7ff32e6f9c2d8e6fe0600c97863459.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_fa7ff32e6f9c2d8e6fe0600c97863459.jpg already downloaded
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2f%252F422fe42bffb1b39bd37f451a37dbc5a5%252Fpa%252FGG38022_deae167defb917ab347818130479de56.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_deae167defb917ab347818130479de56.jpg already downloaded
2026-03-30 10:40:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c514d878-bb14-5703-b4c7-b8d45e7b0326, identifier: GG38022
2026-03-30 10:40:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c514d878-bb14-5703-b4c7-b8d45e7b0326 with identifier: GG38022
2026-03-30 10:40:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c514d878-bb14-5703-b4c7-b8d45e7b0326 with identifier: GG38022
2026-03-30 10:40:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c514d878-bb14-5703-b4c7-b8d45e7b0326 with identifier: GG38022 to the API
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GG38022>
{'auction_title': '',
 'c_o_2_emission_value': 78,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:13:05Z',
 'fuel_type': 'petrol',
 'id': 'c514d878-bb14-5703-b4c7-b8d45e7b0326',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG38022',
 'listing': 'auction',
 'location': 'DE, Kandel',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 98350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_29ac9f9c19c47eaa933c07e2b85397e1.jpg',
                'https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_a1fc547f3c8d43a0427418c71b08ecf4.jpg',
                'https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_a516123a2f9dd9e451b813b826dd1cc1.jpg',
                'https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_f4625e9459120697b6fa44707ed04abe.jpg',
                'https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_3ee2d311385bc25880cb29d470d89b90.jpg',
                'https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_cd138eb8a4cb92e956041db6794aa017.jpg',
                'https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_9c6685a5215d80c36e8c32e117db8a33.jpg',
                'https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_63ac1c30d6244521569450887f76f637.jpg',
                'https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_fa7ff32e6f9c2d8e6fe0600c97863459.jpg',
                'https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_deae167defb917ab347818130479de56.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c514d878-bb14-5703-b4c7-b8d45e7b0326/c514d878-bb14-5703-b4c7-b8d45e7b0326_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_29ac9f9c19c47eaa933c07e2b85397e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c514d878-bb14-5703-b4c7-b8d45e7b0326/c514d878-bb14-5703-b4c7-b8d45e7b0326_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_a1fc547f3c8d43a0427418c71b08ecf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c514d878-bb14-5703-b4c7-b8d45e7b0326/c514d878-bb14-5703-b4c7-b8d45e7b0326_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_a516123a2f9dd9e451b813b826dd1cc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c514d878-bb14-5703-b4c7-b8d45e7b0326/c514d878-bb14-5703-b4c7-b8d45e7b0326_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_f4625e9459120697b6fa44707ed04abe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c514d878-bb14-5703-b4c7-b8d45e7b0326/c514d878-bb14-5703-b4c7-b8d45e7b0326_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_3ee2d311385bc25880cb29d470d89b90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c514d878-bb14-5703-b4c7-b8d45e7b0326/c514d878-bb14-5703-b4c7-b8d45e7b0326_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_cd138eb8a4cb92e956041db6794aa017.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c514d878-bb14-5703-b4c7-b8d45e7b0326/c514d878-bb14-5703-b4c7-b8d45e7b0326_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_9c6685a5215d80c36e8c32e117db8a33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c514d878-bb14-5703-b4c7-b8d45e7b0326/c514d878-bb14-5703-b4c7-b8d45e7b0326_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_63ac1c30d6244521569450887f76f637.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c514d878-bb14-5703-b4c7-b8d45e7b0326/c514d878-bb14-5703-b4c7-b8d45e7b0326_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_fa7ff32e6f9c2d8e6fe0600c97863459.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c514d878-bb14-5703-b4c7-b8d45e7b0326/c514d878-bb14-5703-b4c7-b8d45e7b0326_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2f/422fe42bffb1b39bd37f451a37dbc5a5/pa/GG38022_deae167defb917ab347818130479de56.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Cup up!',
 'transmission': 'manual',
 'trim': 'Cup',
 'year': 2014}
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG38022%27 HTTP/1.1" 200 None
2026-03-30 10:40:01 [auto1.de] INFO: Saving data for GG38022: {'created_time': 1774867201.376269, 'last_price_update_time': 1774867201.376284, 'auction_closing_time': 1774969985.0}
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG38022') HTTP/1.1" 204 0
2026-03-30 10:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA51445/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UW97572/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW71270/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:04 [scrapy.extensions.logstats] INFO: Crawled 381 pages (at 50 pages/min), scraped 261 items (at 40 items/min)
2026-03-30 10:40:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MT60714> (referer: https://www.auto1.com/v1/car-details-view/MT60714/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WV54187> (referer: https://www.auto1.com/v1/car-details-view/WV54187/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a80d869-2970-5973-8b54-c9c07bb05ca5 with identifier: MT60714
2026-03-30 10:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a80d869-2970-5973-8b54-c9c07bb05ca5 with scrape type 1
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a80d869-2970-5973-8b54-c9c07bb05ca5
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_e1fa9f46d55a8d5fb3c966bf960a9ff3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_e1fa9f46d55a8d5fb3c966bf960a9ff3.jpg not downloaded yet
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_e582cd9fc41b98327ba0fc8217b7ce92.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_e582cd9fc41b98327ba0fc8217b7ce92.jpg not downloaded yet
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_12d970e883bf2b958ae54ec71f16c52d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_12d970e883bf2b958ae54ec71f16c52d.jpg not downloaded yet
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_ec8523ff5c34052491b7d85d0e228b10.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_ec8523ff5c34052491b7d85d0e228b10.jpg not downloaded yet
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_a03112da6df212eb0551f3656691d1b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_a03112da6df212eb0551f3656691d1b2.jpg not downloaded yet
2026-03-30 10:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1427c279-e734-5c70-aecf-4265cc090813 with identifier: WV54187
2026-03-30 10:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1427c279-e734-5c70-aecf-4265cc090813 with scrape type 1
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1427c279-e734-5c70-aecf-4265cc090813
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F45%252F7f452e7a1f2e5c2c651d408094aafbf7%252Fpa%252FWV54187_fc81ff0e18a67d889c6fc5e2bccef326.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_fc81ff0e18a67d889c6fc5e2bccef326.jpg already downloaded
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F45%252F7f452e7a1f2e5c2c651d408094aafbf7%252Fpa%252FWV54187_f65302c31053f331201477abff6c0a27.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_f65302c31053f331201477abff6c0a27.jpg already downloaded
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F45%252F7f452e7a1f2e5c2c651d408094aafbf7%252Fpa%252FWV54187_1f57de75d8f59537765ae7d36d45064f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_1f57de75d8f59537765ae7d36d45064f.jpg already downloaded
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F45%252F7f452e7a1f2e5c2c651d408094aafbf7%252Fpa%252FWV54187_901183903892fc7d1bef6041cbf0c93f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_901183903892fc7d1bef6041cbf0c93f.jpg already downloaded
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F45%252F7f452e7a1f2e5c2c651d408094aafbf7%252Fpa%252FWV54187_3e78b1a8f392b5d1b965afb32770043a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_3e78b1a8f392b5d1b965afb32770043a.jpg already downloaded
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F45%252F7f452e7a1f2e5c2c651d408094aafbf7%252Fpa%252FWV54187_fda032f8678139bfd9cc4117ab663a03.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_fda032f8678139bfd9cc4117ab663a03.jpg already downloaded
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F45%252F7f452e7a1f2e5c2c651d408094aafbf7%252Fpa%252FWV54187_10a7009911930ecf342c82883a3befe5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_10a7009911930ecf342c82883a3befe5.jpg already downloaded
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F45%252F7f452e7a1f2e5c2c651d408094aafbf7%252Fpa%252FWV54187_161c6cedede6254877c07972d9b3fde1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_161c6cedede6254877c07972d9b3fde1.jpg already downloaded
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F45%252F7f452e7a1f2e5c2c651d408094aafbf7%252Fpa%252FWV54187_d5997bd886326eb762755d3880a8e27b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_d5997bd886326eb762755d3880a8e27b.jpg already downloaded
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F45%252F7f452e7a1f2e5c2c651d408094aafbf7%252Fpa%252FWV54187_43f5c5a9f96e7f8c90cb37452377f995.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_43f5c5a9f96e7f8c90cb37452377f995.jpg already downloaded
2026-03-30 10:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1427c279-e734-5c70-aecf-4265cc090813, identifier: WV54187
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_13a043f90c91cb933d55356f1bf0f155.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_13a043f90c91cb933d55356f1bf0f155.jpg not downloaded yet
2026-03-30 10:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1427c279-e734-5c70-aecf-4265cc090813 with identifier: WV54187
2026-03-30 10:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1427c279-e734-5c70-aecf-4265cc090813 with identifier: WV54187
2026-03-30 10:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1427c279-e734-5c70-aecf-4265cc090813 with identifier: WV54187 to the API
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WV54187>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:08:10Z',
 'fuel_type': 'diesel',
 'id': '1427c279-e734-5c70-aecf-4265cc090813',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV54187',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 166685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_fc81ff0e18a67d889c6fc5e2bccef326.jpg',
                'https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_f65302c31053f331201477abff6c0a27.jpg',
                'https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_1f57de75d8f59537765ae7d36d45064f.jpg',
                'https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_901183903892fc7d1bef6041cbf0c93f.jpg',
                'https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_3e78b1a8f392b5d1b965afb32770043a.jpg',
                'https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_fda032f8678139bfd9cc4117ab663a03.jpg',
                'https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_10a7009911930ecf342c82883a3befe5.jpg',
                'https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_161c6cedede6254877c07972d9b3fde1.jpg',
                'https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_d5997bd886326eb762755d3880a8e27b.jpg',
                'https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_43f5c5a9f96e7f8c90cb37452377f995.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1427c279-e734-5c70-aecf-4265cc090813/1427c279-e734-5c70-aecf-4265cc090813_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_fc81ff0e18a67d889c6fc5e2bccef326.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1427c279-e734-5c70-aecf-4265cc090813/1427c279-e734-5c70-aecf-4265cc090813_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_f65302c31053f331201477abff6c0a27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1427c279-e734-5c70-aecf-4265cc090813/1427c279-e734-5c70-aecf-4265cc090813_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2161089,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_1f57de75d8f59537765ae7d36d45064f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1427c279-e734-5c70-aecf-4265cc090813/1427c279-e734-5c70-aecf-4265cc090813_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2599294,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_901183903892fc7d1bef6041cbf0c93f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1427c279-e734-5c70-aecf-4265cc090813/1427c279-e734-5c70-aecf-4265cc090813_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2430941,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_3e78b1a8f392b5d1b965afb32770043a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1427c279-e734-5c70-aecf-4265cc090813/1427c279-e734-5c70-aecf-4265cc090813_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2552250,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_fda032f8678139bfd9cc4117ab663a03.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1427c279-e734-5c70-aecf-4265cc090813/1427c279-e734-5c70-aecf-4265cc090813_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_10a7009911930ecf342c82883a3befe5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1427c279-e734-5c70-aecf-4265cc090813/1427c279-e734-5c70-aecf-4265cc090813_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_161c6cedede6254877c07972d9b3fde1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1427c279-e734-5c70-aecf-4265cc090813/1427c279-e734-5c70-aecf-4265cc090813_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_d5997bd886326eb762755d3880a8e27b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1427c279-e734-5c70-aecf-4265cc090813/1427c279-e734-5c70-aecf-4265cc090813_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/45/7f452e7a1f2e5c2c651d408094aafbf7/pa/WV54187_43f5c5a9f96e7f8c90cb37452377f995.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2017}
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV54187%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [auto1.de] INFO: Saving data for WV54187: {'created_time': 1774867206.736123, 'last_price_update_time': 1774867206.736134, 'auction_closing_time': 1774969690.0}
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV54187') HTTP/1.1" 204 0
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_0f34a65280e35ea3320d0b25df03d407.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_0f34a65280e35ea3320d0b25df03d407.jpg not downloaded yet
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_a9692caffde5bb9263baec919311a31d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_a9692caffde5bb9263baec919311a31d.jpg not downloaded yet
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_8c0df7e921fe0663f7394f6fb89e6963.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_8c0df7e921fe0663f7394f6fb89e6963.jpg not downloaded yet
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_ad8233a0d97515212a24e1ed6d5bfd71.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_ad8233a0d97515212a24e1ed6d5bfd71.jpg not downloaded yet
2026-03-30 10:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ32446/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_ad8233a0d97515212a24e1ed6d5bfd71.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_8c0df7e921fe0663f7394f6fb89e6963.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefe88d0>
2026-03-30 10:40:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_ad8233a0d97515212a24e1ed6d5bfd71.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_ad8233a0d97515212a24e1ed6d5bfd71.jpg saved to cache
2026-03-30 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a80d869-2970-5973-8b54-c9c07bb05ca5
2026-03-30 10:40:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef0c0d0>
2026-03-30 10:40:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_8c0df7e921fe0663f7394f6fb89e6963.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_8c0df7e921fe0663f7394f6fb89e6963.jpg saved to cache
2026-03-30 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a80d869-2970-5973-8b54-c9c07bb05ca5
2026-03-30 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE34822/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_a9692caffde5bb9263baec919311a31d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_0f34a65280e35ea3320d0b25df03d407.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d7650>
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_a9692caffde5bb9263baec919311a31d.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_a9692caffde5bb9263baec919311a31d.jpg saved to cache
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a80d869-2970-5973-8b54-c9c07bb05ca5
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee47a810>
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_0f34a65280e35ea3320d0b25df03d407.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_0f34a65280e35ea3320d0b25df03d407.jpg saved to cache
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a80d869-2970-5973-8b54-c9c07bb05ca5
2026-03-30 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP80912> (referer: https://www.auto1.com/v1/car-details-view/LP80912/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_13a043f90c91cb933d55356f1bf0f155.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 202b5177-a1c0-53bb-b55e-67393a3b4f0b with identifier: LP80912
2026-03-30 10:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 202b5177-a1c0-53bb-b55e-67393a3b4f0b with scrape type 1
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 202b5177-a1c0-53bb-b55e-67393a3b4f0b
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_0a99b4b515dd221fa5b1e99884df93ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_0a99b4b515dd221fa5b1e99884df93ba.jpg not downloaded yet
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_75c939d946faac17c44b5d89bac257dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_75c939d946faac17c44b5d89bac257dd.jpg not downloaded yet
2026-03-30 10:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_a03112da6df212eb0551f3656691d1b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_0895efffe0c46b1e183a9a8bfaeee660.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_0895efffe0c46b1e183a9a8bfaeee660.jpg not downloaded yet
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_7e21cec8f82171935a44ea7f5dcbc7e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_7e21cec8f82171935a44ea7f5dcbc7e6.jpg not downloaded yet
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_db4174764b175459d78a970e4bae11a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_db4174764b175459d78a970e4bae11a2.jpg not downloaded yet
2026-03-30 10:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA78695/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_548df99715ab2ee85d35dd1bdf1a91f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_548df99715ab2ee85d35dd1bdf1a91f1.jpg not downloaded yet
2026-03-30 10:40:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef2810>
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_13a043f90c91cb933d55356f1bf0f155.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_13a043f90c91cb933d55356f1bf0f155.jpg saved to cache
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a80d869-2970-5973-8b54-c9c07bb05ca5
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_9d65efe410e7d030fca5ff0552a3bb0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_9d65efe410e7d030fca5ff0552a3bb0e.jpg not downloaded yet
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41c7350>
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_a03112da6df212eb0551f3656691d1b2.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_a03112da6df212eb0551f3656691d1b2.jpg saved to cache
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a80d869-2970-5973-8b54-c9c07bb05ca5
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_f47655c1eeb9e801bff5829dfc981bbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_f47655c1eeb9e801bff5829dfc981bbb.jpg not downloaded yet
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_a6932e925d841263eed42a4d77491b7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_a6932e925d841263eed42a4d77491b7e.jpg not downloaded yet
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_ace81846a63ad5e2813df33102e80dd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_ace81846a63ad5e2813df33102e80dd2.jpg not downloaded yet
2026-03-30 10:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_75c939d946faac17c44b5d89bac257dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN26761> (referer: https://www.auto1.com/v1/car-details-view/CN26761/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee90250>
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_75c939d946faac17c44b5d89bac257dd.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_75c939d946faac17c44b5d89bac257dd.jpg saved to cache
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 202b5177-a1c0-53bb-b55e-67393a3b4f0b
2026-03-30 10:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 887ade34-a9c8-5afa-8e44-90ca0eb44557 with identifier: CN26761
2026-03-30 10:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 887ade34-a9c8-5afa-8e44-90ca0eb44557 with scrape type 1
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 887ade34-a9c8-5afa-8e44-90ca0eb44557
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F91%252F909174abe38a5a39ed1b927801ec4d54%252Fpa%252FCN26761_54e4d6645c3be157a3062116daa91a96.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_54e4d6645c3be157a3062116daa91a96.jpg already downloaded
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F91%252F909174abe38a5a39ed1b927801ec4d54%252Fpa%252FCN26761_007ab86b5bca4e7c63b23f2d1933cadf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_007ab86b5bca4e7c63b23f2d1933cadf.jpg already downloaded
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F91%252F909174abe38a5a39ed1b927801ec4d54%252Fpa%252FCN26761_c960b26fb28590c5446941c8866e7773.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_c960b26fb28590c5446941c8866e7773.jpg already downloaded
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F91%252F909174abe38a5a39ed1b927801ec4d54%252Fpa%252FCN26761_d3a6b255fde2223131f0db9cb81519f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_d3a6b255fde2223131f0db9cb81519f6.jpg already downloaded
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F91%252F909174abe38a5a39ed1b927801ec4d54%252Fpa%252FCN26761_d4aeb5cf722b420c455c963feec7fc69.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_d4aeb5cf722b420c455c963feec7fc69.jpg already downloaded
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F91%252F909174abe38a5a39ed1b927801ec4d54%252Fpa%252FCN26761_b58b59c39aa15cb449e7c2717e988f97.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_b58b59c39aa15cb449e7c2717e988f97.jpg already downloaded
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F91%252F909174abe38a5a39ed1b927801ec4d54%252Fpa%252FCN26761_d8a9382b52424316e9ace3f226823f3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_d8a9382b52424316e9ace3f226823f3c.jpg already downloaded
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F91%252F909174abe38a5a39ed1b927801ec4d54%252Fpa%252FCN26761_a5832c412ffe5b9d670cff25f85e1bd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_a5832c412ffe5b9d670cff25f85e1bd8.jpg already downloaded
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F91%252F909174abe38a5a39ed1b927801ec4d54%252Fpa%252FCN26761_456c80268069532663d76a25ae0f5f55.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_456c80268069532663d76a25ae0f5f55.jpg already downloaded
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F91%252F909174abe38a5a39ed1b927801ec4d54%252Fpa%252FCN26761_18f1f7525f55aed1a527875fad044b33.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_18f1f7525f55aed1a527875fad044b33.jpg already downloaded
2026-03-30 10:40:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 887ade34-a9c8-5afa-8e44-90ca0eb44557, identifier: CN26761
2026-03-30 10:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_db4174764b175459d78a970e4bae11a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 887ade34-a9c8-5afa-8e44-90ca0eb44557 with identifier: CN26761
2026-03-30 10:40:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 887ade34-a9c8-5afa-8e44-90ca0eb44557 with identifier: CN26761
2026-03-30 10:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 887ade34-a9c8-5afa-8e44-90ca0eb44557 with identifier: CN26761 to the API
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CN26761>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:53:53Z',
 'fuel_type': 'diesel',
 'id': '887ade34-a9c8-5afa-8e44-90ca0eb44557',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN26761',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 30381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_54e4d6645c3be157a3062116daa91a96.jpg',
                'https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_007ab86b5bca4e7c63b23f2d1933cadf.jpg',
                'https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_c960b26fb28590c5446941c8866e7773.jpg',
                'https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_d3a6b255fde2223131f0db9cb81519f6.jpg',
                'https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_d4aeb5cf722b420c455c963feec7fc69.jpg',
                'https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_b58b59c39aa15cb449e7c2717e988f97.jpg',
                'https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_d8a9382b52424316e9ace3f226823f3c.jpg',
                'https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_a5832c412ffe5b9d670cff25f85e1bd8.jpg',
                'https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_456c80268069532663d76a25ae0f5f55.jpg',
                'https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_18f1f7525f55aed1a527875fad044b33.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887ade34-a9c8-5afa-8e44-90ca0eb44557/887ade34-a9c8-5afa-8e44-90ca0eb44557_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_54e4d6645c3be157a3062116daa91a96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887ade34-a9c8-5afa-8e44-90ca0eb44557/887ade34-a9c8-5afa-8e44-90ca0eb44557_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_007ab86b5bca4e7c63b23f2d1933cadf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887ade34-a9c8-5afa-8e44-90ca0eb44557/887ade34-a9c8-5afa-8e44-90ca0eb44557_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_c960b26fb28590c5446941c8866e7773.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887ade34-a9c8-5afa-8e44-90ca0eb44557/887ade34-a9c8-5afa-8e44-90ca0eb44557_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_d3a6b255fde2223131f0db9cb81519f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887ade34-a9c8-5afa-8e44-90ca0eb44557/887ade34-a9c8-5afa-8e44-90ca0eb44557_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_d4aeb5cf722b420c455c963feec7fc69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887ade34-a9c8-5afa-8e44-90ca0eb44557/887ade34-a9c8-5afa-8e44-90ca0eb44557_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_b58b59c39aa15cb449e7c2717e988f97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887ade34-a9c8-5afa-8e44-90ca0eb44557/887ade34-a9c8-5afa-8e44-90ca0eb44557_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_d8a9382b52424316e9ace3f226823f3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887ade34-a9c8-5afa-8e44-90ca0eb44557/887ade34-a9c8-5afa-8e44-90ca0eb44557_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_a5832c412ffe5b9d670cff25f85e1bd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887ade34-a9c8-5afa-8e44-90ca0eb44557/887ade34-a9c8-5afa-8e44-90ca0eb44557_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_456c80268069532663d76a25ae0f5f55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887ade34-a9c8-5afa-8e44-90ca0eb44557/887ade34-a9c8-5afa-8e44-90ca0eb44557_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/91/909174abe38a5a39ed1b927801ec4d54/pa/CN26761_18f1f7525f55aed1a527875fad044b33.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Trafic 2.0 BLUE dCi L2H1 3,0t (8/9 Sitze) Start',
 'transmission': 'manual',
 'trim': 'L2H1 3,0t (8/9 Sitze) Start',
 'year': 2023}
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN26761%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [auto1.de] INFO: Saving data for CN26761: {'created_time': 1774867213.215293, 'last_price_update_time': 1774867213.215305, 'auction_closing_time': 1774972433.0}
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN26761') HTTP/1.1" 204 0
2026-03-30 10:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TC02406> (referer: https://www.auto1.com/v1/car-details-view/TC02406/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f593fa50>
2026-03-30 10:40:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_db4174764b175459d78a970e4bae11a2.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_db4174764b175459d78a970e4bae11a2.jpg saved to cache
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 202b5177-a1c0-53bb-b55e-67393a3b4f0b
2026-03-30 10:40:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58137188-0516-5064-8b46-5432fd7c596f with identifier: TC02406
2026-03-30 10:40:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58137188-0516-5064-8b46-5432fd7c596f with scrape type 1
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 58137188-0516-5064-8b46-5432fd7c596f
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_c05fc6e360bd1922267fca3f4ebe755a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_c05fc6e360bd1922267fca3f4ebe755a.jpg not downloaded yet
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_8fdd7e7ad4c0bc69c3abfdf08f493d12.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_8fdd7e7ad4c0bc69c3abfdf08f493d12.jpg not downloaded yet
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_9cf976e6ce31c9add109a75ae2df7820.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_9cf976e6ce31c9add109a75ae2df7820.jpg not downloaded yet
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_671003429b402fe13085264b6aad3765.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_671003429b402fe13085264b6aad3765.jpg not downloaded yet
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_3b7254c143181acd232994a94be496de.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_3b7254c143181acd232994a94be496de.jpg not downloaded yet
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_392eb6fb797e8b69a5c9027a58fa31a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_392eb6fb797e8b69a5c9027a58fa31a2.jpg not downloaded yet
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_2307ee499f552dd32e61917ada3d44e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_2307ee499f552dd32e61917ada3d44e1.jpg not downloaded yet
2026-03-30 10:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_ace81846a63ad5e2813df33102e80dd2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_bdccffbca157c790ba73a0bc518a4f11.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_bdccffbca157c790ba73a0bc518a4f11.jpg not downloaded yet
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_571f272fc3fdd7897f9e93bdbca5be2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_571f272fc3fdd7897f9e93bdbca5be2a.jpg not downloaded yet
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_113b1aafb0865943e4e358235f748e7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_113b1aafb0865943e4e358235f748e7f.jpg not downloaded yet
2026-03-30 10:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_f47655c1eeb9e801bff5829dfc981bbb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_a6932e925d841263eed42a4d77491b7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41eaad0>
2026-03-30 10:40:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_ace81846a63ad5e2813df33102e80dd2.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_ace81846a63ad5e2813df33102e80dd2.jpg saved to cache
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 202b5177-a1c0-53bb-b55e-67393a3b4f0b
2026-03-30 10:40:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5dfd9d0>
2026-03-30 10:40:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_f47655c1eeb9e801bff5829dfc981bbb.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_f47655c1eeb9e801bff5829dfc981bbb.jpg saved to cache
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 202b5177-a1c0-53bb-b55e-67393a3b4f0b
2026-03-30 10:40:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419b5d0>
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_a6932e925d841263eed42a4d77491b7e.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_a6932e925d841263eed42a4d77491b7e.jpg saved to cache
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 202b5177-a1c0-53bb-b55e-67393a3b4f0b
2026-03-30 10:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_2307ee499f552dd32e61917ada3d44e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_113b1aafb0865943e4e358235f748e7f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee403dd0>
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_2307ee499f552dd32e61917ada3d44e1.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_2307ee499f552dd32e61917ada3d44e1.jpg saved to cache
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58137188-0516-5064-8b46-5432fd7c596f
2026-03-30 10:40:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4292f90>
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_113b1aafb0865943e4e358235f748e7f.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_113b1aafb0865943e4e358235f748e7f.jpg saved to cache
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 58137188-0516-5064-8b46-5432fd7c596f
2026-03-30 10:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_571f272fc3fdd7897f9e93bdbca5be2a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_bdccffbca157c790ba73a0bc518a4f11.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428ca50>
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_571f272fc3fdd7897f9e93bdbca5be2a.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_571f272fc3fdd7897f9e93bdbca5be2a.jpg saved to cache
2026-03-30 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 58137188-0516-5064-8b46-5432fd7c596f
2026-03-30 10:40:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4290050>
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_bdccffbca157c790ba73a0bc518a4f11.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_bdccffbca157c790ba73a0bc518a4f11.jpg saved to cache
2026-03-30 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58137188-0516-5064-8b46-5432fd7c596f
2026-03-30 10:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_3b7254c143181acd232994a94be496de.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428d350>
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_3b7254c143181acd232994a94be496de.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_3b7254c143181acd232994a94be496de.jpg saved to cache
2026-03-30 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58137188-0516-5064-8b46-5432fd7c596f
2026-03-30 10:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_671003429b402fe13085264b6aad3765.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428e2d0>
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_671003429b402fe13085264b6aad3765.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_671003429b402fe13085264b6aad3765.jpg saved to cache
2026-03-30 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58137188-0516-5064-8b46-5432fd7c596f
2026-03-30 10:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_9cf976e6ce31c9add109a75ae2df7820.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_8fdd7e7ad4c0bc69c3abfdf08f493d12.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4335150>
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_9cf976e6ce31c9add109a75ae2df7820.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_9cf976e6ce31c9add109a75ae2df7820.jpg saved to cache
2026-03-30 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58137188-0516-5064-8b46-5432fd7c596f
2026-03-30 10:40:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef0690>
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_8fdd7e7ad4c0bc69c3abfdf08f493d12.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_8fdd7e7ad4c0bc69c3abfdf08f493d12.jpg saved to cache
2026-03-30 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58137188-0516-5064-8b46-5432fd7c596f
2026-03-30 10:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_c05fc6e360bd1922267fca3f4ebe755a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4199f10>
2026-03-30 10:40:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_c05fc6e360bd1922267fca3f4ebe755a.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_c05fc6e360bd1922267fca3f4ebe755a.jpg saved to cache
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58137188-0516-5064-8b46-5432fd7c596f
2026-03-30 10:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_9d65efe410e7d030fca5ff0552a3bb0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_548df99715ab2ee85d35dd1bdf1a91f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_392eb6fb797e8b69a5c9027a58fa31a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef1090>
2026-03-30 10:40:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_9d65efe410e7d030fca5ff0552a3bb0e.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_9d65efe410e7d030fca5ff0552a3bb0e.jpg saved to cache
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 202b5177-a1c0-53bb-b55e-67393a3b4f0b
2026-03-30 10:40:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef7d590>
2026-03-30 10:40:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_548df99715ab2ee85d35dd1bdf1a91f1.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_548df99715ab2ee85d35dd1bdf1a91f1.jpg saved to cache
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 202b5177-a1c0-53bb-b55e-67393a3b4f0b
2026-03-30 10:40:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3e8d0>
2026-03-30 10:40:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F9e%252F479e05a49468286150cf79617dc9ba4d%252Fpa%252FTC02406_392eb6fb797e8b69a5c9027a58fa31a2.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_392eb6fb797e8b69a5c9027a58fa31a2.jpg saved to cache
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58137188-0516-5064-8b46-5432fd7c596f
2026-03-30 10:40:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58137188-0516-5064-8b46-5432fd7c596f, skipping ID generation
2026-03-30 10:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58137188-0516-5064-8b46-5432fd7c596f with scrape type 1
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58137188-0516-5064-8b46-5432fd7c596f sending to next pipeline
2026-03-30 10:40:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58137188-0516-5064-8b46-5432fd7c596f, identifier: TC02406
2026-03-30 10:40:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58137188-0516-5064-8b46-5432fd7c596f with identifier: TC02406
2026-03-30 10:40:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58137188-0516-5064-8b46-5432fd7c596f with identifier: TC02406
2026-03-30 10:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58137188-0516-5064-8b46-5432fd7c596f with identifier: TC02406 to the API
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_392eb6fb797e8b69a5c9027a58fa31a2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:04:47Z',
 'fuel_type': 'diesel',
 'id': '58137188-0516-5064-8b46-5432fd7c596f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC02406',
 'listing': 'auction',
 'location': 'DE, Bitburg',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 322876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2587832,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_c05fc6e360bd1922267fca3f4ebe755a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2703122,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_8fdd7e7ad4c0bc69c3abfdf08f493d12.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2503016,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_9cf976e6ce31c9add109a75ae2df7820.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2632696,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_671003429b402fe13085264b6aad3765.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2509025,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_3b7254c143181acd232994a94be496de.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2873720,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_392eb6fb797e8b69a5c9027a58fa31a2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2697786,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_2307ee499f552dd32e61917ada3d44e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2580281,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_bdccffbca157c790ba73a0bc518a4f11.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2673902,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_571f272fc3fdd7897f9e93bdbca5be2a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58137188-0516-5064-8b46-5432fd7c596f/58137188-0516-5064-8b46-5432fd7c596f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3062430,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/9e/479e05a49468286150cf79617dc9ba4d/pa/TC02406_113b1aafb0865943e4e358235f748e7f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Best of',
 'transmission': 'automatic',
 'trim': 'Best of',
 'year': 2015}
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC02406%27 HTTP/1.1" 200 None
2026-03-30 10:40:17 [auto1.de] INFO: Saving data for TC02406: {'created_time': 1774867217.423799, 'last_price_update_time': 1774867217.42381, 'auction_closing_time': 1774969487.0}
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TC02406') HTTP/1.1" 204 0
2026-03-30 10:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_7e21cec8f82171935a44ea7f5dcbc7e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_0895efffe0c46b1e183a9a8bfaeee660.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_ec8523ff5c34052491b7d85d0e228b10.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_12d970e883bf2b958ae54ec71f16c52d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4919d0>
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_7e21cec8f82171935a44ea7f5dcbc7e6.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_7e21cec8f82171935a44ea7f5dcbc7e6.jpg saved to cache
2026-03-30 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 202b5177-a1c0-53bb-b55e-67393a3b4f0b
2026-03-30 10:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_e582cd9fc41b98327ba0fc8217b7ce92.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_e1fa9f46d55a8d5fb3c966bf960a9ff3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4230450>
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_0895efffe0c46b1e183a9a8bfaeee660.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_0895efffe0c46b1e183a9a8bfaeee660.jpg saved to cache
2026-03-30 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 202b5177-a1c0-53bb-b55e-67393a3b4f0b
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429c2d0>
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_ec8523ff5c34052491b7d85d0e228b10.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_ec8523ff5c34052491b7d85d0e228b10.jpg saved to cache
2026-03-30 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a80d869-2970-5973-8b54-c9c07bb05ca5
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5910b10>
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_12d970e883bf2b958ae54ec71f16c52d.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_12d970e883bf2b958ae54ec71f16c52d.jpg saved to cache
2026-03-30 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a80d869-2970-5973-8b54-c9c07bb05ca5
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee80ad0>
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_e582cd9fc41b98327ba0fc8217b7ce92.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_e582cd9fc41b98327ba0fc8217b7ce92.jpg saved to cache
2026-03-30 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a80d869-2970-5973-8b54-c9c07bb05ca5
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef1a90>
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Ff4%252F76f42c71eacfa13f8d21f8457d640a62%252Fpa%252FMT60714_e1fa9f46d55a8d5fb3c966bf960a9ff3.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_e1fa9f46d55a8d5fb3c966bf960a9ff3.jpg saved to cache
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a80d869-2970-5973-8b54-c9c07bb05ca5
2026-03-30 10:40:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a80d869-2970-5973-8b54-c9c07bb05ca5, skipping ID generation
2026-03-30 10:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a80d869-2970-5973-8b54-c9c07bb05ca5 with scrape type 1
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a80d869-2970-5973-8b54-c9c07bb05ca5 sending to next pipeline
2026-03-30 10:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a80d869-2970-5973-8b54-c9c07bb05ca5, identifier: MT60714
2026-03-30 10:40:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a80d869-2970-5973-8b54-c9c07bb05ca5 with identifier: MT60714
2026-03-30 10:40:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a80d869-2970-5973-8b54-c9c07bb05ca5 with identifier: MT60714
2026-03-30 10:40:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a80d869-2970-5973-8b54-c9c07bb05ca5 with identifier: MT60714 to the API
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_e1fa9f46d55a8d5fb3c966bf960a9ff3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 262,
 'expiration_date': '2026-03-31T15:14:20Z',
 'fuel_type': 'diesel',
 'id': '3a80d869-2970-5973-8b54-c9c07bb05ca5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT60714',
 'listing': 'auction',
 'location': 'DE, Bonn',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 255978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_e1fa9f46d55a8d5fb3c966bf960a9ff3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_e582cd9fc41b98327ba0fc8217b7ce92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_12d970e883bf2b958ae54ec71f16c52d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_ec8523ff5c34052491b7d85d0e228b10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_a03112da6df212eb0551f3656691d1b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_13a043f90c91cb933d55356f1bf0f155.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_0f34a65280e35ea3320d0b25df03d407.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_a9692caffde5bb9263baec919311a31d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_8c0df7e921fe0663f7394f6fb89e6963.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a80d869-2970-5973-8b54-c9c07bb05ca5/3a80d869-2970-5973-8b54-c9c07bb05ca5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f4/76f42c71eacfa13f8d21f8457d640a62/pa/MT60714_ad8233a0d97515212a24e1ed6d5bfd71.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion Terrain Tech',
 'transmission': 'automatic',
 'trim': 'BlueMotion Terrain Tech',
 'year': 2016}
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT60714%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [auto1.de] INFO: Saving data for MT60714: {'created_time': 1774867218.510087, 'last_price_update_time': 1774867218.5101, 'auction_closing_time': 1774970060.0}
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT60714') HTTP/1.1" 204 0
2026-03-30 10:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB77071> (referer: https://www.auto1.com/v1/car-details-view/HB77071/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_0a99b4b515dd221fa5b1e99884df93ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MF97779> (referer: https://www.auto1.com/v1/car-details-view/MF97779/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b1c6d7c-9462-5000-9333-9ab5c2370659 with identifier: HB77071
2026-03-30 10:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b1c6d7c-9462-5000-9333-9ab5c2370659 with scrape type 1
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b1c6d7c-9462-5000-9333-9ab5c2370659
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F77%252F10779d529bfaa17943791cd25be9bc1f%252Fpa%252FHB77071_ffc895a58df6d8861697a382de366eab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_ffc895a58df6d8861697a382de366eab.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F77%252F10779d529bfaa17943791cd25be9bc1f%252Fpa%252FHB77071_85c5d48989f6dd11b6b898beafe5f30b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_85c5d48989f6dd11b6b898beafe5f30b.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F77%252F10779d529bfaa17943791cd25be9bc1f%252Fpa%252FHB77071_aee5320d4df611b79ddbd4e90c5aedc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_aee5320d4df611b79ddbd4e90c5aedc2.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F77%252F10779d529bfaa17943791cd25be9bc1f%252Fpa%252FHB77071_ec43b03b2f620abe0e5195df207e7373.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_ec43b03b2f620abe0e5195df207e7373.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F77%252F10779d529bfaa17943791cd25be9bc1f%252Fpa%252FHB77071_86af1621557e99d8ebaef57c437b36d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_86af1621557e99d8ebaef57c437b36d9.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F77%252F10779d529bfaa17943791cd25be9bc1f%252Fpa%252FHB77071_03457f13815e2717586d2405d134ecea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_03457f13815e2717586d2405d134ecea.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F77%252F10779d529bfaa17943791cd25be9bc1f%252Fpa%252FHB77071_4b07fb9668db1b7e9e04140c56c82422.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_4b07fb9668db1b7e9e04140c56c82422.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F77%252F10779d529bfaa17943791cd25be9bc1f%252Fpa%252FHB77071_49d01098b7004f80d9dafc86648b47a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_49d01098b7004f80d9dafc86648b47a6.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F77%252F10779d529bfaa17943791cd25be9bc1f%252Fpa%252FHB77071_a552b11636f0313c6bab64b3676f9cea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_a552b11636f0313c6bab64b3676f9cea.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F77%252F10779d529bfaa17943791cd25be9bc1f%252Fpa%252FHB77071_daa630740da29383bc7b8278b0e91036.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_daa630740da29383bc7b8278b0e91036.jpg already downloaded
2026-03-30 10:40:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b1c6d7c-9462-5000-9333-9ab5c2370659, identifier: HB77071
2026-03-30 10:40:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b1c6d7c-9462-5000-9333-9ab5c2370659 with identifier: HB77071
2026-03-30 10:40:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b1c6d7c-9462-5000-9333-9ab5c2370659 with identifier: HB77071
2026-03-30 10:40:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b1c6d7c-9462-5000-9333-9ab5c2370659 with identifier: HB77071 to the API
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HB77071>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:43:00Z',
 'fuel_type': 'diesel',
 'id': '3b1c6d7c-9462-5000-9333-9ab5c2370659',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB77071',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 260815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_ffc895a58df6d8861697a382de366eab.jpg',
                'https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_85c5d48989f6dd11b6b898beafe5f30b.jpg',
                'https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_aee5320d4df611b79ddbd4e90c5aedc2.jpg',
                'https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_ec43b03b2f620abe0e5195df207e7373.jpg',
                'https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_86af1621557e99d8ebaef57c437b36d9.jpg',
                'https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_03457f13815e2717586d2405d134ecea.jpg',
                'https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_4b07fb9668db1b7e9e04140c56c82422.jpg',
                'https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_49d01098b7004f80d9dafc86648b47a6.jpg',
                'https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_a552b11636f0313c6bab64b3676f9cea.jpg',
                'https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_daa630740da29383bc7b8278b0e91036.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b1c6d7c-9462-5000-9333-9ab5c2370659/3b1c6d7c-9462-5000-9333-9ab5c2370659_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_ffc895a58df6d8861697a382de366eab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b1c6d7c-9462-5000-9333-9ab5c2370659/3b1c6d7c-9462-5000-9333-9ab5c2370659_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_85c5d48989f6dd11b6b898beafe5f30b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b1c6d7c-9462-5000-9333-9ab5c2370659/3b1c6d7c-9462-5000-9333-9ab5c2370659_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_aee5320d4df611b79ddbd4e90c5aedc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b1c6d7c-9462-5000-9333-9ab5c2370659/3b1c6d7c-9462-5000-9333-9ab5c2370659_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_ec43b03b2f620abe0e5195df207e7373.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b1c6d7c-9462-5000-9333-9ab5c2370659/3b1c6d7c-9462-5000-9333-9ab5c2370659_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_86af1621557e99d8ebaef57c437b36d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b1c6d7c-9462-5000-9333-9ab5c2370659/3b1c6d7c-9462-5000-9333-9ab5c2370659_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_03457f13815e2717586d2405d134ecea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b1c6d7c-9462-5000-9333-9ab5c2370659/3b1c6d7c-9462-5000-9333-9ab5c2370659_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_4b07fb9668db1b7e9e04140c56c82422.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b1c6d7c-9462-5000-9333-9ab5c2370659/3b1c6d7c-9462-5000-9333-9ab5c2370659_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_49d01098b7004f80d9dafc86648b47a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b1c6d7c-9462-5000-9333-9ab5c2370659/3b1c6d7c-9462-5000-9333-9ab5c2370659_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_a552b11636f0313c6bab64b3676f9cea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b1c6d7c-9462-5000-9333-9ab5c2370659/3b1c6d7c-9462-5000-9333-9ab5c2370659_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/77/10779d529bfaa17943791cd25be9bc1f/pa/HB77071_daa630740da29383bc7b8278b0e91036.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-04-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI BlueEfficiency Elegance',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Elegance',
 'year': 2011}
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB77071%27 HTTP/1.1" 200 None
2026-03-30 10:40:19 [auto1.de] INFO: Saving data for HB77071: {'created_time': 1774867219.351364, 'last_price_update_time': 1774867219.351378, 'auction_closing_time': 1774971780.0}
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB77071') HTTP/1.1" 204 0
2026-03-30 10:40:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef35910>
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fc3%252F16c3df1d5a557a7fb71ffc1d8921f30a%252Fpa%252FLP80912_0a99b4b515dd221fa5b1e99884df93ba.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_0a99b4b515dd221fa5b1e99884df93ba.jpg saved to cache
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 202b5177-a1c0-53bb-b55e-67393a3b4f0b
2026-03-30 10:40:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 202b5177-a1c0-53bb-b55e-67393a3b4f0b, skipping ID generation
2026-03-30 10:40:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 202b5177-a1c0-53bb-b55e-67393a3b4f0b with scrape type 1
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 202b5177-a1c0-53bb-b55e-67393a3b4f0b sending to next pipeline
2026-03-30 10:40:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 202b5177-a1c0-53bb-b55e-67393a3b4f0b, identifier: LP80912
2026-03-30 10:40:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 873d24b4-a183-5262-92d5-0b15cb173edd with identifier: MF97779
2026-03-30 10:40:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 873d24b4-a183-5262-92d5-0b15cb173edd with scrape type 1
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 873d24b4-a183-5262-92d5-0b15cb173edd
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F63%252Feb63ea96227a1440c287cde35ce80ad0%252Fpa%252FMF97779_f385038ccc1cd27d45a356e87a91a038.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_f385038ccc1cd27d45a356e87a91a038.jpg not downloaded yet
2026-03-30 10:40:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 202b5177-a1c0-53bb-b55e-67393a3b4f0b with identifier: LP80912
2026-03-30 10:40:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 202b5177-a1c0-53bb-b55e-67393a3b4f0b with identifier: LP80912
2026-03-30 10:40:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 202b5177-a1c0-53bb-b55e-67393a3b4f0b with identifier: LP80912 to the API
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_0a99b4b515dd221fa5b1e99884df93ba.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:44:25Z',
 'fuel_type': 'petrol',
 'id': '202b5177-a1c0-53bb-b55e-67393a3b4f0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP80912',
 'listing': 'auction',
 'location': 'DE, Potsdam',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 25321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2279951,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_0a99b4b515dd221fa5b1e99884df93ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2269804,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_75c939d946faac17c44b5d89bac257dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2023367,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_0895efffe0c46b1e183a9a8bfaeee660.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2001902,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_7e21cec8f82171935a44ea7f5dcbc7e6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2186357,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_db4174764b175459d78a970e4bae11a2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2251619,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_548df99715ab2ee85d35dd1bdf1a91f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2591639,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_9d65efe410e7d030fca5ff0552a3bb0e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2412581,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_f47655c1eeb9e801bff5829dfc981bbb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2210947,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_a6932e925d841263eed42a4d77491b7e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202b5177-a1c0-53bb-b55e-67393a3b4f0b/202b5177-a1c0-53bb-b55e-67393a3b4f0b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2110312,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/c3/16c3df1d5a557a7fb71ffc1d8921f30a/pa/LP80912_ace81846a63ad5e2813df33102e80dd2.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Clever',
 'transmission': 'automatic',
 'trim': 'Clever',
 'year': 2021}
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP80912%27 HTTP/1.1" 200 None
2026-03-30 10:40:19 [auto1.de] INFO: Saving data for LP80912: {'created_time': 1774867219.958488, 'last_price_update_time': 1774867219.9585, 'auction_closing_time': 1774971865.0}
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LP80912') HTTP/1.1" 204 0
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F63%252Feb63ea96227a1440c287cde35ce80ad0%252Fpa%252FMF97779_3b5dff365e4292c6e82cebd37d28d205.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_3b5dff365e4292c6e82cebd37d28d205.jpg not downloaded yet
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F63%252Feb63ea96227a1440c287cde35ce80ad0%252Fpa%252FMF97779_a5ebd9ac96b00af76b7f9ff250e90e82.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_a5ebd9ac96b00af76b7f9ff250e90e82.jpg not downloaded yet
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F63%252Feb63ea96227a1440c287cde35ce80ad0%252Fpa%252FMF97779_18b2bd74d8475aa763917a1155e59476.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_18b2bd74d8475aa763917a1155e59476.jpg not downloaded yet
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F63%252Feb63ea96227a1440c287cde35ce80ad0%252Fpa%252FMF97779_870b6c5e04fc04134dbe96cef494dc5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_870b6c5e04fc04134dbe96cef494dc5e.jpg not downloaded yet
2026-03-30 10:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_ec382b076c82cd622b2fbd6ec980515f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_c8035cf6c20dd05f81751f06b429f518.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_d4ba1622d43079c383cad22f1378e79d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_870b6c5e04fc04134dbe96cef494dc5e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee485190>
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_ec382b076c82cd622b2fbd6ec980515f.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_ec382b076c82cd622b2fbd6ec980515f.jpg saved to cache
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item acf3fe72-685e-5977-bfa5-b98614339b1c
2026-03-30 10:40:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3e350>
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_c8035cf6c20dd05f81751f06b429f518.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_c8035cf6c20dd05f81751f06b429f518.jpg saved to cache
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item acf3fe72-685e-5977-bfa5-b98614339b1c
2026-03-30 10:40:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d4290>
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_d4ba1622d43079c383cad22f1378e79d.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_d4ba1622d43079c383cad22f1378e79d.jpg saved to cache
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item acf3fe72-685e-5977-bfa5-b98614339b1c
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4217f10>
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_873d24b4-a183-5262-92d5-0b15cb173edd/873d24b4-a183-5262-92d5-0b15cb173edd_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F63%252Feb63ea96227a1440c287cde35ce80ad0%252Fpa%252FMF97779_870b6c5e04fc04134dbe96cef494dc5e.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_870b6c5e04fc04134dbe96cef494dc5e.jpg saved to cache
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 873d24b4-a183-5262-92d5-0b15cb173edd
2026-03-30 10:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_18b2bd74d8475aa763917a1155e59476.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_3b5dff365e4292c6e82cebd37d28d205.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_a5ebd9ac96b00af76b7f9ff250e90e82.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_f385038ccc1cd27d45a356e87a91a038.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_e664e9422404dcb867e867e455343839.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4217250>
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_873d24b4-a183-5262-92d5-0b15cb173edd/873d24b4-a183-5262-92d5-0b15cb173edd_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F63%252Feb63ea96227a1440c287cde35ce80ad0%252Fpa%252FMF97779_18b2bd74d8475aa763917a1155e59476.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_18b2bd74d8475aa763917a1155e59476.jpg saved to cache
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 873d24b4-a183-5262-92d5-0b15cb173edd
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41ebb90>
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_873d24b4-a183-5262-92d5-0b15cb173edd/873d24b4-a183-5262-92d5-0b15cb173edd_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F63%252Feb63ea96227a1440c287cde35ce80ad0%252Fpa%252FMF97779_3b5dff365e4292c6e82cebd37d28d205.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_3b5dff365e4292c6e82cebd37d28d205.jpg saved to cache
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 873d24b4-a183-5262-92d5-0b15cb173edd
2026-03-30 10:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_c86b54fdff1d2f2c2e1153b35050e191.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4302010>
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_873d24b4-a183-5262-92d5-0b15cb173edd/873d24b4-a183-5262-92d5-0b15cb173edd_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F63%252Feb63ea96227a1440c287cde35ce80ad0%252Fpa%252FMF97779_a5ebd9ac96b00af76b7f9ff250e90e82.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_a5ebd9ac96b00af76b7f9ff250e90e82.jpg saved to cache
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 873d24b4-a183-5262-92d5-0b15cb173edd
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f8a50>
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_873d24b4-a183-5262-92d5-0b15cb173edd/873d24b4-a183-5262-92d5-0b15cb173edd_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F63%252Feb63ea96227a1440c287cde35ce80ad0%252Fpa%252FMF97779_f385038ccc1cd27d45a356e87a91a038.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_f385038ccc1cd27d45a356e87a91a038.jpg saved to cache
2026-03-30 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 873d24b4-a183-5262-92d5-0b15cb173edd
2026-03-30 10:40:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 873d24b4-a183-5262-92d5-0b15cb173edd, skipping ID generation
2026-03-30 10:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 873d24b4-a183-5262-92d5-0b15cb173edd with scrape type 1
2026-03-30 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 873d24b4-a183-5262-92d5-0b15cb173edd sending to next pipeline
2026-03-30 10:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 873d24b4-a183-5262-92d5-0b15cb173edd, identifier: MF97779
2026-03-30 10:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 873d24b4-a183-5262-92d5-0b15cb173edd with identifier: MF97779
2026-03-30 10:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 873d24b4-a183-5262-92d5-0b15cb173edd with identifier: MF97779
2026-03-30 10:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 873d24b4-a183-5262-92d5-0b15cb173edd with identifier: MF97779 to the API
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_f385038ccc1cd27d45a356e87a91a038.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 145,
 'expiration_date': '2026-03-31T15:06:31Z',
 'fuel_type': 'petrol',
 'id': '873d24b4-a183-5262-92d5-0b15cb173edd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF97779',
 'listing': 'auction',
 'location': 'DE, Brühl',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 169323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_873d24b4-a183-5262-92d5-0b15cb173edd/873d24b4-a183-5262-92d5-0b15cb173edd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_f385038ccc1cd27d45a356e87a91a038.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_873d24b4-a183-5262-92d5-0b15cb173edd/873d24b4-a183-5262-92d5-0b15cb173edd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_3b5dff365e4292c6e82cebd37d28d205.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_873d24b4-a183-5262-92d5-0b15cb173edd/873d24b4-a183-5262-92d5-0b15cb173edd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_a5ebd9ac96b00af76b7f9ff250e90e82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_873d24b4-a183-5262-92d5-0b15cb173edd/873d24b4-a183-5262-92d5-0b15cb173edd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_18b2bd74d8475aa763917a1155e59476.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_873d24b4-a183-5262-92d5-0b15cb173edd/873d24b4-a183-5262-92d5-0b15cb173edd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/63/eb63ea96227a1440c287cde35ce80ad0/pa/MF97779_870b6c5e04fc04134dbe96cef494dc5e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 Ghia',
 'transmission': 'manual',
 'trim': 'Ghia',
 'year': 2007}
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF97779%27 HTTP/1.1" 200 None
2026-03-30 10:40:21 [auto1.de] INFO: Saving data for MF97779: {'created_time': 1774867221.492763, 'last_price_update_time': 1774867221.492774, 'auction_closing_time': 1774969591.0}
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF97779') HTTP/1.1" 204 0
2026-03-30 10:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef0e10>
2026-03-30 10:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce147cb4-5733-5711-9256-32d2e36da4d5/ce147cb4-5733-5711-9256-32d2e36da4d5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fd0%252F50d0702f048ccab9105a421f00caa11e%252Fpa%252FMF98789_e664e9422404dcb867e867e455343839.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_e664e9422404dcb867e867e455343839.jpg saved to cache
2026-03-30 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce147cb4-5733-5711-9256-32d2e36da4d5
2026-03-30 10:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeed410>
2026-03-30 10:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce147cb4-5733-5711-9256-32d2e36da4d5/ce147cb4-5733-5711-9256-32d2e36da4d5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fd0%252F50d0702f048ccab9105a421f00caa11e%252Fpa%252FMF98789_c86b54fdff1d2f2c2e1153b35050e191.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_c86b54fdff1d2f2c2e1153b35050e191.jpg saved to cache
2026-03-30 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce147cb4-5733-5711-9256-32d2e36da4d5
2026-03-30 10:40:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce147cb4-5733-5711-9256-32d2e36da4d5, skipping ID generation
2026-03-30 10:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce147cb4-5733-5711-9256-32d2e36da4d5 with scrape type 1
2026-03-30 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce147cb4-5733-5711-9256-32d2e36da4d5 sending to next pipeline
2026-03-30 10:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce147cb4-5733-5711-9256-32d2e36da4d5, identifier: MF98789
2026-03-30 10:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_5ade24142e824b04c9d0829ab2280298.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce147cb4-5733-5711-9256-32d2e36da4d5 with identifier: MF98789
2026-03-30 10:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce147cb4-5733-5711-9256-32d2e36da4d5 with identifier: MF98789
2026-03-30 10:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce147cb4-5733-5711-9256-32d2e36da4d5 with identifier: MF98789 to the API
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_c86b54fdff1d2f2c2e1153b35050e191.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 198,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:02:52Z',
 'fuel_type': 'petrol',
 'id': 'ce147cb4-5733-5711-9256-32d2e36da4d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF98789',
 'listing': 'auction',
 'location': 'DE, Würzburg',
 'make': 'Volkswagen',
 'model': 'Eos',
 'odometer': 107247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce147cb4-5733-5711-9256-32d2e36da4d5/ce147cb4-5733-5711-9256-32d2e36da4d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_c86b54fdff1d2f2c2e1153b35050e191.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce147cb4-5733-5711-9256-32d2e36da4d5/ce147cb4-5733-5711-9256-32d2e36da4d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_e664e9422404dcb867e867e455343839.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce147cb4-5733-5711-9256-32d2e36da4d5/ce147cb4-5733-5711-9256-32d2e36da4d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_2128d66c165d87d007322b7288fdbac5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce147cb4-5733-5711-9256-32d2e36da4d5/ce147cb4-5733-5711-9256-32d2e36da4d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_41f6b8f9cd6e3d6aa27cecbace013e1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce147cb4-5733-5711-9256-32d2e36da4d5/ce147cb4-5733-5711-9256-32d2e36da4d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 153536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_6ce9c7250c987c68b71617f5e036ecb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce147cb4-5733-5711-9256-32d2e36da4d5/ce147cb4-5733-5711-9256-32d2e36da4d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/d0/50d0702f048ccab9105a421f00caa11e/pa/MF98789_d227fa2788fbc688b60feb84fa2cb7ef.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Eos 2.0 FSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF98789%27 HTTP/1.1" 200 None
2026-03-30 10:40:22 [auto1.de] INFO: Saving data for MF98789: {'created_time': 1774867222.065061, 'last_price_update_time': 1774867222.065071, 'auction_closing_time': 1774969372.0}
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF98789') HTTP/1.1" 204 0
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeef910>
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60812389-82e3-54c2-bc65-39fbb8443718/60812389-82e3-54c2-bc65-39fbb8443718_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F08%252Fa0086ded281eed395e5bc08a6df62225%252Fpa%252FSB38553_5ade24142e824b04c9d0829ab2280298.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_5ade24142e824b04c9d0829ab2280298.jpg saved to cache
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60812389-82e3-54c2-bc65-39fbb8443718
2026-03-30 10:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_75c718f3cf50b5978866f1d72ee8e073.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_58c6c73dc2c6ffbf450d8d7ed4e8a60b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee417510>
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_75c718f3cf50b5978866f1d72ee8e073.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_75c718f3cf50b5978866f1d72ee8e073.jpg saved to cache
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item acf3fe72-685e-5977-bfa5-b98614339b1c
2026-03-30 10:40:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4215c10>
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fb4%252F9eb4924424a3acb00ee354fd4ad9277b%252Fpa%252FGH80135_58c6c73dc2c6ffbf450d8d7ed4e8a60b.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_58c6c73dc2c6ffbf450d8d7ed4e8a60b.jpg saved to cache
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item acf3fe72-685e-5977-bfa5-b98614339b1c
2026-03-30 10:40:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acf3fe72-685e-5977-bfa5-b98614339b1c, skipping ID generation
2026-03-30 10:40:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acf3fe72-685e-5977-bfa5-b98614339b1c with scrape type 1
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item acf3fe72-685e-5977-bfa5-b98614339b1c sending to next pipeline
2026-03-30 10:40:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acf3fe72-685e-5977-bfa5-b98614339b1c, identifier: GH80135
2026-03-30 10:40:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acf3fe72-685e-5977-bfa5-b98614339b1c with identifier: GH80135
2026-03-30 10:40:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acf3fe72-685e-5977-bfa5-b98614339b1c with identifier: GH80135
2026-03-30 10:40:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acf3fe72-685e-5977-bfa5-b98614339b1c with identifier: GH80135 to the API
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_58c6c73dc2c6ffbf450d8d7ed4e8a60b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:26:13Z',
 'fuel_type': 'petrol',
 'id': 'acf3fe72-685e-5977-bfa5-b98614339b1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH80135',
 'listing': 'auction',
 'location': 'DE, Nürnberg',
 'make': 'Opel',
 'model': 'Combo Life',
 'odometer': 82871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2808553,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_75c718f3cf50b5978866f1d72ee8e073.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2982735,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_a0c3e23b3d7a72dd58c5c21acfaedde7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2983073,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_58c6c73dc2c6ffbf450d8d7ed4e8a60b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2571216,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_d4ba1622d43079c383cad22f1378e79d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2640971,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_d4a6068af3855640ebf3b0c5ec0d2e3c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2658982,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_ec382b076c82cd622b2fbd6ec980515f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2690456,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_c8035cf6c20dd05f81751f06b429f518.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2977354,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_a5d36300b52e074b7e135a8f2e7d4459.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2627731,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_2a8b6070f0922f2b049ab9c24d4b8f3a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf3fe72-685e-5977-bfa5-b98614339b1c/acf3fe72-685e-5977-bfa5-b98614339b1c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2631669,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/b4/9eb4924424a3acb00ee354fd4ad9277b/pa/GH80135_96ec4feb2b9bdd862bfa06556784767f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Combo Life 1.2 Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2018}
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH80135%27 HTTP/1.1" 200 None
2026-03-30 10:40:23 [auto1.de] INFO: Saving data for GH80135: {'created_time': 1774867223.199874, 'last_price_update_time': 1774867223.199885, 'auction_closing_time': 1774970773.0}
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH80135') HTTP/1.1" 204 0
2026-03-30 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FZ11767> (referer: https://www.auto1.com/v1/car-details-view/FZ11767/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_96e069cf4ee7134a2d9f472a604e8e5f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab04bad6-1b62-5c0b-a8d7-887bd3f1f107 with identifier: FZ11767
2026-03-30 10:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab04bad6-1b62-5c0b-a8d7-887bd3f1f107 with scrape type 1
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab04bad6-1b62-5c0b-a8d7-887bd3f1f107
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_59f7a15d18076b783cc9371757a16d50.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_59f7a15d18076b783cc9371757a16d50.jpg not downloaded yet
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_87e9565b491ce98ab293522be88fba92.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_87e9565b491ce98ab293522be88fba92.jpg not downloaded yet
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_249003f96350072703af610141d0eabb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_249003f96350072703af610141d0eabb.jpg not downloaded yet
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_063101eb0388da9f6d3fd639a2673808.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_063101eb0388da9f6d3fd639a2673808.jpg not downloaded yet
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_f03a2d6c5c4a4cd85cc831ad75a1af62.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_f03a2d6c5c4a4cd85cc831ad75a1af62.jpg not downloaded yet
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_587987f1252d7b546ffa1f9cef0e1666.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_587987f1252d7b546ffa1f9cef0e1666.jpg not downloaded yet
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee92f90>
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60812389-82e3-54c2-bc65-39fbb8443718/60812389-82e3-54c2-bc65-39fbb8443718_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F08%252Fa0086ded281eed395e5bc08a6df62225%252Fpa%252FSB38553_96e069cf4ee7134a2d9f472a604e8e5f.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_96e069cf4ee7134a2d9f472a604e8e5f.jpg saved to cache
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60812389-82e3-54c2-bc65-39fbb8443718
2026-03-30 10:40:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60812389-82e3-54c2-bc65-39fbb8443718, skipping ID generation
2026-03-30 10:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60812389-82e3-54c2-bc65-39fbb8443718 with scrape type 1
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60812389-82e3-54c2-bc65-39fbb8443718 sending to next pipeline
2026-03-30 10:40:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60812389-82e3-54c2-bc65-39fbb8443718, identifier: SB38553
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_9c93d6b7cecbfe93c44cdef558f4ea83.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_9c93d6b7cecbfe93c44cdef558f4ea83.jpg not downloaded yet
2026-03-30 10:40:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60812389-82e3-54c2-bc65-39fbb8443718 with identifier: SB38553
2026-03-30 10:40:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60812389-82e3-54c2-bc65-39fbb8443718 with identifier: SB38553
2026-03-30 10:40:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60812389-82e3-54c2-bc65-39fbb8443718 with identifier: SB38553 to the API
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_96e069cf4ee7134a2d9f472a604e8e5f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:56:23Z',
 'fuel_type': 'petrol',
 'id': '60812389-82e3-54c2-bc65-39fbb8443718',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB38553',
 'listing': 'auction',
 'location': 'DE, Waiblingen',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 112106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60812389-82e3-54c2-bc65-39fbb8443718/60812389-82e3-54c2-bc65-39fbb8443718_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_96e069cf4ee7134a2d9f472a604e8e5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60812389-82e3-54c2-bc65-39fbb8443718/60812389-82e3-54c2-bc65-39fbb8443718_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_5ade24142e824b04c9d0829ab2280298.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60812389-82e3-54c2-bc65-39fbb8443718/60812389-82e3-54c2-bc65-39fbb8443718_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_855236425e94444ccf1f751e901e5a43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60812389-82e3-54c2-bc65-39fbb8443718/60812389-82e3-54c2-bc65-39fbb8443718_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_9f5ba9639f03e74d695535c653813a84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60812389-82e3-54c2-bc65-39fbb8443718/60812389-82e3-54c2-bc65-39fbb8443718_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/08/a0086ded281eed395e5bc08a6df62225/pa/SB38553_39481a4424f5065a276421c24ad0097a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2013}
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB38553%27 HTTP/1.1" 200 None
2026-03-30 10:40:24 [auto1.de] INFO: Saving data for SB38553: {'created_time': 1774867224.104953, 'last_price_update_time': 1774867224.104967, 'auction_closing_time': 1774972583.0}
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB38553') HTTP/1.1" 204 0
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_24aa809c2db153fcdcfff913426d5dc6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_24aa809c2db153fcdcfff913426d5dc6.jpg not downloaded yet
2026-03-30 10:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW71270> (referer: https://www.auto1.com/v1/car-details-view/EW71270/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA51445> (referer: https://www.auto1.com/v1/car-details-view/RA51445/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_47b08229f0564034e08e433a428feec1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_47b08229f0564034e08e433a428feec1.jpg not downloaded yet
2026-03-30 10:40:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_d008da60180e31c57516389480f0c32f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_d008da60180e31c57516389480f0c32f.jpg not downloaded yet
2026-03-30 10:40:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ea914d6-f018-577a-9d50-f987680a5929 with identifier: EW71270
2026-03-30 10:40:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ea914d6-f018-577a-9d50-f987680a5929 with scrape type 1
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2ea914d6-f018-577a-9d50-f987680a5929
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fa5%252F44a5350b2c4501996d413595ca03f7ed%252Fpa%252FEW71270_c61d4e8d21a5ac3b644bee00133ce1bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_c61d4e8d21a5ac3b644bee00133ce1bb.jpg already downloaded
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fa5%252F44a5350b2c4501996d413595ca03f7ed%252Fpa%252FEW71270_ea851594875a6187c024a44d7f0dcbaa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_ea851594875a6187c024a44d7f0dcbaa.jpg already downloaded
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fa5%252F44a5350b2c4501996d413595ca03f7ed%252Fpa%252FEW71270_9c5562f780c522e84f0518045e2e0791.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_9c5562f780c522e84f0518045e2e0791.jpg already downloaded
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fa5%252F44a5350b2c4501996d413595ca03f7ed%252Fpa%252FEW71270_6983a5a194a6918b239b669da163b560.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_6983a5a194a6918b239b669da163b560.jpg already downloaded
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fa5%252F44a5350b2c4501996d413595ca03f7ed%252Fpa%252FEW71270_0b221ba0fbe4daa63598872e352b3aa9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_0b221ba0fbe4daa63598872e352b3aa9.jpg already downloaded
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fa5%252F44a5350b2c4501996d413595ca03f7ed%252Fpa%252FEW71270_6d00fe7f13fd80ae84988561e71a12b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_6d00fe7f13fd80ae84988561e71a12b2.jpg already downloaded
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fa5%252F44a5350b2c4501996d413595ca03f7ed%252Fpa%252FEW71270_c016eaed222a6ce01be9e7d8929997ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_c016eaed222a6ce01be9e7d8929997ff.jpg already downloaded
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fa5%252F44a5350b2c4501996d413595ca03f7ed%252Fpa%252FEW71270_ec845ebfca9e25ce4bc7d649e60174d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_ec845ebfca9e25ce4bc7d649e60174d0.jpg already downloaded
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fa5%252F44a5350b2c4501996d413595ca03f7ed%252Fpa%252FEW71270_2c4b380c362fa3a1b67431aefe5a8e0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_2c4b380c362fa3a1b67431aefe5a8e0d.jpg already downloaded
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fa5%252F44a5350b2c4501996d413595ca03f7ed%252Fpa%252FEW71270_5326db4c376c0c5b5ae3fe9bf66ad263.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_5326db4c376c0c5b5ae3fe9bf66ad263.jpg already downloaded
2026-03-30 10:40:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ea914d6-f018-577a-9d50-f987680a5929, identifier: EW71270
2026-03-30 10:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ea914d6-f018-577a-9d50-f987680a5929 with identifier: EW71270
2026-03-30 10:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ea914d6-f018-577a-9d50-f987680a5929 with identifier: EW71270
2026-03-30 10:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ea914d6-f018-577a-9d50-f987680a5929 with identifier: EW71270 to the API
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EW71270>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:58:29Z',
 'fuel_type': 'diesel',
 'id': '2ea914d6-f018-577a-9d50-f987680a5929',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW71270',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 123228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_c61d4e8d21a5ac3b644bee00133ce1bb.jpg',
                'https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_ea851594875a6187c024a44d7f0dcbaa.jpg',
                'https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_9c5562f780c522e84f0518045e2e0791.jpg',
                'https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_6983a5a194a6918b239b669da163b560.jpg',
                'https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_0b221ba0fbe4daa63598872e352b3aa9.jpg',
                'https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_6d00fe7f13fd80ae84988561e71a12b2.jpg',
                'https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_c016eaed222a6ce01be9e7d8929997ff.jpg',
                'https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_ec845ebfca9e25ce4bc7d649e60174d0.jpg',
                'https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_2c4b380c362fa3a1b67431aefe5a8e0d.jpg',
                'https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_5326db4c376c0c5b5ae3fe9bf66ad263.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea914d6-f018-577a-9d50-f987680a5929/2ea914d6-f018-577a-9d50-f987680a5929_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340310,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_c61d4e8d21a5ac3b644bee00133ce1bb.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea914d6-f018-577a-9d50-f987680a5929/2ea914d6-f018-577a-9d50-f987680a5929_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357375,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_ea851594875a6187c024a44d7f0dcbaa.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea914d6-f018-577a-9d50-f987680a5929/2ea914d6-f018-577a-9d50-f987680a5929_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343152,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_9c5562f780c522e84f0518045e2e0791.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea914d6-f018-577a-9d50-f987680a5929/2ea914d6-f018-577a-9d50-f987680a5929_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278641,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_6983a5a194a6918b239b669da163b560.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea914d6-f018-577a-9d50-f987680a5929/2ea914d6-f018-577a-9d50-f987680a5929_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332304,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_0b221ba0fbe4daa63598872e352b3aa9.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea914d6-f018-577a-9d50-f987680a5929/2ea914d6-f018-577a-9d50-f987680a5929_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346643,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_6d00fe7f13fd80ae84988561e71a12b2.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea914d6-f018-577a-9d50-f987680a5929/2ea914d6-f018-577a-9d50-f987680a5929_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287811,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_c016eaed222a6ce01be9e7d8929997ff.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea914d6-f018-577a-9d50-f987680a5929/2ea914d6-f018-577a-9d50-f987680a5929_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372581,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_ec845ebfca9e25ce4bc7d649e60174d0.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea914d6-f018-577a-9d50-f987680a5929/2ea914d6-f018-577a-9d50-f987680a5929_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317584,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_2c4b380c362fa3a1b67431aefe5a8e0d.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea914d6-f018-577a-9d50-f987680a5929/2ea914d6-f018-577a-9d50-f987680a5929_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437467,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img44/a5/44a5350b2c4501996d413595ca03f7ed/pa/EW71270_5326db4c376c0c5b5ae3fe9bf66ad263.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi Business L1',
 'transmission': 'manual',
 'trim': 'Business L1',
 'year': 2016}
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW71270%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [auto1.de] INFO: Saving data for EW71270: {'created_time': 1774867225.18687, 'last_price_update_time': 1774867225.186883, 'auction_closing_time': 1774972709.0}
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW71270') HTTP/1.1" 204 0
2026-03-30 10:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ32446> (referer: https://www.auto1.com/v1/car-details-view/GZ32446/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf with identifier: RA51445
2026-03-30 10:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf with scrape type 1
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F21%252F6121e2b9be5f203958fccddd5402f8d1%252Fpa%252FRA51445_025e108e9d5cc2bde60a6b4fc8008c93.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_025e108e9d5cc2bde60a6b4fc8008c93.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F21%252F6121e2b9be5f203958fccddd5402f8d1%252Fpa%252FRA51445_5ee78f04362f23fa747fba6ae8bf11a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_5ee78f04362f23fa747fba6ae8bf11a3.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F21%252F6121e2b9be5f203958fccddd5402f8d1%252Fpa%252FRA51445_0a517885af7d8dda7bbc64a9cfc5fb47.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_0a517885af7d8dda7bbc64a9cfc5fb47.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F21%252F6121e2b9be5f203958fccddd5402f8d1%252Fpa%252FRA51445_3ae6c162559dcf138cd312440bedd9be.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_3ae6c162559dcf138cd312440bedd9be.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F21%252F6121e2b9be5f203958fccddd5402f8d1%252Fpa%252FRA51445_4bb770632c7841fb3e60678f919ce1f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_4bb770632c7841fb3e60678f919ce1f6.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F21%252F6121e2b9be5f203958fccddd5402f8d1%252Fpa%252FRA51445_22214f22edaa4b22e2de3960216f83cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_22214f22edaa4b22e2de3960216f83cf.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F21%252F6121e2b9be5f203958fccddd5402f8d1%252Fpa%252FRA51445_16eab894dd6de7d85c35074e40d97f37.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_16eab894dd6de7d85c35074e40d97f37.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F21%252F6121e2b9be5f203958fccddd5402f8d1%252Fpa%252FRA51445_31e8cdd727b517dd996a400fcc3eeff5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_31e8cdd727b517dd996a400fcc3eeff5.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F21%252F6121e2b9be5f203958fccddd5402f8d1%252Fpa%252FRA51445_f90e10131084b4453ddc566e62efbeb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_f90e10131084b4453ddc566e62efbeb7.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F21%252F6121e2b9be5f203958fccddd5402f8d1%252Fpa%252FRA51445_83b60c803c908c332413ed42da05c905.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_83b60c803c908c332413ed42da05c905.jpg already downloaded
2026-03-30 10:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf, identifier: RA51445
2026-03-30 10:40:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf with identifier: RA51445
2026-03-30 10:40:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf with identifier: RA51445
2026-03-30 10:40:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf with identifier: RA51445 to the API
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RA51445>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:48:34Z',
 'fuel_type': 'petrol',
 'id': '15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA51445',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 86509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_025e108e9d5cc2bde60a6b4fc8008c93.jpg',
                'https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_5ee78f04362f23fa747fba6ae8bf11a3.jpg',
                'https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_0a517885af7d8dda7bbc64a9cfc5fb47.jpg',
                'https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_3ae6c162559dcf138cd312440bedd9be.jpg',
                'https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_4bb770632c7841fb3e60678f919ce1f6.jpg',
                'https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_22214f22edaa4b22e2de3960216f83cf.jpg',
                'https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_16eab894dd6de7d85c35074e40d97f37.jpg',
                'https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_31e8cdd727b517dd996a400fcc3eeff5.jpg',
                'https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_f90e10131084b4453ddc566e62efbeb7.jpg',
                'https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_83b60c803c908c332413ed42da05c905.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf/15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2927291,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_025e108e9d5cc2bde60a6b4fc8008c93.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf/15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2557670,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_5ee78f04362f23fa747fba6ae8bf11a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf/15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2570172,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_0a517885af7d8dda7bbc64a9cfc5fb47.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf/15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608968,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_3ae6c162559dcf138cd312440bedd9be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf/15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_4bb770632c7841fb3e60678f919ce1f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf/15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_22214f22edaa4b22e2de3960216f83cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf/15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2686745,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_16eab894dd6de7d85c35074e40d97f37.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf/15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2612048,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_31e8cdd727b517dd996a400fcc3eeff5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf/15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2788918,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_f90e10131084b4453ddc566e62efbeb7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf/15c9c2ee-4115-53fe-86e0-4ec0c9bef9bf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2604045,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/21/6121e2b9be5f203958fccddd5402f8d1/pa/RA51445_83b60c803c908c332413ed42da05c905.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-11-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2012}
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA51445%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [auto1.de] INFO: Saving data for RA51445: {'created_time': 1774867225.910647, 'last_price_update_time': 1774867225.91066, 'auction_closing_time': 1774972114.0}
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA51445') HTTP/1.1" 204 0
2026-03-30 10:40:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00f31630-ebb5-5ee3-8b55-6b7dfba70d6e with identifier: GZ32446
2026-03-30 10:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00f31630-ebb5-5ee3-8b55-6b7dfba70d6e with scrape type 1
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 00f31630-ebb5-5ee3-8b55-6b7dfba70d6e
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fff%252Fc1ff34bcfc0bc7e4149363da9f5b14fc%252Fpa%252FGZ32446_b6a21d81c7d24837e816a659fff30e34.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/ff/c1ff34bcfc0bc7e4149363da9f5b14fc/pa/GZ32446_b6a21d81c7d24837e816a659fff30e34.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fff%252Fc1ff34bcfc0bc7e4149363da9f5b14fc%252Fpa%252FGZ32446_0af8a21a63a4b0e1819acf23145e4678.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/ff/c1ff34bcfc0bc7e4149363da9f5b14fc/pa/GZ32446_0af8a21a63a4b0e1819acf23145e4678.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fff%252Fc1ff34bcfc0bc7e4149363da9f5b14fc%252Fpa%252FGZ32446_3d39c62ed619af4da959cb1e1cf153d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/ff/c1ff34bcfc0bc7e4149363da9f5b14fc/pa/GZ32446_3d39c62ed619af4da959cb1e1cf153d1.jpg already downloaded
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fff%252Fc1ff34bcfc0bc7e4149363da9f5b14fc%252Fpa%252FGZ32446_fda24b9e8c07417715124273b5590d3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/ff/c1ff34bcfc0bc7e4149363da9f5b14fc/pa/GZ32446_fda24b9e8c07417715124273b5590d3f.jpg already downloaded
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fff%252Fc1ff34bcfc0bc7e4149363da9f5b14fc%252Fpa%252FGZ32446_b38b3dd33784e6f946ad0fe3f7d3f3b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/ff/c1ff34bcfc0bc7e4149363da9f5b14fc/pa/GZ32446_b38b3dd33784e6f946ad0fe3f7d3f3b5.jpg already downloaded
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fff%252Fc1ff34bcfc0bc7e4149363da9f5b14fc%252Fpa%252FGZ32446_c81d964389415ab8d559748a484fb5de.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/ff/c1ff34bcfc0bc7e4149363da9f5b14fc/pa/GZ32446_c81d964389415ab8d559748a484fb5de.jpg already downloaded
2026-03-30 10:40:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00f31630-ebb5-5ee3-8b55-6b7dfba70d6e, identifier: GZ32446
2026-03-30 10:40:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00f31630-ebb5-5ee3-8b55-6b7dfba70d6e with identifier: GZ32446
2026-03-30 10:40:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00f31630-ebb5-5ee3-8b55-6b7dfba70d6e with identifier: GZ32446
2026-03-30 10:40:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00f31630-ebb5-5ee3-8b55-6b7dfba70d6e with identifier: GZ32446 to the API
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GZ32446>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:14:30Z',
 'fuel_type': 'diesel',
 'id': '00f31630-ebb5-5ee3-8b55-6b7dfba70d6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ32446',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 191972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgc1/ff/c1ff34bcfc0bc7e4149363da9f5b14fc/pa/GZ32446_b6a21d81c7d24837e816a659fff30e34.jpg',
                'https://img-pa.auto1.com/imgc1/ff/c1ff34bcfc0bc7e4149363da9f5b14fc/pa/GZ32446_0af8a21a63a4b0e1819acf23145e4678.jpg',
                'https://img-pa.auto1.com/imgc1/ff/c1ff34bcfc0bc7e4149363da9f5b14fc/pa/GZ32446_3d39c62ed619af4da959cb1e1cf153d1.jpg',
                'https://img-pa.auto1.com/imgc1/ff/c1ff34bcfc0bc7e4149363da9f5b14fc/pa/GZ32446_fda24b9e8c07417715124273b5590d3f.jpg',
                'https://img-pa.auto1.com/imgc1/ff/c1ff34bcfc0bc7e4149363da9f5b14fc/pa/GZ32446_b38b3dd33784e6f946ad0fe3f7d3f3b5.jpg',
                'https://img-pa.auto1.com/imgc1/ff/c1ff34bcfc0bc7e4149363da9f5b14fc/pa/GZ32446_c81d964389415ab8d559748a484fb5de.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f31630-ebb5-5ee3-8b55-6b7dfba70d6e/00f31630-ebb5-5ee3-8b55-6b7dfba70d6e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/ff/c1ff34bcfc0bc7e4149363da9f5b14fc/pa/GZ32446_b6a21d81c7d24837e816a659fff30e34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f31630-ebb5-5ee3-8b55-6b7dfba70d6e/00f31630-ebb5-5ee3-8b55-6b7dfba70d6e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/ff/c1ff34bcfc0bc7e4149363da9f5b14fc/pa/GZ32446_0af8a21a63a4b0e1819acf23145e4678.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f31630-ebb5-5ee3-8b55-6b7dfba70d6e/00f31630-ebb5-5ee3-8b55-6b7dfba70d6e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/ff/c1ff34bcfc0bc7e4149363da9f5b14fc/pa/GZ32446_3d39c62ed619af4da959cb1e1cf153d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f31630-ebb5-5ee3-8b55-6b7dfba70d6e/00f31630-ebb5-5ee3-8b55-6b7dfba70d6e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/ff/c1ff34bcfc0bc7e4149363da9f5b14fc/pa/GZ32446_fda24b9e8c07417715124273b5590d3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f31630-ebb5-5ee3-8b55-6b7dfba70d6e/00f31630-ebb5-5ee3-8b55-6b7dfba70d6e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/ff/c1ff34bcfc0bc7e4149363da9f5b14fc/pa/GZ32446_b38b3dd33784e6f946ad0fe3f7d3f3b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f31630-ebb5-5ee3-8b55-6b7dfba70d6e/00f31630-ebb5-5ee3-8b55-6b7dfba70d6e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/ff/c1ff34bcfc0bc7e4149363da9f5b14fc/pa/GZ32446_c81d964389415ab8d559748a484fb5de.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V50 2.0 D Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2010}
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ32446%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [auto1.de] INFO: Saving data for GZ32446: {'created_time': 1774867226.467782, 'last_price_update_time': 1774867226.467794, 'auction_closing_time': 1774970070.0}
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ32446') HTTP/1.1" 204 0
2026-03-30 10:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC81161/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_24aa809c2db153fcdcfff913426d5dc6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_9c93d6b7cecbfe93c44cdef558f4ea83.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_d008da60180e31c57516389480f0c32f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefa5ad0>
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_24aa809c2db153fcdcfff913426d5dc6.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_24aa809c2db153fcdcfff913426d5dc6.jpg saved to cache
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab04bad6-1b62-5c0b-a8d7-887bd3f1f107
2026-03-30 10:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE34822> (referer: https://www.auto1.com/v1/car-details-view/KE34822/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA78695> (referer: https://www.auto1.com/v1/car-details-view/UA78695/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee484f50>
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_9c93d6b7cecbfe93c44cdef558f4ea83.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_9c93d6b7cecbfe93c44cdef558f4ea83.jpg saved to cache
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab04bad6-1b62-5c0b-a8d7-887bd3f1f107
2026-03-30 10:40:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41fdcd0>
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_d008da60180e31c57516389480f0c32f.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_d008da60180e31c57516389480f0c32f.jpg saved to cache
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab04bad6-1b62-5c0b-a8d7-887bd3f1f107
2026-03-30 10:40:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ebc7eff-6536-5b82-a332-3a91c5b608d6 with identifier: KE34822
2026-03-30 10:40:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ebc7eff-6536-5b82-a332-3a91c5b608d6 with scrape type 1
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1ebc7eff-6536-5b82-a332-3a91c5b608d6
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F01%252F7101b64acd52f2835546852bc4dcbc77%252Fpa%252FKE34822_f05b792b0f19473bcaef50528292eaea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_f05b792b0f19473bcaef50528292eaea.jpg already downloaded
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F01%252F7101b64acd52f2835546852bc4dcbc77%252Fpa%252FKE34822_0440fe99584df7b83e12cf1492f2e550.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_0440fe99584df7b83e12cf1492f2e550.jpg already downloaded
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F01%252F7101b64acd52f2835546852bc4dcbc77%252Fpa%252FKE34822_9626b487abfd424cedb878bb9fa3eafb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_9626b487abfd424cedb878bb9fa3eafb.jpg already downloaded
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F01%252F7101b64acd52f2835546852bc4dcbc77%252Fpa%252FKE34822_cfb68f03655bd25760ff42123718835c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_cfb68f03655bd25760ff42123718835c.jpg already downloaded
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F01%252F7101b64acd52f2835546852bc4dcbc77%252Fpa%252FKE34822_ed3e1ac7bf63329231af90529d2d374b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_ed3e1ac7bf63329231af90529d2d374b.jpg already downloaded
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F01%252F7101b64acd52f2835546852bc4dcbc77%252Fpa%252FKE34822_5111cb23fd92da9fc2c8b8bc5f57d633.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_5111cb23fd92da9fc2c8b8bc5f57d633.jpg already downloaded
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F01%252F7101b64acd52f2835546852bc4dcbc77%252Fpa%252FKE34822_54c9df9f0188f8b67966c7d4dbcd3a7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_54c9df9f0188f8b67966c7d4dbcd3a7d.jpg already downloaded
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F01%252F7101b64acd52f2835546852bc4dcbc77%252Fpa%252FKE34822_96872c7aff4fa945bda34766e87ce76f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_96872c7aff4fa945bda34766e87ce76f.jpg already downloaded
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F01%252F7101b64acd52f2835546852bc4dcbc77%252Fpa%252FKE34822_e2336c321e58d98c6673c4b59044f9dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_e2336c321e58d98c6673c4b59044f9dd.jpg already downloaded
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F01%252F7101b64acd52f2835546852bc4dcbc77%252Fpa%252FKE34822_87740f47978e95890103fe386783497e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_87740f47978e95890103fe386783497e.jpg already downloaded
2026-03-30 10:40:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ebc7eff-6536-5b82-a332-3a91c5b608d6, identifier: KE34822
2026-03-30 10:40:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f99f6295-d075-5f39-8a08-805f554f64e0 with identifier: UA78695
2026-03-30 10:40:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f99f6295-d075-5f39-8a08-805f554f64e0 with scrape type 1
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f99f6295-d075-5f39-8a08-805f554f64e0
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_9a880d2b7f0d4eb4e6b14a610029e84a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_9a880d2b7f0d4eb4e6b14a610029e84a.jpg not downloaded yet
2026-03-30 10:40:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ebc7eff-6536-5b82-a332-3a91c5b608d6 with identifier: KE34822
2026-03-30 10:40:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ebc7eff-6536-5b82-a332-3a91c5b608d6 with identifier: KE34822
2026-03-30 10:40:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ebc7eff-6536-5b82-a332-3a91c5b608d6 with identifier: KE34822 to the API
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KE34822>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:31:16Z',
 'fuel_type': 'petrol',
 'id': '1ebc7eff-6536-5b82-a332-3a91c5b608d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE34822',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 59151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_f05b792b0f19473bcaef50528292eaea.jpg',
                'https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_0440fe99584df7b83e12cf1492f2e550.jpg',
                'https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_9626b487abfd424cedb878bb9fa3eafb.jpg',
                'https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_cfb68f03655bd25760ff42123718835c.jpg',
                'https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_ed3e1ac7bf63329231af90529d2d374b.jpg',
                'https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_5111cb23fd92da9fc2c8b8bc5f57d633.jpg',
                'https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_54c9df9f0188f8b67966c7d4dbcd3a7d.jpg',
                'https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_96872c7aff4fa945bda34766e87ce76f.jpg',
                'https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_e2336c321e58d98c6673c4b59044f9dd.jpg',
                'https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_87740f47978e95890103fe386783497e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebc7eff-6536-5b82-a332-3a91c5b608d6/1ebc7eff-6536-5b82-a332-3a91c5b608d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_f05b792b0f19473bcaef50528292eaea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebc7eff-6536-5b82-a332-3a91c5b608d6/1ebc7eff-6536-5b82-a332-3a91c5b608d6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_0440fe99584df7b83e12cf1492f2e550.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebc7eff-6536-5b82-a332-3a91c5b608d6/1ebc7eff-6536-5b82-a332-3a91c5b608d6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_9626b487abfd424cedb878bb9fa3eafb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebc7eff-6536-5b82-a332-3a91c5b608d6/1ebc7eff-6536-5b82-a332-3a91c5b608d6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_cfb68f03655bd25760ff42123718835c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebc7eff-6536-5b82-a332-3a91c5b608d6/1ebc7eff-6536-5b82-a332-3a91c5b608d6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_ed3e1ac7bf63329231af90529d2d374b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebc7eff-6536-5b82-a332-3a91c5b608d6/1ebc7eff-6536-5b82-a332-3a91c5b608d6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_5111cb23fd92da9fc2c8b8bc5f57d633.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebc7eff-6536-5b82-a332-3a91c5b608d6/1ebc7eff-6536-5b82-a332-3a91c5b608d6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_54c9df9f0188f8b67966c7d4dbcd3a7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebc7eff-6536-5b82-a332-3a91c5b608d6/1ebc7eff-6536-5b82-a332-3a91c5b608d6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_96872c7aff4fa945bda34766e87ce76f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebc7eff-6536-5b82-a332-3a91c5b608d6/1ebc7eff-6536-5b82-a332-3a91c5b608d6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_e2336c321e58d98c6673c4b59044f9dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ebc7eff-6536-5b82-a332-3a91c5b608d6/1ebc7eff-6536-5b82-a332-3a91c5b608d6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/01/7101b64acd52f2835546852bc4dcbc77/pa/KE34822_87740f47978e95890103fe386783497e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE34822%27 HTTP/1.1" 200 None
2026-03-30 10:40:27 [auto1.de] INFO: Saving data for KE34822: {'created_time': 1774867227.932859, 'last_price_update_time': 1774867227.932871, 'auction_closing_time': 1774971076.0}
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE34822') HTTP/1.1" 204 0
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_42cd666814f514a352ae1edd1aa54a02.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_42cd666814f514a352ae1edd1aa54a02.jpg not downloaded yet
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_c1648f4212f5abf55dcf63dbace232a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_c1648f4212f5abf55dcf63dbace232a4.jpg not downloaded yet
2026-03-30 10:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM13759/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_c2ffabf2fabedacdc7aa462ef98e8c5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_c2ffabf2fabedacdc7aa462ef98e8c5d.jpg not downloaded yet
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_80f8cac356c025bd78125b763c30bdb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_80f8cac356c025bd78125b763c30bdb5.jpg not downloaded yet
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_afca9f02e9c480f4a430cfc069ce0e77.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_afca9f02e9c480f4a430cfc069ce0e77.jpg not downloaded yet
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_e251274762f3aaf175351bc4e3b0b615.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_e251274762f3aaf175351bc4e3b0b615.jpg not downloaded yet
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_20a1de92e08d3d054066271f86e8bc85.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_20a1de92e08d3d054066271f86e8bc85.jpg not downloaded yet
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_b9324c4572632c90f9440cf53ac239da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_b9324c4572632c90f9440cf53ac239da.jpg not downloaded yet
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_813de3528747b1f47d9aa9f8b59dc238.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_813de3528747b1f47d9aa9f8b59dc238.jpg not downloaded yet
2026-03-30 10:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_42cd666814f514a352ae1edd1aa54a02.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_47b08229f0564034e08e433a428feec1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_587987f1252d7b546ffa1f9cef0e1666.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_249003f96350072703af610141d0eabb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_063101eb0388da9f6d3fd639a2673808.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428fe90>
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_42cd666814f514a352ae1edd1aa54a02.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_42cd666814f514a352ae1edd1aa54a02.jpg saved to cache
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f99f6295-d075-5f39-8a08-805f554f64e0
2026-03-30 10:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_813de3528747b1f47d9aa9f8b59dc238.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef9e050>
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_47b08229f0564034e08e433a428feec1.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_47b08229f0564034e08e433a428feec1.jpg saved to cache
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab04bad6-1b62-5c0b-a8d7-887bd3f1f107
2026-03-30 10:40:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41f1f10>
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_587987f1252d7b546ffa1f9cef0e1666.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_587987f1252d7b546ffa1f9cef0e1666.jpg saved to cache
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab04bad6-1b62-5c0b-a8d7-887bd3f1f107
2026-03-30 10:40:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefded50>
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_249003f96350072703af610141d0eabb.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_249003f96350072703af610141d0eabb.jpg saved to cache
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab04bad6-1b62-5c0b-a8d7-887bd3f1f107
2026-03-30 10:40:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef47f50>
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_063101eb0388da9f6d3fd639a2673808.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_063101eb0388da9f6d3fd639a2673808.jpg saved to cache
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab04bad6-1b62-5c0b-a8d7-887bd3f1f107
2026-03-30 10:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_f03a2d6c5c4a4cd85cc831ad75a1af62.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA23365/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f425a7d0>
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_813de3528747b1f47d9aa9f8b59dc238.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_813de3528747b1f47d9aa9f8b59dc238.jpg saved to cache
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f99f6295-d075-5f39-8a08-805f554f64e0
2026-03-30 10:40:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3a890>
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_f03a2d6c5c4a4cd85cc831ad75a1af62.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_f03a2d6c5c4a4cd85cc831ad75a1af62.jpg saved to cache
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab04bad6-1b62-5c0b-a8d7-887bd3f1f107
2026-03-30 10:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_b9324c4572632c90f9440cf53ac239da.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_e251274762f3aaf175351bc4e3b0b615.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_afca9f02e9c480f4a430cfc069ce0e77.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_20a1de92e08d3d054066271f86e8bc85.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_80f8cac356c025bd78125b763c30bdb5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_c2ffabf2fabedacdc7aa462ef98e8c5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_9a880d2b7f0d4eb4e6b14a610029e84a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_c1648f4212f5abf55dcf63dbace232a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4170890>
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_b9324c4572632c90f9440cf53ac239da.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_b9324c4572632c90f9440cf53ac239da.jpg saved to cache
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f99f6295-d075-5f39-8a08-805f554f64e0
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef0e890>
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_e251274762f3aaf175351bc4e3b0b615.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_e251274762f3aaf175351bc4e3b0b615.jpg saved to cache
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f99f6295-d075-5f39-8a08-805f554f64e0
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef75190>
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_afca9f02e9c480f4a430cfc069ce0e77.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_afca9f02e9c480f4a430cfc069ce0e77.jpg saved to cache
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f99f6295-d075-5f39-8a08-805f554f64e0
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417e210>
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_20a1de92e08d3d054066271f86e8bc85.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_20a1de92e08d3d054066271f86e8bc85.jpg saved to cache
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f99f6295-d075-5f39-8a08-805f554f64e0
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee48390>
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_80f8cac356c025bd78125b763c30bdb5.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_80f8cac356c025bd78125b763c30bdb5.jpg saved to cache
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f99f6295-d075-5f39-8a08-805f554f64e0
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417f810>
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_c2ffabf2fabedacdc7aa462ef98e8c5d.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_c2ffabf2fabedacdc7aa462ef98e8c5d.jpg saved to cache
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f99f6295-d075-5f39-8a08-805f554f64e0
2026-03-30 10:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WZ29509> (referer: https://www.auto1.com/v1/car-details-view/WZ29509/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3db850>
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_9a880d2b7f0d4eb4e6b14a610029e84a.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_9a880d2b7f0d4eb4e6b14a610029e84a.jpg saved to cache
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f99f6295-d075-5f39-8a08-805f554f64e0
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e9cd0>
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd75d767fd97259a739b92ace7c2e61%252Fpa%252FUA78695_c1648f4212f5abf55dcf63dbace232a4.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_c1648f4212f5abf55dcf63dbace232a4.jpg saved to cache
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f99f6295-d075-5f39-8a08-805f554f64e0
2026-03-30 10:40:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f99f6295-d075-5f39-8a08-805f554f64e0, skipping ID generation
2026-03-30 10:40:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f99f6295-d075-5f39-8a08-805f554f64e0 with scrape type 1
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f99f6295-d075-5f39-8a08-805f554f64e0 sending to next pipeline
2026-03-30 10:40:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f99f6295-d075-5f39-8a08-805f554f64e0, identifier: UA78695
2026-03-30 10:40:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f99f6295-d075-5f39-8a08-805f554f64e0 with identifier: UA78695
2026-03-30 10:40:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f99f6295-d075-5f39-8a08-805f554f64e0 with identifier: UA78695
2026-03-30 10:40:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f99f6295-d075-5f39-8a08-805f554f64e0 with identifier: UA78695 to the API
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_c1648f4212f5abf55dcf63dbace232a4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:50:26Z',
 'fuel_type': 'petrol',
 'id': 'f99f6295-d075-5f39-8a08-805f554f64e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA78695',
 'listing': 'auction',
 'location': 'DE, Paderborn',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 51496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_9a880d2b7f0d4eb4e6b14a610029e84a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_42cd666814f514a352ae1edd1aa54a02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_c1648f4212f5abf55dcf63dbace232a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_c2ffabf2fabedacdc7aa462ef98e8c5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_80f8cac356c025bd78125b763c30bdb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_afca9f02e9c480f4a430cfc069ce0e77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_e251274762f3aaf175351bc4e3b0b615.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_20a1de92e08d3d054066271f86e8bc85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_b9324c4572632c90f9440cf53ac239da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f99f6295-d075-5f39-8a08-805f554f64e0/f99f6295-d075-5f39-8a08-805f554f64e0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd75d767fd97259a739b92ace7c2e61/pa/UA78695_813de3528747b1f47d9aa9f8b59dc238.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 Elective',
 'transmission': 'manual',
 'trim': 'Elective',
 'year': 2013}
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA78695%27 HTTP/1.1" 200 None
2026-03-30 10:40:31 [auto1.de] INFO: Saving data for UA78695: {'created_time': 1774867231.472853, 'last_price_update_time': 1774867231.472865, 'auction_closing_time': 1774972226.0}
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA78695') HTTP/1.1" 204 0
2026-03-30 10:40:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UW97572> (referer: https://www.auto1.com/v1/car-details-view/UW97572/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 679cc9d8-cb4b-5e93-884f-7e3cc7856dfa with identifier: WZ29509
2026-03-30 10:40:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 679cc9d8-cb4b-5e93-884f-7e3cc7856dfa with scrape type 1
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 679cc9d8-cb4b-5e93-884f-7e3cc7856dfa
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F63%252F77633783a1254c4884848af421ef29c1%252Fpa%252FWZ29509_4b332342ff63c5f0c83fd97f96106d2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_4b332342ff63c5f0c83fd97f96106d2b.jpg not downloaded yet
2026-03-30 10:40:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F63%252F77633783a1254c4884848af421ef29c1%252Fpa%252FWZ29509_fea4fa13d0ead8c1230cf9e465cc7644.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_fea4fa13d0ead8c1230cf9e465cc7644.jpg not downloaded yet
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F63%252F77633783a1254c4884848af421ef29c1%252Fpa%252FWZ29509_c80ca3880e16a6f8909bd10aa8e73b66.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_c80ca3880e16a6f8909bd10aa8e73b66.jpg not downloaded yet
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F63%252F77633783a1254c4884848af421ef29c1%252Fpa%252FWZ29509_5c0f31c51cca31440c66019ab6535759.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_5c0f31c51cca31440c66019ab6535759.jpg not downloaded yet
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F63%252F77633783a1254c4884848af421ef29c1%252Fpa%252FWZ29509_8e174add71b4ea8ccbe58bb72ff98fae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_8e174add71b4ea8ccbe58bb72ff98fae.jpg not downloaded yet
2026-03-30 10:40:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_87e9565b491ce98ab293522be88fba92.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 120558cf-1f69-591f-b0c2-12be38b3ed7e with identifier: UW97572
2026-03-30 10:40:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 120558cf-1f69-591f-b0c2-12be38b3ed7e with scrape type 1
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 120558cf-1f69-591f-b0c2-12be38b3ed7e
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F21%252Ffb211e724bc5bced8bbfcf95ed85d88c%252Fpa%252FUW97572_9fba7488c4474b9f42de5d99c9f94248.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_9fba7488c4474b9f42de5d99c9f94248.jpg already downloaded
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F21%252Ffb211e724bc5bced8bbfcf95ed85d88c%252Fpa%252FUW97572_5b6fb681b0935c9485886afcc1b7a75d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_5b6fb681b0935c9485886afcc1b7a75d.jpg already downloaded
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F21%252Ffb211e724bc5bced8bbfcf95ed85d88c%252Fpa%252FUW97572_49312cc4207798404c2bcecd12b83819.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_49312cc4207798404c2bcecd12b83819.jpg already downloaded
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F21%252Ffb211e724bc5bced8bbfcf95ed85d88c%252Fpa%252FUW97572_5f8b3e7f7d1c33be186f1bf9a99aaef7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_5f8b3e7f7d1c33be186f1bf9a99aaef7.jpg already downloaded
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F21%252Ffb211e724bc5bced8bbfcf95ed85d88c%252Fpa%252FUW97572_9165989406ade3c921fa3d57d3d44f2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_9165989406ade3c921fa3d57d3d44f2e.jpg already downloaded
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F21%252Ffb211e724bc5bced8bbfcf95ed85d88c%252Fpa%252FUW97572_fa6d756122b93541bbbd0cdd30e68357.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_fa6d756122b93541bbbd0cdd30e68357.jpg already downloaded
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F21%252Ffb211e724bc5bced8bbfcf95ed85d88c%252Fpa%252FUW97572_c05ef716f5120308f6d531dcf74bb9d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_c05ef716f5120308f6d531dcf74bb9d3.jpg already downloaded
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F21%252Ffb211e724bc5bced8bbfcf95ed85d88c%252Fpa%252FUW97572_dc48294585416d019a8b41af146494a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_dc48294585416d019a8b41af146494a7.jpg already downloaded
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F21%252Ffb211e724bc5bced8bbfcf95ed85d88c%252Fpa%252FUW97572_6fe951ed7c319060d2ec7d28e8a3d577.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_6fe951ed7c319060d2ec7d28e8a3d577.jpg already downloaded
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F21%252Ffb211e724bc5bced8bbfcf95ed85d88c%252Fpa%252FUW97572_765af879b0f5c2fb31414480463cdb84.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_765af879b0f5c2fb31414480463cdb84.jpg already downloaded
2026-03-30 10:40:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 120558cf-1f69-591f-b0c2-12be38b3ed7e, identifier: UW97572
2026-03-30 10:40:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 120558cf-1f69-591f-b0c2-12be38b3ed7e with identifier: UW97572
2026-03-30 10:40:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 120558cf-1f69-591f-b0c2-12be38b3ed7e with identifier: UW97572
2026-03-30 10:40:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 120558cf-1f69-591f-b0c2-12be38b3ed7e with identifier: UW97572 to the API
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UW97572>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:37:20Z',
 'fuel_type': 'diesel',
 'id': '120558cf-1f69-591f-b0c2-12be38b3ed7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW97572',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 102316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_9fba7488c4474b9f42de5d99c9f94248.jpg',
                'https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_5b6fb681b0935c9485886afcc1b7a75d.jpg',
                'https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_49312cc4207798404c2bcecd12b83819.jpg',
                'https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_5f8b3e7f7d1c33be186f1bf9a99aaef7.jpg',
                'https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_9165989406ade3c921fa3d57d3d44f2e.jpg',
                'https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_fa6d756122b93541bbbd0cdd30e68357.jpg',
                'https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_c05ef716f5120308f6d531dcf74bb9d3.jpg',
                'https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_dc48294585416d019a8b41af146494a7.jpg',
                'https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_6fe951ed7c319060d2ec7d28e8a3d577.jpg',
                'https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_765af879b0f5c2fb31414480463cdb84.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120558cf-1f69-591f-b0c2-12be38b3ed7e/120558cf-1f69-591f-b0c2-12be38b3ed7e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_9fba7488c4474b9f42de5d99c9f94248.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120558cf-1f69-591f-b0c2-12be38b3ed7e/120558cf-1f69-591f-b0c2-12be38b3ed7e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_5b6fb681b0935c9485886afcc1b7a75d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120558cf-1f69-591f-b0c2-12be38b3ed7e/120558cf-1f69-591f-b0c2-12be38b3ed7e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_49312cc4207798404c2bcecd12b83819.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120558cf-1f69-591f-b0c2-12be38b3ed7e/120558cf-1f69-591f-b0c2-12be38b3ed7e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_5f8b3e7f7d1c33be186f1bf9a99aaef7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120558cf-1f69-591f-b0c2-12be38b3ed7e/120558cf-1f69-591f-b0c2-12be38b3ed7e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_9165989406ade3c921fa3d57d3d44f2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120558cf-1f69-591f-b0c2-12be38b3ed7e/120558cf-1f69-591f-b0c2-12be38b3ed7e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_fa6d756122b93541bbbd0cdd30e68357.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120558cf-1f69-591f-b0c2-12be38b3ed7e/120558cf-1f69-591f-b0c2-12be38b3ed7e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_c05ef716f5120308f6d531dcf74bb9d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120558cf-1f69-591f-b0c2-12be38b3ed7e/120558cf-1f69-591f-b0c2-12be38b3ed7e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_dc48294585416d019a8b41af146494a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120558cf-1f69-591f-b0c2-12be38b3ed7e/120558cf-1f69-591f-b0c2-12be38b3ed7e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_6fe951ed7c319060d2ec7d28e8a3d577.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120558cf-1f69-591f-b0c2-12be38b3ed7e/120558cf-1f69-591f-b0c2-12be38b3ed7e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/21/fb211e724bc5bced8bbfcf95ed85d88c/pa/UW97572_765af879b0f5c2fb31414480463cdb84.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Energy Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2017}
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW97572%27 HTTP/1.1" 200 None
2026-03-30 10:40:32 [auto1.de] INFO: Saving data for UW97572: {'created_time': 1774867232.287788, 'last_price_update_time': 1774867232.2878, 'auction_closing_time': 1774971440.0}
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW97572') HTTP/1.1" 204 0
2026-03-30 10:40:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7fd90>
2026-03-30 10:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_87e9565b491ce98ab293522be88fba92.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_87e9565b491ce98ab293522be88fba92.jpg saved to cache
2026-03-30 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab04bad6-1b62-5c0b-a8d7-887bd3f1f107
2026-03-30 10:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_59f7a15d18076b783cc9371757a16d50.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:32 [auto1.de] INFO: Channel: 24h | Page: 17 | totalHits: 9437 | hits on page: 40
2026-03-30 10:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_8e174add71b4ea8ccbe58bb72ff98fae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC81161> (referer: https://www.auto1.com/v1/car-details-view/CC81161/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:32 [auto1.de] INFO: Found listing with ID: PU16523
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU16523%27 HTTP/1.1" 200 None
2026-03-30 10:40:32 [auto1.de] INFO: Scrape type for PU16523: 0
2026-03-30 10:40:32 [auto1.de] INFO: Found listing with ID: LB68583
2026-03-30 10:40:32 [auto1.de] INFO: Found listing with ID: CX98346
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX98346%27 HTTP/1.1" 200 None
2026-03-30 10:40:32 [auto1.de] INFO: Scrape type for CX98346: 1
2026-03-30 10:40:32 [auto1.de] INFO: Found listing with ID: JU91217
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU91217%27 HTTP/1.1" 200 None
2026-03-30 10:40:32 [auto1.de] INFO: Scrape type for JU91217: 2
2026-03-30 10:40:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d59031d4-4adb-535c-aa8f-770d0becb3cb with identifier: JU91217
2026-03-30 10:40:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d59031d4-4adb-535c-aa8f-770d0becb3cb with scrape type 2
2026-03-30 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d59031d4-4adb-535c-aa8f-770d0becb3cb with scrape type 2
2026-03-30 10:40:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d59031d4-4adb-535c-aa8f-770d0becb3cb, identifier: JU91217
2026-03-30 10:40:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d59031d4-4adb-535c-aa8f-770d0becb3cb with identifier: JU91217
2026-03-30 10:40:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d59031d4-4adb-535c-aa8f-770d0becb3cb with identifier: JU91217
2026-03-30 10:40:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d59031d4-4adb-535c-aa8f-770d0becb3cb with identifier: JU91217 to the API
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-31T15:19:46Z',
 'fuel_type': 'petrol',
 'id': 'd59031d4-4adb-535c-aa8f-770d0becb3cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU91217',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 139793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-20',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU91217%27 HTTP/1.1" 200 None
2026-03-30 10:40:32 [auto1.de] INFO: Saving data for JU91217: {'auction_closing_time': 1774970386.0, 'created_time': 1774294350.329011, 'last_price_update_time': 1774867232.944683}
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU91217') HTTP/1.1" 204 0
2026-03-30 10:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JP72611/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_5c0f31c51cca31440c66019ab6535759.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:32 [auto1.de] INFO: Found listing with ID: JG32491
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG32491%27 HTTP/1.1" 200 None
2026-03-30 10:40:32 [auto1.de] INFO: Scrape type for JG32491: 1
2026-03-30 10:40:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_fea4fa13d0ead8c1230cf9e465cc7644.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_c80ca3880e16a6f8909bd10aa8e73b66.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefb7cd0>
2026-03-30 10:40:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F96%252Fc196b3c9361de2e881cdbb8c5b0e1fe2%252Fpa%252FFZ11767_59f7a15d18076b783cc9371757a16d50.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_59f7a15d18076b783cc9371757a16d50.jpg saved to cache
2026-03-30 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab04bad6-1b62-5c0b-a8d7-887bd3f1f107
2026-03-30 10:40:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab04bad6-1b62-5c0b-a8d7-887bd3f1f107, skipping ID generation
2026-03-30 10:40:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab04bad6-1b62-5c0b-a8d7-887bd3f1f107 with scrape type 1
2026-03-30 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab04bad6-1b62-5c0b-a8d7-887bd3f1f107 sending to next pipeline
2026-03-30 10:40:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab04bad6-1b62-5c0b-a8d7-887bd3f1f107, identifier: FZ11767
2026-03-30 10:40:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8e7d0>
2026-03-30 10:40:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679cc9d8-cb4b-5e93-884f-7e3cc7856dfa/679cc9d8-cb4b-5e93-884f-7e3cc7856dfa_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F63%252F77633783a1254c4884848af421ef29c1%252Fpa%252FWZ29509_8e174add71b4ea8ccbe58bb72ff98fae.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_8e174add71b4ea8ccbe58bb72ff98fae.jpg saved to cache
2026-03-30 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 679cc9d8-cb4b-5e93-884f-7e3cc7856dfa
2026-03-30 10:40:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be34feb8-7a45-5af4-a1f5-2427e2b9c0bf with identifier: CC81161
2026-03-30 10:40:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be34feb8-7a45-5af4-a1f5-2427e2b9c0bf with scrape type 1
2026-03-30 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be34feb8-7a45-5af4-a1f5-2427e2b9c0bf
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff0%252F2bf081853373d84d22749b69a1e75e4b%252Fpa%252FCC81161_bc373587ca135000746403fac47a634b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_bc373587ca135000746403fac47a634b.jpg already downloaded
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff0%252F2bf081853373d84d22749b69a1e75e4b%252Fpa%252FCC81161_304a11179250aa0aa3a7f2a9a0b07f7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_304a11179250aa0aa3a7f2a9a0b07f7b.jpg already downloaded
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff0%252F2bf081853373d84d22749b69a1e75e4b%252Fpa%252FCC81161_adbcc69a0538bc6e1d9794b71066733e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_adbcc69a0538bc6e1d9794b71066733e.jpg already downloaded
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff0%252F2bf081853373d84d22749b69a1e75e4b%252Fpa%252FCC81161_63d2eea6f932dfc5968a3118eb7b8f87.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_63d2eea6f932dfc5968a3118eb7b8f87.jpg already downloaded
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff0%252F2bf081853373d84d22749b69a1e75e4b%252Fpa%252FCC81161_43a9934b56afe304b663f3fbfec82cc8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_43a9934b56afe304b663f3fbfec82cc8.jpg already downloaded
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff0%252F2bf081853373d84d22749b69a1e75e4b%252Fpa%252FCC81161_7c0ffa059c4f1211141e2972d6c32e26.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_7c0ffa059c4f1211141e2972d6c32e26.jpg already downloaded
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff0%252F2bf081853373d84d22749b69a1e75e4b%252Fpa%252FCC81161_e255465f77ae2be113f3a17022f530d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_e255465f77ae2be113f3a17022f530d1.jpg already downloaded
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff0%252F2bf081853373d84d22749b69a1e75e4b%252Fpa%252FCC81161_e7df86e3f723bbd07f03fe74577ae6e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_e7df86e3f723bbd07f03fe74577ae6e9.jpg already downloaded
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff0%252F2bf081853373d84d22749b69a1e75e4b%252Fpa%252FCC81161_82e14dc473907d0346067466e1d0744b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_82e14dc473907d0346067466e1d0744b.jpg already downloaded
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff0%252F2bf081853373d84d22749b69a1e75e4b%252Fpa%252FCC81161_0d46089963c7c355fae89a093c85ec55.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_0d46089963c7c355fae89a093c85ec55.jpg already downloaded
2026-03-30 10:40:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be34feb8-7a45-5af4-a1f5-2427e2b9c0bf, identifier: CC81161
2026-03-30 10:40:33 [auto1.de] INFO: Found listing with ID: GM30461
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM30461%27 HTTP/1.1" 200 None
2026-03-30 10:40:33 [auto1.de] INFO: Scrape type for GM30461: 2
2026-03-30 10:40:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54982c61-abc8-50c8-8493-1068e3eb8c81 with identifier: GM30461
2026-03-30 10:40:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54982c61-abc8-50c8-8493-1068e3eb8c81 with scrape type 2
2026-03-30 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54982c61-abc8-50c8-8493-1068e3eb8c81 with scrape type 2
2026-03-30 10:40:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54982c61-abc8-50c8-8493-1068e3eb8c81, identifier: GM30461
2026-03-30 10:40:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab04bad6-1b62-5c0b-a8d7-887bd3f1f107 with identifier: FZ11767
2026-03-30 10:40:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab04bad6-1b62-5c0b-a8d7-887bd3f1f107 with identifier: FZ11767
2026-03-30 10:40:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab04bad6-1b62-5c0b-a8d7-887bd3f1f107 with identifier: FZ11767 to the API
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_59f7a15d18076b783cc9371757a16d50.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '3.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:29:42Z',
 'fuel_type': 'petrol',
 'id': 'ab04bad6-1b62-5c0b-a8d7-887bd3f1f107',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ11767',
 'listing': 'auction',
 'location': 'DE, Mainz',
 'make': 'Mercedes-Benz',
 'model': 'SL-Klasse',
 'odometer': 94912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2757989,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_59f7a15d18076b783cc9371757a16d50.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2736075,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_87e9565b491ce98ab293522be88fba92.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2596038,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_249003f96350072703af610141d0eabb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2700855,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_063101eb0388da9f6d3fd639a2673808.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2538708,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_f03a2d6c5c4a4cd85cc831ad75a1af62.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2620322,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_587987f1252d7b546ffa1f9cef0e1666.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2748866,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_9c93d6b7cecbfe93c44cdef558f4ea83.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2694364,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_24aa809c2db153fcdcfff913426d5dc6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2668199,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_47b08229f0564034e08e433a428feec1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab04bad6-1b62-5c0b-a8d7-887bd3f1f107/ab04bad6-1b62-5c0b-a8d7-887bd3f1f107_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2667544,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/96/c196b3c9361de2e881cdbb8c5b0e1fe2/pa/FZ11767_d008da60180e31c57516389480f0c32f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1992-05-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz SL-Klasse SL 300',
 'transmission': 'automatic',
 'trim': '',
 'year': 1992}
2026-03-30 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ11767%27 HTTP/1.1" 200 None
2026-03-30 10:40:34 [auto1.de] INFO: Saving data for FZ11767: {'created_time': 1774867234.568115, 'last_price_update_time': 1774867234.568128, 'auction_closing_time': 1774970982.0}
2026-03-30 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ11767') HTTP/1.1" 204 0
2026-03-30 10:40:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be34feb8-7a45-5af4-a1f5-2427e2b9c0bf with identifier: CC81161
2026-03-30 10:40:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be34feb8-7a45-5af4-a1f5-2427e2b9c0bf with identifier: CC81161
2026-03-30 10:40:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be34feb8-7a45-5af4-a1f5-2427e2b9c0bf with identifier: CC81161 to the API
2026-03-30 10:40:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CC81161>
{'auction_title': '',
 'c_o_2_emission_value': 194,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 178,
 'expiration_date': '2026-03-31T15:27:20Z',
 'fuel_type': 'diesel',
 'id': 'be34feb8-7a45-5af4-a1f5-2427e2b9c0bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC81161',
 'listing': 'auction',
 'location': 'DE, Lüdenscheid',
 'make': 'Ssangyong',
 'model': 'Rexton',
 'odometer': 251995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_bc373587ca135000746403fac47a634b.jpg',
                'https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_304a11179250aa0aa3a7f2a9a0b07f7b.jpg',
                'https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_adbcc69a0538bc6e1d9794b71066733e.jpg',
                'https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_63d2eea6f932dfc5968a3118eb7b8f87.jpg',
                'https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_43a9934b56afe304b663f3fbfec82cc8.jpg',
                'https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_7c0ffa059c4f1211141e2972d6c32e26.jpg',
                'https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_e255465f77ae2be113f3a17022f530d1.jpg',
                'https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_e7df86e3f723bbd07f03fe74577ae6e9.jpg',
                'https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_82e14dc473907d0346067466e1d0744b.jpg',
                'https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_0d46089963c7c355fae89a093c85ec55.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be34feb8-7a45-5af4-a1f5-2427e2b9c0bf/be34feb8-7a45-5af4-a1f5-2427e2b9c0bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3307931,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_bc373587ca135000746403fac47a634b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be34feb8-7a45-5af4-a1f5-2427e2b9c0bf/be34feb8-7a45-5af4-a1f5-2427e2b9c0bf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_304a11179250aa0aa3a7f2a9a0b07f7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be34feb8-7a45-5af4-a1f5-2427e2b9c0bf/be34feb8-7a45-5af4-a1f5-2427e2b9c0bf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_adbcc69a0538bc6e1d9794b71066733e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be34feb8-7a45-5af4-a1f5-2427e2b9c0bf/be34feb8-7a45-5af4-a1f5-2427e2b9c0bf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_63d2eea6f932dfc5968a3118eb7b8f87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be34feb8-7a45-5af4-a1f5-2427e2b9c0bf/be34feb8-7a45-5af4-a1f5-2427e2b9c0bf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_43a9934b56afe304b663f3fbfec82cc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be34feb8-7a45-5af4-a1f5-2427e2b9c0bf/be34feb8-7a45-5af4-a1f5-2427e2b9c0bf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3302644,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_7c0ffa059c4f1211141e2972d6c32e26.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be34feb8-7a45-5af4-a1f5-2427e2b9c0bf/be34feb8-7a45-5af4-a1f5-2427e2b9c0bf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_e255465f77ae2be113f3a17022f530d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be34feb8-7a45-5af4-a1f5-2427e2b9c0bf/be34feb8-7a45-5af4-a1f5-2427e2b9c0bf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_e7df86e3f723bbd07f03fe74577ae6e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be34feb8-7a45-5af4-a1f5-2427e2b9c0bf/be34feb8-7a45-5af4-a1f5-2427e2b9c0bf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_82e14dc473907d0346067466e1d0744b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be34feb8-7a45-5af4-a1f5-2427e2b9c0bf/be34feb8-7a45-5af4-a1f5-2427e2b9c0bf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f0/2bf081853373d84d22749b69a1e75e4b/pa/CC81161_0d46089963c7c355fae89a093c85ec55.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ssangyong Rexton 2.2 TD Quartz 4x4',
 'transmission': 'automatic',
 'trim': 'Quartz 4x4',
 'year': 2017}
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC81161%27 HTTP/1.1" 200 None
2026-03-30 10:40:35 [auto1.de] INFO: Saving data for CC81161: {'created_time': 1774867235.051444, 'last_price_update_time': 1774867235.051456, 'auction_closing_time': 1774970840.0}
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC81161') HTTP/1.1" 204 0
2026-03-30 10:40:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54982c61-abc8-50c8-8493-1068e3eb8c81 with identifier: GM30461
2026-03-30 10:40:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54982c61-abc8-50c8-8493-1068e3eb8c81 with identifier: GM30461
2026-03-30 10:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54982c61-abc8-50c8-8493-1068e3eb8c81 with identifier: GM30461 to the API
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:05:54Z',
 'fuel_type': 'petrol',
 'id': '54982c61-abc8-50c8-8493-1068e3eb8c81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM30461',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 170222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-15',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 N-Tec',
 'transmission': 'manual',
 'trim': 'N-Tec',
 'year': 2016}
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM30461%27 HTTP/1.1" 200 None
2026-03-30 10:40:35 [auto1.de] INFO: Saving data for GM30461: {'auction_closing_time': 1774969554.0, 'created_time': 1773305133.600951, 'last_price_update_time': 1774867235.449666}
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM30461') HTTP/1.1" 204 0
2026-03-30 10:40:35 [auto1.de] INFO: Found listing with ID: AS52109
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS52109%27 HTTP/1.1" 200 None
2026-03-30 10:40:35 [auto1.de] INFO: Scrape type for AS52109: 2
2026-03-30 10:40:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dbfcca0-ce40-5d09-9037-2c1604c9ade5 with identifier: AS52109
2026-03-30 10:40:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dbfcca0-ce40-5d09-9037-2c1604c9ade5 with scrape type 2
2026-03-30 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dbfcca0-ce40-5d09-9037-2c1604c9ade5 with scrape type 2
2026-03-30 10:40:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0dbfcca0-ce40-5d09-9037-2c1604c9ade5, identifier: AS52109
2026-03-30 10:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NT58972> (referer: https://www.auto1.com/v1/car-details-view/NT58972/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4233b10>
2026-03-30 10:40:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679cc9d8-cb4b-5e93-884f-7e3cc7856dfa/679cc9d8-cb4b-5e93-884f-7e3cc7856dfa_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F63%252F77633783a1254c4884848af421ef29c1%252Fpa%252FWZ29509_5c0f31c51cca31440c66019ab6535759.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_5c0f31c51cca31440c66019ab6535759.jpg saved to cache
2026-03-30 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 679cc9d8-cb4b-5e93-884f-7e3cc7856dfa
2026-03-30 10:40:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee480510>
2026-03-30 10:40:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679cc9d8-cb4b-5e93-884f-7e3cc7856dfa/679cc9d8-cb4b-5e93-884f-7e3cc7856dfa_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F63%252F77633783a1254c4884848af421ef29c1%252Fpa%252FWZ29509_fea4fa13d0ead8c1230cf9e465cc7644.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_fea4fa13d0ead8c1230cf9e465cc7644.jpg saved to cache
2026-03-30 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 679cc9d8-cb4b-5e93-884f-7e3cc7856dfa
2026-03-30 10:40:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee442890>
2026-03-30 10:40:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679cc9d8-cb4b-5e93-884f-7e3cc7856dfa/679cc9d8-cb4b-5e93-884f-7e3cc7856dfa_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F63%252F77633783a1254c4884848af421ef29c1%252Fpa%252FWZ29509_c80ca3880e16a6f8909bd10aa8e73b66.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_c80ca3880e16a6f8909bd10aa8e73b66.jpg saved to cache
2026-03-30 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 679cc9d8-cb4b-5e93-884f-7e3cc7856dfa
2026-03-30 10:40:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0dbfcca0-ce40-5d09-9037-2c1604c9ade5 with identifier: AS52109
2026-03-30 10:40:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0dbfcca0-ce40-5d09-9037-2c1604c9ade5 with identifier: AS52109
2026-03-30 10:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0dbfcca0-ce40-5d09-9037-2c1604c9ade5 with identifier: AS52109 to the API
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:25:44Z',
 'fuel_type': 'petrol',
 'id': '0dbfcca0-ce40-5d09-9037-2c1604c9ade5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS52109',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 46678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-15',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2015}
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS52109%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [auto1.de] INFO: Saving data for AS52109: {'auction_closing_time': 1774970744.0, 'created_time': 1773773716.05624, 'last_price_update_time': 1774867236.210446}
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS52109') HTTP/1.1" 204 0
2026-03-30 10:40:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_cb757e76838911ae127a1e133eba5d37.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_4b332342ff63c5f0c83fd97f96106d2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: GX74523
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: SS39773
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: FF66514
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF66514%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [auto1.de] INFO: Scrape type for FF66514: 1
2026-03-30 10:40:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a407c1ee-5f3f-5de5-96b0-96866db47cf9 with identifier: NT58972
2026-03-30 10:40:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a407c1ee-5f3f-5de5-96b0-96866db47cf9 with scrape type 1
2026-03-30 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a407c1ee-5f3f-5de5-96b0-96866db47cf9
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Feb%252Faeeb85348ef4771ca45d2dbc72215217%252Fpa%252FNT58972_e70ada41d8d5d219576b531dbf69c85a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_e70ada41d8d5d219576b531dbf69c85a.jpg already downloaded
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Feb%252Faeeb85348ef4771ca45d2dbc72215217%252Fpa%252FNT58972_6a625eb4bf104ad28c3aad6b6c846edd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_6a625eb4bf104ad28c3aad6b6c846edd.jpg already downloaded
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Feb%252Faeeb85348ef4771ca45d2dbc72215217%252Fpa%252FNT58972_29a4c03aa99a99a0e45e1d3b67dc2a49.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_29a4c03aa99a99a0e45e1d3b67dc2a49.jpg already downloaded
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Feb%252Faeeb85348ef4771ca45d2dbc72215217%252Fpa%252FNT58972_9bd9d7555ecbcf68897a50ebee661da0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_9bd9d7555ecbcf68897a50ebee661da0.jpg already downloaded
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Feb%252Faeeb85348ef4771ca45d2dbc72215217%252Fpa%252FNT58972_9321a31ff67e98fd3b3c883efe6d0303.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_9321a31ff67e98fd3b3c883efe6d0303.jpg already downloaded
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Feb%252Faeeb85348ef4771ca45d2dbc72215217%252Fpa%252FNT58972_e9d385de025c53ec089932e01f98b03f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_e9d385de025c53ec089932e01f98b03f.jpg already downloaded
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Feb%252Faeeb85348ef4771ca45d2dbc72215217%252Fpa%252FNT58972_37b88e83cf70b83b50f565f23860f8b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_37b88e83cf70b83b50f565f23860f8b7.jpg already downloaded
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Feb%252Faeeb85348ef4771ca45d2dbc72215217%252Fpa%252FNT58972_823a62e9e13bf47590d82d18eff8e175.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_823a62e9e13bf47590d82d18eff8e175.jpg already downloaded
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Feb%252Faeeb85348ef4771ca45d2dbc72215217%252Fpa%252FNT58972_459036cc2f0e98212cf53052e31a9a59.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_459036cc2f0e98212cf53052e31a9a59.jpg already downloaded
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Feb%252Faeeb85348ef4771ca45d2dbc72215217%252Fpa%252FNT58972_b2cbb32b3e011873cbbfdfb4c439ddb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_b2cbb32b3e011873cbbfdfb4c439ddb1.jpg already downloaded
2026-03-30 10:40:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a407c1ee-5f3f-5de5-96b0-96866db47cf9, identifier: NT58972
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: XR67128
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: HP05192
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: JM60003
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM60003%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [auto1.de] INFO: Scrape type for JM60003: 1
2026-03-30 10:40:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a407c1ee-5f3f-5de5-96b0-96866db47cf9 with identifier: NT58972
2026-03-30 10:40:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a407c1ee-5f3f-5de5-96b0-96866db47cf9 with identifier: NT58972
2026-03-30 10:40:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a407c1ee-5f3f-5de5-96b0-96866db47cf9 with identifier: NT58972 to the API
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NT58972>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:36:16Z',
 'fuel_type': 'diesel',
 'id': 'a407c1ee-5f3f-5de5-96b0-96866db47cf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT58972',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 197968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_e70ada41d8d5d219576b531dbf69c85a.jpg',
                'https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_6a625eb4bf104ad28c3aad6b6c846edd.jpg',
                'https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_29a4c03aa99a99a0e45e1d3b67dc2a49.jpg',
                'https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_9bd9d7555ecbcf68897a50ebee661da0.jpg',
                'https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_9321a31ff67e98fd3b3c883efe6d0303.jpg',
                'https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_e9d385de025c53ec089932e01f98b03f.jpg',
                'https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_37b88e83cf70b83b50f565f23860f8b7.jpg',
                'https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_823a62e9e13bf47590d82d18eff8e175.jpg',
                'https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_459036cc2f0e98212cf53052e31a9a59.jpg',
                'https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_b2cbb32b3e011873cbbfdfb4c439ddb1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a407c1ee-5f3f-5de5-96b0-96866db47cf9/a407c1ee-5f3f-5de5-96b0-96866db47cf9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2191690,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_e70ada41d8d5d219576b531dbf69c85a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a407c1ee-5f3f-5de5-96b0-96866db47cf9/a407c1ee-5f3f-5de5-96b0-96866db47cf9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_6a625eb4bf104ad28c3aad6b6c846edd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a407c1ee-5f3f-5de5-96b0-96866db47cf9/a407c1ee-5f3f-5de5-96b0-96866db47cf9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2167236,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_29a4c03aa99a99a0e45e1d3b67dc2a49.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a407c1ee-5f3f-5de5-96b0-96866db47cf9/a407c1ee-5f3f-5de5-96b0-96866db47cf9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1906687,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_9bd9d7555ecbcf68897a50ebee661da0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a407c1ee-5f3f-5de5-96b0-96866db47cf9/a407c1ee-5f3f-5de5-96b0-96866db47cf9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2147710,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_9321a31ff67e98fd3b3c883efe6d0303.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a407c1ee-5f3f-5de5-96b0-96866db47cf9/a407c1ee-5f3f-5de5-96b0-96866db47cf9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_e9d385de025c53ec089932e01f98b03f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a407c1ee-5f3f-5de5-96b0-96866db47cf9/a407c1ee-5f3f-5de5-96b0-96866db47cf9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1871770,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_37b88e83cf70b83b50f565f23860f8b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a407c1ee-5f3f-5de5-96b0-96866db47cf9/a407c1ee-5f3f-5de5-96b0-96866db47cf9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_823a62e9e13bf47590d82d18eff8e175.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a407c1ee-5f3f-5de5-96b0-96866db47cf9/a407c1ee-5f3f-5de5-96b0-96866db47cf9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_459036cc2f0e98212cf53052e31a9a59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a407c1ee-5f3f-5de5-96b0-96866db47cf9/a407c1ee-5f3f-5de5-96b0-96866db47cf9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2168552,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/eb/aeeb85348ef4771ca45d2dbc72215217/pa/NT58972_b2cbb32b3e011873cbbfdfb4c439ddb1.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2016}
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT58972%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [auto1.de] INFO: Saving data for NT58972: {'created_time': 1774867237.192113, 'last_price_update_time': 1774867237.192125, 'auction_closing_time': 1774971376.0}
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT58972') HTTP/1.1" 204 0
2026-03-30 10:40:37 [auto1.de] INFO: Found listing with ID: JA61981
2026-03-30 10:40:37 [auto1.de] INFO: Found listing with ID: EU42545
2026-03-30 10:40:37 [auto1.de] INFO: Found listing with ID: DK17732
2026-03-30 10:40:37 [auto1.de] INFO: Found listing with ID: YL20348
2026-03-30 10:40:37 [auto1.de] INFO: Found listing with ID: YN89377
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN89377%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [auto1.de] INFO: Scrape type for YN89377: 1
2026-03-30 10:40:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_5657e8457c75507b72396d697207d791.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:37 [auto1.de] INFO: Found listing with ID: EC11597
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC11597%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [auto1.de] INFO: Scrape type for EC11597: 1
2026-03-30 10:40:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45f0d0>
2026-03-30 10:40:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_cb757e76838911ae127a1e133eba5d37.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_cb757e76838911ae127a1e133eba5d37.jpg saved to cache
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3654fb31-e3a6-5db9-a661-5d8b36abb97c
2026-03-30 10:40:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef1ae50>
2026-03-30 10:40:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679cc9d8-cb4b-5e93-884f-7e3cc7856dfa/679cc9d8-cb4b-5e93-884f-7e3cc7856dfa_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F63%252F77633783a1254c4884848af421ef29c1%252Fpa%252FWZ29509_4b332342ff63c5f0c83fd97f96106d2b.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_4b332342ff63c5f0c83fd97f96106d2b.jpg saved to cache
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 679cc9d8-cb4b-5e93-884f-7e3cc7856dfa
2026-03-30 10:40:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 679cc9d8-cb4b-5e93-884f-7e3cc7856dfa, skipping ID generation
2026-03-30 10:40:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 679cc9d8-cb4b-5e93-884f-7e3cc7856dfa with scrape type 1
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 679cc9d8-cb4b-5e93-884f-7e3cc7856dfa sending to next pipeline
2026-03-30 10:40:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 679cc9d8-cb4b-5e93-884f-7e3cc7856dfa, identifier: WZ29509
2026-03-30 10:40:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 679cc9d8-cb4b-5e93-884f-7e3cc7856dfa with identifier: WZ29509
2026-03-30 10:40:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 679cc9d8-cb4b-5e93-884f-7e3cc7856dfa with identifier: WZ29509
2026-03-30 10:40:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 679cc9d8-cb4b-5e93-884f-7e3cc7856dfa with identifier: WZ29509 to the API
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_4b332342ff63c5f0c83fd97f96106d2b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:20:55Z',
 'fuel_type': 'diesel',
 'id': '679cc9d8-cb4b-5e93-884f-7e3cc7856dfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ29509',
 'listing': 'auction',
 'location': 'DE, Itzehoe',
 'make': 'Mazda',
 'model': '6',
 'odometer': 242885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679cc9d8-cb4b-5e93-884f-7e3cc7856dfa/679cc9d8-cb4b-5e93-884f-7e3cc7856dfa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_4b332342ff63c5f0c83fd97f96106d2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679cc9d8-cb4b-5e93-884f-7e3cc7856dfa/679cc9d8-cb4b-5e93-884f-7e3cc7856dfa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_fea4fa13d0ead8c1230cf9e465cc7644.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679cc9d8-cb4b-5e93-884f-7e3cc7856dfa/679cc9d8-cb4b-5e93-884f-7e3cc7856dfa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_c80ca3880e16a6f8909bd10aa8e73b66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679cc9d8-cb4b-5e93-884f-7e3cc7856dfa/679cc9d8-cb4b-5e93-884f-7e3cc7856dfa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_5c0f31c51cca31440c66019ab6535759.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679cc9d8-cb4b-5e93-884f-7e3cc7856dfa/679cc9d8-cb4b-5e93-884f-7e3cc7856dfa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/63/77633783a1254c4884848af421ef29c1/pa/WZ29509_8e174add71b4ea8ccbe58bb72ff98fae.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel CRDT Center-Line',
 'transmission': 'manual',
 'trim': 'CRDT Center-Line',
 'year': 2012}
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ29509%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [auto1.de] INFO: Saving data for WZ29509: {'created_time': 1774867237.866219, 'last_price_update_time': 1774867237.86623, 'auction_closing_time': 1774970455.0}
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ29509') HTTP/1.1" 204 0
2026-03-30 10:40:37 [auto1.de] INFO: Found listing with ID: JH14903
2026-03-30 10:40:37 [auto1.de] INFO: Found listing with ID: NS27830
2026-03-30 10:40:37 [auto1.de] INFO: Found listing with ID: PG39438
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG39438%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [auto1.de] INFO: Scrape type for PG39438: 2
2026-03-30 10:40:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91026042-85bf-5249-aeba-3f0afaa1aba8 with identifier: PG39438
2026-03-30 10:40:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91026042-85bf-5249-aeba-3f0afaa1aba8 with scrape type 2
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91026042-85bf-5249-aeba-3f0afaa1aba8 with scrape type 2
2026-03-30 10:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91026042-85bf-5249-aeba-3f0afaa1aba8, identifier: PG39438
2026-03-30 10:40:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91026042-85bf-5249-aeba-3f0afaa1aba8 with identifier: PG39438
2026-03-30 10:40:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91026042-85bf-5249-aeba-3f0afaa1aba8 with identifier: PG39438
2026-03-30 10:40:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91026042-85bf-5249-aeba-3f0afaa1aba8 with identifier: PG39438 to the API
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:47:57Z',
 'fuel_type': 'petrol',
 'id': '91026042-85bf-5249-aeba-3f0afaa1aba8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG39438',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 151909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-26',
 'seller_name': None,
 'title': 'Seat Leon 1.8 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2015}
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG39438%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [auto1.de] INFO: Saving data for PG39438: {'auction_closing_time': 1774972077.0, 'created_time': 1773344804.620617, 'last_price_update_time': 1774867238.565401}
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG39438') HTTP/1.1" 204 0
2026-03-30 10:40:38 [auto1.de] INFO: Found listing with ID: UK98474
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK98474%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [auto1.de] INFO: Scrape type for UK98474: 1
2026-03-30 10:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU80356/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee441790>
2026-03-30 10:40:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_5657e8457c75507b72396d697207d791.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_5657e8457c75507b72396d697207d791.jpg saved to cache
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3654fb31-e3a6-5db9-a661-5d8b36abb97c
2026-03-30 10:40:38 [auto1.de] INFO: Found listing with ID: AR54418
2026-03-30 10:40:38 [auto1.de] INFO: Found listing with ID: HD45334
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD45334%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [auto1.de] INFO: Scrape type for HD45334: 1
2026-03-30 10:40:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU61041/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_83dee00d8c6cfdb52d43016f83433375.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:38 [auto1.de] INFO: Found listing with ID: JN68320
2026-03-30 10:40:38 [auto1.de] INFO: Found listing with ID: RP65650
2026-03-30 10:40:38 [auto1.de] INFO: Found listing with ID: GD36991
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD36991%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [auto1.de] INFO: Scrape type for GD36991: 1
2026-03-30 10:40:38 [auto1.de] INFO: Found listing with ID: AW88873
2026-03-30 10:40:38 [auto1.de] INFO: Found listing with ID: PJ55478
2026-03-30 10:40:38 [auto1.de] INFO: Found listing with ID: AS73684
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS73684%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [auto1.de] INFO: Scrape type for AS73684: 1
2026-03-30 10:40:38 [auto1.de] INFO: Found listing with ID: VM58526
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM58526%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [auto1.de] INFO: Scrape type for VM58526: 2
2026-03-30 10:40:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b41ea3c-ccd0-53f4-8814-96787e7629c5 with identifier: VM58526
2026-03-30 10:40:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b41ea3c-ccd0-53f4-8814-96787e7629c5 with scrape type 2
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b41ea3c-ccd0-53f4-8814-96787e7629c5 with scrape type 2
2026-03-30 10:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b41ea3c-ccd0-53f4-8814-96787e7629c5, identifier: VM58526
2026-03-30 10:40:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b41ea3c-ccd0-53f4-8814-96787e7629c5 with identifier: VM58526
2026-03-30 10:40:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b41ea3c-ccd0-53f4-8814-96787e7629c5 with identifier: VM58526
2026-03-30 10:40:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b41ea3c-ccd0-53f4-8814-96787e7629c5 with identifier: VM58526 to the API
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:22:26Z',
 'fuel_type': 'petrol',
 'id': '2b41ea3c-ccd0-53f4-8814-96787e7629c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM58526',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 141194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-26',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Drive',
 'transmission': 'automatic',
 'trim': 'Drive',
 'year': 2017}
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM58526%27 HTTP/1.1" 200 None
2026-03-30 10:40:39 [auto1.de] INFO: Saving data for VM58526: {'auction_closing_time': 1774970546.0, 'created_time': 1773135539.578931, 'last_price_update_time': 1774867239.547752}
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VM58526') HTTP/1.1" 204 0
2026-03-30 10:40:39 [auto1.de] INFO: Found listing with ID: TR40725
2026-03-30 10:40:39 [auto1.de] INFO: Found listing with ID: HT98852
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT98852%27 HTTP/1.1" 200 None
2026-03-30 10:40:39 [auto1.de] INFO: Scrape type for HT98852: 2
2026-03-30 10:40:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cbe8e02-c86b-580c-93a2-2a7845cc7452 with identifier: HT98852
2026-03-30 10:40:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cbe8e02-c86b-580c-93a2-2a7845cc7452 with scrape type 2
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cbe8e02-c86b-580c-93a2-2a7845cc7452 with scrape type 2
2026-03-30 10:40:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7cbe8e02-c86b-580c-93a2-2a7845cc7452, identifier: HT98852
2026-03-30 10:40:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7cbe8e02-c86b-580c-93a2-2a7845cc7452 with identifier: HT98852
2026-03-30 10:40:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7cbe8e02-c86b-580c-93a2-2a7845cc7452 with identifier: HT98852
2026-03-30 10:40:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7cbe8e02-c86b-580c-93a2-2a7845cc7452 with identifier: HT98852 to the API
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:49:05Z',
 'fuel_type': 'diesel',
 'id': '7cbe8e02-c86b-580c-93a2-2a7845cc7452',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT98852',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 202074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-15',
 'seller_name': None,
 'title': 'Peugeot 508 2.0 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2015}
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT98852%27 HTTP/1.1" 200 None
2026-03-30 10:40:40 [auto1.de] INFO: Saving data for HT98852: {'auction_closing_time': 1774972145.0, 'created_time': 1774294448.311101, 'last_price_update_time': 1774867240.967584}
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT98852') HTTP/1.1" 204 0
2026-03-30 10:40:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee42abd0>
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_83dee00d8c6cfdb52d43016f83433375.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_83dee00d8c6cfdb52d43016f83433375.jpg saved to cache
2026-03-30 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40d7c578-c4b1-55ed-bc33-15175e40b0d2
2026-03-30 10:40:41 [auto1.de] INFO: Found listing with ID: JK85727
2026-03-30 10:40:41 [auto1.de] INFO: Found listing with ID: AR37837
2026-03-30 10:40:41 [auto1.de] INFO: Found listing with ID: CV38607
2026-03-30 10:40:41 [auto1.de] INFO: Found listing with ID: DG14752
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG14752%27 HTTP/1.1" 200 None
2026-03-30 10:40:41 [auto1.de] INFO: Scrape type for DG14752: 1
2026-03-30 10:40:41 [auto1.de] INFO: Found listing with ID: VK28848
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK28848%27 HTTP/1.1" 200 None
2026-03-30 10:40:41 [auto1.de] INFO: Scrape type for VK28848: 2
2026-03-30 10:40:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a3faea1-5c47-5673-be47-7197f775d1b1 with identifier: VK28848
2026-03-30 10:40:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a3faea1-5c47-5673-be47-7197f775d1b1 with scrape type 2
2026-03-30 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a3faea1-5c47-5673-be47-7197f775d1b1 with scrape type 2
2026-03-30 10:40:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a3faea1-5c47-5673-be47-7197f775d1b1, identifier: VK28848
2026-03-30 10:40:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a3faea1-5c47-5673-be47-7197f775d1b1 with identifier: VK28848
2026-03-30 10:40:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a3faea1-5c47-5673-be47-7197f775d1b1 with identifier: VK28848
2026-03-30 10:40:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a3faea1-5c47-5673-be47-7197f775d1b1 with identifier: VK28848 to the API
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:12:59Z',
 'fuel_type': 'diesel',
 'id': '8a3faea1-5c47-5673-be47-7197f775d1b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK28848',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 48580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-26',
 'seller_name': None,
 'title': 'BMW 2er 220d Gran Coupe Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2023}
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK28848%27 HTTP/1.1" 200 None
2026-03-30 10:40:41 [auto1.de] INFO: Saving data for VK28848: {'auction_closing_time': 1774969979.0, 'created_time': 1773302822.225183, 'last_price_update_time': 1774867241.561381}
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK28848') HTTP/1.1" 204 0
2026-03-30 10:40:41 [auto1.de] INFO: Found listing with ID: FW45589
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW45589%27 HTTP/1.1" 200 None
2026-03-30 10:40:41 [auto1.de] INFO: Scrape type for FW45589: 1
2026-03-30 10:40:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_4c19d6ecbdf2dc72023d0957f1e7268b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41fd550>
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_4c19d6ecbdf2dc72023d0957f1e7268b.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_4c19d6ecbdf2dc72023d0957f1e7268b.jpg saved to cache
2026-03-30 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40d7c578-c4b1-55ed-bc33-15175e40b0d2
2026-03-30 10:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:42 [auto1.de] INFO: Channel: 24h | Page: 18 | totalHits: 9438 | hits on page: 40
2026-03-30 10:40:42 [auto1.de] INFO: Found listing with ID: FW45589
2026-03-30 10:40:42 [auto1.de] INFO: Found listing with ID: DP77092
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP77092%27 HTTP/1.1" 200 None
2026-03-30 10:40:42 [auto1.de] INFO: Scrape type for DP77092: 2
2026-03-30 10:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9760fbe-98b2-5727-b78c-433f50e8e15b with identifier: DP77092
2026-03-30 10:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9760fbe-98b2-5727-b78c-433f50e8e15b with scrape type 2
2026-03-30 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9760fbe-98b2-5727-b78c-433f50e8e15b with scrape type 2
2026-03-30 10:40:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9760fbe-98b2-5727-b78c-433f50e8e15b, identifier: DP77092
2026-03-30 10:40:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9760fbe-98b2-5727-b78c-433f50e8e15b with identifier: DP77092
2026-03-30 10:40:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9760fbe-98b2-5727-b78c-433f50e8e15b with identifier: DP77092
2026-03-30 10:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9760fbe-98b2-5727-b78c-433f50e8e15b with identifier: DP77092 to the API
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:35:09Z',
 'fuel_type': 'diesel',
 'id': 'e9760fbe-98b2-5727-b78c-433f50e8e15b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP77092',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 233632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-02',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D4 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2014}
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP77092%27 HTTP/1.1" 200 None
2026-03-30 10:40:42 [auto1.de] INFO: Saving data for DP77092: {'auction_closing_time': 1774971309.0, 'created_time': 1773688488.767519, 'last_price_update_time': 1774867242.926535}
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP77092') HTTP/1.1" 204 0
2026-03-30 10:40:42 [auto1.de] INFO: Found listing with ID: RT97145
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT97145%27 HTTP/1.1" 200 None
2026-03-30 10:40:42 [auto1.de] INFO: Scrape type for RT97145: 1
2026-03-30 10:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA23365> (referer: https://www.auto1.com/v1/car-details-view/DA23365/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BF55628/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:42 [auto1.de] INFO: Found listing with ID: YM37880
2026-03-30 10:40:42 [auto1.de] INFO: Found listing with ID: VL31583
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL31583%27 HTTP/1.1" 200 None
2026-03-30 10:40:42 [auto1.de] INFO: Scrape type for VL31583: 2
2026-03-30 10:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f91dd5d5-8fbc-5377-bc03-dc6f32023942 with identifier: VL31583
2026-03-30 10:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f91dd5d5-8fbc-5377-bc03-dc6f32023942 with scrape type 2
2026-03-30 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f91dd5d5-8fbc-5377-bc03-dc6f32023942 with scrape type 2
2026-03-30 10:40:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f91dd5d5-8fbc-5377-bc03-dc6f32023942, identifier: VL31583
2026-03-30 10:40:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f91dd5d5-8fbc-5377-bc03-dc6f32023942 with identifier: VL31583
2026-03-30 10:40:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f91dd5d5-8fbc-5377-bc03-dc6f32023942 with identifier: VL31583
2026-03-30 10:40:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f91dd5d5-8fbc-5377-bc03-dc6f32023942 with identifier: VL31583 to the API
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 457,
 'expiration_date': '2026-03-31T15:15:38Z',
 'fuel_type': 'petrol',
 'id': 'f91dd5d5-8fbc-5377-bc03-dc6f32023942',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL31583',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 112125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-14',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 53 AMG Mild-Hybrid 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2019}
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL31583%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [auto1.de] INFO: Saving data for VL31583: {'auction_closing_time': 1774970138.0, 'created_time': 1773773685.46517, 'last_price_update_time': 1774867243.378012}
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL31583') HTTP/1.1" 204 0
2026-03-30 10:40:43 [auto1.de] INFO: Found listing with ID: JB74437
2026-03-30 10:40:43 [auto1.de] INFO: Found listing with ID: BX70852
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX70852%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [auto1.de] INFO: Scrape type for BX70852: 1
2026-03-30 10:40:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40a28f27-542a-5231-9511-1da844e4fb9b with identifier: DA23365
2026-03-30 10:40:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a28f27-542a-5231-9511-1da844e4fb9b with scrape type 1
2026-03-30 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40a28f27-542a-5231-9511-1da844e4fb9b
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_bb1ebb5921fd6bd9f7916a562ba18270.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_bb1ebb5921fd6bd9f7916a562ba18270.jpg not downloaded yet
2026-03-30 10:40:43 [auto1.de] INFO: Found listing with ID: AJ81132
2026-03-30 10:40:43 [auto1.de] INFO: Found listing with ID: UL45474
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL45474%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [auto1.de] INFO: Scrape type for UL45474: 1
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_46b744530eded5183897887c962d4216.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_46b744530eded5183897887c962d4216.jpg not downloaded yet
2026-03-30 10:40:43 [auto1.de] INFO: Found listing with ID: RZ67892
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ67892%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [auto1.de] INFO: Scrape type for RZ67892: 1
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_d4034727ec0c278bf98970318e7bb81a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_d4034727ec0c278bf98970318e7bb81a.jpg not downloaded yet
2026-03-30 10:40:43 [auto1.de] INFO: Found listing with ID: WH06926
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH06926%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [auto1.de] INFO: Scrape type for WH06926: 1
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_73bea01ba0f95f31ca97f1a6797783d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_73bea01ba0f95f31ca97f1a6797783d4.jpg not downloaded yet
2026-03-30 10:40:43 [auto1.de] INFO: Found listing with ID: CU85166
2026-03-30 10:40:43 [auto1.de] INFO: Found listing with ID: AD23421
2026-03-30 10:40:43 [auto1.de] INFO: Found listing with ID: NP43212
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP43212%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [auto1.de] INFO: Scrape type for NP43212: 2
2026-03-30 10:40:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8353eca-7975-5fdc-af33-363050e18f79 with identifier: NP43212
2026-03-30 10:40:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8353eca-7975-5fdc-af33-363050e18f79 with scrape type 2
2026-03-30 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8353eca-7975-5fdc-af33-363050e18f79 with scrape type 2
2026-03-30 10:40:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8353eca-7975-5fdc-af33-363050e18f79, identifier: NP43212
2026-03-30 10:40:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8353eca-7975-5fdc-af33-363050e18f79 with identifier: NP43212
2026-03-30 10:40:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8353eca-7975-5fdc-af33-363050e18f79 with identifier: NP43212
2026-03-30 10:40:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8353eca-7975-5fdc-af33-363050e18f79 with identifier: NP43212 to the API
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-31T15:37:55Z',
 'fuel_type': 'petrol',
 'id': 'b8353eca-7975-5fdc-af33-363050e18f79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP43212',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 56068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-06',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 Essentiel',
 'transmission': 'manual',
 'trim': 'Essentiel',
 'year': 2017}
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP43212%27 HTTP/1.1" 200 None
2026-03-30 10:40:44 [auto1.de] INFO: Saving data for NP43212: {'auction_closing_time': 1774971475.0, 'created_time': 1773304584.749547, 'last_price_update_time': 1774867244.101101}
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP43212') HTTP/1.1" 204 0
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_1f1235b4c0f011a5dd430dd0d6a6188e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_1f1235b4c0f011a5dd430dd0d6a6188e.jpg not downloaded yet
2026-03-30 10:40:44 [auto1.de] INFO: Found listing with ID: UV35229
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV35229%27 HTTP/1.1" 200 None
2026-03-30 10:40:44 [auto1.de] INFO: Scrape type for UV35229: 2
2026-03-30 10:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23239d76-cae3-5bbf-9d56-eb6ea509884f with identifier: UV35229
2026-03-30 10:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23239d76-cae3-5bbf-9d56-eb6ea509884f with scrape type 2
2026-03-30 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23239d76-cae3-5bbf-9d56-eb6ea509884f with scrape type 2
2026-03-30 10:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23239d76-cae3-5bbf-9d56-eb6ea509884f, identifier: UV35229
2026-03-30 10:40:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23239d76-cae3-5bbf-9d56-eb6ea509884f with identifier: UV35229
2026-03-30 10:40:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23239d76-cae3-5bbf-9d56-eb6ea509884f with identifier: UV35229
2026-03-30 10:40:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23239d76-cae3-5bbf-9d56-eb6ea509884f with identifier: UV35229 to the API
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:00:56Z',
 'fuel_type': 'diesel',
 'id': '23239d76-cae3-5bbf-9d56-eb6ea509884f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV35229',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 242236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-12',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 3.0 CDI lang BlueEfficiency Ambiente Edition',
 'transmission': 'automatic',
 'trim': 'lang BlueEfficiency Ambiente Edition',
 'year': 2011}
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV35229%27 HTTP/1.1" 200 None
2026-03-30 10:40:44 [auto1.de] INFO: Saving data for UV35229: {'auction_closing_time': 1774969256.0, 'created_time': 1774294187.491195, 'last_price_update_time': 1774867244.604501}
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV35229') HTTP/1.1" 204 0
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_0c24529ef1037e515fa7664494892361.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_0c24529ef1037e515fa7664494892361.jpg not downloaded yet
2026-03-30 10:40:44 [auto1.de] INFO: Found listing with ID: JM46671
2026-03-30 10:40:44 [auto1.de] INFO: Found listing with ID: YJ94163
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ94163%27 HTTP/1.1" 200 None
2026-03-30 10:40:44 [auto1.de] INFO: Scrape type for YJ94163: 2
2026-03-30 10:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26a719ff-4142-51ca-b31b-cc7996b7f141 with identifier: YJ94163
2026-03-30 10:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26a719ff-4142-51ca-b31b-cc7996b7f141 with scrape type 2
2026-03-30 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26a719ff-4142-51ca-b31b-cc7996b7f141 with scrape type 2
2026-03-30 10:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26a719ff-4142-51ca-b31b-cc7996b7f141, identifier: YJ94163
2026-03-30 10:40:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26a719ff-4142-51ca-b31b-cc7996b7f141 with identifier: YJ94163
2026-03-30 10:40:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26a719ff-4142-51ca-b31b-cc7996b7f141 with identifier: YJ94163
2026-03-30 10:40:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26a719ff-4142-51ca-b31b-cc7996b7f141 with identifier: YJ94163 to the API
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 71,
 'expiration_date': '2026-03-31T15:27:25Z',
 'fuel_type': 'petrol',
 'id': '26a719ff-4142-51ca-b31b-cc7996b7f141',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ94163',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 25559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-21',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.2 Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2022}
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ94163%27 HTTP/1.1" 200 None
2026-03-30 10:40:45 [auto1.de] INFO: Saving data for YJ94163: {'auction_closing_time': 1774970845.0, 'created_time': 1774294687.624967, 'last_price_update_time': 1774867245.188115}
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ94163') HTTP/1.1" 204 0
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_1893dab4162b07e9dcf4f453d8db8990.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_1893dab4162b07e9dcf4f453d8db8990.jpg not downloaded yet
2026-03-30 10:40:45 [auto1.de] INFO: Found listing with ID: ZA52966
2026-03-30 10:40:45 [auto1.de] INFO: Found listing with ID: PK53394
2026-03-30 10:40:45 [auto1.de] INFO: Found listing with ID: UV59286
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV59286%27 HTTP/1.1" 200 None
2026-03-30 10:40:45 [auto1.de] INFO: Scrape type for UV59286: 2
2026-03-30 10:40:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e08c5f4a-c3a2-5fe5-8146-b98357267794 with identifier: UV59286
2026-03-30 10:40:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e08c5f4a-c3a2-5fe5-8146-b98357267794 with scrape type 2
2026-03-30 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e08c5f4a-c3a2-5fe5-8146-b98357267794 with scrape type 2
2026-03-30 10:40:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e08c5f4a-c3a2-5fe5-8146-b98357267794, identifier: UV59286
2026-03-30 10:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX98346/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e08c5f4a-c3a2-5fe5-8146-b98357267794 with identifier: UV59286
2026-03-30 10:40:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e08c5f4a-c3a2-5fe5-8146-b98357267794 with identifier: UV59286
2026-03-30 10:40:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e08c5f4a-c3a2-5fe5-8146-b98357267794 with identifier: UV59286 to the API
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 283,
 'expiration_date': '2026-03-31T15:31:50Z',
 'fuel_type': 'hybrid',
 'id': 'e08c5f4a-c3a2-5fe5-8146-b98357267794',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV59286',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 221723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-24',
 'seller_name': None,
 'title': 'Volvo V60 2.4 D6 Plug-in Hybrid Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2013}
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV59286%27 HTTP/1.1" 200 None
2026-03-30 10:40:45 [auto1.de] INFO: Saving data for UV59286: {'auction_closing_time': 1774971110.0, 'created_time': 1773308286.904663, 'last_price_update_time': 1774867245.950082}
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV59286') HTTP/1.1" 204 0
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_c2461fbbd103c7dc9de8fd11cfcee060.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_c2461fbbd103c7dc9de8fd11cfcee060.jpg not downloaded yet
2026-03-30 10:40:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:45 [auto1.de] INFO: Found listing with ID: WT13361
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT13361%27 HTTP/1.1" 200 None
2026-03-30 10:40:46 [auto1.de] INFO: Scrape type for WT13361: 1
2026-03-30 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM13759> (referer: https://www.auto1.com/v1/car-details-view/MM13759/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_6ba58670e670dd0868f047f2169bdefc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_6ba58670e670dd0868f047f2169bdefc.jpg not downloaded yet
2026-03-30 10:40:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JP72611> (referer: https://www.auto1.com/v1/car-details-view/JP72611/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:46 [auto1.de] INFO: Found listing with ID: DL10324
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL10324%27 HTTP/1.1" 200 None
2026-03-30 10:40:46 [auto1.de] INFO: Scrape type for DL10324: 1
2026-03-30 10:40:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_1017b52df601dc16a4833e271f666617.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_1017b52df601dc16a4833e271f666617.jpg not downloaded yet
2026-03-30 10:40:46 [auto1.de] INFO: Found listing with ID: JK71664
2026-03-30 10:40:46 [auto1.de] INFO: Found listing with ID: YV49543
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV49543%27 HTTP/1.1" 200 None
2026-03-30 10:40:46 [auto1.de] INFO: Scrape type for YV49543: 1
2026-03-30 10:40:46 [auto1.de] INFO: Found listing with ID: SX45825
2026-03-30 10:40:46 [auto1.de] INFO: Found listing with ID: MD17781
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD17781%27 HTTP/1.1" 200 None
2026-03-30 10:40:46 [auto1.de] INFO: Scrape type for MD17781: 1
2026-03-30 10:40:46 [auto1.de] INFO: Found listing with ID: XM95043
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM95043%27 HTTP/1.1" 200 None
2026-03-30 10:40:46 [auto1.de] INFO: Scrape type for XM95043: 1
2026-03-30 10:40:46 [auto1.de] INFO: Found listing with ID: BX85596
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX85596%27 HTTP/1.1" 200 None
2026-03-30 10:40:46 [auto1.de] INFO: Scrape type for BX85596: 2
2026-03-30 10:40:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b5d1519-cbb6-5217-8475-fdc1cd3f636f with identifier: BX85596
2026-03-30 10:40:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b5d1519-cbb6-5217-8475-fdc1cd3f636f with scrape type 2
2026-03-30 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b5d1519-cbb6-5217-8475-fdc1cd3f636f with scrape type 2
2026-03-30 10:40:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b5d1519-cbb6-5217-8475-fdc1cd3f636f, identifier: BX85596
2026-03-30 10:40:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d40773be-b764-5bc1-bf4e-84c2f003e6e6 with identifier: MM13759
2026-03-30 10:40:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d40773be-b764-5bc1-bf4e-84c2f003e6e6 with scrape type 1
2026-03-30 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d40773be-b764-5bc1-bf4e-84c2f003e6e6
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fce%252F46ceea02c2df7a7c37f32483c89be669%252Fpa%252FMM13759_455a9a9c5474ae52bd2d0ae73b57f989.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_455a9a9c5474ae52bd2d0ae73b57f989.jpg not downloaded yet
2026-03-30 10:40:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b5d1519-cbb6-5217-8475-fdc1cd3f636f with identifier: BX85596
2026-03-30 10:40:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b5d1519-cbb6-5217-8475-fdc1cd3f636f with identifier: BX85596
2026-03-30 10:40:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b5d1519-cbb6-5217-8475-fdc1cd3f636f with identifier: BX85596 to the API
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:39:00Z',
 'fuel_type': 'petrol',
 'id': '2b5d1519-cbb6-5217-8475-fdc1cd3f636f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX85596',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 198976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-04',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX85596%27 HTTP/1.1" 200 None
2026-03-30 10:40:47 [auto1.de] INFO: Saving data for BX85596: {'auction_closing_time': 1774971540.0, 'created_time': 1773346480.689596, 'last_price_update_time': 1774867247.064419}
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX85596') HTTP/1.1" 204 0
2026-03-30 10:40:47 [auto1.de] INFO: Found listing with ID: SV41161
2026-03-30 10:40:47 [auto1.de] INFO: Found listing with ID: US50096
2026-03-30 10:40:47 [auto1.de] INFO: Found listing with ID: HU25132
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU25132%27 HTTP/1.1" 200 None
2026-03-30 10:40:47 [auto1.de] INFO: Scrape type for HU25132: 2
2026-03-30 10:40:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fd94393-76eb-5b5b-8bff-ad71ff471681 with identifier: HU25132
2026-03-30 10:40:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fd94393-76eb-5b5b-8bff-ad71ff471681 with scrape type 2
2026-03-30 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fd94393-76eb-5b5b-8bff-ad71ff471681 with scrape type 2
2026-03-30 10:40:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3fd94393-76eb-5b5b-8bff-ad71ff471681, identifier: HU25132
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fce%252F46ceea02c2df7a7c37f32483c89be669%252Fpa%252FMM13759_2cef67e1807377135baef6e45a63ba32.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_2cef67e1807377135baef6e45a63ba32.jpg not downloaded yet
2026-03-30 10:40:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3fd94393-76eb-5b5b-8bff-ad71ff471681 with identifier: HU25132
2026-03-30 10:40:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3fd94393-76eb-5b5b-8bff-ad71ff471681 with identifier: HU25132
2026-03-30 10:40:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3fd94393-76eb-5b5b-8bff-ad71ff471681 with identifier: HU25132 to the API
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:23:44Z',
 'fuel_type': 'diesel',
 'id': '3fd94393-76eb-5b5b-8bff-ad71ff471681',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU25132',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 218141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2017}
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU25132%27 HTTP/1.1" 200 None
2026-03-30 10:40:47 [auto1.de] INFO: Saving data for HU25132: {'auction_closing_time': 1774970624.0, 'created_time': 1774262941.64173, 'last_price_update_time': 1774867247.794961}
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU25132') HTTP/1.1" 204 0
2026-03-30 10:40:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad24118e-933b-55c2-b932-ddc230f4fbc9 with identifier: JP72611
2026-03-30 10:40:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad24118e-933b-55c2-b932-ddc230f4fbc9 with scrape type 1
2026-03-30 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad24118e-933b-55c2-b932-ddc230f4fbc9
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_9e7a05fb5e24fd9b5919483b2dba561f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_9e7a05fb5e24fd9b5919483b2dba561f.jpg not downloaded yet
2026-03-30 10:40:47 [auto1.de] INFO: Found listing with ID: WL29620
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL29620%27 HTTP/1.1" 200 None
2026-03-30 10:40:47 [auto1.de] INFO: Scrape type for WL29620: 2
2026-03-30 10:40:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14904254-dd57-5a18-a199-4616fdda3819 with identifier: WL29620
2026-03-30 10:40:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14904254-dd57-5a18-a199-4616fdda3819 with scrape type 2
2026-03-30 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14904254-dd57-5a18-a199-4616fdda3819 with scrape type 2
2026-03-30 10:40:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14904254-dd57-5a18-a199-4616fdda3819, identifier: WL29620
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fce%252F46ceea02c2df7a7c37f32483c89be669%252Fpa%252FMM13759_553415c2ba43835eae89556d9e406ccf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_553415c2ba43835eae89556d9e406ccf.jpg not downloaded yet
2026-03-30 10:40:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14904254-dd57-5a18-a199-4616fdda3819 with identifier: WL29620
2026-03-30 10:40:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14904254-dd57-5a18-a199-4616fdda3819 with identifier: WL29620
2026-03-30 10:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14904254-dd57-5a18-a199-4616fdda3819 with identifier: WL29620 to the API
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:38:03Z',
 'fuel_type': 'petrol',
 'id': '14904254-dd57-5a18-a199-4616fdda3819',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL29620',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 105064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-20',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost R&B',
 'transmission': 'manual',
 'trim': 'R&B',
 'year': 2015}
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL29620%27 HTTP/1.1" 200 None
2026-03-30 10:40:48 [auto1.de] INFO: Saving data for WL29620: {'auction_closing_time': 1774971483.0, 'created_time': 1774348288.197002, 'last_price_update_time': 1774867248.374811}
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL29620') HTTP/1.1" 204 0
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_0d7287377d8f6e316ed132887dcd424c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_0d7287377d8f6e316ed132887dcd424c.jpg not downloaded yet
2026-03-30 10:40:48 [auto1.de] INFO: Found listing with ID: ME10410
2026-03-30 10:40:48 [auto1.de] INFO: Found listing with ID: JW10834
2026-03-30 10:40:48 [auto1.de] INFO: Found listing with ID: LM07761
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM07761%27 HTTP/1.1" 200 None
2026-03-30 10:40:48 [auto1.de] INFO: Scrape type for LM07761: 2
2026-03-30 10:40:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c3711a5-9f18-561a-9498-eb0bf9691675 with identifier: LM07761
2026-03-30 10:40:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c3711a5-9f18-561a-9498-eb0bf9691675 with scrape type 2
2026-03-30 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c3711a5-9f18-561a-9498-eb0bf9691675 with scrape type 2
2026-03-30 10:40:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c3711a5-9f18-561a-9498-eb0bf9691675, identifier: LM07761
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fce%252F46ceea02c2df7a7c37f32483c89be669%252Fpa%252FMM13759_04eb97cbdc437ce76c97534db4ec6a79.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_04eb97cbdc437ce76c97534db4ec6a79.jpg not downloaded yet
2026-03-30 10:40:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c3711a5-9f18-561a-9498-eb0bf9691675 with identifier: LM07761
2026-03-30 10:40:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c3711a5-9f18-561a-9498-eb0bf9691675 with identifier: LM07761
2026-03-30 10:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c3711a5-9f18-561a-9498-eb0bf9691675 with identifier: LM07761 to the API
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:23:31Z',
 'fuel_type': 'diesel',
 'id': '1c3711a5-9f18-561a-9498-eb0bf9691675',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM07761',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 12285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-23',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2024}
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM07761%27 HTTP/1.1" 200 None
2026-03-30 10:40:49 [auto1.de] INFO: Saving data for LM07761: {'auction_closing_time': 1774970611.0, 'created_time': 1774294169.370626, 'last_price_update_time': 1774867249.059279}
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM07761') HTTP/1.1" 204 0
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_648a68652d547cbcaa6a191a105a2f86.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_648a68652d547cbcaa6a191a105a2f86.jpg not downloaded yet
2026-03-30 10:40:49 [auto1.de] INFO: Found listing with ID: YV90191
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV90191%27 HTTP/1.1" 200 None
2026-03-30 10:40:49 [auto1.de] INFO: Scrape type for YV90191: 1
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fce%252F46ceea02c2df7a7c37f32483c89be669%252Fpa%252FMM13759_3c5ad713a859216426efdda72cdbe691.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_3c5ad713a859216426efdda72cdbe691.jpg not downloaded yet
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_9cceb58ecfeb7e69d394b2807f9429b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_9cceb58ecfeb7e69d394b2807f9429b8.jpg not downloaded yet
2026-03-30 10:40:49 [auto1.de] INFO: Found listing with ID: NK05047
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK05047%27 HTTP/1.1" 200 None
2026-03-30 10:40:49 [auto1.de] INFO: Scrape type for NK05047: 1
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fce%252F46ceea02c2df7a7c37f32483c89be669%252Fpa%252FMM13759_f89578478da8b1dedacb352325cbd11c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_f89578478da8b1dedacb352325cbd11c.jpg not downloaded yet
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_4b60982efa35c2f323725af0b8580567.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_4b60982efa35c2f323725af0b8580567.jpg not downloaded yet
2026-03-30 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK98474/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:49 [auto1.de] INFO: Found listing with ID: AG32992
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG32992%27 HTTP/1.1" 200 None
2026-03-30 10:40:49 [auto1.de] INFO: Scrape type for AG32992: 1
2026-03-30 10:40:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_e523cdb15df185d90a752cc6bb9e821b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_e523cdb15df185d90a752cc6bb9e821b.jpg not downloaded yet
2026-03-30 10:40:49 [auto1.de] INFO: Found listing with ID: BL26241
2026-03-30 10:40:49 [auto1.de] INFO: Found listing with ID: BV02154
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_3429f151e147e90283dd7999c83176f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_3429f151e147e90283dd7999c83176f2.jpg not downloaded yet
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_9193292892e87b858c13b5c2ccf4256b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_9193292892e87b858c13b5c2ccf4256b.jpg not downloaded yet
2026-03-30 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_f89578478da8b1dedacb352325cbd11c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_773a89e0b7e6ee9415167375fa9bd755.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_773a89e0b7e6ee9415167375fa9bd755.jpg not downloaded yet
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_b02be9cf663e0decaeb4f8631199c883.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_b02be9cf663e0decaeb4f8631199c883.jpg not downloaded yet
2026-03-30 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_1893dab4162b07e9dcf4f453d8db8990.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_c2461fbbd103c7dc9de8fd11cfcee060.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_9193292892e87b858c13b5c2ccf4256b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5913850>
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d40773be-b764-5bc1-bf4e-84c2f003e6e6/d40773be-b764-5bc1-bf4e-84c2f003e6e6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fce%252F46ceea02c2df7a7c37f32483c89be669%252Fpa%252FMM13759_f89578478da8b1dedacb352325cbd11c.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_f89578478da8b1dedacb352325cbd11c.jpg saved to cache
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d40773be-b764-5bc1-bf4e-84c2f003e6e6
2026-03-30 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_b02be9cf663e0decaeb4f8631199c883.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_773a89e0b7e6ee9415167375fa9bd755.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d3590>
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_1893dab4162b07e9dcf4f453d8db8990.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_1893dab4162b07e9dcf4f453d8db8990.jpg saved to cache
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40a28f27-542a-5231-9511-1da844e4fb9b
2026-03-30 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_e523cdb15df185d90a752cc6bb9e821b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_3429f151e147e90283dd7999c83176f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee4b050>
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_c2461fbbd103c7dc9de8fd11cfcee060.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_c2461fbbd103c7dc9de8fd11cfcee060.jpg saved to cache
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40a28f27-542a-5231-9511-1da844e4fb9b
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417ec90>
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_9193292892e87b858c13b5c2ccf4256b.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_9193292892e87b858c13b5c2ccf4256b.jpg saved to cache
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad24118e-933b-55c2-b932-ddc230f4fbc9
2026-03-30 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_4b60982efa35c2f323725af0b8580567.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HD45334/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e2050>
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_b02be9cf663e0decaeb4f8631199c883.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_b02be9cf663e0decaeb4f8631199c883.jpg saved to cache
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ad24118e-933b-55c2-b932-ddc230f4fbc9
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c03fd0>
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_773a89e0b7e6ee9415167375fa9bd755.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_773a89e0b7e6ee9415167375fa9bd755.jpg saved to cache
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad24118e-933b-55c2-b932-ddc230f4fbc9
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5959090>
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_e523cdb15df185d90a752cc6bb9e821b.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_e523cdb15df185d90a752cc6bb9e821b.jpg saved to cache
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad24118e-933b-55c2-b932-ddc230f4fbc9
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee44f610>
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_3429f151e147e90283dd7999c83176f2.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_3429f151e147e90283dd7999c83176f2.jpg saved to cache
2026-03-30 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad24118e-933b-55c2-b932-ddc230f4fbc9
2026-03-30 10:40:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5959e50>
2026-03-30 10:40:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_4b60982efa35c2f323725af0b8580567.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_4b60982efa35c2f323725af0b8580567.jpg saved to cache
2026-03-30 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad24118e-933b-55c2-b932-ddc230f4fbc9
2026-03-30 10:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_9cceb58ecfeb7e69d394b2807f9429b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419e190>
2026-03-30 10:40:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_9cceb58ecfeb7e69d394b2807f9429b8.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_9cceb58ecfeb7e69d394b2807f9429b8.jpg saved to cache
2026-03-30 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad24118e-933b-55c2-b932-ddc230f4fbc9
2026-03-30 10:40:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW45589/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_3c5ad713a859216426efdda72cdbe691.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e2f90>
2026-03-30 10:40:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d40773be-b764-5bc1-bf4e-84c2f003e6e6/d40773be-b764-5bc1-bf4e-84c2f003e6e6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fce%252F46ceea02c2df7a7c37f32483c89be669%252Fpa%252FMM13759_3c5ad713a859216426efdda72cdbe691.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_3c5ad713a859216426efdda72cdbe691.jpg saved to cache
2026-03-30 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d40773be-b764-5bc1-bf4e-84c2f003e6e6
2026-03-30 10:40:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JG32491/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT97145/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:03 [auto1.de] INFO: Channel: 24h | Page: 19 | totalHits: 9444 | hits on page: 40
2026-03-30 10:41:03 [auto1.de] INFO: Found listing with ID: LM07761
2026-03-30 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM07761%27 HTTP/1.1" 200 None
2026-03-30 10:41:03 [auto1.de] INFO: Scrape type for LM07761: 0
2026-03-30 10:41:03 [auto1.de] INFO: Found listing with ID: YV90191
2026-03-30 10:41:03 [auto1.de] INFO: Found listing with ID: NK05047
2026-03-30 10:41:03 [auto1.de] INFO: Found listing with ID: AG32992
2026-03-30 10:41:03 [auto1.de] INFO: Found listing with ID: BL26241
2026-03-30 10:41:03 [auto1.de] INFO: Found listing with ID: BV02154
2026-03-30 10:41:03 [auto1.de] INFO: Found listing with ID: JL60015
2026-03-30 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL60015%27 HTTP/1.1" 200 None
2026-03-30 10:41:03 [auto1.de] INFO: Scrape type for JL60015: 2
2026-03-30 10:41:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f with identifier: JL60015
2026-03-30 10:41:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f with scrape type 2
2026-03-30 10:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f with scrape type 2
2026-03-30 10:41:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f, identifier: JL60015
2026-03-30 10:41:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f with identifier: JL60015
2026-03-30 10:41:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f with identifier: JL60015
2026-03-30 10:41:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f with identifier: JL60015 to the API
2026-03-30 10:41:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:28:38Z',
 'fuel_type': 'diesel',
 'id': '43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL60015',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 273685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-22',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2012}
2026-03-30 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL60015%27 HTTP/1.1" 200 None
2026-03-30 10:41:03 [auto1.de] INFO: Saving data for JL60015: {'auction_closing_time': 1774970918.0, 'created_time': 1774262862.082253, 'last_price_update_time': 1774867263.912696}
2026-03-30 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL60015') HTTP/1.1" 204 0
2026-03-30 10:41:04 [auto1.de] INFO: Found listing with ID: TC70677
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC70677%27 HTTP/1.1" 200 None
2026-03-30 10:41:04 [auto1.de] INFO: Scrape type for TC70677: 2
2026-03-30 10:41:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 633bd3ae-cda6-539f-b6ab-f90f1b7d9dbe with identifier: TC70677
2026-03-30 10:41:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 633bd3ae-cda6-539f-b6ab-f90f1b7d9dbe with scrape type 2
2026-03-30 10:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 633bd3ae-cda6-539f-b6ab-f90f1b7d9dbe with scrape type 2
2026-03-30 10:41:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 633bd3ae-cda6-539f-b6ab-f90f1b7d9dbe, identifier: TC70677
2026-03-30 10:41:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 633bd3ae-cda6-539f-b6ab-f90f1b7d9dbe with identifier: TC70677
2026-03-30 10:41:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 633bd3ae-cda6-539f-b6ab-f90f1b7d9dbe with identifier: TC70677
2026-03-30 10:41:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 633bd3ae-cda6-539f-b6ab-f90f1b7d9dbe with identifier: TC70677 to the API
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:07:56Z',
 'fuel_type': 'diesel',
 'id': '633bd3ae-cda6-539f-b6ab-f90f1b7d9dbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC70677',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 117085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Join',
 'transmission': 'automatic',
 'trim': 'Join',
 'year': 2018}
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC70677%27 HTTP/1.1" 200 None
2026-03-30 10:41:04 [auto1.de] INFO: Saving data for TC70677: {'auction_closing_time': 1774969676.0, 'created_time': 1774293813.920998, 'last_price_update_time': 1774867264.455241}
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TC70677') HTTP/1.1" 204 0
2026-03-30 10:41:04 [auto1.de] INFO: Found listing with ID: TU86287
2026-03-30 10:41:04 [auto1.de] INFO: Found listing with ID: PJ48616
2026-03-30 10:41:04 [auto1.de] INFO: Found listing with ID: VV80524
2026-03-30 10:41:04 [auto1.de] INFO: Found listing with ID: YJ94181
2026-03-30 10:41:04 [auto1.de] INFO: Found listing with ID: MJ25324
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ25324%27 HTTP/1.1" 200 None
2026-03-30 10:41:04 [auto1.de] INFO: Scrape type for MJ25324: 2
2026-03-30 10:41:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5730e925-d6bb-5fc8-91ce-6afae8fa3033 with identifier: MJ25324
2026-03-30 10:41:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5730e925-d6bb-5fc8-91ce-6afae8fa3033 with scrape type 2
2026-03-30 10:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5730e925-d6bb-5fc8-91ce-6afae8fa3033 with scrape type 2
2026-03-30 10:41:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5730e925-d6bb-5fc8-91ce-6afae8fa3033, identifier: MJ25324
2026-03-30 10:41:04 [scrapy.extensions.logstats] INFO: Crawled 420 pages (at 39 pages/min), scraped 300 items (at 39 items/min)
2026-03-30 10:41:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:41:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5730e925-d6bb-5fc8-91ce-6afae8fa3033 with identifier: MJ25324
2026-03-30 10:41:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5730e925-d6bb-5fc8-91ce-6afae8fa3033 with identifier: MJ25324
2026-03-30 10:41:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5730e925-d6bb-5fc8-91ce-6afae8fa3033 with identifier: MJ25324 to the API
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:46:20Z',
 'fuel_type': 'petrol',
 'id': '5730e925-d6bb-5fc8-91ce-6afae8fa3033',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ25324',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 34245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ25324%27 HTTP/1.1" 200 None
2026-03-30 10:41:04 [auto1.de] INFO: Saving data for MJ25324: {'auction_closing_time': 1774971980.0, 'created_time': 1774290720.41021, 'last_price_update_time': 1774867264.905629}
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ25324') HTTP/1.1" 204 0
2026-03-30 10:41:04 [auto1.de] INFO: Found listing with ID: PG46559
2026-03-30 10:41:04 [auto1.de] INFO: Found listing with ID: PT79001
2026-03-30 10:41:04 [auto1.de] INFO: Found listing with ID: AD74925
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD74925%27 HTTP/1.1" 200 None
2026-03-30 10:41:04 [auto1.de] INFO: Scrape type for AD74925: 1
2026-03-30 10:41:04 [auto1.de] INFO: Found listing with ID: SM01610
2026-03-30 10:41:04 [auto1.de] INFO: Found listing with ID: JY04317
2026-03-30 10:41:04 [auto1.de] INFO: Found listing with ID: JZ50493
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ50493%27 HTTP/1.1" 200 None
2026-03-30 10:41:04 [auto1.de] INFO: Scrape type for JZ50493: 1
2026-03-30 10:41:04 [auto1.de] INFO: Found listing with ID: GF43891
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF43891%27 HTTP/1.1" 200 None
2026-03-30 10:41:04 [auto1.de] INFO: Scrape type for GF43891: 1
2026-03-30 10:41:04 [auto1.de] INFO: Found listing with ID: ZB42125
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB42125%27 HTTP/1.1" 200 None
2026-03-30 10:41:04 [auto1.de] INFO: Scrape type for ZB42125: 2
2026-03-30 10:41:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d92f83e-a4df-572d-aba1-9858fb2ec6e7 with identifier: ZB42125
2026-03-30 10:41:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d92f83e-a4df-572d-aba1-9858fb2ec6e7 with scrape type 2
2026-03-30 10:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d92f83e-a4df-572d-aba1-9858fb2ec6e7 with scrape type 2
2026-03-30 10:41:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d92f83e-a4df-572d-aba1-9858fb2ec6e7, identifier: ZB42125
2026-03-30 10:41:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d92f83e-a4df-572d-aba1-9858fb2ec6e7 with identifier: ZB42125
2026-03-30 10:41:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d92f83e-a4df-572d-aba1-9858fb2ec6e7 with identifier: ZB42125
2026-03-30 10:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d92f83e-a4df-572d-aba1-9858fb2ec6e7 with identifier: ZB42125 to the API
2026-03-30 10:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-31T15:31:48Z',
 'fuel_type': 'petrol',
 'id': '0d92f83e-a4df-572d-aba1-9858fb2ec6e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB42125',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 137933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-28',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-30 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB42125%27 HTTP/1.1" 200 None
2026-03-30 10:41:05 [auto1.de] INFO: Saving data for ZB42125: {'auction_closing_time': 1774971108.0, 'created_time': 1773687944.232921, 'last_price_update_time': 1774867265.402957}
2026-03-30 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB42125') HTTP/1.1" 204 0
2026-03-30 10:41:05 [auto1.de] INFO: Found listing with ID: JE19895
2026-03-30 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE19895%27 HTTP/1.1" 200 None
2026-03-30 10:41:05 [auto1.de] INFO: Scrape type for JE19895: 2
2026-03-30 10:41:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c49da0bf-7319-5f6a-9959-9f8a8494ceae with identifier: JE19895
2026-03-30 10:41:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c49da0bf-7319-5f6a-9959-9f8a8494ceae with scrape type 2
2026-03-30 10:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c49da0bf-7319-5f6a-9959-9f8a8494ceae with scrape type 2
2026-03-30 10:41:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c49da0bf-7319-5f6a-9959-9f8a8494ceae, identifier: JE19895
2026-03-30 10:41:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c49da0bf-7319-5f6a-9959-9f8a8494ceae with identifier: JE19895
2026-03-30 10:41:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c49da0bf-7319-5f6a-9959-9f8a8494ceae with identifier: JE19895
2026-03-30 10:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c49da0bf-7319-5f6a-9959-9f8a8494ceae with identifier: JE19895 to the API
2026-03-30 10:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-31T15:06:23Z',
 'fuel_type': 'petrol',
 'id': 'c49da0bf-7319-5f6a-9959-9f8a8494ceae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE19895',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 19033,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-21',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 43 AMG Mild-Hybrid 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2023}
2026-03-30 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE19895%27 HTTP/1.1" 200 None
2026-03-30 10:41:05 [auto1.de] INFO: Saving data for JE19895: {'auction_closing_time': 1774969583.0, 'created_time': 1774294446.385571, 'last_price_update_time': 1774867265.99374}
2026-03-30 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE19895') HTTP/1.1" 204 0
2026-03-30 10:41:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YN89377/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:06 [auto1.de] INFO: Found listing with ID: AX74187
2026-03-30 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX74187%27 HTTP/1.1" 200 None
2026-03-30 10:41:06 [auto1.de] INFO: Scrape type for AX74187: 1
2026-03-30 10:41:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:06 [auto1.de] INFO: Found listing with ID: JT23307
2026-03-30 10:41:06 [auto1.de] INFO: Found listing with ID: XA22438
2026-03-30 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA22438%27 HTTP/1.1" 200 None
2026-03-30 10:41:06 [auto1.de] INFO: Scrape type for XA22438: 2
2026-03-30 10:41:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ae628a7-6ef9-58f5-b26c-a48b892b55a9 with identifier: XA22438
2026-03-30 10:41:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ae628a7-6ef9-58f5-b26c-a48b892b55a9 with scrape type 2
2026-03-30 10:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ae628a7-6ef9-58f5-b26c-a48b892b55a9 with scrape type 2
2026-03-30 10:41:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ae628a7-6ef9-58f5-b26c-a48b892b55a9, identifier: XA22438
2026-03-30 10:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ae628a7-6ef9-58f5-b26c-a48b892b55a9 with identifier: XA22438
2026-03-30 10:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ae628a7-6ef9-58f5-b26c-a48b892b55a9 with identifier: XA22438
2026-03-30 10:41:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ae628a7-6ef9-58f5-b26c-a48b892b55a9 with identifier: XA22438 to the API
2026-03-30 10:41:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:54:01Z',
 'fuel_type': 'petrol',
 'id': '0ae628a7-6ef9-58f5-b26c-a48b892b55a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA22438',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 111443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-03',
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 GLS',
 'transmission': 'manual',
 'trim': 'GLS',
 'year': 2008}
2026-03-30 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA22438%27 HTTP/1.1" 200 None
2026-03-30 10:41:06 [auto1.de] INFO: Saving data for XA22438: {'auction_closing_time': 1774972441.0, 'created_time': 1773773071.689134, 'last_price_update_time': 1774867266.468889}
2026-03-30 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA22438') HTTP/1.1" 204 0
2026-03-30 10:41:06 [auto1.de] INFO: Found listing with ID: PU71173
2026-03-30 10:41:06 [auto1.de] INFO: Found listing with ID: LR15426
2026-03-30 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR15426%27 HTTP/1.1" 200 None
2026-03-30 10:41:06 [auto1.de] INFO: Scrape type for LR15426: 1
2026-03-30 10:41:06 [auto1.de] INFO: Found listing with ID: LZ41589
2026-03-30 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ41589%27 HTTP/1.1" 200 None
2026-03-30 10:41:06 [auto1.de] INFO: Scrape type for LZ41589: 1
2026-03-30 10:41:06 [auto1.de] INFO: Found listing with ID: KG83393
2026-03-30 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG83393%27 HTTP/1.1" 200 None
2026-03-30 10:41:06 [auto1.de] INFO: Scrape type for KG83393: 2
2026-03-30 10:41:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11a78fd6-e968-56b3-a8c5-51705c177325 with identifier: KG83393
2026-03-30 10:41:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11a78fd6-e968-56b3-a8c5-51705c177325 with scrape type 2
2026-03-30 10:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11a78fd6-e968-56b3-a8c5-51705c177325 with scrape type 2
2026-03-30 10:41:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11a78fd6-e968-56b3-a8c5-51705c177325, identifier: KG83393
2026-03-30 10:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11a78fd6-e968-56b3-a8c5-51705c177325 with identifier: KG83393
2026-03-30 10:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11a78fd6-e968-56b3-a8c5-51705c177325 with identifier: KG83393
2026-03-30 10:41:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11a78fd6-e968-56b3-a8c5-51705c177325 with identifier: KG83393 to the API
2026-03-30 10:41:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 227,
 'expiration_date': '2026-03-31T15:00:59Z',
 'fuel_type': 'petrol',
 'id': '11a78fd6-e968-56b3-a8c5-51705c177325',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG83393',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 23495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-14',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2023}
2026-03-30 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG83393%27 HTTP/1.1" 200 None
2026-03-30 10:41:07 [auto1.de] INFO: Saving data for KG83393: {'auction_closing_time': 1774969259.0, 'created_time': 1773774744.793086, 'last_price_update_time': 1774867267.651834}
2026-03-30 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG83393') HTTP/1.1" 204 0
2026-03-30 10:41:07 [auto1.de] INFO: Found listing with ID: LR88294
2026-03-30 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR88294%27 HTTP/1.1" 200 None
2026-03-30 10:41:07 [auto1.de] INFO: Scrape type for LR88294: 1
2026-03-30 10:41:07 [auto1.de] INFO: Found listing with ID: XG74436
2026-03-30 10:41:07 [auto1.de] INFO: Found listing with ID: TM99691
2026-03-30 10:41:07 [auto1.de] INFO: Found listing with ID: ZH41637
2026-03-30 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH41637%27 HTTP/1.1" 200 None
2026-03-30 10:41:07 [auto1.de] INFO: Scrape type for ZH41637: 2
2026-03-30 10:41:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f5dbd2f-c80f-5408-81c2-e35fb565b0ca with identifier: ZH41637
2026-03-30 10:41:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f5dbd2f-c80f-5408-81c2-e35fb565b0ca with scrape type 2
2026-03-30 10:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f5dbd2f-c80f-5408-81c2-e35fb565b0ca with scrape type 2
2026-03-30 10:41:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f5dbd2f-c80f-5408-81c2-e35fb565b0ca, identifier: ZH41637
2026-03-30 10:41:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f5dbd2f-c80f-5408-81c2-e35fb565b0ca with identifier: ZH41637
2026-03-30 10:41:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f5dbd2f-c80f-5408-81c2-e35fb565b0ca with identifier: ZH41637
2026-03-30 10:41:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f5dbd2f-c80f-5408-81c2-e35fb565b0ca with identifier: ZH41637 to the API
2026-03-30 10:41:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:28:48Z',
 'fuel_type': 'diesel',
 'id': '9f5dbd2f-c80f-5408-81c2-e35fb565b0ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH41637',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 119040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-01',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d kompakt 4Matic BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'kompakt 4Matic BlueTEC Avantgarde',
 'year': 2015}
2026-03-30 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH41637%27 HTTP/1.1" 200 None
2026-03-30 10:41:08 [auto1.de] INFO: Saving data for ZH41637: {'auction_closing_time': 1774970928.0, 'created_time': 1773303044.576127, 'last_price_update_time': 1774867268.182573}
2026-03-30 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH41637') HTTP/1.1" 204 0
2026-03-30 10:41:08 [auto1.de] INFO: Found listing with ID: KJ93142
2026-03-30 10:41:08 [auto1.de] INFO: Found listing with ID: VG68690
2026-03-30 10:41:08 [auto1.de] INFO: Found listing with ID: VN57759
2026-03-30 10:41:08 [auto1.de] INFO: Found listing with ID: GN20483
2026-03-30 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN20483%27 HTTP/1.1" 200 None
2026-03-30 10:41:08 [auto1.de] INFO: Scrape type for GN20483: 1
2026-03-30 10:41:08 [auto1.de] INFO: Found listing with ID: UY11504
2026-03-30 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY11504%27 HTTP/1.1" 200 None
2026-03-30 10:41:08 [auto1.de] INFO: Scrape type for UY11504: 2
2026-03-30 10:41:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 786b8b58-d2ac-5618-905a-b1d033e228c6 with identifier: UY11504
2026-03-30 10:41:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 786b8b58-d2ac-5618-905a-b1d033e228c6 with scrape type 2
2026-03-30 10:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 786b8b58-d2ac-5618-905a-b1d033e228c6 with scrape type 2
2026-03-30 10:41:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 786b8b58-d2ac-5618-905a-b1d033e228c6, identifier: UY11504
2026-03-30 10:41:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 786b8b58-d2ac-5618-905a-b1d033e228c6 with identifier: UY11504
2026-03-30 10:41:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 786b8b58-d2ac-5618-905a-b1d033e228c6 with identifier: UY11504
2026-03-30 10:41:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 786b8b58-d2ac-5618-905a-b1d033e228c6 with identifier: UY11504 to the API
2026-03-30 10:41:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:15:19Z',
 'fuel_type': 'petrol',
 'id': '786b8b58-d2ac-5618-905a-b1d033e228c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY11504',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 82645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-18',
 'seller_name': None,
 'title': 'Audi A1 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2011}
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY11504%27 HTTP/1.1" 200 None
2026-03-30 10:41:09 [auto1.de] INFO: Saving data for UY11504: {'auction_closing_time': 1774970119.0, 'created_time': 1773659155.863166, 'last_price_update_time': 1774867269.108458}
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY11504') HTTP/1.1" 204 0
2026-03-30 10:41:09 [auto1.de] INFO: Found listing with ID: JR21744
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR21744%27 HTTP/1.1" 200 None
2026-03-30 10:41:09 [auto1.de] INFO: Scrape type for JR21744: 1
2026-03-30 10:41:09 [auto1.de] INFO: Found listing with ID: HC44441
2026-03-30 10:41:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK98474> (referer: https://www.auto1.com/v1/car-details-view/UK98474/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51784db5-63b1-5c6d-b879-bcfa04d80864 with identifier: UK98474
2026-03-30 10:41:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51784db5-63b1-5c6d-b879-bcfa04d80864 with scrape type 1
2026-03-30 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 51784db5-63b1-5c6d-b879-bcfa04d80864
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_3e0e098d780704f7264d51f214cea714.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_3e0e098d780704f7264d51f214cea714.jpg not downloaded yet
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_a0b783d99dfe46f960a5d39b4812840e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_a0b783d99dfe46f960a5d39b4812840e.jpg not downloaded yet
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_1fa050a851a79617b451d55ac368fd2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_1fa050a851a79617b451d55ac368fd2a.jpg not downloaded yet
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_7a99d3ca1360c214ceb4469075dd51be.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_7a99d3ca1360c214ceb4469075dd51be.jpg not downloaded yet
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_2e67f275862de1a83b8598b6e5f5c2ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_2e67f275862de1a83b8598b6e5f5c2ac.jpg not downloaded yet
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_285f8a0699e76d75a08bc9c6f25c0d20.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_285f8a0699e76d75a08bc9c6f25c0d20.jpg not downloaded yet
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_17532034f829aa459eca04259e7771d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_17532034f829aa459eca04259e7771d9.jpg not downloaded yet
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_c96d66c828a2cb22a06b7e0f304f95e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_c96d66c828a2cb22a06b7e0f304f95e4.jpg not downloaded yet
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_24a9cd4ed974b6230bd37f850fc3b01c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_24a9cd4ed974b6230bd37f850fc3b01c.jpg not downloaded yet
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_c2150936470acec4e51d5f4410a89fc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_c2150936470acec4e51d5f4410a89fc0.jpg not downloaded yet
2026-03-30 10:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG32992/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_c2150936470acec4e51d5f4410a89fc0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41da6d0>
2026-03-30 10:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_c2150936470acec4e51d5f4410a89fc0.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_c2150936470acec4e51d5f4410a89fc0.jpg saved to cache
2026-03-30 10:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 51784db5-63b1-5c6d-b879-bcfa04d80864
2026-03-30 10:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WT13361/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_24a9cd4ed974b6230bd37f850fc3b01c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee441090>
2026-03-30 10:41:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_24a9cd4ed974b6230bd37f850fc3b01c.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_24a9cd4ed974b6230bd37f850fc3b01c.jpg saved to cache
2026-03-30 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 51784db5-63b1-5c6d-b879-bcfa04d80864
2026-03-30 10:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC11597/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_c96d66c828a2cb22a06b7e0f304f95e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea05d0>
2026-03-30 10:41:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_c96d66c828a2cb22a06b7e0f304f95e4.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_c96d66c828a2cb22a06b7e0f304f95e4.jpg saved to cache
2026-03-30 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51784db5-63b1-5c6d-b879-bcfa04d80864
2026-03-30 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HD45334> (referer: https://www.auto1.com/v1/car-details-view/HD45334/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:32 [crawlers.middlewares.id_gen_middleware] INFO: Duplicate ID generated for item: ecac2567-3be3-5b55-b73d-5eb705a1dc54 with identifier: HD45334, dropping item
2026-03-30 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_17532034f829aa459eca04259e7771d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41da450>
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_17532034f829aa459eca04259e7771d9.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_17532034f829aa459eca04259e7771d9.jpg saved to cache
2026-03-30 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51784db5-63b1-5c6d-b879-bcfa04d80864
2026-03-30 10:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV90191/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_285f8a0699e76d75a08bc9c6f25c0d20.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW45589> (referer: https://www.auto1.com/v1/car-details-view/FW45589/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_2e67f275862de1a83b8598b6e5f5c2ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4421d0>
2026-03-30 10:41:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_285f8a0699e76d75a08bc9c6f25c0d20.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_285f8a0699e76d75a08bc9c6f25c0d20.jpg saved to cache
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51784db5-63b1-5c6d-b879-bcfa04d80864
2026-03-30 10:41:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf03d252-2969-553c-a226-bdfdf006d416 with identifier: FW45589
2026-03-30 10:41:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf03d252-2969-553c-a226-bdfdf006d416 with scrape type 1
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf03d252-2969-553c-a226-bdfdf006d416
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Faf%252F48afccc7acebabd2de4e23c84e85664b%252Fpa%252FFW45589_46f419302c459ef8e4120b5b73e8e4c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_46f419302c459ef8e4120b5b73e8e4c6.jpg already downloaded
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Faf%252F48afccc7acebabd2de4e23c84e85664b%252Fpa%252FFW45589_cf80edb680eac5c2456573649fb82a3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_cf80edb680eac5c2456573649fb82a3e.jpg already downloaded
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Faf%252F48afccc7acebabd2de4e23c84e85664b%252Fpa%252FFW45589_dc54b7a216f016a40675fbfdb25ecb5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_dc54b7a216f016a40675fbfdb25ecb5d.jpg already downloaded
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Faf%252F48afccc7acebabd2de4e23c84e85664b%252Fpa%252FFW45589_21e1ec00561c1fde2a9e4a09b7b90fbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_21e1ec00561c1fde2a9e4a09b7b90fbd.jpg already downloaded
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Faf%252F48afccc7acebabd2de4e23c84e85664b%252Fpa%252FFW45589_7d86b0f345ecdb8017070d8379454e0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_7d86b0f345ecdb8017070d8379454e0a.jpg already downloaded
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Faf%252F48afccc7acebabd2de4e23c84e85664b%252Fpa%252FFW45589_e361e7778cefcc5f49d9cd2df26ba3e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_e361e7778cefcc5f49d9cd2df26ba3e4.jpg already downloaded
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Faf%252F48afccc7acebabd2de4e23c84e85664b%252Fpa%252FFW45589_3d48e35c245d03b0290428991774a1d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_3d48e35c245d03b0290428991774a1d9.jpg already downloaded
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Faf%252F48afccc7acebabd2de4e23c84e85664b%252Fpa%252FFW45589_24784198f3101695d7be916bed50593a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_24784198f3101695d7be916bed50593a.jpg already downloaded
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Faf%252F48afccc7acebabd2de4e23c84e85664b%252Fpa%252FFW45589_b808c3085e09221caebe8dfb8b36f97f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_b808c3085e09221caebe8dfb8b36f97f.jpg already downloaded
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Faf%252F48afccc7acebabd2de4e23c84e85664b%252Fpa%252FFW45589_635d84f1e6f7bbe35077a25ead2f63c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_635d84f1e6f7bbe35077a25ead2f63c7.jpg already downloaded
2026-03-30 10:41:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf03d252-2969-553c-a226-bdfdf006d416, identifier: FW45589
2026-03-30 10:41:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee02b90>
2026-03-30 10:41:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_2e67f275862de1a83b8598b6e5f5c2ac.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_2e67f275862de1a83b8598b6e5f5c2ac.jpg saved to cache
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51784db5-63b1-5c6d-b879-bcfa04d80864
2026-03-30 10:41:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf03d252-2969-553c-a226-bdfdf006d416 with identifier: FW45589
2026-03-30 10:41:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf03d252-2969-553c-a226-bdfdf006d416 with identifier: FW45589
2026-03-30 10:41:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf03d252-2969-553c-a226-bdfdf006d416 with identifier: FW45589 to the API
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FW45589>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:47:54Z',
 'fuel_type': 'hybrid',
 'id': 'bf03d252-2969-553c-a226-bdfdf006d416',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW45589',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 38892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_46f419302c459ef8e4120b5b73e8e4c6.jpg',
                'https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_cf80edb680eac5c2456573649fb82a3e.jpg',
                'https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_dc54b7a216f016a40675fbfdb25ecb5d.jpg',
                'https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_21e1ec00561c1fde2a9e4a09b7b90fbd.jpg',
                'https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_7d86b0f345ecdb8017070d8379454e0a.jpg',
                'https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_e361e7778cefcc5f49d9cd2df26ba3e4.jpg',
                'https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_3d48e35c245d03b0290428991774a1d9.jpg',
                'https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_24784198f3101695d7be916bed50593a.jpg',
                'https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_b808c3085e09221caebe8dfb8b36f97f.jpg',
                'https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_635d84f1e6f7bbe35077a25ead2f63c7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf03d252-2969-553c-a226-bdfdf006d416/bf03d252-2969-553c-a226-bdfdf006d416_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_46f419302c459ef8e4120b5b73e8e4c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf03d252-2969-553c-a226-bdfdf006d416/bf03d252-2969-553c-a226-bdfdf006d416_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_cf80edb680eac5c2456573649fb82a3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf03d252-2969-553c-a226-bdfdf006d416/bf03d252-2969-553c-a226-bdfdf006d416_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_dc54b7a216f016a40675fbfdb25ecb5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf03d252-2969-553c-a226-bdfdf006d416/bf03d252-2969-553c-a226-bdfdf006d416_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_21e1ec00561c1fde2a9e4a09b7b90fbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf03d252-2969-553c-a226-bdfdf006d416/bf03d252-2969-553c-a226-bdfdf006d416_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_7d86b0f345ecdb8017070d8379454e0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf03d252-2969-553c-a226-bdfdf006d416/bf03d252-2969-553c-a226-bdfdf006d416_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_e361e7778cefcc5f49d9cd2df26ba3e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf03d252-2969-553c-a226-bdfdf006d416/bf03d252-2969-553c-a226-bdfdf006d416_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_3d48e35c245d03b0290428991774a1d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf03d252-2969-553c-a226-bdfdf006d416/bf03d252-2969-553c-a226-bdfdf006d416_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_24784198f3101695d7be916bed50593a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf03d252-2969-553c-a226-bdfdf006d416/bf03d252-2969-553c-a226-bdfdf006d416_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_b808c3085e09221caebe8dfb8b36f97f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf03d252-2969-553c-a226-bdfdf006d416/bf03d252-2969-553c-a226-bdfdf006d416_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/af/48afccc7acebabd2de4e23c84e85664b/pa/FW45589_635d84f1e6f7bbe35077a25ead2f63c7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 250e Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2022}
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW45589%27 HTTP/1.1" 200 None
2026-03-30 10:41:34 [auto1.de] INFO: Saving data for FW45589: {'created_time': 1774867294.379335, 'last_price_update_time': 1774867294.379347, 'auction_closing_time': 1774972074.0}
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW45589') HTTP/1.1" 204 0
2026-03-30 10:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_7a99d3ca1360c214ceb4469075dd51be.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3fa1d0>
2026-03-30 10:41:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_7a99d3ca1360c214ceb4469075dd51be.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_7a99d3ca1360c214ceb4469075dd51be.jpg saved to cache
2026-03-30 10:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51784db5-63b1-5c6d-b879-bcfa04d80864
2026-03-30 10:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_1fa050a851a79617b451d55ac368fd2a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_a0b783d99dfe46f960a5d39b4812840e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4338a90>
2026-03-30 10:41:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_1fa050a851a79617b451d55ac368fd2a.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_1fa050a851a79617b451d55ac368fd2a.jpg saved to cache
2026-03-30 10:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51784db5-63b1-5c6d-b879-bcfa04d80864
2026-03-30 10:41:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5fa4950>
2026-03-30 10:41:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_a0b783d99dfe46f960a5d39b4812840e.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_a0b783d99dfe46f960a5d39b4812840e.jpg saved to cache
2026-03-30 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51784db5-63b1-5c6d-b879-bcfa04d80864
2026-03-30 10:41:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_3e0e098d780704f7264d51f214cea714.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4338c50>
2026-03-30 10:41:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fcb%252F01cb9e003aeedb6c71c7a971948d5cc0%252Fpa%252FUK98474_3e0e098d780704f7264d51f214cea714.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_3e0e098d780704f7264d51f214cea714.jpg saved to cache
2026-03-30 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51784db5-63b1-5c6d-b879-bcfa04d80864
2026-03-30 10:41:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51784db5-63b1-5c6d-b879-bcfa04d80864, skipping ID generation
2026-03-30 10:41:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51784db5-63b1-5c6d-b879-bcfa04d80864 with scrape type 1
2026-03-30 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51784db5-63b1-5c6d-b879-bcfa04d80864 sending to next pipeline
2026-03-30 10:41:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51784db5-63b1-5c6d-b879-bcfa04d80864, identifier: UK98474
2026-03-30 10:41:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51784db5-63b1-5c6d-b879-bcfa04d80864 with identifier: UK98474
2026-03-30 10:41:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51784db5-63b1-5c6d-b879-bcfa04d80864 with identifier: UK98474
2026-03-30 10:41:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51784db5-63b1-5c6d-b879-bcfa04d80864 with identifier: UK98474 to the API
2026-03-30 10:41:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_3e0e098d780704f7264d51f214cea714.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:41:30Z',
 'fuel_type': 'petrol',
 'id': '51784db5-63b1-5c6d-b879-bcfa04d80864',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK98474',
 'listing': 'auction',
 'location': 'DE, Esslingen am Neckar',
 'make': 'Citroen',
 'model': 'C5 X',
 'odometer': 1450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3058661,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_3e0e098d780704f7264d51f214cea714.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3021238,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_a0b783d99dfe46f960a5d39b4812840e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2948206,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_1fa050a851a79617b451d55ac368fd2a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3222258,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_7a99d3ca1360c214ceb4469075dd51be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3095725,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_2e67f275862de1a83b8598b6e5f5c2ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3159148,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_285f8a0699e76d75a08bc9c6f25c0d20.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3187110,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_17532034f829aa459eca04259e7771d9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3149229,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_c96d66c828a2cb22a06b7e0f304f95e4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3154314,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_24a9cd4ed974b6230bd37f850fc3b01c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51784db5-63b1-5c6d-b879-bcfa04d80864/51784db5-63b1-5c6d-b879-bcfa04d80864_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3034546,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/cb/01cb9e003aeedb6c71c7a971948d5cc0/pa/UK98474_c2150936470acec4e51d5f4410a89fc0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 X 1.2 PureTech YOU',
 'transmission': 'automatic',
 'trim': 'YOU',
 'year': 2024}
2026-03-30 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK98474%27 HTTP/1.1" 200 None
2026-03-30 10:41:35 [auto1.de] INFO: Saving data for UK98474: {'created_time': 1774867295.860523, 'last_price_update_time': 1774867295.860532, 'auction_closing_time': 1774971690.0}
2026-03-30 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK98474') HTTP/1.1" 204 0
2026-03-30 10:41:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MZ56747/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF43891/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK05047/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JR21744/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WT13361> (referer: https://www.auto1.com/v1/car-details-view/WT13361/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b0a0686-acd1-5d7d-99c5-4cb3930da994 with identifier: WT13361
2026-03-30 10:41:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b0a0686-acd1-5d7d-99c5-4cb3930da994 with scrape type 1
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0b0a0686-acd1-5d7d-99c5-4cb3930da994
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_afb95cfcd5b280d8d6e584feb19407e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_afb95cfcd5b280d8d6e584feb19407e8.jpg not downloaded yet
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_e3782a650661de972e635d6dab67420c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_e3782a650661de972e635d6dab67420c.jpg not downloaded yet
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_20cf77f3347ec2197188f8d202577580.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_20cf77f3347ec2197188f8d202577580.jpg not downloaded yet
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_d63570fc8483eadde1b629dbe6a79194.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_d63570fc8483eadde1b629dbe6a79194.jpg not downloaded yet
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_55edf007bbe2a09fc4f467358cbd66cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_55edf007bbe2a09fc4f467358cbd66cd.jpg not downloaded yet
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_1d2e58131d8a9810998e620ee4f6ea4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_1d2e58131d8a9810998e620ee4f6ea4c.jpg not downloaded yet
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_24ae328586608a25118034d3873efa82.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_24ae328586608a25118034d3873efa82.jpg not downloaded yet
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_ac9f4158d28298785f6be64acc214004.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_ac9f4158d28298785f6be64acc214004.jpg not downloaded yet
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_c2e07b558b7b856beeb79a9fe584f439.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_c2e07b558b7b856beeb79a9fe584f439.jpg not downloaded yet
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_32b73ee1ee6456e0d84686d45027c98a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_32b73ee1ee6456e0d84686d45027c98a.jpg not downloaded yet
2026-03-30 10:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JG32491> (referer: https://www.auto1.com/v1/car-details-view/JG32491/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT97145> (referer: https://www.auto1.com/v1/car-details-view/RT97145/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5359d38a-d661-53b0-9d4f-1aa81d5608df with identifier: JG32491
2026-03-30 10:41:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5359d38a-d661-53b0-9d4f-1aa81d5608df with scrape type 1
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5359d38a-d661-53b0-9d4f-1aa81d5608df
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_82fb0f105a6d0fdf6aac68d009375ad4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_82fb0f105a6d0fdf6aac68d009375ad4.jpg not downloaded yet
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_71fb3d6adbc9084604f131f389d7ddf7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_71fb3d6adbc9084604f131f389d7ddf7.jpg not downloaded yet
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_91f88221ad19288da1ac0b3b5d6c6e67.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_91f88221ad19288da1ac0b3b5d6c6e67.jpg not downloaded yet
2026-03-30 10:41:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f2a7d45-15d6-5232-aac2-bf196e6415cf with identifier: RT97145
2026-03-30 10:41:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f2a7d45-15d6-5232-aac2-bf196e6415cf with scrape type 1
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f2a7d45-15d6-5232-aac2-bf196e6415cf
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F5a%252Fcb5a3f2a533bae286b230d5f7f404689%252Fpa%252FRT97145_695d7c5fd687deb640e0e9ac412769bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_695d7c5fd687deb640e0e9ac412769bc.jpg already downloaded
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F5a%252Fcb5a3f2a533bae286b230d5f7f404689%252Fpa%252FRT97145_8bd71695fa30bc8f5eaf560ce79691fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_8bd71695fa30bc8f5eaf560ce79691fb.jpg already downloaded
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F5a%252Fcb5a3f2a533bae286b230d5f7f404689%252Fpa%252FRT97145_ba57b94a4b0ec320d67acb20224471be.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_ba57b94a4b0ec320d67acb20224471be.jpg already downloaded
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F5a%252Fcb5a3f2a533bae286b230d5f7f404689%252Fpa%252FRT97145_024dcc3e328f0336375f9a60fdb0c7a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_024dcc3e328f0336375f9a60fdb0c7a9.jpg already downloaded
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F5a%252Fcb5a3f2a533bae286b230d5f7f404689%252Fpa%252FRT97145_6aacc59bc0ba7657e81e8f09dd3fd14f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_6aacc59bc0ba7657e81e8f09dd3fd14f.jpg already downloaded
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F5a%252Fcb5a3f2a533bae286b230d5f7f404689%252Fpa%252FRT97145_2f72ccc71f92b64f303e6d16445516b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_2f72ccc71f92b64f303e6d16445516b5.jpg already downloaded
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F5a%252Fcb5a3f2a533bae286b230d5f7f404689%252Fpa%252FRT97145_9c36a8bce1c4b0b615fa6bb197e3f383.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_9c36a8bce1c4b0b615fa6bb197e3f383.jpg already downloaded
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F5a%252Fcb5a3f2a533bae286b230d5f7f404689%252Fpa%252FRT97145_d09dc29889227c5a79a987a3226066f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_d09dc29889227c5a79a987a3226066f0.jpg already downloaded
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F5a%252Fcb5a3f2a533bae286b230d5f7f404689%252Fpa%252FRT97145_38de652e19bde8650e28296ac8cb99cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_38de652e19bde8650e28296ac8cb99cc.jpg already downloaded
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F5a%252Fcb5a3f2a533bae286b230d5f7f404689%252Fpa%252FRT97145_6c142dff9696335fce727d43517702c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_6c142dff9696335fce727d43517702c6.jpg already downloaded
2026-03-30 10:41:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f2a7d45-15d6-5232-aac2-bf196e6415cf, identifier: RT97145
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_93a6a320703b135e927b0e492fd04fa1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_93a6a320703b135e927b0e492fd04fa1.jpg not downloaded yet
2026-03-30 10:41:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f2a7d45-15d6-5232-aac2-bf196e6415cf with identifier: RT97145
2026-03-30 10:41:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f2a7d45-15d6-5232-aac2-bf196e6415cf with identifier: RT97145
2026-03-30 10:41:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f2a7d45-15d6-5232-aac2-bf196e6415cf with identifier: RT97145 to the API
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RT97145>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:36:51Z',
 'fuel_type': 'petrol',
 'id': '2f2a7d45-15d6-5232-aac2-bf196e6415cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT97145',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 62389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_695d7c5fd687deb640e0e9ac412769bc.jpg',
                'https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_8bd71695fa30bc8f5eaf560ce79691fb.jpg',
                'https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_ba57b94a4b0ec320d67acb20224471be.jpg',
                'https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_024dcc3e328f0336375f9a60fdb0c7a9.jpg',
                'https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_6aacc59bc0ba7657e81e8f09dd3fd14f.jpg',
                'https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_2f72ccc71f92b64f303e6d16445516b5.jpg',
                'https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_9c36a8bce1c4b0b615fa6bb197e3f383.jpg',
                'https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_d09dc29889227c5a79a987a3226066f0.jpg',
                'https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_38de652e19bde8650e28296ac8cb99cc.jpg',
                'https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_6c142dff9696335fce727d43517702c6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f2a7d45-15d6-5232-aac2-bf196e6415cf/2f2a7d45-15d6-5232-aac2-bf196e6415cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_695d7c5fd687deb640e0e9ac412769bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f2a7d45-15d6-5232-aac2-bf196e6415cf/2f2a7d45-15d6-5232-aac2-bf196e6415cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_8bd71695fa30bc8f5eaf560ce79691fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f2a7d45-15d6-5232-aac2-bf196e6415cf/2f2a7d45-15d6-5232-aac2-bf196e6415cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_ba57b94a4b0ec320d67acb20224471be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f2a7d45-15d6-5232-aac2-bf196e6415cf/2f2a7d45-15d6-5232-aac2-bf196e6415cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_024dcc3e328f0336375f9a60fdb0c7a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f2a7d45-15d6-5232-aac2-bf196e6415cf/2f2a7d45-15d6-5232-aac2-bf196e6415cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_6aacc59bc0ba7657e81e8f09dd3fd14f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f2a7d45-15d6-5232-aac2-bf196e6415cf/2f2a7d45-15d6-5232-aac2-bf196e6415cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_2f72ccc71f92b64f303e6d16445516b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f2a7d45-15d6-5232-aac2-bf196e6415cf/2f2a7d45-15d6-5232-aac2-bf196e6415cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_9c36a8bce1c4b0b615fa6bb197e3f383.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f2a7d45-15d6-5232-aac2-bf196e6415cf/2f2a7d45-15d6-5232-aac2-bf196e6415cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_d09dc29889227c5a79a987a3226066f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f2a7d45-15d6-5232-aac2-bf196e6415cf/2f2a7d45-15d6-5232-aac2-bf196e6415cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_38de652e19bde8650e28296ac8cb99cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f2a7d45-15d6-5232-aac2-bf196e6415cf/2f2a7d45-15d6-5232-aac2-bf196e6415cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/5a/cb5a3f2a533bae286b230d5f7f404689/pa/RT97145_6c142dff9696335fce727d43517702c6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.5 TSI ACT Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2020}
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT97145%27 HTTP/1.1" 200 None
2026-03-30 10:41:53 [auto1.de] INFO: Saving data for RT97145: {'created_time': 1774867313.085479, 'last_price_update_time': 1774867313.085491, 'auction_closing_time': 1774971411.0}
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT97145') HTTP/1.1" 204 0
2026-03-30 10:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_32b73ee1ee6456e0d84686d45027c98a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_c2e07b558b7b856beeb79a9fe584f439.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_67e4c55be38bc51541b765b18f971ccd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_67e4c55be38bc51541b765b18f971ccd.jpg not downloaded yet
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_f292e2a7a5364a0b6b4ff783f3cdcf77.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_f292e2a7a5364a0b6b4ff783f3cdcf77.jpg not downloaded yet
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_2e4d9d7a21b8801fb06e4793708385c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_2e4d9d7a21b8801fb06e4793708385c5.jpg not downloaded yet
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_5c3c34b51614ff2afd18cb8516104902.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_5c3c34b51614ff2afd18cb8516104902.jpg not downloaded yet
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_81d5beb2ff0bc99f4f2b4943d4b7810a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_81d5beb2ff0bc99f4f2b4943d4b7810a.jpg not downloaded yet
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_5884f5a227681e5c466d6ea3b8c9a561.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_5884f5a227681e5c466d6ea3b8c9a561.jpg not downloaded yet
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4170490>
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_32b73ee1ee6456e0d84686d45027c98a.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_32b73ee1ee6456e0d84686d45027c98a.jpg saved to cache
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0b0a0686-acd1-5d7d-99c5-4cb3930da994
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4339b50>
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_c2e07b558b7b856beeb79a9fe584f439.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_c2e07b558b7b856beeb79a9fe584f439.jpg saved to cache
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0b0a0686-acd1-5d7d-99c5-4cb3930da994
2026-03-30 10:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_93a6a320703b135e927b0e492fd04fa1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_91f88221ad19288da1ac0b3b5d6c6e67.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_81d5beb2ff0bc99f4f2b4943d4b7810a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_5884f5a227681e5c466d6ea3b8c9a561.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429dd50>
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_93a6a320703b135e927b0e492fd04fa1.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_93a6a320703b135e927b0e492fd04fa1.jpg saved to cache
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5359d38a-d661-53b0-9d4f-1aa81d5608df
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14035aa6d0>
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_91f88221ad19288da1ac0b3b5d6c6e67.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_91f88221ad19288da1ac0b3b5d6c6e67.jpg saved to cache
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5359d38a-d661-53b0-9d4f-1aa81d5608df
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45d950>
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_81d5beb2ff0bc99f4f2b4943d4b7810a.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_81d5beb2ff0bc99f4f2b4943d4b7810a.jpg saved to cache
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5359d38a-d661-53b0-9d4f-1aa81d5608df
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee42ab10>
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_5884f5a227681e5c466d6ea3b8c9a561.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_5884f5a227681e5c466d6ea3b8c9a561.jpg saved to cache
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5359d38a-d661-53b0-9d4f-1aa81d5608df
2026-03-30 10:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_2e4d9d7a21b8801fb06e4793708385c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_5c3c34b51614ff2afd18cb8516104902.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4259090>
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_2e4d9d7a21b8801fb06e4793708385c5.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_2e4d9d7a21b8801fb06e4793708385c5.jpg saved to cache
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5359d38a-d661-53b0-9d4f-1aa81d5608df
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee11910>
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_5c3c34b51614ff2afd18cb8516104902.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_5c3c34b51614ff2afd18cb8516104902.jpg saved to cache
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5359d38a-d661-53b0-9d4f-1aa81d5608df
2026-03-30 10:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_f292e2a7a5364a0b6b4ff783f3cdcf77.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_67e4c55be38bc51541b765b18f971ccd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_82fb0f105a6d0fdf6aac68d009375ad4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee10b90>
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_f292e2a7a5364a0b6b4ff783f3cdcf77.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_f292e2a7a5364a0b6b4ff783f3cdcf77.jpg saved to cache
2026-03-30 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5359d38a-d661-53b0-9d4f-1aa81d5608df
2026-03-30 10:41:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d0490>
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_67e4c55be38bc51541b765b18f971ccd.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_67e4c55be38bc51541b765b18f971ccd.jpg saved to cache
2026-03-30 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5359d38a-d661-53b0-9d4f-1aa81d5608df
2026-03-30 10:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_71fb3d6adbc9084604f131f389d7ddf7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee10dd0>
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_82fb0f105a6d0fdf6aac68d009375ad4.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_82fb0f105a6d0fdf6aac68d009375ad4.jpg saved to cache
2026-03-30 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5359d38a-d661-53b0-9d4f-1aa81d5608df
2026-03-30 10:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_ac9f4158d28298785f6be64acc214004.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4434d0>
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F6b%252F616bc0eb2bbed1ef670391a748689d5c%252Fpa%252FJG32491_71fb3d6adbc9084604f131f389d7ddf7.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_71fb3d6adbc9084604f131f389d7ddf7.jpg saved to cache
2026-03-30 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5359d38a-d661-53b0-9d4f-1aa81d5608df
2026-03-30 10:41:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5359d38a-d661-53b0-9d4f-1aa81d5608df, skipping ID generation
2026-03-30 10:41:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5359d38a-d661-53b0-9d4f-1aa81d5608df with scrape type 1
2026-03-30 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5359d38a-d661-53b0-9d4f-1aa81d5608df sending to next pipeline
2026-03-30 10:41:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5359d38a-d661-53b0-9d4f-1aa81d5608df, identifier: JG32491
2026-03-30 10:41:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5359d38a-d661-53b0-9d4f-1aa81d5608df with identifier: JG32491
2026-03-30 10:41:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5359d38a-d661-53b0-9d4f-1aa81d5608df with identifier: JG32491
2026-03-30 10:41:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5359d38a-d661-53b0-9d4f-1aa81d5608df with identifier: JG32491 to the API
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_71fb3d6adbc9084604f131f389d7ddf7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:30:54Z',
 'fuel_type': 'petrol',
 'id': '5359d38a-d661-53b0-9d4f-1aa81d5608df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG32491',
 'listing': 'auction',
 'location': 'DE, Böblingen',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 98370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_82fb0f105a6d0fdf6aac68d009375ad4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_71fb3d6adbc9084604f131f389d7ddf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_91f88221ad19288da1ac0b3b5d6c6e67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_93a6a320703b135e927b0e492fd04fa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2404882,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_67e4c55be38bc51541b765b18f971ccd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_f292e2a7a5364a0b6b4ff783f3cdcf77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_2e4d9d7a21b8801fb06e4793708385c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_5c3c34b51614ff2afd18cb8516104902.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_81d5beb2ff0bc99f4f2b4943d4b7810a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5359d38a-d661-53b0-9d4f-1aa81d5608df/5359d38a-d661-53b0-9d4f-1aa81d5608df_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/6b/616bc0eb2bbed1ef670391a748689d5c/pa/JG32491_5884f5a227681e5c466d6ea3b8c9a561.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2019}
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG32491%27 HTTP/1.1" 200 None
2026-03-30 10:41:54 [auto1.de] INFO: Saving data for JG32491: {'created_time': 1774867314.887743, 'last_price_update_time': 1774867314.887755, 'auction_closing_time': 1774971054.0}
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG32491') HTTP/1.1" 204 0
2026-03-30 10:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_24ae328586608a25118034d3873efa82.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_1d2e58131d8a9810998e620ee4f6ea4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee12e90>
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_ac9f4158d28298785f6be64acc214004.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_ac9f4158d28298785f6be64acc214004.jpg saved to cache
2026-03-30 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0b0a0686-acd1-5d7d-99c5-4cb3930da994
2026-03-30 10:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC11597> (referer: https://www.auto1.com/v1/car-details-view/EC11597/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_20cf77f3347ec2197188f8d202577580.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d1cd0>
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_24ae328586608a25118034d3873efa82.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_24ae328586608a25118034d3873efa82.jpg saved to cache
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0b0a0686-acd1-5d7d-99c5-4cb3930da994
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee85850>
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_1d2e58131d8a9810998e620ee4f6ea4c.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_1d2e58131d8a9810998e620ee4f6ea4c.jpg saved to cache
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0b0a0686-acd1-5d7d-99c5-4cb3930da994
2026-03-30 10:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_55edf007bbe2a09fc4f467358cbd66cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f1454c4-149a-5094-80ab-ce8696e271a2 with identifier: EC11597
2026-03-30 10:41:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f1454c4-149a-5094-80ab-ce8696e271a2 with scrape type 1
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f1454c4-149a-5094-80ab-ce8696e271a2
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_aa03590a2f2a1af5f1fbfd84002a587b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_aa03590a2f2a1af5f1fbfd84002a587b.jpg not downloaded yet
2026-03-30 10:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_d63570fc8483eadde1b629dbe6a79194.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_e98e6cd1358d8c65c338654ed5e932d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_e98e6cd1358d8c65c338654ed5e932d8.jpg not downloaded yet
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_32a2ddc98c44160bff8eebb022114742.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_32a2ddc98c44160bff8eebb022114742.jpg not downloaded yet
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419bcd0>
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_20cf77f3347ec2197188f8d202577580.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_20cf77f3347ec2197188f8d202577580.jpg saved to cache
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0b0a0686-acd1-5d7d-99c5-4cb3930da994
2026-03-30 10:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_afb95cfcd5b280d8d6e584feb19407e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_d0b044a3b75bd553ddedfb4d5d073208.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_d0b044a3b75bd553ddedfb4d5d073208.jpg not downloaded yet
2026-03-30 10:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_e3782a650661de972e635d6dab67420c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_583bf9a85c65af9adbd6774b3b927cdb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_583bf9a85c65af9adbd6774b3b927cdb.jpg not downloaded yet
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_87273f4a253365182ec0c533ef0c379f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_87273f4a253365182ec0c533ef0c379f.jpg not downloaded yet
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42b7e90>
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_55edf007bbe2a09fc4f467358cbd66cd.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_55edf007bbe2a09fc4f467358cbd66cd.jpg saved to cache
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0b0a0686-acd1-5d7d-99c5-4cb3930da994
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_c961b6160472815368bb0b19aa1aa554.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_c961b6160472815368bb0b19aa1aa554.jpg not downloaded yet
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee5d010>
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_d63570fc8483eadde1b629dbe6a79194.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_d63570fc8483eadde1b629dbe6a79194.jpg saved to cache
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0b0a0686-acd1-5d7d-99c5-4cb3930da994
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_5a38066943bf8b7a96039a2c231e2241.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_5a38066943bf8b7a96039a2c231e2241.jpg not downloaded yet
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee84ed0>
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_afb95cfcd5b280d8d6e584feb19407e8.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_afb95cfcd5b280d8d6e584feb19407e8.jpg saved to cache
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b0a0686-acd1-5d7d-99c5-4cb3930da994
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41e9750>
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Ff5%252F18f5e38c8502c62e3a75217f479e2660%252Fpa%252FWT13361_e3782a650661de972e635d6dab67420c.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_e3782a650661de972e635d6dab67420c.jpg saved to cache
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0b0a0686-acd1-5d7d-99c5-4cb3930da994
2026-03-30 10:41:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b0a0686-acd1-5d7d-99c5-4cb3930da994, skipping ID generation
2026-03-30 10:41:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b0a0686-acd1-5d7d-99c5-4cb3930da994 with scrape type 1
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b0a0686-acd1-5d7d-99c5-4cb3930da994 sending to next pipeline
2026-03-30 10:41:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b0a0686-acd1-5d7d-99c5-4cb3930da994, identifier: WT13361
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_79e6816fefe93e840b115633ec67def4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_79e6816fefe93e840b115633ec67def4.jpg not downloaded yet
2026-03-30 10:41:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b0a0686-acd1-5d7d-99c5-4cb3930da994 with identifier: WT13361
2026-03-30 10:41:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b0a0686-acd1-5d7d-99c5-4cb3930da994 with identifier: WT13361
2026-03-30 10:41:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b0a0686-acd1-5d7d-99c5-4cb3930da994 with identifier: WT13361 to the API
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_e3782a650661de972e635d6dab67420c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:43:50Z',
 'fuel_type': 'petrol',
 'id': '0b0a0686-acd1-5d7d-99c5-4cb3930da994',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT13361',
 'listing': 'auction',
 'location': 'DE, Hamburg',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 82056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_afb95cfcd5b280d8d6e584feb19407e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_e3782a650661de972e635d6dab67420c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_20cf77f3347ec2197188f8d202577580.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_d63570fc8483eadde1b629dbe6a79194.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_55edf007bbe2a09fc4f467358cbd66cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_1d2e58131d8a9810998e620ee4f6ea4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_24ae328586608a25118034d3873efa82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_ac9f4158d28298785f6be64acc214004.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_c2e07b558b7b856beeb79a9fe584f439.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0a0686-acd1-5d7d-99c5-4cb3930da994/0b0a0686-acd1-5d7d-99c5-4cb3930da994_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f5/18f5e38c8502c62e3a75217f479e2660/pa/WT13361_32b73ee1ee6456e0d84686d45027c98a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.4 VTi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2015}
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT13361%27 HTTP/1.1" 200 None
2026-03-30 10:41:56 [auto1.de] INFO: Saving data for WT13361: {'created_time': 1774867316.109085, 'last_price_update_time': 1774867316.109095, 'auction_closing_time': 1774971830.0}
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT13361') HTTP/1.1" 204 0
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_8ddc98aa8ae707b33f090c27b2d47655.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_8ddc98aa8ae707b33f090c27b2d47655.jpg not downloaded yet
2026-03-30 10:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR88294/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_aa03590a2f2a1af5f1fbfd84002a587b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_e98e6cd1358d8c65c338654ed5e932d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_32a2ddc98c44160bff8eebb022114742.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4328a90>
2026-03-30 10:41:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_aa03590a2f2a1af5f1fbfd84002a587b.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_aa03590a2f2a1af5f1fbfd84002a587b.jpg saved to cache
2026-03-30 10:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f1454c4-149a-5094-80ab-ce8696e271a2
2026-03-30 10:41:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee48850>
2026-03-30 10:41:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_e98e6cd1358d8c65c338654ed5e932d8.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_e98e6cd1358d8c65c338654ed5e932d8.jpg saved to cache
2026-03-30 10:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f1454c4-149a-5094-80ab-ce8696e271a2
2026-03-30 10:41:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58bcbd0>
2026-03-30 10:41:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_32a2ddc98c44160bff8eebb022114742.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_32a2ddc98c44160bff8eebb022114742.jpg saved to cache
2026-03-30 10:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f1454c4-149a-5094-80ab-ce8696e271a2
2026-03-30 10:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_8ddc98aa8ae707b33f090c27b2d47655.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_79e6816fefe93e840b115633ec67def4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9c910>
2026-03-30 10:41:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_8ddc98aa8ae707b33f090c27b2d47655.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_8ddc98aa8ae707b33f090c27b2d47655.jpg saved to cache
2026-03-30 10:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f1454c4-149a-5094-80ab-ce8696e271a2
2026-03-30 10:41:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41e8a50>
2026-03-30 10:41:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_79e6816fefe93e840b115633ec67def4.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_79e6816fefe93e840b115633ec67def4.jpg saved to cache
2026-03-30 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f1454c4-149a-5094-80ab-ce8696e271a2
2026-03-30 10:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ41589/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_5a38066943bf8b7a96039a2c231e2241.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_87273f4a253365182ec0c533ef0c379f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_c961b6160472815368bb0b19aa1aa554.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9c910>
2026-03-30 10:41:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_5a38066943bf8b7a96039a2c231e2241.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_5a38066943bf8b7a96039a2c231e2241.jpg saved to cache
2026-03-30 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f1454c4-149a-5094-80ab-ce8696e271a2
2026-03-30 10:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DG14752/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45c290>
2026-03-30 10:41:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_87273f4a253365182ec0c533ef0c379f.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_87273f4a253365182ec0c533ef0c379f.jpg saved to cache
2026-03-30 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f1454c4-149a-5094-80ab-ce8696e271a2
2026-03-30 10:41:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee41bf10>
2026-03-30 10:41:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_c961b6160472815368bb0b19aa1aa554.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_c961b6160472815368bb0b19aa1aa554.jpg saved to cache
2026-03-30 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f1454c4-149a-5094-80ab-ce8696e271a2
2026-03-30 10:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_583bf9a85c65af9adbd6774b3b927cdb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_d0b044a3b75bd553ddedfb4d5d073208.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef58a10>
2026-03-30 10:41:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_583bf9a85c65af9adbd6774b3b927cdb.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_583bf9a85c65af9adbd6774b3b927cdb.jpg saved to cache
2026-03-30 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f1454c4-149a-5094-80ab-ce8696e271a2
2026-03-30 10:41:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee30550>
2026-03-30 10:41:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da1d55426766dafe237b595ad7e2e2%252Fpa%252FEC11597_d0b044a3b75bd553ddedfb4d5d073208.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_d0b044a3b75bd553ddedfb4d5d073208.jpg saved to cache
2026-03-30 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f1454c4-149a-5094-80ab-ce8696e271a2
2026-03-30 10:41:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f1454c4-149a-5094-80ab-ce8696e271a2, skipping ID generation
2026-03-30 10:41:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f1454c4-149a-5094-80ab-ce8696e271a2 with scrape type 1
2026-03-30 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f1454c4-149a-5094-80ab-ce8696e271a2 sending to next pipeline
2026-03-30 10:41:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f1454c4-149a-5094-80ab-ce8696e271a2, identifier: EC11597
2026-03-30 10:41:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f1454c4-149a-5094-80ab-ce8696e271a2 with identifier: EC11597
2026-03-30 10:41:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f1454c4-149a-5094-80ab-ce8696e271a2 with identifier: EC11597
2026-03-30 10:41:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f1454c4-149a-5094-80ab-ce8696e271a2 with identifier: EC11597 to the API
2026-03-30 10:41:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_d0b044a3b75bd553ddedfb4d5d073208.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:58:10Z',
 'fuel_type': 'petrol',
 'id': '9f1454c4-149a-5094-80ab-ce8696e271a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC11597',
 'listing': 'auction',
 'location': 'DE, Freiburg im Breisgau',
 'make': 'BMW',
 'model': '1er',
 'odometer': 136937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2956817,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_aa03590a2f2a1af5f1fbfd84002a587b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3022366,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_e98e6cd1358d8c65c338654ed5e932d8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3101189,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_32a2ddc98c44160bff8eebb022114742.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3076840,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_d0b044a3b75bd553ddedfb4d5d073208.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3151814,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_583bf9a85c65af9adbd6774b3b927cdb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3178301,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_87273f4a253365182ec0c533ef0c379f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3107715,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_c961b6160472815368bb0b19aa1aa554.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3024646,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_5a38066943bf8b7a96039a2c231e2241.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2951578,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_79e6816fefe93e840b115633ec67def4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1454c4-149a-5094-80ab-ce8696e271a2/9f1454c4-149a-5094-80ab-ce8696e271a2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2947132,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da1d55426766dafe237b595ad7e2e2/pa/EC11597_8ddc98aa8ae707b33f090c27b2d47655.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2017}
2026-03-30 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC11597%27 HTTP/1.1" 200 None
2026-03-30 10:41:58 [auto1.de] INFO: Saving data for EC11597: {'created_time': 1774867318.838511, 'last_price_update_time': 1774867318.838525, 'auction_closing_time': 1774972690.0}
2026-03-30 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC11597') HTTP/1.1" 204 0
2026-03-30 10:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF43891> (referer: https://www.auto1.com/v1/car-details-view/GF43891/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3252cdab-90c7-5160-a1e4-470b1fb8e1d5 with identifier: GF43891
2026-03-30 10:41:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3252cdab-90c7-5160-a1e4-470b1fb8e1d5 with scrape type 1
2026-03-30 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3252cdab-90c7-5160-a1e4-470b1fb8e1d5
2026-03-30 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_74983f5da6d590cddde07421fce213f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_74983f5da6d590cddde07421fce213f5.jpg not downloaded yet
2026-03-30 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_a7e2a23551ead40ff8a274e64b62782e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_a7e2a23551ead40ff8a274e64b62782e.jpg not downloaded yet
2026-03-30 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_48c7b767621e6c78d9331c39637cd29e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_48c7b767621e6c78d9331c39637cd29e.jpg not downloaded yet
2026-03-30 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_5d57d3e713c2b9ed076a68c9950727a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_5d57d3e713c2b9ed076a68c9950727a7.jpg not downloaded yet
2026-03-30 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_ed6ff1930e5288f2efd7f03c310d7237.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_ed6ff1930e5288f2efd7f03c310d7237.jpg not downloaded yet
2026-03-30 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_3a76e28c9994ea71643e6baf27e7f0ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_3a76e28c9994ea71643e6baf27e7f0ff.jpg not downloaded yet
2026-03-30 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_e9ba4f03d7b6f772cbbc17b2fce15020.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_e9ba4f03d7b6f772cbbc17b2fce15020.jpg not downloaded yet
2026-03-30 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_33ba972052dd8b6b9ac6156efccd5d78.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_33ba972052dd8b6b9ac6156efccd5d78.jpg not downloaded yet
2026-03-30 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_3c4a844bbf7948a9900d372b7874829c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_3c4a844bbf7948a9900d372b7874829c.jpg not downloaded yet
2026-03-30 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_25df7611626ba888a06b6c05a7c3de89.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_25df7611626ba888a06b6c05a7c3de89.jpg not downloaded yet
2026-03-30 10:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK05047> (referer: https://www.auto1.com/v1/car-details-view/NK05047/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70e3767c-5942-5f45-a690-6985e267efb8 with identifier: NK05047
2026-03-30 10:42:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e3767c-5942-5f45-a690-6985e267efb8 with scrape type 1
2026-03-30 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70e3767c-5942-5f45-a690-6985e267efb8
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb2%252F14b237880a11325b7960ae7af252df14%252Fpa%252FNK05047_896bb42ad6adecec35d53f9f74f7b545.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_896bb42ad6adecec35d53f9f74f7b545.jpg already downloaded
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb2%252F14b237880a11325b7960ae7af252df14%252Fpa%252FNK05047_4a2a5316250b45c71d294e82522b7e1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_4a2a5316250b45c71d294e82522b7e1e.jpg already downloaded
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb2%252F14b237880a11325b7960ae7af252df14%252Fpa%252FNK05047_c759893fed24b02c061141f89035a2ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_c759893fed24b02c061141f89035a2ca.jpg already downloaded
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb2%252F14b237880a11325b7960ae7af252df14%252Fpa%252FNK05047_48b3bc12ea2ae04c6ce41d54072358d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_48b3bc12ea2ae04c6ce41d54072358d0.jpg already downloaded
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb2%252F14b237880a11325b7960ae7af252df14%252Fpa%252FNK05047_8010dc62ef6179d5b1160795661c8775.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_8010dc62ef6179d5b1160795661c8775.jpg already downloaded
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb2%252F14b237880a11325b7960ae7af252df14%252Fpa%252FNK05047_a1ad2f8774d8348700f168e2b4ab408f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_a1ad2f8774d8348700f168e2b4ab408f.jpg already downloaded
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb2%252F14b237880a11325b7960ae7af252df14%252Fpa%252FNK05047_906bd9a81438d86e4d359c9875d5dd8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_906bd9a81438d86e4d359c9875d5dd8d.jpg already downloaded
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb2%252F14b237880a11325b7960ae7af252df14%252Fpa%252FNK05047_fb00bf0f5eb477302d767f6af4631725.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_fb00bf0f5eb477302d767f6af4631725.jpg already downloaded
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb2%252F14b237880a11325b7960ae7af252df14%252Fpa%252FNK05047_002bdfa5a209a7b953b0841cb878e6a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_002bdfa5a209a7b953b0841cb878e6a6.jpg already downloaded
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb2%252F14b237880a11325b7960ae7af252df14%252Fpa%252FNK05047_9c6517c89fac72602acff7d567dbb16e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_9c6517c89fac72602acff7d567dbb16e.jpg already downloaded
2026-03-30 10:42:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70e3767c-5942-5f45-a690-6985e267efb8, identifier: NK05047
2026-03-30 10:42:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70e3767c-5942-5f45-a690-6985e267efb8 with identifier: NK05047
2026-03-30 10:42:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70e3767c-5942-5f45-a690-6985e267efb8 with identifier: NK05047
2026-03-30 10:42:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70e3767c-5942-5f45-a690-6985e267efb8 with identifier: NK05047 to the API
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NK05047>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:40:03Z',
 'fuel_type': 'petrol',
 'id': '70e3767c-5942-5f45-a690-6985e267efb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK05047',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Mazda',
 'model': '2',
 'odometer': 106371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_896bb42ad6adecec35d53f9f74f7b545.jpg',
                'https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_4a2a5316250b45c71d294e82522b7e1e.jpg',
                'https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_c759893fed24b02c061141f89035a2ca.jpg',
                'https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_48b3bc12ea2ae04c6ce41d54072358d0.jpg',
                'https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_8010dc62ef6179d5b1160795661c8775.jpg',
                'https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_a1ad2f8774d8348700f168e2b4ab408f.jpg',
                'https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_906bd9a81438d86e4d359c9875d5dd8d.jpg',
                'https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_fb00bf0f5eb477302d767f6af4631725.jpg',
                'https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_002bdfa5a209a7b953b0841cb878e6a6.jpg',
                'https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_9c6517c89fac72602acff7d567dbb16e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e3767c-5942-5f45-a690-6985e267efb8/70e3767c-5942-5f45-a690-6985e267efb8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_896bb42ad6adecec35d53f9f74f7b545.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e3767c-5942-5f45-a690-6985e267efb8/70e3767c-5942-5f45-a690-6985e267efb8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_4a2a5316250b45c71d294e82522b7e1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e3767c-5942-5f45-a690-6985e267efb8/70e3767c-5942-5f45-a690-6985e267efb8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_c759893fed24b02c061141f89035a2ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e3767c-5942-5f45-a690-6985e267efb8/70e3767c-5942-5f45-a690-6985e267efb8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2783560,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_48b3bc12ea2ae04c6ce41d54072358d0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e3767c-5942-5f45-a690-6985e267efb8/70e3767c-5942-5f45-a690-6985e267efb8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_8010dc62ef6179d5b1160795661c8775.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e3767c-5942-5f45-a690-6985e267efb8/70e3767c-5942-5f45-a690-6985e267efb8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_a1ad2f8774d8348700f168e2b4ab408f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e3767c-5942-5f45-a690-6985e267efb8/70e3767c-5942-5f45-a690-6985e267efb8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2799966,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_906bd9a81438d86e4d359c9875d5dd8d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e3767c-5942-5f45-a690-6985e267efb8/70e3767c-5942-5f45-a690-6985e267efb8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_fb00bf0f5eb477302d767f6af4631725.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e3767c-5942-5f45-a690-6985e267efb8/70e3767c-5942-5f45-a690-6985e267efb8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_002bdfa5a209a7b953b0841cb878e6a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e3767c-5942-5f45-a690-6985e267efb8/70e3767c-5942-5f45-a690-6985e267efb8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/b2/14b237880a11325b7960ae7af252df14/pa/NK05047_9c6517c89fac72602acff7d567dbb16e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 2 1.5 Kizoku',
 'transmission': 'manual',
 'trim': 'Kizoku',
 'year': 2017}
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK05047%27 HTTP/1.1" 200 None
2026-03-30 10:42:01 [auto1.de] INFO: Saving data for NK05047: {'created_time': 1774867321.664133, 'last_price_update_time': 1774867321.664143, 'auction_closing_time': 1774971603.0}
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK05047') HTTP/1.1" 204 0
2026-03-30 10:42:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_25df7611626ba888a06b6c05a7c3de89.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee41ab10>
2026-03-30 10:42:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_25df7611626ba888a06b6c05a7c3de89.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_25df7611626ba888a06b6c05a7c3de89.jpg saved to cache
2026-03-30 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3252cdab-90c7-5160-a1e4-470b1fb8e1d5
2026-03-30 10:42:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_3c4a844bbf7948a9900d372b7874829c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3fba10>
2026-03-30 10:42:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_3c4a844bbf7948a9900d372b7874829c.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_3c4a844bbf7948a9900d372b7874829c.jpg saved to cache
2026-03-30 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3252cdab-90c7-5160-a1e4-470b1fb8e1d5
2026-03-30 10:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_33ba972052dd8b6b9ac6156efccd5d78.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9e750>
2026-03-30 10:42:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_33ba972052dd8b6b9ac6156efccd5d78.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_33ba972052dd8b6b9ac6156efccd5d78.jpg saved to cache
2026-03-30 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3252cdab-90c7-5160-a1e4-470b1fb8e1d5
2026-03-30 10:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_e9ba4f03d7b6f772cbbc17b2fce15020.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MZ56747> (referer: https://www.auto1.com/v1/car-details-view/MZ56747/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f80d0>
2026-03-30 10:42:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_e9ba4f03d7b6f772cbbc17b2fce15020.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_e9ba4f03d7b6f772cbbc17b2fce15020.jpg saved to cache
2026-03-30 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3252cdab-90c7-5160-a1e4-470b1fb8e1d5
2026-03-30 10:42:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19fee1e9-ca91-58e5-9e51-f4a3b7618616 with identifier: MZ56747
2026-03-30 10:42:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19fee1e9-ca91-58e5-9e51-f4a3b7618616 with scrape type 1
2026-03-30 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 19fee1e9-ca91-58e5-9e51-f4a3b7618616
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fdb%252F24dbe33802bee2bc8ada50dfe7dc568c%252Fpa%252FMZ56747_82f3ec6905dc6406493689bd2eb0c69f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_82f3ec6905dc6406493689bd2eb0c69f.jpg already downloaded
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fdb%252F24dbe33802bee2bc8ada50dfe7dc568c%252Fpa%252FMZ56747_ff06dc509883aed32c9785909a0aceeb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_ff06dc509883aed32c9785909a0aceeb.jpg already downloaded
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fdb%252F24dbe33802bee2bc8ada50dfe7dc568c%252Fpa%252FMZ56747_853dd3ea825d0ae1e0d5377495a3c8ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_853dd3ea825d0ae1e0d5377495a3c8ea.jpg already downloaded
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fdb%252F24dbe33802bee2bc8ada50dfe7dc568c%252Fpa%252FMZ56747_37244ae3d4fa6382e33d49a79c373af1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_37244ae3d4fa6382e33d49a79c373af1.jpg already downloaded
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fdb%252F24dbe33802bee2bc8ada50dfe7dc568c%252Fpa%252FMZ56747_a290ae19458f3202f086b30e8214cea2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_a290ae19458f3202f086b30e8214cea2.jpg already downloaded
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fdb%252F24dbe33802bee2bc8ada50dfe7dc568c%252Fpa%252FMZ56747_3313e33642e9094724d02ff9ef9eb4e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_3313e33642e9094724d02ff9ef9eb4e0.jpg already downloaded
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fdb%252F24dbe33802bee2bc8ada50dfe7dc568c%252Fpa%252FMZ56747_a32a8a40c6b5cb986ae99aea8043dbca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_a32a8a40c6b5cb986ae99aea8043dbca.jpg already downloaded
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fdb%252F24dbe33802bee2bc8ada50dfe7dc568c%252Fpa%252FMZ56747_d7bef40a349c89542f7fa3f828c6f2c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_d7bef40a349c89542f7fa3f828c6f2c7.jpg already downloaded
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fdb%252F24dbe33802bee2bc8ada50dfe7dc568c%252Fpa%252FMZ56747_5acf3b55bb601b0ecdbc7b49274c5e2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_5acf3b55bb601b0ecdbc7b49274c5e2b.jpg already downloaded
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fdb%252F24dbe33802bee2bc8ada50dfe7dc568c%252Fpa%252FMZ56747_89aef627731ed5f3774c1015efa33b56.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_89aef627731ed5f3774c1015efa33b56.jpg already downloaded
2026-03-30 10:42:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19fee1e9-ca91-58e5-9e51-f4a3b7618616, identifier: MZ56747
2026-03-30 10:42:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19fee1e9-ca91-58e5-9e51-f4a3b7618616 with identifier: MZ56747
2026-03-30 10:42:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19fee1e9-ca91-58e5-9e51-f4a3b7618616 with identifier: MZ56747
2026-03-30 10:42:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19fee1e9-ca91-58e5-9e51-f4a3b7618616 with identifier: MZ56747 to the API
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MZ56747>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:29:06Z',
 'fuel_type': 'petrol',
 'id': '19fee1e9-ca91-58e5-9e51-f4a3b7618616',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ56747',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 53425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_82f3ec6905dc6406493689bd2eb0c69f.jpg',
                'https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_ff06dc509883aed32c9785909a0aceeb.jpg',
                'https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_853dd3ea825d0ae1e0d5377495a3c8ea.jpg',
                'https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_37244ae3d4fa6382e33d49a79c373af1.jpg',
                'https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_a290ae19458f3202f086b30e8214cea2.jpg',
                'https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_3313e33642e9094724d02ff9ef9eb4e0.jpg',
                'https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_a32a8a40c6b5cb986ae99aea8043dbca.jpg',
                'https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_d7bef40a349c89542f7fa3f828c6f2c7.jpg',
                'https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_5acf3b55bb601b0ecdbc7b49274c5e2b.jpg',
                'https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_89aef627731ed5f3774c1015efa33b56.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19fee1e9-ca91-58e5-9e51-f4a3b7618616/19fee1e9-ca91-58e5-9e51-f4a3b7618616_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_82f3ec6905dc6406493689bd2eb0c69f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19fee1e9-ca91-58e5-9e51-f4a3b7618616/19fee1e9-ca91-58e5-9e51-f4a3b7618616_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_ff06dc509883aed32c9785909a0aceeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19fee1e9-ca91-58e5-9e51-f4a3b7618616/19fee1e9-ca91-58e5-9e51-f4a3b7618616_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_853dd3ea825d0ae1e0d5377495a3c8ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19fee1e9-ca91-58e5-9e51-f4a3b7618616/19fee1e9-ca91-58e5-9e51-f4a3b7618616_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_37244ae3d4fa6382e33d49a79c373af1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19fee1e9-ca91-58e5-9e51-f4a3b7618616/19fee1e9-ca91-58e5-9e51-f4a3b7618616_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_a290ae19458f3202f086b30e8214cea2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19fee1e9-ca91-58e5-9e51-f4a3b7618616/19fee1e9-ca91-58e5-9e51-f4a3b7618616_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_3313e33642e9094724d02ff9ef9eb4e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19fee1e9-ca91-58e5-9e51-f4a3b7618616/19fee1e9-ca91-58e5-9e51-f4a3b7618616_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_a32a8a40c6b5cb986ae99aea8043dbca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19fee1e9-ca91-58e5-9e51-f4a3b7618616/19fee1e9-ca91-58e5-9e51-f4a3b7618616_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_d7bef40a349c89542f7fa3f828c6f2c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19fee1e9-ca91-58e5-9e51-f4a3b7618616/19fee1e9-ca91-58e5-9e51-f4a3b7618616_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_5acf3b55bb601b0ecdbc7b49274c5e2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19fee1e9-ca91-58e5-9e51-f4a3b7618616/19fee1e9-ca91-58e5-9e51-f4a3b7618616_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/db/24dbe33802bee2bc8ada50dfe7dc568c/pa/MZ56747_89aef627731ed5f3774c1015efa33b56.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ56747%27 HTTP/1.1" 200 None
2026-03-30 10:42:03 [auto1.de] INFO: Saving data for MZ56747: {'created_time': 1774867323.591166, 'last_price_update_time': 1774867323.591178, 'auction_closing_time': 1774970946.0}
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ56747') HTTP/1.1" 204 0
2026-03-30 10:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JR21744> (referer: https://www.auto1.com/v1/car-details-view/JR21744/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_3a76e28c9994ea71643e6baf27e7f0ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_5d57d3e713c2b9ed076a68c9950727a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a87a669a-7d3f-5744-8684-756d34bf6e53 with identifier: JR21744
2026-03-30 10:42:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a87a669a-7d3f-5744-8684-756d34bf6e53 with scrape type 1
2026-03-30 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a87a669a-7d3f-5744-8684-756d34bf6e53
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_0f882fd07a1590444a77da98cd79bc80.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_0f882fd07a1590444a77da98cd79bc80.jpg not downloaded yet
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_37b493fe74b3e4455e3c929397540070.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_37b493fe74b3e4455e3c929397540070.jpg not downloaded yet
2026-03-30 10:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_ed6ff1930e5288f2efd7f03c310d7237.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_34b55bebfdf0d1ce2708cddff0b1c98a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_34b55bebfdf0d1ce2708cddff0b1c98a.jpg not downloaded yet
2026-03-30 10:42:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef19150>
2026-03-30 10:42:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_3a76e28c9994ea71643e6baf27e7f0ff.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_3a76e28c9994ea71643e6baf27e7f0ff.jpg saved to cache
2026-03-30 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3252cdab-90c7-5160-a1e4-470b1fb8e1d5
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_5864078b5444e8de3cd914161236a1a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_5864078b5444e8de3cd914161236a1a2.jpg not downloaded yet
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428f850>
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_5d57d3e713c2b9ed076a68c9950727a7.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_5d57d3e713c2b9ed076a68c9950727a7.jpg saved to cache
2026-03-30 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3252cdab-90c7-5160-a1e4-470b1fb8e1d5
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_ef3609bfe1157c4c86738bd1f8affb7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_ef3609bfe1157c4c86738bd1f8affb7b.jpg not downloaded yet
2026-03-30 10:42:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e3d10>
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_ed6ff1930e5288f2efd7f03c310d7237.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_ed6ff1930e5288f2efd7f03c310d7237.jpg saved to cache
2026-03-30 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3252cdab-90c7-5160-a1e4-470b1fb8e1d5
2026-03-30 10:42:04 [scrapy.extensions.logstats] INFO: Crawled 443 pages (at 23 pages/min), scraped 315 items (at 15 items/min)
2026-03-30 10:42:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_64f31bb2be4a946842b4b3d48b5969b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_64f31bb2be4a946842b4b3d48b5969b0.jpg not downloaded yet
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_93f91d0e57abad5057f7f187151fc301.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_93f91d0e57abad5057f7f187151fc301.jpg not downloaded yet
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_eba42613587604416c454feccb0d4cc5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_eba42613587604416c454feccb0d4cc5.jpg not downloaded yet
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_be30f71a8e12a7600712c8809fa7e45d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_be30f71a8e12a7600712c8809fa7e45d.jpg not downloaded yet
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_20f4a859487deed0a9dde6990e9893a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_20f4a859487deed0a9dde6990e9893a4.jpg not downloaded yet
2026-03-30 10:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_48c7b767621e6c78d9331c39637cd29e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_a7e2a23551ead40ff8a274e64b62782e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_34b55bebfdf0d1ce2708cddff0b1c98a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:04 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.281(s), this was the 1st time calling it.
2026-03-30 10:42:04 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.609228354951765 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:42:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3fa890>
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_48c7b767621e6c78d9331c39637cd29e.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_48c7b767621e6c78d9331c39637cd29e.jpg saved to cache
2026-03-30 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3252cdab-90c7-5160-a1e4-470b1fb8e1d5
2026-03-30 10:42:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417e1d0>
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_a7e2a23551ead40ff8a274e64b62782e.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_a7e2a23551ead40ff8a274e64b62782e.jpg saved to cache
2026-03-30 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3252cdab-90c7-5160-a1e4-470b1fb8e1d5
2026-03-30 10:42:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4302350>
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_34b55bebfdf0d1ce2708cddff0b1c98a.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_34b55bebfdf0d1ce2708cddff0b1c98a.jpg saved to cache
2026-03-30 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a87a669a-7d3f-5744-8684-756d34bf6e53
2026-03-30 10:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_20f4a859487deed0a9dde6990e9893a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee60610>
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_20f4a859487deed0a9dde6990e9893a4.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_20f4a859487deed0a9dde6990e9893a4.jpg saved to cache
2026-03-30 10:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a87a669a-7d3f-5744-8684-756d34bf6e53
2026-03-30 10:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_eba42613587604416c454feccb0d4cc5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_93f91d0e57abad5057f7f187151fc301.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee30fd0>
2026-03-30 10:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_eba42613587604416c454feccb0d4cc5.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_eba42613587604416c454feccb0d4cc5.jpg saved to cache
2026-03-30 10:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a87a669a-7d3f-5744-8684-756d34bf6e53
2026-03-30 10:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_be30f71a8e12a7600712c8809fa7e45d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5911b50>
2026-03-30 10:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_93f91d0e57abad5057f7f187151fc301.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_93f91d0e57abad5057f7f187151fc301.jpg saved to cache
2026-03-30 10:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a87a669a-7d3f-5744-8684-756d34bf6e53
2026-03-30 10:42:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4171c10>
2026-03-30 10:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_be30f71a8e12a7600712c8809fa7e45d.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_be30f71a8e12a7600712c8809fa7e45d.jpg saved to cache
2026-03-30 10:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a87a669a-7d3f-5744-8684-756d34bf6e53
2026-03-30 10:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_64f31bb2be4a946842b4b3d48b5969b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9d750>
2026-03-30 10:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_64f31bb2be4a946842b4b3d48b5969b0.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_64f31bb2be4a946842b4b3d48b5969b0.jpg saved to cache
2026-03-30 10:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a87a669a-7d3f-5744-8684-756d34bf6e53
2026-03-30 10:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_37b493fe74b3e4455e3c929397540070.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_ef3609bfe1157c4c86738bd1f8affb7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4258310>
2026-03-30 10:42:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_37b493fe74b3e4455e3c929397540070.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_37b493fe74b3e4455e3c929397540070.jpg saved to cache
2026-03-30 10:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a87a669a-7d3f-5744-8684-756d34bf6e53
2026-03-30 10:42:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9d410>
2026-03-30 10:42:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_ef3609bfe1157c4c86738bd1f8affb7b.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_ef3609bfe1157c4c86738bd1f8affb7b.jpg saved to cache
2026-03-30 10:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a87a669a-7d3f-5744-8684-756d34bf6e53
2026-03-30 10:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_5864078b5444e8de3cd914161236a1a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_0f882fd07a1590444a77da98cd79bc80.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4170e90>
2026-03-30 10:42:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_5864078b5444e8de3cd914161236a1a2.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_5864078b5444e8de3cd914161236a1a2.jpg saved to cache
2026-03-30 10:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a87a669a-7d3f-5744-8684-756d34bf6e53
2026-03-30 10:42:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee63a50>
2026-03-30 10:42:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F1c%252F661cf8270085b5bca10958ee719a594a%252Fpa%252FJR21744_0f882fd07a1590444a77da98cd79bc80.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_0f882fd07a1590444a77da98cd79bc80.jpg saved to cache
2026-03-30 10:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a87a669a-7d3f-5744-8684-756d34bf6e53
2026-03-30 10:42:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a87a669a-7d3f-5744-8684-756d34bf6e53, skipping ID generation
2026-03-30 10:42:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a87a669a-7d3f-5744-8684-756d34bf6e53 with scrape type 1
2026-03-30 10:42:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a87a669a-7d3f-5744-8684-756d34bf6e53 sending to next pipeline
2026-03-30 10:42:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a87a669a-7d3f-5744-8684-756d34bf6e53, identifier: JR21744
2026-03-30 10:42:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a87a669a-7d3f-5744-8684-756d34bf6e53 with identifier: JR21744
2026-03-30 10:42:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a87a669a-7d3f-5744-8684-756d34bf6e53 with identifier: JR21744
2026-03-30 10:42:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a87a669a-7d3f-5744-8684-756d34bf6e53 with identifier: JR21744 to the API
2026-03-30 10:42:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_0f882fd07a1590444a77da98cd79bc80.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:36:31Z',
 'fuel_type': 'petrol',
 'id': 'a87a669a-7d3f-5744-8684-756d34bf6e53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR21744',
 'listing': 'auction',
 'location': 'DE, Rosenheim',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 70320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2935966,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_0f882fd07a1590444a77da98cd79bc80.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2860007,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_37b493fe74b3e4455e3c929397540070.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2886757,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_34b55bebfdf0d1ce2708cddff0b1c98a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2737132,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_5864078b5444e8de3cd914161236a1a2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2948889,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_ef3609bfe1157c4c86738bd1f8affb7b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2915023,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_64f31bb2be4a946842b4b3d48b5969b0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2820886,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_93f91d0e57abad5057f7f187151fc301.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3025977,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_eba42613587604416c454feccb0d4cc5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2979356,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_be30f71a8e12a7600712c8809fa7e45d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a87a669a-7d3f-5744-8684-756d34bf6e53/a87a669a-7d3f-5744-8684-756d34bf6e53_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3022370,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/1c/661cf8270085b5bca10958ee719a594a/pa/JR21744_20f4a859487deed0a9dde6990e9893a4.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 Edition 19 Progressive',
 'transmission': 'automatic',
 'trim': 'Edition 19 Progressive',
 'year': 2020}
2026-03-30 10:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR21744%27 HTTP/1.1" 200 None
2026-03-30 10:42:07 [auto1.de] INFO: Saving data for JR21744: {'created_time': 1774867327.378749, 'last_price_update_time': 1774867327.378761, 'auction_closing_time': 1774971391.0}
2026-03-30 10:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR21744') HTTP/1.1" 204 0
2026-03-30 10:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_74983f5da6d590cddde07421fce213f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_648a68652d547cbcaa6a191a105a2f86.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef59090>
2026-03-30 10:42:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff0%252F51f0cff3dba4d69f9edc48ba76f5c2ad%252Fpa%252FGF43891_74983f5da6d590cddde07421fce213f5.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_74983f5da6d590cddde07421fce213f5.jpg saved to cache
2026-03-30 10:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3252cdab-90c7-5160-a1e4-470b1fb8e1d5
2026-03-30 10:42:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3252cdab-90c7-5160-a1e4-470b1fb8e1d5, skipping ID generation
2026-03-30 10:42:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3252cdab-90c7-5160-a1e4-470b1fb8e1d5 with scrape type 1
2026-03-30 10:42:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3252cdab-90c7-5160-a1e4-470b1fb8e1d5 sending to next pipeline
2026-03-30 10:42:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3252cdab-90c7-5160-a1e4-470b1fb8e1d5, identifier: GF43891
2026-03-30 10:42:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3252cdab-90c7-5160-a1e4-470b1fb8e1d5 with identifier: GF43891
2026-03-30 10:42:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3252cdab-90c7-5160-a1e4-470b1fb8e1d5 with identifier: GF43891
2026-03-30 10:42:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3252cdab-90c7-5160-a1e4-470b1fb8e1d5 with identifier: GF43891 to the API
2026-03-30 10:42:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_74983f5da6d590cddde07421fce213f5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:40:27Z',
 'fuel_type': 'diesel',
 'id': '3252cdab-90c7-5160-a1e4-470b1fb8e1d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF43891',
 'listing': 'auction',
 'location': 'DE, Bruchsal',
 'make': 'BMW',
 'model': '3er',
 'odometer': 218548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2422930,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_74983f5da6d590cddde07421fce213f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2430871,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_a7e2a23551ead40ff8a274e64b62782e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2648755,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_48c7b767621e6c78d9331c39637cd29e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_5d57d3e713c2b9ed076a68c9950727a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2614780,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_ed6ff1930e5288f2efd7f03c310d7237.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2480013,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_3a76e28c9994ea71643e6baf27e7f0ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2442164,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_e9ba4f03d7b6f772cbbc17b2fce15020.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2683942,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_33ba972052dd8b6b9ac6156efccd5d78.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2319331,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_3c4a844bbf7948a9900d372b7874829c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3252cdab-90c7-5160-a1e4-470b1fb8e1d5/3252cdab-90c7-5160-a1e4-470b1fb8e1d5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2716893,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f0/51f0cff3dba4d69f9edc48ba76f5c2ad/pa/GF43891_25df7611626ba888a06b6c05a7c3de89.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2016}
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF43891%27 HTTP/1.1" 200 None
2026-03-30 10:42:08 [auto1.de] INFO: Saving data for GF43891: {'created_time': 1774867328.118641, 'last_price_update_time': 1774867328.118653, 'auction_closing_time': 1774971627.0}
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF43891') HTTP/1.1" 204 0
2026-03-30 10:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_04eb97cbdc437ce76c97534db4ec6a79.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef5b5d0>
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_648a68652d547cbcaa6a191a105a2f86.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_648a68652d547cbcaa6a191a105a2f86.jpg saved to cache
2026-03-30 10:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad24118e-933b-55c2-b932-ddc230f4fbc9
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4170e90>
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d40773be-b764-5bc1-bf4e-84c2f003e6e6/d40773be-b764-5bc1-bf4e-84c2f003e6e6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fce%252F46ceea02c2df7a7c37f32483c89be669%252Fpa%252FMM13759_04eb97cbdc437ce76c97534db4ec6a79.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_04eb97cbdc437ce76c97534db4ec6a79.jpg saved to cache
2026-03-30 10:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d40773be-b764-5bc1-bf4e-84c2f003e6e6
2026-03-30 10:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_0d7287377d8f6e316ed132887dcd424c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_553415c2ba43835eae89556d9e406ccf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4335b90>
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_0d7287377d8f6e316ed132887dcd424c.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_0d7287377d8f6e316ed132887dcd424c.jpg saved to cache
2026-03-30 10:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad24118e-933b-55c2-b932-ddc230f4fbc9
2026-03-30 10:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_9e7a05fb5e24fd9b5919483b2dba561f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee86850>
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d40773be-b764-5bc1-bf4e-84c2f003e6e6/d40773be-b764-5bc1-bf4e-84c2f003e6e6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fce%252F46ceea02c2df7a7c37f32483c89be669%252Fpa%252FMM13759_553415c2ba43835eae89556d9e406ccf.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_553415c2ba43835eae89556d9e406ccf.jpg saved to cache
2026-03-30 10:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d40773be-b764-5bc1-bf4e-84c2f003e6e6
2026-03-30 10:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_2cef67e1807377135baef6e45a63ba32.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e0c50>
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F73%252F2a736c9416b09bbab88fd59a006bfd09%252Fpa%252FJP72611_9e7a05fb5e24fd9b5919483b2dba561f.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_9e7a05fb5e24fd9b5919483b2dba561f.jpg saved to cache
2026-03-30 10:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad24118e-933b-55c2-b932-ddc230f4fbc9
2026-03-30 10:42:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad24118e-933b-55c2-b932-ddc230f4fbc9, skipping ID generation
2026-03-30 10:42:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad24118e-933b-55c2-b932-ddc230f4fbc9 with scrape type 1
2026-03-30 10:42:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad24118e-933b-55c2-b932-ddc230f4fbc9 sending to next pipeline
2026-03-30 10:42:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad24118e-933b-55c2-b932-ddc230f4fbc9, identifier: JP72611
2026-03-30 10:42:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad24118e-933b-55c2-b932-ddc230f4fbc9 with identifier: JP72611
2026-03-30 10:42:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad24118e-933b-55c2-b932-ddc230f4fbc9 with identifier: JP72611
2026-03-30 10:42:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad24118e-933b-55c2-b932-ddc230f4fbc9 with identifier: JP72611 to the API
2026-03-30 10:42:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_9e7a05fb5e24fd9b5919483b2dba561f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:25:24Z',
 'fuel_type': 'petrol',
 'id': 'ad24118e-933b-55c2-b932-ddc230f4fbc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP72611',
 'listing': 'auction',
 'location': 'DE, Waiblingen',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 168670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_9e7a05fb5e24fd9b5919483b2dba561f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_0d7287377d8f6e316ed132887dcd424c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_648a68652d547cbcaa6a191a105a2f86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_9cceb58ecfeb7e69d394b2807f9429b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_4b60982efa35c2f323725af0b8580567.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_e523cdb15df185d90a752cc6bb9e821b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_3429f151e147e90283dd7999c83176f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_9193292892e87b858c13b5c2ccf4256b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_773a89e0b7e6ee9415167375fa9bd755.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad24118e-933b-55c2-b932-ddc230f4fbc9/ad24118e-933b-55c2-b932-ddc230f4fbc9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/73/2a736c9416b09bbab88fd59a006bfd09/pa/JP72611_b02be9cf663e0decaeb4f8631199c883.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-30 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP72611%27 HTTP/1.1" 200 None
2026-03-30 10:42:09 [auto1.de] INFO: Saving data for JP72611: {'created_time': 1774867329.24028, 'last_price_update_time': 1774867329.240291, 'auction_closing_time': 1774970724.0}
2026-03-30 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP72611') HTTP/1.1" 204 0
2026-03-30 10:42:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_455a9a9c5474ae52bd2d0ae73b57f989.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f59112d0>
2026-03-30 10:42:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d40773be-b764-5bc1-bf4e-84c2f003e6e6/d40773be-b764-5bc1-bf4e-84c2f003e6e6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fce%252F46ceea02c2df7a7c37f32483c89be669%252Fpa%252FMM13759_2cef67e1807377135baef6e45a63ba32.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_2cef67e1807377135baef6e45a63ba32.jpg saved to cache
2026-03-30 10:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d40773be-b764-5bc1-bf4e-84c2f003e6e6
2026-03-30 10:42:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4141990>
2026-03-30 10:42:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d40773be-b764-5bc1-bf4e-84c2f003e6e6/d40773be-b764-5bc1-bf4e-84c2f003e6e6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fce%252F46ceea02c2df7a7c37f32483c89be669%252Fpa%252FMM13759_455a9a9c5474ae52bd2d0ae73b57f989.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_455a9a9c5474ae52bd2d0ae73b57f989.jpg saved to cache
2026-03-30 10:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d40773be-b764-5bc1-bf4e-84c2f003e6e6
2026-03-30 10:42:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d40773be-b764-5bc1-bf4e-84c2f003e6e6, skipping ID generation
2026-03-30 10:42:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d40773be-b764-5bc1-bf4e-84c2f003e6e6 with scrape type 1
2026-03-30 10:42:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d40773be-b764-5bc1-bf4e-84c2f003e6e6 sending to next pipeline
2026-03-30 10:42:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d40773be-b764-5bc1-bf4e-84c2f003e6e6, identifier: MM13759
2026-03-30 10:42:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d40773be-b764-5bc1-bf4e-84c2f003e6e6 with identifier: MM13759
2026-03-30 10:42:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d40773be-b764-5bc1-bf4e-84c2f003e6e6 with identifier: MM13759
2026-03-30 10:42:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d40773be-b764-5bc1-bf4e-84c2f003e6e6 with identifier: MM13759 to the API
2026-03-30 10:42:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_455a9a9c5474ae52bd2d0ae73b57f989.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:08:01Z',
 'fuel_type': 'diesel',
 'id': 'd40773be-b764-5bc1-bf4e-84c2f003e6e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM13759',
 'listing': 'auction',
 'location': 'DE, Donaueschingen',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 191731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d40773be-b764-5bc1-bf4e-84c2f003e6e6/d40773be-b764-5bc1-bf4e-84c2f003e6e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_455a9a9c5474ae52bd2d0ae73b57f989.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d40773be-b764-5bc1-bf4e-84c2f003e6e6/d40773be-b764-5bc1-bf4e-84c2f003e6e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_2cef67e1807377135baef6e45a63ba32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d40773be-b764-5bc1-bf4e-84c2f003e6e6/d40773be-b764-5bc1-bf4e-84c2f003e6e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_553415c2ba43835eae89556d9e406ccf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d40773be-b764-5bc1-bf4e-84c2f003e6e6/d40773be-b764-5bc1-bf4e-84c2f003e6e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_04eb97cbdc437ce76c97534db4ec6a79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d40773be-b764-5bc1-bf4e-84c2f003e6e6/d40773be-b764-5bc1-bf4e-84c2f003e6e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_3c5ad713a859216426efdda72cdbe691.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d40773be-b764-5bc1-bf4e-84c2f003e6e6/d40773be-b764-5bc1-bf4e-84c2f003e6e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/ce/46ceea02c2df7a7c37f32483c89be669/pa/MM13759_f89578478da8b1dedacb352325cbd11c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2008}
2026-03-30 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM13759%27 HTTP/1.1" 200 None
2026-03-30 10:42:09 [auto1.de] INFO: Saving data for MM13759: {'created_time': 1774867329.903022, 'last_price_update_time': 1774867329.903033, 'auction_closing_time': 1774969681.0}
2026-03-30 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM13759') HTTP/1.1" 204 0
2026-03-30 10:42:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:42:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY24892> (referer: https://www.auto1.com/v1/car-details-view/DY24892/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c0b0718-7398-5ddc-b63c-60f5d50ddf25 with identifier: DY24892
2026-03-30 10:42:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c0b0718-7398-5ddc-b63c-60f5d50ddf25 with scrape type 1
2026-03-30 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c0b0718-7398-5ddc-b63c-60f5d50ddf25
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_03cbf3a6a40b6950a0c4477817fd0794.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_03cbf3a6a40b6950a0c4477817fd0794.jpg not downloaded yet
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_4f25c1268c705f92b66c155657e9650d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_4f25c1268c705f92b66c155657e9650d.jpg not downloaded yet
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_bf9600da0b13ed48c47a1f2e72e3ea01.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_bf9600da0b13ed48c47a1f2e72e3ea01.jpg not downloaded yet
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_1cb9496d50be423fc6d75ea2f6df6c77.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_1cb9496d50be423fc6d75ea2f6df6c77.jpg not downloaded yet
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_ed070c0b7aa74b7b14b9ef152cbdafa1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_ed070c0b7aa74b7b14b9ef152cbdafa1.jpg not downloaded yet
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_3022d4ffce21a464a5239dc3702759f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_3022d4ffce21a464a5239dc3702759f2.jpg not downloaded yet
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_f4223fe3a013075c2b6c50fd93d5d2ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_f4223fe3a013075c2b6c50fd93d5d2ab.jpg not downloaded yet
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_0e4515d490086ad64d063e7e8211f597.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_0e4515d490086ad64d063e7e8211f597.jpg not downloaded yet
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_20e7f332ce8fcce940e65592327ed7d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_20e7f332ce8fcce940e65592327ed7d2.jpg not downloaded yet
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_94e04fa0d5154df2f5f9ee0b3e59981a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_94e04fa0d5154df2f5f9ee0b3e59981a.jpg not downloaded yet
2026-03-30 10:42:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YN89377> (referer: https://www.auto1.com/v1/car-details-view/YN89377/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_94e04fa0d5154df2f5f9ee0b3e59981a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c360fc90-e4f5-5032-ad8f-f0e340fd2a57 with identifier: YN89377
2026-03-30 10:42:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c360fc90-e4f5-5032-ad8f-f0e340fd2a57 with scrape type 1
2026-03-30 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c360fc90-e4f5-5032-ad8f-f0e340fd2a57
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_d7137dd5775d0d16496d19a68728f12f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_d7137dd5775d0d16496d19a68728f12f.jpg not downloaded yet
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_a01e285d5f4c6c0148959e007f3c2ea9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_a01e285d5f4c6c0148959e007f3c2ea9.jpg not downloaded yet
2026-03-30 10:42:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_20e7f332ce8fcce940e65592327ed7d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_381d10b5f15186c46fa9da757dd445ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_381d10b5f15186c46fa9da757dd445ba.jpg not downloaded yet
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_5223d621468fad5601a4539fe28ef5f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_5223d621468fad5601a4539fe28ef5f1.jpg not downloaded yet
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_8f214f9d247201eb0aaaaf7a1e2c8c05.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_8f214f9d247201eb0aaaaf7a1e2c8c05.jpg not downloaded yet
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_652a055fe74836c17fa744281a7ac6b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_652a055fe74836c17fa744281a7ac6b7.jpg not downloaded yet
2026-03-30 10:42:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f432b3d0>
2026-03-30 10:42:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_94e04fa0d5154df2f5f9ee0b3e59981a.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_94e04fa0d5154df2f5f9ee0b3e59981a.jpg saved to cache
2026-03-30 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c0b0718-7398-5ddc-b63c-60f5d50ddf25
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_d4c46fa77ee8d04e3a729acf2a560ace.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_d4c46fa77ee8d04e3a729acf2a560ace.jpg not downloaded yet
2026-03-30 10:42:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f425b710>
2026-03-30 10:42:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_20e7f332ce8fcce940e65592327ed7d2.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_20e7f332ce8fcce940e65592327ed7d2.jpg saved to cache
2026-03-30 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c0b0718-7398-5ddc-b63c-60f5d50ddf25
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_8d4ba4928fa1e896e2931605aee2b77a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_8d4ba4928fa1e896e2931605aee2b77a.jpg not downloaded yet
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_d1e61a5b8de0d6e93e5ba3798044ef87.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_d1e61a5b8de0d6e93e5ba3798044ef87.jpg not downloaded yet
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_10395e3bd9385b1f262e30213688c720.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_10395e3bd9385b1f262e30213688c720.jpg not downloaded yet
2026-03-30 10:42:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_a01e285d5f4c6c0148959e007f3c2ea9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43367d0>
2026-03-30 10:42:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_a01e285d5f4c6c0148959e007f3c2ea9.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_a01e285d5f4c6c0148959e007f3c2ea9.jpg saved to cache
2026-03-30 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c360fc90-e4f5-5032-ad8f-f0e340fd2a57
2026-03-30 10:42:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_10395e3bd9385b1f262e30213688c720.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41eae90>
2026-03-30 10:42:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_10395e3bd9385b1f262e30213688c720.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_10395e3bd9385b1f262e30213688c720.jpg saved to cache
2026-03-30 10:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c360fc90-e4f5-5032-ad8f-f0e340fd2a57
2026-03-30 10:42:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_d1e61a5b8de0d6e93e5ba3798044ef87.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e3050>
2026-03-30 10:42:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_d1e61a5b8de0d6e93e5ba3798044ef87.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_d1e61a5b8de0d6e93e5ba3798044ef87.jpg saved to cache
2026-03-30 10:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c360fc90-e4f5-5032-ad8f-f0e340fd2a57
2026-03-30 10:42:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_8d4ba4928fa1e896e2931605aee2b77a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea0590>
2026-03-30 10:42:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_8d4ba4928fa1e896e2931605aee2b77a.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_8d4ba4928fa1e896e2931605aee2b77a.jpg saved to cache
2026-03-30 10:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c360fc90-e4f5-5032-ad8f-f0e340fd2a57
2026-03-30 10:42:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_d4c46fa77ee8d04e3a729acf2a560ace.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee01fd0>
2026-03-30 10:42:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_d4c46fa77ee8d04e3a729acf2a560ace.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_d4c46fa77ee8d04e3a729acf2a560ace.jpg saved to cache
2026-03-30 10:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c360fc90-e4f5-5032-ad8f-f0e340fd2a57
2026-03-30 10:42:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR15426/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_652a055fe74836c17fa744281a7ac6b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef6f90>
2026-03-30 10:42:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_652a055fe74836c17fa744281a7ac6b7.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_652a055fe74836c17fa744281a7ac6b7.jpg saved to cache
2026-03-30 10:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c360fc90-e4f5-5032-ad8f-f0e340fd2a57
2026-03-30 10:42:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_8f214f9d247201eb0aaaaf7a1e2c8c05.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea3c90>
2026-03-30 10:42:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_8f214f9d247201eb0aaaaf7a1e2c8c05.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_8f214f9d247201eb0aaaaf7a1e2c8c05.jpg saved to cache
2026-03-30 10:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c360fc90-e4f5-5032-ad8f-f0e340fd2a57
2026-03-30 10:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_5223d621468fad5601a4539fe28ef5f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4142a50>
2026-03-30 10:42:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_5223d621468fad5601a4539fe28ef5f1.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_5223d621468fad5601a4539fe28ef5f1.jpg saved to cache
2026-03-30 10:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c360fc90-e4f5-5032-ad8f-f0e340fd2a57
2026-03-30 10:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_381d10b5f15186c46fa9da757dd445ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4177a90>
2026-03-30 10:42:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_381d10b5f15186c46fa9da757dd445ba.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_381d10b5f15186c46fa9da757dd445ba.jpg saved to cache
2026-03-30 10:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c360fc90-e4f5-5032-ad8f-f0e340fd2a57
2026-03-30 10:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_d7137dd5775d0d16496d19a68728f12f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_0e4515d490086ad64d063e7e8211f597.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c0e990>
2026-03-30 10:42:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F44%252Fcf4474e58f208498d2d6a136dabdc0bc%252Fpa%252FYN89377_d7137dd5775d0d16496d19a68728f12f.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_d7137dd5775d0d16496d19a68728f12f.jpg saved to cache
2026-03-30 10:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c360fc90-e4f5-5032-ad8f-f0e340fd2a57
2026-03-30 10:42:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c360fc90-e4f5-5032-ad8f-f0e340fd2a57, skipping ID generation
2026-03-30 10:42:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c360fc90-e4f5-5032-ad8f-f0e340fd2a57 with scrape type 1
2026-03-30 10:42:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c360fc90-e4f5-5032-ad8f-f0e340fd2a57 sending to next pipeline
2026-03-30 10:42:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c360fc90-e4f5-5032-ad8f-f0e340fd2a57, identifier: YN89377
2026-03-30 10:42:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c360fc90-e4f5-5032-ad8f-f0e340fd2a57 with identifier: YN89377
2026-03-30 10:42:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c360fc90-e4f5-5032-ad8f-f0e340fd2a57 with identifier: YN89377
2026-03-30 10:42:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c360fc90-e4f5-5032-ad8f-f0e340fd2a57 with identifier: YN89377 to the API
2026-03-30 10:42:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_d7137dd5775d0d16496d19a68728f12f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 221,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.5L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-31T15:14:42Z',
 'fuel_type': 'diesel',
 'id': 'c360fc90-e4f5-5032-ad8f-f0e340fd2a57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN89377',
 'listing': 'auction',
 'location': 'DE, Reutlingen',
 'make': 'Volkswagen',
 'model': 'T5 Caravelle',
 'odometer': 177285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2918574,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_d7137dd5775d0d16496d19a68728f12f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2995599,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_a01e285d5f4c6c0148959e007f3c2ea9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2995447,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_381d10b5f15186c46fa9da757dd445ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2870851,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_5223d621468fad5601a4539fe28ef5f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3104701,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_8f214f9d247201eb0aaaaf7a1e2c8c05.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3002156,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_652a055fe74836c17fa744281a7ac6b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2776161,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_d4c46fa77ee8d04e3a729acf2a560ace.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2884969,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_8d4ba4928fa1e896e2931605aee2b77a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2833064,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_d1e61a5b8de0d6e93e5ba3798044ef87.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c360fc90-e4f5-5032-ad8f-f0e340fd2a57/c360fc90-e4f5-5032-ad8f-f0e340fd2a57_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3112014,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/44/cf4474e58f208498d2d6a136dabdc0bc/pa/YN89377_10395e3bd9385b1f262e30213688c720.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-09-17',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Volkswagen T5 Caravelle 2.5 TDI Comfortline lang',
 'transmission': 'manual',
 'trim': 'Comfortline lang',
 'year': 2008}
2026-03-30 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN89377%27 HTTP/1.1" 200 None
2026-03-30 10:42:17 [auto1.de] INFO: Saving data for YN89377: {'created_time': 1774867337.701929, 'last_price_update_time': 1774867337.70194, 'auction_closing_time': 1774970082.0}
2026-03-30 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN89377') HTTP/1.1" 204 0
2026-03-30 10:42:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_f4223fe3a013075c2b6c50fd93d5d2ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e00d0>
2026-03-30 10:42:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_0e4515d490086ad64d063e7e8211f597.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_0e4515d490086ad64d063e7e8211f597.jpg saved to cache
2026-03-30 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c0b0718-7398-5ddc-b63c-60f5d50ddf25
2026-03-30 10:42:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c03e10>
2026-03-30 10:42:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_f4223fe3a013075c2b6c50fd93d5d2ab.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_f4223fe3a013075c2b6c50fd93d5d2ab.jpg saved to cache
2026-03-30 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c0b0718-7398-5ddc-b63c-60f5d50ddf25
2026-03-30 10:42:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_3022d4ffce21a464a5239dc3702759f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_ed070c0b7aa74b7b14b9ef152cbdafa1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee80a10>
2026-03-30 10:42:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_3022d4ffce21a464a5239dc3702759f2.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_3022d4ffce21a464a5239dc3702759f2.jpg saved to cache
2026-03-30 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c0b0718-7398-5ddc-b63c-60f5d50ddf25
2026-03-30 10:42:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_1cb9496d50be423fc6d75ea2f6df6c77.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4184c10>
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_ed070c0b7aa74b7b14b9ef152cbdafa1.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_ed070c0b7aa74b7b14b9ef152cbdafa1.jpg saved to cache
2026-03-30 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c0b0718-7398-5ddc-b63c-60f5d50ddf25
2026-03-30 10:42:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_bf9600da0b13ed48c47a1f2e72e3ea01.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee82250>
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_1cb9496d50be423fc6d75ea2f6df6c77.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_1cb9496d50be423fc6d75ea2f6df6c77.jpg saved to cache
2026-03-30 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c0b0718-7398-5ddc-b63c-60f5d50ddf25
2026-03-30 10:42:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_4f25c1268c705f92b66c155657e9650d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45f590>
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_bf9600da0b13ed48c47a1f2e72e3ea01.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_bf9600da0b13ed48c47a1f2e72e3ea01.jpg saved to cache
2026-03-30 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c0b0718-7398-5ddc-b63c-60f5d50ddf25
2026-03-30 10:42:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_03cbf3a6a40b6950a0c4477817fd0794.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c03e90>
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_4f25c1268c705f92b66c155657e9650d.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_4f25c1268c705f92b66c155657e9650d.jpg saved to cache
2026-03-30 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c0b0718-7398-5ddc-b63c-60f5d50ddf25
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee06a10>
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F18%252Fdd1867f1e9090f9343db4f33ae7df4d0%252Fpa%252FDY24892_03cbf3a6a40b6950a0c4477817fd0794.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_03cbf3a6a40b6950a0c4477817fd0794.jpg saved to cache
2026-03-30 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c0b0718-7398-5ddc-b63c-60f5d50ddf25
2026-03-30 10:42:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c0b0718-7398-5ddc-b63c-60f5d50ddf25, skipping ID generation
2026-03-30 10:42:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c0b0718-7398-5ddc-b63c-60f5d50ddf25 with scrape type 1
2026-03-30 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c0b0718-7398-5ddc-b63c-60f5d50ddf25 sending to next pipeline
2026-03-30 10:42:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c0b0718-7398-5ddc-b63c-60f5d50ddf25, identifier: DY24892
2026-03-30 10:42:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c0b0718-7398-5ddc-b63c-60f5d50ddf25 with identifier: DY24892
2026-03-30 10:42:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c0b0718-7398-5ddc-b63c-60f5d50ddf25 with identifier: DY24892
2026-03-30 10:42:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c0b0718-7398-5ddc-b63c-60f5d50ddf25 with identifier: DY24892 to the API
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_03cbf3a6a40b6950a0c4477817fd0794.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:35:26Z',
 'fuel_type': 'diesel',
 'id': '8c0b0718-7398-5ddc-b63c-60f5d50ddf25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY24892',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 95579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_03cbf3a6a40b6950a0c4477817fd0794.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_4f25c1268c705f92b66c155657e9650d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_bf9600da0b13ed48c47a1f2e72e3ea01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_1cb9496d50be423fc6d75ea2f6df6c77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_ed070c0b7aa74b7b14b9ef152cbdafa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_3022d4ffce21a464a5239dc3702759f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_f4223fe3a013075c2b6c50fd93d5d2ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_0e4515d490086ad64d063e7e8211f597.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_20e7f332ce8fcce940e65592327ed7d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0b0718-7398-5ddc-b63c-60f5d50ddf25/8c0b0718-7398-5ddc-b63c-60f5d50ddf25_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/18/dd1867f1e9090f9343db4f33ae7df4d0/pa/DY24892_94e04fa0d5154df2f5f9ee0b3e59981a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.5 TDCi EcoBlue Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2020}
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY24892%27 HTTP/1.1" 200 None
2026-03-30 10:42:18 [auto1.de] INFO: Saving data for DY24892: {'created_time': 1774867338.883299, 'last_price_update_time': 1774867338.883312, 'auction_closing_time': 1774971326.0}
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY24892') HTTP/1.1" 204 0
2026-03-30 10:42:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR88294> (referer: https://www.auto1.com/v1/car-details-view/LR88294/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86df853a-1e77-52b2-af9b-e63475535d6c with identifier: LR88294
2026-03-30 10:42:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86df853a-1e77-52b2-af9b-e63475535d6c with scrape type 1
2026-03-30 10:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 86df853a-1e77-52b2-af9b-e63475535d6c
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_82ee845bb5525ef225b0c7375a96dc84.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_82ee845bb5525ef225b0c7375a96dc84.jpg not downloaded yet
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_d45224139b4f66f47b78b623494d24d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_d45224139b4f66f47b78b623494d24d8.jpg not downloaded yet
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_54ecd9a0891775357e5fc726ee0d15bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_54ecd9a0891775357e5fc726ee0d15bc.jpg not downloaded yet
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_200c26c9a5382e3dbd8bf5c29d702d54.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_200c26c9a5382e3dbd8bf5c29d702d54.jpg not downloaded yet
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_fd05ce69cfd5f5309132f128ac8e1a2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_fd05ce69cfd5f5309132f128ac8e1a2a.jpg not downloaded yet
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_0df24c5fea533e7e37ad9b4f8fa92d5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_0df24c5fea533e7e37ad9b4f8fa92d5d.jpg not downloaded yet
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_14c6832ff3b860ae3bf37de6445f58e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_14c6832ff3b860ae3bf37de6445f58e1.jpg not downloaded yet
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_3133927b4ead3aef5e376d156243e943.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_3133927b4ead3aef5e376d156243e943.jpg not downloaded yet
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_99c91d45aeec10c8efd2f23a87e6b9de.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_99c91d45aeec10c8efd2f23a87e6b9de.jpg not downloaded yet
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_855746a3c993ad061e1805f031d9a04c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_855746a3c993ad061e1805f031d9a04c.jpg not downloaded yet
2026-03-30 10:42:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_1017b52df601dc16a4833e271f666617.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea1590>
2026-03-30 10:42:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_1017b52df601dc16a4833e271f666617.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_1017b52df601dc16a4833e271f666617.jpg saved to cache
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40a28f27-542a-5231-9511-1da844e4fb9b
2026-03-30 10:42:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ41589> (referer: https://www.auto1.com/v1/car-details-view/LZ41589/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_855746a3c993ad061e1805f031d9a04c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5927bac1-7634-5ba2-86cb-c5a85eb30a47 with identifier: LZ41589
2026-03-30 10:42:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5927bac1-7634-5ba2-86cb-c5a85eb30a47 with scrape type 1
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5927bac1-7634-5ba2-86cb-c5a85eb30a47
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6b%252Fe16b384b058bc7627897cbed72fdda45%252Fpa%252FLZ41589_8b363c57f24d18bdb64624f819381ff9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_8b363c57f24d18bdb64624f819381ff9.jpg already downloaded
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6b%252Fe16b384b058bc7627897cbed72fdda45%252Fpa%252FLZ41589_2e1048be2224f61920953de6423c37a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_2e1048be2224f61920953de6423c37a3.jpg already downloaded
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6b%252Fe16b384b058bc7627897cbed72fdda45%252Fpa%252FLZ41589_66919dd75f762125b917a3b50c0aae52.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_66919dd75f762125b917a3b50c0aae52.jpg already downloaded
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6b%252Fe16b384b058bc7627897cbed72fdda45%252Fpa%252FLZ41589_1690b6b0d0134049b800143020c4b8ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_1690b6b0d0134049b800143020c4b8ff.jpg already downloaded
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6b%252Fe16b384b058bc7627897cbed72fdda45%252Fpa%252FLZ41589_0bf2e304ddeba56316c8a68172445207.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_0bf2e304ddeba56316c8a68172445207.jpg already downloaded
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6b%252Fe16b384b058bc7627897cbed72fdda45%252Fpa%252FLZ41589_b2b5e9dcaca1dbb43aab0d3dd64aeb15.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_b2b5e9dcaca1dbb43aab0d3dd64aeb15.jpg already downloaded
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6b%252Fe16b384b058bc7627897cbed72fdda45%252Fpa%252FLZ41589_861838e75b5f88b623d02006e6e0282a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_861838e75b5f88b623d02006e6e0282a.jpg already downloaded
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6b%252Fe16b384b058bc7627897cbed72fdda45%252Fpa%252FLZ41589_b515b39163daead6906f5014b3121b80.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_b515b39163daead6906f5014b3121b80.jpg already downloaded
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6b%252Fe16b384b058bc7627897cbed72fdda45%252Fpa%252FLZ41589_9799c8163786ef273ef5fd505f5b01c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_9799c8163786ef273ef5fd505f5b01c4.jpg already downloaded
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6b%252Fe16b384b058bc7627897cbed72fdda45%252Fpa%252FLZ41589_7844966b7c45c3997d9a00e0153a045f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_7844966b7c45c3997d9a00e0153a045f.jpg already downloaded
2026-03-30 10:42:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5927bac1-7634-5ba2-86cb-c5a85eb30a47, identifier: LZ41589
2026-03-30 10:42:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5927bac1-7634-5ba2-86cb-c5a85eb30a47 with identifier: LZ41589
2026-03-30 10:42:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5927bac1-7634-5ba2-86cb-c5a85eb30a47 with identifier: LZ41589
2026-03-30 10:42:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5927bac1-7634-5ba2-86cb-c5a85eb30a47 with identifier: LZ41589 to the API
2026-03-30 10:42:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LZ41589>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:52:08Z',
 'fuel_type': 'diesel',
 'id': '5927bac1-7634-5ba2-86cb-c5a85eb30a47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ41589',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Nissan',
 'model': 'NP300 Pick-up',
 'odometer': 122979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_8b363c57f24d18bdb64624f819381ff9.jpg',
                'https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_2e1048be2224f61920953de6423c37a3.jpg',
                'https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_66919dd75f762125b917a3b50c0aae52.jpg',
                'https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_1690b6b0d0134049b800143020c4b8ff.jpg',
                'https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_0bf2e304ddeba56316c8a68172445207.jpg',
                'https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_b2b5e9dcaca1dbb43aab0d3dd64aeb15.jpg',
                'https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_861838e75b5f88b623d02006e6e0282a.jpg',
                'https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_b515b39163daead6906f5014b3121b80.jpg',
                'https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_9799c8163786ef273ef5fd505f5b01c4.jpg',
                'https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_7844966b7c45c3997d9a00e0153a045f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5927bac1-7634-5ba2-86cb-c5a85eb30a47/5927bac1-7634-5ba2-86cb-c5a85eb30a47_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_8b363c57f24d18bdb64624f819381ff9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5927bac1-7634-5ba2-86cb-c5a85eb30a47/5927bac1-7634-5ba2-86cb-c5a85eb30a47_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_2e1048be2224f61920953de6423c37a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5927bac1-7634-5ba2-86cb-c5a85eb30a47/5927bac1-7634-5ba2-86cb-c5a85eb30a47_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3116921,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_66919dd75f762125b917a3b50c0aae52.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5927bac1-7634-5ba2-86cb-c5a85eb30a47/5927bac1-7634-5ba2-86cb-c5a85eb30a47_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_1690b6b0d0134049b800143020c4b8ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5927bac1-7634-5ba2-86cb-c5a85eb30a47/5927bac1-7634-5ba2-86cb-c5a85eb30a47_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3338533,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_0bf2e304ddeba56316c8a68172445207.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5927bac1-7634-5ba2-86cb-c5a85eb30a47/5927bac1-7634-5ba2-86cb-c5a85eb30a47_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_b2b5e9dcaca1dbb43aab0d3dd64aeb15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5927bac1-7634-5ba2-86cb-c5a85eb30a47/5927bac1-7634-5ba2-86cb-c5a85eb30a47_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3194810,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_861838e75b5f88b623d02006e6e0282a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5927bac1-7634-5ba2-86cb-c5a85eb30a47/5927bac1-7634-5ba2-86cb-c5a85eb30a47_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_b515b39163daead6906f5014b3121b80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5927bac1-7634-5ba2-86cb-c5a85eb30a47/5927bac1-7634-5ba2-86cb-c5a85eb30a47_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3177934,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_9799c8163786ef273ef5fd505f5b01c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5927bac1-7634-5ba2-86cb-c5a85eb30a47/5927bac1-7634-5ba2-86cb-c5a85eb30a47_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6b/e16b384b058bc7627897cbed72fdda45/pa/LZ41589_7844966b7c45c3997d9a00e0153a045f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan NP300 Pick-up 2.3 dCi Tekna Double Cab 4x4',
 'transmission': 'automatic',
 'trim': 'Tekna Double Cab 4x4',
 'year': 2017}
2026-03-30 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ41589%27 HTTP/1.1" 200 None
2026-03-30 10:42:21 [auto1.de] INFO: Saving data for LZ41589: {'created_time': 1774867341.501656, 'last_price_update_time': 1774867341.501667, 'auction_closing_time': 1774972328.0}
2026-03-30 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ41589') HTTP/1.1" 204 0
2026-03-30 10:42:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee33d10>
2026-03-30 10:42:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_855746a3c993ad061e1805f031d9a04c.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_855746a3c993ad061e1805f031d9a04c.jpg saved to cache
2026-03-30 10:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86df853a-1e77-52b2-af9b-e63475535d6c
2026-03-30 10:42:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_99c91d45aeec10c8efd2f23a87e6b9de.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_3133927b4ead3aef5e376d156243e943.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5958410>
2026-03-30 10:42:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_99c91d45aeec10c8efd2f23a87e6b9de.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_99c91d45aeec10c8efd2f23a87e6b9de.jpg saved to cache
2026-03-30 10:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 86df853a-1e77-52b2-af9b-e63475535d6c
2026-03-30 10:42:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef5a810>
2026-03-30 10:42:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_3133927b4ead3aef5e376d156243e943.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_3133927b4ead3aef5e376d156243e943.jpg saved to cache
2026-03-30 10:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86df853a-1e77-52b2-af9b-e63475535d6c
2026-03-30 10:42:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_14c6832ff3b860ae3bf37de6445f58e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41d81d0>
2026-03-30 10:42:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_14c6832ff3b860ae3bf37de6445f58e1.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_14c6832ff3b860ae3bf37de6445f58e1.jpg saved to cache
2026-03-30 10:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86df853a-1e77-52b2-af9b-e63475535d6c
2026-03-30 10:42:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_0df24c5fea533e7e37ad9b4f8fa92d5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_fd05ce69cfd5f5309132f128ac8e1a2a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef5b510>
2026-03-30 10:42:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_0df24c5fea533e7e37ad9b4f8fa92d5d.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_0df24c5fea533e7e37ad9b4f8fa92d5d.jpg saved to cache
2026-03-30 10:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86df853a-1e77-52b2-af9b-e63475535d6c
2026-03-30 10:42:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58d1890>
2026-03-30 10:42:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_fd05ce69cfd5f5309132f128ac8e1a2a.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_fd05ce69cfd5f5309132f128ac8e1a2a.jpg saved to cache
2026-03-30 10:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86df853a-1e77-52b2-af9b-e63475535d6c
2026-03-30 10:42:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.795(s), this was the 1st time calling it.
2026-03-30 10:42:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.905791351466429 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:42:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_200c26c9a5382e3dbd8bf5c29d702d54.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef5a390>
2026-03-30 10:42:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_200c26c9a5382e3dbd8bf5c29d702d54.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_200c26c9a5382e3dbd8bf5c29d702d54.jpg saved to cache
2026-03-30 10:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86df853a-1e77-52b2-af9b-e63475535d6c
2026-03-30 10:42:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_54ecd9a0891775357e5fc726ee0d15bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_d45224139b4f66f47b78b623494d24d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4186a90>
2026-03-30 10:42:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_54ecd9a0891775357e5fc726ee0d15bc.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_54ecd9a0891775357e5fc726ee0d15bc.jpg saved to cache
2026-03-30 10:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86df853a-1e77-52b2-af9b-e63475535d6c
2026-03-30 10:42:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef59790>
2026-03-30 10:42:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_d45224139b4f66f47b78b623494d24d8.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_d45224139b4f66f47b78b623494d24d8.jpg saved to cache
2026-03-30 10:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86df853a-1e77-52b2-af9b-e63475535d6c
2026-03-30 10:42:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_82ee845bb5525ef225b0c7375a96dc84.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee49790>
2026-03-30 10:42:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F37%252F0537c62d88c81fdc8cf7371c31e14fed%252Fpa%252FLR88294_82ee845bb5525ef225b0c7375a96dc84.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_82ee845bb5525ef225b0c7375a96dc84.jpg saved to cache
2026-03-30 10:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86df853a-1e77-52b2-af9b-e63475535d6c
2026-03-30 10:42:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86df853a-1e77-52b2-af9b-e63475535d6c, skipping ID generation
2026-03-30 10:42:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86df853a-1e77-52b2-af9b-e63475535d6c with scrape type 1
2026-03-30 10:42:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86df853a-1e77-52b2-af9b-e63475535d6c sending to next pipeline
2026-03-30 10:42:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86df853a-1e77-52b2-af9b-e63475535d6c, identifier: LR88294
2026-03-30 10:42:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86df853a-1e77-52b2-af9b-e63475535d6c with identifier: LR88294
2026-03-30 10:42:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86df853a-1e77-52b2-af9b-e63475535d6c with identifier: LR88294
2026-03-30 10:42:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86df853a-1e77-52b2-af9b-e63475535d6c with identifier: LR88294 to the API
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_82ee845bb5525ef225b0c7375a96dc84.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:23:40Z',
 'fuel_type': 'diesel',
 'id': '86df853a-1e77-52b2-af9b-e63475535d6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR88294',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Nissan',
 'model': 'NV200 Evalia',
 'odometer': 131159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3061184,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_82ee845bb5525ef225b0c7375a96dc84.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3252493,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_d45224139b4f66f47b78b623494d24d8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3106037,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_54ecd9a0891775357e5fc726ee0d15bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2979068,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_200c26c9a5382e3dbd8bf5c29d702d54.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3357710,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_fd05ce69cfd5f5309132f128ac8e1a2a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3175515,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_0df24c5fea533e7e37ad9b4f8fa92d5d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3374815,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_14c6832ff3b860ae3bf37de6445f58e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3127135,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_3133927b4ead3aef5e376d156243e943.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2853663,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_99c91d45aeec10c8efd2f23a87e6b9de.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86df853a-1e77-52b2-af9b-e63475535d6c/86df853a-1e77-52b2-af9b-e63475535d6c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3010574,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img05/37/0537c62d88c81fdc8cf7371c31e14fed/pa/LR88294_855746a3c993ad061e1805f031d9a04c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Nissan NV200 Evalia 1.5 dCi Evalia Tekna',
 'transmission': 'manual',
 'trim': 'Evalia Tekna',
 'year': 2018}
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR88294%27 HTTP/1.1" 200 None
2026-03-30 10:42:24 [auto1.de] INFO: Saving data for LR88294: {'created_time': 1774867344.494052, 'last_price_update_time': 1774867344.494065, 'auction_closing_time': 1774970620.0}
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR88294') HTTP/1.1" 204 0
2026-03-30 10:42:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DG14752> (referer: https://www.auto1.com/v1/car-details-view/DG14752/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d05a9f7-9710-54da-b741-f2e98941586f with identifier: DG14752
2026-03-30 10:42:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d05a9f7-9710-54da-b741-f2e98941586f with scrape type 1
2026-03-30 10:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d05a9f7-9710-54da-b741-f2e98941586f
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_c6bf70040aea3b7b8874fc463c64fd0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_c6bf70040aea3b7b8874fc463c64fd0a.jpg not downloaded yet
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_73ba84e0de73288afa8b2ec648f53c65.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_73ba84e0de73288afa8b2ec648f53c65.jpg not downloaded yet
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_146a6026f7c24be05cb97dba804ac7fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_146a6026f7c24be05cb97dba804ac7fe.jpg not downloaded yet
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_bda293fe28af5e604819fd02e611c36a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_bda293fe28af5e604819fd02e611c36a.jpg not downloaded yet
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_61ce9a7c4000d7925112cfd083136b5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_61ce9a7c4000d7925112cfd083136b5b.jpg not downloaded yet
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_80fc13a7f0136db60b97ca46d8c53f0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_80fc13a7f0136db60b97ca46d8c53f0c.jpg not downloaded yet
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_3e1c867f9bafefb2f04027fa3dff4736.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_3e1c867f9bafefb2f04027fa3dff4736.jpg not downloaded yet
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_30234e3b0bca0fec12c82e49c7172388.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_30234e3b0bca0fec12c82e49c7172388.jpg not downloaded yet
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_9574ddeb6898d5a8025080e6c99491df.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_9574ddeb6898d5a8025080e6c99491df.jpg not downloaded yet
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_169cc7d7c381b4e3f54666437d4dcd9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_169cc7d7c381b4e3f54666437d4dcd9a.jpg not downloaded yet
2026-03-30 10:42:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_6ba58670e670dd0868f047f2169bdefc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee869d0>
2026-03-30 10:42:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_6ba58670e670dd0868f047f2169bdefc.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_6ba58670e670dd0868f047f2169bdefc.jpg saved to cache
2026-03-30 10:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40a28f27-542a-5231-9511-1da844e4fb9b
2026-03-30 10:42:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_169cc7d7c381b4e3f54666437d4dcd9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4142390>
2026-03-30 10:42:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_169cc7d7c381b4e3f54666437d4dcd9a.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_169cc7d7c381b4e3f54666437d4dcd9a.jpg saved to cache
2026-03-30 10:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d05a9f7-9710-54da-b741-f2e98941586f
2026-03-30 10:42:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_9574ddeb6898d5a8025080e6c99491df.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee83c50>
2026-03-30 10:42:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_9574ddeb6898d5a8025080e6c99491df.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_9574ddeb6898d5a8025080e6c99491df.jpg saved to cache
2026-03-30 10:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d05a9f7-9710-54da-b741-f2e98941586f
2026-03-30 10:42:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ50493/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_30234e3b0bca0fec12c82e49c7172388.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45de50>
2026-03-30 10:42:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_30234e3b0bca0fec12c82e49c7172388.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_30234e3b0bca0fec12c82e49c7172388.jpg saved to cache
2026-03-30 10:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d05a9f7-9710-54da-b741-f2e98941586f
2026-03-30 10:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_3e1c867f9bafefb2f04027fa3dff4736.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43340d0>
2026-03-30 10:42:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_3e1c867f9bafefb2f04027fa3dff4736.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_3e1c867f9bafefb2f04027fa3dff4736.jpg saved to cache
2026-03-30 10:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d05a9f7-9710-54da-b741-f2e98941586f
2026-03-30 10:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_80fc13a7f0136db60b97ca46d8c53f0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee481e10>
2026-03-30 10:42:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_80fc13a7f0136db60b97ca46d8c53f0c.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_80fc13a7f0136db60b97ca46d8c53f0c.jpg saved to cache
2026-03-30 10:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d05a9f7-9710-54da-b741-f2e98941586f
2026-03-30 10:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_61ce9a7c4000d7925112cfd083136b5b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41ea790>
2026-03-30 10:42:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_61ce9a7c4000d7925112cfd083136b5b.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_61ce9a7c4000d7925112cfd083136b5b.jpg saved to cache
2026-03-30 10:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d05a9f7-9710-54da-b741-f2e98941586f
2026-03-30 10:42:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_bda293fe28af5e604819fd02e611c36a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef589d0>
2026-03-30 10:42:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_bda293fe28af5e604819fd02e611c36a.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_bda293fe28af5e604819fd02e611c36a.jpg saved to cache
2026-03-30 10:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d05a9f7-9710-54da-b741-f2e98941586f
2026-03-30 10:42:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_146a6026f7c24be05cb97dba804ac7fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee86f50>
2026-03-30 10:42:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_146a6026f7c24be05cb97dba804ac7fe.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_146a6026f7c24be05cb97dba804ac7fe.jpg saved to cache
2026-03-30 10:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d05a9f7-9710-54da-b741-f2e98941586f
2026-03-30 10:42:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_73ba84e0de73288afa8b2ec648f53c65.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41eb150>
2026-03-30 10:42:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_73ba84e0de73288afa8b2ec648f53c65.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_73ba84e0de73288afa8b2ec648f53c65.jpg saved to cache
2026-03-30 10:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d05a9f7-9710-54da-b741-f2e98941586f
2026-03-30 10:42:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_c6bf70040aea3b7b8874fc463c64fd0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41d8250>
2026-03-30 10:42:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F74%252Fbc74b3456322bfcba2b9f0897fed7f67%252Fpa%252FDG14752_c6bf70040aea3b7b8874fc463c64fd0a.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_c6bf70040aea3b7b8874fc463c64fd0a.jpg saved to cache
2026-03-30 10:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d05a9f7-9710-54da-b741-f2e98941586f
2026-03-30 10:42:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d05a9f7-9710-54da-b741-f2e98941586f, skipping ID generation
2026-03-30 10:42:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d05a9f7-9710-54da-b741-f2e98941586f with scrape type 1
2026-03-30 10:42:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d05a9f7-9710-54da-b741-f2e98941586f sending to next pipeline
2026-03-30 10:42:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d05a9f7-9710-54da-b741-f2e98941586f, identifier: DG14752
2026-03-30 10:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HR01670> (referer: https://www.auto1.com/v1/car-details-view/HR01670/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d05a9f7-9710-54da-b741-f2e98941586f with identifier: DG14752
2026-03-30 10:42:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d05a9f7-9710-54da-b741-f2e98941586f with identifier: DG14752
2026-03-30 10:42:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d05a9f7-9710-54da-b741-f2e98941586f with identifier: DG14752 to the API
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_c6bf70040aea3b7b8874fc463c64fd0a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:18:51Z',
 'fuel_type': 'petrol',
 'id': '0d05a9f7-9710-54da-b741-f2e98941586f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG14752',
 'listing': 'auction',
 'location': 'DE, Hanau',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 47886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2689806,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_c6bf70040aea3b7b8874fc463c64fd0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2419122,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_73ba84e0de73288afa8b2ec648f53c65.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2591931,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_146a6026f7c24be05cb97dba804ac7fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2382486,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_bda293fe28af5e604819fd02e611c36a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2444523,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_61ce9a7c4000d7925112cfd083136b5b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2456173,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_80fc13a7f0136db60b97ca46d8c53f0c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2443483,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_3e1c867f9bafefb2f04027fa3dff4736.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2656802,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_30234e3b0bca0fec12c82e49c7172388.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2715477,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_9574ddeb6898d5a8025080e6c99491df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d05a9f7-9710-54da-b741-f2e98941586f/0d05a9f7-9710-54da-b741-f2e98941586f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2638276,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/74/bc74b3456322bfcba2b9f0897fed7f67/pa/DG14752_169cc7d7c381b4e3f54666437d4dcd9a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2021}
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG14752%27 HTTP/1.1" 200 None
2026-03-30 10:42:28 [auto1.de] INFO: Saving data for DG14752: {'created_time': 1774867348.574067, 'last_price_update_time': 1774867348.57408, 'auction_closing_time': 1774970331.0}
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG14752') HTTP/1.1" 204 0
2026-03-30 10:42:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:28 [auto1.de] INFO: Channel: 24h | Page: 20 | totalHits: 9449 | hits on page: 40
2026-03-30 10:42:28 [auto1.de] INFO: Found listing with ID: VN57759
2026-03-30 10:42:28 [auto1.de] INFO: Found listing with ID: GN20483
2026-03-30 10:42:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17733d76-63f0-5456-985f-b6936c7d5ff4 with identifier: HR01670
2026-03-30 10:42:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17733d76-63f0-5456-985f-b6936c7d5ff4 with scrape type 1
2026-03-30 10:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17733d76-63f0-5456-985f-b6936c7d5ff4
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fd1%252F13d1f1669cbf7372088e3b14d83fa6e1%252Fpa%252FHR01670_9ac8e543a527faffd432e50d05370bdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_9ac8e543a527faffd432e50d05370bdc.jpg already downloaded
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fd1%252F13d1f1669cbf7372088e3b14d83fa6e1%252Fpa%252FHR01670_8fb2d426f343386551feeeb58710510a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_8fb2d426f343386551feeeb58710510a.jpg already downloaded
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fd1%252F13d1f1669cbf7372088e3b14d83fa6e1%252Fpa%252FHR01670_d6c7c718d2e5fd25324ab256350cbc35.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_d6c7c718d2e5fd25324ab256350cbc35.jpg already downloaded
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fd1%252F13d1f1669cbf7372088e3b14d83fa6e1%252Fpa%252FHR01670_121cb18f36a26eeb04af597affe88ac2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_121cb18f36a26eeb04af597affe88ac2.jpg already downloaded
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fd1%252F13d1f1669cbf7372088e3b14d83fa6e1%252Fpa%252FHR01670_29255b1c349b29c32d30a03826ede14b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_29255b1c349b29c32d30a03826ede14b.jpg already downloaded
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fd1%252F13d1f1669cbf7372088e3b14d83fa6e1%252Fpa%252FHR01670_e09cab2f6fe14dcbf6e4adf929e188fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_e09cab2f6fe14dcbf6e4adf929e188fb.jpg already downloaded
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fd1%252F13d1f1669cbf7372088e3b14d83fa6e1%252Fpa%252FHR01670_6d7ee6b38746a62bd4788ee81a2caa24.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_6d7ee6b38746a62bd4788ee81a2caa24.jpg already downloaded
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fd1%252F13d1f1669cbf7372088e3b14d83fa6e1%252Fpa%252FHR01670_08e06246ca43666f33c99986401566ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_08e06246ca43666f33c99986401566ba.jpg already downloaded
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fd1%252F13d1f1669cbf7372088e3b14d83fa6e1%252Fpa%252FHR01670_cf8ec0dcae98e8eb32d8ebdeaa69cc01.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_cf8ec0dcae98e8eb32d8ebdeaa69cc01.jpg already downloaded
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fd1%252F13d1f1669cbf7372088e3b14d83fa6e1%252Fpa%252FHR01670_f902538b76d2d7b8527ad0abe841ef5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_f902538b76d2d7b8527ad0abe841ef5b.jpg already downloaded
2026-03-30 10:42:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17733d76-63f0-5456-985f-b6936c7d5ff4, identifier: HR01670
2026-03-30 10:42:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17733d76-63f0-5456-985f-b6936c7d5ff4 with identifier: HR01670
2026-03-30 10:42:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17733d76-63f0-5456-985f-b6936c7d5ff4 with identifier: HR01670
2026-03-30 10:42:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17733d76-63f0-5456-985f-b6936c7d5ff4 with identifier: HR01670 to the API
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HR01670>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:42:54Z',
 'fuel_type': 'petrol',
 'id': '17733d76-63f0-5456-985f-b6936c7d5ff4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR01670',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 69683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_9ac8e543a527faffd432e50d05370bdc.jpg',
                'https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_8fb2d426f343386551feeeb58710510a.jpg',
                'https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_d6c7c718d2e5fd25324ab256350cbc35.jpg',
                'https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_121cb18f36a26eeb04af597affe88ac2.jpg',
                'https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_29255b1c349b29c32d30a03826ede14b.jpg',
                'https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_e09cab2f6fe14dcbf6e4adf929e188fb.jpg',
                'https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_6d7ee6b38746a62bd4788ee81a2caa24.jpg',
                'https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_08e06246ca43666f33c99986401566ba.jpg',
                'https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_cf8ec0dcae98e8eb32d8ebdeaa69cc01.jpg',
                'https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_f902538b76d2d7b8527ad0abe841ef5b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17733d76-63f0-5456-985f-b6936c7d5ff4/17733d76-63f0-5456-985f-b6936c7d5ff4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_9ac8e543a527faffd432e50d05370bdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17733d76-63f0-5456-985f-b6936c7d5ff4/17733d76-63f0-5456-985f-b6936c7d5ff4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_8fb2d426f343386551feeeb58710510a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17733d76-63f0-5456-985f-b6936c7d5ff4/17733d76-63f0-5456-985f-b6936c7d5ff4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_d6c7c718d2e5fd25324ab256350cbc35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17733d76-63f0-5456-985f-b6936c7d5ff4/17733d76-63f0-5456-985f-b6936c7d5ff4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_121cb18f36a26eeb04af597affe88ac2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17733d76-63f0-5456-985f-b6936c7d5ff4/17733d76-63f0-5456-985f-b6936c7d5ff4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_29255b1c349b29c32d30a03826ede14b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17733d76-63f0-5456-985f-b6936c7d5ff4/17733d76-63f0-5456-985f-b6936c7d5ff4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_e09cab2f6fe14dcbf6e4adf929e188fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17733d76-63f0-5456-985f-b6936c7d5ff4/17733d76-63f0-5456-985f-b6936c7d5ff4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_6d7ee6b38746a62bd4788ee81a2caa24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17733d76-63f0-5456-985f-b6936c7d5ff4/17733d76-63f0-5456-985f-b6936c7d5ff4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_08e06246ca43666f33c99986401566ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17733d76-63f0-5456-985f-b6936c7d5ff4/17733d76-63f0-5456-985f-b6936c7d5ff4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_cf8ec0dcae98e8eb32d8ebdeaa69cc01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17733d76-63f0-5456-985f-b6936c7d5ff4/17733d76-63f0-5456-985f-b6936c7d5ff4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/d1/13d1f1669cbf7372088e3b14d83fa6e1/pa/HR01670_f902538b76d2d7b8527ad0abe841ef5b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2016}
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR01670%27 HTTP/1.1" 200 None
2026-03-30 10:42:29 [auto1.de] INFO: Saving data for HR01670: {'created_time': 1774867349.371486, 'last_price_update_time': 1774867349.371496, 'auction_closing_time': 1774971774.0}
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR01670') HTTP/1.1" 204 0
2026-03-30 10:42:29 [auto1.de] INFO: Found listing with ID: UY11504
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY11504%27 HTTP/1.1" 200 None
2026-03-30 10:42:29 [auto1.de] INFO: Scrape type for UY11504: 0
2026-03-30 10:42:29 [auto1.de] INFO: Found listing with ID: JR21744
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR21744%27 HTTP/1.1" 200 None
2026-03-30 10:42:29 [auto1.de] INFO: Scrape type for JR21744: 0
2026-03-30 10:42:29 [auto1.de] INFO: Found listing with ID: HC44441
2026-03-30 10:42:29 [auto1.de] INFO: Found listing with ID: XA25457
2026-03-30 10:42:29 [auto1.de] INFO: Found listing with ID: UZ93598
2026-03-30 10:42:29 [auto1.de] INFO: Found listing with ID: AG06219
2026-03-30 10:42:29 [auto1.de] INFO: Found listing with ID: PE90731
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE90731%27 HTTP/1.1" 200 None
2026-03-30 10:42:29 [auto1.de] INFO: Scrape type for PE90731: 1
2026-03-30 10:42:29 [auto1.de] INFO: Found listing with ID: UG25956
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG25956%27 HTTP/1.1" 200 None
2026-03-30 10:42:29 [auto1.de] INFO: Scrape type for UG25956: 1
2026-03-30 10:42:29 [auto1.de] INFO: Found listing with ID: JP99561
2026-03-30 10:42:29 [auto1.de] INFO: Found listing with ID: SS69708
2026-03-30 10:42:29 [auto1.de] INFO: Found listing with ID: ZJ98470
2026-03-30 10:42:29 [auto1.de] INFO: Found listing with ID: PY04255
2026-03-30 10:42:29 [auto1.de] INFO: Found listing with ID: WU72894
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU72894%27 HTTP/1.1" 200 None
2026-03-30 10:42:29 [auto1.de] INFO: Scrape type for WU72894: 2
2026-03-30 10:42:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53fb464a-eccf-5f03-bf2e-bdf14b072b0c with identifier: WU72894
2026-03-30 10:42:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53fb464a-eccf-5f03-bf2e-bdf14b072b0c with scrape type 2
2026-03-30 10:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53fb464a-eccf-5f03-bf2e-bdf14b072b0c with scrape type 2
2026-03-30 10:42:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53fb464a-eccf-5f03-bf2e-bdf14b072b0c, identifier: WU72894
2026-03-30 10:42:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53fb464a-eccf-5f03-bf2e-bdf14b072b0c with identifier: WU72894
2026-03-30 10:42:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53fb464a-eccf-5f03-bf2e-bdf14b072b0c with identifier: WU72894
2026-03-30 10:42:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53fb464a-eccf-5f03-bf2e-bdf14b072b0c with identifier: WU72894 to the API
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:23:27Z',
 'fuel_type': 'diesel',
 'id': '53fb464a-eccf-5f03-bf2e-bdf14b072b0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU72894',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 182495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-20',
 'seller_name': None,
 'title': 'Ford C-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU72894%27 HTTP/1.1" 200 None
2026-03-30 10:42:29 [auto1.de] INFO: Saving data for WU72894: {'auction_closing_time': 1774970607.0, 'created_time': 1774263054.513959, 'last_price_update_time': 1774867349.91727}
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WU72894') HTTP/1.1" 204 0
2026-03-30 10:42:30 [auto1.de] INFO: Found listing with ID: NY96025
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY96025%27 HTTP/1.1" 200 None
2026-03-30 10:42:30 [auto1.de] INFO: Scrape type for NY96025: 1
2026-03-30 10:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XM95043/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:30 [auto1.de] INFO: Found listing with ID: BS49761
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS49761%27 HTTP/1.1" 200 None
2026-03-30 10:42:30 [auto1.de] INFO: Scrape type for BS49761: 2
2026-03-30 10:42:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45f18753-908e-5afc-bbb3-40959d6ebc60 with identifier: BS49761
2026-03-30 10:42:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45f18753-908e-5afc-bbb3-40959d6ebc60 with scrape type 2
2026-03-30 10:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45f18753-908e-5afc-bbb3-40959d6ebc60 with scrape type 2
2026-03-30 10:42:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45f18753-908e-5afc-bbb3-40959d6ebc60, identifier: BS49761
2026-03-30 10:42:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AD74925/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45f18753-908e-5afc-bbb3-40959d6ebc60 with identifier: BS49761
2026-03-30 10:42:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45f18753-908e-5afc-bbb3-40959d6ebc60 with identifier: BS49761
2026-03-30 10:42:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45f18753-908e-5afc-bbb3-40959d6ebc60 with identifier: BS49761 to the API
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-31T15:34:09Z',
 'fuel_type': 'hybrid',
 'id': '45f18753-908e-5afc-bbb3-40959d6ebc60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS49761',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 153019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-08',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350de 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2021}
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS49761%27 HTTP/1.1" 200 None
2026-03-30 10:42:30 [auto1.de] INFO: Saving data for BS49761: {'auction_closing_time': 1774971249.0, 'created_time': 1774522279.20624, 'last_price_update_time': 1774867350.541144}
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS49761') HTTP/1.1" 204 0
2026-03-30 10:42:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:30 [auto1.de] INFO: Found listing with ID: ZS77255
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS77255%27 HTTP/1.1" 200 None
2026-03-30 10:42:30 [auto1.de] INFO: Scrape type for ZS77255: 1
2026-03-30 10:42:30 [auto1.de] INFO: Found listing with ID: LN61761
2026-03-30 10:42:30 [auto1.de] INFO: Found listing with ID: RM34833
2026-03-30 10:42:30 [auto1.de] INFO: Found listing with ID: TF05985
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF05985%27 HTTP/1.1" 200 None
2026-03-30 10:42:30 [auto1.de] INFO: Scrape type for TF05985: 1
2026-03-30 10:42:30 [auto1.de] INFO: Found listing with ID: XT65202
2026-03-30 10:42:30 [auto1.de] INFO: Found listing with ID: VC85429
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC85429%27 HTTP/1.1" 200 None
2026-03-30 10:42:30 [auto1.de] INFO: Scrape type for VC85429: 1
2026-03-30 10:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_0c24529ef1037e515fa7664494892361.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:30 [auto1.de] INFO: Found listing with ID: BG36270
2026-03-30 10:42:30 [auto1.de] INFO: Found listing with ID: XH91941
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH91941%27 HTTP/1.1" 200 None
2026-03-30 10:42:30 [auto1.de] INFO: Scrape type for XH91941: 1
2026-03-30 10:42:30 [auto1.de] INFO: Found listing with ID: FW22794
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW22794%27 HTTP/1.1" 200 None
2026-03-30 10:42:30 [auto1.de] INFO: Scrape type for FW22794: 1
2026-03-30 10:42:30 [auto1.de] INFO: Found listing with ID: SE03748
2026-03-30 10:42:30 [auto1.de] INFO: Found listing with ID: AE01122
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE01122%27 HTTP/1.1" 200 None
2026-03-30 10:42:30 [auto1.de] INFO: Scrape type for AE01122: 2
2026-03-30 10:42:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ff99a07-4847-5e0f-8426-535044081754 with identifier: AE01122
2026-03-30 10:42:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ff99a07-4847-5e0f-8426-535044081754 with scrape type 2
2026-03-30 10:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ff99a07-4847-5e0f-8426-535044081754 with scrape type 2
2026-03-30 10:42:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ff99a07-4847-5e0f-8426-535044081754, identifier: AE01122
2026-03-30 10:42:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ff99a07-4847-5e0f-8426-535044081754 with identifier: AE01122
2026-03-30 10:42:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ff99a07-4847-5e0f-8426-535044081754 with identifier: AE01122
2026-03-30 10:42:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ff99a07-4847-5e0f-8426-535044081754 with identifier: AE01122 to the API
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-31T15:55:57Z',
 'fuel_type': 'diesel',
 'id': '9ff99a07-4847-5e0f-8426-535044081754',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE01122',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 144417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-31',
 'seller_name': None,
 'title': 'BMW X4 xDrive 35d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE01122%27 HTTP/1.1" 200 None
2026-03-30 10:42:31 [auto1.de] INFO: Saving data for AE01122: {'auction_closing_time': 1774972557.0, 'created_time': 1773688896.533094, 'last_price_update_time': 1774867351.601293}
2026-03-30 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE01122') HTTP/1.1" 204 0
2026-03-30 10:42:31 [auto1.de] INFO: Found listing with ID: FE15332
2026-03-30 10:42:31 [auto1.de] INFO: Found listing with ID: MY39780
2026-03-30 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY39780%27 HTTP/1.1" 200 None
2026-03-30 10:42:31 [auto1.de] INFO: Scrape type for MY39780: 1
2026-03-30 10:42:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41db390>
2026-03-30 10:42:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_0c24529ef1037e515fa7664494892361.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_0c24529ef1037e515fa7664494892361.jpg saved to cache
2026-03-30 10:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40a28f27-542a-5231-9511-1da844e4fb9b
2026-03-30 10:42:31 [auto1.de] INFO: Found listing with ID: GP33761
2026-03-30 10:42:31 [auto1.de] INFO: Found listing with ID: LT55201
2026-03-30 10:42:31 [auto1.de] INFO: Found listing with ID: UD05197
2026-03-30 10:42:31 [auto1.de] INFO: Found listing with ID: DL76971
2026-03-30 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL76971%27 HTTP/1.1" 200 None
2026-03-30 10:42:31 [auto1.de] INFO: Scrape type for DL76971: 2
2026-03-30 10:42:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b078761a-ca65-5f4a-842e-7d2e8eda63be with identifier: DL76971
2026-03-30 10:42:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b078761a-ca65-5f4a-842e-7d2e8eda63be with scrape type 2
2026-03-30 10:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b078761a-ca65-5f4a-842e-7d2e8eda63be with scrape type 2
2026-03-30 10:42:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b078761a-ca65-5f4a-842e-7d2e8eda63be, identifier: DL76971
2026-03-30 10:42:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD17781/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN20483/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b078761a-ca65-5f4a-842e-7d2e8eda63be with identifier: DL76971
2026-03-30 10:42:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b078761a-ca65-5f4a-842e-7d2e8eda63be with identifier: DL76971
2026-03-30 10:42:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b078761a-ca65-5f4a-842e-7d2e8eda63be with identifier: DL76971 to the API
2026-03-30 10:42:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-31T15:58:02Z',
 'fuel_type': 'petrol',
 'id': 'b078761a-ca65-5f4a-842e-7d2e8eda63be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL76971',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 88541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-03',
 'seller_name': None,
 'title': 'Hyundai i30 2.0 TGDI N Performance',
 'transmission': 'manual',
 'trim': 'N Performance',
 'year': 2019}
2026-03-30 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL76971%27 HTTP/1.1" 200 None
2026-03-30 10:42:32 [auto1.de] INFO: Saving data for DL76971: {'auction_closing_time': 1774972682.0, 'created_time': 1773304566.208801, 'last_price_update_time': 1774867352.726241}
2026-03-30 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL76971') HTTP/1.1" 204 0
2026-03-30 10:42:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:32 [auto1.de] INFO: Found listing with ID: AZ54716
2026-03-30 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ54716%27 HTTP/1.1" 200 None
2026-03-30 10:42:32 [auto1.de] INFO: Scrape type for AZ54716: 1
2026-03-30 10:42:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_1f1235b4c0f011a5dd430dd0d6a6188e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:32 [auto1.de] INFO: Found listing with ID: CJ78489
2026-03-30 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ78489%27 HTTP/1.1" 200 None
2026-03-30 10:42:32 [auto1.de] INFO: Scrape type for CJ78489: 2
2026-03-30 10:42:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b14d2fb-c7e0-577a-9df4-db06f6de9f7f with identifier: CJ78489
2026-03-30 10:42:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b14d2fb-c7e0-577a-9df4-db06f6de9f7f with scrape type 2
2026-03-30 10:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b14d2fb-c7e0-577a-9df4-db06f6de9f7f with scrape type 2
2026-03-30 10:42:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b14d2fb-c7e0-577a-9df4-db06f6de9f7f, identifier: CJ78489
2026-03-30 10:42:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b14d2fb-c7e0-577a-9df4-db06f6de9f7f with identifier: CJ78489
2026-03-30 10:42:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b14d2fb-c7e0-577a-9df4-db06f6de9f7f with identifier: CJ78489
2026-03-30 10:42:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b14d2fb-c7e0-577a-9df4-db06f6de9f7f with identifier: CJ78489 to the API
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:23:21Z',
 'fuel_type': 'petrol',
 'id': '3b14d2fb-c7e0-577a-9df4-db06f6de9f7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ78489',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 44767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-15',
 'seller_name': None,
 'title': 'Audi Q3 40 TFSI quattro S Line',
 'transmission': 'automatic',
 'trim': 'quattro S Line',
 'year': 2019}
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ78489%27 HTTP/1.1" 200 None
2026-03-30 10:42:33 [auto1.de] INFO: Saving data for CJ78489: {'auction_closing_time': 1774970601.0, 'created_time': 1773775405.238697, 'last_price_update_time': 1774867353.317541}
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ78489') HTTP/1.1" 204 0
2026-03-30 10:42:33 [auto1.de] INFO: Found listing with ID: AM79685
2026-03-30 10:42:33 [auto1.de] INFO: Found listing with ID: BP11097
2026-03-30 10:42:33 [auto1.de] INFO: Found listing with ID: ME64597
2026-03-30 10:42:33 [auto1.de] INFO: Found listing with ID: DA24351
2026-03-30 10:42:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef39f90>
2026-03-30 10:42:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_1f1235b4c0f011a5dd430dd0d6a6188e.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_1f1235b4c0f011a5dd430dd0d6a6188e.jpg saved to cache
2026-03-30 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40a28f27-542a-5231-9511-1da844e4fb9b
2026-03-30 10:42:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_73bea01ba0f95f31ca97f1a6797783d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434e3d0>
2026-03-30 10:42:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_73bea01ba0f95f31ca97f1a6797783d4.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_73bea01ba0f95f31ca97f1a6797783d4.jpg saved to cache
2026-03-30 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40a28f27-542a-5231-9511-1da844e4fb9b
2026-03-30 10:42:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CX98346> (referer: https://www.auto1.com/v1/car-details-view/CX98346/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL10324/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8cf3f9f-d07d-52a3-8873-757e83f26cf7 with identifier: CX98346
2026-03-30 10:42:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8cf3f9f-d07d-52a3-8873-757e83f26cf7 with scrape type 1
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8cf3f9f-d07d-52a3-8873-757e83f26cf7
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcc%252F4bcca57d9cb17cd4f098fcae18c17d08%252Fpa%252FCX98346_63d477406fdfeb51513f44495b3ed301.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_63d477406fdfeb51513f44495b3ed301.jpg already downloaded
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcc%252F4bcca57d9cb17cd4f098fcae18c17d08%252Fpa%252FCX98346_9c4e124f1a89d1756af816e143449485.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_9c4e124f1a89d1756af816e143449485.jpg already downloaded
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcc%252F4bcca57d9cb17cd4f098fcae18c17d08%252Fpa%252FCX98346_f577f58345d5193b247e4575c1f0d48b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_f577f58345d5193b247e4575c1f0d48b.jpg already downloaded
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcc%252F4bcca57d9cb17cd4f098fcae18c17d08%252Fpa%252FCX98346_3422577da246ccf3ada9c813119ed7e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_3422577da246ccf3ada9c813119ed7e2.jpg already downloaded
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcc%252F4bcca57d9cb17cd4f098fcae18c17d08%252Fpa%252FCX98346_24358303c8596afedc978d9f09cfa051.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_24358303c8596afedc978d9f09cfa051.jpg already downloaded
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcc%252F4bcca57d9cb17cd4f098fcae18c17d08%252Fpa%252FCX98346_d277ed4584c6d2fa54416caec845ab32.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_d277ed4584c6d2fa54416caec845ab32.jpg already downloaded
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcc%252F4bcca57d9cb17cd4f098fcae18c17d08%252Fpa%252FCX98346_cf55e7fa78535106243cfd01c47a7751.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_cf55e7fa78535106243cfd01c47a7751.jpg already downloaded
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcc%252F4bcca57d9cb17cd4f098fcae18c17d08%252Fpa%252FCX98346_367d0460f46d48a7bc26b210c37839f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_367d0460f46d48a7bc26b210c37839f9.jpg already downloaded
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcc%252F4bcca57d9cb17cd4f098fcae18c17d08%252Fpa%252FCX98346_1e257aa19008241b9230824884fa7c60.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_1e257aa19008241b9230824884fa7c60.jpg already downloaded
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcc%252F4bcca57d9cb17cd4f098fcae18c17d08%252Fpa%252FCX98346_e884b5d9fb6e5cf9a21f2ad307fdca0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_e884b5d9fb6e5cf9a21f2ad307fdca0d.jpg already downloaded
2026-03-30 10:42:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8cf3f9f-d07d-52a3-8873-757e83f26cf7, identifier: CX98346
2026-03-30 10:42:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8cf3f9f-d07d-52a3-8873-757e83f26cf7 with identifier: CX98346
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:42:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8cf3f9f-d07d-52a3-8873-757e83f26cf7 with identifier: CX98346
2026-03-30 10:42:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8cf3f9f-d07d-52a3-8873-757e83f26cf7 with identifier: CX98346 to the API
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CX98346>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:05:07Z',
 'fuel_type': 'petrol',
 'id': 'b8cf3f9f-d07d-52a3-8873-757e83f26cf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX98346',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 72448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_63d477406fdfeb51513f44495b3ed301.jpg',
                'https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_9c4e124f1a89d1756af816e143449485.jpg',
                'https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_f577f58345d5193b247e4575c1f0d48b.jpg',
                'https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_3422577da246ccf3ada9c813119ed7e2.jpg',
                'https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_24358303c8596afedc978d9f09cfa051.jpg',
                'https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_d277ed4584c6d2fa54416caec845ab32.jpg',
                'https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_cf55e7fa78535106243cfd01c47a7751.jpg',
                'https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_367d0460f46d48a7bc26b210c37839f9.jpg',
                'https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_1e257aa19008241b9230824884fa7c60.jpg',
                'https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_e884b5d9fb6e5cf9a21f2ad307fdca0d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cf3f9f-d07d-52a3-8873-757e83f26cf7/b8cf3f9f-d07d-52a3-8873-757e83f26cf7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_63d477406fdfeb51513f44495b3ed301.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cf3f9f-d07d-52a3-8873-757e83f26cf7/b8cf3f9f-d07d-52a3-8873-757e83f26cf7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_9c4e124f1a89d1756af816e143449485.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cf3f9f-d07d-52a3-8873-757e83f26cf7/b8cf3f9f-d07d-52a3-8873-757e83f26cf7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_f577f58345d5193b247e4575c1f0d48b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cf3f9f-d07d-52a3-8873-757e83f26cf7/b8cf3f9f-d07d-52a3-8873-757e83f26cf7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_3422577da246ccf3ada9c813119ed7e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cf3f9f-d07d-52a3-8873-757e83f26cf7/b8cf3f9f-d07d-52a3-8873-757e83f26cf7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_24358303c8596afedc978d9f09cfa051.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cf3f9f-d07d-52a3-8873-757e83f26cf7/b8cf3f9f-d07d-52a3-8873-757e83f26cf7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_d277ed4584c6d2fa54416caec845ab32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cf3f9f-d07d-52a3-8873-757e83f26cf7/b8cf3f9f-d07d-52a3-8873-757e83f26cf7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_cf55e7fa78535106243cfd01c47a7751.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cf3f9f-d07d-52a3-8873-757e83f26cf7/b8cf3f9f-d07d-52a3-8873-757e83f26cf7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_367d0460f46d48a7bc26b210c37839f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cf3f9f-d07d-52a3-8873-757e83f26cf7/b8cf3f9f-d07d-52a3-8873-757e83f26cf7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_1e257aa19008241b9230824884fa7c60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cf3f9f-d07d-52a3-8873-757e83f26cf7/b8cf3f9f-d07d-52a3-8873-757e83f26cf7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cc/4bcca57d9cb17cd4f098fcae18c17d08/pa/CX98346_e884b5d9fb6e5cf9a21f2ad307fdca0d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2014}
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX98346%27 HTTP/1.1" 200 None
2026-03-30 10:42:35 [auto1.de] INFO: Saving data for CX98346: {'created_time': 1774867355.343458, 'last_price_update_time': 1774867355.343468, 'auction_closing_time': 1774969507.0}
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX98346') HTTP/1.1" 204 0
2026-03-30 10:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR15426> (referer: https://www.auto1.com/v1/car-details-view/LR15426/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65c29820-c686-5e57-bea8-a9b353402fc6 with identifier: LR15426
2026-03-30 10:42:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65c29820-c686-5e57-bea8-a9b353402fc6 with scrape type 1
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65c29820-c686-5e57-bea8-a9b353402fc6
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_b85be971aded52114a92e54240e5c79e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_b85be971aded52114a92e54240e5c79e.jpg not downloaded yet
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_e3ac92549ab72812c4f43aa78af7ecfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_e3ac92549ab72812c4f43aa78af7ecfe.jpg not downloaded yet
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_af5a700ed16e8bdbcece2522c4e85ee6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_af5a700ed16e8bdbcece2522c4e85ee6.jpg not downloaded yet
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_8a2ef1d9193edb618e656762e7ac3c1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_8a2ef1d9193edb618e656762e7ac3c1e.jpg not downloaded yet
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_e7393a139fe4efffaf193c1017f0a7f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_e7393a139fe4efffaf193c1017f0a7f3.jpg not downloaded yet
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_373cadad4994bdc7fad41d38216c3697.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_373cadad4994bdc7fad41d38216c3697.jpg not downloaded yet
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_90494ca8e502fd02fbe482af16c419bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_90494ca8e502fd02fbe482af16c419bd.jpg not downloaded yet
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_9736d30517d4c091ef5fa30fd1f798c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_9736d30517d4c091ef5fa30fd1f798c1.jpg not downloaded yet
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_831bc79c1dd85dfb80a7ccc5ba6158b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_831bc79c1dd85dfb80a7ccc5ba6158b4.jpg not downloaded yet
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_71a2beec6c2b2726f2ee4dd24c984377.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_71a2beec6c2b2726f2ee4dd24c984377.jpg not downloaded yet
2026-03-30 10:42:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV49543/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_71a2beec6c2b2726f2ee4dd24c984377.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3faf90>
2026-03-30 10:42:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_71a2beec6c2b2726f2ee4dd24c984377.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_71a2beec6c2b2726f2ee4dd24c984377.jpg saved to cache
2026-03-30 10:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 65c29820-c686-5e57-bea8-a9b353402fc6
2026-03-30 10:42:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX74187/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_831bc79c1dd85dfb80a7ccc5ba6158b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeee2750>
2026-03-30 10:42:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_831bc79c1dd85dfb80a7ccc5ba6158b4.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_831bc79c1dd85dfb80a7ccc5ba6158b4.jpg saved to cache
2026-03-30 10:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 65c29820-c686-5e57-bea8-a9b353402fc6
2026-03-30 10:42:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ50493> (referer: https://www.auto1.com/v1/car-details-view/JZ50493/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_9736d30517d4c091ef5fa30fd1f798c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51273f1e-8e51-5a24-afab-3768a127c295 with identifier: JZ50493
2026-03-30 10:42:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51273f1e-8e51-5a24-afab-3768a127c295 with scrape type 1
2026-03-30 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_711bbaced1459056458b041711a716ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_711bbaced1459056458b041711a716ac.jpg not downloaded yet
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_9656c26e36cd464a732a4a1a3217b211.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_9656c26e36cd464a732a4a1a3217b211.jpg not downloaded yet
2026-03-30 10:42:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_90494ca8e502fd02fbe482af16c419bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_304ad10d3f4a588f50243b6b4a880766.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_304ad10d3f4a588f50243b6b4a880766.jpg not downloaded yet
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_9a4b1a83d62b9c740706037abc568fe0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_9a4b1a83d62b9c740706037abc568fe0.jpg not downloaded yet
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_228ddd2d4c9658271ab070d570535107.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_228ddd2d4c9658271ab070d570535107.jpg not downloaded yet
2026-03-30 10:42:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4230090>
2026-03-30 10:42:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_9736d30517d4c091ef5fa30fd1f798c1.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_9736d30517d4c091ef5fa30fd1f798c1.jpg saved to cache
2026-03-30 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 65c29820-c686-5e57-bea8-a9b353402fc6
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_7764a9920cb4b65db379f378cc358a4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_7764a9920cb4b65db379f378cc358a4f.jpg not downloaded yet
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_f456a76b67645becd15816e83dbfe240.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_f456a76b67645becd15816e83dbfe240.jpg not downloaded yet
2026-03-30 10:42:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f597c990>
2026-03-30 10:42:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_90494ca8e502fd02fbe482af16c419bd.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_90494ca8e502fd02fbe482af16c419bd.jpg saved to cache
2026-03-30 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 65c29820-c686-5e57-bea8-a9b353402fc6
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_39c1609c6901310d9b3bfb5c5d1ec787.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_39c1609c6901310d9b3bfb5c5d1ec787.jpg not downloaded yet
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_97afeb737626b811942e559f458ed306.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_97afeb737626b811942e559f458ed306.jpg not downloaded yet
2026-03-30 10:42:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_9656c26e36cd464a732a4a1a3217b211.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_75793abafd6a31a02589f5dad8e5dff9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_75793abafd6a31a02589f5dad8e5dff9.jpg not downloaded yet
2026-03-30 10:42:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee442010>
2026-03-30 10:42:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_9656c26e36cd464a732a4a1a3217b211.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_9656c26e36cd464a732a4a1a3217b211.jpg saved to cache
2026-03-30 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-30 10:42:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_97afeb737626b811942e559f458ed306.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417fed0>
2026-03-30 10:42:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_97afeb737626b811942e559f458ed306.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_97afeb737626b811942e559f458ed306.jpg saved to cache
2026-03-30 10:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-30 10:42:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_75793abafd6a31a02589f5dad8e5dff9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a2450>
2026-03-30 10:42:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_75793abafd6a31a02589f5dad8e5dff9.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_75793abafd6a31a02589f5dad8e5dff9.jpg saved to cache
2026-03-30 10:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-30 10:42:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_39c1609c6901310d9b3bfb5c5d1ec787.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429cad0>
2026-03-30 10:42:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_39c1609c6901310d9b3bfb5c5d1ec787.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_39c1609c6901310d9b3bfb5c5d1ec787.jpg saved to cache
2026-03-30 10:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-30 10:42:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_f456a76b67645becd15816e83dbfe240.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a38d0>
2026-03-30 10:42:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_f456a76b67645becd15816e83dbfe240.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_f456a76b67645becd15816e83dbfe240.jpg saved to cache
2026-03-30 10:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-30 10:42:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_7764a9920cb4b65db379f378cc358a4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee43e50>
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_7764a9920cb4b65db379f378cc358a4f.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_7764a9920cb4b65db379f378cc358a4f.jpg saved to cache
2026-03-30 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-30 10:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_228ddd2d4c9658271ab070d570535107.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5bdc750>
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_228ddd2d4c9658271ab070d570535107.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_228ddd2d4c9658271ab070d570535107.jpg saved to cache
2026-03-30 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-30 10:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_9a4b1a83d62b9c740706037abc568fe0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_304ad10d3f4a588f50243b6b4a880766.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4295d0>
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_9a4b1a83d62b9c740706037abc568fe0.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_9a4b1a83d62b9c740706037abc568fe0.jpg saved to cache
2026-03-30 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-30 10:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_711bbaced1459056458b041711a716ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee621d0>
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_304ad10d3f4a588f50243b6b4a880766.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_304ad10d3f4a588f50243b6b4a880766.jpg saved to cache
2026-03-30 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c00b50>
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F69%252F9d6921428f194f34cd80478c6911172c%252Fpa%252FJZ50493_711bbaced1459056458b041711a716ac.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_711bbaced1459056458b041711a716ac.jpg saved to cache
2026-03-30 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-30 10:42:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51273f1e-8e51-5a24-afab-3768a127c295, skipping ID generation
2026-03-30 10:42:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51273f1e-8e51-5a24-afab-3768a127c295 with scrape type 1
2026-03-30 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51273f1e-8e51-5a24-afab-3768a127c295 sending to next pipeline
2026-03-30 10:42:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51273f1e-8e51-5a24-afab-3768a127c295, identifier: JZ50493
2026-03-30 10:42:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51273f1e-8e51-5a24-afab-3768a127c295 with identifier: JZ50493
2026-03-30 10:42:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51273f1e-8e51-5a24-afab-3768a127c295 with identifier: JZ50493
2026-03-30 10:42:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51273f1e-8e51-5a24-afab-3768a127c295 with identifier: JZ50493 to the API
2026-03-30 10:42:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_711bbaced1459056458b041711a716ac.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:34:08Z',
 'fuel_type': 'electro',
 'id': '51273f1e-8e51-5a24-afab-3768a127c295',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ50493',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 12,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_711bbaced1459056458b041711a716ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_9656c26e36cd464a732a4a1a3217b211.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_304ad10d3f4a588f50243b6b4a880766.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_9a4b1a83d62b9c740706037abc568fe0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_228ddd2d4c9658271ab070d570535107.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_7764a9920cb4b65db379f378cc358a4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_f456a76b67645becd15816e83dbfe240.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_39c1609c6901310d9b3bfb5c5d1ec787.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_97afeb737626b811942e559f458ed306.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/69/9d6921428f194f34cd80478c6911172c/pa/JZ50493_75793abafd6a31a02589f5dad8e5dff9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-12-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-30 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ50493%27 HTTP/1.1" 200 None
2026-03-30 10:42:44 [auto1.de] INFO: Saving data for JZ50493: {'created_time': 1774867364.232423, 'last_price_update_time': 1774867364.232437, 'auction_closing_time': 1774971248.0}
2026-03-30 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ50493') HTTP/1.1" 204 0
2026-03-30 10:42:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_373cadad4994bdc7fad41d38216c3697.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a28d0>
2026-03-30 10:42:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_373cadad4994bdc7fad41d38216c3697.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_373cadad4994bdc7fad41d38216c3697.jpg saved to cache
2026-03-30 10:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65c29820-c686-5e57-bea8-a9b353402fc6
2026-03-30 10:42:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_e7393a139fe4efffaf193c1017f0a7f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3b790>
2026-03-30 10:42:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_e7393a139fe4efffaf193c1017f0a7f3.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_e7393a139fe4efffaf193c1017f0a7f3.jpg saved to cache
2026-03-30 10:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65c29820-c686-5e57-bea8-a9b353402fc6
2026-03-30 10:42:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_8a2ef1d9193edb618e656762e7ac3c1e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41f0490>
2026-03-30 10:42:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_8a2ef1d9193edb618e656762e7ac3c1e.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_8a2ef1d9193edb618e656762e7ac3c1e.jpg saved to cache
2026-03-30 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65c29820-c686-5e57-bea8-a9b353402fc6
2026-03-30 10:42:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_af5a700ed16e8bdbcece2522c4e85ee6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_e3ac92549ab72812c4f43aa78af7ecfe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43384d0>
2026-03-30 10:42:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_af5a700ed16e8bdbcece2522c4e85ee6.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_af5a700ed16e8bdbcece2522c4e85ee6.jpg saved to cache
2026-03-30 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65c29820-c686-5e57-bea8-a9b353402fc6
2026-03-30 10:42:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_b85be971aded52114a92e54240e5c79e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef510d0>
2026-03-30 10:42:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_e3ac92549ab72812c4f43aa78af7ecfe.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_e3ac92549ab72812c4f43aa78af7ecfe.jpg saved to cache
2026-03-30 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65c29820-c686-5e57-bea8-a9b353402fc6
2026-03-30 10:42:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4411d0>
2026-03-30 10:42:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0cea2cbece6e6361dae43590c37ddd%252Fpa%252FLR15426_b85be971aded52114a92e54240e5c79e.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_b85be971aded52114a92e54240e5c79e.jpg saved to cache
2026-03-30 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65c29820-c686-5e57-bea8-a9b353402fc6
2026-03-30 10:42:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65c29820-c686-5e57-bea8-a9b353402fc6, skipping ID generation
2026-03-30 10:42:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65c29820-c686-5e57-bea8-a9b353402fc6 with scrape type 1
2026-03-30 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65c29820-c686-5e57-bea8-a9b353402fc6 sending to next pipeline
2026-03-30 10:42:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65c29820-c686-5e57-bea8-a9b353402fc6, identifier: LR15426
2026-03-30 10:42:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65c29820-c686-5e57-bea8-a9b353402fc6 with identifier: LR15426
2026-03-30 10:42:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65c29820-c686-5e57-bea8-a9b353402fc6 with identifier: LR15426
2026-03-30 10:42:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65c29820-c686-5e57-bea8-a9b353402fc6 with identifier: LR15426 to the API
2026-03-30 10:42:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_b85be971aded52114a92e54240e5c79e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:18:44Z',
 'fuel_type': 'petrol',
 'id': '65c29820-c686-5e57-bea8-a9b353402fc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR15426',
 'listing': 'auction',
 'location': 'DE, Hanau',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 77128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_b85be971aded52114a92e54240e5c79e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_e3ac92549ab72812c4f43aa78af7ecfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2894925,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_af5a700ed16e8bdbcece2522c4e85ee6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2784110,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_8a2ef1d9193edb618e656762e7ac3c1e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2661824,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_e7393a139fe4efffaf193c1017f0a7f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2813717,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_373cadad4994bdc7fad41d38216c3697.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_90494ca8e502fd02fbe482af16c419bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_9736d30517d4c091ef5fa30fd1f798c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2789826,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_831bc79c1dd85dfb80a7ccc5ba6158b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65c29820-c686-5e57-bea8-a9b353402fc6/65c29820-c686-5e57-bea8-a9b353402fc6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2668260,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0c/1e0cea2cbece6e6361dae43590c37ddd/pa/LR15426_71a2beec6c2b2726f2ee4dd24c984377.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2021}
2026-03-30 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR15426%27 HTTP/1.1" 200 None
2026-03-30 10:42:46 [auto1.de] INFO: Saving data for LR15426: {'created_time': 1774867366.338384, 'last_price_update_time': 1774867366.338394, 'auction_closing_time': 1774970324.0}
2026-03-30 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR15426') HTTP/1.1" 204 0
2026-03-30 10:42:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG25956/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MY39780/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VC85429/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:49 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.783(s), this was the 1st time calling it.
2026-03-30 10:42:49 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.6098176230395262 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:42:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW22794/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN20483> (referer: https://www.auto1.com/v1/car-details-view/GN20483/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD17781> (referer: https://www.auto1.com/v1/car-details-view/MD17781/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8e27fb0-143e-5aaf-a21a-e73a35a23ba3 with identifier: GN20483
2026-03-30 10:42:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8e27fb0-143e-5aaf-a21a-e73a35a23ba3 with scrape type 1
2026-03-30 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8e27fb0-143e-5aaf-a21a-e73a35a23ba3
2026-03-30 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_8a66c2c40dbdd7e381926ab0e838f7d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_8a66c2c40dbdd7e381926ab0e838f7d3.jpg not downloaded yet
2026-03-30 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_d651d2f225a5e9c8dadc04c22a5bb062.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_d651d2f225a5e9c8dadc04c22a5bb062.jpg not downloaded yet
2026-03-30 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_45e4ccda2ca88f5f268b9a1f1bd77007.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_45e4ccda2ca88f5f268b9a1f1bd77007.jpg not downloaded yet
2026-03-30 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_6ca0b3822c3808bddb6f2f5178ca8a44.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_6ca0b3822c3808bddb6f2f5178ca8a44.jpg not downloaded yet
2026-03-30 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_805ba9d47b5157e8cee0e41458da7fce.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_805ba9d47b5157e8cee0e41458da7fce.jpg not downloaded yet
2026-03-30 10:42:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28c5dd75-6d02-59ca-abaf-8d204d679d8d with identifier: MD17781
2026-03-30 10:42:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28c5dd75-6d02-59ca-abaf-8d204d679d8d with scrape type 1
2026-03-30 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28c5dd75-6d02-59ca-abaf-8d204d679d8d
2026-03-30 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_d6800d2daec80af2866206f9c82b4765.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_d6800d2daec80af2866206f9c82b4765.jpg not downloaded yet
2026-03-30 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_e3db4c9555084e2608b8fdfb809accf7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_e3db4c9555084e2608b8fdfb809accf7.jpg not downloaded yet
2026-03-30 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_d585cfeecb0e7f1ad77980af9db9f242.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_d585cfeecb0e7f1ad77980af9db9f242.jpg not downloaded yet
2026-03-30 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_c15b30a1c54255a2cb8e598a79558341.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_c15b30a1c54255a2cb8e598a79558341.jpg not downloaded yet
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_43670c3b473f0e4246c2520ca218eb31.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_43670c3b473f0e4246c2520ca218eb31.jpg not downloaded yet
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_32249f44eb54d1b991c122c887a465da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_32249f44eb54d1b991c122c887a465da.jpg not downloaded yet
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_106df9f095535702e98b1e9a689b4170.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_106df9f095535702e98b1e9a689b4170.jpg not downloaded yet
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_ae3ad8c93f77ced0d36e5e52b19c2c8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_ae3ad8c93f77ced0d36e5e52b19c2c8a.jpg not downloaded yet
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_c15f4b82f1b541592f49e008451a3291.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_c15f4b82f1b541592f49e008451a3291.jpg not downloaded yet
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_5397d7adc86f8eb8b3b159538bafebbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_5397d7adc86f8eb8b3b159538bafebbb.jpg not downloaded yet
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_95dac7b7dba6f0f9e9b554343dccd36a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_95dac7b7dba6f0f9e9b554343dccd36a.jpg not downloaded yet
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_dec863c031a639d53c1ee9642bf07d00.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_dec863c031a639d53c1ee9642bf07d00.jpg not downloaded yet
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_579f2088cb5bc46553c2736421d9dcb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_579f2088cb5bc46553c2736421d9dcb5.jpg not downloaded yet
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_d0f7971b23b596fe4fa0db81ebc02889.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_d0f7971b23b596fe4fa0db81ebc02889.jpg not downloaded yet
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_bdd499cbfe843829d0eead5e85f46f26.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_bdd499cbfe843829d0eead5e85f46f26.jpg not downloaded yet
2026-03-30 10:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XH91941/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_bdd499cbfe843829d0eead5e85f46f26.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419bb50>
2026-03-30 10:42:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_bdd499cbfe843829d0eead5e85f46f26.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_bdd499cbfe843829d0eead5e85f46f26.jpg saved to cache
2026-03-30 10:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 28c5dd75-6d02-59ca-abaf-8d204d679d8d
2026-03-30 10:42:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX74187> (referer: https://www.auto1.com/v1/car-details-view/AX74187/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d52f533-97e8-5160-baef-0a4ebaf715ea with identifier: AX74187
2026-03-30 10:42:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d52f533-97e8-5160-baef-0a4ebaf715ea with scrape type 1
2026-03-30 10:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d52f533-97e8-5160-baef-0a4ebaf715ea
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Ffc%252F85fc550a6148eef85b494242af023052%252Fpa%252FAX74187_0dbb8acf8c76aecd60d7ca3862e896c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_0dbb8acf8c76aecd60d7ca3862e896c2.jpg already downloaded
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Ffc%252F85fc550a6148eef85b494242af023052%252Fpa%252FAX74187_f196f11d7c1539378038dea9cb60d32f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_f196f11d7c1539378038dea9cb60d32f.jpg already downloaded
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Ffc%252F85fc550a6148eef85b494242af023052%252Fpa%252FAX74187_ec37f2fc0e52a2d9dc100015956a83a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_ec37f2fc0e52a2d9dc100015956a83a5.jpg already downloaded
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Ffc%252F85fc550a6148eef85b494242af023052%252Fpa%252FAX74187_dc92f693329a0f54a8c5ded47ae58474.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_dc92f693329a0f54a8c5ded47ae58474.jpg already downloaded
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Ffc%252F85fc550a6148eef85b494242af023052%252Fpa%252FAX74187_a67a73bb28a89338c210f1d8e833b99d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_a67a73bb28a89338c210f1d8e833b99d.jpg already downloaded
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Ffc%252F85fc550a6148eef85b494242af023052%252Fpa%252FAX74187_5ea6b94ed9db3105bd41daa90db48b3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_5ea6b94ed9db3105bd41daa90db48b3b.jpg already downloaded
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Ffc%252F85fc550a6148eef85b494242af023052%252Fpa%252FAX74187_bfe6417957506672cfe8ea8f43d336cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_bfe6417957506672cfe8ea8f43d336cd.jpg already downloaded
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Ffc%252F85fc550a6148eef85b494242af023052%252Fpa%252FAX74187_5db543b745e7727cddc0584e3c1957c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_5db543b745e7727cddc0584e3c1957c1.jpg already downloaded
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Ffc%252F85fc550a6148eef85b494242af023052%252Fpa%252FAX74187_65960fd2c96669807b0ebe5e413a33b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_65960fd2c96669807b0ebe5e413a33b3.jpg already downloaded
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Ffc%252F85fc550a6148eef85b494242af023052%252Fpa%252FAX74187_110c8d4666f177c72f1bcbed9650dc12.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_110c8d4666f177c72f1bcbed9650dc12.jpg already downloaded
2026-03-30 10:42:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d52f533-97e8-5160-baef-0a4ebaf715ea, identifier: AX74187
2026-03-30 10:42:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d52f533-97e8-5160-baef-0a4ebaf715ea with identifier: AX74187
2026-03-30 10:42:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d52f533-97e8-5160-baef-0a4ebaf715ea with identifier: AX74187
2026-03-30 10:42:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d52f533-97e8-5160-baef-0a4ebaf715ea with identifier: AX74187 to the API
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AX74187>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:44:44Z',
 'fuel_type': 'petrol',
 'id': '7d52f533-97e8-5160-baef-0a4ebaf715ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX74187',
 'listing': 'auction',
 'location': 'Potsdam',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 44709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_0dbb8acf8c76aecd60d7ca3862e896c2.jpg',
                'https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_f196f11d7c1539378038dea9cb60d32f.jpg',
                'https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_ec37f2fc0e52a2d9dc100015956a83a5.jpg',
                'https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_dc92f693329a0f54a8c5ded47ae58474.jpg',
                'https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_a67a73bb28a89338c210f1d8e833b99d.jpg',
                'https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_5ea6b94ed9db3105bd41daa90db48b3b.jpg',
                'https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_bfe6417957506672cfe8ea8f43d336cd.jpg',
                'https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_5db543b745e7727cddc0584e3c1957c1.jpg',
                'https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_65960fd2c96669807b0ebe5e413a33b3.jpg',
                'https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_110c8d4666f177c72f1bcbed9650dc12.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d52f533-97e8-5160-baef-0a4ebaf715ea/7d52f533-97e8-5160-baef-0a4ebaf715ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_0dbb8acf8c76aecd60d7ca3862e896c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d52f533-97e8-5160-baef-0a4ebaf715ea/7d52f533-97e8-5160-baef-0a4ebaf715ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1886868,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_f196f11d7c1539378038dea9cb60d32f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d52f533-97e8-5160-baef-0a4ebaf715ea/7d52f533-97e8-5160-baef-0a4ebaf715ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1946576,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_ec37f2fc0e52a2d9dc100015956a83a5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d52f533-97e8-5160-baef-0a4ebaf715ea/7d52f533-97e8-5160-baef-0a4ebaf715ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1712424,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_dc92f693329a0f54a8c5ded47ae58474.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d52f533-97e8-5160-baef-0a4ebaf715ea/7d52f533-97e8-5160-baef-0a4ebaf715ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_a67a73bb28a89338c210f1d8e833b99d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d52f533-97e8-5160-baef-0a4ebaf715ea/7d52f533-97e8-5160-baef-0a4ebaf715ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2103174,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_5ea6b94ed9db3105bd41daa90db48b3b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d52f533-97e8-5160-baef-0a4ebaf715ea/7d52f533-97e8-5160-baef-0a4ebaf715ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1766223,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_bfe6417957506672cfe8ea8f43d336cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d52f533-97e8-5160-baef-0a4ebaf715ea/7d52f533-97e8-5160-baef-0a4ebaf715ea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_5db543b745e7727cddc0584e3c1957c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d52f533-97e8-5160-baef-0a4ebaf715ea/7d52f533-97e8-5160-baef-0a4ebaf715ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2048107,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_65960fd2c96669807b0ebe5e413a33b3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d52f533-97e8-5160-baef-0a4ebaf715ea/7d52f533-97e8-5160-baef-0a4ebaf715ea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2051276,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/fc/85fc550a6148eef85b494242af023052/pa/AX74187_110c8d4666f177c72f1bcbed9650dc12.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-30 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX74187%27 HTTP/1.1" 200 None
2026-03-30 10:42:53 [auto1.de] INFO: Saving data for AX74187: {'created_time': 1774867373.084226, 'last_price_update_time': 1774867373.084238, 'auction_closing_time': 1774971884.0}
2026-03-30 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX74187') HTTP/1.1" 204 0
2026-03-30 10:42:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_d0f7971b23b596fe4fa0db81ebc02889.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4197d0>
2026-03-30 10:42:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_d0f7971b23b596fe4fa0db81ebc02889.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_d0f7971b23b596fe4fa0db81ebc02889.jpg saved to cache
2026-03-30 10:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 28c5dd75-6d02-59ca-abaf-8d204d679d8d
2026-03-30 10:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_579f2088cb5bc46553c2736421d9dcb5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41d8350>
2026-03-30 10:42:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_579f2088cb5bc46553c2736421d9dcb5.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_579f2088cb5bc46553c2736421d9dcb5.jpg saved to cache
2026-03-30 10:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28c5dd75-6d02-59ca-abaf-8d204d679d8d
2026-03-30 10:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_dec863c031a639d53c1ee9642bf07d00.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f8510>
2026-03-30 10:42:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_dec863c031a639d53c1ee9642bf07d00.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_dec863c031a639d53c1ee9642bf07d00.jpg saved to cache
2026-03-30 10:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28c5dd75-6d02-59ca-abaf-8d204d679d8d
2026-03-30 10:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FS39177/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_95dac7b7dba6f0f9e9b554343dccd36a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41d8a90>
2026-03-30 10:42:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_95dac7b7dba6f0f9e9b554343dccd36a.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_95dac7b7dba6f0f9e9b554343dccd36a.jpg saved to cache
2026-03-30 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28c5dd75-6d02-59ca-abaf-8d204d679d8d
2026-03-30 10:42:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AD74925> (referer: https://www.auto1.com/v1/car-details-view/AD74925/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_5397d7adc86f8eb8b3b159538bafebbb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_c15f4b82f1b541592f49e008451a3291.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb93e27c-41d7-5c47-873a-3d6a8c31b2bb with identifier: AD74925
2026-03-30 10:42:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb93e27c-41d7-5c47-873a-3d6a8c31b2bb with scrape type 1
2026-03-30 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb93e27c-41d7-5c47-873a-3d6a8c31b2bb
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F6f%252Fd16f5fdfdc0fda59c60f19ae50889a22%252Fpa%252FAD74925_18a8403012ec5cfce2defe5e010d6f9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_18a8403012ec5cfce2defe5e010d6f9e.jpg already downloaded
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F6f%252Fd16f5fdfdc0fda59c60f19ae50889a22%252Fpa%252FAD74925_c4bd54fdc4dde9badf354b3a73e9575f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_c4bd54fdc4dde9badf354b3a73e9575f.jpg already downloaded
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F6f%252Fd16f5fdfdc0fda59c60f19ae50889a22%252Fpa%252FAD74925_307d2837fcb4342f020cdfc6522eca29.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_307d2837fcb4342f020cdfc6522eca29.jpg already downloaded
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F6f%252Fd16f5fdfdc0fda59c60f19ae50889a22%252Fpa%252FAD74925_9b53652341c09204512cf31f50a2cb8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_9b53652341c09204512cf31f50a2cb8b.jpg already downloaded
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F6f%252Fd16f5fdfdc0fda59c60f19ae50889a22%252Fpa%252FAD74925_441440cac7bc79cec1d790e43b1bbe6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_441440cac7bc79cec1d790e43b1bbe6c.jpg already downloaded
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F6f%252Fd16f5fdfdc0fda59c60f19ae50889a22%252Fpa%252FAD74925_f81176767dc511930b4de13fd443199b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_f81176767dc511930b4de13fd443199b.jpg already downloaded
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F6f%252Fd16f5fdfdc0fda59c60f19ae50889a22%252Fpa%252FAD74925_bd4e0507adcda2f27e934a414ea65db6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_bd4e0507adcda2f27e934a414ea65db6.jpg already downloaded
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F6f%252Fd16f5fdfdc0fda59c60f19ae50889a22%252Fpa%252FAD74925_4652f1f9cbaa266f36e8d9dc010e42ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_4652f1f9cbaa266f36e8d9dc010e42ac.jpg already downloaded
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F6f%252Fd16f5fdfdc0fda59c60f19ae50889a22%252Fpa%252FAD74925_f30dfdec6f26e32cc36c85517e27ce35.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_f30dfdec6f26e32cc36c85517e27ce35.jpg already downloaded
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F6f%252Fd16f5fdfdc0fda59c60f19ae50889a22%252Fpa%252FAD74925_0b81871429fdb058250ba630b47fa91c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_0b81871429fdb058250ba630b47fa91c.jpg already downloaded
2026-03-30 10:42:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb93e27c-41d7-5c47-873a-3d6a8c31b2bb, identifier: AD74925
2026-03-30 10:42:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb93e27c-41d7-5c47-873a-3d6a8c31b2bb with identifier: AD74925
2026-03-30 10:42:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb93e27c-41d7-5c47-873a-3d6a8c31b2bb with identifier: AD74925
2026-03-30 10:42:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb93e27c-41d7-5c47-873a-3d6a8c31b2bb with identifier: AD74925 to the API
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AD74925>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:02:57Z',
 'fuel_type': 'diesel',
 'id': 'cb93e27c-41d7-5c47-873a-3d6a8c31b2bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD74925',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 297247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_18a8403012ec5cfce2defe5e010d6f9e.jpg',
                'https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_c4bd54fdc4dde9badf354b3a73e9575f.jpg',
                'https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_307d2837fcb4342f020cdfc6522eca29.jpg',
                'https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_9b53652341c09204512cf31f50a2cb8b.jpg',
                'https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_441440cac7bc79cec1d790e43b1bbe6c.jpg',
                'https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_f81176767dc511930b4de13fd443199b.jpg',
                'https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_bd4e0507adcda2f27e934a414ea65db6.jpg',
                'https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_4652f1f9cbaa266f36e8d9dc010e42ac.jpg',
                'https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_f30dfdec6f26e32cc36c85517e27ce35.jpg',
                'https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_0b81871429fdb058250ba630b47fa91c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb93e27c-41d7-5c47-873a-3d6a8c31b2bb/cb93e27c-41d7-5c47-873a-3d6a8c31b2bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_18a8403012ec5cfce2defe5e010d6f9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb93e27c-41d7-5c47-873a-3d6a8c31b2bb/cb93e27c-41d7-5c47-873a-3d6a8c31b2bb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_c4bd54fdc4dde9badf354b3a73e9575f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb93e27c-41d7-5c47-873a-3d6a8c31b2bb/cb93e27c-41d7-5c47-873a-3d6a8c31b2bb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2643976,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_307d2837fcb4342f020cdfc6522eca29.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb93e27c-41d7-5c47-873a-3d6a8c31b2bb/cb93e27c-41d7-5c47-873a-3d6a8c31b2bb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_9b53652341c09204512cf31f50a2cb8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb93e27c-41d7-5c47-873a-3d6a8c31b2bb/cb93e27c-41d7-5c47-873a-3d6a8c31b2bb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_441440cac7bc79cec1d790e43b1bbe6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb93e27c-41d7-5c47-873a-3d6a8c31b2bb/cb93e27c-41d7-5c47-873a-3d6a8c31b2bb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2610253,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_f81176767dc511930b4de13fd443199b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb93e27c-41d7-5c47-873a-3d6a8c31b2bb/cb93e27c-41d7-5c47-873a-3d6a8c31b2bb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2729133,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_bd4e0507adcda2f27e934a414ea65db6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb93e27c-41d7-5c47-873a-3d6a8c31b2bb/cb93e27c-41d7-5c47-873a-3d6a8c31b2bb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2564048,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_4652f1f9cbaa266f36e8d9dc010e42ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb93e27c-41d7-5c47-873a-3d6a8c31b2bb/cb93e27c-41d7-5c47-873a-3d6a8c31b2bb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_f30dfdec6f26e32cc36c85517e27ce35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb93e27c-41d7-5c47-873a-3d6a8c31b2bb/cb93e27c-41d7-5c47-873a-3d6a8c31b2bb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/6f/d16f5fdfdc0fda59c60f19ae50889a22/pa/AD74925_0b81871429fdb058250ba630b47fa91c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2013}
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD74925%27 HTTP/1.1" 200 None
2026-03-30 10:42:55 [auto1.de] INFO: Saving data for AD74925: {'created_time': 1774867375.057483, 'last_price_update_time': 1774867375.057491, 'auction_closing_time': 1774969377.0}
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD74925') HTTP/1.1" 204 0
2026-03-30 10:42:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AZ54716/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4338710>
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_5397d7adc86f8eb8b3b159538bafebbb.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_5397d7adc86f8eb8b3b159538bafebbb.jpg saved to cache
2026-03-30 10:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8e27fb0-143e-5aaf-a21a-e73a35a23ba3
2026-03-30 10:42:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4142fd0>
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_c15f4b82f1b541592f49e008451a3291.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_c15f4b82f1b541592f49e008451a3291.jpg saved to cache
2026-03-30 10:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28c5dd75-6d02-59ca-abaf-8d204d679d8d
2026-03-30 10:42:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_ae3ad8c93f77ced0d36e5e52b19c2c8a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f26d0>
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_ae3ad8c93f77ced0d36e5e52b19c2c8a.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_ae3ad8c93f77ced0d36e5e52b19c2c8a.jpg saved to cache
2026-03-30 10:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8e27fb0-143e-5aaf-a21a-e73a35a23ba3
2026-03-30 10:42:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_32249f44eb54d1b991c122c887a465da.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_106df9f095535702e98b1e9a689b4170.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee41be10>
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_32249f44eb54d1b991c122c887a465da.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_32249f44eb54d1b991c122c887a465da.jpg saved to cache
2026-03-30 10:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8e27fb0-143e-5aaf-a21a-e73a35a23ba3
2026-03-30 10:42:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee3ca90>
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_106df9f095535702e98b1e9a689b4170.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_106df9f095535702e98b1e9a689b4170.jpg saved to cache
2026-03-30 10:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28c5dd75-6d02-59ca-abaf-8d204d679d8d
2026-03-30 10:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_43670c3b473f0e4246c2520ca218eb31.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG25956> (referer: https://www.auto1.com/v1/car-details-view/UG25956/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee41a910>
2026-03-30 10:42:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_43670c3b473f0e4246c2520ca218eb31.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_43670c3b473f0e4246c2520ca218eb31.jpg saved to cache
2026-03-30 10:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28c5dd75-6d02-59ca-abaf-8d204d679d8d
2026-03-30 10:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF05985/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5984effc-4535-5711-87f2-0d3400eec102 with identifier: UG25956
2026-03-30 10:42:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5984effc-4535-5711-87f2-0d3400eec102 with scrape type 1
2026-03-30 10:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5984effc-4535-5711-87f2-0d3400eec102
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F03%252Fef038c597981a5b52371d4933b0f987c%252Fpa%252FUG25956_7a33d3a18716dcd7c2872ad453f08cdd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_7a33d3a18716dcd7c2872ad453f08cdd.jpg already downloaded
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F03%252Fef038c597981a5b52371d4933b0f987c%252Fpa%252FUG25956_16d11c7bb809fceeb26bda903591f050.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_16d11c7bb809fceeb26bda903591f050.jpg already downloaded
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F03%252Fef038c597981a5b52371d4933b0f987c%252Fpa%252FUG25956_a766f075bff6015e1aa51268d96b7bfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_a766f075bff6015e1aa51268d96b7bfe.jpg already downloaded
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F03%252Fef038c597981a5b52371d4933b0f987c%252Fpa%252FUG25956_e89454abd10f7d655731279238f57f7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_e89454abd10f7d655731279238f57f7b.jpg already downloaded
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F03%252Fef038c597981a5b52371d4933b0f987c%252Fpa%252FUG25956_2d86b2c4c7d672ea06221c0c949b1235.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_2d86b2c4c7d672ea06221c0c949b1235.jpg already downloaded
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F03%252Fef038c597981a5b52371d4933b0f987c%252Fpa%252FUG25956_33b3b8cff39313cf659741c8b967b241.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_33b3b8cff39313cf659741c8b967b241.jpg already downloaded
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F03%252Fef038c597981a5b52371d4933b0f987c%252Fpa%252FUG25956_5e5a46c984badc456b1e14732e5011c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_5e5a46c984badc456b1e14732e5011c5.jpg already downloaded
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F03%252Fef038c597981a5b52371d4933b0f987c%252Fpa%252FUG25956_ce4fba9792707436c452c790c4dd6e0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_ce4fba9792707436c452c790c4dd6e0c.jpg already downloaded
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F03%252Fef038c597981a5b52371d4933b0f987c%252Fpa%252FUG25956_c5cde652535c870e2f4aafb352491622.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_c5cde652535c870e2f4aafb352491622.jpg already downloaded
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F03%252Fef038c597981a5b52371d4933b0f987c%252Fpa%252FUG25956_d2efb7830b23906b4d827e808e4bf42d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_d2efb7830b23906b4d827e808e4bf42d.jpg already downloaded
2026-03-30 10:42:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5984effc-4535-5711-87f2-0d3400eec102, identifier: UG25956
2026-03-30 10:42:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5984effc-4535-5711-87f2-0d3400eec102 with identifier: UG25956
2026-03-30 10:42:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5984effc-4535-5711-87f2-0d3400eec102 with identifier: UG25956
2026-03-30 10:42:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5984effc-4535-5711-87f2-0d3400eec102 with identifier: UG25956 to the API
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UG25956>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:53:01Z',
 'fuel_type': 'petrol',
 'id': '5984effc-4535-5711-87f2-0d3400eec102',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG25956',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 142803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_7a33d3a18716dcd7c2872ad453f08cdd.jpg',
                'https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_16d11c7bb809fceeb26bda903591f050.jpg',
                'https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_a766f075bff6015e1aa51268d96b7bfe.jpg',
                'https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_e89454abd10f7d655731279238f57f7b.jpg',
                'https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_2d86b2c4c7d672ea06221c0c949b1235.jpg',
                'https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_33b3b8cff39313cf659741c8b967b241.jpg',
                'https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_5e5a46c984badc456b1e14732e5011c5.jpg',
                'https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_ce4fba9792707436c452c790c4dd6e0c.jpg',
                'https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_c5cde652535c870e2f4aafb352491622.jpg',
                'https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_d2efb7830b23906b4d827e808e4bf42d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5984effc-4535-5711-87f2-0d3400eec102/5984effc-4535-5711-87f2-0d3400eec102_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2744639,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_7a33d3a18716dcd7c2872ad453f08cdd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5984effc-4535-5711-87f2-0d3400eec102/5984effc-4535-5711-87f2-0d3400eec102_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2868329,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_16d11c7bb809fceeb26bda903591f050.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5984effc-4535-5711-87f2-0d3400eec102/5984effc-4535-5711-87f2-0d3400eec102_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_a766f075bff6015e1aa51268d96b7bfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5984effc-4535-5711-87f2-0d3400eec102/5984effc-4535-5711-87f2-0d3400eec102_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2671848,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_e89454abd10f7d655731279238f57f7b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5984effc-4535-5711-87f2-0d3400eec102/5984effc-4535-5711-87f2-0d3400eec102_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2757030,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_2d86b2c4c7d672ea06221c0c949b1235.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5984effc-4535-5711-87f2-0d3400eec102/5984effc-4535-5711-87f2-0d3400eec102_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_33b3b8cff39313cf659741c8b967b241.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5984effc-4535-5711-87f2-0d3400eec102/5984effc-4535-5711-87f2-0d3400eec102_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2910352,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_5e5a46c984badc456b1e14732e5011c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5984effc-4535-5711-87f2-0d3400eec102/5984effc-4535-5711-87f2-0d3400eec102_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2791339,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_ce4fba9792707436c452c790c4dd6e0c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5984effc-4535-5711-87f2-0d3400eec102/5984effc-4535-5711-87f2-0d3400eec102_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_c5cde652535c870e2f4aafb352491622.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5984effc-4535-5711-87f2-0d3400eec102/5984effc-4535-5711-87f2-0d3400eec102_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/03/ef038c597981a5b52371d4933b0f987c/pa/UG25956_d2efb7830b23906b4d827e808e4bf42d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG25956%27 HTTP/1.1" 200 None
2026-03-30 10:42:56 [auto1.de] INFO: Saving data for UG25956: {'created_time': 1774867376.982188, 'last_price_update_time': 1774867376.982198, 'auction_closing_time': 1774972381.0}
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG25956') HTTP/1.1" 204 0
2026-03-30 10:42:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_c15b30a1c54255a2cb8e598a79558341.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_d585cfeecb0e7f1ad77980af9db9f242.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_e3db4c9555084e2608b8fdfb809accf7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee83810>
2026-03-30 10:42:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_c15b30a1c54255a2cb8e598a79558341.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_c15b30a1c54255a2cb8e598a79558341.jpg saved to cache
2026-03-30 10:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8e27fb0-143e-5aaf-a21a-e73a35a23ba3
2026-03-30 10:42:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4823d0>
2026-03-30 10:42:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_d585cfeecb0e7f1ad77980af9db9f242.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_d585cfeecb0e7f1ad77980af9db9f242.jpg saved to cache
2026-03-30 10:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28c5dd75-6d02-59ca-abaf-8d204d679d8d
2026-03-30 10:42:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42b7dd0>
2026-03-30 10:42:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_e3db4c9555084e2608b8fdfb809accf7.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_e3db4c9555084e2608b8fdfb809accf7.jpg saved to cache
2026-03-30 10:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8e27fb0-143e-5aaf-a21a-e73a35a23ba3
2026-03-30 10:42:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_d6800d2daec80af2866206f9c82b4765.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4301990>
2026-03-30 10:42:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb6%252Ff9b675120045926e527307a04fc2a6b2%252Fpa%252FMD17781_d6800d2daec80af2866206f9c82b4765.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_d6800d2daec80af2866206f9c82b4765.jpg saved to cache
2026-03-30 10:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28c5dd75-6d02-59ca-abaf-8d204d679d8d
2026-03-30 10:42:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28c5dd75-6d02-59ca-abaf-8d204d679d8d, skipping ID generation
2026-03-30 10:42:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28c5dd75-6d02-59ca-abaf-8d204d679d8d with scrape type 1
2026-03-30 10:42:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28c5dd75-6d02-59ca-abaf-8d204d679d8d sending to next pipeline
2026-03-30 10:42:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28c5dd75-6d02-59ca-abaf-8d204d679d8d, identifier: MD17781
2026-03-30 10:42:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28c5dd75-6d02-59ca-abaf-8d204d679d8d with identifier: MD17781
2026-03-30 10:42:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28c5dd75-6d02-59ca-abaf-8d204d679d8d with identifier: MD17781
2026-03-30 10:42:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28c5dd75-6d02-59ca-abaf-8d204d679d8d with identifier: MD17781 to the API
2026-03-30 10:42:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_d6800d2daec80af2866206f9c82b4765.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:51:38Z',
 'fuel_type': 'petrol',
 'id': '28c5dd75-6d02-59ca-abaf-8d204d679d8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD17781',
 'listing': 'auction',
 'location': 'DE, Halle',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 101666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2907461,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_d6800d2daec80af2866206f9c82b4765.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2709753,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_d585cfeecb0e7f1ad77980af9db9f242.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2755826,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_43670c3b473f0e4246c2520ca218eb31.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2785190,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_106df9f095535702e98b1e9a689b4170.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2730866,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_c15f4b82f1b541592f49e008451a3291.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2763951,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_95dac7b7dba6f0f9e9b554343dccd36a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2848065,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_dec863c031a639d53c1ee9642bf07d00.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2797669,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_579f2088cb5bc46553c2736421d9dcb5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2727274,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_d0f7971b23b596fe4fa0db81ebc02889.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c5dd75-6d02-59ca-abaf-8d204d679d8d/28c5dd75-6d02-59ca-abaf-8d204d679d8d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2927740,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b6/f9b675120045926e527307a04fc2a6b2/pa/MD17781_bdd499cbfe843829d0eead5e85f46f26.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.0 TGDI Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2020}
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD17781%27 HTTP/1.1" 200 None
2026-03-30 10:42:58 [auto1.de] INFO: Saving data for MD17781: {'created_time': 1774867378.190153, 'last_price_update_time': 1774867378.190164, 'auction_closing_time': 1774972298.0}
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD17781') HTTP/1.1" 204 0
2026-03-30 10:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XM95043> (referer: https://www.auto1.com/v1/car-details-view/XM95043/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VC85429> (referer: https://www.auto1.com/v1/car-details-view/VC85429/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_805ba9d47b5157e8cee0e41458da7fce.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_6ca0b3822c3808bddb6f2f5178ca8a44.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_45e4ccda2ca88f5f268b9a1f1bd77007.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7a84f5d-4507-5a18-a7c1-02b650f56d35 with identifier: XM95043
2026-03-30 10:42:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7a84f5d-4507-5a18-a7c1-02b650f56d35 with scrape type 1
2026-03-30 10:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7a84f5d-4507-5a18-a7c1-02b650f56d35
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F6a%252F976af507f7059bcfbef1e68b103761d7%252Fpa%252FXM95043_9c86f3efef7a0da462c086122b5da086.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_9c86f3efef7a0da462c086122b5da086.jpg already downloaded
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F6a%252F976af507f7059bcfbef1e68b103761d7%252Fpa%252FXM95043_f3dc12eda2b54a6483333b70c72df399.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_f3dc12eda2b54a6483333b70c72df399.jpg already downloaded
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F6a%252F976af507f7059bcfbef1e68b103761d7%252Fpa%252FXM95043_2385a97582e88c576a8ec5c39a138ce8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_2385a97582e88c576a8ec5c39a138ce8.jpg already downloaded
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F6a%252F976af507f7059bcfbef1e68b103761d7%252Fpa%252FXM95043_565d43be21cdffc3956f227b35c835a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_565d43be21cdffc3956f227b35c835a0.jpg already downloaded
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F6a%252F976af507f7059bcfbef1e68b103761d7%252Fpa%252FXM95043_2a160d6cdb087762ead1740010b6bd8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_2a160d6cdb087762ead1740010b6bd8b.jpg already downloaded
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F6a%252F976af507f7059bcfbef1e68b103761d7%252Fpa%252FXM95043_82882d158ba0e1b59784928f20b21c96.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_82882d158ba0e1b59784928f20b21c96.jpg already downloaded
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F6a%252F976af507f7059bcfbef1e68b103761d7%252Fpa%252FXM95043_09522abbdc4b7886b1feed140c46d812.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_09522abbdc4b7886b1feed140c46d812.jpg already downloaded
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F6a%252F976af507f7059bcfbef1e68b103761d7%252Fpa%252FXM95043_2dc6b3a0d7b257f7fa9c9061eec9fef2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_2dc6b3a0d7b257f7fa9c9061eec9fef2.jpg already downloaded
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F6a%252F976af507f7059bcfbef1e68b103761d7%252Fpa%252FXM95043_e23dc3427dd23a3284f598a57e27b534.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_e23dc3427dd23a3284f598a57e27b534.jpg already downloaded
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F6a%252F976af507f7059bcfbef1e68b103761d7%252Fpa%252FXM95043_bf731f6374fa6c8dbb340b0bdf02a42c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_bf731f6374fa6c8dbb340b0bdf02a42c.jpg already downloaded
2026-03-30 10:42:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7a84f5d-4507-5a18-a7c1-02b650f56d35, identifier: XM95043
2026-03-30 10:42:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7a84f5d-4507-5a18-a7c1-02b650f56d35 with identifier: XM95043
2026-03-30 10:42:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7a84f5d-4507-5a18-a7c1-02b650f56d35 with identifier: XM95043
2026-03-30 10:42:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7a84f5d-4507-5a18-a7c1-02b650f56d35 with identifier: XM95043 to the API
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XM95043>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:55:23Z',
 'fuel_type': 'petrol',
 'id': 'd7a84f5d-4507-5a18-a7c1-02b650f56d35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM95043',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Skoda',
 'model': 'Citigo',
 'odometer': 146543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_9c86f3efef7a0da462c086122b5da086.jpg',
                'https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_f3dc12eda2b54a6483333b70c72df399.jpg',
                'https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_2385a97582e88c576a8ec5c39a138ce8.jpg',
                'https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_565d43be21cdffc3956f227b35c835a0.jpg',
                'https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_2a160d6cdb087762ead1740010b6bd8b.jpg',
                'https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_82882d158ba0e1b59784928f20b21c96.jpg',
                'https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_09522abbdc4b7886b1feed140c46d812.jpg',
                'https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_2dc6b3a0d7b257f7fa9c9061eec9fef2.jpg',
                'https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_e23dc3427dd23a3284f598a57e27b534.jpg',
                'https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_bf731f6374fa6c8dbb340b0bdf02a42c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a84f5d-4507-5a18-a7c1-02b650f56d35/d7a84f5d-4507-5a18-a7c1-02b650f56d35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3019535,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_9c86f3efef7a0da462c086122b5da086.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a84f5d-4507-5a18-a7c1-02b650f56d35/d7a84f5d-4507-5a18-a7c1-02b650f56d35_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_f3dc12eda2b54a6483333b70c72df399.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a84f5d-4507-5a18-a7c1-02b650f56d35/d7a84f5d-4507-5a18-a7c1-02b650f56d35_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_2385a97582e88c576a8ec5c39a138ce8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a84f5d-4507-5a18-a7c1-02b650f56d35/d7a84f5d-4507-5a18-a7c1-02b650f56d35_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2710299,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_565d43be21cdffc3956f227b35c835a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a84f5d-4507-5a18-a7c1-02b650f56d35/d7a84f5d-4507-5a18-a7c1-02b650f56d35_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_2a160d6cdb087762ead1740010b6bd8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a84f5d-4507-5a18-a7c1-02b650f56d35/d7a84f5d-4507-5a18-a7c1-02b650f56d35_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2968835,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_82882d158ba0e1b59784928f20b21c96.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a84f5d-4507-5a18-a7c1-02b650f56d35/d7a84f5d-4507-5a18-a7c1-02b650f56d35_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_09522abbdc4b7886b1feed140c46d812.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a84f5d-4507-5a18-a7c1-02b650f56d35/d7a84f5d-4507-5a18-a7c1-02b650f56d35_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_2dc6b3a0d7b257f7fa9c9061eec9fef2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a84f5d-4507-5a18-a7c1-02b650f56d35/d7a84f5d-4507-5a18-a7c1-02b650f56d35_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_e23dc3427dd23a3284f598a57e27b534.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a84f5d-4507-5a18-a7c1-02b650f56d35/d7a84f5d-4507-5a18-a7c1-02b650f56d35_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/6a/976af507f7059bcfbef1e68b103761d7/pa/XM95043_bf731f6374fa6c8dbb340b0bdf02a42c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Skoda Citigo 1.0 MPI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM95043%27 HTTP/1.1" 200 None
2026-03-30 10:42:59 [auto1.de] INFO: Saving data for XM95043: {'created_time': 1774867379.042411, 'last_price_update_time': 1774867379.042422, 'auction_closing_time': 1774972523.0}
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM95043') HTTP/1.1" 204 0
2026-03-30 10:42:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a with identifier: VC85429
2026-03-30 10:42:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a with scrape type 1
2026-03-30 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fab%252Fe2ab698ccf2ca6c5177a7437e32bcb9c%252Fpa%252FVC85429_d5bd0254904c6057df56e415cf8aafec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_d5bd0254904c6057df56e415cf8aafec.jpg already downloaded
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fab%252Fe2ab698ccf2ca6c5177a7437e32bcb9c%252Fpa%252FVC85429_26c5490988564216a221d4f9b9760ec2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_26c5490988564216a221d4f9b9760ec2.jpg already downloaded
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fab%252Fe2ab698ccf2ca6c5177a7437e32bcb9c%252Fpa%252FVC85429_8acd5bfc2d1574f07c412699aa838f33.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_8acd5bfc2d1574f07c412699aa838f33.jpg already downloaded
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fab%252Fe2ab698ccf2ca6c5177a7437e32bcb9c%252Fpa%252FVC85429_2caff84c627582f9e06eaf1372a155d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_2caff84c627582f9e06eaf1372a155d7.jpg already downloaded
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fab%252Fe2ab698ccf2ca6c5177a7437e32bcb9c%252Fpa%252FVC85429_9cb411bd0813f263799416074dbbb61d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_9cb411bd0813f263799416074dbbb61d.jpg already downloaded
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fab%252Fe2ab698ccf2ca6c5177a7437e32bcb9c%252Fpa%252FVC85429_2a3e7dd6d5c1bf3f56959d1f320bc5b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_2a3e7dd6d5c1bf3f56959d1f320bc5b0.jpg already downloaded
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fab%252Fe2ab698ccf2ca6c5177a7437e32bcb9c%252Fpa%252FVC85429_408f599fc57fc2c8357cb889142db2bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_408f599fc57fc2c8357cb889142db2bb.jpg already downloaded
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fab%252Fe2ab698ccf2ca6c5177a7437e32bcb9c%252Fpa%252FVC85429_a7444d9e9a3a090f74f234c482181006.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_a7444d9e9a3a090f74f234c482181006.jpg already downloaded
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fab%252Fe2ab698ccf2ca6c5177a7437e32bcb9c%252Fpa%252FVC85429_068e6567089c0a923950cd49e40d5645.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_068e6567089c0a923950cd49e40d5645.jpg already downloaded
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fab%252Fe2ab698ccf2ca6c5177a7437e32bcb9c%252Fpa%252FVC85429_9c0af29f46f0ce5a98763d52e1e7806b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_9c0af29f46f0ce5a98763d52e1e7806b.jpg already downloaded
2026-03-30 10:42:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a, identifier: VC85429
2026-03-30 10:42:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a with identifier: VC85429
2026-03-30 10:42:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a with identifier: VC85429
2026-03-30 10:42:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a with identifier: VC85429 to the API
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VC85429>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:27:26Z',
 'fuel_type': 'petrol',
 'id': 'c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC85429',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 139722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_d5bd0254904c6057df56e415cf8aafec.jpg',
                'https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_26c5490988564216a221d4f9b9760ec2.jpg',
                'https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_8acd5bfc2d1574f07c412699aa838f33.jpg',
                'https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_2caff84c627582f9e06eaf1372a155d7.jpg',
                'https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_9cb411bd0813f263799416074dbbb61d.jpg',
                'https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_2a3e7dd6d5c1bf3f56959d1f320bc5b0.jpg',
                'https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_408f599fc57fc2c8357cb889142db2bb.jpg',
                'https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_a7444d9e9a3a090f74f234c482181006.jpg',
                'https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_068e6567089c0a923950cd49e40d5645.jpg',
                'https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_9c0af29f46f0ce5a98763d52e1e7806b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a/c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3012849,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_d5bd0254904c6057df56e415cf8aafec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a/c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2947999,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_26c5490988564216a221d4f9b9760ec2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a/c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2738173,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_8acd5bfc2d1574f07c412699aa838f33.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a/c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2934185,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_2caff84c627582f9e06eaf1372a155d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a/c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2762554,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_9cb411bd0813f263799416074dbbb61d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a/c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2371885,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_2a3e7dd6d5c1bf3f56959d1f320bc5b0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a/c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2343795,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_408f599fc57fc2c8357cb889142db2bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a/c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2475352,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_a7444d9e9a3a090f74f234c482181006.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a/c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3051144,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_068e6567089c0a923950cd49e40d5645.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a/c52e20ab-27e8-5dea-b6f7-cf4d3f12b60a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2854963,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ab/e2ab698ccf2ca6c5177a7437e32bcb9c/pa/VC85429_9c0af29f46f0ce5a98763d52e1e7806b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2013}
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC85429%27 HTTP/1.1" 200 None
2026-03-30 10:42:59 [auto1.de] INFO: Saving data for VC85429: {'created_time': 1774867379.65951, 'last_price_update_time': 1774867379.65952, 'auction_closing_time': 1774970846.0}
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC85429') HTTP/1.1" 204 0
2026-03-30 10:43:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3b790>
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_805ba9d47b5157e8cee0e41458da7fce.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_805ba9d47b5157e8cee0e41458da7fce.jpg saved to cache
2026-03-30 10:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8e27fb0-143e-5aaf-a21a-e73a35a23ba3
2026-03-30 10:43:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419c890>
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_6ca0b3822c3808bddb6f2f5178ca8a44.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_6ca0b3822c3808bddb6f2f5178ca8a44.jpg saved to cache
2026-03-30 10:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8e27fb0-143e-5aaf-a21a-e73a35a23ba3
2026-03-30 10:43:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef5710>
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_45e4ccda2ca88f5f268b9a1f1bd77007.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_45e4ccda2ca88f5f268b9a1f1bd77007.jpg saved to cache
2026-03-30 10:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8e27fb0-143e-5aaf-a21a-e73a35a23ba3
2026-03-30 10:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_8a66c2c40dbdd7e381926ab0e838f7d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_d651d2f225a5e9c8dadc04c22a5bb062.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434ec10>
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_8a66c2c40dbdd7e381926ab0e838f7d3.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_8a66c2c40dbdd7e381926ab0e838f7d3.jpg saved to cache
2026-03-30 10:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8e27fb0-143e-5aaf-a21a-e73a35a23ba3
2026-03-30 10:43:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee85b10>
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F1f%252F3d1f003b2410fee2a6a23f338388f13e%252Fpa%252FGN20483_d651d2f225a5e9c8dadc04c22a5bb062.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_d651d2f225a5e9c8dadc04c22a5bb062.jpg saved to cache
2026-03-30 10:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8e27fb0-143e-5aaf-a21a-e73a35a23ba3
2026-03-30 10:43:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8e27fb0-143e-5aaf-a21a-e73a35a23ba3, skipping ID generation
2026-03-30 10:43:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8e27fb0-143e-5aaf-a21a-e73a35a23ba3 with scrape type 1
2026-03-30 10:43:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8e27fb0-143e-5aaf-a21a-e73a35a23ba3 sending to next pipeline
2026-03-30 10:43:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8e27fb0-143e-5aaf-a21a-e73a35a23ba3, identifier: GN20483
2026-03-30 10:43:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8e27fb0-143e-5aaf-a21a-e73a35a23ba3 with identifier: GN20483
2026-03-30 10:43:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8e27fb0-143e-5aaf-a21a-e73a35a23ba3 with identifier: GN20483
2026-03-30 10:43:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8e27fb0-143e-5aaf-a21a-e73a35a23ba3 with identifier: GN20483 to the API
2026-03-30 10:43:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_d651d2f225a5e9c8dadc04c22a5bb062.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:27:11Z',
 'fuel_type': 'petrol',
 'id': 'c8e27fb0-143e-5aaf-a21a-e73a35a23ba3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN20483',
 'listing': 'auction',
 'location': 'DE, Seesen',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 199029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2864922,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_8a66c2c40dbdd7e381926ab0e838f7d3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2854404,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_d651d2f225a5e9c8dadc04c22a5bb062.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2691939,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_45e4ccda2ca88f5f268b9a1f1bd77007.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2911468,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_6ca0b3822c3808bddb6f2f5178ca8a44.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2540810,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_805ba9d47b5157e8cee0e41458da7fce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2870930,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_e3db4c9555084e2608b8fdfb809accf7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2758769,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_c15b30a1c54255a2cb8e598a79558341.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2896798,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_32249f44eb54d1b991c122c887a465da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2896303,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_ae3ad8c93f77ced0d36e5e52b19c2c8a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8e27fb0-143e-5aaf-a21a-e73a35a23ba3/c8e27fb0-143e-5aaf-a21a-e73a35a23ba3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2740358,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/1f/3d1f003b2410fee2a6a23f338388f13e/pa/GN20483_5397d7adc86f8eb8b3b159538bafebbb.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20i',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-30 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN20483%27 HTTP/1.1" 200 None
2026-03-30 10:43:01 [auto1.de] INFO: Saving data for GN20483: {'created_time': 1774867381.269415, 'last_price_update_time': 1774867381.269425, 'auction_closing_time': 1774970831.0}
2026-03-30 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN20483') HTTP/1.1" 204 0
2026-03-30 10:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_d4034727ec0c278bf98970318e7bb81a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4171090>
2026-03-30 10:43:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_d4034727ec0c278bf98970318e7bb81a.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_d4034727ec0c278bf98970318e7bb81a.jpg saved to cache
2026-03-30 10:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40a28f27-542a-5231-9511-1da844e4fb9b
2026-03-30 10:43:04 [scrapy.extensions.logstats] INFO: Crawled 477 pages (at 34 pages/min), scraped 340 items (at 25 items/min)
2026-03-30 10:43:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:43:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY96025/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_46b744530eded5183897887c962d4216.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45f950>
2026-03-30 10:43:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_46b744530eded5183897887c962d4216.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_46b744530eded5183897887c962d4216.jpg saved to cache
2026-03-30 10:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40a28f27-542a-5231-9511-1da844e4fb9b
2026-03-30 10:43:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MY39780> (referer: https://www.auto1.com/v1/car-details-view/MY39780/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e1f4857-ed6a-54ae-bbba-e506bce656c0 with identifier: MY39780
2026-03-30 10:43:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e1f4857-ed6a-54ae-bbba-e506bce656c0 with scrape type 1
2026-03-30 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e1f4857-ed6a-54ae-bbba-e506bce656c0
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_90927ec8e08f2605d039aa4b7dd74150.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_90927ec8e08f2605d039aa4b7dd74150.jpg not downloaded yet
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_ce75a42bca72a2f144e702292ca5dae2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_ce75a42bca72a2f144e702292ca5dae2.jpg not downloaded yet
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_9861518fbd8fca000ff2b51d0998a9fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_9861518fbd8fca000ff2b51d0998a9fb.jpg not downloaded yet
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_05119d67640da1f96fdafb54be324e8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_05119d67640da1f96fdafb54be324e8b.jpg not downloaded yet
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_34225078ddba1a6267c72931938fbe4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_34225078ddba1a6267c72931938fbe4c.jpg not downloaded yet
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_12d4af920c90f947fcdb468df244cbd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_12d4af920c90f947fcdb468df244cbd1.jpg not downloaded yet
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_25702c091119aabf33cc7abf74cd17eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_25702c091119aabf33cc7abf74cd17eb.jpg not downloaded yet
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_3931d4caff0acd1b7fbdd1d1f6995f25.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_3931d4caff0acd1b7fbdd1d1f6995f25.jpg not downloaded yet
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_e97ddca0acd2c485fbfdea51e0cf8f9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_e97ddca0acd2c485fbfdea51e0cf8f9a.jpg not downloaded yet
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_730d1c60c2f8d989c6c4f5c0497fc093.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_730d1c60c2f8d989c6c4f5c0497fc093.jpg not downloaded yet
2026-03-30 10:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL10324> (referer: https://www.auto1.com/v1/car-details-view/DL10324/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_730d1c60c2f8d989c6c4f5c0497fc093.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad4c2b68-df03-52d2-81cf-494de2bc807d with identifier: DL10324
2026-03-30 10:43:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad4c2b68-df03-52d2-81cf-494de2bc807d with scrape type 1
2026-03-30 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad4c2b68-df03-52d2-81cf-494de2bc807d
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_d9deeb0b77b3303fe137a9afc5958a29.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_d9deeb0b77b3303fe137a9afc5958a29.jpg not downloaded yet
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_888b21b24a7d4905d40d04c81e4305c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_888b21b24a7d4905d40d04c81e4305c0.jpg not downloaded yet
2026-03-30 10:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_e97ddca0acd2c485fbfdea51e0cf8f9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_b83a33492f9f9db5587ac00d5dddb376.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_b83a33492f9f9db5587ac00d5dddb376.jpg not downloaded yet
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_851c9e05bde8a40a73adb0d0a7d3a83d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_851c9e05bde8a40a73adb0d0a7d3a83d.jpg not downloaded yet
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_93d8e397d9ec2082ad1633dc92524794.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_93d8e397d9ec2082ad1633dc92524794.jpg not downloaded yet
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_ff515cd59bce7f0a0fda07f9329bc42a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_ff515cd59bce7f0a0fda07f9329bc42a.jpg not downloaded yet
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef4e4d0>
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_730d1c60c2f8d989c6c4f5c0497fc093.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_730d1c60c2f8d989c6c4f5c0497fc093.jpg saved to cache
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e1f4857-ed6a-54ae-bbba-e506bce656c0
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_5f5869d408d0f2639b4142968ce8d72f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_5f5869d408d0f2639b4142968ce8d72f.jpg not downloaded yet
2026-03-30 10:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_888b21b24a7d4905d40d04c81e4305c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_ac8ed107abc993e78a92ef2fd7554bd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_ac8ed107abc993e78a92ef2fd7554bd9.jpg not downloaded yet
2026-03-30 10:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AZ54716> (referer: https://www.auto1.com/v1/car-details-view/AZ54716/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_91eecf20db41e01594f51e2f17b1d896.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_91eecf20db41e01594f51e2f17b1d896.jpg not downloaded yet
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a0ed0>
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_e97ddca0acd2c485fbfdea51e0cf8f9a.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_e97ddca0acd2c485fbfdea51e0cf8f9a.jpg saved to cache
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e1f4857-ed6a-54ae-bbba-e506bce656c0
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_4e3223610433f8fb6ae52b45e33cd865.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_4e3223610433f8fb6ae52b45e33cd865.jpg not downloaded yet
2026-03-30 10:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_ff515cd59bce7f0a0fda07f9329bc42a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee41a810>
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_888b21b24a7d4905d40d04c81e4305c0.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_888b21b24a7d4905d40d04c81e4305c0.jpg saved to cache
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad4c2b68-df03-52d2-81cf-494de2bc807d
2026-03-30 10:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_ac8ed107abc993e78a92ef2fd7554bd9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dac40b34-d293-515f-9949-2a8913ae9e26 with identifier: AZ54716
2026-03-30 10:43:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dac40b34-d293-515f-9949-2a8913ae9e26 with scrape type 1
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item dac40b34-d293-515f-9949-2a8913ae9e26
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167761e83aaea7543784c2fcb9f62c9%252Fpa%252FAZ54716_55b55b80507cfa963d8929a9b8ee3cd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_55b55b80507cfa963d8929a9b8ee3cd1.jpg not downloaded yet
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167761e83aaea7543784c2fcb9f62c9%252Fpa%252FAZ54716_67b5c810a23e95b3ad752c43e18495c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_67b5c810a23e95b3ad752c43e18495c8.jpg not downloaded yet
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167761e83aaea7543784c2fcb9f62c9%252Fpa%252FAZ54716_c7c3418d0e81b7728b3820d78f4afbec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_c7c3418d0e81b7728b3820d78f4afbec.jpg not downloaded yet
2026-03-30 10:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_4e3223610433f8fb6ae52b45e33cd865.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167761e83aaea7543784c2fcb9f62c9%252Fpa%252FAZ54716_c68f6ea9055864213429f4d255da565a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_c68f6ea9055864213429f4d255da565a.jpg not downloaded yet
2026-03-30 10:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_91eecf20db41e01594f51e2f17b1d896.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee60150>
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_ff515cd59bce7f0a0fda07f9329bc42a.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_ff515cd59bce7f0a0fda07f9329bc42a.jpg saved to cache
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad4c2b68-df03-52d2-81cf-494de2bc807d
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167761e83aaea7543784c2fcb9f62c9%252Fpa%252FAZ54716_2c892332759c8921c386814ba13b81e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_2c892332759c8921c386814ba13b81e0.jpg not downloaded yet
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167761e83aaea7543784c2fcb9f62c9%252Fpa%252FAZ54716_dcd1825c4c04b6872843196520ccebeb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_dcd1825c4c04b6872843196520ccebeb.jpg not downloaded yet
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d3e50>
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_ac8ed107abc993e78a92ef2fd7554bd9.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_ac8ed107abc993e78a92ef2fd7554bd9.jpg saved to cache
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad4c2b68-df03-52d2-81cf-494de2bc807d
2026-03-30 10:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_c7c3418d0e81b7728b3820d78f4afbec.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c02290>
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_4e3223610433f8fb6ae52b45e33cd865.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_4e3223610433f8fb6ae52b45e33cd865.jpg saved to cache
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ad4c2b68-df03-52d2-81cf-494de2bc807d
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4303c90>
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_91eecf20db41e01594f51e2f17b1d896.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_91eecf20db41e01594f51e2f17b1d896.jpg saved to cache
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad4c2b68-df03-52d2-81cf-494de2bc807d
2026-03-30 10:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FS39177> (referer: https://www.auto1.com/v1/car-details-view/FS39177/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45e310>
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac40b34-d293-515f-9949-2a8913ae9e26/dac40b34-d293-515f-9949-2a8913ae9e26_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167761e83aaea7543784c2fcb9f62c9%252Fpa%252FAZ54716_c7c3418d0e81b7728b3820d78f4afbec.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_c7c3418d0e81b7728b3820d78f4afbec.jpg saved to cache
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dac40b34-d293-515f-9949-2a8913ae9e26
2026-03-30 10:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_67b5c810a23e95b3ad752c43e18495c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_dcd1825c4c04b6872843196520ccebeb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 935d3819-5cef-5ec2-b416-5ccd79a8c89b with identifier: FS39177
2026-03-30 10:43:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 935d3819-5cef-5ec2-b416-5ccd79a8c89b with scrape type 1
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 935d3819-5cef-5ec2-b416-5ccd79a8c89b
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_8ac6112527e9522e3d465ea4677e3403.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_8ac6112527e9522e3d465ea4677e3403.jpg not downloaded yet
2026-03-30 10:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_55b55b80507cfa963d8929a9b8ee3cd1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_d1d51a12334d892fbf450f52ed05272c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_d1d51a12334d892fbf450f52ed05272c.jpg not downloaded yet
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_53adff6e673d0a938d788690fe3c6203.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_53adff6e673d0a938d788690fe3c6203.jpg not downloaded yet
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_7a9c17ea3c69d9649afe2ab53eaa1ddc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_7a9c17ea3c69d9649afe2ab53eaa1ddc.jpg not downloaded yet
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef5bed0>
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac40b34-d293-515f-9949-2a8913ae9e26/dac40b34-d293-515f-9949-2a8913ae9e26_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167761e83aaea7543784c2fcb9f62c9%252Fpa%252FAZ54716_67b5c810a23e95b3ad752c43e18495c8.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_67b5c810a23e95b3ad752c43e18495c8.jpg saved to cache
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dac40b34-d293-515f-9949-2a8913ae9e26
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41f3790>
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac40b34-d293-515f-9949-2a8913ae9e26/dac40b34-d293-515f-9949-2a8913ae9e26_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167761e83aaea7543784c2fcb9f62c9%252Fpa%252FAZ54716_dcd1825c4c04b6872843196520ccebeb.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_dcd1825c4c04b6872843196520ccebeb.jpg saved to cache
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dac40b34-d293-515f-9949-2a8913ae9e26
2026-03-30 10:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_c68f6ea9055864213429f4d255da565a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_2a942222019bdd4f17d1fc0bb7207d59.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_2a942222019bdd4f17d1fc0bb7207d59.jpg not downloaded yet
2026-03-30 10:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_2c892332759c8921c386814ba13b81e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_8ac6112527e9522e3d465ea4677e3403.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_fb76a51335353eadb203e1fb4e4f08f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_fb76a51335353eadb203e1fb4e4f08f8.jpg not downloaded yet
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeee2810>
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac40b34-d293-515f-9949-2a8913ae9e26/dac40b34-d293-515f-9949-2a8913ae9e26_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167761e83aaea7543784c2fcb9f62c9%252Fpa%252FAZ54716_55b55b80507cfa963d8929a9b8ee3cd1.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_55b55b80507cfa963d8929a9b8ee3cd1.jpg saved to cache
2026-03-30 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dac40b34-d293-515f-9949-2a8913ae9e26
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_d10f4188091b974c8666576840f96e3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_d10f4188091b974c8666576840f96e3e.jpg not downloaded yet
2026-03-30 10:43:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_7a9c17ea3c69d9649afe2ab53eaa1ddc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_2e72fb61229364d708c3e69a94795ba7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_2e72fb61229364d708c3e69a94795ba7.jpg not downloaded yet
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_8d5c84498041c2dec94a759c5eee423c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_8d5c84498041c2dec94a759c5eee423c.jpg not downloaded yet
2026-03-30 10:43:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee94510>
2026-03-30 10:43:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac40b34-d293-515f-9949-2a8913ae9e26/dac40b34-d293-515f-9949-2a8913ae9e26_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167761e83aaea7543784c2fcb9f62c9%252Fpa%252FAZ54716_c68f6ea9055864213429f4d255da565a.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_c68f6ea9055864213429f4d255da565a.jpg saved to cache
2026-03-30 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dac40b34-d293-515f-9949-2a8913ae9e26
2026-03-30 10:43:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_d1d51a12334d892fbf450f52ed05272c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_e0017c9a437e5bf2a53b2c4cc8077248.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_e0017c9a437e5bf2a53b2c4cc8077248.jpg not downloaded yet
2026-03-30 10:43:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3fb950>
2026-03-30 10:43:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac40b34-d293-515f-9949-2a8913ae9e26/dac40b34-d293-515f-9949-2a8913ae9e26_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167761e83aaea7543784c2fcb9f62c9%252Fpa%252FAZ54716_2c892332759c8921c386814ba13b81e0.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_2c892332759c8921c386814ba13b81e0.jpg saved to cache
2026-03-30 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dac40b34-d293-515f-9949-2a8913ae9e26
2026-03-30 10:43:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dac40b34-d293-515f-9949-2a8913ae9e26, skipping ID generation
2026-03-30 10:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dac40b34-d293-515f-9949-2a8913ae9e26 with scrape type 1
2026-03-30 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dac40b34-d293-515f-9949-2a8913ae9e26 sending to next pipeline
2026-03-30 10:43:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dac40b34-d293-515f-9949-2a8913ae9e26, identifier: AZ54716
2026-03-30 10:43:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5911a90>
2026-03-30 10:43:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_8ac6112527e9522e3d465ea4677e3403.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_8ac6112527e9522e3d465ea4677e3403.jpg saved to cache
2026-03-30 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 935d3819-5cef-5ec2-b416-5ccd79a8c89b
2026-03-30 10:43:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_53adff6e673d0a938d788690fe3c6203.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_fb76a51335353eadb203e1fb4e4f08f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dac40b34-d293-515f-9949-2a8913ae9e26 with identifier: AZ54716
2026-03-30 10:43:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dac40b34-d293-515f-9949-2a8913ae9e26 with identifier: AZ54716
2026-03-30 10:43:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dac40b34-d293-515f-9949-2a8913ae9e26 with identifier: AZ54716 to the API
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_2c892332759c8921c386814ba13b81e0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:32:57Z',
 'fuel_type': 'petrol',
 'id': 'dac40b34-d293-515f-9949-2a8913ae9e26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ54716',
 'listing': 'auction',
 'location': 'DE, Halberstadt',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 92829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac40b34-d293-515f-9949-2a8913ae9e26/dac40b34-d293-515f-9949-2a8913ae9e26_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_55b55b80507cfa963d8929a9b8ee3cd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac40b34-d293-515f-9949-2a8913ae9e26/dac40b34-d293-515f-9949-2a8913ae9e26_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_67b5c810a23e95b3ad752c43e18495c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac40b34-d293-515f-9949-2a8913ae9e26/dac40b34-d293-515f-9949-2a8913ae9e26_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_c7c3418d0e81b7728b3820d78f4afbec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac40b34-d293-515f-9949-2a8913ae9e26/dac40b34-d293-515f-9949-2a8913ae9e26_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_c68f6ea9055864213429f4d255da565a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac40b34-d293-515f-9949-2a8913ae9e26/dac40b34-d293-515f-9949-2a8913ae9e26_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_2c892332759c8921c386814ba13b81e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac40b34-d293-515f-9949-2a8913ae9e26/dac40b34-d293-515f-9949-2a8913ae9e26_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/67/d167761e83aaea7543784c2fcb9f62c9/pa/AZ54716_dcd1825c4c04b6872843196520ccebeb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Kia Picanto 1.1 Start',
 'transmission': 'manual',
 'trim': 'Start',
 'year': 2009}
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ54716%27 HTTP/1.1" 200 None
2026-03-30 10:43:11 [auto1.de] INFO: Saving data for AZ54716: {'created_time': 1774867391.349844, 'last_price_update_time': 1774867391.349855, 'auction_closing_time': 1774971177.0}
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ54716') HTTP/1.1" 204 0
2026-03-30 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZS77255/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41da8d0>
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_7a9c17ea3c69d9649afe2ab53eaa1ddc.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_7a9c17ea3c69d9649afe2ab53eaa1ddc.jpg saved to cache
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 935d3819-5cef-5ec2-b416-5ccd79a8c89b
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424c490>
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_d1d51a12334d892fbf450f52ed05272c.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_d1d51a12334d892fbf450f52ed05272c.jpg saved to cache
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 935d3819-5cef-5ec2-b416-5ccd79a8c89b
2026-03-30 10:43:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PE90731/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c03610>
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_53adff6e673d0a938d788690fe3c6203.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_53adff6e673d0a938d788690fe3c6203.jpg saved to cache
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 935d3819-5cef-5ec2-b416-5ccd79a8c89b
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee42ab10>
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_fb76a51335353eadb203e1fb4e4f08f8.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_fb76a51335353eadb203e1fb4e4f08f8.jpg saved to cache
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 935d3819-5cef-5ec2-b416-5ccd79a8c89b
2026-03-30 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_8d5c84498041c2dec94a759c5eee423c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_d10f4188091b974c8666576840f96e3e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_2e72fb61229364d708c3e69a94795ba7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_5f5869d408d0f2639b4142968ce8d72f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_2a942222019bdd4f17d1fc0bb7207d59.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_e0017c9a437e5bf2a53b2c4cc8077248.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_93d8e397d9ec2082ad1633dc92524794.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_851c9e05bde8a40a73adb0d0a7d3a83d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_b83a33492f9f9db5587ac00d5dddb376.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414ca90>
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_8d5c84498041c2dec94a759c5eee423c.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_8d5c84498041c2dec94a759c5eee423c.jpg saved to cache
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 935d3819-5cef-5ec2-b416-5ccd79a8c89b
2026-03-30 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_d9deeb0b77b3303fe137a9afc5958a29.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43965d0>
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_d10f4188091b974c8666576840f96e3e.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_d10f4188091b974c8666576840f96e3e.jpg saved to cache
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 935d3819-5cef-5ec2-b416-5ccd79a8c89b
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42b6e90>
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_2e72fb61229364d708c3e69a94795ba7.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_2e72fb61229364d708c3e69a94795ba7.jpg saved to cache
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 935d3819-5cef-5ec2-b416-5ccd79a8c89b
2026-03-30 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_3931d4caff0acd1b7fbdd1d1f6995f25.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_25702c091119aabf33cc7abf74cd17eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414db50>
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_5f5869d408d0f2639b4142968ce8d72f.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_5f5869d408d0f2639b4142968ce8d72f.jpg saved to cache
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad4c2b68-df03-52d2-81cf-494de2bc807d
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef77410>
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_2a942222019bdd4f17d1fc0bb7207d59.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_2a942222019bdd4f17d1fc0bb7207d59.jpg saved to cache
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 935d3819-5cef-5ec2-b416-5ccd79a8c89b
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3ef90>
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fcf%252F43cf6d9ef326108909087ba96631398b%252Fpa%252FFS39177_e0017c9a437e5bf2a53b2c4cc8077248.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_e0017c9a437e5bf2a53b2c4cc8077248.jpg saved to cache
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 935d3819-5cef-5ec2-b416-5ccd79a8c89b
2026-03-30 10:43:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 935d3819-5cef-5ec2-b416-5ccd79a8c89b, skipping ID generation
2026-03-30 10:43:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 935d3819-5cef-5ec2-b416-5ccd79a8c89b with scrape type 1
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 935d3819-5cef-5ec2-b416-5ccd79a8c89b sending to next pipeline
2026-03-30 10:43:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 935d3819-5cef-5ec2-b416-5ccd79a8c89b, identifier: FS39177
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef1b710>
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_93d8e397d9ec2082ad1633dc92524794.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_93d8e397d9ec2082ad1633dc92524794.jpg saved to cache
2026-03-30 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad4c2b68-df03-52d2-81cf-494de2bc807d
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4139410>
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_851c9e05bde8a40a73adb0d0a7d3a83d.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_851c9e05bde8a40a73adb0d0a7d3a83d.jpg saved to cache
2026-03-30 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad4c2b68-df03-52d2-81cf-494de2bc807d
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee414e10>
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_b83a33492f9f9db5587ac00d5dddb376.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_b83a33492f9f9db5587ac00d5dddb376.jpg saved to cache
2026-03-30 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad4c2b68-df03-52d2-81cf-494de2bc807d
2026-03-30 10:43:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 935d3819-5cef-5ec2-b416-5ccd79a8c89b with identifier: FS39177
2026-03-30 10:43:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 935d3819-5cef-5ec2-b416-5ccd79a8c89b with identifier: FS39177
2026-03-30 10:43:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 935d3819-5cef-5ec2-b416-5ccd79a8c89b with identifier: FS39177 to the API
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_e0017c9a437e5bf2a53b2c4cc8077248.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:46:47Z',
 'fuel_type': 'petrol',
 'id': '935d3819-5cef-5ec2-b416-5ccd79a8c89b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS39177',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 75089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_8ac6112527e9522e3d465ea4677e3403.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_d1d51a12334d892fbf450f52ed05272c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_53adff6e673d0a938d788690fe3c6203.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_7a9c17ea3c69d9649afe2ab53eaa1ddc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_2a942222019bdd4f17d1fc0bb7207d59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_fb76a51335353eadb203e1fb4e4f08f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_d10f4188091b974c8666576840f96e3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_2e72fb61229364d708c3e69a94795ba7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_8d5c84498041c2dec94a759c5eee423c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935d3819-5cef-5ec2-b416-5ccd79a8c89b/935d3819-5cef-5ec2-b416-5ccd79a8c89b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/cf/43cf6d9ef326108909087ba96631398b/pa/FS39177_e0017c9a437e5bf2a53b2c4cc8077248.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2015}
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS39177%27 HTTP/1.1" 200 None
2026-03-30 10:43:12 [auto1.de] INFO: Saving data for FS39177: {'created_time': 1774867392.626163, 'last_price_update_time': 1774867392.626173, 'auction_closing_time': 1774972007.0}
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS39177') HTTP/1.1" 204 0
2026-03-30 10:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_12d4af920c90f947fcdb468df244cbd1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_34225078ddba1a6267c72931938fbe4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF05985> (referer: https://www.auto1.com/v1/car-details-view/TF05985/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee443090>
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F11%252F7011559d36dea279a9e97e99091fde68%252Fpa%252FDL10324_d9deeb0b77b3303fe137a9afc5958a29.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_d9deeb0b77b3303fe137a9afc5958a29.jpg saved to cache
2026-03-30 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad4c2b68-df03-52d2-81cf-494de2bc807d
2026-03-30 10:43:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad4c2b68-df03-52d2-81cf-494de2bc807d, skipping ID generation
2026-03-30 10:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad4c2b68-df03-52d2-81cf-494de2bc807d with scrape type 1
2026-03-30 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad4c2b68-df03-52d2-81cf-494de2bc807d sending to next pipeline
2026-03-30 10:43:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad4c2b68-df03-52d2-81cf-494de2bc807d, identifier: DL10324
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5bfe810>
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_3931d4caff0acd1b7fbdd1d1f6995f25.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_3931d4caff0acd1b7fbdd1d1f6995f25.jpg saved to cache
2026-03-30 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e1f4857-ed6a-54ae-bbba-e506bce656c0
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee41b9d0>
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_25702c091119aabf33cc7abf74cd17eb.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_25702c091119aabf33cc7abf74cd17eb.jpg saved to cache
2026-03-30 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e1f4857-ed6a-54ae-bbba-e506bce656c0
2026-03-30 10:43:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad4c2b68-df03-52d2-81cf-494de2bc807d with identifier: DL10324
2026-03-30 10:43:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad4c2b68-df03-52d2-81cf-494de2bc807d with identifier: DL10324
2026-03-30 10:43:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad4c2b68-df03-52d2-81cf-494de2bc807d with identifier: DL10324 to the API
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_d9deeb0b77b3303fe137a9afc5958a29.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:04:02Z',
 'fuel_type': 'diesel',
 'id': 'ad4c2b68-df03-52d2-81cf-494de2bc807d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL10324',
 'listing': 'auction',
 'location': 'DE, Delmenhorst',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 132903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_d9deeb0b77b3303fe137a9afc5958a29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_888b21b24a7d4905d40d04c81e4305c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_b83a33492f9f9db5587ac00d5dddb376.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_851c9e05bde8a40a73adb0d0a7d3a83d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_93d8e397d9ec2082ad1633dc92524794.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_ff515cd59bce7f0a0fda07f9329bc42a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_5f5869d408d0f2639b4142968ce8d72f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_ac8ed107abc993e78a92ef2fd7554bd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_91eecf20db41e01594f51e2f17b1d896.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4c2b68-df03-52d2-81cf-494de2bc807d/ad4c2b68-df03-52d2-81cf-494de2bc807d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/11/7011559d36dea279a9e97e99091fde68/pa/DL10324_4e3223610433f8fb6ae52b45e33cd865.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi L2H1 2,9t Komfort',
 'transmission': 'manual',
 'trim': 'L2H1 2,9t Komfort',
 'year': 2017}
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL10324%27 HTTP/1.1" 200 None
2026-03-30 10:43:13 [auto1.de] INFO: Saving data for DL10324: {'created_time': 1774867393.370714, 'last_price_update_time': 1774867393.370723, 'auction_closing_time': 1774969442.0}
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL10324') HTTP/1.1" 204 0
2026-03-30 10:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_05119d67640da1f96fdafb54be324e8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefeaa10>
2026-03-30 10:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_12d4af920c90f947fcdb468df244cbd1.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_12d4af920c90f947fcdb468df244cbd1.jpg saved to cache
2026-03-30 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e1f4857-ed6a-54ae-bbba-e506bce656c0
2026-03-30 10:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee478350>
2026-03-30 10:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_34225078ddba1a6267c72931938fbe4c.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_34225078ddba1a6267c72931938fbe4c.jpg saved to cache
2026-03-30 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e1f4857-ed6a-54ae-bbba-e506bce656c0
2026-03-30 10:43:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6789bc4d-e56d-5d3f-9660-6c5f53c088f0 with identifier: TF05985
2026-03-30 10:43:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6789bc4d-e56d-5d3f-9660-6c5f53c088f0 with scrape type 1
2026-03-30 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6789bc4d-e56d-5d3f-9660-6c5f53c088f0
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fe1%252Ffde1d2914101b94d70eb6d0e54a6d7c0%252Fpa%252FTF05985_dc75fe7e286bf530c738449928ab9ac5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/e1/fde1d2914101b94d70eb6d0e54a6d7c0/pa/TF05985_dc75fe7e286bf530c738449928ab9ac5.jpg already downloaded
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fe1%252Ffde1d2914101b94d70eb6d0e54a6d7c0%252Fpa%252FTF05985_5e7389a02091a6d7b1a3429e9e4b5d8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/e1/fde1d2914101b94d70eb6d0e54a6d7c0/pa/TF05985_5e7389a02091a6d7b1a3429e9e4b5d8a.jpg already downloaded
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fe1%252Ffde1d2914101b94d70eb6d0e54a6d7c0%252Fpa%252FTF05985_d230f7796efef127c0528297c7e3aa5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/e1/fde1d2914101b94d70eb6d0e54a6d7c0/pa/TF05985_d230f7796efef127c0528297c7e3aa5a.jpg already downloaded
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fe1%252Ffde1d2914101b94d70eb6d0e54a6d7c0%252Fpa%252FTF05985_5c785b1111ea1c129d5dab99d9ccfd6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/e1/fde1d2914101b94d70eb6d0e54a6d7c0/pa/TF05985_5c785b1111ea1c129d5dab99d9ccfd6c.jpg already downloaded
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fe1%252Ffde1d2914101b94d70eb6d0e54a6d7c0%252Fpa%252FTF05985_ea9da464347256acef7bf18936bc2113.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/e1/fde1d2914101b94d70eb6d0e54a6d7c0/pa/TF05985_ea9da464347256acef7bf18936bc2113.jpg already downloaded
2026-03-30 10:43:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6789bc4d-e56d-5d3f-9660-6c5f53c088f0, identifier: TF05985
2026-03-30 10:43:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6789bc4d-e56d-5d3f-9660-6c5f53c088f0 with identifier: TF05985
2026-03-30 10:43:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6789bc4d-e56d-5d3f-9660-6c5f53c088f0 with identifier: TF05985
2026-03-30 10:43:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6789bc4d-e56d-5d3f-9660-6c5f53c088f0 with identifier: TF05985 to the API
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TF05985>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:03:03Z',
 'fuel_type': 'petrol',
 'id': '6789bc4d-e56d-5d3f-9660-6c5f53c088f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF05985',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 132400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgfd/e1/fde1d2914101b94d70eb6d0e54a6d7c0/pa/TF05985_dc75fe7e286bf530c738449928ab9ac5.jpg',
                'https://img-pa.auto1.com/imgfd/e1/fde1d2914101b94d70eb6d0e54a6d7c0/pa/TF05985_5e7389a02091a6d7b1a3429e9e4b5d8a.jpg',
                'https://img-pa.auto1.com/imgfd/e1/fde1d2914101b94d70eb6d0e54a6d7c0/pa/TF05985_d230f7796efef127c0528297c7e3aa5a.jpg',
                'https://img-pa.auto1.com/imgfd/e1/fde1d2914101b94d70eb6d0e54a6d7c0/pa/TF05985_5c785b1111ea1c129d5dab99d9ccfd6c.jpg',
                'https://img-pa.auto1.com/imgfd/e1/fde1d2914101b94d70eb6d0e54a6d7c0/pa/TF05985_ea9da464347256acef7bf18936bc2113.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6789bc4d-e56d-5d3f-9660-6c5f53c088f0/6789bc4d-e56d-5d3f-9660-6c5f53c088f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/e1/fde1d2914101b94d70eb6d0e54a6d7c0/pa/TF05985_dc75fe7e286bf530c738449928ab9ac5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6789bc4d-e56d-5d3f-9660-6c5f53c088f0/6789bc4d-e56d-5d3f-9660-6c5f53c088f0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/e1/fde1d2914101b94d70eb6d0e54a6d7c0/pa/TF05985_5e7389a02091a6d7b1a3429e9e4b5d8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6789bc4d-e56d-5d3f-9660-6c5f53c088f0/6789bc4d-e56d-5d3f-9660-6c5f53c088f0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/e1/fde1d2914101b94d70eb6d0e54a6d7c0/pa/TF05985_d230f7796efef127c0528297c7e3aa5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6789bc4d-e56d-5d3f-9660-6c5f53c088f0/6789bc4d-e56d-5d3f-9660-6c5f53c088f0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/e1/fde1d2914101b94d70eb6d0e54a6d7c0/pa/TF05985_5c785b1111ea1c129d5dab99d9ccfd6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6789bc4d-e56d-5d3f-9660-6c5f53c088f0/6789bc4d-e56d-5d3f-9660-6c5f53c088f0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/e1/fde1d2914101b94d70eb6d0e54a6d7c0/pa/TF05985_ea9da464347256acef7bf18936bc2113.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-08-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive pure',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive pure',
 'year': 2011}
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF05985%27 HTTP/1.1" 200 None
2026-03-30 10:43:14 [auto1.de] INFO: Saving data for TF05985: {'created_time': 1774867394.08152, 'last_price_update_time': 1774867394.08153, 'auction_closing_time': 1774969383.0}
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF05985') HTTP/1.1" 204 0
2026-03-30 10:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_ce75a42bca72a2f144e702292ca5dae2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_9861518fbd8fca000ff2b51d0998a9fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f593c4d0>
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_05119d67640da1f96fdafb54be324e8b.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_05119d67640da1f96fdafb54be324e8b.jpg saved to cache
2026-03-30 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e1f4857-ed6a-54ae-bbba-e506bce656c0
2026-03-30 10:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_90927ec8e08f2605d039aa4b7dd74150.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeddd90>
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_ce75a42bca72a2f144e702292ca5dae2.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_ce75a42bca72a2f144e702292ca5dae2.jpg saved to cache
2026-03-30 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e1f4857-ed6a-54ae-bbba-e506bce656c0
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee442bd0>
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_9861518fbd8fca000ff2b51d0998a9fb.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_9861518fbd8fca000ff2b51d0998a9fb.jpg saved to cache
2026-03-30 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e1f4857-ed6a-54ae-bbba-e506bce656c0
2026-03-30 10:43:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4794d0>
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F64%252Fba64ed0a756d6729853cbe915990a496%252Fpa%252FMY39780_90927ec8e08f2605d039aa4b7dd74150.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_90927ec8e08f2605d039aa4b7dd74150.jpg saved to cache
2026-03-30 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e1f4857-ed6a-54ae-bbba-e506bce656c0
2026-03-30 10:43:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e1f4857-ed6a-54ae-bbba-e506bce656c0, skipping ID generation
2026-03-30 10:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e1f4857-ed6a-54ae-bbba-e506bce656c0 with scrape type 1
2026-03-30 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e1f4857-ed6a-54ae-bbba-e506bce656c0 sending to next pipeline
2026-03-30 10:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e1f4857-ed6a-54ae-bbba-e506bce656c0, identifier: MY39780
2026-03-30 10:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e1f4857-ed6a-54ae-bbba-e506bce656c0 with identifier: MY39780
2026-03-30 10:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e1f4857-ed6a-54ae-bbba-e506bce656c0 with identifier: MY39780
2026-03-30 10:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e1f4857-ed6a-54ae-bbba-e506bce656c0 with identifier: MY39780 to the API
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_90927ec8e08f2605d039aa4b7dd74150.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:47:25Z',
 'fuel_type': 'petrol',
 'id': '9e1f4857-ed6a-54ae-bbba-e506bce656c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY39780',
 'listing': 'auction',
 'location': 'DE, Greifswald',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 52077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3187077,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_90927ec8e08f2605d039aa4b7dd74150.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_ce75a42bca72a2f144e702292ca5dae2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_9861518fbd8fca000ff2b51d0998a9fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_05119d67640da1f96fdafb54be324e8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_34225078ddba1a6267c72931938fbe4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_12d4af920c90f947fcdb468df244cbd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_25702c091119aabf33cc7abf74cd17eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_3931d4caff0acd1b7fbdd1d1f6995f25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_e97ddca0acd2c485fbfdea51e0cf8f9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1f4857-ed6a-54ae-bbba-e506bce656c0/9e1f4857-ed6a-54ae-bbba-e506bce656c0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/64/ba64ed0a756d6729853cbe915990a496/pa/MY39780_730d1c60c2f8d989c6c4f5c0497fc093.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.5 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2018}
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY39780%27 HTTP/1.1" 200 None
2026-03-30 10:43:14 [auto1.de] INFO: Saving data for MY39780: {'created_time': 1774867394.944803, 'last_price_update_time': 1774867394.944814, 'auction_closing_time': 1774972045.0}
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY39780') HTTP/1.1" 204 0
2026-03-30 10:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_bb1ebb5921fd6bd9f7916a562ba18270.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41993d0>
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F25%252F68253f14f1d76c0061551a4909186403%252Fpa%252FDA23365_bb1ebb5921fd6bd9f7916a562ba18270.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_bb1ebb5921fd6bd9f7916a562ba18270.jpg saved to cache
2026-03-30 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40a28f27-542a-5231-9511-1da844e4fb9b
2026-03-30 10:43:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40a28f27-542a-5231-9511-1da844e4fb9b, skipping ID generation
2026-03-30 10:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a28f27-542a-5231-9511-1da844e4fb9b with scrape type 1
2026-03-30 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40a28f27-542a-5231-9511-1da844e4fb9b sending to next pipeline
2026-03-30 10:43:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40a28f27-542a-5231-9511-1da844e4fb9b, identifier: DA23365
2026-03-30 10:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40a28f27-542a-5231-9511-1da844e4fb9b with identifier: DA23365
2026-03-30 10:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40a28f27-542a-5231-9511-1da844e4fb9b with identifier: DA23365
2026-03-30 10:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40a28f27-542a-5231-9511-1da844e4fb9b with identifier: DA23365 to the API
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_bb1ebb5921fd6bd9f7916a562ba18270.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 202,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:40:03Z',
 'fuel_type': 'diesel',
 'id': '40a28f27-542a-5231-9511-1da844e4fb9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA23365',
 'listing': 'auction',
 'location': 'DE, Neubrandenburg',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 368597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2690158,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_bb1ebb5921fd6bd9f7916a562ba18270.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2595552,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_46b744530eded5183897887c962d4216.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2483681,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_d4034727ec0c278bf98970318e7bb81a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2373052,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_73bea01ba0f95f31ca97f1a6797783d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2553780,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_1f1235b4c0f011a5dd430dd0d6a6188e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2090940,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_0c24529ef1037e515fa7664494892361.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1933968,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_1893dab4162b07e9dcf4f453d8db8990.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2123499,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_c2461fbbd103c7dc9de8fd11cfcee060.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2579582,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_6ba58670e670dd0868f047f2169bdefc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a28f27-542a-5231-9511-1da844e4fb9b/40a28f27-542a-5231-9511-1da844e4fb9b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2827330,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/25/68253f14f1d76c0061551a4909186403/pa/DA23365_1017b52df601dc16a4833e271f666617.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-10',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Opel Vivaro 2.0 CDTI Kombi L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Kombi L1H1 2,7t',
 'year': 2013}
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA23365%27 HTTP/1.1" 200 None
2026-03-30 10:43:15 [auto1.de] INFO: Saving data for DA23365: {'created_time': 1774867395.665799, 'last_price_update_time': 1774867395.66581, 'auction_closing_time': 1774971603.0}
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA23365') HTTP/1.1" 204 0
2026-03-30 10:43:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RZ67892/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WH06926/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY96025> (referer: https://www.auto1.com/v1/car-details-view/NY96025/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f9dbc53-9c82-59e6-ade1-01e17f1e1341 with identifier: NY96025
2026-03-30 10:43:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f9dbc53-9c82-59e6-ade1-01e17f1e1341 with scrape type 1
2026-03-30 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f9dbc53-9c82-59e6-ade1-01e17f1e1341
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fc1%252F2fc139b937efe02998c67634e3309e90%252Fpa%252FNY96025_25352004bdd3601ad85dbe8f54f3cab2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_25352004bdd3601ad85dbe8f54f3cab2.jpg already downloaded
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fc1%252F2fc139b937efe02998c67634e3309e90%252Fpa%252FNY96025_3fd3bad37da9caebceabd06040d196dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_3fd3bad37da9caebceabd06040d196dc.jpg already downloaded
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fc1%252F2fc139b937efe02998c67634e3309e90%252Fpa%252FNY96025_05d23764832f58470e95855e9d296920.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_05d23764832f58470e95855e9d296920.jpg already downloaded
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fc1%252F2fc139b937efe02998c67634e3309e90%252Fpa%252FNY96025_c329dc10527ff5dc508cf59383d6d240.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_c329dc10527ff5dc508cf59383d6d240.jpg already downloaded
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fc1%252F2fc139b937efe02998c67634e3309e90%252Fpa%252FNY96025_f36cbd2ef2444fbf0a87fb9e0c99cfa0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_f36cbd2ef2444fbf0a87fb9e0c99cfa0.jpg already downloaded
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fc1%252F2fc139b937efe02998c67634e3309e90%252Fpa%252FNY96025_2eb2748f8f59492d58728dd5493c6d88.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_2eb2748f8f59492d58728dd5493c6d88.jpg already downloaded
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fc1%252F2fc139b937efe02998c67634e3309e90%252Fpa%252FNY96025_3f226fb2c472f7d9bd5d85d23e82f486.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_3f226fb2c472f7d9bd5d85d23e82f486.jpg already downloaded
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fc1%252F2fc139b937efe02998c67634e3309e90%252Fpa%252FNY96025_024d5262f0823f591577c997194cbe49.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_024d5262f0823f591577c997194cbe49.jpg already downloaded
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fc1%252F2fc139b937efe02998c67634e3309e90%252Fpa%252FNY96025_df4129764c3621dd19870a32545b6be0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_df4129764c3621dd19870a32545b6be0.jpg already downloaded
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fc1%252F2fc139b937efe02998c67634e3309e90%252Fpa%252FNY96025_cff8ae8726bf7bbaed69e163d187347a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_cff8ae8726bf7bbaed69e163d187347a.jpg already downloaded
2026-03-30 10:43:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f9dbc53-9c82-59e6-ade1-01e17f1e1341, identifier: NY96025
2026-03-30 10:43:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f9dbc53-9c82-59e6-ade1-01e17f1e1341 with identifier: NY96025
2026-03-30 10:43:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f9dbc53-9c82-59e6-ade1-01e17f1e1341 with identifier: NY96025
2026-03-30 10:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f9dbc53-9c82-59e6-ade1-01e17f1e1341 with identifier: NY96025 to the API
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NY96025>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:31:48Z',
 'fuel_type': 'petrol',
 'id': '3f9dbc53-9c82-59e6-ade1-01e17f1e1341',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY96025',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 54187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_25352004bdd3601ad85dbe8f54f3cab2.jpg',
                'https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_3fd3bad37da9caebceabd06040d196dc.jpg',
                'https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_05d23764832f58470e95855e9d296920.jpg',
                'https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_c329dc10527ff5dc508cf59383d6d240.jpg',
                'https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_f36cbd2ef2444fbf0a87fb9e0c99cfa0.jpg',
                'https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_2eb2748f8f59492d58728dd5493c6d88.jpg',
                'https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_3f226fb2c472f7d9bd5d85d23e82f486.jpg',
                'https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_024d5262f0823f591577c997194cbe49.jpg',
                'https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_df4129764c3621dd19870a32545b6be0.jpg',
                'https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_cff8ae8726bf7bbaed69e163d187347a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9dbc53-9c82-59e6-ade1-01e17f1e1341/3f9dbc53-9c82-59e6-ade1-01e17f1e1341_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2760302,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_25352004bdd3601ad85dbe8f54f3cab2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9dbc53-9c82-59e6-ade1-01e17f1e1341/3f9dbc53-9c82-59e6-ade1-01e17f1e1341_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2735730,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_3fd3bad37da9caebceabd06040d196dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9dbc53-9c82-59e6-ade1-01e17f1e1341/3f9dbc53-9c82-59e6-ade1-01e17f1e1341_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2832470,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_05d23764832f58470e95855e9d296920.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9dbc53-9c82-59e6-ade1-01e17f1e1341/3f9dbc53-9c82-59e6-ade1-01e17f1e1341_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2701783,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_c329dc10527ff5dc508cf59383d6d240.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9dbc53-9c82-59e6-ade1-01e17f1e1341/3f9dbc53-9c82-59e6-ade1-01e17f1e1341_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2606762,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_f36cbd2ef2444fbf0a87fb9e0c99cfa0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9dbc53-9c82-59e6-ade1-01e17f1e1341/3f9dbc53-9c82-59e6-ade1-01e17f1e1341_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3033270,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_2eb2748f8f59492d58728dd5493c6d88.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9dbc53-9c82-59e6-ade1-01e17f1e1341/3f9dbc53-9c82-59e6-ade1-01e17f1e1341_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2722256,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_3f226fb2c472f7d9bd5d85d23e82f486.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9dbc53-9c82-59e6-ade1-01e17f1e1341/3f9dbc53-9c82-59e6-ade1-01e17f1e1341_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2707860,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_024d5262f0823f591577c997194cbe49.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9dbc53-9c82-59e6-ade1-01e17f1e1341/3f9dbc53-9c82-59e6-ade1-01e17f1e1341_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2716897,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_df4129764c3621dd19870a32545b6be0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9dbc53-9c82-59e6-ade1-01e17f1e1341/3f9dbc53-9c82-59e6-ade1-01e17f1e1341_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/c1/2fc139b937efe02998c67634e3309e90/pa/NY96025_cff8ae8726bf7bbaed69e163d187347a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.0 Turbo Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2018}
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY96025%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [auto1.de] INFO: Saving data for NY96025: {'created_time': 1774867397.641536, 'last_price_update_time': 1774867397.641546, 'auction_closing_time': 1774971108.0}
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY96025') HTTP/1.1" 204 0
2026-03-30 10:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL45474/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV49543> (referer: https://www.auto1.com/v1/car-details-view/YV49543/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e562e8b2-dc13-5420-ba23-fdc9ed85dc81 with identifier: YV49543
2026-03-30 10:43:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e562e8b2-dc13-5420-ba23-fdc9ed85dc81 with scrape type 1
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e562e8b2-dc13-5420-ba23-fdc9ed85dc81
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_b0c5fdebb43aace7cd73f094b1bc9bad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_b0c5fdebb43aace7cd73f094b1bc9bad.jpg not downloaded yet
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_41fef81dcf068e85d72059e64fc88e88.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_41fef81dcf068e85d72059e64fc88e88.jpg not downloaded yet
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_9fce2ad4b8a64e7483c5930cf94f29b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_9fce2ad4b8a64e7483c5930cf94f29b3.jpg not downloaded yet
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_1e7bcb98b94fb7f6c0ee6a4fabcb7413.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_1e7bcb98b94fb7f6c0ee6a4fabcb7413.jpg not downloaded yet
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_ffa0bdebf68107ce6e65be97c829d2a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_ffa0bdebf68107ce6e65be97c829d2a6.jpg not downloaded yet
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_81eabe6c8256c1096cf59b70fb7077d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_81eabe6c8256c1096cf59b70fb7077d0.jpg not downloaded yet
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_da82cab45985dad4dd33762bad910042.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_da82cab45985dad4dd33762bad910042.jpg not downloaded yet
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_dc725408d1d516c55109d4a1551cf4f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_dc725408d1d516c55109d4a1551cf4f7.jpg not downloaded yet
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_b28879dac0c7dcf75c2c88130b608ded.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_b28879dac0c7dcf75c2c88130b608ded.jpg not downloaded yet
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_27ed267431d02bff29566d5a537e04c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_27ed267431d02bff29566d5a537e04c8.jpg not downloaded yet
2026-03-30 10:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PE90731> (referer: https://www.auto1.com/v1/car-details-view/PE90731/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_27ed267431d02bff29566d5a537e04c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 094156a2-38cf-5c59-8506-71428ec3c517 with identifier: PE90731
2026-03-30 10:43:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 094156a2-38cf-5c59-8506-71428ec3c517 with scrape type 1
2026-03-30 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 094156a2-38cf-5c59-8506-71428ec3c517
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_ad8731769817c8d66a875d2114159522.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_ad8731769817c8d66a875d2114159522.jpg not downloaded yet
2026-03-30 10:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_b28879dac0c7dcf75c2c88130b608ded.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_26f3d6ae3d10b66e7d30f0f5345fee4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_26f3d6ae3d10b66e7d30f0f5345fee4d.jpg not downloaded yet
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_b054fabe23f2dbb7c18e99db3b2aaba3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_b054fabe23f2dbb7c18e99db3b2aaba3.jpg not downloaded yet
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_fc2c329b37710e8b3dae9c4a561459c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_fc2c329b37710e8b3dae9c4a561459c2.jpg not downloaded yet
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_c548dc3e7f3f9ec373030066ed5494a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_c548dc3e7f3f9ec373030066ed5494a8.jpg not downloaded yet
2026-03-30 10:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee478b90>
2026-03-30 10:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_27ed267431d02bff29566d5a537e04c8.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_27ed267431d02bff29566d5a537e04c8.jpg saved to cache
2026-03-30 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e562e8b2-dc13-5420-ba23-fdc9ed85dc81
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_dc691b897637d6f3d7f833332880832e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_dc691b897637d6f3d7f833332880832e.jpg not downloaded yet
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_4ec6da297ddc7814286016ac331cf8d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_4ec6da297ddc7814286016ac331cf8d0.jpg not downloaded yet
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_6c0107d0868fb3746e48c7a63a123cf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_6c0107d0868fb3746e48c7a63a123cf2.jpg not downloaded yet
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee928d0>
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_b28879dac0c7dcf75c2c88130b608ded.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_b28879dac0c7dcf75c2c88130b608ded.jpg saved to cache
2026-03-30 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e562e8b2-dc13-5420-ba23-fdc9ed85dc81
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_1bff70917aa87f181cbeb87c3c6bde26.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_1bff70917aa87f181cbeb87c3c6bde26.jpg not downloaded yet
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_eb5c9c9ca9992ac2a701957d60abc5cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_eb5c9c9ca9992ac2a701957d60abc5cb.jpg not downloaded yet
2026-03-30 10:43:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_ad8731769817c8d66a875d2114159522.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4143e90>
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_ad8731769817c8d66a875d2114159522.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_ad8731769817c8d66a875d2114159522.jpg saved to cache
2026-03-30 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 094156a2-38cf-5c59-8506-71428ec3c517
2026-03-30 10:43:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_eb5c9c9ca9992ac2a701957d60abc5cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee11290>
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_eb5c9c9ca9992ac2a701957d60abc5cb.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_eb5c9c9ca9992ac2a701957d60abc5cb.jpg saved to cache
2026-03-30 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 094156a2-38cf-5c59-8506-71428ec3c517
2026-03-30 10:43:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_1bff70917aa87f181cbeb87c3c6bde26.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41714d0>
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_1bff70917aa87f181cbeb87c3c6bde26.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_1bff70917aa87f181cbeb87c3c6bde26.jpg saved to cache
2026-03-30 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 094156a2-38cf-5c59-8506-71428ec3c517
2026-03-30 10:43:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_6c0107d0868fb3746e48c7a63a123cf2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e89d0>
2026-03-30 10:43:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_6c0107d0868fb3746e48c7a63a123cf2.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_6c0107d0868fb3746e48c7a63a123cf2.jpg saved to cache
2026-03-30 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 094156a2-38cf-5c59-8506-71428ec3c517
2026-03-30 10:43:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_4ec6da297ddc7814286016ac331cf8d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43023d0>
2026-03-30 10:43:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_4ec6da297ddc7814286016ac331cf8d0.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_4ec6da297ddc7814286016ac331cf8d0.jpg saved to cache
2026-03-30 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 094156a2-38cf-5c59-8506-71428ec3c517
2026-03-30 10:43:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_dc691b897637d6f3d7f833332880832e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3ebd50>
2026-03-30 10:43:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_dc691b897637d6f3d7f833332880832e.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_dc691b897637d6f3d7f833332880832e.jpg saved to cache
2026-03-30 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 094156a2-38cf-5c59-8506-71428ec3c517
2026-03-30 10:43:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_c548dc3e7f3f9ec373030066ed5494a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45ea50>
2026-03-30 10:43:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_c548dc3e7f3f9ec373030066ed5494a8.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_c548dc3e7f3f9ec373030066ed5494a8.jpg saved to cache
2026-03-30 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 094156a2-38cf-5c59-8506-71428ec3c517
2026-03-30 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_fc2c329b37710e8b3dae9c4a561459c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4171b50>
2026-03-30 10:43:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_fc2c329b37710e8b3dae9c4a561459c2.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_fc2c329b37710e8b3dae9c4a561459c2.jpg saved to cache
2026-03-30 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 094156a2-38cf-5c59-8506-71428ec3c517
2026-03-30 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_b054fabe23f2dbb7c18e99db3b2aaba3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef519d0>
2026-03-30 10:43:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_b054fabe23f2dbb7c18e99db3b2aaba3.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_b054fabe23f2dbb7c18e99db3b2aaba3.jpg saved to cache
2026-03-30 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 094156a2-38cf-5c59-8506-71428ec3c517
2026-03-30 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_26f3d6ae3d10b66e7d30f0f5345fee4d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_dc725408d1d516c55109d4a1551cf4f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e8d90>
2026-03-30 10:43:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fd5%252F80d55b2337d342f898cd4687272456c1%252Fpa%252FPE90731_26f3d6ae3d10b66e7d30f0f5345fee4d.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_26f3d6ae3d10b66e7d30f0f5345fee4d.jpg saved to cache
2026-03-30 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 094156a2-38cf-5c59-8506-71428ec3c517
2026-03-30 10:43:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 094156a2-38cf-5c59-8506-71428ec3c517, skipping ID generation
2026-03-30 10:43:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 094156a2-38cf-5c59-8506-71428ec3c517 with scrape type 1
2026-03-30 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 094156a2-38cf-5c59-8506-71428ec3c517 sending to next pipeline
2026-03-30 10:43:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 094156a2-38cf-5c59-8506-71428ec3c517, identifier: PE90731
2026-03-30 10:43:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 094156a2-38cf-5c59-8506-71428ec3c517 with identifier: PE90731
2026-03-30 10:43:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 094156a2-38cf-5c59-8506-71428ec3c517 with identifier: PE90731
2026-03-30 10:43:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 094156a2-38cf-5c59-8506-71428ec3c517 with identifier: PE90731 to the API
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_26f3d6ae3d10b66e7d30f0f5345fee4d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:44:26Z',
 'fuel_type': 'petrol',
 'id': '094156a2-38cf-5c59-8506-71428ec3c517',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE90731',
 'listing': 'auction',
 'location': 'DE, Gießen',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 128747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2764481,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_ad8731769817c8d66a875d2114159522.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2779533,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_26f3d6ae3d10b66e7d30f0f5345fee4d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2744007,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_b054fabe23f2dbb7c18e99db3b2aaba3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2486763,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_fc2c329b37710e8b3dae9c4a561459c2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2835787,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_c548dc3e7f3f9ec373030066ed5494a8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2686545,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_dc691b897637d6f3d7f833332880832e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2540534,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_4ec6da297ddc7814286016ac331cf8d0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2803726,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_6c0107d0868fb3746e48c7a63a123cf2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2829056,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_1bff70917aa87f181cbeb87c3c6bde26.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_094156a2-38cf-5c59-8506-71428ec3c517/094156a2-38cf-5c59-8506-71428ec3c517_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3001441,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img80/d5/80d55b2337d342f898cd4687272456c1/pa/PE90731_eb5c9c9ca9992ac2a701957d60abc5cb.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2012}
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE90731%27 HTTP/1.1" 200 None
2026-03-30 10:43:22 [auto1.de] INFO: Saving data for PE90731: {'created_time': 1774867402.585683, 'last_price_update_time': 1774867402.585693, 'auction_closing_time': 1774971866.0}
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE90731') HTTP/1.1" 204 0
2026-03-30 10:43:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_da82cab45985dad4dd33762bad910042.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef53c90>
2026-03-30 10:43:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_dc725408d1d516c55109d4a1551cf4f7.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_dc725408d1d516c55109d4a1551cf4f7.jpg saved to cache
2026-03-30 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e562e8b2-dc13-5420-ba23-fdc9ed85dc81
2026-03-30 10:43:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef46750>
2026-03-30 10:43:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_da82cab45985dad4dd33762bad910042.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_da82cab45985dad4dd33762bad910042.jpg saved to cache
2026-03-30 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e562e8b2-dc13-5420-ba23-fdc9ed85dc81
2026-03-30 10:43:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_81eabe6c8256c1096cf59b70fb7077d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_ffa0bdebf68107ce6e65be97c829d2a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45cd90>
2026-03-30 10:43:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_81eabe6c8256c1096cf59b70fb7077d0.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_81eabe6c8256c1096cf59b70fb7077d0.jpg saved to cache
2026-03-30 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e562e8b2-dc13-5420-ba23-fdc9ed85dc81
2026-03-30 10:43:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_1e7bcb98b94fb7f6c0ee6a4fabcb7413.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee440610>
2026-03-30 10:43:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_ffa0bdebf68107ce6e65be97c829d2a6.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_ffa0bdebf68107ce6e65be97c829d2a6.jpg saved to cache
2026-03-30 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e562e8b2-dc13-5420-ba23-fdc9ed85dc81
2026-03-30 10:43:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_9fce2ad4b8a64e7483c5930cf94f29b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef47090>
2026-03-30 10:43:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_1e7bcb98b94fb7f6c0ee6a4fabcb7413.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_1e7bcb98b94fb7f6c0ee6a4fabcb7413.jpg saved to cache
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e562e8b2-dc13-5420-ba23-fdc9ed85dc81
2026-03-30 10:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_41fef81dcf068e85d72059e64fc88e88.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4170c50>
2026-03-30 10:43:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_9fce2ad4b8a64e7483c5930cf94f29b3.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_9fce2ad4b8a64e7483c5930cf94f29b3.jpg saved to cache
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e562e8b2-dc13-5420-ba23-fdc9ed85dc81
2026-03-30 10:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_b0c5fdebb43aace7cd73f094b1bc9bad.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3eb390>
2026-03-30 10:43:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_41fef81dcf068e85d72059e64fc88e88.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_41fef81dcf068e85d72059e64fc88e88.jpg saved to cache
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e562e8b2-dc13-5420-ba23-fdc9ed85dc81
2026-03-30 10:43:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef75d10>
2026-03-30 10:43:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46ae473dedccc8ac44fea4e5843e72%252Fpa%252FYV49543_b0c5fdebb43aace7cd73f094b1bc9bad.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_b0c5fdebb43aace7cd73f094b1bc9bad.jpg saved to cache
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e562e8b2-dc13-5420-ba23-fdc9ed85dc81
2026-03-30 10:43:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e562e8b2-dc13-5420-ba23-fdc9ed85dc81, skipping ID generation
2026-03-30 10:43:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e562e8b2-dc13-5420-ba23-fdc9ed85dc81 with scrape type 1
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e562e8b2-dc13-5420-ba23-fdc9ed85dc81 sending to next pipeline
2026-03-30 10:43:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e562e8b2-dc13-5420-ba23-fdc9ed85dc81, identifier: YV49543
2026-03-30 10:43:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e562e8b2-dc13-5420-ba23-fdc9ed85dc81 with identifier: YV49543
2026-03-30 10:43:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e562e8b2-dc13-5420-ba23-fdc9ed85dc81 with identifier: YV49543
2026-03-30 10:43:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e562e8b2-dc13-5420-ba23-fdc9ed85dc81 with identifier: YV49543 to the API
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_b0c5fdebb43aace7cd73f094b1bc9bad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:58:40Z',
 'fuel_type': 'diesel',
 'id': 'e562e8b2-dc13-5420-ba23-fdc9ed85dc81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV49543',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 109953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_b0c5fdebb43aace7cd73f094b1bc9bad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_41fef81dcf068e85d72059e64fc88e88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_9fce2ad4b8a64e7483c5930cf94f29b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_1e7bcb98b94fb7f6c0ee6a4fabcb7413.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_ffa0bdebf68107ce6e65be97c829d2a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_81eabe6c8256c1096cf59b70fb7077d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_da82cab45985dad4dd33762bad910042.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_dc725408d1d516c55109d4a1551cf4f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_b28879dac0c7dcf75c2c88130b608ded.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562e8b2-dc13-5420-ba23-fdc9ed85dc81/e562e8b2-dc13-5420-ba23-fdc9ed85dc81_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46ae473dedccc8ac44fea4e5843e72/pa/YV49543_27ed267431d02bff29566d5a537e04c8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Comfort 4x4',
 'transmission': 'manual',
 'trim': 'Comfort 4x4',
 'year': 2019}
2026-03-30 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV49543%27 HTTP/1.1" 200 None
2026-03-30 10:43:24 [auto1.de] INFO: Saving data for YV49543: {'created_time': 1774867404.044341, 'last_price_update_time': 1774867404.044352, 'auction_closing_time': 1774972720.0}
2026-03-30 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV49543') HTTP/1.1" 204 0
2026-03-30 10:43:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BF55628> (referer: https://www.auto1.com/v1/car-details-view/BF55628/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca6b442d-0f88-5860-a88e-f9b85af1af04 with identifier: BF55628
2026-03-30 10:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca6b442d-0f88-5860-a88e-f9b85af1af04 with scrape type 1
2026-03-30 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ca6b442d-0f88-5860-a88e-f9b85af1af04
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_6e7cc653865c8b08889e283b9451d5e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_6e7cc653865c8b08889e283b9451d5e5.jpg not downloaded yet
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_4aea568e84105255c6ef03758d0173d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_4aea568e84105255c6ef03758d0173d1.jpg not downloaded yet
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_beedbe4818ef0d40460433b9bdb78823.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_beedbe4818ef0d40460433b9bdb78823.jpg not downloaded yet
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_47caa75273ab86162b2dc6ee243257d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_47caa75273ab86162b2dc6ee243257d5.jpg not downloaded yet
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_6e433ed4db3dc2a54be62093dcc287a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_6e433ed4db3dc2a54be62093dcc287a3.jpg not downloaded yet
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_dd0a67efdc11e0054850af862bb9cb11.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_dd0a67efdc11e0054850af862bb9cb11.jpg not downloaded yet
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_745c2b0bc373305a42603e180cd546c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_745c2b0bc373305a42603e180cd546c0.jpg not downloaded yet
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_02858d3b44bfea0517d86017d5f0599a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_02858d3b44bfea0517d86017d5f0599a.jpg not downloaded yet
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_a8aa55e6fa23ed5d425564335eed5777.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_a8aa55e6fa23ed5d425564335eed5777.jpg not downloaded yet
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_3bb36f5a89554adb61d1c03b7714b023.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_3bb36f5a89554adb61d1c03b7714b023.jpg not downloaded yet
2026-03-30 10:43:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XH91941> (referer: https://www.auto1.com/v1/car-details-view/XH91941/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_3bb36f5a89554adb61d1c03b7714b023.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW22794> (referer: https://www.auto1.com/v1/car-details-view/FW22794/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7062e20d-652c-5fc1-a3c9-139bf512ba13 with identifier: XH91941
2026-03-30 10:43:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7062e20d-652c-5fc1-a3c9-139bf512ba13 with scrape type 1
2026-03-30 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7062e20d-652c-5fc1-a3c9-139bf512ba13
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_95437a7c068d75a810cc39750d853cb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_95437a7c068d75a810cc39750d853cb6.jpg not downloaded yet
2026-03-30 10:43:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_a8aa55e6fa23ed5d425564335eed5777.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_18069c0eaa1488fa8fbfb55352e0941d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_18069c0eaa1488fa8fbfb55352e0941d.jpg not downloaded yet
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_9e57742421425a9c16d1e8d1e9bfc553.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_9e57742421425a9c16d1e8d1e9bfc553.jpg not downloaded yet
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_06cede6ba795f7a59baf86ffa38df1d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_06cede6ba795f7a59baf86ffa38df1d1.jpg not downloaded yet
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_b24a568389f205ff92327b7699af1c8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_b24a568389f205ff92327b7699af1c8b.jpg not downloaded yet
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefb5bd0>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_3bb36f5a89554adb61d1c03b7714b023.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_3bb36f5a89554adb61d1c03b7714b023.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ca6b442d-0f88-5860-a88e-f9b85af1af04
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_04d8dab6399fd116c6c5a45c3ae1c720.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_04d8dab6399fd116c6c5a45c3ae1c720.jpg not downloaded yet
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_95437a7c068d75a810cc39750d853cb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_5d212e6c920fddc0f27174f8a055fe94.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_5d212e6c920fddc0f27174f8a055fe94.jpg not downloaded yet
2026-03-30 10:43:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3af93f0-bc0b-5c45-81e0-5ae46e234a5f with identifier: FW22794
2026-03-30 10:43:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3af93f0-bc0b-5c45-81e0-5ae46e234a5f with scrape type 1
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e3af93f0-bc0b-5c45-81e0-5ae46e234a5f
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_7c0d1dfd36fcf4cad268103b609de31c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_7c0d1dfd36fcf4cad268103b609de31c.jpg not downloaded yet
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8c350>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_a8aa55e6fa23ed5d425564335eed5777.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_a8aa55e6fa23ed5d425564335eed5777.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ca6b442d-0f88-5860-a88e-f9b85af1af04
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_37fbd06630b7de952248bdc0f277b29d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_37fbd06630b7de952248bdc0f277b29d.jpg not downloaded yet
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_2079d9529693ae1fbd206e1084a45000.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_2079d9529693ae1fbd206e1084a45000.jpg not downloaded yet
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_02858d3b44bfea0517d86017d5f0599a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_d1b84228a6787f7e3b7de12d955b1240.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_d1b84228a6787f7e3b7de12d955b1240.jpg not downloaded yet
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_81e9058b77cdee3ffc55fe08609b3a62.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_81e9058b77cdee3ffc55fe08609b3a62.jpg not downloaded yet
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_04d8dab6399fd116c6c5a45c3ae1c720.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_8d47357e596af921c1429695a6285493.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_8d47357e596af921c1429695a6285493.jpg not downloaded yet
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_980f70ed6796bfd1bc48f866d08d2937.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_980f70ed6796bfd1bc48f866d08d2937.jpg not downloaded yet
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7fc50>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_95437a7c068d75a810cc39750d853cb6.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_95437a7c068d75a810cc39750d853cb6.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7062e20d-652c-5fc1-a3c9-139bf512ba13
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_37fbd06630b7de952248bdc0f277b29d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_6a7ec69b8bbadb5ab371d4a43ce9da17.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_6a7ec69b8bbadb5ab371d4a43ce9da17.jpg not downloaded yet
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f425a090>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_02858d3b44bfea0517d86017d5f0599a.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_02858d3b44bfea0517d86017d5f0599a.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ca6b442d-0f88-5860-a88e-f9b85af1af04
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_07a2ef3a7af7ccc25fb89e373c906ef2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_07a2ef3a7af7ccc25fb89e373c906ef2.jpg not downloaded yet
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_81e9058b77cdee3ffc55fe08609b3a62.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_d7e5022a7fc896690524b30ffe2b9543.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_d7e5022a7fc896690524b30ffe2b9543.jpg not downloaded yet
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419bed0>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_04d8dab6399fd116c6c5a45c3ae1c720.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_04d8dab6399fd116c6c5a45c3ae1c720.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7062e20d-652c-5fc1-a3c9-139bf512ba13
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_980f70ed6796bfd1bc48f866d08d2937.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_28ed83cd2282d09777aa4114b228690e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_28ed83cd2282d09777aa4114b228690e.jpg not downloaded yet
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef53a50>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_37fbd06630b7de952248bdc0f277b29d.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_37fbd06630b7de952248bdc0f277b29d.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7062e20d-652c-5fc1-a3c9-139bf512ba13
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_07a2ef3a7af7ccc25fb89e373c906ef2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_ec3b013170422d761afda60b69198745.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_ec3b013170422d761afda60b69198745.jpg not downloaded yet
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_828ca70d1414b7f93803fa132ed14633.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_828ca70d1414b7f93803fa132ed14633.jpg not downloaded yet
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef44410>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_81e9058b77cdee3ffc55fe08609b3a62.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_81e9058b77cdee3ffc55fe08609b3a62.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3af93f0-bc0b-5c45-81e0-5ae46e234a5f
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_d7e5022a7fc896690524b30ffe2b9543.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee4b190>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_980f70ed6796bfd1bc48f866d08d2937.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_980f70ed6796bfd1bc48f866d08d2937.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3af93f0-bc0b-5c45-81e0-5ae46e234a5f
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_28ed83cd2282d09777aa4114b228690e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_828ca70d1414b7f93803fa132ed14633.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee4bc50>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_07a2ef3a7af7ccc25fb89e373c906ef2.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_07a2ef3a7af7ccc25fb89e373c906ef2.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3af93f0-bc0b-5c45-81e0-5ae46e234a5f
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3d390>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_d7e5022a7fc896690524b30ffe2b9543.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_d7e5022a7fc896690524b30ffe2b9543.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3af93f0-bc0b-5c45-81e0-5ae46e234a5f
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_ec3b013170422d761afda60b69198745.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41ffb10>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_28ed83cd2282d09777aa4114b228690e.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_28ed83cd2282d09777aa4114b228690e.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e3af93f0-bc0b-5c45-81e0-5ae46e234a5f
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4142390>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_828ca70d1414b7f93803fa132ed14633.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_828ca70d1414b7f93803fa132ed14633.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e3af93f0-bc0b-5c45-81e0-5ae46e234a5f
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_6a7ec69b8bbadb5ab371d4a43ce9da17.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e9cd0>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_ec3b013170422d761afda60b69198745.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_ec3b013170422d761afda60b69198745.jpg saved to cache
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e3af93f0-bc0b-5c45-81e0-5ae46e234a5f
2026-03-30 10:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_8d47357e596af921c1429695a6285493.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f433ab50>
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_6a7ec69b8bbadb5ab371d4a43ce9da17.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_6a7ec69b8bbadb5ab371d4a43ce9da17.jpg saved to cache
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3af93f0-bc0b-5c45-81e0-5ae46e234a5f
2026-03-30 10:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_2079d9529693ae1fbd206e1084a45000.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_d1b84228a6787f7e3b7de12d955b1240.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4215190>
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_8d47357e596af921c1429695a6285493.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_8d47357e596af921c1429695a6285493.jpg saved to cache
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7062e20d-652c-5fc1-a3c9-139bf512ba13
2026-03-30 10:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_7c0d1dfd36fcf4cad268103b609de31c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee47af90>
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_2079d9529693ae1fbd206e1084a45000.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_2079d9529693ae1fbd206e1084a45000.jpg saved to cache
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3af93f0-bc0b-5c45-81e0-5ae46e234a5f
2026-03-30 10:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_5d212e6c920fddc0f27174f8a055fe94.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f593f050>
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_d1b84228a6787f7e3b7de12d955b1240.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_d1b84228a6787f7e3b7de12d955b1240.jpg saved to cache
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7062e20d-652c-5fc1-a3c9-139bf512ba13
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4258f50>
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F34%252Fd334152ded6b2b825f354c9337cb3cd3%252Fpa%252FFW22794_7c0d1dfd36fcf4cad268103b609de31c.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_7c0d1dfd36fcf4cad268103b609de31c.jpg saved to cache
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3af93f0-bc0b-5c45-81e0-5ae46e234a5f
2026-03-30 10:43:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3af93f0-bc0b-5c45-81e0-5ae46e234a5f, skipping ID generation
2026-03-30 10:43:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3af93f0-bc0b-5c45-81e0-5ae46e234a5f with scrape type 1
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3af93f0-bc0b-5c45-81e0-5ae46e234a5f sending to next pipeline
2026-03-30 10:43:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3af93f0-bc0b-5c45-81e0-5ae46e234a5f, identifier: FW22794
2026-03-30 10:43:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3af93f0-bc0b-5c45-81e0-5ae46e234a5f with identifier: FW22794
2026-03-30 10:43:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3af93f0-bc0b-5c45-81e0-5ae46e234a5f with identifier: FW22794
2026-03-30 10:43:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3af93f0-bc0b-5c45-81e0-5ae46e234a5f with identifier: FW22794 to the API
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_7c0d1dfd36fcf4cad268103b609de31c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:41:44Z',
 'fuel_type': 'hybrid',
 'id': 'e3af93f0-bc0b-5c45-81e0-5ae46e234a5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW22794',
 'listing': 'auction',
 'location': 'DE, Mannheim',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 49054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_7c0d1dfd36fcf4cad268103b609de31c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_2079d9529693ae1fbd206e1084a45000.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_81e9058b77cdee3ffc55fe08609b3a62.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_980f70ed6796bfd1bc48f866d08d2937.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_6a7ec69b8bbadb5ab371d4a43ce9da17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_07a2ef3a7af7ccc25fb89e373c906ef2.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_d7e5022a7fc896690524b30ffe2b9543.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_28ed83cd2282d09777aa4114b228690e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_ec3b013170422d761afda60b69198745.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3af93f0-bc0b-5c45-81e0-5ae46e234a5f/e3af93f0-bc0b-5c45-81e0-5ae46e234a5f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/34/d334152ded6b2b825f354c9337cb3cd3/pa/FW22794_828ca70d1414b7f93803fa132ed14633.jpg',
             'Width': 799}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 225 GT',
 'transmission': 'automatic',
 'trim': '225 GT',
 'year': 2022}
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW22794%27 HTTP/1.1" 200 None
2026-03-30 10:43:33 [auto1.de] INFO: Saving data for FW22794: {'created_time': 1774867413.010872, 'last_price_update_time': 1774867413.010881, 'auction_closing_time': 1774971704.0}
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW22794') HTTP/1.1" 204 0
2026-03-30 10:43:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_06cede6ba795f7a59baf86ffa38df1d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4216850>
2026-03-30 10:43:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_5d212e6c920fddc0f27174f8a055fe94.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_5d212e6c920fddc0f27174f8a055fe94.jpg saved to cache
2026-03-30 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7062e20d-652c-5fc1-a3c9-139bf512ba13
2026-03-30 10:43:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU80356> (referer: https://www.auto1.com/v1/car-details-view/RU80356/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_b24a568389f205ff92327b7699af1c8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e9e10>
2026-03-30 10:43:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_06cede6ba795f7a59baf86ffa38df1d1.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_06cede6ba795f7a59baf86ffa38df1d1.jpg saved to cache
2026-03-30 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7062e20d-652c-5fc1-a3c9-139bf512ba13
2026-03-30 10:43:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_9e57742421425a9c16d1e8d1e9bfc553.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_18069c0eaa1488fa8fbfb55352e0941d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f645ed72-167f-5a14-989f-5576f095a833 with identifier: RU80356
2026-03-30 10:43:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f645ed72-167f-5a14-989f-5576f095a833 with scrape type 1
2026-03-30 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f645ed72-167f-5a14-989f-5576f095a833
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ffd%252Fb2fdcb9107a7f0cf5019a5f36724cb4e%252Fpa%252FRU80356_e9f8b2a970b730001f4efaea652c85e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_e9f8b2a970b730001f4efaea652c85e8.jpg already downloaded
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ffd%252Fb2fdcb9107a7f0cf5019a5f36724cb4e%252Fpa%252FRU80356_b135d4a4dea2bd86ee3cb33d8e904776.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_b135d4a4dea2bd86ee3cb33d8e904776.jpg already downloaded
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ffd%252Fb2fdcb9107a7f0cf5019a5f36724cb4e%252Fpa%252FRU80356_b92dd40aa0e1f6ce348d3d101a20e30c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_b92dd40aa0e1f6ce348d3d101a20e30c.jpg already downloaded
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ffd%252Fb2fdcb9107a7f0cf5019a5f36724cb4e%252Fpa%252FRU80356_3c84f9236f145dac808d72fbe23fca33.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_3c84f9236f145dac808d72fbe23fca33.jpg already downloaded
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ffd%252Fb2fdcb9107a7f0cf5019a5f36724cb4e%252Fpa%252FRU80356_43e551187260d954f23af0e8ed4ae94c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_43e551187260d954f23af0e8ed4ae94c.jpg already downloaded
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ffd%252Fb2fdcb9107a7f0cf5019a5f36724cb4e%252Fpa%252FRU80356_a9ff65b8b77a8564a7c7da0fb97fa85e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_a9ff65b8b77a8564a7c7da0fb97fa85e.jpg already downloaded
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ffd%252Fb2fdcb9107a7f0cf5019a5f36724cb4e%252Fpa%252FRU80356_afc84fc93c3884bc48c3bc0cfdccc00e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_afc84fc93c3884bc48c3bc0cfdccc00e.jpg already downloaded
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ffd%252Fb2fdcb9107a7f0cf5019a5f36724cb4e%252Fpa%252FRU80356_6b13c7df92eef8058a9076f8d83207f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_6b13c7df92eef8058a9076f8d83207f0.jpg already downloaded
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ffd%252Fb2fdcb9107a7f0cf5019a5f36724cb4e%252Fpa%252FRU80356_4d150015d6d88f8770a8c942294784ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_4d150015d6d88f8770a8c942294784ff.jpg already downloaded
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Ffd%252Fb2fdcb9107a7f0cf5019a5f36724cb4e%252Fpa%252FRU80356_cdaa2f4f34ac6bdd8eea7e6960f2ec8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_cdaa2f4f34ac6bdd8eea7e6960f2ec8f.jpg already downloaded
2026-03-30 10:43:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f645ed72-167f-5a14-989f-5576f095a833, identifier: RU80356
2026-03-30 10:43:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f645ed72-167f-5a14-989f-5576f095a833 with identifier: RU80356
2026-03-30 10:43:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f645ed72-167f-5a14-989f-5576f095a833 with identifier: RU80356
2026-03-30 10:43:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f645ed72-167f-5a14-989f-5576f095a833 with identifier: RU80356 to the API
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RU80356>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:37:08Z',
 'fuel_type': 'diesel',
 'id': 'f645ed72-167f-5a14-989f-5576f095a833',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU80356',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 125346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_e9f8b2a970b730001f4efaea652c85e8.jpg',
                'https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_b135d4a4dea2bd86ee3cb33d8e904776.jpg',
                'https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_b92dd40aa0e1f6ce348d3d101a20e30c.jpg',
                'https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_3c84f9236f145dac808d72fbe23fca33.jpg',
                'https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_43e551187260d954f23af0e8ed4ae94c.jpg',
                'https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_a9ff65b8b77a8564a7c7da0fb97fa85e.jpg',
                'https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_afc84fc93c3884bc48c3bc0cfdccc00e.jpg',
                'https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_6b13c7df92eef8058a9076f8d83207f0.jpg',
                'https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_4d150015d6d88f8770a8c942294784ff.jpg',
                'https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_cdaa2f4f34ac6bdd8eea7e6960f2ec8f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f645ed72-167f-5a14-989f-5576f095a833/f645ed72-167f-5a14-989f-5576f095a833_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_e9f8b2a970b730001f4efaea652c85e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f645ed72-167f-5a14-989f-5576f095a833/f645ed72-167f-5a14-989f-5576f095a833_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_b135d4a4dea2bd86ee3cb33d8e904776.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f645ed72-167f-5a14-989f-5576f095a833/f645ed72-167f-5a14-989f-5576f095a833_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3156605,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_b92dd40aa0e1f6ce348d3d101a20e30c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f645ed72-167f-5a14-989f-5576f095a833/f645ed72-167f-5a14-989f-5576f095a833_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2887161,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_3c84f9236f145dac808d72fbe23fca33.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f645ed72-167f-5a14-989f-5576f095a833/f645ed72-167f-5a14-989f-5576f095a833_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_43e551187260d954f23af0e8ed4ae94c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f645ed72-167f-5a14-989f-5576f095a833/f645ed72-167f-5a14-989f-5576f095a833_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_a9ff65b8b77a8564a7c7da0fb97fa85e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f645ed72-167f-5a14-989f-5576f095a833/f645ed72-167f-5a14-989f-5576f095a833_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3173066,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_afc84fc93c3884bc48c3bc0cfdccc00e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f645ed72-167f-5a14-989f-5576f095a833/f645ed72-167f-5a14-989f-5576f095a833_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_6b13c7df92eef8058a9076f8d83207f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f645ed72-167f-5a14-989f-5576f095a833/f645ed72-167f-5a14-989f-5576f095a833_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3109825,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_4d150015d6d88f8770a8c942294784ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f645ed72-167f-5a14-989f-5576f095a833/f645ed72-167f-5a14-989f-5576f095a833_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/fd/b2fdcb9107a7f0cf5019a5f36724cb4e/pa/RU80356_cdaa2f4f34ac6bdd8eea7e6960f2ec8f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Business Start/Stop',
 'transmission': 'manual',
 'trim': 'Business Start/Stop',
 'year': 2019}
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU80356%27 HTTP/1.1" 200 None
2026-03-30 10:43:34 [auto1.de] INFO: Saving data for RU80356: {'created_time': 1774867414.174616, 'last_price_update_time': 1774867414.174624, 'auction_closing_time': 1774971428.0}
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU80356') HTTP/1.1" 204 0
2026-03-30 10:43:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_745c2b0bc373305a42603e180cd546c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4258f90>
2026-03-30 10:43:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_b24a568389f205ff92327b7699af1c8b.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_b24a568389f205ff92327b7699af1c8b.jpg saved to cache
2026-03-30 10:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7062e20d-652c-5fc1-a3c9-139bf512ba13
2026-03-30 10:43:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_6e433ed4db3dc2a54be62093dcc287a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_dd0a67efdc11e0054850af862bb9cb11.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f9850>
2026-03-30 10:43:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_9e57742421425a9c16d1e8d1e9bfc553.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_9e57742421425a9c16d1e8d1e9bfc553.jpg saved to cache
2026-03-30 10:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7062e20d-652c-5fc1-a3c9-139bf512ba13
2026-03-30 10:43:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58d2590>
2026-03-30 10:43:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fd8%252F84d81159d437a8e8a934f60ffe81da0d%252Fpa%252FXH91941_18069c0eaa1488fa8fbfb55352e0941d.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_18069c0eaa1488fa8fbfb55352e0941d.jpg saved to cache
2026-03-30 10:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7062e20d-652c-5fc1-a3c9-139bf512ba13
2026-03-30 10:43:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7062e20d-652c-5fc1-a3c9-139bf512ba13, skipping ID generation
2026-03-30 10:43:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7062e20d-652c-5fc1-a3c9-139bf512ba13 with scrape type 1
2026-03-30 10:43:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7062e20d-652c-5fc1-a3c9-139bf512ba13 sending to next pipeline
2026-03-30 10:43:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7062e20d-652c-5fc1-a3c9-139bf512ba13, identifier: XH91941
2026-03-30 10:43:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7062e20d-652c-5fc1-a3c9-139bf512ba13 with identifier: XH91941
2026-03-30 10:43:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7062e20d-652c-5fc1-a3c9-139bf512ba13 with identifier: XH91941
2026-03-30 10:43:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7062e20d-652c-5fc1-a3c9-139bf512ba13 with identifier: XH91941 to the API
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_18069c0eaa1488fa8fbfb55352e0941d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:13:11Z',
 'fuel_type': 'diesel',
 'id': '7062e20d-652c-5fc1-a3c9-139bf512ba13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH91941',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Volkswagen',
 'model': 'T4 Transporter',
 'odometer': 278442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_95437a7c068d75a810cc39750d853cb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_18069c0eaa1488fa8fbfb55352e0941d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_9e57742421425a9c16d1e8d1e9bfc553.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_06cede6ba795f7a59baf86ffa38df1d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2467695,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_b24a568389f205ff92327b7699af1c8b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_04d8dab6399fd116c6c5a45c3ae1c720.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_5d212e6c920fddc0f27174f8a055fe94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_37fbd06630b7de952248bdc0f277b29d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_d1b84228a6787f7e3b7de12d955b1240.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7062e20d-652c-5fc1-a3c9-139bf512ba13/7062e20d-652c-5fc1-a3c9-139bf512ba13_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/d8/84d81159d437a8e8a934f60ffe81da0d/pa/XH91941_8d47357e596af921c1429695a6285493.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1995-08-22',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Volkswagen T4 Transporter 1.9 Turbodiesel Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 1995}
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH91941%27 HTTP/1.1" 200 None
2026-03-30 10:43:35 [auto1.de] INFO: Saving data for XH91941: {'created_time': 1774867415.11301, 'last_price_update_time': 1774867415.113021, 'auction_closing_time': 1774969991.0}
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH91941') HTTP/1.1" 204 0
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef0b10>
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_745c2b0bc373305a42603e180cd546c0.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_745c2b0bc373305a42603e180cd546c0.jpg saved to cache
2026-03-30 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ca6b442d-0f88-5860-a88e-f9b85af1af04
2026-03-30 10:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_47caa75273ab86162b2dc6ee243257d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f422bed0>
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_6e433ed4db3dc2a54be62093dcc287a3.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_6e433ed4db3dc2a54be62093dcc287a3.jpg saved to cache
2026-03-30 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca6b442d-0f88-5860-a88e-f9b85af1af04
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee93bd0>
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_dd0a67efdc11e0054850af862bb9cb11.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_dd0a67efdc11e0054850af862bb9cb11.jpg saved to cache
2026-03-30 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca6b442d-0f88-5860-a88e-f9b85af1af04
2026-03-30 10:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_4aea568e84105255c6ef03758d0173d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_beedbe4818ef0d40460433b9bdb78823.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef4e0d0>
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_47caa75273ab86162b2dc6ee243257d5.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_47caa75273ab86162b2dc6ee243257d5.jpg saved to cache
2026-03-30 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ca6b442d-0f88-5860-a88e-f9b85af1af04
2026-03-30 10:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_6e7cc653865c8b08889e283b9451d5e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_d642d43bf921dc31677e711db74bd5f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4172810>
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_4aea568e84105255c6ef03758d0173d1.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_4aea568e84105255c6ef03758d0173d1.jpg saved to cache
2026-03-30 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ca6b442d-0f88-5860-a88e-f9b85af1af04
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4344090>
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_beedbe4818ef0d40460433b9bdb78823.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_beedbe4818ef0d40460433b9bdb78823.jpg saved to cache
2026-03-30 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ca6b442d-0f88-5860-a88e-f9b85af1af04
2026-03-30 10:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_9dfb6eec1a7447be9897a336815d0bca.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3d410>
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F40%252F8c40ca35542f69dd9457b197d5aecabb%252Fpa%252FBF55628_6e7cc653865c8b08889e283b9451d5e5.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_6e7cc653865c8b08889e283b9451d5e5.jpg saved to cache
2026-03-30 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca6b442d-0f88-5860-a88e-f9b85af1af04
2026-03-30 10:43:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca6b442d-0f88-5860-a88e-f9b85af1af04, skipping ID generation
2026-03-30 10:43:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca6b442d-0f88-5860-a88e-f9b85af1af04 with scrape type 1
2026-03-30 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca6b442d-0f88-5860-a88e-f9b85af1af04 sending to next pipeline
2026-03-30 10:43:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca6b442d-0f88-5860-a88e-f9b85af1af04, identifier: BF55628
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434d750>
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_d642d43bf921dc31677e711db74bd5f8.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_d642d43bf921dc31677e711db74bd5f8.jpg saved to cache
2026-03-30 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3654fb31-e3a6-5db9-a661-5d8b36abb97c
2026-03-30 10:43:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca6b442d-0f88-5860-a88e-f9b85af1af04 with identifier: BF55628
2026-03-30 10:43:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca6b442d-0f88-5860-a88e-f9b85af1af04 with identifier: BF55628
2026-03-30 10:43:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca6b442d-0f88-5860-a88e-f9b85af1af04 with identifier: BF55628 to the API
2026-03-30 10:43:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_6e7cc653865c8b08889e283b9451d5e5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:11:24Z',
 'fuel_type': 'diesel',
 'id': 'ca6b442d-0f88-5860-a88e-f9b85af1af04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF55628',
 'listing': 'auction',
 'location': 'DE, Delmenhorst',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 229743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_6e7cc653865c8b08889e283b9451d5e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_4aea568e84105255c6ef03758d0173d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_beedbe4818ef0d40460433b9bdb78823.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_47caa75273ab86162b2dc6ee243257d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_6e433ed4db3dc2a54be62093dcc287a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_dd0a67efdc11e0054850af862bb9cb11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_745c2b0bc373305a42603e180cd546c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_02858d3b44bfea0517d86017d5f0599a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_a8aa55e6fa23ed5d425564335eed5777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca6b442d-0f88-5860-a88e-f9b85af1af04/ca6b442d-0f88-5860-a88e-f9b85af1af04_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/40/8c40ca35542f69dd9457b197d5aecabb/pa/BF55628_3bb36f5a89554adb61d1c03b7714b023.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-30 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF55628%27 HTTP/1.1" 200 None
2026-03-30 10:43:36 [auto1.de] INFO: Saving data for BF55628: {'created_time': 1774867416.280825, 'last_price_update_time': 1774867416.280843, 'auction_closing_time': 1774969884.0}
2026-03-30 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF55628') HTTP/1.1" 204 0
2026-03-30 10:43:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef74710>
2026-03-30 10:43:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F3c%252Fd43c4192baace6b183aa4712da58bd83%252Fpa%252FCV02833_9dfb6eec1a7447be9897a336815d0bca.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_9dfb6eec1a7447be9897a336815d0bca.jpg saved to cache
2026-03-30 10:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3654fb31-e3a6-5db9-a661-5d8b36abb97c
2026-03-30 10:43:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3654fb31-e3a6-5db9-a661-5d8b36abb97c, skipping ID generation
2026-03-30 10:43:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3654fb31-e3a6-5db9-a661-5d8b36abb97c with scrape type 1
2026-03-30 10:43:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3654fb31-e3a6-5db9-a661-5d8b36abb97c sending to next pipeline
2026-03-30 10:43:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3654fb31-e3a6-5db9-a661-5d8b36abb97c, identifier: CV02833
2026-03-30 10:43:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3654fb31-e3a6-5db9-a661-5d8b36abb97c with identifier: CV02833
2026-03-30 10:43:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3654fb31-e3a6-5db9-a661-5d8b36abb97c with identifier: CV02833
2026-03-30 10:43:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3654fb31-e3a6-5db9-a661-5d8b36abb97c with identifier: CV02833 to the API
2026-03-30 10:43:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_9dfb6eec1a7447be9897a336815d0bca.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:37:12Z',
 'fuel_type': 'diesel',
 'id': '3654fb31-e3a6-5db9-a661-5d8b36abb97c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV02833',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 191555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 39,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2877580,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_d974fff76d7941e7358b9db0cbb9650a.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_25b810b930d16ccbb99d01c2226e7cb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_9f32e7703e3bec3860be9b6b6fd7ce02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_9dfb6eec1a7447be9897a336815d0bca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_fa9d6a0257a0040bac7d034bc5b83146.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_0c6ee395e951b4b431369b3214f32de1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_f36ebcd13382b4f82ebf6b69900ba504.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_d642d43bf921dc31677e711db74bd5f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_5657e8457c75507b72396d697207d791.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3654fb31-e3a6-5db9-a661-5d8b36abb97c/3654fb31-e3a6-5db9-a661-5d8b36abb97c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/3c/d43c4192baace6b183aa4712da58bd83/pa/CV02833_cb757e76838911ae127a1e133eba5d37.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 2.0 Blue-HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2016}
2026-03-30 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV02833%27 HTTP/1.1" 200 None
2026-03-30 10:43:36 [auto1.de] INFO: Saving data for CV02833: {'created_time': 1774867416.805653, 'last_price_update_time': 1774867416.805669, 'auction_closing_time': 1774971432.0}
2026-03-30 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV02833') HTTP/1.1" 204 0
2026-03-30 10:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_c84f9b875d6c28523dbd3f21affe2b1f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_93e39bfc046915c0632e111e5a10b0b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee93dd0>
2026-03-30 10:43:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_c84f9b875d6c28523dbd3f21affe2b1f.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_c84f9b875d6c28523dbd3f21affe2b1f.jpg saved to cache
2026-03-30 10:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40d7c578-c4b1-55ed-bc33-15175e40b0d2
2026-03-30 10:43:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee939d0>
2026-03-30 10:43:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5f%252Fc55f64063500f330393ba05db0f88cf0%252Fpa%252FWL02580_93e39bfc046915c0632e111e5a10b0b7.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_93e39bfc046915c0632e111e5a10b0b7.jpg saved to cache
2026-03-30 10:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40d7c578-c4b1-55ed-bc33-15175e40b0d2
2026-03-30 10:43:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40d7c578-c4b1-55ed-bc33-15175e40b0d2, skipping ID generation
2026-03-30 10:43:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40d7c578-c4b1-55ed-bc33-15175e40b0d2 with scrape type 1
2026-03-30 10:43:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40d7c578-c4b1-55ed-bc33-15175e40b0d2 sending to next pipeline
2026-03-30 10:43:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40d7c578-c4b1-55ed-bc33-15175e40b0d2, identifier: WL02580
2026-03-30 10:43:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40d7c578-c4b1-55ed-bc33-15175e40b0d2 with identifier: WL02580
2026-03-30 10:43:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40d7c578-c4b1-55ed-bc33-15175e40b0d2 with identifier: WL02580
2026-03-30 10:43:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40d7c578-c4b1-55ed-bc33-15175e40b0d2 with identifier: WL02580 to the API
2026-03-30 10:43:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_93e39bfc046915c0632e111e5a10b0b7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:07:09Z',
 'fuel_type': 'petrol',
 'id': '40d7c578-c4b1-55ed-bc33-15175e40b0d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL02580',
 'listing': 'auction',
 'location': 'DE, Mönchengladbach',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 114890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3394244,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_74114a446c5bb8d2fd8f02695dd2c4c8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3048781,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_15bbbe851bae93193b3810cfd490281f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3486339,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_b80ef353ac68dc22e1833eb2a7e88be6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3036140,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_93e39bfc046915c0632e111e5a10b0b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3157930,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_a2024db1443ffa9484e5e897b493a5ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3063146,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_c84f9b875d6c28523dbd3f21affe2b1f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2865344,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_71dc275cfdeff60f8dcbccd9751b8ff6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3274838,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_4c19d6ecbdf2dc72023d0957f1e7268b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3056806,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_f84a477cf28616a8247f24d3cec318ae.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d7c578-c4b1-55ed-bc33-15175e40b0d2/40d7c578-c4b1-55ed-bc33-15175e40b0d2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3283282,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/5f/c55f64063500f330393ba05db0f88cf0/pa/WL02580_83dee00d8c6cfdb52d43016f83433375.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 MPI Cool Plus',
 'transmission': 'manual',
 'trim': 'Cool Plus',
 'year': 2019}
2026-03-30 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL02580%27 HTTP/1.1" 200 None
2026-03-30 10:43:37 [auto1.de] INFO: Saving data for WL02580: {'created_time': 1774867417.681949, 'last_price_update_time': 1774867417.681961, 'auction_closing_time': 1774969629.0}
2026-03-30 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL02580') HTTP/1.1" 204 0
2026-03-30 10:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AS73684/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.005(s), this was the 1st time calling it.
2026-03-30 10:43:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.404451811562957 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:43:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WH06926> (referer: https://www.auto1.com/v1/car-details-view/WH06926/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b2da3b0-fdec-58c0-9e35-11476234d506 with identifier: WH06926
2026-03-30 10:43:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b2da3b0-fdec-58c0-9e35-11476234d506 with scrape type 1
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8b2da3b0-fdec-58c0-9e35-11476234d506
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F47%252F5c477406d21b2386a91001157fada95b%252Fpa%252FWH06926_eaaedd2e6980af6cd807b7a306abb422.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_eaaedd2e6980af6cd807b7a306abb422.jpg not downloaded yet
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F47%252F5c477406d21b2386a91001157fada95b%252Fpa%252FWH06926_9fa542241b1d8c4b76dcdc0e186d83e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_9fa542241b1d8c4b76dcdc0e186d83e0.jpg not downloaded yet
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F47%252F5c477406d21b2386a91001157fada95b%252Fpa%252FWH06926_7416383f2f322a5b9fe5717fe0ad2ec3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_7416383f2f322a5b9fe5717fe0ad2ec3.jpg not downloaded yet
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F47%252F5c477406d21b2386a91001157fada95b%252Fpa%252FWH06926_6a7ea428adc14098b3b524bed8b397cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_6a7ea428adc14098b3b524bed8b397cc.jpg not downloaded yet
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F47%252F5c477406d21b2386a91001157fada95b%252Fpa%252FWH06926_2b49fe63907a6dbb79e2856384ce7688.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_2b49fe63907a6dbb79e2856384ce7688.jpg not downloaded yet
2026-03-30 10:43:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_eaaedd2e6980af6cd807b7a306abb422.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_9fa542241b1d8c4b76dcdc0e186d83e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43018d0>
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b2da3b0-fdec-58c0-9e35-11476234d506/8b2da3b0-fdec-58c0-9e35-11476234d506_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F47%252F5c477406d21b2386a91001157fada95b%252Fpa%252FWH06926_eaaedd2e6980af6cd807b7a306abb422.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_eaaedd2e6980af6cd807b7a306abb422.jpg saved to cache
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b2da3b0-fdec-58c0-9e35-11476234d506
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43375d0>
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b2da3b0-fdec-58c0-9e35-11476234d506/8b2da3b0-fdec-58c0-9e35-11476234d506_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F47%252F5c477406d21b2386a91001157fada95b%252Fpa%252FWH06926_9fa542241b1d8c4b76dcdc0e186d83e0.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_9fa542241b1d8c4b76dcdc0e186d83e0.jpg saved to cache
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b2da3b0-fdec-58c0-9e35-11476234d506
2026-03-30 10:43:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_7416383f2f322a5b9fe5717fe0ad2ec3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_6a7ea428adc14098b3b524bed8b397cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_2b49fe63907a6dbb79e2856384ce7688.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee4d9d0>
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b2da3b0-fdec-58c0-9e35-11476234d506/8b2da3b0-fdec-58c0-9e35-11476234d506_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F47%252F5c477406d21b2386a91001157fada95b%252Fpa%252FWH06926_7416383f2f322a5b9fe5717fe0ad2ec3.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_7416383f2f322a5b9fe5717fe0ad2ec3.jpg saved to cache
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b2da3b0-fdec-58c0-9e35-11476234d506
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417c210>
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b2da3b0-fdec-58c0-9e35-11476234d506/8b2da3b0-fdec-58c0-9e35-11476234d506_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F47%252F5c477406d21b2386a91001157fada95b%252Fpa%252FWH06926_6a7ea428adc14098b3b524bed8b397cc.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_6a7ea428adc14098b3b524bed8b397cc.jpg saved to cache
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b2da3b0-fdec-58c0-9e35-11476234d506
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4303910>
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b2da3b0-fdec-58c0-9e35-11476234d506/8b2da3b0-fdec-58c0-9e35-11476234d506_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F47%252F5c477406d21b2386a91001157fada95b%252Fpa%252FWH06926_2b49fe63907a6dbb79e2856384ce7688.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_2b49fe63907a6dbb79e2856384ce7688.jpg saved to cache
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b2da3b0-fdec-58c0-9e35-11476234d506
2026-03-30 10:43:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b2da3b0-fdec-58c0-9e35-11476234d506, skipping ID generation
2026-03-30 10:43:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b2da3b0-fdec-58c0-9e35-11476234d506 with scrape type 1
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b2da3b0-fdec-58c0-9e35-11476234d506 sending to next pipeline
2026-03-30 10:43:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b2da3b0-fdec-58c0-9e35-11476234d506, identifier: WH06926
2026-03-30 10:43:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b2da3b0-fdec-58c0-9e35-11476234d506 with identifier: WH06926
2026-03-30 10:43:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b2da3b0-fdec-58c0-9e35-11476234d506 with identifier: WH06926
2026-03-30 10:43:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b2da3b0-fdec-58c0-9e35-11476234d506 with identifier: WH06926 to the API
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_2b49fe63907a6dbb79e2856384ce7688.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:19:39Z',
 'fuel_type': 'petrol',
 'id': '8b2da3b0-fdec-58c0-9e35-11476234d506',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH06926',
 'listing': 'auction',
 'location': 'DE, Kamen',
 'make': 'Mazda',
 'model': '6',
 'odometer': 175240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b2da3b0-fdec-58c0-9e35-11476234d506/8b2da3b0-fdec-58c0-9e35-11476234d506_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_eaaedd2e6980af6cd807b7a306abb422.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b2da3b0-fdec-58c0-9e35-11476234d506/8b2da3b0-fdec-58c0-9e35-11476234d506_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_9fa542241b1d8c4b76dcdc0e186d83e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b2da3b0-fdec-58c0-9e35-11476234d506/8b2da3b0-fdec-58c0-9e35-11476234d506_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_7416383f2f322a5b9fe5717fe0ad2ec3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b2da3b0-fdec-58c0-9e35-11476234d506/8b2da3b0-fdec-58c0-9e35-11476234d506_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_6a7ea428adc14098b3b524bed8b397cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b2da3b0-fdec-58c0-9e35-11476234d506/8b2da3b0-fdec-58c0-9e35-11476234d506_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/47/5c477406d21b2386a91001157fada95b/pa/WH06926_2b49fe63907a6dbb79e2856384ce7688.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 6 1.8 Exclusive Sport',
 'transmission': 'manual',
 'trim': 'Exclusive Sport',
 'year': 2005}
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH06926%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [auto1.de] INFO: Saving data for WH06926: {'created_time': 1774867428.456062, 'last_price_update_time': 1774867428.456075, 'auction_closing_time': 1774970379.0}
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WH06926') HTTP/1.1" 204 0
2026-03-30 10:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RZ67892> (referer: https://www.auto1.com/v1/car-details-view/RZ67892/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d060fcdb-01af-5c6d-82eb-55309d01825f with identifier: RZ67892
2026-03-30 10:43:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d060fcdb-01af-5c6d-82eb-55309d01825f with scrape type 1
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d060fcdb-01af-5c6d-82eb-55309d01825f
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F67%252F4967eefe2a54ea85232253614dbd1cf2%252Fpa%252FRZ67892_879210952b982538fa51b86c532b3f62.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_879210952b982538fa51b86c532b3f62.jpg already downloaded
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F67%252F4967eefe2a54ea85232253614dbd1cf2%252Fpa%252FRZ67892_95f0a021286b09972411acca8ff5bff7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_95f0a021286b09972411acca8ff5bff7.jpg already downloaded
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F67%252F4967eefe2a54ea85232253614dbd1cf2%252Fpa%252FRZ67892_4f937e1416e698431786da70191c0ceb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_4f937e1416e698431786da70191c0ceb.jpg already downloaded
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F67%252F4967eefe2a54ea85232253614dbd1cf2%252Fpa%252FRZ67892_ac20ae0f5aa9a862ce7d2a468505387d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_ac20ae0f5aa9a862ce7d2a468505387d.jpg already downloaded
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F67%252F4967eefe2a54ea85232253614dbd1cf2%252Fpa%252FRZ67892_cd9d7d0163b6a0f7179ff8329665799d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_cd9d7d0163b6a0f7179ff8329665799d.jpg already downloaded
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F67%252F4967eefe2a54ea85232253614dbd1cf2%252Fpa%252FRZ67892_31f2857abd1dd67fec22f57c7db7b083.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_31f2857abd1dd67fec22f57c7db7b083.jpg already downloaded
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F67%252F4967eefe2a54ea85232253614dbd1cf2%252Fpa%252FRZ67892_31420299b91977889114313c5fa8bef1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_31420299b91977889114313c5fa8bef1.jpg already downloaded
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F67%252F4967eefe2a54ea85232253614dbd1cf2%252Fpa%252FRZ67892_0c5b7e5f2eca87ee935c1c8ef0470246.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_0c5b7e5f2eca87ee935c1c8ef0470246.jpg already downloaded
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F67%252F4967eefe2a54ea85232253614dbd1cf2%252Fpa%252FRZ67892_cab70a475b56cc8b60ad07222f9de6e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_cab70a475b56cc8b60ad07222f9de6e9.jpg already downloaded
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F67%252F4967eefe2a54ea85232253614dbd1cf2%252Fpa%252FRZ67892_428c4bf87d826ae6e340c4c824cef86d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_428c4bf87d826ae6e340c4c824cef86d.jpg already downloaded
2026-03-30 10:43:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d060fcdb-01af-5c6d-82eb-55309d01825f, identifier: RZ67892
2026-03-30 10:43:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d060fcdb-01af-5c6d-82eb-55309d01825f with identifier: RZ67892
2026-03-30 10:43:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d060fcdb-01af-5c6d-82eb-55309d01825f with identifier: RZ67892
2026-03-30 10:43:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d060fcdb-01af-5c6d-82eb-55309d01825f with identifier: RZ67892 to the API
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RZ67892>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:27:32Z',
 'fuel_type': 'diesel',
 'id': 'd060fcdb-01af-5c6d-82eb-55309d01825f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ67892',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 203952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_879210952b982538fa51b86c532b3f62.jpg',
                'https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_95f0a021286b09972411acca8ff5bff7.jpg',
                'https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_4f937e1416e698431786da70191c0ceb.jpg',
                'https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_ac20ae0f5aa9a862ce7d2a468505387d.jpg',
                'https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_cd9d7d0163b6a0f7179ff8329665799d.jpg',
                'https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_31f2857abd1dd67fec22f57c7db7b083.jpg',
                'https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_31420299b91977889114313c5fa8bef1.jpg',
                'https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_0c5b7e5f2eca87ee935c1c8ef0470246.jpg',
                'https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_cab70a475b56cc8b60ad07222f9de6e9.jpg',
                'https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_428c4bf87d826ae6e340c4c824cef86d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d060fcdb-01af-5c6d-82eb-55309d01825f/d060fcdb-01af-5c6d-82eb-55309d01825f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_879210952b982538fa51b86c532b3f62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d060fcdb-01af-5c6d-82eb-55309d01825f/d060fcdb-01af-5c6d-82eb-55309d01825f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_95f0a021286b09972411acca8ff5bff7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d060fcdb-01af-5c6d-82eb-55309d01825f/d060fcdb-01af-5c6d-82eb-55309d01825f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_4f937e1416e698431786da70191c0ceb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d060fcdb-01af-5c6d-82eb-55309d01825f/d060fcdb-01af-5c6d-82eb-55309d01825f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_ac20ae0f5aa9a862ce7d2a468505387d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d060fcdb-01af-5c6d-82eb-55309d01825f/d060fcdb-01af-5c6d-82eb-55309d01825f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_cd9d7d0163b6a0f7179ff8329665799d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d060fcdb-01af-5c6d-82eb-55309d01825f/d060fcdb-01af-5c6d-82eb-55309d01825f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_31f2857abd1dd67fec22f57c7db7b083.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d060fcdb-01af-5c6d-82eb-55309d01825f/d060fcdb-01af-5c6d-82eb-55309d01825f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_31420299b91977889114313c5fa8bef1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d060fcdb-01af-5c6d-82eb-55309d01825f/d060fcdb-01af-5c6d-82eb-55309d01825f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_0c5b7e5f2eca87ee935c1c8ef0470246.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d060fcdb-01af-5c6d-82eb-55309d01825f/d060fcdb-01af-5c6d-82eb-55309d01825f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_cab70a475b56cc8b60ad07222f9de6e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d060fcdb-01af-5c6d-82eb-55309d01825f/d060fcdb-01af-5c6d-82eb-55309d01825f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/67/4967eefe2a54ea85232253614dbd1cf2/pa/RZ67892_428c4bf87d826ae6e340c4c824cef86d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ67892%27 HTTP/1.1" 200 None
2026-03-30 10:43:49 [auto1.de] INFO: Saving data for RZ67892: {'created_time': 1774867429.21293, 'last_price_update_time': 1774867429.21294, 'auction_closing_time': 1774970852.0}
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ67892') HTTP/1.1" 204 0
2026-03-30 10:43:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GD36991/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZS77255> (referer: https://www.auto1.com/v1/car-details-view/ZS77255/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d37c4d7-a1e8-523e-8951-53705074b330 with identifier: ZS77255
2026-03-30 10:43:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d37c4d7-a1e8-523e-8951-53705074b330 with scrape type 1
2026-03-30 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2d37c4d7-a1e8-523e-8951-53705074b330
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_9288160e57ea2f2aa80b6d87dd0948f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_9288160e57ea2f2aa80b6d87dd0948f5.jpg not downloaded yet
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_fb3be40ad52cad141e47d53dda61a64e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_fb3be40ad52cad141e47d53dda61a64e.jpg not downloaded yet
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_a90126eec36a440710c1e266172c58df.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_a90126eec36a440710c1e266172c58df.jpg not downloaded yet
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_eba717a11955ee2940fccd9ff16db668.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_eba717a11955ee2940fccd9ff16db668.jpg not downloaded yet
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_51d44d9e21466bb5f694bdf48eda56b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_51d44d9e21466bb5f694bdf48eda56b3.jpg not downloaded yet
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_f1bd9a341ca2b7274fe3a87d6f425bf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_f1bd9a341ca2b7274fe3a87d6f425bf2.jpg not downloaded yet
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_18aacaea13ea0d21a29e2b5934b0a8d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_18aacaea13ea0d21a29e2b5934b0a8d8.jpg not downloaded yet
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_fcf2533cd3036e3e996cdfb9007f0c8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_fcf2533cd3036e3e996cdfb9007f0c8d.jpg not downloaded yet
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_8431b683f94225de2e1bb45057f3f93d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_8431b683f94225de2e1bb45057f3f93d.jpg not downloaded yet
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_bafaed162f7082b52ae9d4c709490e4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_bafaed162f7082b52ae9d4c709490e4f.jpg not downloaded yet
2026-03-30 10:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_a90126eec36a440710c1e266172c58df.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_eba717a11955ee2940fccd9ff16db668.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_9288160e57ea2f2aa80b6d87dd0948f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_51d44d9e21466bb5f694bdf48eda56b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_fb3be40ad52cad141e47d53dda61a64e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43392d0>
2026-03-30 10:43:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_a90126eec36a440710c1e266172c58df.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_a90126eec36a440710c1e266172c58df.jpg saved to cache
2026-03-30 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d37c4d7-a1e8-523e-8951-53705074b330
2026-03-30 10:43:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4172110>
2026-03-30 10:43:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_eba717a11955ee2940fccd9ff16db668.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_eba717a11955ee2940fccd9ff16db668.jpg saved to cache
2026-03-30 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d37c4d7-a1e8-523e-8951-53705074b330
2026-03-30 10:43:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee443010>
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_9288160e57ea2f2aa80b6d87dd0948f5.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_9288160e57ea2f2aa80b6d87dd0948f5.jpg saved to cache
2026-03-30 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d37c4d7-a1e8-523e-8951-53705074b330
2026-03-30 10:43:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeedcad0>
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_51d44d9e21466bb5f694bdf48eda56b3.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_51d44d9e21466bb5f694bdf48eda56b3.jpg saved to cache
2026-03-30 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d37c4d7-a1e8-523e-8951-53705074b330
2026-03-30 10:43:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee40790>
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_fb3be40ad52cad141e47d53dda61a64e.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_fb3be40ad52cad141e47d53dda61a64e.jpg saved to cache
2026-03-30 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d37c4d7-a1e8-523e-8951-53705074b330
2026-03-30 10:43:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_bafaed162f7082b52ae9d4c709490e4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee06410>
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_bafaed162f7082b52ae9d4c709490e4f.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_bafaed162f7082b52ae9d4c709490e4f.jpg saved to cache
2026-03-30 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2d37c4d7-a1e8-523e-8951-53705074b330
2026-03-30 10:43:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_8431b683f94225de2e1bb45057f3f93d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_fcf2533cd3036e3e996cdfb9007f0c8d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f432a310>
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_8431b683f94225de2e1bb45057f3f93d.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_8431b683f94225de2e1bb45057f3f93d.jpg saved to cache
2026-03-30 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2d37c4d7-a1e8-523e-8951-53705074b330
2026-03-30 10:43:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4258e90>
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_fcf2533cd3036e3e996cdfb9007f0c8d.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_fcf2533cd3036e3e996cdfb9007f0c8d.jpg saved to cache
2026-03-30 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d37c4d7-a1e8-523e-8951-53705074b330
2026-03-30 10:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_f1bd9a341ca2b7274fe3a87d6f425bf2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_18aacaea13ea0d21a29e2b5934b0a8d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef1fd0>
2026-03-30 10:43:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_f1bd9a341ca2b7274fe3a87d6f425bf2.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_f1bd9a341ca2b7274fe3a87d6f425bf2.jpg saved to cache
2026-03-30 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d37c4d7-a1e8-523e-8951-53705074b330
2026-03-30 10:43:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:43:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4229510>
2026-03-30 10:43:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F85%252Fd885f8c9f801ada28c27ff26bb445711%252Fpa%252FZS77255_18aacaea13ea0d21a29e2b5934b0a8d8.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_18aacaea13ea0d21a29e2b5934b0a8d8.jpg saved to cache
2026-03-30 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d37c4d7-a1e8-523e-8951-53705074b330
2026-03-30 10:43:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d37c4d7-a1e8-523e-8951-53705074b330, skipping ID generation
2026-03-30 10:43:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d37c4d7-a1e8-523e-8951-53705074b330 with scrape type 1
2026-03-30 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d37c4d7-a1e8-523e-8951-53705074b330 sending to next pipeline
2026-03-30 10:43:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d37c4d7-a1e8-523e-8951-53705074b330, identifier: ZS77255
2026-03-30 10:43:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d37c4d7-a1e8-523e-8951-53705074b330 with identifier: ZS77255
2026-03-30 10:43:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d37c4d7-a1e8-523e-8951-53705074b330 with identifier: ZS77255
2026-03-30 10:43:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d37c4d7-a1e8-523e-8951-53705074b330 with identifier: ZS77255 to the API
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_18aacaea13ea0d21a29e2b5934b0a8d8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:01:03Z',
 'fuel_type': 'petrol',
 'id': '2d37c4d7-a1e8-523e-8951-53705074b330',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS77255',
 'listing': 'auction',
 'location': 'DE, Elmshorn',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 15784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2883090,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_9288160e57ea2f2aa80b6d87dd0948f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2906025,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_fb3be40ad52cad141e47d53dda61a64e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2795807,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_a90126eec36a440710c1e266172c58df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2741536,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_eba717a11955ee2940fccd9ff16db668.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2758313,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_51d44d9e21466bb5f694bdf48eda56b3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2814249,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_f1bd9a341ca2b7274fe3a87d6f425bf2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2713570,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_18aacaea13ea0d21a29e2b5934b0a8d8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3015391,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_fcf2533cd3036e3e996cdfb9007f0c8d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3014484,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_8431b683f94225de2e1bb45057f3f93d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d37c4d7-a1e8-523e-8951-53705074b330/2d37c4d7-a1e8-523e-8951-53705074b330_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2820868,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/85/d885f8c9f801ada28c27ff26bb445711/pa/ZS77255_bafaed162f7082b52ae9d4c709490e4f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Picanto 1.2 Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2016}
2026-03-30 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS77255%27 HTTP/1.1" 200 None
2026-03-30 10:43:53 [auto1.de] INFO: Saving data for ZS77255: {'created_time': 1774867433.024826, 'last_price_update_time': 1774867433.024839, 'auction_closing_time': 1774969263.0}
2026-03-30 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS77255') HTTP/1.1" 204 0
2026-03-30 10:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG32992> (referer: https://www.auto1.com/v1/car-details-view/AG32992/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d056df65-f2c6-50a4-a776-c55649ef1ae0 with identifier: AG32992
2026-03-30 10:43:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d056df65-f2c6-50a4-a776-c55649ef1ae0 with scrape type 1
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d056df65-f2c6-50a4-a776-c55649ef1ae0
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb2%252Fb2b264c1aeac39c21a802f509802ef5b%252Fpa%252FAG32992_146d94aa1baa03d15c5c56e0fdf31e8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_146d94aa1baa03d15c5c56e0fdf31e8e.jpg not downloaded yet
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb2%252Fb2b264c1aeac39c21a802f509802ef5b%252Fpa%252FAG32992_cc277da58d32e82e031b7f4653798f5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_cc277da58d32e82e031b7f4653798f5e.jpg not downloaded yet
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb2%252Fb2b264c1aeac39c21a802f509802ef5b%252Fpa%252FAG32992_1ad15e732f522225ba56a2f979ba72f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_1ad15e732f522225ba56a2f979ba72f8.jpg not downloaded yet
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb2%252Fb2b264c1aeac39c21a802f509802ef5b%252Fpa%252FAG32992_2c2f075526c0d7146a0a98748f35d5f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_2c2f075526c0d7146a0a98748f35d5f4.jpg not downloaded yet
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb2%252Fb2b264c1aeac39c21a802f509802ef5b%252Fpa%252FAG32992_0543cd7078030877048034cc5117984e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_0543cd7078030877048034cc5117984e.jpg not downloaded yet
2026-03-30 10:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BX70852/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_cc277da58d32e82e031b7f4653798f5e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_146d94aa1baa03d15c5c56e0fdf31e8e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_2c2f075526c0d7146a0a98748f35d5f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_0543cd7078030877048034cc5117984e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_1ad15e732f522225ba56a2f979ba72f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef14d0>
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d056df65-f2c6-50a4-a776-c55649ef1ae0/d056df65-f2c6-50a4-a776-c55649ef1ae0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb2%252Fb2b264c1aeac39c21a802f509802ef5b%252Fpa%252FAG32992_cc277da58d32e82e031b7f4653798f5e.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_cc277da58d32e82e031b7f4653798f5e.jpg saved to cache
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d056df65-f2c6-50a4-a776-c55649ef1ae0
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3d390>
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d056df65-f2c6-50a4-a776-c55649ef1ae0/d056df65-f2c6-50a4-a776-c55649ef1ae0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb2%252Fb2b264c1aeac39c21a802f509802ef5b%252Fpa%252FAG32992_146d94aa1baa03d15c5c56e0fdf31e8e.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_146d94aa1baa03d15c5c56e0fdf31e8e.jpg saved to cache
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d056df65-f2c6-50a4-a776-c55649ef1ae0
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef774d0>
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d056df65-f2c6-50a4-a776-c55649ef1ae0/d056df65-f2c6-50a4-a776-c55649ef1ae0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb2%252Fb2b264c1aeac39c21a802f509802ef5b%252Fpa%252FAG32992_2c2f075526c0d7146a0a98748f35d5f4.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_2c2f075526c0d7146a0a98748f35d5f4.jpg saved to cache
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d056df65-f2c6-50a4-a776-c55649ef1ae0
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4217290>
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d056df65-f2c6-50a4-a776-c55649ef1ae0/d056df65-f2c6-50a4-a776-c55649ef1ae0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb2%252Fb2b264c1aeac39c21a802f509802ef5b%252Fpa%252FAG32992_0543cd7078030877048034cc5117984e.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_0543cd7078030877048034cc5117984e.jpg saved to cache
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d056df65-f2c6-50a4-a776-c55649ef1ae0
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4214490>
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d056df65-f2c6-50a4-a776-c55649ef1ae0/d056df65-f2c6-50a4-a776-c55649ef1ae0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb2%252Fb2b264c1aeac39c21a802f509802ef5b%252Fpa%252FAG32992_1ad15e732f522225ba56a2f979ba72f8.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_1ad15e732f522225ba56a2f979ba72f8.jpg saved to cache
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d056df65-f2c6-50a4-a776-c55649ef1ae0
2026-03-30 10:43:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d056df65-f2c6-50a4-a776-c55649ef1ae0, skipping ID generation
2026-03-30 10:43:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d056df65-f2c6-50a4-a776-c55649ef1ae0 with scrape type 1
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d056df65-f2c6-50a4-a776-c55649ef1ae0 sending to next pipeline
2026-03-30 10:43:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d056df65-f2c6-50a4-a776-c55649ef1ae0, identifier: AG32992
2026-03-30 10:43:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d056df65-f2c6-50a4-a776-c55649ef1ae0 with identifier: AG32992
2026-03-30 10:43:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d056df65-f2c6-50a4-a776-c55649ef1ae0 with identifier: AG32992
2026-03-30 10:43:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d056df65-f2c6-50a4-a776-c55649ef1ae0 with identifier: AG32992 to the API
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_1ad15e732f522225ba56a2f979ba72f8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 90,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 3',
 'engine': '0.8L',
 'engine_horse_power': 40,
 'expiration_date': '2026-03-31T15:18:08Z',
 'fuel_type': 'diesel',
 'id': 'd056df65-f2c6-50a4-a776-c55649ef1ae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG32992',
 'listing': 'auction',
 'location': 'DE, Friedrichsdorf',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 170774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d056df65-f2c6-50a4-a776-c55649ef1ae0/d056df65-f2c6-50a4-a776-c55649ef1ae0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_146d94aa1baa03d15c5c56e0fdf31e8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d056df65-f2c6-50a4-a776-c55649ef1ae0/d056df65-f2c6-50a4-a776-c55649ef1ae0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_cc277da58d32e82e031b7f4653798f5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d056df65-f2c6-50a4-a776-c55649ef1ae0/d056df65-f2c6-50a4-a776-c55649ef1ae0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_1ad15e732f522225ba56a2f979ba72f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d056df65-f2c6-50a4-a776-c55649ef1ae0/d056df65-f2c6-50a4-a776-c55649ef1ae0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_2c2f075526c0d7146a0a98748f35d5f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d056df65-f2c6-50a4-a776-c55649ef1ae0/d056df65-f2c6-50a4-a776-c55649ef1ae0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b2/b2b264c1aeac39c21a802f509802ef5b/pa/AG32992_0543cd7078030877048034cc5117984e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-04-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 0.8 CDI Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2004}
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG32992%27 HTTP/1.1" 200 None
2026-03-30 10:43:55 [auto1.de] INFO: Saving data for AG32992: {'created_time': 1774867435.147474, 'last_price_update_time': 1774867435.147486, 'auction_closing_time': 1774970288.0}
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG32992') HTTP/1.1" 204 0
2026-03-30 10:43:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WX33837/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL45474> (referer: https://www.auto1.com/v1/car-details-view/UL45474/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e5dab80-3d41-5c9d-a645-527d4b7e65c6 with identifier: UL45474
2026-03-30 10:43:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e5dab80-3d41-5c9d-a645-527d4b7e65c6 with scrape type 1
2026-03-30 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e5dab80-3d41-5c9d-a645-527d4b7e65c6
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fa4%252Fcda4d43ffed3d516d6afc5ef240c6bf6%252Fpa%252FUL45474_d4729da7023f017bf2b67331aab92e47.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_d4729da7023f017bf2b67331aab92e47.jpg already downloaded
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fa4%252Fcda4d43ffed3d516d6afc5ef240c6bf6%252Fpa%252FUL45474_4cff89b609fc4387326ee87c65ae2820.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_4cff89b609fc4387326ee87c65ae2820.jpg already downloaded
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fa4%252Fcda4d43ffed3d516d6afc5ef240c6bf6%252Fpa%252FUL45474_b4cd9898ef527118bbc1feaa7cacf1b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_b4cd9898ef527118bbc1feaa7cacf1b6.jpg already downloaded
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fa4%252Fcda4d43ffed3d516d6afc5ef240c6bf6%252Fpa%252FUL45474_d39dbd08e9696c6452126b281c446895.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_d39dbd08e9696c6452126b281c446895.jpg already downloaded
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fa4%252Fcda4d43ffed3d516d6afc5ef240c6bf6%252Fpa%252FUL45474_51d2bccc9920a30d2b356aed19489dd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_51d2bccc9920a30d2b356aed19489dd4.jpg already downloaded
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fa4%252Fcda4d43ffed3d516d6afc5ef240c6bf6%252Fpa%252FUL45474_b8ccea2549d5b6030669746f37b9ff84.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_b8ccea2549d5b6030669746f37b9ff84.jpg already downloaded
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fa4%252Fcda4d43ffed3d516d6afc5ef240c6bf6%252Fpa%252FUL45474_8b31cded2604bbea2c9fb6d1b61d765f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_8b31cded2604bbea2c9fb6d1b61d765f.jpg already downloaded
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fa4%252Fcda4d43ffed3d516d6afc5ef240c6bf6%252Fpa%252FUL45474_afec58932fce5d571762c11a0f3cb6c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_afec58932fce5d571762c11a0f3cb6c4.jpg already downloaded
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fa4%252Fcda4d43ffed3d516d6afc5ef240c6bf6%252Fpa%252FUL45474_dc8bc14f39e13d748218a7369294b650.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_dc8bc14f39e13d748218a7369294b650.jpg already downloaded
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fa4%252Fcda4d43ffed3d516d6afc5ef240c6bf6%252Fpa%252FUL45474_8dce2c5e48521d7f4e146e414e369a18.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_8dce2c5e48521d7f4e146e414e369a18.jpg already downloaded
2026-03-30 10:43:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e5dab80-3d41-5c9d-a645-527d4b7e65c6, identifier: UL45474
2026-03-30 10:43:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e5dab80-3d41-5c9d-a645-527d4b7e65c6 with identifier: UL45474
2026-03-30 10:43:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e5dab80-3d41-5c9d-a645-527d4b7e65c6 with identifier: UL45474
2026-03-30 10:43:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e5dab80-3d41-5c9d-a645-527d4b7e65c6 with identifier: UL45474 to the API
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UL45474>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:16:21Z',
 'fuel_type': 'diesel',
 'id': '2e5dab80-3d41-5c9d-a645-527d4b7e65c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL45474',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 211423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_d4729da7023f017bf2b67331aab92e47.jpg',
                'https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_4cff89b609fc4387326ee87c65ae2820.jpg',
                'https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_b4cd9898ef527118bbc1feaa7cacf1b6.jpg',
                'https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_d39dbd08e9696c6452126b281c446895.jpg',
                'https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_51d2bccc9920a30d2b356aed19489dd4.jpg',
                'https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_b8ccea2549d5b6030669746f37b9ff84.jpg',
                'https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_8b31cded2604bbea2c9fb6d1b61d765f.jpg',
                'https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_afec58932fce5d571762c11a0f3cb6c4.jpg',
                'https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_dc8bc14f39e13d748218a7369294b650.jpg',
                'https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_8dce2c5e48521d7f4e146e414e369a18.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e5dab80-3d41-5c9d-a645-527d4b7e65c6/2e5dab80-3d41-5c9d-a645-527d4b7e65c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3005321,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_d4729da7023f017bf2b67331aab92e47.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e5dab80-3d41-5c9d-a645-527d4b7e65c6/2e5dab80-3d41-5c9d-a645-527d4b7e65c6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_4cff89b609fc4387326ee87c65ae2820.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e5dab80-3d41-5c9d-a645-527d4b7e65c6/2e5dab80-3d41-5c9d-a645-527d4b7e65c6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_b4cd9898ef527118bbc1feaa7cacf1b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e5dab80-3d41-5c9d-a645-527d4b7e65c6/2e5dab80-3d41-5c9d-a645-527d4b7e65c6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_d39dbd08e9696c6452126b281c446895.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e5dab80-3d41-5c9d-a645-527d4b7e65c6/2e5dab80-3d41-5c9d-a645-527d4b7e65c6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_51d2bccc9920a30d2b356aed19489dd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e5dab80-3d41-5c9d-a645-527d4b7e65c6/2e5dab80-3d41-5c9d-a645-527d4b7e65c6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2977837,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_b8ccea2549d5b6030669746f37b9ff84.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e5dab80-3d41-5c9d-a645-527d4b7e65c6/2e5dab80-3d41-5c9d-a645-527d4b7e65c6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_8b31cded2604bbea2c9fb6d1b61d765f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e5dab80-3d41-5c9d-a645-527d4b7e65c6/2e5dab80-3d41-5c9d-a645-527d4b7e65c6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_afec58932fce5d571762c11a0f3cb6c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e5dab80-3d41-5c9d-a645-527d4b7e65c6/2e5dab80-3d41-5c9d-a645-527d4b7e65c6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_dc8bc14f39e13d748218a7369294b650.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e5dab80-3d41-5c9d-a645-527d4b7e65c6/2e5dab80-3d41-5c9d-a645-527d4b7e65c6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/a4/cda4d43ffed3d516d6afc5ef240c6bf6/pa/UL45474_8dce2c5e48521d7f4e146e414e369a18.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-20',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL45474%27 HTTP/1.1" 200 None
2026-03-30 10:43:56 [auto1.de] INFO: Saving data for UL45474: {'created_time': 1774867436.952281, 'last_price_update_time': 1774867436.952294, 'auction_closing_time': 1774970181.0}
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL45474') HTTP/1.1" 204 0
2026-03-30 10:43:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AS73684> (referer: https://www.auto1.com/v1/car-details-view/AS73684/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GD36991> (referer: https://www.auto1.com/v1/car-details-view/GD36991/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF66514/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78a4d919-433a-580b-a64f-92d24330bd15 with identifier: AS73684
2026-03-30 10:43:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78a4d919-433a-580b-a64f-92d24330bd15 with scrape type 1
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78a4d919-433a-580b-a64f-92d24330bd15
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F49%252F6c49f61e488f15260b404f9490e76272%252Fpa%252FAS73684_361ba55d348a55cd35fc811d3cdfce20.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_361ba55d348a55cd35fc811d3cdfce20.jpg already downloaded
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F49%252F6c49f61e488f15260b404f9490e76272%252Fpa%252FAS73684_621570a7d706089e0ce4dbe975f65c0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_621570a7d706089e0ce4dbe975f65c0c.jpg already downloaded
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F49%252F6c49f61e488f15260b404f9490e76272%252Fpa%252FAS73684_5040f7578b72d35e7b0f690061f4d2e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_5040f7578b72d35e7b0f690061f4d2e6.jpg already downloaded
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F49%252F6c49f61e488f15260b404f9490e76272%252Fpa%252FAS73684_17488853e1d152b3fa7968485b374837.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_17488853e1d152b3fa7968485b374837.jpg already downloaded
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F49%252F6c49f61e488f15260b404f9490e76272%252Fpa%252FAS73684_5a4718591cc0832a1092f11657daf645.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_5a4718591cc0832a1092f11657daf645.jpg already downloaded
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F49%252F6c49f61e488f15260b404f9490e76272%252Fpa%252FAS73684_183a27f4619e5b7342e5ea227c980593.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_183a27f4619e5b7342e5ea227c980593.jpg already downloaded
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F49%252F6c49f61e488f15260b404f9490e76272%252Fpa%252FAS73684_dea5d1ddee0c4d8d9750aef6f4caec43.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_dea5d1ddee0c4d8d9750aef6f4caec43.jpg already downloaded
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F49%252F6c49f61e488f15260b404f9490e76272%252Fpa%252FAS73684_572ccadb33db6143cb0ffa2a33a07a06.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_572ccadb33db6143cb0ffa2a33a07a06.jpg already downloaded
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F49%252F6c49f61e488f15260b404f9490e76272%252Fpa%252FAS73684_9d48bff626045f53f918252b1b36ab8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_9d48bff626045f53f918252b1b36ab8a.jpg already downloaded
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F49%252F6c49f61e488f15260b404f9490e76272%252Fpa%252FAS73684_d5c957c9dc61ef28ec2a4ae196a12ae5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_d5c957c9dc61ef28ec2a4ae196a12ae5.jpg already downloaded
2026-03-30 10:43:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78a4d919-433a-580b-a64f-92d24330bd15, identifier: AS73684
2026-03-30 10:43:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 489c2d56-68cb-5421-8364-249466ad578f with identifier: GD36991
2026-03-30 10:43:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 489c2d56-68cb-5421-8364-249466ad578f with scrape type 1
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 489c2d56-68cb-5421-8364-249466ad578f
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd8%252Fadd81bef4e14f3449658cab1bf45d364%252Fpa%252FGD36991_c9665f34f196f0a2f4a6853d04b84f6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_c9665f34f196f0a2f4a6853d04b84f6d.jpg already downloaded
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd8%252Fadd81bef4e14f3449658cab1bf45d364%252Fpa%252FGD36991_66e75412b02dd19d6c46cb90835458fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_66e75412b02dd19d6c46cb90835458fa.jpg already downloaded
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd8%252Fadd81bef4e14f3449658cab1bf45d364%252Fpa%252FGD36991_36da8980c670008c7e294b0b747bd99c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_36da8980c670008c7e294b0b747bd99c.jpg already downloaded
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd8%252Fadd81bef4e14f3449658cab1bf45d364%252Fpa%252FGD36991_f1147edbcceada5cb29b04ebb07b417a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_f1147edbcceada5cb29b04ebb07b417a.jpg already downloaded
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd8%252Fadd81bef4e14f3449658cab1bf45d364%252Fpa%252FGD36991_2918f520e07d363ac942c0b62e1a1884.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_2918f520e07d363ac942c0b62e1a1884.jpg already downloaded
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd8%252Fadd81bef4e14f3449658cab1bf45d364%252Fpa%252FGD36991_897fd0efba4542dcdcf194c329a09c46.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_897fd0efba4542dcdcf194c329a09c46.jpg already downloaded
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd8%252Fadd81bef4e14f3449658cab1bf45d364%252Fpa%252FGD36991_b4ed2b091105f9c619b1a3079d158519.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_b4ed2b091105f9c619b1a3079d158519.jpg already downloaded
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd8%252Fadd81bef4e14f3449658cab1bf45d364%252Fpa%252FGD36991_40e606a50df52d5220d868186f7d51c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_40e606a50df52d5220d868186f7d51c0.jpg already downloaded
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd8%252Fadd81bef4e14f3449658cab1bf45d364%252Fpa%252FGD36991_36544854672abfbca9e17cd2b0c6f911.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_36544854672abfbca9e17cd2b0c6f911.jpg already downloaded
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd8%252Fadd81bef4e14f3449658cab1bf45d364%252Fpa%252FGD36991_948f7f99d64024ebfe5e0c66ee75f3bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_948f7f99d64024ebfe5e0c66ee75f3bc.jpg already downloaded
2026-03-30 10:43:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 489c2d56-68cb-5421-8364-249466ad578f, identifier: GD36991
2026-03-30 10:43:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78a4d919-433a-580b-a64f-92d24330bd15 with identifier: AS73684
2026-03-30 10:43:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78a4d919-433a-580b-a64f-92d24330bd15 with identifier: AS73684
2026-03-30 10:43:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78a4d919-433a-580b-a64f-92d24330bd15 with identifier: AS73684 to the API
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AS73684>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:45:14Z',
 'fuel_type': 'diesel',
 'id': '78a4d919-433a-580b-a64f-92d24330bd15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS73684',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 153910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_361ba55d348a55cd35fc811d3cdfce20.jpg',
                'https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_621570a7d706089e0ce4dbe975f65c0c.jpg',
                'https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_5040f7578b72d35e7b0f690061f4d2e6.jpg',
                'https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_17488853e1d152b3fa7968485b374837.jpg',
                'https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_5a4718591cc0832a1092f11657daf645.jpg',
                'https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_183a27f4619e5b7342e5ea227c980593.jpg',
                'https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_dea5d1ddee0c4d8d9750aef6f4caec43.jpg',
                'https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_572ccadb33db6143cb0ffa2a33a07a06.jpg',
                'https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_9d48bff626045f53f918252b1b36ab8a.jpg',
                'https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_d5c957c9dc61ef28ec2a4ae196a12ae5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78a4d919-433a-580b-a64f-92d24330bd15/78a4d919-433a-580b-a64f-92d24330bd15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_361ba55d348a55cd35fc811d3cdfce20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78a4d919-433a-580b-a64f-92d24330bd15/78a4d919-433a-580b-a64f-92d24330bd15_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_621570a7d706089e0ce4dbe975f65c0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78a4d919-433a-580b-a64f-92d24330bd15/78a4d919-433a-580b-a64f-92d24330bd15_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_5040f7578b72d35e7b0f690061f4d2e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78a4d919-433a-580b-a64f-92d24330bd15/78a4d919-433a-580b-a64f-92d24330bd15_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_17488853e1d152b3fa7968485b374837.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78a4d919-433a-580b-a64f-92d24330bd15/78a4d919-433a-580b-a64f-92d24330bd15_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_5a4718591cc0832a1092f11657daf645.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78a4d919-433a-580b-a64f-92d24330bd15/78a4d919-433a-580b-a64f-92d24330bd15_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_183a27f4619e5b7342e5ea227c980593.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78a4d919-433a-580b-a64f-92d24330bd15/78a4d919-433a-580b-a64f-92d24330bd15_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_dea5d1ddee0c4d8d9750aef6f4caec43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78a4d919-433a-580b-a64f-92d24330bd15/78a4d919-433a-580b-a64f-92d24330bd15_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_572ccadb33db6143cb0ffa2a33a07a06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78a4d919-433a-580b-a64f-92d24330bd15/78a4d919-433a-580b-a64f-92d24330bd15_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_9d48bff626045f53f918252b1b36ab8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78a4d919-433a-580b-a64f-92d24330bd15/78a4d919-433a-580b-a64f-92d24330bd15_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/49/6c49f61e488f15260b404f9490e76272/pa/AS73684_d5c957c9dc61ef28ec2a4ae196a12ae5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS73684%27 HTTP/1.1" 200 None
2026-03-30 10:43:58 [auto1.de] INFO: Saving data for AS73684: {'created_time': 1774867438.062678, 'last_price_update_time': 1774867438.062694, 'auction_closing_time': 1774971914.0}
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS73684') HTTP/1.1" 204 0
2026-03-30 10:43:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 489c2d56-68cb-5421-8364-249466ad578f with identifier: GD36991
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 10:43:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:43:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 489c2d56-68cb-5421-8364-249466ad578f with identifier: GD36991
2026-03-30 10:43:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 489c2d56-68cb-5421-8364-249466ad578f with identifier: GD36991 to the API
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GD36991>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:08:39Z',
 'fuel_type': 'petrol',
 'id': '489c2d56-68cb-5421-8364-249466ad578f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD36991',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 53272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_c9665f34f196f0a2f4a6853d04b84f6d.jpg',
                'https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_66e75412b02dd19d6c46cb90835458fa.jpg',
                'https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_36da8980c670008c7e294b0b747bd99c.jpg',
                'https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_f1147edbcceada5cb29b04ebb07b417a.jpg',
                'https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_2918f520e07d363ac942c0b62e1a1884.jpg',
                'https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_897fd0efba4542dcdcf194c329a09c46.jpg',
                'https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_b4ed2b091105f9c619b1a3079d158519.jpg',
                'https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_40e606a50df52d5220d868186f7d51c0.jpg',
                'https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_36544854672abfbca9e17cd2b0c6f911.jpg',
                'https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_948f7f99d64024ebfe5e0c66ee75f3bc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c2d56-68cb-5421-8364-249466ad578f/489c2d56-68cb-5421-8364-249466ad578f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2275383,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_c9665f34f196f0a2f4a6853d04b84f6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c2d56-68cb-5421-8364-249466ad578f/489c2d56-68cb-5421-8364-249466ad578f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2295330,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_66e75412b02dd19d6c46cb90835458fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c2d56-68cb-5421-8364-249466ad578f/489c2d56-68cb-5421-8364-249466ad578f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2286029,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_36da8980c670008c7e294b0b747bd99c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c2d56-68cb-5421-8364-249466ad578f/489c2d56-68cb-5421-8364-249466ad578f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2118496,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_f1147edbcceada5cb29b04ebb07b417a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c2d56-68cb-5421-8364-249466ad578f/489c2d56-68cb-5421-8364-249466ad578f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2318390,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_2918f520e07d363ac942c0b62e1a1884.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c2d56-68cb-5421-8364-249466ad578f/489c2d56-68cb-5421-8364-249466ad578f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2298156,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_897fd0efba4542dcdcf194c329a09c46.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c2d56-68cb-5421-8364-249466ad578f/489c2d56-68cb-5421-8364-249466ad578f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2273940,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_b4ed2b091105f9c619b1a3079d158519.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c2d56-68cb-5421-8364-249466ad578f/489c2d56-68cb-5421-8364-249466ad578f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2126752,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_40e606a50df52d5220d868186f7d51c0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c2d56-68cb-5421-8364-249466ad578f/489c2d56-68cb-5421-8364-249466ad578f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2356502,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_36544854672abfbca9e17cd2b0c6f911.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c2d56-68cb-5421-8364-249466ad578f/489c2d56-68cb-5421-8364-249466ad578f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2469774,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d8/add81bef4e14f3449658cab1bf45d364/pa/GD36991_948f7f99d64024ebfe5e0c66ee75f3bc.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2013}
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD36991%27 HTTP/1.1" 200 None
2026-03-30 10:43:58 [auto1.de] INFO: Saving data for GD36991: {'created_time': 1774867438.556873, 'last_price_update_time': 1774867438.556884, 'auction_closing_time': 1774969719.0}
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD36991') HTTP/1.1" 204 0
2026-03-30 10:43:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM60003/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BX70852> (referer: https://www.auto1.com/v1/car-details-view/BX70852/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WX33837> (referer: https://www.auto1.com/v1/car-details-view/WX33837/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02747ab2-abf0-5044-b672-7988c1105127 with identifier: BX70852
2026-03-30 10:43:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02747ab2-abf0-5044-b672-7988c1105127 with scrape type 1
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 02747ab2-abf0-5044-b672-7988c1105127
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F57%252F915755cbca7a3115d2447c60d0cb928d%252Fpa%252FBX70852_418dca8a990317e293aec9ac50d81f96.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/57/915755cbca7a3115d2447c60d0cb928d/pa/BX70852_418dca8a990317e293aec9ac50d81f96.jpg already downloaded
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F57%252F915755cbca7a3115d2447c60d0cb928d%252Fpa%252FBX70852_e80ccda9c6ac12f42d9711061fad73df.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/57/915755cbca7a3115d2447c60d0cb928d/pa/BX70852_e80ccda9c6ac12f42d9711061fad73df.jpg already downloaded
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F57%252F915755cbca7a3115d2447c60d0cb928d%252Fpa%252FBX70852_32401e3d73ea2b0c15ff4bb269cac677.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/57/915755cbca7a3115d2447c60d0cb928d/pa/BX70852_32401e3d73ea2b0c15ff4bb269cac677.jpg already downloaded
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F57%252F915755cbca7a3115d2447c60d0cb928d%252Fpa%252FBX70852_df7c363cc888f6f69287ae6b24d0a607.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/57/915755cbca7a3115d2447c60d0cb928d/pa/BX70852_df7c363cc888f6f69287ae6b24d0a607.jpg already downloaded
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F57%252F915755cbca7a3115d2447c60d0cb928d%252Fpa%252FBX70852_4b108e16a2c6eba19f9ca10c6f2d2d79.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/57/915755cbca7a3115d2447c60d0cb928d/pa/BX70852_4b108e16a2c6eba19f9ca10c6f2d2d79.jpg already downloaded
2026-03-30 10:43:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02747ab2-abf0-5044-b672-7988c1105127, identifier: BX70852
2026-03-30 10:43:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02747ab2-abf0-5044-b672-7988c1105127 with identifier: BX70852
2026-03-30 10:43:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02747ab2-abf0-5044-b672-7988c1105127 with identifier: BX70852
2026-03-30 10:43:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02747ab2-abf0-5044-b672-7988c1105127 with identifier: BX70852 to the API
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BX70852>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:20:37Z',
 'fuel_type': 'diesel',
 'id': '02747ab2-abf0-5044-b672-7988c1105127',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX70852',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Subaru',
 'model': 'Outback',
 'odometer': 260762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img91/57/915755cbca7a3115d2447c60d0cb928d/pa/BX70852_418dca8a990317e293aec9ac50d81f96.jpg',
                'https://img-pa.auto1.com/img91/57/915755cbca7a3115d2447c60d0cb928d/pa/BX70852_e80ccda9c6ac12f42d9711061fad73df.jpg',
                'https://img-pa.auto1.com/img91/57/915755cbca7a3115d2447c60d0cb928d/pa/BX70852_32401e3d73ea2b0c15ff4bb269cac677.jpg',
                'https://img-pa.auto1.com/img91/57/915755cbca7a3115d2447c60d0cb928d/pa/BX70852_df7c363cc888f6f69287ae6b24d0a607.jpg',
                'https://img-pa.auto1.com/img91/57/915755cbca7a3115d2447c60d0cb928d/pa/BX70852_4b108e16a2c6eba19f9ca10c6f2d2d79.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02747ab2-abf0-5044-b672-7988c1105127/02747ab2-abf0-5044-b672-7988c1105127_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/57/915755cbca7a3115d2447c60d0cb928d/pa/BX70852_418dca8a990317e293aec9ac50d81f96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02747ab2-abf0-5044-b672-7988c1105127/02747ab2-abf0-5044-b672-7988c1105127_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/57/915755cbca7a3115d2447c60d0cb928d/pa/BX70852_e80ccda9c6ac12f42d9711061fad73df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02747ab2-abf0-5044-b672-7988c1105127/02747ab2-abf0-5044-b672-7988c1105127_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/57/915755cbca7a3115d2447c60d0cb928d/pa/BX70852_32401e3d73ea2b0c15ff4bb269cac677.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02747ab2-abf0-5044-b672-7988c1105127/02747ab2-abf0-5044-b672-7988c1105127_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/57/915755cbca7a3115d2447c60d0cb928d/pa/BX70852_df7c363cc888f6f69287ae6b24d0a607.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02747ab2-abf0-5044-b672-7988c1105127/02747ab2-abf0-5044-b672-7988c1105127_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/57/915755cbca7a3115d2447c60d0cb928d/pa/BX70852_4b108e16a2c6eba19f9ca10c6f2d2d79.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Subaru Outback 2.0 Diesel Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2014}
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX70852%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [auto1.de] INFO: Saving data for BX70852: {'created_time': 1774867440.167217, 'last_price_update_time': 1774867440.167228, 'auction_closing_time': 1774970437.0}
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX70852') HTTP/1.1" 204 0
2026-03-30 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM60003> (referer: https://www.auto1.com/v1/car-details-view/JM60003/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e51b0fc1-cb69-5d6c-a916-c18328567988 with identifier: WX33837
2026-03-30 10:44:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e51b0fc1-cb69-5d6c-a916-c18328567988 with scrape type 1
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e51b0fc1-cb69-5d6c-a916-c18328567988
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F71%252Fed71b61e5d2f625a24c9fd6f670079a0%252Fpa%252FWX33837_a88940c0b1b2c95a68e8639eade64d36.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_a88940c0b1b2c95a68e8639eade64d36.jpg not downloaded yet
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F71%252Fed71b61e5d2f625a24c9fd6f670079a0%252Fpa%252FWX33837_10b14959a72c811725b8426fb1965fc8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_10b14959a72c811725b8426fb1965fc8.jpg not downloaded yet
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F71%252Fed71b61e5d2f625a24c9fd6f670079a0%252Fpa%252FWX33837_7aa5043378b913ae9750208f613d649b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_7aa5043378b913ae9750208f613d649b.jpg not downloaded yet
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F71%252Fed71b61e5d2f625a24c9fd6f670079a0%252Fpa%252FWX33837_97e9536aa175ad67911bca3f01edc4b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_97e9536aa175ad67911bca3f01edc4b7.jpg not downloaded yet
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F71%252Fed71b61e5d2f625a24c9fd6f670079a0%252Fpa%252FWX33837_7d7339f8b1d585d068be78281bd66b12.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_7d7339f8b1d585d068be78281bd66b12.jpg not downloaded yet
2026-03-30 10:44:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fce93e6a-d313-5dd4-841b-b0b68303a85a with identifier: JM60003
2026-03-30 10:44:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fce93e6a-d313-5dd4-841b-b0b68303a85a with scrape type 1
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fce93e6a-d313-5dd4-841b-b0b68303a85a
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_0c8a120b48b705a3b5311bd3fd7b30c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_0c8a120b48b705a3b5311bd3fd7b30c0.jpg not downloaded yet
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_f4c6b0d7eb3ccab3b81163f9f4e2c1a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_f4c6b0d7eb3ccab3b81163f9f4e2c1a4.jpg not downloaded yet
2026-03-30 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_10b14959a72c811725b8426fb1965fc8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_a88940c0b1b2c95a68e8639eade64d36.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_2341cce41f7b6bdad6db84bcba4f36d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_2341cce41f7b6bdad6db84bcba4f36d7.jpg not downloaded yet
2026-03-30 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_7aa5043378b913ae9750208f613d649b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_8cb678ae5fe8771fb6b0ec88e061ecf5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_8cb678ae5fe8771fb6b0ec88e061ecf5.jpg not downloaded yet
2026-03-30 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_97e9536aa175ad67911bca3f01edc4b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_321174f055b9d15564f6f5a5af3d6f3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_321174f055b9d15564f6f5a5af3d6f3a.jpg not downloaded yet
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_dfab3a2a5fe3ce5e8f0262a9b6e50cc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_dfab3a2a5fe3ce5e8f0262a9b6e50cc1.jpg not downloaded yet
2026-03-30 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_7d7339f8b1d585d068be78281bd66b12.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_f4c6b0d7eb3ccab3b81163f9f4e2c1a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_c6b3341bf5cd141d1cb1796facc81cd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_c6b3341bf5cd141d1cb1796facc81cd8.jpg not downloaded yet
2026-03-30 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_8cb678ae5fe8771fb6b0ec88e061ecf5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_3722d65598cc856cd4449a7b0d6f5c34.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_3722d65598cc856cd4449a7b0d6f5c34.jpg not downloaded yet
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_a6eb35d2fa1b0889cc7a0ee5dab44981.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_a6eb35d2fa1b0889cc7a0ee5dab44981.jpg not downloaded yet
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419ab90>
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e51b0fc1-cb69-5d6c-a916-c18328567988/e51b0fc1-cb69-5d6c-a916-c18328567988_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F71%252Fed71b61e5d2f625a24c9fd6f670079a0%252Fpa%252FWX33837_10b14959a72c811725b8426fb1965fc8.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_10b14959a72c811725b8426fb1965fc8.jpg saved to cache
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e51b0fc1-cb69-5d6c-a916-c18328567988
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee87dd0>
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e51b0fc1-cb69-5d6c-a916-c18328567988/e51b0fc1-cb69-5d6c-a916-c18328567988_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F71%252Fed71b61e5d2f625a24c9fd6f670079a0%252Fpa%252FWX33837_a88940c0b1b2c95a68e8639eade64d36.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_a88940c0b1b2c95a68e8639eade64d36.jpg saved to cache
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e51b0fc1-cb69-5d6c-a916-c18328567988
2026-03-30 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_2341cce41f7b6bdad6db84bcba4f36d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_321174f055b9d15564f6f5a5af3d6f3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_dfab3a2a5fe3ce5e8f0262a9b6e50cc1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_4bdf0b5d35a289c92ad275b210447b99.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_4bdf0b5d35a289c92ad275b210447b99.jpg not downloaded yet
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f432ae90>
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e51b0fc1-cb69-5d6c-a916-c18328567988/e51b0fc1-cb69-5d6c-a916-c18328567988_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F71%252Fed71b61e5d2f625a24c9fd6f670079a0%252Fpa%252FWX33837_7aa5043378b913ae9750208f613d649b.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_7aa5043378b913ae9750208f613d649b.jpg saved to cache
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e51b0fc1-cb69-5d6c-a916-c18328567988
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefa52d0>
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e51b0fc1-cb69-5d6c-a916-c18328567988/e51b0fc1-cb69-5d6c-a916-c18328567988_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F71%252Fed71b61e5d2f625a24c9fd6f670079a0%252Fpa%252FWX33837_97e9536aa175ad67911bca3f01edc4b7.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_97e9536aa175ad67911bca3f01edc4b7.jpg saved to cache
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e51b0fc1-cb69-5d6c-a916-c18328567988
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4419d0>
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e51b0fc1-cb69-5d6c-a916-c18328567988/e51b0fc1-cb69-5d6c-a916-c18328567988_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F71%252Fed71b61e5d2f625a24c9fd6f670079a0%252Fpa%252FWX33837_7d7339f8b1d585d068be78281bd66b12.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_7d7339f8b1d585d068be78281bd66b12.jpg saved to cache
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e51b0fc1-cb69-5d6c-a916-c18328567988
2026-03-30 10:44:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e51b0fc1-cb69-5d6c-a916-c18328567988, skipping ID generation
2026-03-30 10:44:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e51b0fc1-cb69-5d6c-a916-c18328567988 with scrape type 1
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e51b0fc1-cb69-5d6c-a916-c18328567988 sending to next pipeline
2026-03-30 10:44:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e51b0fc1-cb69-5d6c-a916-c18328567988, identifier: WX33837
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeed1010>
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_f4c6b0d7eb3ccab3b81163f9f4e2c1a4.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_f4c6b0d7eb3ccab3b81163f9f4e2c1a4.jpg saved to cache
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fce93e6a-d313-5dd4-841b-b0b68303a85a
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee401010>
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_8cb678ae5fe8771fb6b0ec88e061ecf5.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_8cb678ae5fe8771fb6b0ec88e061ecf5.jpg saved to cache
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fce93e6a-d313-5dd4-841b-b0b68303a85a
2026-03-30 10:44:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e51b0fc1-cb69-5d6c-a916-c18328567988 with identifier: WX33837
2026-03-30 10:44:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e51b0fc1-cb69-5d6c-a916-c18328567988 with identifier: WX33837
2026-03-30 10:44:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e51b0fc1-cb69-5d6c-a916-c18328567988 with identifier: WX33837 to the API
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_7d7339f8b1d585d068be78281bd66b12.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:20:50Z',
 'fuel_type': 'petrol',
 'id': 'e51b0fc1-cb69-5d6c-a916-c18328567988',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX33837',
 'listing': 'auction',
 'location': 'DE, Regensburg',
 'make': 'BMW',
 'model': '3er',
 'odometer': 180776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e51b0fc1-cb69-5d6c-a916-c18328567988/e51b0fc1-cb69-5d6c-a916-c18328567988_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_a88940c0b1b2c95a68e8639eade64d36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e51b0fc1-cb69-5d6c-a916-c18328567988/e51b0fc1-cb69-5d6c-a916-c18328567988_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_10b14959a72c811725b8426fb1965fc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e51b0fc1-cb69-5d6c-a916-c18328567988/e51b0fc1-cb69-5d6c-a916-c18328567988_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_7aa5043378b913ae9750208f613d649b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e51b0fc1-cb69-5d6c-a916-c18328567988/e51b0fc1-cb69-5d6c-a916-c18328567988_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_97e9536aa175ad67911bca3f01edc4b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e51b0fc1-cb69-5d6c-a916-c18328567988/e51b0fc1-cb69-5d6c-a916-c18328567988_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/71/ed71b61e5d2f625a24c9fd6f670079a0/pa/WX33837_7d7339f8b1d585d068be78281bd66b12.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 316ti',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX33837%27 HTTP/1.1" 200 None
2026-03-30 10:44:01 [auto1.de] INFO: Saving data for WX33837: {'created_time': 1774867441.427905, 'last_price_update_time': 1774867441.427918, 'auction_closing_time': 1774970450.0}
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX33837') HTTP/1.1" 204 0
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefeb390>
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_2341cce41f7b6bdad6db84bcba4f36d7.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_2341cce41f7b6bdad6db84bcba4f36d7.jpg saved to cache
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fce93e6a-d313-5dd4-841b-b0b68303a85a
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee12210>
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_321174f055b9d15564f6f5a5af3d6f3a.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_321174f055b9d15564f6f5a5af3d6f3a.jpg saved to cache
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fce93e6a-d313-5dd4-841b-b0b68303a85a
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41c7a50>
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_dfab3a2a5fe3ce5e8f0262a9b6e50cc1.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_dfab3a2a5fe3ce5e8f0262a9b6e50cc1.jpg saved to cache
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fce93e6a-d313-5dd4-841b-b0b68303a85a
2026-03-30 10:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_a6eb35d2fa1b0889cc7a0ee5dab44981.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_4bdf0b5d35a289c92ad275b210447b99.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FF66514> (referer: https://www.auto1.com/v1/car-details-view/FF66514/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_3722d65598cc856cd4449a7b0d6f5c34.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_c6b3341bf5cd141d1cb1796facc81cd8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f425b390>
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_a6eb35d2fa1b0889cc7a0ee5dab44981.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_a6eb35d2fa1b0889cc7a0ee5dab44981.jpg saved to cache
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fce93e6a-d313-5dd4-841b-b0b68303a85a
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee493450>
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_4bdf0b5d35a289c92ad275b210447b99.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_4bdf0b5d35a289c92ad275b210447b99.jpg saved to cache
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fce93e6a-d313-5dd4-841b-b0b68303a85a
2026-03-30 10:44:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f29d057-8e9d-5a62-b8f2-31f05d050782 with identifier: FF66514
2026-03-30 10:44:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f29d057-8e9d-5a62-b8f2-31f05d050782 with scrape type 1
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f29d057-8e9d-5a62-b8f2-31f05d050782
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_f66afb3c8e8bf8da49efc627818e4b0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_f66afb3c8e8bf8da49efc627818e4b0c.jpg not downloaded yet
2026-03-30 10:44:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 10:44:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 10:44:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 10:44:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 10:44:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419bcd0>
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_3722d65598cc856cd4449a7b0d6f5c34.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_3722d65598cc856cd4449a7b0d6f5c34.jpg saved to cache
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fce93e6a-d313-5dd4-841b-b0b68303a85a
2026-03-30 10:44:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 10:44:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 10:44:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 10:44:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 10:44:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f416f810>
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_c6b3341bf5cd141d1cb1796facc81cd8.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_c6b3341bf5cd141d1cb1796facc81cd8.jpg saved to cache
2026-03-30 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fce93e6a-d313-5dd4-841b-b0b68303a85a
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_f8a7838b0345a07c28b4ece654c64e52.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_f8a7838b0345a07c28b4ece654c64e52.jpg not downloaded yet
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_bf73788e6ab7170056d4591e2f880e0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_bf73788e6ab7170056d4591e2f880e0e.jpg not downloaded yet
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_f29bdb6c1db5bc96cdf605eac3e1bc3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_f29bdb6c1db5bc96cdf605eac3e1bc3c.jpg not downloaded yet
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_2ea8d3f7b8338e18251471a202ba4e0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_2ea8d3f7b8338e18251471a202ba4e0c.jpg not downloaded yet
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_0056631f3468624aa99266b5f394a24b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_0056631f3468624aa99266b5f394a24b.jpg not downloaded yet
2026-03-30 10:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_f66afb3c8e8bf8da49efc627818e4b0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_9bb308ac4b3a457ffb392477cc687add.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_9bb308ac4b3a457ffb392477cc687add.jpg not downloaded yet
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_4063d90720e33a1684ec34ae0a5e8f32.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_4063d90720e33a1684ec34ae0a5e8f32.jpg not downloaded yet
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_261698525b3551e456096361324e279f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_261698525b3551e456096361324e279f.jpg not downloaded yet
2026-03-30 10:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_bf73788e6ab7170056d4591e2f880e0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_f29ab485abb9f6ab2d1cbfeae25b4b7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_f29ab485abb9f6ab2d1cbfeae25b4b7a.jpg not downloaded yet
2026-03-30 10:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_0c8a120b48b705a3b5311bd3fd7b30c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3a990>
2026-03-30 10:44:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_f66afb3c8e8bf8da49efc627818e4b0c.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_f66afb3c8e8bf8da49efc627818e4b0c.jpg saved to cache
2026-03-30 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f29d057-8e9d-5a62-b8f2-31f05d050782
2026-03-30 10:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_f8a7838b0345a07c28b4ece654c64e52.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb3090>
2026-03-30 10:44:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_bf73788e6ab7170056d4591e2f880e0e.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_bf73788e6ab7170056d4591e2f880e0e.jpg saved to cache
2026-03-30 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f29d057-8e9d-5a62-b8f2-31f05d050782
2026-03-30 10:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_9bb308ac4b3a457ffb392477cc687add.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_f29ab485abb9f6ab2d1cbfeae25b4b7a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_261698525b3551e456096361324e279f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_2ea8d3f7b8338e18251471a202ba4e0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_f29bdb6c1db5bc96cdf605eac3e1bc3c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_4063d90720e33a1684ec34ae0a5e8f32.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_0056631f3468624aa99266b5f394a24b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 10:44:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 10:44:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 10:44:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 10:44:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 10:44:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f416f850>
2026-03-30 10:44:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F87%252F4b876470cd43ad1e83e611623803a504%252Fpa%252FJM60003_0c8a120b48b705a3b5311bd3fd7b30c0.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_0c8a120b48b705a3b5311bd3fd7b30c0.jpg saved to cache
2026-03-30 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fce93e6a-d313-5dd4-841b-b0b68303a85a
2026-03-30 10:44:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fce93e6a-d313-5dd4-841b-b0b68303a85a, skipping ID generation
2026-03-30 10:44:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fce93e6a-d313-5dd4-841b-b0b68303a85a with scrape type 1
2026-03-30 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fce93e6a-d313-5dd4-841b-b0b68303a85a sending to next pipeline
2026-03-30 10:44:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fce93e6a-d313-5dd4-841b-b0b68303a85a, identifier: JM60003
2026-03-30 10:44:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee10d50>
2026-03-30 10:44:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_f8a7838b0345a07c28b4ece654c64e52.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_f8a7838b0345a07c28b4ece654c64e52.jpg saved to cache
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f29d057-8e9d-5a62-b8f2-31f05d050782
2026-03-30 10:44:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fce93e6a-d313-5dd4-841b-b0b68303a85a with identifier: JM60003
2026-03-30 10:44:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fce93e6a-d313-5dd4-841b-b0b68303a85a with identifier: JM60003
2026-03-30 10:44:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fce93e6a-d313-5dd4-841b-b0b68303a85a with identifier: JM60003 to the API
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_0c8a120b48b705a3b5311bd3fd7b30c0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:52:44Z',
 'fuel_type': 'diesel',
 'id': 'fce93e6a-d313-5dd4-841b-b0b68303a85a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM60003',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 230112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4945045,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_0c8a120b48b705a3b5311bd3fd7b30c0.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_f4c6b0d7eb3ccab3b81163f9f4e2c1a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_2341cce41f7b6bdad6db84bcba4f36d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_8cb678ae5fe8771fb6b0ec88e061ecf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_321174f055b9d15564f6f5a5af3d6f3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_dfab3a2a5fe3ce5e8f0262a9b6e50cc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4561318,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_c6b3341bf5cd141d1cb1796facc81cd8.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2726393,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_3722d65598cc856cd4449a7b0d6f5c34.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_a6eb35d2fa1b0889cc7a0ee5dab44981.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce93e6a-d313-5dd4-841b-b0b68303a85a/fce93e6a-d313-5dd4-841b-b0b68303a85a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/87/4b876470cd43ad1e83e611623803a504/pa/JM60003_4bdf0b5d35a289c92ad275b210447b99.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-18',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Jumper 2.0 Blue-HDi 40 L4H3 Profi',
 'transmission': 'manual',
 'trim': '40 L4H3 Profi',
 'year': 2018}
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM60003%27 HTTP/1.1" 200 None
2026-03-30 10:44:03 [auto1.de] INFO: Saving data for JM60003: {'created_time': 1774867443.801173, 'last_price_update_time': 1774867443.801184, 'auction_closing_time': 1774972364.0}
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM60003') HTTP/1.1" 204 0
2026-03-30 10:44:03 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.685(s), this was the 1st time calling it.
2026-03-30 10:44:03 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.212969284586738 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f91d0>
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_9bb308ac4b3a457ffb392477cc687add.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_9bb308ac4b3a457ffb392477cc687add.jpg saved to cache
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f29d057-8e9d-5a62-b8f2-31f05d050782
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeee0490>
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_f29ab485abb9f6ab2d1cbfeae25b4b7a.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_f29ab485abb9f6ab2d1cbfeae25b4b7a.jpg saved to cache
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f29d057-8e9d-5a62-b8f2-31f05d050782
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434c7d0>
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_261698525b3551e456096361324e279f.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_261698525b3551e456096361324e279f.jpg saved to cache
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f29d057-8e9d-5a62-b8f2-31f05d050782
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41e9f90>
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_2ea8d3f7b8338e18251471a202ba4e0c.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_2ea8d3f7b8338e18251471a202ba4e0c.jpg saved to cache
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f29d057-8e9d-5a62-b8f2-31f05d050782
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefb75d0>
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_f29bdb6c1db5bc96cdf605eac3e1bc3c.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_f29bdb6c1db5bc96cdf605eac3e1bc3c.jpg saved to cache
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f29d057-8e9d-5a62-b8f2-31f05d050782
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee42b5d0>
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_4063d90720e33a1684ec34ae0a5e8f32.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_4063d90720e33a1684ec34ae0a5e8f32.jpg saved to cache
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f29d057-8e9d-5a62-b8f2-31f05d050782
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4171250>
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F75%252F3a75551eb395e3d67bc5ecfea862b1f4%252Fpa%252FFF66514_0056631f3468624aa99266b5f394a24b.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_0056631f3468624aa99266b5f394a24b.jpg saved to cache
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f29d057-8e9d-5a62-b8f2-31f05d050782
2026-03-30 10:44:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f29d057-8e9d-5a62-b8f2-31f05d050782, skipping ID generation
2026-03-30 10:44:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f29d057-8e9d-5a62-b8f2-31f05d050782 with scrape type 1
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f29d057-8e9d-5a62-b8f2-31f05d050782 sending to next pipeline
2026-03-30 10:44:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f29d057-8e9d-5a62-b8f2-31f05d050782, identifier: FF66514
2026-03-30 10:44:04 [scrapy.extensions.logstats] INFO: Crawled 512 pages (at 35 pages/min), scraped 365 items (at 25 items/min)
2026-03-30 10:44:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:44:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f29d057-8e9d-5a62-b8f2-31f05d050782 with identifier: FF66514
2026-03-30 10:44:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f29d057-8e9d-5a62-b8f2-31f05d050782 with identifier: FF66514
2026-03-30 10:44:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f29d057-8e9d-5a62-b8f2-31f05d050782 with identifier: FF66514 to the API
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_0056631f3468624aa99266b5f394a24b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:51:49Z',
 'fuel_type': 'petrol',
 'id': '6f29d057-8e9d-5a62-b8f2-31f05d050782',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF66514',
 'listing': 'auction',
 'location': 'DE, Bremerhaven',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 111067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_f66afb3c8e8bf8da49efc627818e4b0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_f8a7838b0345a07c28b4ece654c64e52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_bf73788e6ab7170056d4591e2f880e0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_f29bdb6c1db5bc96cdf605eac3e1bc3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_2ea8d3f7b8338e18251471a202ba4e0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_0056631f3468624aa99266b5f394a24b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_9bb308ac4b3a457ffb392477cc687add.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_4063d90720e33a1684ec34ae0a5e8f32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_261698525b3551e456096361324e279f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f29d057-8e9d-5a62-b8f2-31f05d050782/6f29d057-8e9d-5a62-b8f2-31f05d050782_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/75/3a75551eb395e3d67bc5ecfea862b1f4/pa/FF66514_f29ab485abb9f6ab2d1cbfeae25b4b7a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF66514%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [auto1.de] INFO: Saving data for FF66514: {'created_time': 1774867444.772185, 'last_price_update_time': 1774867444.772197, 'auction_closing_time': 1774972309.0}
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF66514') HTTP/1.1" 204 0
2026-03-30 10:44:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:44:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV90191> (referer: https://www.auto1.com/v1/car-details-view/YV90191/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7814121a-8186-51bc-8eda-c4e53420d1b7 with identifier: YV90191
2026-03-30 10:44:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7814121a-8186-51bc-8eda-c4e53420d1b7 with scrape type 1
2026-03-30 10:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7814121a-8186-51bc-8eda-c4e53420d1b7
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa2%252Fb9a2ef45dc2b03d06cc00d47a33f0d41%252Fpa%252FYV90191_c06a78fb5eda4daf5ede62ed1dc117af.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_c06a78fb5eda4daf5ede62ed1dc117af.jpg already downloaded
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa2%252Fb9a2ef45dc2b03d06cc00d47a33f0d41%252Fpa%252FYV90191_a1d03ee7ef7c7955d91471725f83bded.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_a1d03ee7ef7c7955d91471725f83bded.jpg already downloaded
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa2%252Fb9a2ef45dc2b03d06cc00d47a33f0d41%252Fpa%252FYV90191_2685749ed30e6430e815f6eed0905a5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_2685749ed30e6430e815f6eed0905a5a.jpg already downloaded
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa2%252Fb9a2ef45dc2b03d06cc00d47a33f0d41%252Fpa%252FYV90191_2fd4d6264fdae6ae94784cba63c36a5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_2fd4d6264fdae6ae94784cba63c36a5f.jpg already downloaded
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa2%252Fb9a2ef45dc2b03d06cc00d47a33f0d41%252Fpa%252FYV90191_fb8563e7a9c823c09a093b2d60218775.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_fb8563e7a9c823c09a093b2d60218775.jpg already downloaded
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa2%252Fb9a2ef45dc2b03d06cc00d47a33f0d41%252Fpa%252FYV90191_f7ef9d846bd1c33a39ea07d1ad2c07df.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_f7ef9d846bd1c33a39ea07d1ad2c07df.jpg already downloaded
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa2%252Fb9a2ef45dc2b03d06cc00d47a33f0d41%252Fpa%252FYV90191_7b3acf6e3d0250084f95134cba490f51.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_7b3acf6e3d0250084f95134cba490f51.jpg already downloaded
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa2%252Fb9a2ef45dc2b03d06cc00d47a33f0d41%252Fpa%252FYV90191_dd184a8377a577713451c36516584191.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_dd184a8377a577713451c36516584191.jpg already downloaded
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa2%252Fb9a2ef45dc2b03d06cc00d47a33f0d41%252Fpa%252FYV90191_248cdad9d5b8b2badfb301457361209f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_248cdad9d5b8b2badfb301457361209f.jpg already downloaded
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa2%252Fb9a2ef45dc2b03d06cc00d47a33f0d41%252Fpa%252FYV90191_927fe1094a98317c00c5e889a069e950.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_927fe1094a98317c00c5e889a069e950.jpg already downloaded
2026-03-30 10:44:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7814121a-8186-51bc-8eda-c4e53420d1b7, identifier: YV90191
2026-03-30 10:44:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7814121a-8186-51bc-8eda-c4e53420d1b7 with identifier: YV90191
2026-03-30 10:44:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7814121a-8186-51bc-8eda-c4e53420d1b7 with identifier: YV90191
2026-03-30 10:44:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7814121a-8186-51bc-8eda-c4e53420d1b7 with identifier: YV90191 to the API
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YV90191>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:12:46Z',
 'fuel_type': 'petrol',
 'id': '7814121a-8186-51bc-8eda-c4e53420d1b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV90191',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 94590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_c06a78fb5eda4daf5ede62ed1dc117af.jpg',
                'https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_a1d03ee7ef7c7955d91471725f83bded.jpg',
                'https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_2685749ed30e6430e815f6eed0905a5a.jpg',
                'https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_2fd4d6264fdae6ae94784cba63c36a5f.jpg',
                'https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_fb8563e7a9c823c09a093b2d60218775.jpg',
                'https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_f7ef9d846bd1c33a39ea07d1ad2c07df.jpg',
                'https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_7b3acf6e3d0250084f95134cba490f51.jpg',
                'https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_dd184a8377a577713451c36516584191.jpg',
                'https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_248cdad9d5b8b2badfb301457361209f.jpg',
                'https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_927fe1094a98317c00c5e889a069e950.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814121a-8186-51bc-8eda-c4e53420d1b7/7814121a-8186-51bc-8eda-c4e53420d1b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_c06a78fb5eda4daf5ede62ed1dc117af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814121a-8186-51bc-8eda-c4e53420d1b7/7814121a-8186-51bc-8eda-c4e53420d1b7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_a1d03ee7ef7c7955d91471725f83bded.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814121a-8186-51bc-8eda-c4e53420d1b7/7814121a-8186-51bc-8eda-c4e53420d1b7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_2685749ed30e6430e815f6eed0905a5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814121a-8186-51bc-8eda-c4e53420d1b7/7814121a-8186-51bc-8eda-c4e53420d1b7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_2fd4d6264fdae6ae94784cba63c36a5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814121a-8186-51bc-8eda-c4e53420d1b7/7814121a-8186-51bc-8eda-c4e53420d1b7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_fb8563e7a9c823c09a093b2d60218775.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814121a-8186-51bc-8eda-c4e53420d1b7/7814121a-8186-51bc-8eda-c4e53420d1b7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_f7ef9d846bd1c33a39ea07d1ad2c07df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814121a-8186-51bc-8eda-c4e53420d1b7/7814121a-8186-51bc-8eda-c4e53420d1b7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_7b3acf6e3d0250084f95134cba490f51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814121a-8186-51bc-8eda-c4e53420d1b7/7814121a-8186-51bc-8eda-c4e53420d1b7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_dd184a8377a577713451c36516584191.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814121a-8186-51bc-8eda-c4e53420d1b7/7814121a-8186-51bc-8eda-c4e53420d1b7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_248cdad9d5b8b2badfb301457361209f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814121a-8186-51bc-8eda-c4e53420d1b7/7814121a-8186-51bc-8eda-c4e53420d1b7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a2/b9a2ef45dc2b03d06cc00d47a33f0d41/pa/YV90191_927fe1094a98317c00c5e889a069e950.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2019}
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV90191%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [auto1.de] INFO: Saving data for YV90191: {'created_time': 1774867452.622741, 'last_price_update_time': 1774867452.622752, 'auction_closing_time': 1774969966.0}
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV90191') HTTP/1.1" 204 0
2026-03-30 10:44:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:20 [auto1.de] INFO: Channel: 24h | Page: 21 | totalHits: 9458 | hits on page: 40
2026-03-30 10:44:20 [auto1.de] INFO: Found listing with ID: LT55201
2026-03-30 10:44:20 [auto1.de] INFO: Found listing with ID: UD05197
2026-03-30 10:44:20 [auto1.de] INFO: Found listing with ID: DL76971
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL76971%27 HTTP/1.1" 200 None
2026-03-30 10:44:20 [auto1.de] INFO: Scrape type for DL76971: 0
2026-03-30 10:44:20 [auto1.de] INFO: Found listing with ID: AZ54716
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ54716%27 HTTP/1.1" 200 None
2026-03-30 10:44:20 [auto1.de] INFO: Scrape type for AZ54716: 0
2026-03-30 10:44:20 [auto1.de] INFO: Found listing with ID: CJ78489
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ78489%27 HTTP/1.1" 200 None
2026-03-30 10:44:20 [auto1.de] INFO: Scrape type for CJ78489: 0
2026-03-30 10:44:20 [auto1.de] INFO: Found listing with ID: AM79685
2026-03-30 10:44:20 [auto1.de] INFO: Found listing with ID: BP11097
2026-03-30 10:44:20 [auto1.de] INFO: Found listing with ID: ME64597
2026-03-30 10:44:20 [auto1.de] INFO: Found listing with ID: DA24351
2026-03-30 10:44:20 [auto1.de] INFO: Found listing with ID: XC24225
2026-03-30 10:44:20 [auto1.de] INFO: Found listing with ID: UZ72650
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ72650%27 HTTP/1.1" 200 None
2026-03-30 10:44:20 [auto1.de] INFO: Scrape type for UZ72650: 2
2026-03-30 10:44:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfedc73e-a499-55d7-b0fc-3eae450e2266 with identifier: UZ72650
2026-03-30 10:44:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfedc73e-a499-55d7-b0fc-3eae450e2266 with scrape type 2
2026-03-30 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfedc73e-a499-55d7-b0fc-3eae450e2266 with scrape type 2
2026-03-30 10:44:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dfedc73e-a499-55d7-b0fc-3eae450e2266, identifier: UZ72650
2026-03-30 10:44:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dfedc73e-a499-55d7-b0fc-3eae450e2266 with identifier: UZ72650
2026-03-30 10:44:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dfedc73e-a499-55d7-b0fc-3eae450e2266 with identifier: UZ72650
2026-03-30 10:44:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dfedc73e-a499-55d7-b0fc-3eae450e2266 with identifier: UZ72650 to the API
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:34:26Z',
 'fuel_type': 'petrol',
 'id': 'dfedc73e-a499-55d7-b0fc-3eae450e2266',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ72650',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 106570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-19',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2010}
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ72650%27 HTTP/1.1" 200 None
2026-03-30 10:44:20 [auto1.de] INFO: Saving data for UZ72650: {'auction_closing_time': 1774971266.0, 'created_time': 1774290904.074076, 'last_price_update_time': 1774867460.6123}
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ72650') HTTP/1.1" 204 0
2026-03-30 10:44:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:20 [auto1.de] INFO: Found listing with ID: YB03135
2026-03-30 10:44:20 [auto1.de] INFO: Found listing with ID: LT57344
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT57344%27 HTTP/1.1" 200 None
2026-03-30 10:44:20 [auto1.de] INFO: Scrape type for LT57344: 1
2026-03-30 10:44:20 [auto1.de] INFO: Found listing with ID: LC32113
2026-03-30 10:44:20 [auto1.de] INFO: Found listing with ID: SW73821
2026-03-30 10:44:20 [auto1.de] INFO: Found listing with ID: SX71911
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX71911%27 HTTP/1.1" 200 None
2026-03-30 10:44:20 [auto1.de] INFO: Scrape type for SX71911: 2
2026-03-30 10:44:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f92c7ca-bfc6-52e3-b520-84d16d5b6d1a with identifier: SX71911
2026-03-30 10:44:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f92c7ca-bfc6-52e3-b520-84d16d5b6d1a with scrape type 2
2026-03-30 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f92c7ca-bfc6-52e3-b520-84d16d5b6d1a with scrape type 2
2026-03-30 10:44:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f92c7ca-bfc6-52e3-b520-84d16d5b6d1a, identifier: SX71911
2026-03-30 10:44:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f92c7ca-bfc6-52e3-b520-84d16d5b6d1a with identifier: SX71911
2026-03-30 10:44:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f92c7ca-bfc6-52e3-b520-84d16d5b6d1a with identifier: SX71911
2026-03-30 10:44:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f92c7ca-bfc6-52e3-b520-84d16d5b6d1a with identifier: SX71911 to the API
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:18:03Z',
 'fuel_type': 'petrol',
 'id': '5f92c7ca-bfc6-52e3-b520-84d16d5b6d1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX71911',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 125267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-26',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX71911%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [auto1.de] INFO: Saving data for SX71911: {'auction_closing_time': 1774970283.0, 'created_time': 1774377778.719191, 'last_price_update_time': 1774867461.280769}
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX71911') HTTP/1.1" 204 0
2026-03-30 10:44:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:21 [auto1.de] INFO: Found listing with ID: RS78128
2026-03-30 10:44:21 [auto1.de] INFO: Found listing with ID: UN38218
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN38218%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [auto1.de] INFO: Scrape type for UN38218: 1
2026-03-30 10:44:21 [auto1.de] INFO: Found listing with ID: RP83269
2026-03-30 10:44:21 [auto1.de] INFO: Found listing with ID: LX14183
2026-03-30 10:44:21 [auto1.de] INFO: Found listing with ID: AS37884
2026-03-30 10:44:21 [auto1.de] INFO: Found listing with ID: GK60311
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK60311%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [auto1.de] INFO: Scrape type for GK60311: 2
2026-03-30 10:44:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83d7f94b-3029-5b5b-a6c4-b0d1b4fb0110 with identifier: GK60311
2026-03-30 10:44:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83d7f94b-3029-5b5b-a6c4-b0d1b4fb0110 with scrape type 2
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83d7f94b-3029-5b5b-a6c4-b0d1b4fb0110 with scrape type 2
2026-03-30 10:44:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83d7f94b-3029-5b5b-a6c4-b0d1b4fb0110, identifier: GK60311
2026-03-30 10:44:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83d7f94b-3029-5b5b-a6c4-b0d1b4fb0110 with identifier: GK60311
2026-03-30 10:44:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83d7f94b-3029-5b5b-a6c4-b0d1b4fb0110 with identifier: GK60311
2026-03-30 10:44:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83d7f94b-3029-5b5b-a6c4-b0d1b4fb0110 with identifier: GK60311 to the API
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:44:59Z',
 'fuel_type': 'petrol',
 'id': '83d7f94b-3029-5b5b-a6c4-b0d1b4fb0110',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK60311',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 29279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-13',
 'seller_name': None,
 'title': 'Renault Captur 1.2 TCe Energy Luxe',
 'transmission': 'automatic',
 'trim': 'Luxe',
 'year': 2016}
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK60311%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [auto1.de] INFO: Saving data for GK60311: {'auction_closing_time': 1774971899.0, 'created_time': 1773301713.141079, 'last_price_update_time': 1774867461.763519}
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK60311') HTTP/1.1" 204 0
2026-03-30 10:44:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:21 [auto1.de] INFO: Found listing with ID: FE05241
2026-03-30 10:44:21 [auto1.de] INFO: Found listing with ID: ZJ35248
2026-03-30 10:44:21 [auto1.de] INFO: Found listing with ID: DM81124
2026-03-30 10:44:21 [auto1.de] INFO: Found listing with ID: GG04913
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG04913%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [auto1.de] INFO: Scrape type for GG04913: 2
2026-03-30 10:44:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f641387c-fa4d-5f22-9253-6b27d0e51fff with identifier: GG04913
2026-03-30 10:44:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f641387c-fa4d-5f22-9253-6b27d0e51fff with scrape type 2
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f641387c-fa4d-5f22-9253-6b27d0e51fff with scrape type 2
2026-03-30 10:44:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f641387c-fa4d-5f22-9253-6b27d0e51fff, identifier: GG04913
2026-03-30 10:44:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f641387c-fa4d-5f22-9253-6b27d0e51fff with identifier: GG04913
2026-03-30 10:44:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f641387c-fa4d-5f22-9253-6b27d0e51fff with identifier: GG04913
2026-03-30 10:44:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f641387c-fa4d-5f22-9253-6b27d0e51fff with identifier: GG04913 to the API
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:25:51Z',
 'fuel_type': 'petrol',
 'id': 'f641387c-fa4d-5f22-9253-6b27d0e51fff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG04913',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Cascada',
 'odometer': 153142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-18',
 'seller_name': None,
 'title': 'Opel Cascada 1.4 Turbo Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2015}
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG04913%27 HTTP/1.1" 200 None
2026-03-30 10:44:22 [auto1.de] INFO: Saving data for GG04913: {'auction_closing_time': 1774970751.0, 'created_time': 1774608227.912072, 'last_price_update_time': 1774867462.369888}
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG04913') HTTP/1.1" 204 0
2026-03-30 10:44:22 [auto1.de] INFO: Found listing with ID: TW68538
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW68538%27 HTTP/1.1" 200 None
2026-03-30 10:44:22 [auto1.de] INFO: Scrape type for TW68538: 2
2026-03-30 10:44:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8d43043-2a6f-50de-b9f8-d5bd62c31cbf with identifier: TW68538
2026-03-30 10:44:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8d43043-2a6f-50de-b9f8-d5bd62c31cbf with scrape type 2
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8d43043-2a6f-50de-b9f8-d5bd62c31cbf with scrape type 2
2026-03-30 10:44:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8d43043-2a6f-50de-b9f8-d5bd62c31cbf, identifier: TW68538
2026-03-30 10:44:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8d43043-2a6f-50de-b9f8-d5bd62c31cbf with identifier: TW68538
2026-03-30 10:44:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8d43043-2a6f-50de-b9f8-d5bd62c31cbf with identifier: TW68538
2026-03-30 10:44:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8d43043-2a6f-50de-b9f8-d5bd62c31cbf with identifier: TW68538 to the API
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:56:47Z',
 'fuel_type': 'diesel',
 'id': 'f8d43043-2a6f-50de-b9f8-d5bd62c31cbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW68538',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 225632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-27',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW68538%27 HTTP/1.1" 200 None
2026-03-30 10:44:22 [auto1.de] INFO: Saving data for TW68538: {'auction_closing_time': 1774972607.0, 'created_time': 1774294066.933514, 'last_price_update_time': 1774867462.803043}
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW68538') HTTP/1.1" 204 0
2026-03-30 10:44:22 [auto1.de] INFO: Found listing with ID: TA06372
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA06372%27 HTTP/1.1" 200 None
2026-03-30 10:44:22 [auto1.de] INFO: Scrape type for TA06372: 1
2026-03-30 10:44:22 [auto1.de] INFO: Found listing with ID: TR92367
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR92367%27 HTTP/1.1" 200 None
2026-03-30 10:44:22 [auto1.de] INFO: Scrape type for TR92367: 1
2026-03-30 10:44:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:22 [auto1.de] INFO: Found listing with ID: XS59646
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS59646%27 HTTP/1.1" 200 None
2026-03-30 10:44:22 [auto1.de] INFO: Scrape type for XS59646: 1
2026-03-30 10:44:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:22 [auto1.de] INFO: Found listing with ID: NU64922
2026-03-30 10:44:22 [auto1.de] INFO: Found listing with ID: HK95195
2026-03-30 10:44:22 [auto1.de] INFO: Found listing with ID: AX17463
2026-03-30 10:44:22 [auto1.de] INFO: Found listing with ID: EZ95690
2026-03-30 10:44:22 [auto1.de] INFO: Found listing with ID: BS69347
2026-03-30 10:44:22 [auto1.de] INFO: Found listing with ID: WA15492
2026-03-30 10:44:22 [auto1.de] INFO: Found listing with ID: VW06813
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW06813%27 HTTP/1.1" 200 None
2026-03-30 10:44:22 [auto1.de] INFO: Scrape type for VW06813: 1
2026-03-30 10:44:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:22 [auto1.de] INFO: Found listing with ID: RA14894
2026-03-30 10:44:22 [auto1.de] INFO: Found listing with ID: DZ59899
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ59899%27 HTTP/1.1" 200 None
2026-03-30 10:44:22 [auto1.de] INFO: Scrape type for DZ59899: 2
2026-03-30 10:44:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a94be094-3779-5a8b-ae60-f3ae45d2d889 with identifier: DZ59899
2026-03-30 10:44:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a94be094-3779-5a8b-ae60-f3ae45d2d889 with scrape type 2
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a94be094-3779-5a8b-ae60-f3ae45d2d889 with scrape type 2
2026-03-30 10:44:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a94be094-3779-5a8b-ae60-f3ae45d2d889, identifier: DZ59899
2026-03-30 10:44:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a94be094-3779-5a8b-ae60-f3ae45d2d889 with identifier: DZ59899
2026-03-30 10:44:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a94be094-3779-5a8b-ae60-f3ae45d2d889 with identifier: DZ59899
2026-03-30 10:44:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a94be094-3779-5a8b-ae60-f3ae45d2d889 with identifier: DZ59899 to the API
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:08:32Z',
 'fuel_type': 'petrol',
 'id': 'a94be094-3779-5a8b-ae60-f3ae45d2d889',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ59899',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 169886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-19',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2016}
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ59899%27 HTTP/1.1" 200 None
2026-03-30 10:44:23 [auto1.de] INFO: Saving data for DZ59899: {'auction_closing_time': 1774969712.0, 'created_time': 1774379116.521453, 'last_price_update_time': 1774867463.440038}
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ59899') HTTP/1.1" 204 0
2026-03-30 10:44:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:23 [auto1.de] INFO: Found listing with ID: BN22147
2026-03-30 10:44:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TA06372/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VW06813/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VW06813> (referer: https://www.auto1.com/v1/car-details-view/VW06813/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b868ad0-a52f-5698-8167-b1142c493f75 with identifier: VW06813
2026-03-30 10:44:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b868ad0-a52f-5698-8167-b1142c493f75 with scrape type 1
2026-03-30 10:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b868ad0-a52f-5698-8167-b1142c493f75
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2e%252F4e2e19946e20de2cd1dcf454b52ee337%252Fpa%252FVW06813_52f436784f2ea7812a6ccda260106777.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_52f436784f2ea7812a6ccda260106777.jpg already downloaded
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2e%252F4e2e19946e20de2cd1dcf454b52ee337%252Fpa%252FVW06813_bca31ef426a302a75fda5b9b555745e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_bca31ef426a302a75fda5b9b555745e8.jpg already downloaded
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2e%252F4e2e19946e20de2cd1dcf454b52ee337%252Fpa%252FVW06813_679b614bda553d89bb8161c0801dec40.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_679b614bda553d89bb8161c0801dec40.jpg already downloaded
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2e%252F4e2e19946e20de2cd1dcf454b52ee337%252Fpa%252FVW06813_7447becda11f2e1c07a9443e6e376d1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_7447becda11f2e1c07a9443e6e376d1f.jpg already downloaded
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2e%252F4e2e19946e20de2cd1dcf454b52ee337%252Fpa%252FVW06813_805f3ac5dcc4577a01219cc1052ef942.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_805f3ac5dcc4577a01219cc1052ef942.jpg already downloaded
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2e%252F4e2e19946e20de2cd1dcf454b52ee337%252Fpa%252FVW06813_f1d8eb83c4748cadfd38fb2385c1044f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_f1d8eb83c4748cadfd38fb2385c1044f.jpg already downloaded
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2e%252F4e2e19946e20de2cd1dcf454b52ee337%252Fpa%252FVW06813_6c92b80af08a59b1cbbd39a71ff970a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_6c92b80af08a59b1cbbd39a71ff970a1.jpg already downloaded
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2e%252F4e2e19946e20de2cd1dcf454b52ee337%252Fpa%252FVW06813_441283f11aaf71d4a6b456b5bc7db493.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_441283f11aaf71d4a6b456b5bc7db493.jpg already downloaded
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2e%252F4e2e19946e20de2cd1dcf454b52ee337%252Fpa%252FVW06813_2074aeefd2d8dca245d6de0432e80387.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_2074aeefd2d8dca245d6de0432e80387.jpg already downloaded
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2e%252F4e2e19946e20de2cd1dcf454b52ee337%252Fpa%252FVW06813_932adb7045977c09710b9d22ac8bdd95.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_932adb7045977c09710b9d22ac8bdd95.jpg already downloaded
2026-03-30 10:44:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b868ad0-a52f-5698-8167-b1142c493f75, identifier: VW06813
2026-03-30 10:44:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b868ad0-a52f-5698-8167-b1142c493f75 with identifier: VW06813
2026-03-30 10:44:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b868ad0-a52f-5698-8167-b1142c493f75 with identifier: VW06813
2026-03-30 10:44:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b868ad0-a52f-5698-8167-b1142c493f75 with identifier: VW06813 to the API
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VW06813>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 91,
 'expiration_date': '2026-03-31T15:08:20Z',
 'fuel_type': 'petrol',
 'id': '5b868ad0-a52f-5698-8167-b1142c493f75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW06813',
 'listing': 'auction',
 'location': 'DE, Hodenhagen',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 77361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_52f436784f2ea7812a6ccda260106777.jpg',
                'https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_bca31ef426a302a75fda5b9b555745e8.jpg',
                'https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_679b614bda553d89bb8161c0801dec40.jpg',
                'https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_7447becda11f2e1c07a9443e6e376d1f.jpg',
                'https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_805f3ac5dcc4577a01219cc1052ef942.jpg',
                'https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_f1d8eb83c4748cadfd38fb2385c1044f.jpg',
                'https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_6c92b80af08a59b1cbbd39a71ff970a1.jpg',
                'https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_441283f11aaf71d4a6b456b5bc7db493.jpg',
                'https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_2074aeefd2d8dca245d6de0432e80387.jpg',
                'https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_932adb7045977c09710b9d22ac8bdd95.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b868ad0-a52f-5698-8167-b1142c493f75/5b868ad0-a52f-5698-8167-b1142c493f75_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_52f436784f2ea7812a6ccda260106777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b868ad0-a52f-5698-8167-b1142c493f75/5b868ad0-a52f-5698-8167-b1142c493f75_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2913568,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_bca31ef426a302a75fda5b9b555745e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b868ad0-a52f-5698-8167-b1142c493f75/5b868ad0-a52f-5698-8167-b1142c493f75_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2890071,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_679b614bda553d89bb8161c0801dec40.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b868ad0-a52f-5698-8167-b1142c493f75/5b868ad0-a52f-5698-8167-b1142c493f75_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2839757,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_7447becda11f2e1c07a9443e6e376d1f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b868ad0-a52f-5698-8167-b1142c493f75/5b868ad0-a52f-5698-8167-b1142c493f75_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2808964,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_805f3ac5dcc4577a01219cc1052ef942.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b868ad0-a52f-5698-8167-b1142c493f75/5b868ad0-a52f-5698-8167-b1142c493f75_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2851934,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_f1d8eb83c4748cadfd38fb2385c1044f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b868ad0-a52f-5698-8167-b1142c493f75/5b868ad0-a52f-5698-8167-b1142c493f75_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_6c92b80af08a59b1cbbd39a71ff970a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b868ad0-a52f-5698-8167-b1142c493f75/5b868ad0-a52f-5698-8167-b1142c493f75_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_441283f11aaf71d4a6b456b5bc7db493.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b868ad0-a52f-5698-8167-b1142c493f75/5b868ad0-a52f-5698-8167-b1142c493f75_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2939450,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_2074aeefd2d8dca245d6de0432e80387.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b868ad0-a52f-5698-8167-b1142c493f75/5b868ad0-a52f-5698-8167-b1142c493f75_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/2e/4e2e19946e20de2cd1dcf454b52ee337/pa/VW06813_932adb7045977c09710b9d22ac8bdd95.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2022}
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW06813%27 HTTP/1.1" 200 None
2026-03-30 10:44:27 [auto1.de] INFO: Saving data for VW06813: {'created_time': 1774867467.416505, 'last_price_update_time': 1774867467.416519, 'auction_closing_time': 1774969700.0}
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW06813') HTTP/1.1" 204 0
2026-03-30 10:44:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UN38218/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:28 [auto1.de] INFO: Channel: 24h | Page: 22 | totalHits: 9458 | hits on page: 40
2026-03-30 10:44:28 [auto1.de] INFO: Found listing with ID: RU77143
2026-03-30 10:44:28 [auto1.de] INFO: Found listing with ID: BG30699
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG30699%27 HTTP/1.1" 200 None
2026-03-30 10:44:28 [auto1.de] INFO: Scrape type for BG30699: 1
2026-03-30 10:44:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:28 [auto1.de] INFO: Found listing with ID: SC02628
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC02628%27 HTTP/1.1" 200 None
2026-03-30 10:44:28 [auto1.de] INFO: Scrape type for SC02628: 2
2026-03-30 10:44:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63a55544-8d9d-5938-ae35-0a656432a104 with identifier: SC02628
2026-03-30 10:44:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63a55544-8d9d-5938-ae35-0a656432a104 with scrape type 2
2026-03-30 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63a55544-8d9d-5938-ae35-0a656432a104 with scrape type 2
2026-03-30 10:44:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63a55544-8d9d-5938-ae35-0a656432a104, identifier: SC02628
2026-03-30 10:44:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63a55544-8d9d-5938-ae35-0a656432a104 with identifier: SC02628
2026-03-30 10:44:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63a55544-8d9d-5938-ae35-0a656432a104 with identifier: SC02628
2026-03-30 10:44:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63a55544-8d9d-5938-ae35-0a656432a104 with identifier: SC02628 to the API
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:52:22Z',
 'fuel_type': 'petrol',
 'id': '63a55544-8d9d-5938-ae35-0a656432a104',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC02628',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 187692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2010}
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC02628%27 HTTP/1.1" 200 None
2026-03-30 10:44:29 [auto1.de] INFO: Saving data for SC02628: {'auction_closing_time': 1774972342.0, 'created_time': 1773773817.440083, 'last_price_update_time': 1774867469.037929}
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC02628') HTTP/1.1" 204 0
2026-03-30 10:44:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:29 [auto1.de] INFO: Found listing with ID: ED20045
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED20045%27 HTTP/1.1" 200 None
2026-03-30 10:44:29 [auto1.de] INFO: Scrape type for ED20045: 1
2026-03-30 10:44:29 [auto1.de] INFO: Found listing with ID: ZE59650
2026-03-30 10:44:29 [auto1.de] INFO: Found listing with ID: CJ42991
2026-03-30 10:44:29 [auto1.de] INFO: Found listing with ID: KN84771
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN84771%27 HTTP/1.1" 200 None
2026-03-30 10:44:29 [auto1.de] INFO: Scrape type for KN84771: 1
2026-03-30 10:44:29 [auto1.de] INFO: Found listing with ID: JA55411
2026-03-30 10:44:29 [auto1.de] INFO: Found listing with ID: FP87912
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP87912%27 HTTP/1.1" 200 None
2026-03-30 10:44:29 [auto1.de] INFO: Scrape type for FP87912: 2
2026-03-30 10:44:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 075bc60b-be0d-5645-b709-a2ece14a402a with identifier: FP87912
2026-03-30 10:44:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 075bc60b-be0d-5645-b709-a2ece14a402a with scrape type 2
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 075bc60b-be0d-5645-b709-a2ece14a402a with scrape type 2
2026-03-30 10:44:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 075bc60b-be0d-5645-b709-a2ece14a402a, identifier: FP87912
2026-03-30 10:44:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 075bc60b-be0d-5645-b709-a2ece14a402a with identifier: FP87912
2026-03-30 10:44:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 075bc60b-be0d-5645-b709-a2ece14a402a with identifier: FP87912
2026-03-30 10:44:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 075bc60b-be0d-5645-b709-a2ece14a402a with identifier: FP87912 to the API
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 182,
 'expiration_date': '2026-03-31T15:04:38Z',
 'fuel_type': 'petrol',
 'id': '075bc60b-be0d-5645-b709-a2ece14a402a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP87912',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 93303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-16',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP87912%27 HTTP/1.1" 200 None
2026-03-30 10:44:29 [auto1.de] INFO: Saving data for FP87912: {'auction_closing_time': 1774969478.0, 'created_time': 1774378016.923221, 'last_price_update_time': 1774867469.567395}
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP87912') HTTP/1.1" 204 0
2026-03-30 10:44:29 [auto1.de] INFO: Found listing with ID: CA83659
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA83659%27 HTTP/1.1" 200 None
2026-03-30 10:44:29 [auto1.de] INFO: Scrape type for CA83659: 2
2026-03-30 10:44:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 011a2bfd-298d-5e9e-bfb6-761513ec5465 with identifier: CA83659
2026-03-30 10:44:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 011a2bfd-298d-5e9e-bfb6-761513ec5465 with scrape type 2
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 011a2bfd-298d-5e9e-bfb6-761513ec5465 with scrape type 2
2026-03-30 10:44:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 011a2bfd-298d-5e9e-bfb6-761513ec5465, identifier: CA83659
2026-03-30 10:44:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 011a2bfd-298d-5e9e-bfb6-761513ec5465 with identifier: CA83659
2026-03-30 10:44:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 011a2bfd-298d-5e9e-bfb6-761513ec5465 with identifier: CA83659
2026-03-30 10:44:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 011a2bfd-298d-5e9e-bfb6-761513ec5465 with identifier: CA83659 to the API
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:10:15Z',
 'fuel_type': 'diesel',
 'id': '011a2bfd-298d-5e9e-bfb6-761513ec5465',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA83659',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 295952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-30',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA83659%27 HTTP/1.1" 200 None
2026-03-30 10:44:30 [auto1.de] INFO: Saving data for CA83659: {'auction_closing_time': 1774969815.0, 'created_time': 1774416663.618797, 'last_price_update_time': 1774867470.056209}
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA83659') HTTP/1.1" 204 0
2026-03-30 10:44:30 [auto1.de] INFO: Found listing with ID: SZ20941
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ20941%27 HTTP/1.1" 200 None
2026-03-30 10:44:30 [auto1.de] INFO: Scrape type for SZ20941: 2
2026-03-30 10:44:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0ba394a-8c18-549e-ae33-171a0901a115 with identifier: SZ20941
2026-03-30 10:44:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0ba394a-8c18-549e-ae33-171a0901a115 with scrape type 2
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0ba394a-8c18-549e-ae33-171a0901a115 with scrape type 2
2026-03-30 10:44:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0ba394a-8c18-549e-ae33-171a0901a115, identifier: SZ20941
2026-03-30 10:44:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0ba394a-8c18-549e-ae33-171a0901a115 with identifier: SZ20941
2026-03-30 10:44:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0ba394a-8c18-549e-ae33-171a0901a115 with identifier: SZ20941
2026-03-30 10:44:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0ba394a-8c18-549e-ae33-171a0901a115 with identifier: SZ20941 to the API
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-31T15:51:38Z',
 'fuel_type': 'diesel',
 'id': 'e0ba394a-8c18-549e-ae33-171a0901a115',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ20941',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 124398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-25',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2017}
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ20941%27 HTTP/1.1" 200 None
2026-03-30 10:44:30 [auto1.de] INFO: Saving data for SZ20941: {'auction_closing_time': 1774972298.0, 'created_time': 1774522476.857892, 'last_price_update_time': 1774867470.56856}
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ20941') HTTP/1.1" 204 0
2026-03-30 10:44:30 [auto1.de] INFO: Found listing with ID: EH54966
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH54966%27 HTTP/1.1" 200 None
2026-03-30 10:44:30 [auto1.de] INFO: Scrape type for EH54966: 1
2026-03-30 10:44:30 [auto1.de] INFO: Found listing with ID: BB98508
2026-03-30 10:44:30 [auto1.de] INFO: Found listing with ID: VH26338
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH26338%27 HTTP/1.1" 200 None
2026-03-30 10:44:30 [auto1.de] INFO: Scrape type for VH26338: 2
2026-03-30 10:44:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db6f40f4-03f1-5a5c-b3c3-f1c283cc0397 with identifier: VH26338
2026-03-30 10:44:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db6f40f4-03f1-5a5c-b3c3-f1c283cc0397 with scrape type 2
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db6f40f4-03f1-5a5c-b3c3-f1c283cc0397 with scrape type 2
2026-03-30 10:44:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db6f40f4-03f1-5a5c-b3c3-f1c283cc0397, identifier: VH26338
2026-03-30 10:44:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db6f40f4-03f1-5a5c-b3c3-f1c283cc0397 with identifier: VH26338
2026-03-30 10:44:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db6f40f4-03f1-5a5c-b3c3-f1c283cc0397 with identifier: VH26338
2026-03-30 10:44:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db6f40f4-03f1-5a5c-b3c3-f1c283cc0397 with identifier: VH26338 to the API
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:50:22Z',
 'fuel_type': 'petrol',
 'id': 'db6f40f4-03f1-5a5c-b3c3-f1c283cc0397',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH26338',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 52449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-16',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2022}
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH26338%27 HTTP/1.1" 200 None
2026-03-30 10:44:31 [auto1.de] INFO: Saving data for VH26338: {'auction_closing_time': 1774972222.0, 'created_time': 1773306889.255433, 'last_price_update_time': 1774867471.446908}
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH26338') HTTP/1.1" 204 0
2026-03-30 10:44:31 [auto1.de] INFO: Found listing with ID: MH90700
2026-03-30 10:44:31 [auto1.de] INFO: Found listing with ID: YY96342
2026-03-30 10:44:31 [auto1.de] INFO: Found listing with ID: ZN86582
2026-03-30 10:44:31 [auto1.de] INFO: Found listing with ID: AN56008
2026-03-30 10:44:31 [auto1.de] INFO: Found listing with ID: RG93335
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG93335%27 HTTP/1.1" 200 None
2026-03-30 10:44:31 [auto1.de] INFO: Scrape type for RG93335: 1
2026-03-30 10:44:31 [auto1.de] INFO: Found listing with ID: TL54182
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL54182%27 HTTP/1.1" 200 None
2026-03-30 10:44:31 [auto1.de] INFO: Scrape type for TL54182: 1
2026-03-30 10:44:31 [auto1.de] INFO: Found listing with ID: WG19092
2026-03-30 10:44:31 [auto1.de] INFO: Found listing with ID: JU04536
2026-03-30 10:44:31 [auto1.de] INFO: Found listing with ID: JB73143
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB73143%27 HTTP/1.1" 200 None
2026-03-30 10:44:31 [auto1.de] INFO: Scrape type for JB73143: 1
2026-03-30 10:44:31 [auto1.de] INFO: Found listing with ID: UY49160
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY49160%27 HTTP/1.1" 200 None
2026-03-30 10:44:31 [auto1.de] INFO: Scrape type for UY49160: 2
2026-03-30 10:44:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 727b2b66-a3fb-5e21-912f-f021ce66b4f5 with identifier: UY49160
2026-03-30 10:44:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 727b2b66-a3fb-5e21-912f-f021ce66b4f5 with scrape type 2
2026-03-30 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 727b2b66-a3fb-5e21-912f-f021ce66b4f5 with scrape type 2
2026-03-30 10:44:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 727b2b66-a3fb-5e21-912f-f021ce66b4f5, identifier: UY49160
2026-03-30 10:44:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 727b2b66-a3fb-5e21-912f-f021ce66b4f5 with identifier: UY49160
2026-03-30 10:44:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 727b2b66-a3fb-5e21-912f-f021ce66b4f5 with identifier: UY49160
2026-03-30 10:44:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 727b2b66-a3fb-5e21-912f-f021ce66b4f5 with identifier: UY49160 to the API
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:51:15Z',
 'fuel_type': 'diesel',
 'id': '727b2b66-a3fb-5e21-912f-f021ce66b4f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY49160',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 84404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-01',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi Mild-Hybrid 320 L1 Tourneo Titanium X',
 'transmission': 'manual',
 'trim': '320 L1 Tourneo Titanium X',
 'year': 2020}
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY49160%27 HTTP/1.1" 200 None
2026-03-30 10:44:31 [auto1.de] INFO: Saving data for UY49160: {'auction_closing_time': 1774972275.0, 'created_time': 1773686590.922506, 'last_price_update_time': 1774867471.966764}
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY49160') HTTP/1.1" 204 0
2026-03-30 10:44:32 [auto1.de] INFO: Found listing with ID: TH94895
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH94895%27 HTTP/1.1" 200 None
2026-03-30 10:44:32 [auto1.de] INFO: Scrape type for TH94895: 2
2026-03-30 10:44:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61eda4e9-347a-5c08-ae80-6c479cbc0ebd with identifier: TH94895
2026-03-30 10:44:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61eda4e9-347a-5c08-ae80-6c479cbc0ebd with scrape type 2
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61eda4e9-347a-5c08-ae80-6c479cbc0ebd with scrape type 2
2026-03-30 10:44:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61eda4e9-347a-5c08-ae80-6c479cbc0ebd, identifier: TH94895
2026-03-30 10:44:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61eda4e9-347a-5c08-ae80-6c479cbc0ebd with identifier: TH94895
2026-03-30 10:44:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61eda4e9-347a-5c08-ae80-6c479cbc0ebd with identifier: TH94895
2026-03-30 10:44:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61eda4e9-347a-5c08-ae80-6c479cbc0ebd with identifier: TH94895 to the API
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-31T15:08:37Z',
 'fuel_type': 'diesel',
 'id': '61eda4e9-347a-5c08-ae80-6c479cbc0ebd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH94895',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Pathfinder',
 'odometer': 257307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-10',
 'seller_name': None,
 'title': 'Nissan Pathfinder 2.5 dCi Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2006}
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH94895%27 HTTP/1.1" 200 None
2026-03-30 10:44:32 [auto1.de] INFO: Saving data for TH94895: {'auction_closing_time': 1774969717.0, 'created_time': 1773657838.449233, 'last_price_update_time': 1774867472.511536}
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH94895') HTTP/1.1" 204 0
2026-03-30 10:44:32 [auto1.de] INFO: Found listing with ID: RE10488
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE10488%27 HTTP/1.1" 200 None
2026-03-30 10:44:32 [auto1.de] INFO: Scrape type for RE10488: 1
2026-03-30 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:32 [auto1.de] INFO: Found listing with ID: NY45560
2026-03-30 10:44:32 [auto1.de] INFO: Found listing with ID: ZB25912
2026-03-30 10:44:32 [auto1.de] INFO: Found listing with ID: KM19595
2026-03-30 10:44:32 [auto1.de] INFO: Found listing with ID: XD17541
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD17541%27 HTTP/1.1" 200 None
2026-03-30 10:44:32 [auto1.de] INFO: Scrape type for XD17541: 1
2026-03-30 10:44:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BG30699/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XS59646/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR92367/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:32 [auto1.de] INFO: Found listing with ID: GL13033
2026-03-30 10:44:32 [auto1.de] INFO: Found listing with ID: KL67812
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL67812%27 HTTP/1.1" 200 None
2026-03-30 10:44:32 [auto1.de] INFO: Scrape type for KL67812: 2
2026-03-30 10:44:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4592700d-0014-5851-a086-f1fdcd6d4991 with identifier: KL67812
2026-03-30 10:44:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4592700d-0014-5851-a086-f1fdcd6d4991 with scrape type 2
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4592700d-0014-5851-a086-f1fdcd6d4991 with scrape type 2
2026-03-30 10:44:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4592700d-0014-5851-a086-f1fdcd6d4991, identifier: KL67812
2026-03-30 10:44:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4592700d-0014-5851-a086-f1fdcd6d4991 with identifier: KL67812
2026-03-30 10:44:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4592700d-0014-5851-a086-f1fdcd6d4991 with identifier: KL67812
2026-03-30 10:44:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4592700d-0014-5851-a086-f1fdcd6d4991 with identifier: KL67812 to the API
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:41:19Z',
 'fuel_type': 'petrol',
 'id': '4592700d-0014-5851-a086-f1fdcd6d4991',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL67812',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 62834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-25',
 'seller_name': None,
 'title': 'Ford S-Max 1.5 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2018}
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL67812%27 HTTP/1.1" 200 None
2026-03-30 10:44:33 [auto1.de] INFO: Saving data for KL67812: {'auction_closing_time': 1774971679.0, 'created_time': 1774293307.209258, 'last_price_update_time': 1774867473.021818}
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL67812') HTTP/1.1" 204 0
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: GH56807
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: TG88062
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: AG12776
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG12776%27 HTTP/1.1" 200 None
2026-03-30 10:44:33 [auto1.de] INFO: Scrape type for AG12776: 1
2026-03-30 10:44:33 [auto1.de] INFO: Channel: 24h | Page: 23 | totalHits: 9458 | hits on page: 40
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: NG10221
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: UU82160
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU82160%27 HTTP/1.1" 200 None
2026-03-30 10:44:33 [auto1.de] INFO: Scrape type for UU82160: 1
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: LV20570
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV20570%27 HTTP/1.1" 200 None
2026-03-30 10:44:33 [auto1.de] INFO: Scrape type for LV20570: 2
2026-03-30 10:44:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b9e4cd9-e708-560f-b8b9-4e36e61f9028 with identifier: LV20570
2026-03-30 10:44:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b9e4cd9-e708-560f-b8b9-4e36e61f9028 with scrape type 2
2026-03-30 10:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b9e4cd9-e708-560f-b8b9-4e36e61f9028 with scrape type 2
2026-03-30 10:44:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b9e4cd9-e708-560f-b8b9-4e36e61f9028, identifier: LV20570
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: XA81988
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: PF77669
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF77669%27 HTTP/1.1" 200 None
2026-03-30 10:44:33 [auto1.de] INFO: Scrape type for PF77669: 1
2026-03-30 10:44:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b9e4cd9-e708-560f-b8b9-4e36e61f9028 with identifier: LV20570
2026-03-30 10:44:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b9e4cd9-e708-560f-b8b9-4e36e61f9028 with identifier: LV20570
2026-03-30 10:44:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b9e4cd9-e708-560f-b8b9-4e36e61f9028 with identifier: LV20570 to the API
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:05:06Z',
 'fuel_type': 'petrol',
 'id': '7b9e4cd9-e708-560f-b8b9-4e36e61f9028',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV20570',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 112874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-05',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV20570%27 HTTP/1.1" 200 None
2026-03-30 10:44:33 [auto1.de] INFO: Saving data for LV20570: {'auction_closing_time': 1774969506.0, 'created_time': 1774377777.266294, 'last_price_update_time': 1774867473.545224}
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV20570') HTTP/1.1" 204 0
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: MD36296
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: ZH93684
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: NM84118
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: FN84005
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN84005%27 HTTP/1.1" 200 None
2026-03-30 10:44:33 [auto1.de] INFO: Scrape type for FN84005: 1
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: KZ40910
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ40910%27 HTTP/1.1" 200 None
2026-03-30 10:44:33 [auto1.de] INFO: Scrape type for KZ40910: 1
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: AJ41355
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ41355%27 HTTP/1.1" 200 None
2026-03-30 10:44:33 [auto1.de] INFO: Scrape type for AJ41355: 2
2026-03-30 10:44:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37f09ccb-a2aa-54ae-ba5a-7e5cf9be71ca with identifier: AJ41355
2026-03-30 10:44:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37f09ccb-a2aa-54ae-ba5a-7e5cf9be71ca with scrape type 2
2026-03-30 10:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37f09ccb-a2aa-54ae-ba5a-7e5cf9be71ca with scrape type 2
2026-03-30 10:44:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37f09ccb-a2aa-54ae-ba5a-7e5cf9be71ca, identifier: AJ41355
2026-03-30 10:44:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37f09ccb-a2aa-54ae-ba5a-7e5cf9be71ca with identifier: AJ41355
2026-03-30 10:44:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37f09ccb-a2aa-54ae-ba5a-7e5cf9be71ca with identifier: AJ41355
2026-03-30 10:44:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37f09ccb-a2aa-54ae-ba5a-7e5cf9be71ca with identifier: AJ41355 to the API
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:11:24Z',
 'fuel_type': 'diesel',
 'id': '37f09ccb-a2aa-54ae-ba5a-7e5cf9be71ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ41355',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 182625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-14',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Joy',
 'transmission': 'manual',
 'trim': 'Joy',
 'year': 2016}
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ41355%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [auto1.de] INFO: Saving data for AJ41355: {'auction_closing_time': 1774969884.0, 'created_time': 1773775426.804542, 'last_price_update_time': 1774867474.160397}
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ41355') HTTP/1.1" 204 0
2026-03-30 10:44:34 [auto1.de] INFO: Found listing with ID: DZ18684
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ18684%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [auto1.de] INFO: Scrape type for DZ18684: 2
2026-03-30 10:44:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a86fd51-9663-5485-b28e-a62483479552 with identifier: DZ18684
2026-03-30 10:44:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a86fd51-9663-5485-b28e-a62483479552 with scrape type 2
2026-03-30 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a86fd51-9663-5485-b28e-a62483479552 with scrape type 2
2026-03-30 10:44:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a86fd51-9663-5485-b28e-a62483479552, identifier: DZ18684
2026-03-30 10:44:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a86fd51-9663-5485-b28e-a62483479552 with identifier: DZ18684
2026-03-30 10:44:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a86fd51-9663-5485-b28e-a62483479552 with identifier: DZ18684
2026-03-30 10:44:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a86fd51-9663-5485-b28e-a62483479552 with identifier: DZ18684 to the API
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:42:06Z',
 'fuel_type': 'diesel',
 'id': '4a86fd51-9663-5485-b28e-a62483479552',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ18684',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 129778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-06',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 2.0 Blue-HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2014}
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ18684%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [auto1.de] INFO: Saving data for DZ18684: {'auction_closing_time': 1774971726.0, 'created_time': 1773342030.80372, 'last_price_update_time': 1774867474.620309}
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ18684') HTTP/1.1" 204 0
2026-03-30 10:44:34 [auto1.de] INFO: Found listing with ID: CH70727
2026-03-30 10:44:34 [auto1.de] INFO: Found listing with ID: RH55673
2026-03-30 10:44:34 [auto1.de] INFO: Found listing with ID: GV01951
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV01951%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [auto1.de] INFO: Scrape type for GV01951: 1
2026-03-30 10:44:34 [auto1.de] INFO: Found listing with ID: WR71249
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR71249%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [auto1.de] INFO: Scrape type for WR71249: 2
2026-03-30 10:44:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7f9c74e-2a1e-52e8-b3e2-aa0d19476a5e with identifier: WR71249
2026-03-30 10:44:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7f9c74e-2a1e-52e8-b3e2-aa0d19476a5e with scrape type 2
2026-03-30 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7f9c74e-2a1e-52e8-b3e2-aa0d19476a5e with scrape type 2
2026-03-30 10:44:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7f9c74e-2a1e-52e8-b3e2-aa0d19476a5e, identifier: WR71249
2026-03-30 10:44:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TA06372> (referer: https://www.auto1.com/v1/car-details-view/TA06372/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UN38218> (referer: https://www.auto1.com/v1/car-details-view/UN38218/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7f9c74e-2a1e-52e8-b3e2-aa0d19476a5e with identifier: WR71249
2026-03-30 10:44:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7f9c74e-2a1e-52e8-b3e2-aa0d19476a5e with identifier: WR71249
2026-03-30 10:44:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7f9c74e-2a1e-52e8-b3e2-aa0d19476a5e with identifier: WR71249 to the API
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 121,
 'expiration_date': '2026-03-31T15:59:11Z',
 'fuel_type': 'petrol',
 'id': 'c7f9c74e-2a1e-52e8-b3e2-aa0d19476a5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR71249',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 39109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-25',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Kangei',
 'transmission': 'manual',
 'trim': 'Kangei',
 'year': 2019}
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR71249%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [auto1.de] INFO: Saving data for WR71249: {'auction_closing_time': 1774972751.0, 'created_time': 1774001896.537393, 'last_price_update_time': 1774867475.196414}
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR71249') HTTP/1.1" 204 0
2026-03-30 10:44:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:35 [auto1.de] INFO: Found listing with ID: AY54602
2026-03-30 10:44:35 [auto1.de] INFO: Found listing with ID: SW67477
2026-03-30 10:44:35 [auto1.de] INFO: Found listing with ID: CG08115
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG08115%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [auto1.de] INFO: Scrape type for CG08115: 1
2026-03-30 10:44:35 [auto1.de] INFO: Found listing with ID: TU57543
2026-03-30 10:44:35 [auto1.de] INFO: Found listing with ID: NJ99756
2026-03-30 10:44:35 [auto1.de] INFO: Found listing with ID: XK73988
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK73988%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [auto1.de] INFO: Scrape type for XK73988: 1
2026-03-30 10:44:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec74d1f4-8456-5b6b-8228-a723e970ca67 with identifier: TA06372
2026-03-30 10:44:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec74d1f4-8456-5b6b-8228-a723e970ca67 with scrape type 1
2026-03-30 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec74d1f4-8456-5b6b-8228-a723e970ca67
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F5b%252Fd75b4728c779ee5eb4e99a5efc4188f9%252Fpa%252FTA06372_7a3bb97ba26e58b14b53c2372664271f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_7a3bb97ba26e58b14b53c2372664271f.jpg already downloaded
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F5b%252Fd75b4728c779ee5eb4e99a5efc4188f9%252Fpa%252FTA06372_b24b6e6a3c1df1143af5bb8bbfe374fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_b24b6e6a3c1df1143af5bb8bbfe374fb.jpg already downloaded
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F5b%252Fd75b4728c779ee5eb4e99a5efc4188f9%252Fpa%252FTA06372_2f196146a2fcdadb7ece1fb9a7074aab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_2f196146a2fcdadb7ece1fb9a7074aab.jpg already downloaded
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F5b%252Fd75b4728c779ee5eb4e99a5efc4188f9%252Fpa%252FTA06372_ccf651f837bb74ce2ec0046f55cb9462.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_ccf651f837bb74ce2ec0046f55cb9462.jpg already downloaded
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F5b%252Fd75b4728c779ee5eb4e99a5efc4188f9%252Fpa%252FTA06372_bff915afb297643f9e7bcb40af76537a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_bff915afb297643f9e7bcb40af76537a.jpg already downloaded
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F5b%252Fd75b4728c779ee5eb4e99a5efc4188f9%252Fpa%252FTA06372_badd57fe442fa75f199541991a0e64ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_badd57fe442fa75f199541991a0e64ac.jpg already downloaded
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F5b%252Fd75b4728c779ee5eb4e99a5efc4188f9%252Fpa%252FTA06372_42677e41365d2c663dde385eb0e69e15.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_42677e41365d2c663dde385eb0e69e15.jpg already downloaded
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F5b%252Fd75b4728c779ee5eb4e99a5efc4188f9%252Fpa%252FTA06372_01a98b8b41585c5687b4baad82814c6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_01a98b8b41585c5687b4baad82814c6f.jpg already downloaded
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F5b%252Fd75b4728c779ee5eb4e99a5efc4188f9%252Fpa%252FTA06372_0d19a84f050fe69dec93bc8943667ea1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_0d19a84f050fe69dec93bc8943667ea1.jpg already downloaded
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F5b%252Fd75b4728c779ee5eb4e99a5efc4188f9%252Fpa%252FTA06372_bd0ef92f3da86ac91a42bfc0194d4789.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_bd0ef92f3da86ac91a42bfc0194d4789.jpg already downloaded
2026-03-30 10:44:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec74d1f4-8456-5b6b-8228-a723e970ca67, identifier: TA06372
2026-03-30 10:44:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 849c2f94-f7f7-59eb-81fe-46c837a539ae with identifier: UN38218
2026-03-30 10:44:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 849c2f94-f7f7-59eb-81fe-46c837a539ae with scrape type 1
2026-03-30 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 849c2f94-f7f7-59eb-81fe-46c837a539ae
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_7f5da59096e29a9886fc1c005f5c9c8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_7f5da59096e29a9886fc1c005f5c9c8e.jpg not downloaded yet
2026-03-30 10:44:35 [auto1.de] INFO: Found listing with ID: CU76931
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU76931%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [auto1.de] INFO: Scrape type for CU76931: 2
2026-03-30 10:44:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7199633a-dbd9-53cb-8839-da87fec790c7 with identifier: CU76931
2026-03-30 10:44:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7199633a-dbd9-53cb-8839-da87fec790c7 with scrape type 2
2026-03-30 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7199633a-dbd9-53cb-8839-da87fec790c7 with scrape type 2
2026-03-30 10:44:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7199633a-dbd9-53cb-8839-da87fec790c7, identifier: CU76931
2026-03-30 10:44:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec74d1f4-8456-5b6b-8228-a723e970ca67 with identifier: TA06372
2026-03-30 10:44:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec74d1f4-8456-5b6b-8228-a723e970ca67 with identifier: TA06372
2026-03-30 10:44:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec74d1f4-8456-5b6b-8228-a723e970ca67 with identifier: TA06372 to the API
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TA06372>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:23:40Z',
 'fuel_type': 'diesel',
 'id': 'ec74d1f4-8456-5b6b-8228-a723e970ca67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA06372',
 'listing': 'auction',
 'location': 'DE, Cloppenburg',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 146792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_7a3bb97ba26e58b14b53c2372664271f.jpg',
                'https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_b24b6e6a3c1df1143af5bb8bbfe374fb.jpg',
                'https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_2f196146a2fcdadb7ece1fb9a7074aab.jpg',
                'https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_ccf651f837bb74ce2ec0046f55cb9462.jpg',
                'https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_bff915afb297643f9e7bcb40af76537a.jpg',
                'https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_badd57fe442fa75f199541991a0e64ac.jpg',
                'https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_42677e41365d2c663dde385eb0e69e15.jpg',
                'https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_01a98b8b41585c5687b4baad82814c6f.jpg',
                'https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_0d19a84f050fe69dec93bc8943667ea1.jpg',
                'https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_bd0ef92f3da86ac91a42bfc0194d4789.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec74d1f4-8456-5b6b-8228-a723e970ca67/ec74d1f4-8456-5b6b-8228-a723e970ca67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429514,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_7a3bb97ba26e58b14b53c2372664271f.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec74d1f4-8456-5b6b-8228-a723e970ca67/ec74d1f4-8456-5b6b-8228-a723e970ca67_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 444670,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_b24b6e6a3c1df1143af5bb8bbfe374fb.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec74d1f4-8456-5b6b-8228-a723e970ca67/ec74d1f4-8456-5b6b-8228-a723e970ca67_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388710,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_2f196146a2fcdadb7ece1fb9a7074aab.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec74d1f4-8456-5b6b-8228-a723e970ca67/ec74d1f4-8456-5b6b-8228-a723e970ca67_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372408,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_ccf651f837bb74ce2ec0046f55cb9462.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec74d1f4-8456-5b6b-8228-a723e970ca67/ec74d1f4-8456-5b6b-8228-a723e970ca67_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387087,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_bff915afb297643f9e7bcb40af76537a.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec74d1f4-8456-5b6b-8228-a723e970ca67/ec74d1f4-8456-5b6b-8228-a723e970ca67_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 404005,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_badd57fe442fa75f199541991a0e64ac.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec74d1f4-8456-5b6b-8228-a723e970ca67/ec74d1f4-8456-5b6b-8228-a723e970ca67_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367223,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_42677e41365d2c663dde385eb0e69e15.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec74d1f4-8456-5b6b-8228-a723e970ca67/ec74d1f4-8456-5b6b-8228-a723e970ca67_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 442874,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_01a98b8b41585c5687b4baad82814c6f.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec74d1f4-8456-5b6b-8228-a723e970ca67/ec74d1f4-8456-5b6b-8228-a723e970ca67_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369545,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_0d19a84f050fe69dec93bc8943667ea1.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec74d1f4-8456-5b6b-8228-a723e970ca67/ec74d1f4-8456-5b6b-8228-a723e970ca67_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353430,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/5b/d75b4728c779ee5eb4e99a5efc4188f9/pa/TA06372_bd0ef92f3da86ac91a42bfc0194d4789.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA06372%27 HTTP/1.1" 200 None
2026-03-30 10:44:36 [auto1.de] INFO: Saving data for TA06372: {'created_time': 1774867476.125326, 'last_price_update_time': 1774867476.125337, 'auction_closing_time': 1774970620.0}
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA06372') HTTP/1.1" 204 0
2026-03-30 10:44:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7199633a-dbd9-53cb-8839-da87fec790c7 with identifier: CU76931
2026-03-30 10:44:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7199633a-dbd9-53cb-8839-da87fec790c7 with identifier: CU76931
2026-03-30 10:44:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7199633a-dbd9-53cb-8839-da87fec790c7 with identifier: CU76931 to the API
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:40:32Z',
 'fuel_type': 'diesel',
 'id': '7199633a-dbd9-53cb-8839-da87fec790c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU76931',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 242639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2011}
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU76931%27 HTTP/1.1" 200 None
2026-03-30 10:44:36 [auto1.de] INFO: Saving data for CU76931: {'auction_closing_time': 1774971632.0, 'created_time': 1773775100.712366, 'last_price_update_time': 1774867476.537079}
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU76931') HTTP/1.1" 204 0
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_af25c064cfdcdbb467614b4640847b50.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_af25c064cfdcdbb467614b4640847b50.jpg not downloaded yet
2026-03-30 10:44:36 [auto1.de] INFO: Found listing with ID: CE39561
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE39561%27 HTTP/1.1" 200 None
2026-03-30 10:44:36 [auto1.de] INFO: Scrape type for CE39561: 2
2026-03-30 10:44:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5625891b-bb95-5d60-bc2c-5a78f5683cc6 with identifier: CE39561
2026-03-30 10:44:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5625891b-bb95-5d60-bc2c-5a78f5683cc6 with scrape type 2
2026-03-30 10:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5625891b-bb95-5d60-bc2c-5a78f5683cc6 with scrape type 2
2026-03-30 10:44:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5625891b-bb95-5d60-bc2c-5a78f5683cc6, identifier: CE39561
2026-03-30 10:44:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ED20045/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG93335/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5625891b-bb95-5d60-bc2c-5a78f5683cc6 with identifier: CE39561
2026-03-30 10:44:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5625891b-bb95-5d60-bc2c-5a78f5683cc6 with identifier: CE39561
2026-03-30 10:44:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5625891b-bb95-5d60-bc2c-5a78f5683cc6 with identifier: CE39561 to the API
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 232,
 'expiration_date': '2026-03-31T15:02:31Z',
 'fuel_type': 'diesel',
 'id': '5625891b-bb95-5d60-bc2c-5a78f5683cc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE39561',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 258851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-31',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2007}
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE39561%27 HTTP/1.1" 200 None
2026-03-30 10:44:37 [auto1.de] INFO: Saving data for CE39561: {'auction_closing_time': 1774969351.0, 'created_time': 1773304592.423599, 'last_price_update_time': 1774867477.362683}
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE39561') HTTP/1.1" 204 0
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_7b38747e038a5f71c301c9231fb4a481.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_7b38747e038a5f71c301c9231fb4a481.jpg not downloaded yet
2026-03-30 10:44:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:37 [auto1.de] INFO: Found listing with ID: EK50913
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK50913%27 HTTP/1.1" 200 None
2026-03-30 10:44:37 [auto1.de] INFO: Scrape type for EK50913: 2
2026-03-30 10:44:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e31c737-f318-5c60-a573-4f74624bf4e8 with identifier: EK50913
2026-03-30 10:44:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e31c737-f318-5c60-a573-4f74624bf4e8 with scrape type 2
2026-03-30 10:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e31c737-f318-5c60-a573-4f74624bf4e8 with scrape type 2
2026-03-30 10:44:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e31c737-f318-5c60-a573-4f74624bf4e8, identifier: EK50913
2026-03-30 10:44:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e31c737-f318-5c60-a573-4f74624bf4e8 with identifier: EK50913
2026-03-30 10:44:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e31c737-f318-5c60-a573-4f74624bf4e8 with identifier: EK50913
2026-03-30 10:44:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e31c737-f318-5c60-a573-4f74624bf4e8 with identifier: EK50913 to the API
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:12:25Z',
 'fuel_type': 'petrol',
 'id': '4e31c737-f318-5c60-a573-4f74624bf4e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK50913',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 42228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-10',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2019}
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK50913%27 HTTP/1.1" 200 None
2026-03-30 10:44:38 [auto1.de] INFO: Saving data for EK50913: {'auction_closing_time': 1774969945.0, 'created_time': 1773688911.239514, 'last_price_update_time': 1774867478.168818}
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK50913') HTTP/1.1" 204 0
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_c35f40dd797e412494291ab45b5d1dbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_c35f40dd797e412494291ab45b5d1dbf.jpg not downloaded yet
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: GF68697
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: AL28178
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL28178%27 HTTP/1.1" 200 None
2026-03-30 10:44:38 [auto1.de] INFO: Scrape type for AL28178: 1
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_dc0887745e82ae5721840236bd86507e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_dc0887745e82ae5721840236bd86507e.jpg not downloaded yet
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: TN97869
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: ZG52412
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: DT44924
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT44924%27 HTTP/1.1" 200 None
2026-03-30 10:44:38 [auto1.de] INFO: Scrape type for DT44924: 1
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_e6b81798155473de1bd6c2ab4a35141a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_e6b81798155473de1bd6c2ab4a35141a.jpg not downloaded yet
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: TP11686
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: BX30024
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX30024%27 HTTP/1.1" 200 None
2026-03-30 10:44:38 [auto1.de] INFO: Scrape type for BX30024: 1
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_d03a76f666ee83452625f172f4f47460.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_d03a76f666ee83452625f172f4f47460.jpg not downloaded yet
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: DP32279
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: LX18259
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX18259%27 HTTP/1.1" 200 None
2026-03-30 10:44:38 [auto1.de] INFO: Scrape type for LX18259: 1
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_8bb603bf5775d48d42132b9ae186b4df.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_8bb603bf5775d48d42132b9ae186b4df.jpg not downloaded yet
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: GZ97235
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ97235%27 HTTP/1.1" 200 None
2026-03-30 10:44:38 [auto1.de] INFO: Scrape type for GZ97235: 1
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_5e9476b61d82b454e5608bd4a043b87e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_5e9476b61d82b454e5608bd4a043b87e.jpg not downloaded yet
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: LW43153
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: XT84885
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: RK06421
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK06421%27 HTTP/1.1" 200 None
2026-03-30 10:44:38 [auto1.de] INFO: Scrape type for RK06421: 1
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_d33f25268203084dd861df416c9074f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_d33f25268203084dd861df416c9074f5.jpg not downloaded yet
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: RY02033
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: YL37879
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: RR13912
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR13912%27 HTTP/1.1" 200 None
2026-03-30 10:44:38 [auto1.de] INFO: Scrape type for RR13912: 1
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: RK02982
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK02982%27 HTTP/1.1" 200 None
2026-03-30 10:44:38 [auto1.de] INFO: Scrape type for RK02982: 1
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: EJ29706
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: PR60744
2026-03-30 10:44:38 [auto1.de] INFO: Found listing with ID: JJ25259
2026-03-30 10:44:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_7f5da59096e29a9886fc1c005f5c9c8e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_af25c064cfdcdbb467614b4640847b50.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef4b50>
2026-03-30 10:44:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_7f5da59096e29a9886fc1c005f5c9c8e.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_7f5da59096e29a9886fc1c005f5c9c8e.jpg saved to cache
2026-03-30 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 849c2f94-f7f7-59eb-81fe-46c837a539ae
2026-03-30 10:44:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb3a90>
2026-03-30 10:44:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_af25c064cfdcdbb467614b4640847b50.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_af25c064cfdcdbb467614b4640847b50.jpg saved to cache
2026-03-30 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 849c2f94-f7f7-59eb-81fe-46c837a539ae
2026-03-30 10:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KN84771/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_d33f25268203084dd861df416c9074f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e3390>
2026-03-30 10:44:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_d33f25268203084dd861df416c9074f5.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_d33f25268203084dd861df416c9074f5.jpg saved to cache
2026-03-30 10:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 849c2f94-f7f7-59eb-81fe-46c837a539ae
2026-03-30 10:44:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR92367> (referer: https://www.auto1.com/v1/car-details-view/TR92367/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0788743d-e813-5253-8a2f-20ea9969e0ce with identifier: TR92367
2026-03-30 10:44:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0788743d-e813-5253-8a2f-20ea9969e0ce with scrape type 1
2026-03-30 10:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0788743d-e813-5253-8a2f-20ea9969e0ce
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_de97684eb377fe18e36e5cd657d613e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_de97684eb377fe18e36e5cd657d613e1.jpg not downloaded yet
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_4e06be959cc56a080042550f56329f92.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_4e06be959cc56a080042550f56329f92.jpg not downloaded yet
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_558078ef5c591a6610ecf197bba426c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_558078ef5c591a6610ecf197bba426c3.jpg not downloaded yet
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_a0daaf6c07aaf81f4f7d47615a8cec1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_a0daaf6c07aaf81f4f7d47615a8cec1c.jpg not downloaded yet
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_b403543394e6e6e6daed1b5be3435ff7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_b403543394e6e6e6daed1b5be3435ff7.jpg not downloaded yet
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_4edbdb5436cb5b1200cde55323e89571.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_4edbdb5436cb5b1200cde55323e89571.jpg not downloaded yet
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_5b605b5901a0185865924c111dd85aa2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_5b605b5901a0185865924c111dd85aa2.jpg not downloaded yet
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_3a10263254fc3751aadd49d499204c5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_3a10263254fc3751aadd49d499204c5b.jpg not downloaded yet
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_0003e2c8d6d45f6b2fe2f3f33406bcc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_0003e2c8d6d45f6b2fe2f3f33406bcc4.jpg not downloaded yet
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_7cc503b41c3c72f3f91eba3b272da0a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_7cc503b41c3c72f3f91eba3b272da0a6.jpg not downloaded yet
2026-03-30 10:44:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XS59646> (referer: https://www.auto1.com/v1/car-details-view/XS59646/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9c49994-5044-597b-876e-508b4dac1277 with identifier: XS59646
2026-03-30 10:44:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9c49994-5044-597b-876e-508b4dac1277 with scrape type 1
2026-03-30 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9c49994-5044-597b-876e-508b4dac1277
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_c7038d40fcbe283c249ce34a8371ea38.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_c7038d40fcbe283c249ce34a8371ea38.jpg not downloaded yet
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_f1155296cdbef0fda935e6a0a7a94a0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_f1155296cdbef0fda935e6a0a7a94a0f.jpg not downloaded yet
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_587d0649cc26c822d3a1d9407ad56142.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_587d0649cc26c822d3a1d9407ad56142.jpg not downloaded yet
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_5f78d857c2ccfef7516556b53740cb92.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_5f78d857c2ccfef7516556b53740cb92.jpg not downloaded yet
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_a2b09343f0a04245e0030260456af74a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_a2b09343f0a04245e0030260456af74a.jpg not downloaded yet
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_b6eb9c403a31ddd9afad88cd4ebc527b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_b6eb9c403a31ddd9afad88cd4ebc527b.jpg not downloaded yet
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_ba5c644525daa6a71cd6cd268b7e452a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_ba5c644525daa6a71cd6cd268b7e452a.jpg not downloaded yet
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_f4406d4fb7c0f2932c5a9d0d005519f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_f4406d4fb7c0f2932c5a9d0d005519f3.jpg not downloaded yet
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_369b25c78f9481ee1dec317add687f64.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_369b25c78f9481ee1dec317add687f64.jpg not downloaded yet
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_159e7950113e58e4ed9bc7dcaa2cd276.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_159e7950113e58e4ed9bc7dcaa2cd276.jpg not downloaded yet
2026-03-30 10:44:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_7cc503b41c3c72f3f91eba3b272da0a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef51d10>
2026-03-30 10:44:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_7cc503b41c3c72f3f91eba3b272da0a6.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_7cc503b41c3c72f3f91eba3b272da0a6.jpg saved to cache
2026-03-30 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0788743d-e813-5253-8a2f-20ea9969e0ce
2026-03-30 10:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_159e7950113e58e4ed9bc7dcaa2cd276.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414f5d0>
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_159e7950113e58e4ed9bc7dcaa2cd276.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_159e7950113e58e4ed9bc7dcaa2cd276.jpg saved to cache
2026-03-30 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9c49994-5044-597b-876e-508b4dac1277
2026-03-30 10:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_369b25c78f9481ee1dec317add687f64.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee42c10>
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_369b25c78f9481ee1dec317add687f64.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_369b25c78f9481ee1dec317add687f64.jpg saved to cache
2026-03-30 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9c49994-5044-597b-876e-508b4dac1277
2026-03-30 10:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_f4406d4fb7c0f2932c5a9d0d005519f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee443150>
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_f4406d4fb7c0f2932c5a9d0d005519f3.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_f4406d4fb7c0f2932c5a9d0d005519f3.jpg saved to cache
2026-03-30 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9c49994-5044-597b-876e-508b4dac1277
2026-03-30 10:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB73143/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_ba5c644525daa6a71cd6cd268b7e452a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee40250>
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_ba5c644525daa6a71cd6cd268b7e452a.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_ba5c644525daa6a71cd6cd268b7e452a.jpg saved to cache
2026-03-30 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9c49994-5044-597b-876e-508b4dac1277
2026-03-30 10:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_b6eb9c403a31ddd9afad88cd4ebc527b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_a2b09343f0a04245e0030260456af74a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee3f950>
2026-03-30 10:44:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_b6eb9c403a31ddd9afad88cd4ebc527b.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_b6eb9c403a31ddd9afad88cd4ebc527b.jpg saved to cache
2026-03-30 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9c49994-5044-597b-876e-508b4dac1277
2026-03-30 10:44:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef52d10>
2026-03-30 10:44:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_a2b09343f0a04245e0030260456af74a.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_a2b09343f0a04245e0030260456af74a.jpg saved to cache
2026-03-30 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9c49994-5044-597b-876e-508b4dac1277
2026-03-30 10:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BG30699> (referer: https://www.auto1.com/v1/car-details-view/BG30699/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4deba4b-66a7-5098-b4a8-e464d15d76e5 with identifier: BG30699
2026-03-30 10:44:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4deba4b-66a7-5098-b4a8-e464d15d76e5 with scrape type 1
2026-03-30 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b4deba4b-66a7-5098-b4a8-e464d15d76e5
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F93%252Fc3932f12f43fe6daa07abb55509bc744%252Fpa%252FBG30699_ba8752c7e84b2cef187d6a9b7505d9de.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_ba8752c7e84b2cef187d6a9b7505d9de.jpg not downloaded yet
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F93%252Fc3932f12f43fe6daa07abb55509bc744%252Fpa%252FBG30699_ded685322d4dfe096b917b49832de416.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_ded685322d4dfe096b917b49832de416.jpg not downloaded yet
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F93%252Fc3932f12f43fe6daa07abb55509bc744%252Fpa%252FBG30699_7a9d221cea513e0ac1f4fd8aec6a9e8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_7a9d221cea513e0ac1f4fd8aec6a9e8d.jpg not downloaded yet
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F93%252Fc3932f12f43fe6daa07abb55509bc744%252Fpa%252FBG30699_70a9f5401b6bb0223596e6b43728ccc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_70a9f5401b6bb0223596e6b43728ccc3.jpg not downloaded yet
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F93%252Fc3932f12f43fe6daa07abb55509bc744%252Fpa%252FBG30699_b37a2567ce84bcb985f575eda41abfec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_b37a2567ce84bcb985f575eda41abfec.jpg not downloaded yet
2026-03-30 10:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE10488/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_b37a2567ce84bcb985f575eda41abfec.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_587d0649cc26c822d3a1d9407ad56142.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_70a9f5401b6bb0223596e6b43728ccc3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_5f78d857c2ccfef7516556b53740cb92.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefea210>
2026-03-30 10:44:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4deba4b-66a7-5098-b4a8-e464d15d76e5/b4deba4b-66a7-5098-b4a8-e464d15d76e5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F93%252Fc3932f12f43fe6daa07abb55509bc744%252Fpa%252FBG30699_b37a2567ce84bcb985f575eda41abfec.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_b37a2567ce84bcb985f575eda41abfec.jpg saved to cache
2026-03-30 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4deba4b-66a7-5098-b4a8-e464d15d76e5
2026-03-30 10:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_7a9d221cea513e0ac1f4fd8aec6a9e8d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XD17541/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeed0850>
2026-03-30 10:44:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_587d0649cc26c822d3a1d9407ad56142.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_587d0649cc26c822d3a1d9407ad56142.jpg saved to cache
2026-03-30 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9c49994-5044-597b-876e-508b4dac1277
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41e97d0>
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4deba4b-66a7-5098-b4a8-e464d15d76e5/b4deba4b-66a7-5098-b4a8-e464d15d76e5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F93%252Fc3932f12f43fe6daa07abb55509bc744%252Fpa%252FBG30699_70a9f5401b6bb0223596e6b43728ccc3.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_70a9f5401b6bb0223596e6b43728ccc3.jpg saved to cache
2026-03-30 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4deba4b-66a7-5098-b4a8-e464d15d76e5
2026-03-30 10:44:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41f11d0>
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_5f78d857c2ccfef7516556b53740cb92.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_5f78d857c2ccfef7516556b53740cb92.jpg saved to cache
2026-03-30 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9c49994-5044-597b-876e-508b4dac1277
2026-03-30 10:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GV01951/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3bb50>
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4deba4b-66a7-5098-b4a8-e464d15d76e5/b4deba4b-66a7-5098-b4a8-e464d15d76e5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F93%252Fc3932f12f43fe6daa07abb55509bc744%252Fpa%252FBG30699_7a9d221cea513e0ac1f4fd8aec6a9e8d.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_7a9d221cea513e0ac1f4fd8aec6a9e8d.jpg saved to cache
2026-03-30 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4deba4b-66a7-5098-b4a8-e464d15d76e5
2026-03-30 10:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_ba8752c7e84b2cef187d6a9b7505d9de.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_ded685322d4dfe096b917b49832de416.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42168d0>
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4deba4b-66a7-5098-b4a8-e464d15d76e5/b4deba4b-66a7-5098-b4a8-e464d15d76e5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F93%252Fc3932f12f43fe6daa07abb55509bc744%252Fpa%252FBG30699_ba8752c7e84b2cef187d6a9b7505d9de.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_ba8752c7e84b2cef187d6a9b7505d9de.jpg saved to cache
2026-03-30 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4deba4b-66a7-5098-b4a8-e464d15d76e5
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f433b7d0>
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4deba4b-66a7-5098-b4a8-e464d15d76e5/b4deba4b-66a7-5098-b4a8-e464d15d76e5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F93%252Fc3932f12f43fe6daa07abb55509bc744%252Fpa%252FBG30699_ded685322d4dfe096b917b49832de416.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_ded685322d4dfe096b917b49832de416.jpg saved to cache
2026-03-30 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4deba4b-66a7-5098-b4a8-e464d15d76e5
2026-03-30 10:44:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4deba4b-66a7-5098-b4a8-e464d15d76e5, skipping ID generation
2026-03-30 10:44:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4deba4b-66a7-5098-b4a8-e464d15d76e5 with scrape type 1
2026-03-30 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4deba4b-66a7-5098-b4a8-e464d15d76e5 sending to next pipeline
2026-03-30 10:44:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4deba4b-66a7-5098-b4a8-e464d15d76e5, identifier: BG30699
2026-03-30 10:44:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4deba4b-66a7-5098-b4a8-e464d15d76e5 with identifier: BG30699
2026-03-30 10:44:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4deba4b-66a7-5098-b4a8-e464d15d76e5 with identifier: BG30699
2026-03-30 10:44:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4deba4b-66a7-5098-b4a8-e464d15d76e5 with identifier: BG30699 to the API
2026-03-30 10:44:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_ded685322d4dfe096b917b49832de416.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:23:20Z',
 'fuel_type': 'petrol',
 'id': 'b4deba4b-66a7-5098-b4a8-e464d15d76e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG30699',
 'listing': 'auction',
 'location': 'DE, Rostock',
 'make': 'Suzuki',
 'model': 'Splash',
 'odometer': 128730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4deba4b-66a7-5098-b4a8-e464d15d76e5/b4deba4b-66a7-5098-b4a8-e464d15d76e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_ba8752c7e84b2cef187d6a9b7505d9de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4deba4b-66a7-5098-b4a8-e464d15d76e5/b4deba4b-66a7-5098-b4a8-e464d15d76e5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_ded685322d4dfe096b917b49832de416.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4deba4b-66a7-5098-b4a8-e464d15d76e5/b4deba4b-66a7-5098-b4a8-e464d15d76e5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_7a9d221cea513e0ac1f4fd8aec6a9e8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4deba4b-66a7-5098-b4a8-e464d15d76e5/b4deba4b-66a7-5098-b4a8-e464d15d76e5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_70a9f5401b6bb0223596e6b43728ccc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4deba4b-66a7-5098-b4a8-e464d15d76e5/b4deba4b-66a7-5098-b4a8-e464d15d76e5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/93/c3932f12f43fe6daa07abb55509bc744/pa/BG30699_b37a2567ce84bcb985f575eda41abfec.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': "Suzuki Splash 1.2 Germany's next Topmodel",
 'transmission': 'manual',
 'trim': "Germany's next Topmodel",
 'year': 2009}
2026-03-30 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG30699%27 HTTP/1.1" 200 None
2026-03-30 10:44:46 [auto1.de] INFO: Saving data for BG30699: {'created_time': 1774867486.35196, 'last_price_update_time': 1774867486.351972, 'auction_closing_time': 1774970600.0}
2026-03-30 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG30699') HTTP/1.1" 204 0
2026-03-30 10:44:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK02982/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_f1155296cdbef0fda935e6a0a7a94a0f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_c7038d40fcbe283c249ce34a8371ea38.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefde090>
2026-03-30 10:44:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_f1155296cdbef0fda935e6a0a7a94a0f.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_f1155296cdbef0fda935e6a0a7a94a0f.jpg saved to cache
2026-03-30 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9c49994-5044-597b-876e-508b4dac1277
2026-03-30 10:44:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee40b50>
2026-03-30 10:44:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F05%252F3905cd675cf9ebeb120a72fd31dd4cc2%252Fpa%252FXS59646_c7038d40fcbe283c249ce34a8371ea38.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_c7038d40fcbe283c249ce34a8371ea38.jpg saved to cache
2026-03-30 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9c49994-5044-597b-876e-508b4dac1277
2026-03-30 10:44:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9c49994-5044-597b-876e-508b4dac1277, skipping ID generation
2026-03-30 10:44:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9c49994-5044-597b-876e-508b4dac1277 with scrape type 1
2026-03-30 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9c49994-5044-597b-876e-508b4dac1277 sending to next pipeline
2026-03-30 10:44:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9c49994-5044-597b-876e-508b4dac1277, identifier: XS59646
2026-03-30 10:44:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9c49994-5044-597b-876e-508b4dac1277 with identifier: XS59646
2026-03-30 10:44:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9c49994-5044-597b-876e-508b4dac1277 with identifier: XS59646
2026-03-30 10:44:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9c49994-5044-597b-876e-508b4dac1277 with identifier: XS59646 to the API
2026-03-30 10:44:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_c7038d40fcbe283c249ce34a8371ea38.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '5.7L',
 'engine_horse_power': 305,
 'expiration_date': '2026-03-31T15:23:01Z',
 'fuel_type': 'petrol',
 'id': 'c9c49994-5044-597b-876e-508b4dac1277',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS59646',
 'listing': 'auction',
 'location': 'DE, Gummersbach',
 'make': 'Chevrolet',
 'model': 'Corvette',
 'odometer': 86006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2831257,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_c7038d40fcbe283c249ce34a8371ea38.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2861361,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_f1155296cdbef0fda935e6a0a7a94a0f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3092441,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_587d0649cc26c822d3a1d9407ad56142.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2789127,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_5f78d857c2ccfef7516556b53740cb92.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2787516,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_a2b09343f0a04245e0030260456af74a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2877859,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_b6eb9c403a31ddd9afad88cd4ebc527b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2679448,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_ba5c644525daa6a71cd6cd268b7e452a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2827693,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_f4406d4fb7c0f2932c5a9d0d005519f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2523883,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_369b25c78f9481ee1dec317add687f64.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c49994-5044-597b-876e-508b4dac1277/c9c49994-5044-597b-876e-508b4dac1277_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3167618,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/05/3905cd675cf9ebeb120a72fd31dd4cc2/pa/XS59646_159e7950113e58e4ed9bc7dcaa2cd276.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1992-05-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Chevrolet Corvette 5.7 V8 Cabrio',
 'transmission': 'automatic',
 'trim': 'Cabrio',
 'year': 1992}
2026-03-30 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS59646%27 HTTP/1.1" 200 None
2026-03-30 10:44:47 [auto1.de] INFO: Saving data for XS59646: {'created_time': 1774867487.248926, 'last_price_update_time': 1774867487.248938, 'auction_closing_time': 1774970581.0}
2026-03-30 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS59646') HTTP/1.1" 204 0
2026-03-30 10:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_3a10263254fc3751aadd49d499204c5b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_0003e2c8d6d45f6b2fe2f3f33406bcc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5dfd790>
2026-03-30 10:44:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_3a10263254fc3751aadd49d499204c5b.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_3a10263254fc3751aadd49d499204c5b.jpg saved to cache
2026-03-30 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0788743d-e813-5253-8a2f-20ea9969e0ce
2026-03-30 10:44:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee43910>
2026-03-30 10:44:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_0003e2c8d6d45f6b2fe2f3f33406bcc4.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_0003e2c8d6d45f6b2fe2f3f33406bcc4.jpg saved to cache
2026-03-30 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0788743d-e813-5253-8a2f-20ea9969e0ce
2026-03-30 10:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT57344/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_5b605b5901a0185865924c111dd85aa2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_a0daaf6c07aaf81f4f7d47615a8cec1c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_4edbdb5436cb5b1200cde55323e89571.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3eba50>
2026-03-30 10:44:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_5b605b5901a0185865924c111dd85aa2.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_5b605b5901a0185865924c111dd85aa2.jpg saved to cache
2026-03-30 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0788743d-e813-5253-8a2f-20ea9969e0ce
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee43250>
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_a0daaf6c07aaf81f4f7d47615a8cec1c.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_a0daaf6c07aaf81f4f7d47615a8cec1c.jpg saved to cache
2026-03-30 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0788743d-e813-5253-8a2f-20ea9969e0ce
2026-03-30 10:44:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee3d4d0>
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_4edbdb5436cb5b1200cde55323e89571.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_4edbdb5436cb5b1200cde55323e89571.jpg saved to cache
2026-03-30 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0788743d-e813-5253-8a2f-20ea9969e0ce
2026-03-30 10:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_b403543394e6e6e6daed1b5be3435ff7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_558078ef5c591a6610ecf197bba426c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea1110>
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_b403543394e6e6e6daed1b5be3435ff7.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_b403543394e6e6e6daed1b5be3435ff7.jpg saved to cache
2026-03-30 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0788743d-e813-5253-8a2f-20ea9969e0ce
2026-03-30 10:44:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee87690>
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_558078ef5c591a6610ecf197bba426c3.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_558078ef5c591a6610ecf197bba426c3.jpg saved to cache
2026-03-30 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0788743d-e813-5253-8a2f-20ea9969e0ce
2026-03-30 10:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_4e06be959cc56a080042550f56329f92.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea0050>
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_4e06be959cc56a080042550f56329f92.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_4e06be959cc56a080042550f56329f92.jpg saved to cache
2026-03-30 10:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0788743d-e813-5253-8a2f-20ea9969e0ce
2026-03-30 10:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_de97684eb377fe18e36e5cd657d613e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef9fc50>
2026-03-30 10:44:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F5b%252F6b5bf243e143ad9374d6a8be3e97dff6%252Fpa%252FTR92367_de97684eb377fe18e36e5cd657d613e1.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_de97684eb377fe18e36e5cd657d613e1.jpg saved to cache
2026-03-30 10:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0788743d-e813-5253-8a2f-20ea9969e0ce
2026-03-30 10:44:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0788743d-e813-5253-8a2f-20ea9969e0ce, skipping ID generation
2026-03-30 10:44:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0788743d-e813-5253-8a2f-20ea9969e0ce with scrape type 1
2026-03-30 10:44:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0788743d-e813-5253-8a2f-20ea9969e0ce sending to next pipeline
2026-03-30 10:44:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0788743d-e813-5253-8a2f-20ea9969e0ce, identifier: TR92367
2026-03-30 10:44:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0788743d-e813-5253-8a2f-20ea9969e0ce with identifier: TR92367
2026-03-30 10:44:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0788743d-e813-5253-8a2f-20ea9969e0ce with identifier: TR92367
2026-03-30 10:44:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0788743d-e813-5253-8a2f-20ea9969e0ce with identifier: TR92367 to the API
2026-03-30 10:44:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_de97684eb377fe18e36e5cd657d613e1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:34:12Z',
 'fuel_type': 'petrol',
 'id': '0788743d-e813-5253-8a2f-20ea9969e0ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR92367',
 'listing': 'auction',
 'location': 'DE, Petersberg',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 98121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3129573,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_de97684eb377fe18e36e5cd657d613e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3057528,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_4e06be959cc56a080042550f56329f92.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2791738,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_558078ef5c591a6610ecf197bba426c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_a0daaf6c07aaf81f4f7d47615a8cec1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2706477,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_b403543394e6e6e6daed1b5be3435ff7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2773376,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_4edbdb5436cb5b1200cde55323e89571.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2705053,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_5b605b5901a0185865924c111dd85aa2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2787301,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_3a10263254fc3751aadd49d499204c5b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2974546,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_0003e2c8d6d45f6b2fe2f3f33406bcc4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0788743d-e813-5253-8a2f-20ea9969e0ce/0788743d-e813-5253-8a2f-20ea9969e0ce_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3198435,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/5b/6b5bf243e143ad9374d6a8be3e97dff6/pa/TR92367_7cc503b41c3c72f3f91eba3b272da0a6.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 220 4Matic Urban',
 'transmission': 'automatic',
 'trim': '4Matic Urban',
 'year': 2015}
2026-03-30 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR92367%27 HTTP/1.1" 200 None
2026-03-30 10:44:49 [auto1.de] INFO: Saving data for TR92367: {'created_time': 1774867489.876546, 'last_price_update_time': 1774867489.876557, 'auction_closing_time': 1774971252.0}
2026-03-30 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR92367') HTTP/1.1" 204 0
2026-03-30 10:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RR13912/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_5e9476b61d82b454e5608bd4a043b87e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee3c750>
2026-03-30 10:44:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_5e9476b61d82b454e5608bd4a043b87e.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_5e9476b61d82b454e5608bd4a043b87e.jpg saved to cache
2026-03-30 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 849c2f94-f7f7-59eb-81fe-46c837a539ae
2026-03-30 10:44:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_8bb603bf5775d48d42132b9ae186b4df.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d1110>
2026-03-30 10:44:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_8bb603bf5775d48d42132b9ae186b4df.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_8bb603bf5775d48d42132b9ae186b4df.jpg saved to cache
2026-03-30 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 849c2f94-f7f7-59eb-81fe-46c837a539ae
2026-03-30 10:44:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KN84771> (referer: https://www.auto1.com/v1/car-details-view/KN84771/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 311b5876-2175-5863-b828-91f02bdecd84 with identifier: KN84771
2026-03-30 10:44:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 311b5876-2175-5863-b828-91f02bdecd84 with scrape type 1
2026-03-30 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 311b5876-2175-5863-b828-91f02bdecd84
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa1%252F5ba1582c96a4eaeef1482f71b4298778%252Fpa%252FKN84771_a15f79870e34dc7c8ee26744a49d28b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_a15f79870e34dc7c8ee26744a49d28b6.jpg not downloaded yet
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa1%252F5ba1582c96a4eaeef1482f71b4298778%252Fpa%252FKN84771_8be24b0fb36ea2107c880ba52fcdcb8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_8be24b0fb36ea2107c880ba52fcdcb8d.jpg not downloaded yet
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa1%252F5ba1582c96a4eaeef1482f71b4298778%252Fpa%252FKN84771_a04eb564bd3faf3392f632eeb1679fd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_a04eb564bd3faf3392f632eeb1679fd6.jpg not downloaded yet
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa1%252F5ba1582c96a4eaeef1482f71b4298778%252Fpa%252FKN84771_b5f64c922f673f500b35dc189bb69e47.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_b5f64c922f673f500b35dc189bb69e47.jpg not downloaded yet
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa1%252F5ba1582c96a4eaeef1482f71b4298778%252Fpa%252FKN84771_21584e8ae3316487efd4f80aa1ffe17e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_21584e8ae3316487efd4f80aa1ffe17e.jpg not downloaded yet
2026-03-30 10:44:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_d03a76f666ee83452625f172f4f47460.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_21584e8ae3316487efd4f80aa1ffe17e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434c790>
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_d03a76f666ee83452625f172f4f47460.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_d03a76f666ee83452625f172f4f47460.jpg saved to cache
2026-03-30 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 849c2f94-f7f7-59eb-81fe-46c837a539ae
2026-03-30 10:44:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_b5f64c922f673f500b35dc189bb69e47.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef3c50>
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311b5876-2175-5863-b828-91f02bdecd84/311b5876-2175-5863-b828-91f02bdecd84_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa1%252F5ba1582c96a4eaeef1482f71b4298778%252Fpa%252FKN84771_21584e8ae3316487efd4f80aa1ffe17e.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_21584e8ae3316487efd4f80aa1ffe17e.jpg saved to cache
2026-03-30 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 311b5876-2175-5863-b828-91f02bdecd84
2026-03-30 10:44:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_a04eb564bd3faf3392f632eeb1679fd6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef0df10>
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311b5876-2175-5863-b828-91f02bdecd84/311b5876-2175-5863-b828-91f02bdecd84_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa1%252F5ba1582c96a4eaeef1482f71b4298778%252Fpa%252FKN84771_b5f64c922f673f500b35dc189bb69e47.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_b5f64c922f673f500b35dc189bb69e47.jpg saved to cache
2026-03-30 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 311b5876-2175-5863-b828-91f02bdecd84
2026-03-30 10:44:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_8be24b0fb36ea2107c880ba52fcdcb8d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41c44d0>
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311b5876-2175-5863-b828-91f02bdecd84/311b5876-2175-5863-b828-91f02bdecd84_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa1%252F5ba1582c96a4eaeef1482f71b4298778%252Fpa%252FKN84771_a04eb564bd3faf3392f632eeb1679fd6.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_a04eb564bd3faf3392f632eeb1679fd6.jpg saved to cache
2026-03-30 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 311b5876-2175-5863-b828-91f02bdecd84
2026-03-30 10:44:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_a15f79870e34dc7c8ee26744a49d28b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee48990>
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311b5876-2175-5863-b828-91f02bdecd84/311b5876-2175-5863-b828-91f02bdecd84_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa1%252F5ba1582c96a4eaeef1482f71b4298778%252Fpa%252FKN84771_8be24b0fb36ea2107c880ba52fcdcb8d.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_8be24b0fb36ea2107c880ba52fcdcb8d.jpg saved to cache
2026-03-30 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 311b5876-2175-5863-b828-91f02bdecd84
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefea690>
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311b5876-2175-5863-b828-91f02bdecd84/311b5876-2175-5863-b828-91f02bdecd84_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa1%252F5ba1582c96a4eaeef1482f71b4298778%252Fpa%252FKN84771_a15f79870e34dc7c8ee26744a49d28b6.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_a15f79870e34dc7c8ee26744a49d28b6.jpg saved to cache
2026-03-30 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 311b5876-2175-5863-b828-91f02bdecd84
2026-03-30 10:44:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 311b5876-2175-5863-b828-91f02bdecd84, skipping ID generation
2026-03-30 10:44:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 311b5876-2175-5863-b828-91f02bdecd84 with scrape type 1
2026-03-30 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 311b5876-2175-5863-b828-91f02bdecd84 sending to next pipeline
2026-03-30 10:44:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 311b5876-2175-5863-b828-91f02bdecd84, identifier: KN84771
2026-03-30 10:44:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 311b5876-2175-5863-b828-91f02bdecd84 with identifier: KN84771
2026-03-30 10:44:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 311b5876-2175-5863-b828-91f02bdecd84 with identifier: KN84771
2026-03-30 10:44:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 311b5876-2175-5863-b828-91f02bdecd84 with identifier: KN84771 to the API
2026-03-30 10:44:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_a15f79870e34dc7c8ee26744a49d28b6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:43:04Z',
 'fuel_type': 'diesel',
 'id': '311b5876-2175-5863-b828-91f02bdecd84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN84771',
 'listing': 'auction',
 'location': 'DE, Göppingen',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 297459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311b5876-2175-5863-b828-91f02bdecd84/311b5876-2175-5863-b828-91f02bdecd84_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_a15f79870e34dc7c8ee26744a49d28b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311b5876-2175-5863-b828-91f02bdecd84/311b5876-2175-5863-b828-91f02bdecd84_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_8be24b0fb36ea2107c880ba52fcdcb8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311b5876-2175-5863-b828-91f02bdecd84/311b5876-2175-5863-b828-91f02bdecd84_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_a04eb564bd3faf3392f632eeb1679fd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311b5876-2175-5863-b828-91f02bdecd84/311b5876-2175-5863-b828-91f02bdecd84_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_b5f64c922f673f500b35dc189bb69e47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311b5876-2175-5863-b828-91f02bdecd84/311b5876-2175-5863-b828-91f02bdecd84_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 150778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/a1/5ba1582c96a4eaeef1482f71b4298778/pa/KN84771_21584e8ae3316487efd4f80aa1ffe17e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Freestyle BlueMotion',
 'transmission': 'manual',
 'trim': 'Freestyle BlueMotion',
 'year': 2009}
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN84771%27 HTTP/1.1" 200 None
2026-03-30 10:44:52 [auto1.de] INFO: Saving data for KN84771: {'created_time': 1774867492.235325, 'last_price_update_time': 1774867492.235336, 'auction_closing_time': 1774971784.0}
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN84771') HTTP/1.1" 204 0
2026-03-30 10:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE10488> (referer: https://www.auto1.com/v1/car-details-view/RE10488/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72af2544-fc34-5541-b3b1-75f6d0c61c00 with identifier: RE10488
2026-03-30 10:44:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72af2544-fc34-5541-b3b1-75f6d0c61c00 with scrape type 1
2026-03-30 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 72af2544-fc34-5541-b3b1-75f6d0c61c00
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_17c9198f94ee27931bf11fab0b843d60.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_17c9198f94ee27931bf11fab0b843d60.jpg not downloaded yet
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_e79d06b1e74e29b6803ba3e1449bd86f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_e79d06b1e74e29b6803ba3e1449bd86f.jpg not downloaded yet
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_a8c5211375b32f42b4ec1af2d9c8dee6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_a8c5211375b32f42b4ec1af2d9c8dee6.jpg not downloaded yet
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_486d9e8f6461910893c2f8a8449b3416.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_486d9e8f6461910893c2f8a8449b3416.jpg not downloaded yet
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_4385d879427d7983f1e255685a637d78.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_4385d879427d7983f1e255685a637d78.jpg not downloaded yet
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_5dec90ac13a652878f21c9685fd75fcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_5dec90ac13a652878f21c9685fd75fcc.jpg not downloaded yet
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_dd0fc364a84e8b59558d00c4256ac1c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_dd0fc364a84e8b59558d00c4256ac1c3.jpg not downloaded yet
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_88c4235735a516fb7dc723cea0754811.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_88c4235735a516fb7dc723cea0754811.jpg not downloaded yet
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_1519ae923195d537ed83cc0d8c080bf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_1519ae923195d537ed83cc0d8c080bf3.jpg not downloaded yet
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_0378df5233c1ad33694294d95befa1e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_0378df5233c1ad33694294d95befa1e9.jpg not downloaded yet
2026-03-30 10:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_e6b81798155473de1bd6c2ab4a35141a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee3d690>
2026-03-30 10:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_e6b81798155473de1bd6c2ab4a35141a.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_e6b81798155473de1bd6c2ab4a35141a.jpg saved to cache
2026-03-30 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 849c2f94-f7f7-59eb-81fe-46c837a539ae
2026-03-30 10:44:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_0378df5233c1ad33694294d95befa1e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee87f90>
2026-03-30 10:44:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_0378df5233c1ad33694294d95befa1e9.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_0378df5233c1ad33694294d95befa1e9.jpg saved to cache
2026-03-30 10:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 72af2544-fc34-5541-b3b1-75f6d0c61c00
2026-03-30 10:44:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ40910/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_1519ae923195d537ed83cc0d8c080bf3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee48c50>
2026-03-30 10:44:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_1519ae923195d537ed83cc0d8c080bf3.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_1519ae923195d537ed83cc0d8c080bf3.jpg saved to cache
2026-03-30 10:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 72af2544-fc34-5541-b3b1-75f6d0c61c00
2026-03-30 10:44:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_88c4235735a516fb7dc723cea0754811.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_dd0fc364a84e8b59558d00c4256ac1c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee3f990>
2026-03-30 10:44:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_88c4235735a516fb7dc723cea0754811.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_88c4235735a516fb7dc723cea0754811.jpg saved to cache
2026-03-30 10:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 72af2544-fc34-5541-b3b1-75f6d0c61c00
2026-03-30 10:44:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3e0d0>
2026-03-30 10:44:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_dd0fc364a84e8b59558d00c4256ac1c3.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_dd0fc364a84e8b59558d00c4256ac1c3.jpg saved to cache
2026-03-30 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 72af2544-fc34-5541-b3b1-75f6d0c61c00
2026-03-30 10:44:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_5dec90ac13a652878f21c9685fd75fcc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee84e90>
2026-03-30 10:44:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_5dec90ac13a652878f21c9685fd75fcc.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_5dec90ac13a652878f21c9685fd75fcc.jpg saved to cache
2026-03-30 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 72af2544-fc34-5541-b3b1-75f6d0c61c00
2026-03-30 10:44:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GV01951> (referer: https://www.auto1.com/v1/car-details-view/GV01951/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XD17541> (referer: https://www.auto1.com/v1/car-details-view/XD17541/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5603a19-24e9-540c-8872-c48cf7faad94 with identifier: GV01951
2026-03-30 10:44:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5603a19-24e9-540c-8872-c48cf7faad94 with scrape type 1
2026-03-30 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5603a19-24e9-540c-8872-c48cf7faad94
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_0d1c31cb1182f7bfe24d95498c2ceb38.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_0d1c31cb1182f7bfe24d95498c2ceb38.jpg not downloaded yet
2026-03-30 10:44:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1914358-76fa-5b51-ad0a-1048af0e8190 with identifier: XD17541
2026-03-30 10:44:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1914358-76fa-5b51-ad0a-1048af0e8190 with scrape type 1
2026-03-30 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1914358-76fa-5b51-ad0a-1048af0e8190
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_dd891def948a26a987d7adf412a83b83.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_dd891def948a26a987d7adf412a83b83.jpg not downloaded yet
2026-03-30 10:44:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_4385d879427d7983f1e255685a637d78.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_ed2dabacb93cc811b4b4c53a7956aa4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_ed2dabacb93cc811b4b4c53a7956aa4c.jpg not downloaded yet
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_cdb0c76b9ebedf372050ad9415192689.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_cdb0c76b9ebedf372050ad9415192689.jpg not downloaded yet
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_0cc388a4c296612453b6a3260ec72fcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_0cc388a4c296612453b6a3260ec72fcc.jpg not downloaded yet
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_659681987b32d029c6b99ebb6cb377bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_659681987b32d029c6b99ebb6cb377bd.jpg not downloaded yet
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_2d2ea94fee5ffb5f263a51a9824899f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_2d2ea94fee5ffb5f263a51a9824899f6.jpg not downloaded yet
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_f3c4832d0ca8a2a32476cd98c5a11feb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_f3c4832d0ca8a2a32476cd98c5a11feb.jpg not downloaded yet
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_cef7e12674a3dd3dd6041da22abb78aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_cef7e12674a3dd3dd6041da22abb78aa.jpg not downloaded yet
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_98c4acb882641cedc7a66f510a627b5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_98c4acb882641cedc7a66f510a627b5c.jpg not downloaded yet
2026-03-30 10:44:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4142b90>
2026-03-30 10:44:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_4385d879427d7983f1e255685a637d78.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_4385d879427d7983f1e255685a637d78.jpg saved to cache
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 72af2544-fc34-5541-b3b1-75f6d0c61c00
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_ab03a5a556cd0880f4365711791bc279.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_ab03a5a556cd0880f4365711791bc279.jpg not downloaded yet
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_10bf0eb325b2c1c750fb02f4657c265f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_10bf0eb325b2c1c750fb02f4657c265f.jpg not downloaded yet
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_07d93a9b75b15d155526c01e5d00eb85.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_07d93a9b75b15d155526c01e5d00eb85.jpg not downloaded yet
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_cdccf64175eb9bfd263f426f5851543d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_cdccf64175eb9bfd263f426f5851543d.jpg not downloaded yet
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_86d4165616f398c1291c7b1879b2edb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_86d4165616f398c1291c7b1879b2edb3.jpg not downloaded yet
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_4ac6a9ffcf790d62afb448e54ed4faec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_4ac6a9ffcf790d62afb448e54ed4faec.jpg not downloaded yet
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_a5e8f6beccc040098b8c8e4777b892ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_a5e8f6beccc040098b8c8e4777b892ee.jpg not downloaded yet
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_afce1e09e6a30be8a54303c8a1b40f10.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_afce1e09e6a30be8a54303c8a1b40f10.jpg not downloaded yet
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_e8c91dd73f092a8000dd3552c56c48cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_e8c91dd73f092a8000dd3552c56c48cb.jpg not downloaded yet
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_c70aba3551be06b5ae003eac77adacbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_c70aba3551be06b5ae003eac77adacbf.jpg not downloaded yet
2026-03-30 10:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_486d9e8f6461910893c2f8a8449b3416.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_a8c5211375b32f42b4ec1af2d9c8dee6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd5490>
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_486d9e8f6461910893c2f8a8449b3416.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_486d9e8f6461910893c2f8a8449b3416.jpg saved to cache
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 72af2544-fc34-5541-b3b1-75f6d0c61c00
2026-03-30 10:44:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeedf110>
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_a8c5211375b32f42b4ec1af2d9c8dee6.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_a8c5211375b32f42b4ec1af2d9c8dee6.jpg saved to cache
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 72af2544-fc34-5541-b3b1-75f6d0c61c00
2026-03-30 10:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_dd891def948a26a987d7adf412a83b83.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_e8c91dd73f092a8000dd3552c56c48cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_c70aba3551be06b5ae003eac77adacbf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee43c90>
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_dd891def948a26a987d7adf412a83b83.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_dd891def948a26a987d7adf412a83b83.jpg saved to cache
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1914358-76fa-5b51-ad0a-1048af0e8190
2026-03-30 10:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_a5e8f6beccc040098b8c8e4777b892ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeede8d0>
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_e8c91dd73f092a8000dd3552c56c48cb.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_e8c91dd73f092a8000dd3552c56c48cb.jpg saved to cache
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b5603a19-24e9-540c-8872-c48cf7faad94
2026-03-30 10:44:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c02750>
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_c70aba3551be06b5ae003eac77adacbf.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_c70aba3551be06b5ae003eac77adacbf.jpg saved to cache
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1914358-76fa-5b51-ad0a-1048af0e8190
2026-03-30 10:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_86d4165616f398c1291c7b1879b2edb3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d0bd0>
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_a5e8f6beccc040098b8c8e4777b892ee.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_a5e8f6beccc040098b8c8e4777b892ee.jpg saved to cache
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b5603a19-24e9-540c-8872-c48cf7faad94
2026-03-30 10:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_afce1e09e6a30be8a54303c8a1b40f10.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef77550>
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_86d4165616f398c1291c7b1879b2edb3.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_86d4165616f398c1291c7b1879b2edb3.jpg saved to cache
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5603a19-24e9-540c-8872-c48cf7faad94
2026-03-30 10:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_07d93a9b75b15d155526c01e5d00eb85.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41e9dd0>
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_afce1e09e6a30be8a54303c8a1b40f10.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_afce1e09e6a30be8a54303c8a1b40f10.jpg saved to cache
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1914358-76fa-5b51-ad0a-1048af0e8190
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c02fd0>
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_07d93a9b75b15d155526c01e5d00eb85.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_07d93a9b75b15d155526c01e5d00eb85.jpg saved to cache
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5603a19-24e9-540c-8872-c48cf7faad94
2026-03-30 10:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_4ac6a9ffcf790d62afb448e54ed4faec.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_ab03a5a556cd0880f4365711791bc279.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_cdccf64175eb9bfd263f426f5851543d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef3ed0>
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_4ac6a9ffcf790d62afb448e54ed4faec.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_4ac6a9ffcf790d62afb448e54ed4faec.jpg saved to cache
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1914358-76fa-5b51-ad0a-1048af0e8190
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee40810>
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_ab03a5a556cd0880f4365711791bc279.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_ab03a5a556cd0880f4365711791bc279.jpg saved to cache
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5603a19-24e9-540c-8872-c48cf7faad94
2026-03-30 10:44:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeed4d0>
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_cdccf64175eb9bfd263f426f5851543d.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_cdccf64175eb9bfd263f426f5851543d.jpg saved to cache
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1914358-76fa-5b51-ad0a-1048af0e8190
2026-03-30 10:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_98c4acb882641cedc7a66f510a627b5c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_10bf0eb325b2c1c750fb02f4657c265f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_cef7e12674a3dd3dd6041da22abb78aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefa5a10>
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_98c4acb882641cedc7a66f510a627b5c.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_98c4acb882641cedc7a66f510a627b5c.jpg saved to cache
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1914358-76fa-5b51-ad0a-1048af0e8190
2026-03-30 10:44:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef53590>
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_10bf0eb325b2c1c750fb02f4657c265f.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_10bf0eb325b2c1c750fb02f4657c265f.jpg saved to cache
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1914358-76fa-5b51-ad0a-1048af0e8190
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434ee90>
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_cef7e12674a3dd3dd6041da22abb78aa.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_cef7e12674a3dd3dd6041da22abb78aa.jpg saved to cache
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b5603a19-24e9-540c-8872-c48cf7faad94
2026-03-30 10:44:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_f3c4832d0ca8a2a32476cd98c5a11feb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_2d2ea94fee5ffb5f263a51a9824899f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_0cc388a4c296612453b6a3260ec72fcc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_ed2dabacb93cc811b4b4c53a7956aa4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4401d0>
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_f3c4832d0ca8a2a32476cd98c5a11feb.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_f3c4832d0ca8a2a32476cd98c5a11feb.jpg saved to cache
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1914358-76fa-5b51-ad0a-1048af0e8190
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeec650>
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_2d2ea94fee5ffb5f263a51a9824899f6.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_2d2ea94fee5ffb5f263a51a9824899f6.jpg saved to cache
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5603a19-24e9-540c-8872-c48cf7faad94
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41ea1d0>
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_0cc388a4c296612453b6a3260ec72fcc.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_0cc388a4c296612453b6a3260ec72fcc.jpg saved to cache
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5603a19-24e9-540c-8872-c48cf7faad94
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef15d0>
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_ed2dabacb93cc811b4b4c53a7956aa4c.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_ed2dabacb93cc811b4b4c53a7956aa4c.jpg saved to cache
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5603a19-24e9-540c-8872-c48cf7faad94
2026-03-30 10:44:57 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (10664760) larger than download warn size (10485760) in request <GET https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_0d1c31cb1182f7bfe24d95498c2ceb38.jpg>.
2026-03-30 10:44:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_659681987b32d029c6b99ebb6cb377bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK02982> (referer: https://www.auto1.com/v1/car-details-view/RK02982/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_cdb0c76b9ebedf372050ad9415192689.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41ea590>
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_659681987b32d029c6b99ebb6cb377bd.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_659681987b32d029c6b99ebb6cb377bd.jpg saved to cache
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1914358-76fa-5b51-ad0a-1048af0e8190
2026-03-30 10:44:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 121b3ba1-73d9-5512-bd4d-367a561e518c with identifier: RK02982
2026-03-30 10:44:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 121b3ba1-73d9-5512-bd4d-367a561e518c with scrape type 1
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 121b3ba1-73d9-5512-bd4d-367a561e518c
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_58d61f39671044fb3d6d696fd731ea7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_58d61f39671044fb3d6d696fd731ea7e.jpg not downloaded yet
2026-03-30 10:44:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef52d0>
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F99%252Fc699f3441a07af3416d42c3b370c0b55%252Fpa%252FXD17541_cdb0c76b9ebedf372050ad9415192689.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_cdb0c76b9ebedf372050ad9415192689.jpg saved to cache
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1914358-76fa-5b51-ad0a-1048af0e8190
2026-03-30 10:44:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1914358-76fa-5b51-ad0a-1048af0e8190, skipping ID generation
2026-03-30 10:44:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1914358-76fa-5b51-ad0a-1048af0e8190 with scrape type 1
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1914358-76fa-5b51-ad0a-1048af0e8190 sending to next pipeline
2026-03-30 10:44:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1914358-76fa-5b51-ad0a-1048af0e8190, identifier: XD17541
2026-03-30 10:44:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1914358-76fa-5b51-ad0a-1048af0e8190 with identifier: XD17541
2026-03-30 10:44:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1914358-76fa-5b51-ad0a-1048af0e8190 with identifier: XD17541
2026-03-30 10:44:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1914358-76fa-5b51-ad0a-1048af0e8190 with identifier: XD17541 to the API
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_cdb0c76b9ebedf372050ad9415192689.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:38:34Z',
 'fuel_type': 'petrol',
 'id': 'a1914358-76fa-5b51-ad0a-1048af0e8190',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD17541',
 'listing': 'auction',
 'location': 'DE, Göttingen',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 31308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3023689,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_dd891def948a26a987d7adf412a83b83.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3003713,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_cdb0c76b9ebedf372050ad9415192689.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2794992,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_659681987b32d029c6b99ebb6cb377bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3110352,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_f3c4832d0ca8a2a32476cd98c5a11feb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2970721,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_98c4acb882641cedc7a66f510a627b5c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2980306,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_10bf0eb325b2c1c750fb02f4657c265f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3026909,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_cdccf64175eb9bfd263f426f5851543d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3024053,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_4ac6a9ffcf790d62afb448e54ed4faec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3069501,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_afce1e09e6a30be8a54303c8a1b40f10.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1914358-76fa-5b51-ad0a-1048af0e8190/a1914358-76fa-5b51-ad0a-1048af0e8190_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3136771,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/99/c699f3441a07af3416d42c3b370c0b55/pa/XD17541_c70aba3551be06b5ae003eac77adacbf.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD17541%27 HTTP/1.1" 200 None
2026-03-30 10:44:58 [auto1.de] INFO: Saving data for XD17541: {'created_time': 1774867498.780465, 'last_price_update_time': 1774867498.780475, 'auction_closing_time': 1774971514.0}
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD17541') HTTP/1.1" 204 0
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_a55a320e291925042ec6da73e24584c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_a55a320e291925042ec6da73e24584c9.jpg not downloaded yet
2026-03-30 10:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK06421/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LT57344> (referer: https://www.auto1.com/v1/car-details-view/LT57344/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB73143> (referer: https://www.auto1.com/v1/car-details-view/JB73143/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_26830aa196cecf4e9d356f17defdfdb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_26830aa196cecf4e9d356f17defdfdb0.jpg not downloaded yet
2026-03-30 10:44:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_fe3a5cd24e89a687105e955f47acfc33.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_fe3a5cd24e89a687105e955f47acfc33.jpg not downloaded yet
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_642296c19ed535629c16b7f745f68d3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_642296c19ed535629c16b7f745f68d3a.jpg not downloaded yet
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_2dddfe0e35ec728852ffff045388628b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_2dddfe0e35ec728852ffff045388628b.jpg not downloaded yet
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_c13ef96268cff3e805e41e11a9c979a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_c13ef96268cff3e805e41e11a9c979a6.jpg not downloaded yet
2026-03-30 10:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_58d61f39671044fb3d6d696fd731ea7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_fe2aa3631026e0f648db75b4d14d1b0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_fe2aa3631026e0f648db75b4d14d1b0a.jpg not downloaded yet
2026-03-30 10:44:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8bbc336-dfcb-55ef-826c-711f517ef380 with identifier: LT57344
2026-03-30 10:44:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8bbc336-dfcb-55ef-826c-711f517ef380 with scrape type 1
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8bbc336-dfcb-55ef-826c-711f517ef380
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb8%252Fa4b8d212ae61626cf81e002f7f9da805%252Fpa%252FLT57344_a43df81c6a2b2d4f822c5f829d1ec214.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_a43df81c6a2b2d4f822c5f829d1ec214.jpg already downloaded
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb8%252Fa4b8d212ae61626cf81e002f7f9da805%252Fpa%252FLT57344_491ea7e583e95c36bbaf17c611570769.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_491ea7e583e95c36bbaf17c611570769.jpg already downloaded
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb8%252Fa4b8d212ae61626cf81e002f7f9da805%252Fpa%252FLT57344_81075cb05af9862c2a2d1262f8b140b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_81075cb05af9862c2a2d1262f8b140b4.jpg already downloaded
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb8%252Fa4b8d212ae61626cf81e002f7f9da805%252Fpa%252FLT57344_a98ac636977722013acc8f5107eebd10.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_a98ac636977722013acc8f5107eebd10.jpg already downloaded
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb8%252Fa4b8d212ae61626cf81e002f7f9da805%252Fpa%252FLT57344_16f2433198c2c4e1648613d9f02bb34c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_16f2433198c2c4e1648613d9f02bb34c.jpg already downloaded
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb8%252Fa4b8d212ae61626cf81e002f7f9da805%252Fpa%252FLT57344_6f196efd5169108bfa4c36901d96a938.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_6f196efd5169108bfa4c36901d96a938.jpg already downloaded
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb8%252Fa4b8d212ae61626cf81e002f7f9da805%252Fpa%252FLT57344_47daa09dfdffe0d389eb37336b3dad88.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_47daa09dfdffe0d389eb37336b3dad88.jpg already downloaded
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb8%252Fa4b8d212ae61626cf81e002f7f9da805%252Fpa%252FLT57344_62a6aa80e919dd77cd11e18f5ef8e3d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_62a6aa80e919dd77cd11e18f5ef8e3d9.jpg already downloaded
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb8%252Fa4b8d212ae61626cf81e002f7f9da805%252Fpa%252FLT57344_ea21618a84054f0dc397f117129327d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_ea21618a84054f0dc397f117129327d8.jpg already downloaded
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb8%252Fa4b8d212ae61626cf81e002f7f9da805%252Fpa%252FLT57344_5a7bbd4e235c11839efb906be3872694.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_5a7bbd4e235c11839efb906be3872694.jpg already downloaded
2026-03-30 10:44:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8bbc336-dfcb-55ef-826c-711f517ef380, identifier: LT57344
2026-03-30 10:44:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22d2fe9e-8e5d-599c-9e15-16d29915f072 with identifier: JB73143
2026-03-30 10:44:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22d2fe9e-8e5d-599c-9e15-16d29915f072 with scrape type 1
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 22d2fe9e-8e5d-599c-9e15-16d29915f072
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_6b157797395be29479ed559a8ad0e8ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_6b157797395be29479ed559a8ad0e8ec.jpg not downloaded yet
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_7f79fa70fed587b0495953b2a843d480.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_7f79fa70fed587b0495953b2a843d480.jpg not downloaded yet
2026-03-30 10:44:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8bbc336-dfcb-55ef-826c-711f517ef380 with identifier: LT57344
2026-03-30 10:44:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8bbc336-dfcb-55ef-826c-711f517ef380 with identifier: LT57344
2026-03-30 10:44:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8bbc336-dfcb-55ef-826c-711f517ef380 with identifier: LT57344 to the API
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LT57344>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:19:20Z',
 'fuel_type': 'petrol',
 'id': 'b8bbc336-dfcb-55ef-826c-711f517ef380',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT57344',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 61052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_a43df81c6a2b2d4f822c5f829d1ec214.jpg',
                'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_491ea7e583e95c36bbaf17c611570769.jpg',
                'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_81075cb05af9862c2a2d1262f8b140b4.jpg',
                'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_a98ac636977722013acc8f5107eebd10.jpg',
                'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_16f2433198c2c4e1648613d9f02bb34c.jpg',
                'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_6f196efd5169108bfa4c36901d96a938.jpg',
                'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_47daa09dfdffe0d389eb37336b3dad88.jpg',
                'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_62a6aa80e919dd77cd11e18f5ef8e3d9.jpg',
                'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_ea21618a84054f0dc397f117129327d8.jpg',
                'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_5a7bbd4e235c11839efb906be3872694.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2913133,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_a43df81c6a2b2d4f822c5f829d1ec214.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2878016,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_491ea7e583e95c36bbaf17c611570769.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2967744,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_81075cb05af9862c2a2d1262f8b140b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_a98ac636977722013acc8f5107eebd10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_16f2433198c2c4e1648613d9f02bb34c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2980842,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_6f196efd5169108bfa4c36901d96a938.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3026157,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_47daa09dfdffe0d389eb37336b3dad88.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2888133,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_62a6aa80e919dd77cd11e18f5ef8e3d9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2900730,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_ea21618a84054f0dc397f117129327d8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2975591,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_5a7bbd4e235c11839efb906be3872694.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2015}
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT57344%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [auto1.de] INFO: Saving data for LT57344: {'created_time': 1774867499.669747, 'last_price_update_time': 1774867499.669755, 'auction_closing_time': 1774970360.0}
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT57344') HTTP/1.1" 204 0
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_5c4ac56b5447e2af62f6198ff7088c22.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_5c4ac56b5447e2af62f6198ff7088c22.jpg not downloaded yet
2026-03-30 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_a55a320e291925042ec6da73e24584c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_550c908a1fe84ad91b736efb2ba83400.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_550c908a1fe84ad91b736efb2ba83400.jpg not downloaded yet
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_91dd3dd168713ae676a0ab63912ceff6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_91dd3dd168713ae676a0ab63912ceff6.jpg not downloaded yet
2026-03-30 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7c150>
2026-03-30 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_58d61f39671044fb3d6d696fd731ea7e.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_58d61f39671044fb3d6d696fd731ea7e.jpg saved to cache
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 121b3ba1-73d9-5512-bd4d-367a561e518c
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_e480dc1b263a25c0d72336a09c59453f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_e480dc1b263a25c0d72336a09c59453f.jpg not downloaded yet
2026-03-30 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_c13ef96268cff3e805e41e11a9c979a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_85efc97740ff3e454906abc6c4e0d072.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_85efc97740ff3e454906abc6c4e0d072.jpg not downloaded yet
2026-03-30 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee49210>
2026-03-30 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_a55a320e291925042ec6da73e24584c9.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_a55a320e291925042ec6da73e24584c9.jpg saved to cache
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 121b3ba1-73d9-5512-bd4d-367a561e518c
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_4301a16d7f6c4c19a4b6f97dd91c2559.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_4301a16d7f6c4c19a4b6f97dd91c2559.jpg not downloaded yet
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_d74999fbadbcc246f06d056222dc800f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_d74999fbadbcc246f06d056222dc800f.jpg not downloaded yet
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_1ac877943c508e657446e65683113dac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_1ac877943c508e657446e65683113dac.jpg not downloaded yet
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeed0bd0>
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_c13ef96268cff3e805e41e11a9c979a6.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_c13ef96268cff3e805e41e11a9c979a6.jpg saved to cache
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 121b3ba1-73d9-5512-bd4d-367a561e518c
2026-03-30 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_e79d06b1e74e29b6803ba3e1449bd86f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_85be8a5a6a16a1256a4334ae12d91e11.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_85be8a5a6a16a1256a4334ae12d91e11.jpg not downloaded yet
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_8ab70d776c010ddf789b44244446c23e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_8ab70d776c010ddf789b44244446c23e.jpg not downloaded yet
2026-03-30 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_17c9198f94ee27931bf11fab0b843d60.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_5c4ac56b5447e2af62f6198ff7088c22.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_dc0887745e82ae5721840236bd86507e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_e480dc1b263a25c0d72336a09c59453f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417e1d0>
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_e79d06b1e74e29b6803ba3e1449bd86f.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_e79d06b1e74e29b6803ba3e1449bd86f.jpg saved to cache
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 72af2544-fc34-5541-b3b1-75f6d0c61c00
2026-03-30 10:45:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef5bfd0>
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa1%252F23a1e3c40e506a2905ff11b423528c4c%252Fpa%252FRE10488_17c9198f94ee27931bf11fab0b843d60.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_17c9198f94ee27931bf11fab0b843d60.jpg saved to cache
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72af2544-fc34-5541-b3b1-75f6d0c61c00
2026-03-30 10:45:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72af2544-fc34-5541-b3b1-75f6d0c61c00, skipping ID generation
2026-03-30 10:45:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72af2544-fc34-5541-b3b1-75f6d0c61c00 with scrape type 1
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72af2544-fc34-5541-b3b1-75f6d0c61c00 sending to next pipeline
2026-03-30 10:45:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72af2544-fc34-5541-b3b1-75f6d0c61c00, identifier: RE10488
2026-03-30 10:45:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef76950>
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_5c4ac56b5447e2af62f6198ff7088c22.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_5c4ac56b5447e2af62f6198ff7088c22.jpg saved to cache
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22d2fe9e-8e5d-599c-9e15-16d29915f072
2026-03-30 10:45:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeed550>
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_dc0887745e82ae5721840236bd86507e.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_dc0887745e82ae5721840236bd86507e.jpg saved to cache
2026-03-30 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 849c2f94-f7f7-59eb-81fe-46c837a539ae
2026-03-30 10:45:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee402590>
2026-03-30 10:45:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_e480dc1b263a25c0d72336a09c59453f.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_e480dc1b263a25c0d72336a09c59453f.jpg saved to cache
2026-03-30 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22d2fe9e-8e5d-599c-9e15-16d29915f072
2026-03-30 10:45:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72af2544-fc34-5541-b3b1-75f6d0c61c00 with identifier: RE10488
2026-03-30 10:45:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72af2544-fc34-5541-b3b1-75f6d0c61c00 with identifier: RE10488
2026-03-30 10:45:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72af2544-fc34-5541-b3b1-75f6d0c61c00 with identifier: RE10488 to the API
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_17c9198f94ee27931bf11fab0b843d60.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:07:53Z',
 'fuel_type': 'petrol',
 'id': '72af2544-fc34-5541-b3b1-75f6d0c61c00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE10488',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 127912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3010521,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_17c9198f94ee27931bf11fab0b843d60.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3022029,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_e79d06b1e74e29b6803ba3e1449bd86f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3012795,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_a8c5211375b32f42b4ec1af2d9c8dee6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2764078,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_486d9e8f6461910893c2f8a8449b3416.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2819845,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_4385d879427d7983f1e255685a637d78.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2914043,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_5dec90ac13a652878f21c9685fd75fcc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2860938,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_dd0fc364a84e8b59558d00c4256ac1c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2976410,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_88c4235735a516fb7dc723cea0754811.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2987183,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_1519ae923195d537ed83cc0d8c080bf3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72af2544-fc34-5541-b3b1-75f6d0c61c00/72af2544-fc34-5541-b3b1-75f6d0c61c00_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2847087,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/a1/23a1e3c40e506a2905ff11b423528c4c/pa/RE10488_0378df5233c1ad33694294d95befa1e9.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Design Edition',
 'transmission': 'manual',
 'trim': 'Design Edition',
 'year': 2012}
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE10488%27 HTTP/1.1" 200 None
2026-03-30 10:45:01 [auto1.de] INFO: Saving data for RE10488: {'created_time': 1774867501.570717, 'last_price_update_time': 1774867501.57073, 'auction_closing_time': 1774969673.0}
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE10488') HTTP/1.1" 204 0
2026-03-30 10:45:01 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_0d1c31cb1182f7bfe24d95498c2ceb38.jpg>.
2026-03-30 10:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_0d1c31cb1182f7bfe24d95498c2ceb38.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_1ac877943c508e657446e65683113dac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_d74999fbadbcc246f06d056222dc800f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 10:45:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 10:45:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 10:45:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 10:45:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 10:45:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f47fbe10>
2026-03-30 10:45:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2e%252Fa82e295f9862ff9c6ea1c69a4c7c20be%252Fpa%252FGV01951_0d1c31cb1182f7bfe24d95498c2ceb38.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_0d1c31cb1182f7bfe24d95498c2ceb38.jpg saved to cache
2026-03-30 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5603a19-24e9-540c-8872-c48cf7faad94
2026-03-30 10:45:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5603a19-24e9-540c-8872-c48cf7faad94, skipping ID generation
2026-03-30 10:45:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5603a19-24e9-540c-8872-c48cf7faad94 with scrape type 1
2026-03-30 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5603a19-24e9-540c-8872-c48cf7faad94 sending to next pipeline
2026-03-30 10:45:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5603a19-24e9-540c-8872-c48cf7faad94, identifier: GV01951
2026-03-30 10:45:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5603a19-24e9-540c-8872-c48cf7faad94 with identifier: GV01951
2026-03-30 10:45:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5603a19-24e9-540c-8872-c48cf7faad94 with identifier: GV01951
2026-03-30 10:45:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5603a19-24e9-540c-8872-c48cf7faad94 with identifier: GV01951 to the API
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_0d1c31cb1182f7bfe24d95498c2ceb38.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:47:14Z',
 'fuel_type': 'diesel',
 'id': 'b5603a19-24e9-540c-8872-c48cf7faad94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV01951',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 97763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 10664760,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_0d1c31cb1182f7bfe24d95498c2ceb38.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_ed2dabacb93cc811b4b4c53a7956aa4c.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_0cc388a4c296612453b6a3260ec72fcc.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_2d2ea94fee5ffb5f263a51a9824899f6.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_cef7e12674a3dd3dd6041da22abb78aa.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_ab03a5a556cd0880f4365711791bc279.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_07d93a9b75b15d155526c01e5d00eb85.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_86d4165616f398c1291c7b1879b2edb3.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_a5e8f6beccc040098b8c8e4777b892ee.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5603a19-24e9-540c-8872-c48cf7faad94/b5603a19-24e9-540c-8872-c48cf7faad94_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/2e/a82e295f9862ff9c6ea1c69a4c7c20be/pa/GV01951_e8c91dd73f092a8000dd3552c56c48cb.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 1.6 CDTI DPF Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2016}
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV01951%27 HTTP/1.1" 200 None
2026-03-30 10:45:02 [auto1.de] INFO: Saving data for GV01951: {'created_time': 1774867502.51284, 'last_price_update_time': 1774867502.512852, 'auction_closing_time': 1774972034.0}
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV01951') HTTP/1.1" 204 0
2026-03-30 10:45:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefa6950>
2026-03-30 10:45:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_1ac877943c508e657446e65683113dac.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_1ac877943c508e657446e65683113dac.jpg saved to cache
2026-03-30 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22d2fe9e-8e5d-599c-9e15-16d29915f072
2026-03-30 10:45:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45c550>
2026-03-30 10:45:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_d74999fbadbcc246f06d056222dc800f.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_d74999fbadbcc246f06d056222dc800f.jpg saved to cache
2026-03-30 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22d2fe9e-8e5d-599c-9e15-16d29915f072
2026-03-30 10:45:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_85be8a5a6a16a1256a4334ae12d91e11.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_8ab70d776c010ddf789b44244446c23e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_4301a16d7f6c4c19a4b6f97dd91c2559.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_85efc97740ff3e454906abc6c4e0d072.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee4bbd0>
2026-03-30 10:45:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_85be8a5a6a16a1256a4334ae12d91e11.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_85be8a5a6a16a1256a4334ae12d91e11.jpg saved to cache
2026-03-30 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 22d2fe9e-8e5d-599c-9e15-16d29915f072
2026-03-30 10:45:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_7f79fa70fed587b0495953b2a843d480.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef77150>
2026-03-30 10:45:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_8ab70d776c010ddf789b44244446c23e.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_8ab70d776c010ddf789b44244446c23e.jpg saved to cache
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 22d2fe9e-8e5d-599c-9e15-16d29915f072
2026-03-30 10:45:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58d30d0>
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_4301a16d7f6c4c19a4b6f97dd91c2559.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_4301a16d7f6c4c19a4b6f97dd91c2559.jpg saved to cache
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22d2fe9e-8e5d-599c-9e15-16d29915f072
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef45310>
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_85efc97740ff3e454906abc6c4e0d072.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_85efc97740ff3e454906abc6c4e0d072.jpg saved to cache
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22d2fe9e-8e5d-599c-9e15-16d29915f072
2026-03-30 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_550c908a1fe84ad91b736efb2ba83400.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f597c550>
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_7f79fa70fed587b0495953b2a843d480.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_7f79fa70fed587b0495953b2a843d480.jpg saved to cache
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 121b3ba1-73d9-5512-bd4d-367a561e518c
2026-03-30 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_91dd3dd168713ae676a0ab63912ceff6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c0c5d0>
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_550c908a1fe84ad91b736efb2ba83400.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_550c908a1fe84ad91b736efb2ba83400.jpg saved to cache
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 121b3ba1-73d9-5512-bd4d-367a561e518c
2026-03-30 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_fe2aa3631026e0f648db75b4d14d1b0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee42a7d0>
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_91dd3dd168713ae676a0ab63912ceff6.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_91dd3dd168713ae676a0ab63912ceff6.jpg saved to cache
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22d2fe9e-8e5d-599c-9e15-16d29915f072
2026-03-30 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_2dddfe0e35ec728852ffff045388628b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_642296c19ed535629c16b7f745f68d3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_fe3a5cd24e89a687105e955f47acfc33.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4831750>
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_fe2aa3631026e0f648db75b4d14d1b0a.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_fe2aa3631026e0f648db75b4d14d1b0a.jpg saved to cache
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 121b3ba1-73d9-5512-bd4d-367a561e518c
2026-03-30 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_26830aa196cecf4e9d356f17defdfdb0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_6b157797395be29479ed559a8ad0e8ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeede150>
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_2dddfe0e35ec728852ffff045388628b.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_2dddfe0e35ec728852ffff045388628b.jpg saved to cache
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 121b3ba1-73d9-5512-bd4d-367a561e518c
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee419850>
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_642296c19ed535629c16b7f745f68d3a.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_642296c19ed535629c16b7f745f68d3a.jpg saved to cache
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 121b3ba1-73d9-5512-bd4d-367a561e518c
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee5df90>
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_fe3a5cd24e89a687105e955f47acfc33.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_fe3a5cd24e89a687105e955f47acfc33.jpg saved to cache
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 121b3ba1-73d9-5512-bd4d-367a561e518c
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee5ffd0>
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ff5%252F51f505232d001699ba4f4c9f2c136231%252Fpa%252FRK02982_26830aa196cecf4e9d356f17defdfdb0.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_26830aa196cecf4e9d356f17defdfdb0.jpg saved to cache
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 121b3ba1-73d9-5512-bd4d-367a561e518c
2026-03-30 10:45:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 121b3ba1-73d9-5512-bd4d-367a561e518c, skipping ID generation
2026-03-30 10:45:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 121b3ba1-73d9-5512-bd4d-367a561e518c with scrape type 1
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 121b3ba1-73d9-5512-bd4d-367a561e518c sending to next pipeline
2026-03-30 10:45:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 121b3ba1-73d9-5512-bd4d-367a561e518c, identifier: RK02982
2026-03-30 10:45:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee82d50>
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fac%252Febac04fd35e8b66b1cd739645337cd3c%252Fpa%252FJB73143_6b157797395be29479ed559a8ad0e8ec.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_6b157797395be29479ed559a8ad0e8ec.jpg saved to cache
2026-03-30 10:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22d2fe9e-8e5d-599c-9e15-16d29915f072
2026-03-30 10:45:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22d2fe9e-8e5d-599c-9e15-16d29915f072, skipping ID generation
2026-03-30 10:45:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22d2fe9e-8e5d-599c-9e15-16d29915f072 with scrape type 1
2026-03-30 10:45:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22d2fe9e-8e5d-599c-9e15-16d29915f072 sending to next pipeline
2026-03-30 10:45:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22d2fe9e-8e5d-599c-9e15-16d29915f072, identifier: JB73143
2026-03-30 10:45:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 121b3ba1-73d9-5512-bd4d-367a561e518c with identifier: RK02982
2026-03-30 10:45:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 121b3ba1-73d9-5512-bd4d-367a561e518c with identifier: RK02982
2026-03-30 10:45:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 121b3ba1-73d9-5512-bd4d-367a561e518c with identifier: RK02982 to the API
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_26830aa196cecf4e9d356f17defdfdb0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:05:25Z',
 'fuel_type': 'petrol',
 'id': '121b3ba1-73d9-5512-bd4d-367a561e518c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK02982',
 'listing': 'auction',
 'location': 'DE, Bretzenheim',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 100405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_58d61f39671044fb3d6d696fd731ea7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_a55a320e291925042ec6da73e24584c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_26830aa196cecf4e9d356f17defdfdb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_fe3a5cd24e89a687105e955f47acfc33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_642296c19ed535629c16b7f745f68d3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_2dddfe0e35ec728852ffff045388628b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_c13ef96268cff3e805e41e11a9c979a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_fe2aa3631026e0f648db75b4d14d1b0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_7f79fa70fed587b0495953b2a843d480.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_121b3ba1-73d9-5512-bd4d-367a561e518c/121b3ba1-73d9-5512-bd4d-367a561e518c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/f5/51f505232d001699ba4f4c9f2c136231/pa/RK02982_550c908a1fe84ad91b736efb2ba83400.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.0 TGDI Passion blue',
 'transmission': 'manual',
 'trim': 'Passion blue',
 'year': 2017}
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK02982%27 HTTP/1.1" 200 None
2026-03-30 10:45:04 [auto1.de] INFO: Saving data for RK02982: {'created_time': 1774867504.59934, 'last_price_update_time': 1774867504.599354, 'auction_closing_time': 1774969525.0}
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK02982') HTTP/1.1" 204 0
2026-03-30 10:45:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22d2fe9e-8e5d-599c-9e15-16d29915f072 with identifier: JB73143
2026-03-30 10:45:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22d2fe9e-8e5d-599c-9e15-16d29915f072 with identifier: JB73143
2026-03-30 10:45:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22d2fe9e-8e5d-599c-9e15-16d29915f072 with identifier: JB73143 to the API
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_6b157797395be29479ed559a8ad0e8ec.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 224,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.5L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-31T15:46:29Z',
 'fuel_type': 'diesel',
 'id': '22d2fe9e-8e5d-599c-9e15-16d29915f072',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB73143',
 'listing': 'auction',
 'location': 'DE, Aachen',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 234037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2358458,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_6b157797395be29479ed559a8ad0e8ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2127951,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_5c4ac56b5447e2af62f6198ff7088c22.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2315008,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_91dd3dd168713ae676a0ab63912ceff6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1931045,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_e480dc1b263a25c0d72336a09c59453f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_85efc97740ff3e454906abc6c4e0d072.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2370622,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_4301a16d7f6c4c19a4b6f97dd91c2559.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_d74999fbadbcc246f06d056222dc800f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2309853,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_1ac877943c508e657446e65683113dac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2290158,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_85be8a5a6a16a1256a4334ae12d91e11.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d2fe9e-8e5d-599c-9e15-16d29915f072/22d2fe9e-8e5d-599c-9e15-16d29915f072_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2268351,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/ac/ebac04fd35e8b66b1cd739645337cd3c/pa/JB73143_8ab70d776c010ddf789b44244446c23e.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-09-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2005}
2026-03-30 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB73143%27 HTTP/1.1" 200 None
2026-03-30 10:45:05 [auto1.de] INFO: Saving data for JB73143: {'created_time': 1774867505.06849, 'last_price_update_time': 1774867505.068504, 'auction_closing_time': 1774971989.0}
2026-03-30 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB73143') HTTP/1.1" 204 0
2026-03-30 10:45:05 [scrapy.extensions.logstats] INFO: Crawled 547 pages (at 35 pages/min), scraped 400 items (at 35 items/min)
2026-03-30 10:45:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_7b38747e038a5f71c301c9231fb4a481.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_c35f40dd797e412494291ab45b5d1dbf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424f190>
2026-03-30 10:45:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_7b38747e038a5f71c301c9231fb4a481.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_7b38747e038a5f71c301c9231fb4a481.jpg saved to cache
2026-03-30 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 849c2f94-f7f7-59eb-81fe-46c837a539ae
2026-03-30 10:45:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee10290>
2026-03-30 10:45:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa5%252F84a5b8f66b627cc0a13e30d47f90bb6b%252Fpa%252FUN38218_c35f40dd797e412494291ab45b5d1dbf.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_c35f40dd797e412494291ab45b5d1dbf.jpg saved to cache
2026-03-30 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 849c2f94-f7f7-59eb-81fe-46c837a539ae
2026-03-30 10:45:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 849c2f94-f7f7-59eb-81fe-46c837a539ae, skipping ID generation
2026-03-30 10:45:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 849c2f94-f7f7-59eb-81fe-46c837a539ae with scrape type 1
2026-03-30 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 849c2f94-f7f7-59eb-81fe-46c837a539ae sending to next pipeline
2026-03-30 10:45:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 849c2f94-f7f7-59eb-81fe-46c837a539ae, identifier: UN38218
2026-03-30 10:45:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 849c2f94-f7f7-59eb-81fe-46c837a539ae with identifier: UN38218
2026-03-30 10:45:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 849c2f94-f7f7-59eb-81fe-46c837a539ae with identifier: UN38218
2026-03-30 10:45:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 849c2f94-f7f7-59eb-81fe-46c837a539ae with identifier: UN38218 to the API
2026-03-30 10:45:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_c35f40dd797e412494291ab45b5d1dbf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:45:10Z',
 'fuel_type': 'petrol',
 'id': '849c2f94-f7f7-59eb-81fe-46c837a539ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN38218',
 'listing': 'auction',
 'location': 'DE, Brühl',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 94001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3251359,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_7f5da59096e29a9886fc1c005f5c9c8e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3219748,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_af25c064cfdcdbb467614b4640847b50.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3076229,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_7b38747e038a5f71c301c9231fb4a481.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3281488,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_c35f40dd797e412494291ab45b5d1dbf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3224497,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_dc0887745e82ae5721840236bd86507e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3196681,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_e6b81798155473de1bd6c2ab4a35141a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3032439,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_d03a76f666ee83452625f172f4f47460.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3262352,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_8bb603bf5775d48d42132b9ae186b4df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3091847,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_5e9476b61d82b454e5608bd4a043b87e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849c2f94-f7f7-59eb-81fe-46c837a539ae/849c2f94-f7f7-59eb-81fe-46c837a539ae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3210367,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a5/84a5b8f66b627cc0a13e30d47f90bb6b/pa/UN38218_d33f25268203084dd861df416c9074f5.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Excellence Start/Stop',
 'transmission': 'manual',
 'trim': 'Excellence Start/Stop',
 'year': 2017}
2026-03-30 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN38218%27 HTTP/1.1" 200 None
2026-03-30 10:45:05 [auto1.de] INFO: Saving data for UN38218: {'created_time': 1774867505.965706, 'last_price_update_time': 1774867505.965716, 'auction_closing_time': 1774971910.0}
2026-03-30 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN38218') HTTP/1.1" 204 0
2026-03-30 10:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX18259/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ40910> (referer: https://www.auto1.com/v1/car-details-view/KZ40910/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c0b13e5-fd58-5757-9bd8-b68f3efa425f with identifier: KZ40910
2026-03-30 10:45:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c0b13e5-fd58-5757-9bd8-b68f3efa425f with scrape type 1
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2c0b13e5-fd58-5757-9bd8-b68f3efa425f
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F12%252F4212f3f01897748ce676948e6442c5ee%252Fpa%252FKZ40910_49477e3d4f145bebe03cf56d7c599c16.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/12/4212f3f01897748ce676948e6442c5ee/pa/KZ40910_49477e3d4f145bebe03cf56d7c599c16.jpg already downloaded
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F12%252F4212f3f01897748ce676948e6442c5ee%252Fpa%252FKZ40910_4e49b50029e74f5ba4ae1725d4a737da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/12/4212f3f01897748ce676948e6442c5ee/pa/KZ40910_4e49b50029e74f5ba4ae1725d4a737da.jpg already downloaded
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F12%252F4212f3f01897748ce676948e6442c5ee%252Fpa%252FKZ40910_ce63daa1f5cac6101b08dc5c7c23a2e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/12/4212f3f01897748ce676948e6442c5ee/pa/KZ40910_ce63daa1f5cac6101b08dc5c7c23a2e4.jpg already downloaded
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F12%252F4212f3f01897748ce676948e6442c5ee%252Fpa%252FKZ40910_7ecc53f76e8ca5d0fdb062d324d50aa4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/12/4212f3f01897748ce676948e6442c5ee/pa/KZ40910_7ecc53f76e8ca5d0fdb062d324d50aa4.jpg already downloaded
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F12%252F4212f3f01897748ce676948e6442c5ee%252Fpa%252FKZ40910_a57f0ddf7509615c484dc4688a3f025c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/12/4212f3f01897748ce676948e6442c5ee/pa/KZ40910_a57f0ddf7509615c484dc4688a3f025c.jpg already downloaded
2026-03-30 10:45:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c0b13e5-fd58-5757-9bd8-b68f3efa425f, identifier: KZ40910
2026-03-30 10:45:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c0b13e5-fd58-5757-9bd8-b68f3efa425f with identifier: KZ40910
2026-03-30 10:45:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c0b13e5-fd58-5757-9bd8-b68f3efa425f with identifier: KZ40910
2026-03-30 10:45:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c0b13e5-fd58-5757-9bd8-b68f3efa425f with identifier: KZ40910 to the API
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KZ40910>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:39:32Z',
 'fuel_type': 'petrol',
 'id': '2c0b13e5-fd58-5757-9bd8-b68f3efa425f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ40910',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 182769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img42/12/4212f3f01897748ce676948e6442c5ee/pa/KZ40910_49477e3d4f145bebe03cf56d7c599c16.jpg',
                'https://img-pa.auto1.com/img42/12/4212f3f01897748ce676948e6442c5ee/pa/KZ40910_4e49b50029e74f5ba4ae1725d4a737da.jpg',
                'https://img-pa.auto1.com/img42/12/4212f3f01897748ce676948e6442c5ee/pa/KZ40910_ce63daa1f5cac6101b08dc5c7c23a2e4.jpg',
                'https://img-pa.auto1.com/img42/12/4212f3f01897748ce676948e6442c5ee/pa/KZ40910_7ecc53f76e8ca5d0fdb062d324d50aa4.jpg',
                'https://img-pa.auto1.com/img42/12/4212f3f01897748ce676948e6442c5ee/pa/KZ40910_a57f0ddf7509615c484dc4688a3f025c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c0b13e5-fd58-5757-9bd8-b68f3efa425f/2c0b13e5-fd58-5757-9bd8-b68f3efa425f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/12/4212f3f01897748ce676948e6442c5ee/pa/KZ40910_49477e3d4f145bebe03cf56d7c599c16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c0b13e5-fd58-5757-9bd8-b68f3efa425f/2c0b13e5-fd58-5757-9bd8-b68f3efa425f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/12/4212f3f01897748ce676948e6442c5ee/pa/KZ40910_4e49b50029e74f5ba4ae1725d4a737da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c0b13e5-fd58-5757-9bd8-b68f3efa425f/2c0b13e5-fd58-5757-9bd8-b68f3efa425f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/12/4212f3f01897748ce676948e6442c5ee/pa/KZ40910_ce63daa1f5cac6101b08dc5c7c23a2e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c0b13e5-fd58-5757-9bd8-b68f3efa425f/2c0b13e5-fd58-5757-9bd8-b68f3efa425f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/12/4212f3f01897748ce676948e6442c5ee/pa/KZ40910_7ecc53f76e8ca5d0fdb062d324d50aa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c0b13e5-fd58-5757-9bd8-b68f3efa425f/2c0b13e5-fd58-5757-9bd8-b68f3efa425f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 155400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/12/4212f3f01897748ce676948e6442c5ee/pa/KZ40910_a57f0ddf7509615c484dc4688a3f025c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ40910%27 HTTP/1.1" 200 None
2026-03-30 10:45:08 [auto1.de] INFO: Saving data for KZ40910: {'created_time': 1774867508.593775, 'last_price_update_time': 1774867508.593787, 'auction_closing_time': 1774971572.0}
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ40910') HTTP/1.1" 204 0
2026-03-30 10:45:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DT44924/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ97235/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:16 [auto1.de] INFO: Channel: 24h | Page: 24 | totalHits: 9465 | hits on page: 40
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: RY02033
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: YL37879
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: RR13912
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: RK02982
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK02982%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [auto1.de] INFO: Scrape type for RK02982: 0
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: EJ29706
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: PR60744
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: JJ25259
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: MK63509
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: UM69054
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM69054%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [auto1.de] INFO: Scrape type for UM69054: 1
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: KM40135
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: FJ71862
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71862%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [auto1.de] INFO: Scrape type for FJ71862: 2
2026-03-30 10:45:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11ef7503-825f-5e34-804f-5dad28e0b4a6 with identifier: FJ71862
2026-03-30 10:45:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11ef7503-825f-5e34-804f-5dad28e0b4a6 with scrape type 2
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11ef7503-825f-5e34-804f-5dad28e0b4a6 with scrape type 2
2026-03-30 10:45:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11ef7503-825f-5e34-804f-5dad28e0b4a6, identifier: FJ71862
2026-03-30 10:45:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11ef7503-825f-5e34-804f-5dad28e0b4a6 with identifier: FJ71862
2026-03-30 10:45:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11ef7503-825f-5e34-804f-5dad28e0b4a6 with identifier: FJ71862
2026-03-30 10:45:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11ef7503-825f-5e34-804f-5dad28e0b4a6 with identifier: FJ71862 to the API
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:19:26Z',
 'fuel_type': 'petrol',
 'id': '11ef7503-825f-5e34-804f-5dad28e0b4a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ71862',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 136852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-07',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71862%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [auto1.de] INFO: Saving data for FJ71862: {'auction_closing_time': 1774970366.0, 'created_time': 1773659448.052675, 'last_price_update_time': 1774867516.632056}
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ71862') HTTP/1.1" 204 0
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: YP95979
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: MZ76661
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ76661%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [auto1.de] INFO: Scrape type for MZ76661: 1
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: FC01690
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC01690%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [auto1.de] INFO: Scrape type for FC01690: 1
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: MD91791
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: TP91786
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP91786%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [auto1.de] INFO: Scrape type for TP91786: 1
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: DW28316
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: YF96126
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF96126%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [auto1.de] INFO: Scrape type for YF96126: 1
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: TS03545
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: BH45611
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: UZ85196
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: CR07619
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: FE23219
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE23219%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [auto1.de] INFO: Scrape type for FE23219: 1
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: LK64913
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK64913%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [auto1.de] INFO: Scrape type for LK64913: 1
2026-03-30 10:45:16 [auto1.de] INFO: Found listing with ID: CA34591
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA34591%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [auto1.de] INFO: Scrape type for CA34591: 2
2026-03-30 10:45:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02aae4ae-31a1-55b0-9174-9ef433ba44b6 with identifier: CA34591
2026-03-30 10:45:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02aae4ae-31a1-55b0-9174-9ef433ba44b6 with scrape type 2
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02aae4ae-31a1-55b0-9174-9ef433ba44b6 with scrape type 2
2026-03-30 10:45:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02aae4ae-31a1-55b0-9174-9ef433ba44b6, identifier: CA34591
2026-03-30 10:45:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02aae4ae-31a1-55b0-9174-9ef433ba44b6 with identifier: CA34591
2026-03-30 10:45:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02aae4ae-31a1-55b0-9174-9ef433ba44b6 with identifier: CA34591
2026-03-30 10:45:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02aae4ae-31a1-55b0-9174-9ef433ba44b6 with identifier: CA34591 to the API
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 387,
 'expiration_date': '2026-03-31T15:51:26Z',
 'fuel_type': 'petrol',
 'id': '02aae4ae-31a1-55b0-9174-9ef433ba44b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA34591',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 256749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-14',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 500',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA34591%27 HTTP/1.1" 200 None
2026-03-30 10:45:17 [auto1.de] INFO: Saving data for CA34591: {'auction_closing_time': 1774972286.0, 'created_time': 1773305050.778976, 'last_price_update_time': 1774867517.25483}
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA34591') HTTP/1.1" 204 0
2026-03-30 10:45:17 [auto1.de] INFO: Found listing with ID: JP87174
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP87174%27 HTTP/1.1" 200 None
2026-03-30 10:45:17 [auto1.de] INFO: Scrape type for JP87174: 1
2026-03-30 10:45:17 [auto1.de] INFO: Found listing with ID: FE34808
2026-03-30 10:45:17 [auto1.de] INFO: Found listing with ID: BC17196
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC17196%27 HTTP/1.1" 200 None
2026-03-30 10:45:17 [auto1.de] INFO: Scrape type for BC17196: 1
2026-03-30 10:45:17 [auto1.de] INFO: Found listing with ID: CK11901
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK11901%27 HTTP/1.1" 200 None
2026-03-30 10:45:17 [auto1.de] INFO: Scrape type for CK11901: 1
2026-03-30 10:45:17 [auto1.de] INFO: Found listing with ID: UZ12630
2026-03-30 10:45:17 [auto1.de] INFO: Found listing with ID: EZ57191
2026-03-30 10:45:17 [auto1.de] INFO: Found listing with ID: AR08419
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR08419%27 HTTP/1.1" 200 None
2026-03-30 10:45:17 [auto1.de] INFO: Scrape type for AR08419: 1
2026-03-30 10:45:17 [auto1.de] INFO: Found listing with ID: DA80798
2026-03-30 10:45:17 [auto1.de] INFO: Found listing with ID: AA94538
2026-03-30 10:45:17 [auto1.de] INFO: Found listing with ID: FK95635
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK95635%27 HTTP/1.1" 200 None
2026-03-30 10:45:17 [auto1.de] INFO: Scrape type for FK95635: 1
2026-03-30 10:45:17 [auto1.de] INFO: Found listing with ID: AH51648
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH51648%27 HTTP/1.1" 200 None
2026-03-30 10:45:17 [auto1.de] INFO: Scrape type for AH51648: 2
2026-03-30 10:45:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 656677fa-90af-5c01-acc4-97442c9f5002 with identifier: AH51648
2026-03-30 10:45:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 656677fa-90af-5c01-acc4-97442c9f5002 with scrape type 2
2026-03-30 10:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 656677fa-90af-5c01-acc4-97442c9f5002 with scrape type 2
2026-03-30 10:45:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 656677fa-90af-5c01-acc4-97442c9f5002, identifier: AH51648
2026-03-30 10:45:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 656677fa-90af-5c01-acc4-97442c9f5002 with identifier: AH51648
2026-03-30 10:45:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 656677fa-90af-5c01-acc4-97442c9f5002 with identifier: AH51648
2026-03-30 10:45:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 656677fa-90af-5c01-acc4-97442c9f5002 with identifier: AH51648 to the API
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:46:07Z',
 'fuel_type': 'diesel',
 'id': '656677fa-90af-5c01-acc4-97442c9f5002',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH51648',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 153286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-15',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH51648%27 HTTP/1.1" 200 None
2026-03-30 10:45:17 [auto1.de] INFO: Saving data for AH51648: {'auction_closing_time': 1774971967.0, 'created_time': 1774467446.543028, 'last_price_update_time': 1774867517.993291}
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH51648') HTTP/1.1" 204 0
2026-03-30 10:45:18 [auto1.de] INFO: Found listing with ID: VA91828
2026-03-30 10:45:18 [auto1.de] INFO: Found listing with ID: XL02877
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL02877%27 HTTP/1.1" 200 None
2026-03-30 10:45:18 [auto1.de] INFO: Scrape type for XL02877: 1
2026-03-30 10:45:18 [auto1.de] INFO: Found listing with ID: WW35819
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW35819%27 HTTP/1.1" 200 None
2026-03-30 10:45:18 [auto1.de] INFO: Scrape type for WW35819: 1
2026-03-30 10:45:18 [auto1.de] INFO: Found listing with ID: YY43496
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY43496%27 HTTP/1.1" 200 None
2026-03-30 10:45:18 [auto1.de] INFO: Scrape type for YY43496: 1
2026-03-30 10:45:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ED20045> (referer: https://www.auto1.com/v1/car-details-view/ED20045/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99b33316-01ad-5edd-94ec-d92036899e3f with identifier: ED20045
2026-03-30 10:45:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99b33316-01ad-5edd-94ec-d92036899e3f with scrape type 1
2026-03-30 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 99b33316-01ad-5edd-94ec-d92036899e3f
2026-03-30 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fcb%252Ff0cbc2e77fc47aad82d390a2f0a907b0%252Fpa%252FED20045_b70fea8db589396bfc7a6e64e4db01e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/cb/f0cbc2e77fc47aad82d390a2f0a907b0/pa/ED20045_b70fea8db589396bfc7a6e64e4db01e0.jpg already downloaded
2026-03-30 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fcb%252Ff0cbc2e77fc47aad82d390a2f0a907b0%252Fpa%252FED20045_1f469f87acb718a41da991749c177e39.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/cb/f0cbc2e77fc47aad82d390a2f0a907b0/pa/ED20045_1f469f87acb718a41da991749c177e39.jpg already downloaded
2026-03-30 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fcb%252Ff0cbc2e77fc47aad82d390a2f0a907b0%252Fpa%252FED20045_b00db205ed1029431e1e9a52e751b1aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/cb/f0cbc2e77fc47aad82d390a2f0a907b0/pa/ED20045_b00db205ed1029431e1e9a52e751b1aa.jpg already downloaded
2026-03-30 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fcb%252Ff0cbc2e77fc47aad82d390a2f0a907b0%252Fpa%252FED20045_9aa43d3e31ad5584806906dd141c983c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/cb/f0cbc2e77fc47aad82d390a2f0a907b0/pa/ED20045_9aa43d3e31ad5584806906dd141c983c.jpg already downloaded
2026-03-30 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fcb%252Ff0cbc2e77fc47aad82d390a2f0a907b0%252Fpa%252FED20045_5057e3e06208f0bc1d860070b2aa540a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/cb/f0cbc2e77fc47aad82d390a2f0a907b0/pa/ED20045_5057e3e06208f0bc1d860070b2aa540a.jpg already downloaded
2026-03-30 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fcb%252Ff0cbc2e77fc47aad82d390a2f0a907b0%252Fpa%252FED20045_048b9bd1edc9557932e7f15821e91778.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/cb/f0cbc2e77fc47aad82d390a2f0a907b0/pa/ED20045_048b9bd1edc9557932e7f15821e91778.jpg already downloaded
2026-03-30 10:45:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99b33316-01ad-5edd-94ec-d92036899e3f, identifier: ED20045
2026-03-30 10:45:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99b33316-01ad-5edd-94ec-d92036899e3f with identifier: ED20045
2026-03-30 10:45:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99b33316-01ad-5edd-94ec-d92036899e3f with identifier: ED20045
2026-03-30 10:45:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99b33316-01ad-5edd-94ec-d92036899e3f with identifier: ED20045 to the API
2026-03-30 10:45:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ED20045>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:42:09Z',
 'fuel_type': 'petrol',
 'id': '99b33316-01ad-5edd-94ec-d92036899e3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED20045',
 'listing': 'auction',
 'location': 'DE, Lahr',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 185013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgf0/cb/f0cbc2e77fc47aad82d390a2f0a907b0/pa/ED20045_b70fea8db589396bfc7a6e64e4db01e0.jpg',
                'https://img-pa.auto1.com/imgf0/cb/f0cbc2e77fc47aad82d390a2f0a907b0/pa/ED20045_1f469f87acb718a41da991749c177e39.jpg',
                'https://img-pa.auto1.com/imgf0/cb/f0cbc2e77fc47aad82d390a2f0a907b0/pa/ED20045_b00db205ed1029431e1e9a52e751b1aa.jpg',
                'https://img-pa.auto1.com/imgf0/cb/f0cbc2e77fc47aad82d390a2f0a907b0/pa/ED20045_9aa43d3e31ad5584806906dd141c983c.jpg',
                'https://img-pa.auto1.com/imgf0/cb/f0cbc2e77fc47aad82d390a2f0a907b0/pa/ED20045_5057e3e06208f0bc1d860070b2aa540a.jpg',
                'https://img-pa.auto1.com/imgf0/cb/f0cbc2e77fc47aad82d390a2f0a907b0/pa/ED20045_048b9bd1edc9557932e7f15821e91778.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99b33316-01ad-5edd-94ec-d92036899e3f/99b33316-01ad-5edd-94ec-d92036899e3f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/cb/f0cbc2e77fc47aad82d390a2f0a907b0/pa/ED20045_b70fea8db589396bfc7a6e64e4db01e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99b33316-01ad-5edd-94ec-d92036899e3f/99b33316-01ad-5edd-94ec-d92036899e3f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/cb/f0cbc2e77fc47aad82d390a2f0a907b0/pa/ED20045_1f469f87acb718a41da991749c177e39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99b33316-01ad-5edd-94ec-d92036899e3f/99b33316-01ad-5edd-94ec-d92036899e3f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/cb/f0cbc2e77fc47aad82d390a2f0a907b0/pa/ED20045_b00db205ed1029431e1e9a52e751b1aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99b33316-01ad-5edd-94ec-d92036899e3f/99b33316-01ad-5edd-94ec-d92036899e3f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/cb/f0cbc2e77fc47aad82d390a2f0a907b0/pa/ED20045_9aa43d3e31ad5584806906dd141c983c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99b33316-01ad-5edd-94ec-d92036899e3f/99b33316-01ad-5edd-94ec-d92036899e3f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/cb/f0cbc2e77fc47aad82d390a2f0a907b0/pa/ED20045_5057e3e06208f0bc1d860070b2aa540a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99b33316-01ad-5edd-94ec-d92036899e3f/99b33316-01ad-5edd-94ec-d92036899e3f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/cb/f0cbc2e77fc47aad82d390a2f0a907b0/pa/ED20045_048b9bd1edc9557932e7f15821e91778.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Impuls Edition',
 'transmission': 'manual',
 'trim': 'Impuls Edition',
 'year': 2011}
2026-03-30 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED20045%27 HTTP/1.1" 200 None
2026-03-30 10:45:22 [auto1.de] INFO: Saving data for ED20045: {'created_time': 1774867522.077049, 'last_price_update_time': 1774867522.077059, 'auction_closing_time': 1774971729.0}
2026-03-30 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED20045') HTTP/1.1" 204 0
2026-03-30 10:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG93335> (referer: https://www.auto1.com/v1/car-details-view/RG93335/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fc4ad66-88ab-503d-91fe-06a7e6c64140 with identifier: RG93335
2026-03-30 10:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fc4ad66-88ab-503d-91fe-06a7e6c64140 with scrape type 1
2026-03-30 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1fc4ad66-88ab-503d-91fe-06a7e6c64140
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_77f11465a5a8c15a799db45bd5e507cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_77f11465a5a8c15a799db45bd5e507cf.jpg not downloaded yet
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_be1b677c482be2d86566d7a503fde2c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_be1b677c482be2d86566d7a503fde2c2.jpg not downloaded yet
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_53740e0ff8d089d362020f3a75a1b892.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_53740e0ff8d089d362020f3a75a1b892.jpg not downloaded yet
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_de0ae7ce892695ce8078a24a9bc96bd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_de0ae7ce892695ce8078a24a9bc96bd4.jpg not downloaded yet
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_3de3aad5ea7cbe47224a1e500a065eaf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_3de3aad5ea7cbe47224a1e500a065eaf.jpg not downloaded yet
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_3af7099c802987890f8f11ea055a30d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_3af7099c802987890f8f11ea055a30d8.jpg not downloaded yet
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_073e9ad2fd4989cc4ec804f8ce727e2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_073e9ad2fd4989cc4ec804f8ce727e2f.jpg not downloaded yet
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_af201380711a5bf52942bde5cc745cf6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_af201380711a5bf52942bde5cc745cf6.jpg not downloaded yet
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_9c2a4bb2b0798fc1a2cd9badf4c1301b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_9c2a4bb2b0798fc1a2cd9badf4c1301b.jpg not downloaded yet
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_86525c499cf619971bedfe05e3337426.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_86525c499cf619971bedfe05e3337426.jpg not downloaded yet
2026-03-30 10:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK73988/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_86525c499cf619971bedfe05e3337426.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45ed10>
2026-03-30 10:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_86525c499cf619971bedfe05e3337426.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_86525c499cf619971bedfe05e3337426.jpg saved to cache
2026-03-30 10:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1fc4ad66-88ab-503d-91fe-06a7e6c64140
2026-03-30 10:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CG08115/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_9c2a4bb2b0798fc1a2cd9badf4c1301b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefa5350>
2026-03-30 10:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_9c2a4bb2b0798fc1a2cd9badf4c1301b.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_9c2a4bb2b0798fc1a2cd9badf4c1301b.jpg saved to cache
2026-03-30 10:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1fc4ad66-88ab-503d-91fe-06a7e6c64140
2026-03-30 10:45:35 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.186(s), this was the 1st time calling it.
2026-03-30 10:45:35 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.000721646371966 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RR13912> (referer: https://www.auto1.com/v1/car-details-view/RR13912/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 283e0959-1625-59b4-8b46-ab407ea3503b with identifier: RR13912
2026-03-30 10:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 283e0959-1625-59b4-8b46-ab407ea3503b with scrape type 1
2026-03-30 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 283e0959-1625-59b4-8b46-ab407ea3503b
2026-03-30 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff0%252F37f03e522baf76a32636c5ccbdbedfd5%252Fpa%252FRR13912_b88679aa4d7bda7871bfad9c0d63780e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_b88679aa4d7bda7871bfad9c0d63780e.jpg already downloaded
2026-03-30 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff0%252F37f03e522baf76a32636c5ccbdbedfd5%252Fpa%252FRR13912_579234028fa32d1edd3720a69d92a1f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_579234028fa32d1edd3720a69d92a1f2.jpg already downloaded
2026-03-30 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff0%252F37f03e522baf76a32636c5ccbdbedfd5%252Fpa%252FRR13912_81f9f0919dda9d4ea0870d1acbb74836.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_81f9f0919dda9d4ea0870d1acbb74836.jpg already downloaded
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff0%252F37f03e522baf76a32636c5ccbdbedfd5%252Fpa%252FRR13912_98fa0a0c66e26e9ab4e779416dc2d642.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_98fa0a0c66e26e9ab4e779416dc2d642.jpg already downloaded
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff0%252F37f03e522baf76a32636c5ccbdbedfd5%252Fpa%252FRR13912_8044852e0af5e1c0ca243da95efc1652.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_8044852e0af5e1c0ca243da95efc1652.jpg already downloaded
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff0%252F37f03e522baf76a32636c5ccbdbedfd5%252Fpa%252FRR13912_54f997b3db5cf1bb8257baa438390577.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_54f997b3db5cf1bb8257baa438390577.jpg already downloaded
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff0%252F37f03e522baf76a32636c5ccbdbedfd5%252Fpa%252FRR13912_a3604aed2a222157d27b4bc9ba26d7a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_a3604aed2a222157d27b4bc9ba26d7a9.jpg already downloaded
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff0%252F37f03e522baf76a32636c5ccbdbedfd5%252Fpa%252FRR13912_5dac6e1ad31fe0d5ccceccb75353c254.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_5dac6e1ad31fe0d5ccceccb75353c254.jpg already downloaded
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff0%252F37f03e522baf76a32636c5ccbdbedfd5%252Fpa%252FRR13912_042f3731275aa54dab15a7bcdfc72265.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_042f3731275aa54dab15a7bcdfc72265.jpg already downloaded
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff0%252F37f03e522baf76a32636c5ccbdbedfd5%252Fpa%252FRR13912_b2759901f89e44ee148de337dd969f58.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_b2759901f89e44ee148de337dd969f58.jpg already downloaded
2026-03-30 10:45:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 283e0959-1625-59b4-8b46-ab407ea3503b, identifier: RR13912
2026-03-30 10:45:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 283e0959-1625-59b4-8b46-ab407ea3503b with identifier: RR13912
2026-03-30 10:45:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 283e0959-1625-59b4-8b46-ab407ea3503b with identifier: RR13912
2026-03-30 10:45:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 283e0959-1625-59b4-8b46-ab407ea3503b with identifier: RR13912 to the API
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RR13912>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:40:14Z',
 'fuel_type': 'diesel',
 'id': '283e0959-1625-59b4-8b46-ab407ea3503b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR13912',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 77915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_b88679aa4d7bda7871bfad9c0d63780e.jpg',
                'https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_579234028fa32d1edd3720a69d92a1f2.jpg',
                'https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_81f9f0919dda9d4ea0870d1acbb74836.jpg',
                'https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_98fa0a0c66e26e9ab4e779416dc2d642.jpg',
                'https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_8044852e0af5e1c0ca243da95efc1652.jpg',
                'https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_54f997b3db5cf1bb8257baa438390577.jpg',
                'https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_a3604aed2a222157d27b4bc9ba26d7a9.jpg',
                'https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_5dac6e1ad31fe0d5ccceccb75353c254.jpg',
                'https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_042f3731275aa54dab15a7bcdfc72265.jpg',
                'https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_b2759901f89e44ee148de337dd969f58.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283e0959-1625-59b4-8b46-ab407ea3503b/283e0959-1625-59b4-8b46-ab407ea3503b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2543143,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_b88679aa4d7bda7871bfad9c0d63780e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283e0959-1625-59b4-8b46-ab407ea3503b/283e0959-1625-59b4-8b46-ab407ea3503b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2490022,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_579234028fa32d1edd3720a69d92a1f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283e0959-1625-59b4-8b46-ab407ea3503b/283e0959-1625-59b4-8b46-ab407ea3503b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2325223,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_81f9f0919dda9d4ea0870d1acbb74836.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283e0959-1625-59b4-8b46-ab407ea3503b/283e0959-1625-59b4-8b46-ab407ea3503b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_98fa0a0c66e26e9ab4e779416dc2d642.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283e0959-1625-59b4-8b46-ab407ea3503b/283e0959-1625-59b4-8b46-ab407ea3503b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2203488,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_8044852e0af5e1c0ca243da95efc1652.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283e0959-1625-59b4-8b46-ab407ea3503b/283e0959-1625-59b4-8b46-ab407ea3503b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_54f997b3db5cf1bb8257baa438390577.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283e0959-1625-59b4-8b46-ab407ea3503b/283e0959-1625-59b4-8b46-ab407ea3503b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2346260,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_a3604aed2a222157d27b4bc9ba26d7a9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283e0959-1625-59b4-8b46-ab407ea3503b/283e0959-1625-59b4-8b46-ab407ea3503b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_5dac6e1ad31fe0d5ccceccb75353c254.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283e0959-1625-59b4-8b46-ab407ea3503b/283e0959-1625-59b4-8b46-ab407ea3503b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2454892,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_042f3731275aa54dab15a7bcdfc72265.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283e0959-1625-59b4-8b46-ab407ea3503b/283e0959-1625-59b4-8b46-ab407ea3503b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2795820,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/f0/37f03e522baf76a32636c5ccbdbedfd5/pa/RR13912_b2759901f89e44ee148de337dd969f58.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 109 CDI Extralang',
 'transmission': 'manual',
 'trim': 'Extralang',
 'year': 2015}
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR13912%27 HTTP/1.1" 200 None
2026-03-30 10:45:36 [auto1.de] INFO: Saving data for RR13912: {'created_time': 1774867536.586212, 'last_price_update_time': 1774867536.586222, 'auction_closing_time': 1774971614.0}
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR13912') HTTP/1.1" 204 0
2026-03-30 10:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_af201380711a5bf52942bde5cc745cf6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c01390>
2026-03-30 10:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_af201380711a5bf52942bde5cc745cf6.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_af201380711a5bf52942bde5cc745cf6.jpg saved to cache
2026-03-30 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1fc4ad66-88ab-503d-91fe-06a7e6c64140
2026-03-30 10:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_073e9ad2fd4989cc4ec804f8ce727e2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee12890>
2026-03-30 10:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_073e9ad2fd4989cc4ec804f8ce727e2f.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_073e9ad2fd4989cc4ec804f8ce727e2f.jpg saved to cache
2026-03-30 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1fc4ad66-88ab-503d-91fe-06a7e6c64140
2026-03-30 10:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_3af7099c802987890f8f11ea055a30d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3e910>
2026-03-30 10:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_3af7099c802987890f8f11ea055a30d8.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_3af7099c802987890f8f11ea055a30d8.jpg saved to cache
2026-03-30 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1fc4ad66-88ab-503d-91fe-06a7e6c64140
2026-03-30 10:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_3de3aad5ea7cbe47224a1e500a065eaf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefdd810>
2026-03-30 10:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_3de3aad5ea7cbe47224a1e500a065eaf.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_3de3aad5ea7cbe47224a1e500a065eaf.jpg saved to cache
2026-03-30 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1fc4ad66-88ab-503d-91fe-06a7e6c64140
2026-03-30 10:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_de0ae7ce892695ce8078a24a9bc96bd4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee81e90>
2026-03-30 10:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_de0ae7ce892695ce8078a24a9bc96bd4.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_de0ae7ce892695ce8078a24a9bc96bd4.jpg saved to cache
2026-03-30 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1fc4ad66-88ab-503d-91fe-06a7e6c64140
2026-03-30 10:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_53740e0ff8d089d362020f3a75a1b892.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefdf7d0>
2026-03-30 10:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_53740e0ff8d089d362020f3a75a1b892.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_53740e0ff8d089d362020f3a75a1b892.jpg saved to cache
2026-03-30 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1fc4ad66-88ab-503d-91fe-06a7e6c64140
2026-03-30 10:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_be1b677c482be2d86566d7a503fde2c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefa5350>
2026-03-30 10:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_be1b677c482be2d86566d7a503fde2c2.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_be1b677c482be2d86566d7a503fde2c2.jpg saved to cache
2026-03-30 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1fc4ad66-88ab-503d-91fe-06a7e6c64140
2026-03-30 10:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_77f11465a5a8c15a799db45bd5e507cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FN84005/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3df50>
2026-03-30 10:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5e%252F135e7c25951554c27727466103636443%252Fpa%252FRG93335_77f11465a5a8c15a799db45bd5e507cf.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_77f11465a5a8c15a799db45bd5e507cf.jpg saved to cache
2026-03-30 10:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fc4ad66-88ab-503d-91fe-06a7e6c64140
2026-03-30 10:45:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fc4ad66-88ab-503d-91fe-06a7e6c64140, skipping ID generation
2026-03-30 10:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fc4ad66-88ab-503d-91fe-06a7e6c64140 with scrape type 1
2026-03-30 10:45:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fc4ad66-88ab-503d-91fe-06a7e6c64140 sending to next pipeline
2026-03-30 10:45:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fc4ad66-88ab-503d-91fe-06a7e6c64140, identifier: RG93335
2026-03-30 10:45:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fc4ad66-88ab-503d-91fe-06a7e6c64140 with identifier: RG93335
2026-03-30 10:45:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fc4ad66-88ab-503d-91fe-06a7e6c64140 with identifier: RG93335
2026-03-30 10:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fc4ad66-88ab-503d-91fe-06a7e6c64140 with identifier: RG93335 to the API
2026-03-30 10:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_77f11465a5a8c15a799db45bd5e507cf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:18:44Z',
 'fuel_type': 'diesel',
 'id': '1fc4ad66-88ab-503d-91fe-06a7e6c64140',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG93335',
 'listing': 'auction',
 'location': 'DE, Krefeld',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 167848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2595141,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_77f11465a5a8c15a799db45bd5e507cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2533974,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_be1b677c482be2d86566d7a503fde2c2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2743197,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_53740e0ff8d089d362020f3a75a1b892.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2706842,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_de0ae7ce892695ce8078a24a9bc96bd4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2891367,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_3de3aad5ea7cbe47224a1e500a065eaf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2543524,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_3af7099c802987890f8f11ea055a30d8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2703829,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_073e9ad2fd4989cc4ec804f8ce727e2f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2491346,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_af201380711a5bf52942bde5cc745cf6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2640934,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_9c2a4bb2b0798fc1a2cd9badf4c1301b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc4ad66-88ab-503d-91fe-06a7e6c64140/1fc4ad66-88ab-503d-91fe-06a7e6c64140_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2644532,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5e/135e7c25951554c27727466103636443/pa/RG93335_86525c499cf619971bedfe05e3337426.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-30 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG93335%27 HTTP/1.1" 200 None
2026-03-30 10:45:39 [auto1.de] INFO: Saving data for RG93335: {'created_time': 1774867539.659853, 'last_price_update_time': 1774867539.659867, 'auction_closing_time': 1774970324.0}
2026-03-30 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG93335') HTTP/1.1" 204 0
2026-03-30 10:45:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL28178/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU61041> (referer: https://www.auto1.com/v1/car-details-view/RU61041/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57c19a09-7096-5988-91ad-b08fa2db183a with identifier: RU61041
2026-03-30 10:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57c19a09-7096-5988-91ad-b08fa2db183a with scrape type 1
2026-03-30 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 57c19a09-7096-5988-91ad-b08fa2db183a
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_d2ecf80218e0b5b032c626f99314cd86.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_d2ecf80218e0b5b032c626f99314cd86.jpg not downloaded yet
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_f03c2c8a7352c8df56c77abf4c375fae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_f03c2c8a7352c8df56c77abf4c375fae.jpg not downloaded yet
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_948594b4a79b54125ac98352421bc9ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_948594b4a79b54125ac98352421bc9ed.jpg not downloaded yet
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_89acd43b350dbce4e113fc8a5eddf7f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_89acd43b350dbce4e113fc8a5eddf7f0.jpg not downloaded yet
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_a924f6ae863dfd77cc9b328fb0cb9b0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_a924f6ae863dfd77cc9b328fb0cb9b0d.jpg not downloaded yet
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_526d6d4d41944f765cc7a5a177771f02.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_526d6d4d41944f765cc7a5a177771f02.jpg not downloaded yet
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_9bf0d6a76dd68c672a0384aabcfb293e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_9bf0d6a76dd68c672a0384aabcfb293e.jpg not downloaded yet
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_1557f1b7ff6bd9c2af7a4f18c32f9307.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_1557f1b7ff6bd9c2af7a4f18c32f9307.jpg not downloaded yet
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_8e749475f6914f2ca8dd5eff0ac33fc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_8e749475f6914f2ca8dd5eff0ac33fc0.jpg not downloaded yet
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_a87cd50e293cef26e2a22c366d77f642.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_a87cd50e293cef26e2a22c366d77f642.jpg not downloaded yet
2026-03-30 10:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ97235> (referer: https://www.auto1.com/v1/car-details-view/GZ97235/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_a87cd50e293cef26e2a22c366d77f642.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 942fc0bd-1b03-5c2b-aaa1-e23e3307624a with identifier: GZ97235
2026-03-30 10:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 942fc0bd-1b03-5c2b-aaa1-e23e3307624a with scrape type 1
2026-03-30 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 942fc0bd-1b03-5c2b-aaa1-e23e3307624a
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_4d4c4142a2e7d7e43b27d63aedffc5b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_4d4c4142a2e7d7e43b27d63aedffc5b5.jpg not downloaded yet
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_fa0d44ba1d8faa7fbfb0ff0f9f961153.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_fa0d44ba1d8faa7fbfb0ff0f9f961153.jpg not downloaded yet
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_415730010368917b6889944ea5ecf8a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_415730010368917b6889944ea5ecf8a2.jpg not downloaded yet
2026-03-30 10:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_8e749475f6914f2ca8dd5eff0ac33fc0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_9bf81fd43891b0579f8eec35ec38b10a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_9bf81fd43891b0579f8eec35ec38b10a.jpg not downloaded yet
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_7f77e243131830bed302a7e969de475a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_7f77e243131830bed302a7e969de475a.jpg not downloaded yet
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_49989a9a9ec4bb6bb6b99edca35f1143.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_49989a9a9ec4bb6bb6b99edca35f1143.jpg not downloaded yet
2026-03-30 10:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef9f7d0>
2026-03-30 10:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_a87cd50e293cef26e2a22c366d77f642.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_a87cd50e293cef26e2a22c366d77f642.jpg saved to cache
2026-03-30 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 57c19a09-7096-5988-91ad-b08fa2db183a
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_ceaac152a2934eb626c89dba29af1fea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_ceaac152a2934eb626c89dba29af1fea.jpg not downloaded yet
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_cd57dc90e970fdcf4a6425216536a668.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_cd57dc90e970fdcf4a6425216536a668.jpg not downloaded yet
2026-03-30 10:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_415730010368917b6889944ea5ecf8a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_ee0ef2de7d4c9a1dab4fb17739eb89f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_ee0ef2de7d4c9a1dab4fb17739eb89f1.jpg not downloaded yet
2026-03-30 10:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef5b910>
2026-03-30 10:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_8e749475f6914f2ca8dd5eff0ac33fc0.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_8e749475f6914f2ca8dd5eff0ac33fc0.jpg saved to cache
2026-03-30 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 57c19a09-7096-5988-91ad-b08fa2db183a
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_53d42bdb0510185bfb1a5567c74bbabf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_53d42bdb0510185bfb1a5567c74bbabf.jpg not downloaded yet
2026-03-30 10:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4173110>
2026-03-30 10:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_415730010368917b6889944ea5ecf8a2.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_415730010368917b6889944ea5ecf8a2.jpg saved to cache
2026-03-30 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 942fc0bd-1b03-5c2b-aaa1-e23e3307624a
2026-03-30 10:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_cd57dc90e970fdcf4a6425216536a668.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_53d42bdb0510185bfb1a5567c74bbabf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3ea890>
2026-03-30 10:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_cd57dc90e970fdcf4a6425216536a668.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_cd57dc90e970fdcf4a6425216536a668.jpg saved to cache
2026-03-30 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 942fc0bd-1b03-5c2b-aaa1-e23e3307624a
2026-03-30 10:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_ee0ef2de7d4c9a1dab4fb17739eb89f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45c690>
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_53d42bdb0510185bfb1a5567c74bbabf.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_53d42bdb0510185bfb1a5567c74bbabf.jpg saved to cache
2026-03-30 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 942fc0bd-1b03-5c2b-aaa1-e23e3307624a
2026-03-30 10:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_ceaac152a2934eb626c89dba29af1fea.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee111d0>
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_ee0ef2de7d4c9a1dab4fb17739eb89f1.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_ee0ef2de7d4c9a1dab4fb17739eb89f1.jpg saved to cache
2026-03-30 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 942fc0bd-1b03-5c2b-aaa1-e23e3307624a
2026-03-30 10:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_49989a9a9ec4bb6bb6b99edca35f1143.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee127d0>
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_ceaac152a2934eb626c89dba29af1fea.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_ceaac152a2934eb626c89dba29af1fea.jpg saved to cache
2026-03-30 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 942fc0bd-1b03-5c2b-aaa1-e23e3307624a
2026-03-30 10:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_7f77e243131830bed302a7e969de475a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee12450>
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_49989a9a9ec4bb6bb6b99edca35f1143.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_49989a9a9ec4bb6bb6b99edca35f1143.jpg saved to cache
2026-03-30 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 942fc0bd-1b03-5c2b-aaa1-e23e3307624a
2026-03-30 10:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_9bf81fd43891b0579f8eec35ec38b10a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45f510>
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_7f77e243131830bed302a7e969de475a.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_7f77e243131830bed302a7e969de475a.jpg saved to cache
2026-03-30 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 942fc0bd-1b03-5c2b-aaa1-e23e3307624a
2026-03-30 10:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_fa0d44ba1d8faa7fbfb0ff0f9f961153.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefa5390>
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_9bf81fd43891b0579f8eec35ec38b10a.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_9bf81fd43891b0579f8eec35ec38b10a.jpg saved to cache
2026-03-30 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 942fc0bd-1b03-5c2b-aaa1-e23e3307624a
2026-03-30 10:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_4d4c4142a2e7d7e43b27d63aedffc5b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45d610>
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_fa0d44ba1d8faa7fbfb0ff0f9f961153.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_fa0d44ba1d8faa7fbfb0ff0f9f961153.jpg saved to cache
2026-03-30 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 942fc0bd-1b03-5c2b-aaa1-e23e3307624a
2026-03-30 10:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_1557f1b7ff6bd9c2af7a4f18c32f9307.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd6190>
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fab%252F51ab846115776267426a1945b0bf772e%252Fpa%252FGZ97235_4d4c4142a2e7d7e43b27d63aedffc5b5.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_4d4c4142a2e7d7e43b27d63aedffc5b5.jpg saved to cache
2026-03-30 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 942fc0bd-1b03-5c2b-aaa1-e23e3307624a
2026-03-30 10:45:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 942fc0bd-1b03-5c2b-aaa1-e23e3307624a, skipping ID generation
2026-03-30 10:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 942fc0bd-1b03-5c2b-aaa1-e23e3307624a with scrape type 1
2026-03-30 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 942fc0bd-1b03-5c2b-aaa1-e23e3307624a sending to next pipeline
2026-03-30 10:45:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 942fc0bd-1b03-5c2b-aaa1-e23e3307624a, identifier: GZ97235
2026-03-30 10:45:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 942fc0bd-1b03-5c2b-aaa1-e23e3307624a with identifier: GZ97235
2026-03-30 10:45:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 942fc0bd-1b03-5c2b-aaa1-e23e3307624a with identifier: GZ97235
2026-03-30 10:45:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 942fc0bd-1b03-5c2b-aaa1-e23e3307624a with identifier: GZ97235 to the API
2026-03-30 10:45:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_4d4c4142a2e7d7e43b27d63aedffc5b5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:46:37Z',
 'fuel_type': 'diesel',
 'id': '942fc0bd-1b03-5c2b-aaa1-e23e3307624a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ97235',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 222595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_4d4c4142a2e7d7e43b27d63aedffc5b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_fa0d44ba1d8faa7fbfb0ff0f9f961153.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_415730010368917b6889944ea5ecf8a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_9bf81fd43891b0579f8eec35ec38b10a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_7f77e243131830bed302a7e969de475a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_49989a9a9ec4bb6bb6b99edca35f1143.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_ceaac152a2934eb626c89dba29af1fea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_cd57dc90e970fdcf4a6425216536a668.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_ee0ef2de7d4c9a1dab4fb17739eb89f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942fc0bd-1b03-5c2b-aaa1-e23e3307624a/942fc0bd-1b03-5c2b-aaa1-e23e3307624a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ab/51ab846115776267426a1945b0bf772e/pa/GZ97235_53d42bdb0510185bfb1a5567c74bbabf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 1.6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ97235%27 HTTP/1.1" 200 None
2026-03-30 10:45:52 [auto1.de] INFO: Saving data for GZ97235: {'created_time': 1774867552.23488, 'last_price_update_time': 1774867552.23489, 'auction_closing_time': 1774971997.0}
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ97235') HTTP/1.1" 204 0
2026-03-30 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_9bf0d6a76dd68c672a0384aabcfb293e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef776d0>
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_1557f1b7ff6bd9c2af7a4f18c32f9307.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_1557f1b7ff6bd9c2af7a4f18c32f9307.jpg saved to cache
2026-03-30 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 57c19a09-7096-5988-91ad-b08fa2db183a
2026-03-30 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_526d6d4d41944f765cc7a5a177771f02.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee428710>
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_9bf0d6a76dd68c672a0384aabcfb293e.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_9bf0d6a76dd68c672a0384aabcfb293e.jpg saved to cache
2026-03-30 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 57c19a09-7096-5988-91ad-b08fa2db183a
2026-03-30 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_a924f6ae863dfd77cc9b328fb0cb9b0d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41db9d0>
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_526d6d4d41944f765cc7a5a177771f02.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_526d6d4d41944f765cc7a5a177771f02.jpg saved to cache
2026-03-30 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 57c19a09-7096-5988-91ad-b08fa2db183a
2026-03-30 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_89acd43b350dbce4e113fc8a5eddf7f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee81c50>
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_a924f6ae863dfd77cc9b328fb0cb9b0d.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_a924f6ae863dfd77cc9b328fb0cb9b0d.jpg saved to cache
2026-03-30 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 57c19a09-7096-5988-91ad-b08fa2db183a
2026-03-30 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_948594b4a79b54125ac98352421bc9ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef77850>
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_89acd43b350dbce4e113fc8a5eddf7f0.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_89acd43b350dbce4e113fc8a5eddf7f0.jpg saved to cache
2026-03-30 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 57c19a09-7096-5988-91ad-b08fa2db183a
2026-03-30 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_f03c2c8a7352c8df56c77abf4c375fae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee3edd0>
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_948594b4a79b54125ac98352421bc9ed.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_948594b4a79b54125ac98352421bc9ed.jpg saved to cache
2026-03-30 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 57c19a09-7096-5988-91ad-b08fa2db183a
2026-03-30 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_d2ecf80218e0b5b032c626f99314cd86.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424e450>
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_f03c2c8a7352c8df56c77abf4c375fae.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_f03c2c8a7352c8df56c77abf4c375fae.jpg saved to cache
2026-03-30 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 57c19a09-7096-5988-91ad-b08fa2db183a
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424d450>
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F30%252F30307c42d47aee369f75549af3d07335%252Fpa%252FRU61041_d2ecf80218e0b5b032c626f99314cd86.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_d2ecf80218e0b5b032c626f99314cd86.jpg saved to cache
2026-03-30 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57c19a09-7096-5988-91ad-b08fa2db183a
2026-03-30 10:45:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57c19a09-7096-5988-91ad-b08fa2db183a, skipping ID generation
2026-03-30 10:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57c19a09-7096-5988-91ad-b08fa2db183a with scrape type 1
2026-03-30 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57c19a09-7096-5988-91ad-b08fa2db183a sending to next pipeline
2026-03-30 10:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57c19a09-7096-5988-91ad-b08fa2db183a, identifier: RU61041
2026-03-30 10:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57c19a09-7096-5988-91ad-b08fa2db183a with identifier: RU61041
2026-03-30 10:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57c19a09-7096-5988-91ad-b08fa2db183a with identifier: RU61041
2026-03-30 10:45:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57c19a09-7096-5988-91ad-b08fa2db183a with identifier: RU61041 to the API
2026-03-30 10:45:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_d2ecf80218e0b5b032c626f99314cd86.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 33,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 328,
 'expiration_date': '2026-03-31T15:35:47Z',
 'fuel_type': 'hybrid',
 'id': '57c19a09-7096-5988-91ad-b08fa2db183a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU61041',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Mazda',
 'model': 'CX-60',
 'odometer': 68684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_d2ecf80218e0b5b032c626f99314cd86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_f03c2c8a7352c8df56c77abf4c375fae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_948594b4a79b54125ac98352421bc9ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_89acd43b350dbce4e113fc8a5eddf7f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_a924f6ae863dfd77cc9b328fb0cb9b0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_526d6d4d41944f765cc7a5a177771f02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_9bf0d6a76dd68c672a0384aabcfb293e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_1557f1b7ff6bd9c2af7a4f18c32f9307.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_8e749475f6914f2ca8dd5eff0ac33fc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c19a09-7096-5988-91ad-b08fa2db183a/57c19a09-7096-5988-91ad-b08fa2db183a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/30/30307c42d47aee369f75549af3d07335/pa/RU61041_a87cd50e293cef26e2a22c366d77f642.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-60 2.5 e-Skyactiv Plug-in Hybrid Homura AWD',
 'transmission': 'automatic',
 'trim': 'Homura AWD',
 'year': 2024}
2026-03-30 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU61041%27 HTTP/1.1" 200 None
2026-03-30 10:45:53 [auto1.de] INFO: Saving data for RU61041: {'created_time': 1774867553.373421, 'last_price_update_time': 1774867553.373431, 'auction_closing_time': 1774971347.0}
2026-03-30 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU61041') HTTP/1.1" 204 0
2026-03-30 10:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX18259> (referer: https://www.auto1.com/v1/car-details-view/LX18259/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2415641-cab7-54f1-8dcb-8492ec4650e9 with identifier: LX18259
2026-03-30 10:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2415641-cab7-54f1-8dcb-8492ec4650e9 with scrape type 1
2026-03-30 10:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2415641-cab7-54f1-8dcb-8492ec4650e9
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F2e%252Fb12eb803cd279bb0b3e112cbc2376a1f%252Fpa%252FLX18259_c9afc5da5cb6ff84b946ffd36a3641d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_c9afc5da5cb6ff84b946ffd36a3641d1.jpg already downloaded
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F2e%252Fb12eb803cd279bb0b3e112cbc2376a1f%252Fpa%252FLX18259_8db51ba2e8ed45f2ae76468a407432fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_8db51ba2e8ed45f2ae76468a407432fb.jpg already downloaded
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F2e%252Fb12eb803cd279bb0b3e112cbc2376a1f%252Fpa%252FLX18259_a9097c807804a4549a95907f5264d9a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_a9097c807804a4549a95907f5264d9a1.jpg already downloaded
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F2e%252Fb12eb803cd279bb0b3e112cbc2376a1f%252Fpa%252FLX18259_96b704d5196af93df68f132bbf09076a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_96b704d5196af93df68f132bbf09076a.jpg already downloaded
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F2e%252Fb12eb803cd279bb0b3e112cbc2376a1f%252Fpa%252FLX18259_403a5e823bb871569d3bf1cb786ff8aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_403a5e823bb871569d3bf1cb786ff8aa.jpg already downloaded
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F2e%252Fb12eb803cd279bb0b3e112cbc2376a1f%252Fpa%252FLX18259_030ae251688d731876f750320d4ec619.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_030ae251688d731876f750320d4ec619.jpg already downloaded
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F2e%252Fb12eb803cd279bb0b3e112cbc2376a1f%252Fpa%252FLX18259_e416ef72ad4a29aba08fd1a64f7e44d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_e416ef72ad4a29aba08fd1a64f7e44d0.jpg already downloaded
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F2e%252Fb12eb803cd279bb0b3e112cbc2376a1f%252Fpa%252FLX18259_fc6febb735285d164993ad9c9404835a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_fc6febb735285d164993ad9c9404835a.jpg already downloaded
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F2e%252Fb12eb803cd279bb0b3e112cbc2376a1f%252Fpa%252FLX18259_5d38a0f15e1e1b033fba3c53f1560fbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_5d38a0f15e1e1b033fba3c53f1560fbc.jpg already downloaded
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F2e%252Fb12eb803cd279bb0b3e112cbc2376a1f%252Fpa%252FLX18259_811f8aecc022d8722fa3ecea1e026c3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_811f8aecc022d8722fa3ecea1e026c3b.jpg already downloaded
2026-03-30 10:45:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2415641-cab7-54f1-8dcb-8492ec4650e9, identifier: LX18259
2026-03-30 10:45:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2415641-cab7-54f1-8dcb-8492ec4650e9 with identifier: LX18259
2026-03-30 10:45:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2415641-cab7-54f1-8dcb-8492ec4650e9 with identifier: LX18259
2026-03-30 10:45:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2415641-cab7-54f1-8dcb-8492ec4650e9 with identifier: LX18259 to the API
2026-03-30 10:45:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LX18259>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 147,
 'expiration_date': '2026-03-31T15:35:46Z',
 'fuel_type': 'petrol',
 'id': 'd2415641-cab7-54f1-8dcb-8492ec4650e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX18259',
 'listing': 'auction',
 'location': 'DE, Kandel',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 172327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_c9afc5da5cb6ff84b946ffd36a3641d1.jpg',
                'https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_8db51ba2e8ed45f2ae76468a407432fb.jpg',
                'https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_a9097c807804a4549a95907f5264d9a1.jpg',
                'https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_96b704d5196af93df68f132bbf09076a.jpg',
                'https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_403a5e823bb871569d3bf1cb786ff8aa.jpg',
                'https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_030ae251688d731876f750320d4ec619.jpg',
                'https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_e416ef72ad4a29aba08fd1a64f7e44d0.jpg',
                'https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_fc6febb735285d164993ad9c9404835a.jpg',
                'https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_5d38a0f15e1e1b033fba3c53f1560fbc.jpg',
                'https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_811f8aecc022d8722fa3ecea1e026c3b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2415641-cab7-54f1-8dcb-8492ec4650e9/d2415641-cab7-54f1-8dcb-8492ec4650e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_c9afc5da5cb6ff84b946ffd36a3641d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2415641-cab7-54f1-8dcb-8492ec4650e9/d2415641-cab7-54f1-8dcb-8492ec4650e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_8db51ba2e8ed45f2ae76468a407432fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2415641-cab7-54f1-8dcb-8492ec4650e9/d2415641-cab7-54f1-8dcb-8492ec4650e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_a9097c807804a4549a95907f5264d9a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2415641-cab7-54f1-8dcb-8492ec4650e9/d2415641-cab7-54f1-8dcb-8492ec4650e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_96b704d5196af93df68f132bbf09076a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2415641-cab7-54f1-8dcb-8492ec4650e9/d2415641-cab7-54f1-8dcb-8492ec4650e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_403a5e823bb871569d3bf1cb786ff8aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2415641-cab7-54f1-8dcb-8492ec4650e9/d2415641-cab7-54f1-8dcb-8492ec4650e9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2643387,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_030ae251688d731876f750320d4ec619.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2415641-cab7-54f1-8dcb-8492ec4650e9/d2415641-cab7-54f1-8dcb-8492ec4650e9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_e416ef72ad4a29aba08fd1a64f7e44d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2415641-cab7-54f1-8dcb-8492ec4650e9/d2415641-cab7-54f1-8dcb-8492ec4650e9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2476425,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_fc6febb735285d164993ad9c9404835a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2415641-cab7-54f1-8dcb-8492ec4650e9/d2415641-cab7-54f1-8dcb-8492ec4650e9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2384032,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_5d38a0f15e1e1b033fba3c53f1560fbc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2415641-cab7-54f1-8dcb-8492ec4650e9/d2415641-cab7-54f1-8dcb-8492ec4650e9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2748251,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/2e/b12eb803cd279bb0b3e112cbc2376a1f/pa/LX18259_811f8aecc022d8722fa3ecea1e026c3b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Avensis 1.8 Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2015}
2026-03-30 10:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX18259%27 HTTP/1.1" 200 None
2026-03-30 10:45:57 [auto1.de] INFO: Saving data for LX18259: {'created_time': 1774867557.307751, 'last_price_update_time': 1774867557.307764, 'auction_closing_time': 1774971346.0}
2026-03-30 10:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX18259') HTTP/1.1" 204 0
2026-03-30 10:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DT44924> (referer: https://www.auto1.com/v1/car-details-view/DT44924/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14f324be-a36e-5e88-ab52-2441b84d44a3 with identifier: DT44924
2026-03-30 10:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f324be-a36e-5e88-ab52-2441b84d44a3 with scrape type 1
2026-03-30 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14f324be-a36e-5e88-ab52-2441b84d44a3
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F6a%252F236aa68496ad43b17d18336839ec5118%252Fpa%252FDT44924_47fe39dca6bea988dea6d1e8fda8887a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_47fe39dca6bea988dea6d1e8fda8887a.jpg already downloaded
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F6a%252F236aa68496ad43b17d18336839ec5118%252Fpa%252FDT44924_635f5b5ae4b0b4c17a87da4b2a07c72c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_635f5b5ae4b0b4c17a87da4b2a07c72c.jpg already downloaded
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F6a%252F236aa68496ad43b17d18336839ec5118%252Fpa%252FDT44924_017b1531544d6e442506331422aa521a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_017b1531544d6e442506331422aa521a.jpg already downloaded
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F6a%252F236aa68496ad43b17d18336839ec5118%252Fpa%252FDT44924_931f639f38862b2b2c1f7aa04731b449.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_931f639f38862b2b2c1f7aa04731b449.jpg already downloaded
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F6a%252F236aa68496ad43b17d18336839ec5118%252Fpa%252FDT44924_af3b43e33084617a19a033a9365cb18d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_af3b43e33084617a19a033a9365cb18d.jpg already downloaded
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F6a%252F236aa68496ad43b17d18336839ec5118%252Fpa%252FDT44924_64f825f0fa72654f091f6f4a07689807.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_64f825f0fa72654f091f6f4a07689807.jpg already downloaded
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F6a%252F236aa68496ad43b17d18336839ec5118%252Fpa%252FDT44924_32d773434185ef1a2d59e0808856499b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_32d773434185ef1a2d59e0808856499b.jpg already downloaded
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F6a%252F236aa68496ad43b17d18336839ec5118%252Fpa%252FDT44924_dba86d9e3019a7a8c38e095d000e4739.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_dba86d9e3019a7a8c38e095d000e4739.jpg already downloaded
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F6a%252F236aa68496ad43b17d18336839ec5118%252Fpa%252FDT44924_213fea3e662bcf4c18436a904b78aed2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_213fea3e662bcf4c18436a904b78aed2.jpg already downloaded
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F6a%252F236aa68496ad43b17d18336839ec5118%252Fpa%252FDT44924_2ec5c00a8671af80e6041aa41724df76.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_2ec5c00a8671af80e6041aa41724df76.jpg already downloaded
2026-03-30 10:46:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14f324be-a36e-5e88-ab52-2441b84d44a3, identifier: DT44924
2026-03-30 10:46:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14f324be-a36e-5e88-ab52-2441b84d44a3 with identifier: DT44924
2026-03-30 10:46:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14f324be-a36e-5e88-ab52-2441b84d44a3 with identifier: DT44924
2026-03-30 10:46:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14f324be-a36e-5e88-ab52-2441b84d44a3 with identifier: DT44924 to the API
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DT44924>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:04:21Z',
 'fuel_type': 'petrol',
 'id': '14f324be-a36e-5e88-ab52-2441b84d44a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT44924',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 59199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_47fe39dca6bea988dea6d1e8fda8887a.jpg',
                'https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_635f5b5ae4b0b4c17a87da4b2a07c72c.jpg',
                'https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_017b1531544d6e442506331422aa521a.jpg',
                'https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_931f639f38862b2b2c1f7aa04731b449.jpg',
                'https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_af3b43e33084617a19a033a9365cb18d.jpg',
                'https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_64f825f0fa72654f091f6f4a07689807.jpg',
                'https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_32d773434185ef1a2d59e0808856499b.jpg',
                'https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_dba86d9e3019a7a8c38e095d000e4739.jpg',
                'https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_213fea3e662bcf4c18436a904b78aed2.jpg',
                'https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_2ec5c00a8671af80e6041aa41724df76.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f324be-a36e-5e88-ab52-2441b84d44a3/14f324be-a36e-5e88-ab52-2441b84d44a3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2444104,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_47fe39dca6bea988dea6d1e8fda8887a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f324be-a36e-5e88-ab52-2441b84d44a3/14f324be-a36e-5e88-ab52-2441b84d44a3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2319518,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_635f5b5ae4b0b4c17a87da4b2a07c72c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f324be-a36e-5e88-ab52-2441b84d44a3/14f324be-a36e-5e88-ab52-2441b84d44a3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2275739,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_017b1531544d6e442506331422aa521a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f324be-a36e-5e88-ab52-2441b84d44a3/14f324be-a36e-5e88-ab52-2441b84d44a3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2208733,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_931f639f38862b2b2c1f7aa04731b449.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f324be-a36e-5e88-ab52-2441b84d44a3/14f324be-a36e-5e88-ab52-2441b84d44a3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2426566,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_af3b43e33084617a19a033a9365cb18d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f324be-a36e-5e88-ab52-2441b84d44a3/14f324be-a36e-5e88-ab52-2441b84d44a3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2574481,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_64f825f0fa72654f091f6f4a07689807.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f324be-a36e-5e88-ab52-2441b84d44a3/14f324be-a36e-5e88-ab52-2441b84d44a3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2394331,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_32d773434185ef1a2d59e0808856499b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f324be-a36e-5e88-ab52-2441b84d44a3/14f324be-a36e-5e88-ab52-2441b84d44a3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2404797,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_dba86d9e3019a7a8c38e095d000e4739.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f324be-a36e-5e88-ab52-2441b84d44a3/14f324be-a36e-5e88-ab52-2441b84d44a3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2530688,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_213fea3e662bcf4c18436a904b78aed2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f324be-a36e-5e88-ab52-2441b84d44a3/14f324be-a36e-5e88-ab52-2441b84d44a3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2771494,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/6a/236aa68496ad43b17d18336839ec5118/pa/DT44924_2ec5c00a8671af80e6041aa41724df76.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2003}
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT44924%27 HTTP/1.1" 200 None
2026-03-30 10:46:02 [auto1.de] INFO: Saving data for DT44924: {'created_time': 1774867562.668521, 'last_price_update_time': 1774867562.668531, 'auction_closing_time': 1774969461.0}
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT44924') HTTP/1.1" 204 0
2026-03-30 10:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY43496/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:04 [scrapy.extensions.logstats] INFO: Crawled 564 pages (at 17 pages/min), scraped 412 items (at 12 items/min)
2026-03-30 10:46:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW35819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CG08115> (referer: https://www.auto1.com/v1/car-details-view/CG08115/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51f869b4-4509-57d3-a042-637a4f5ba29e with identifier: CG08115
2026-03-30 10:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51f869b4-4509-57d3-a042-637a4f5ba29e with scrape type 1
2026-03-30 10:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 51f869b4-4509-57d3-a042-637a4f5ba29e
2026-03-30 10:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fb8%252F2cb8111fdcb19994b7cab9efd3b82b69%252Fpa%252FCG08115_a165b387e6afd6704d5dad5d26325f1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_a165b387e6afd6704d5dad5d26325f1b.jpg not downloaded yet
2026-03-30 10:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fb8%252F2cb8111fdcb19994b7cab9efd3b82b69%252Fpa%252FCG08115_4d3f1ea3f9a1ab18b7480424e0ea3325.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_4d3f1ea3f9a1ab18b7480424e0ea3325.jpg not downloaded yet
2026-03-30 10:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fb8%252F2cb8111fdcb19994b7cab9efd3b82b69%252Fpa%252FCG08115_f55574f07dc54a2c62e11ae75f5ea122.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_f55574f07dc54a2c62e11ae75f5ea122.jpg not downloaded yet
2026-03-30 10:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fb8%252F2cb8111fdcb19994b7cab9efd3b82b69%252Fpa%252FCG08115_3a5279344748952b110ea3f75c42827f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_3a5279344748952b110ea3f75c42827f.jpg not downloaded yet
2026-03-30 10:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fb8%252F2cb8111fdcb19994b7cab9efd3b82b69%252Fpa%252FCG08115_f973796a2b5797d3ce6df98fd79b4bc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_f973796a2b5797d3ce6df98fd79b4bc4.jpg not downloaded yet
2026-03-30 10:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK95635/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_f973796a2b5797d3ce6df98fd79b4bc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_3a5279344748952b110ea3f75c42827f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL02877/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef45dd0>
2026-03-30 10:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fb8%252F2cb8111fdcb19994b7cab9efd3b82b69%252Fpa%252FCG08115_f973796a2b5797d3ce6df98fd79b4bc4.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_f973796a2b5797d3ce6df98fd79b4bc4.jpg saved to cache
2026-03-30 10:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51f869b4-4509-57d3-a042-637a4f5ba29e
2026-03-30 10:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_f55574f07dc54a2c62e11ae75f5ea122.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef7c3d0>
2026-03-30 10:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fb8%252F2cb8111fdcb19994b7cab9efd3b82b69%252Fpa%252FCG08115_3a5279344748952b110ea3f75c42827f.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_3a5279344748952b110ea3f75c42827f.jpg saved to cache
2026-03-30 10:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51f869b4-4509-57d3-a042-637a4f5ba29e
2026-03-30 10:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_4d3f1ea3f9a1ab18b7480424e0ea3325.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeedd390>
2026-03-30 10:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fb8%252F2cb8111fdcb19994b7cab9efd3b82b69%252Fpa%252FCG08115_f55574f07dc54a2c62e11ae75f5ea122.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_f55574f07dc54a2c62e11ae75f5ea122.jpg saved to cache
2026-03-30 10:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51f869b4-4509-57d3-a042-637a4f5ba29e
2026-03-30 10:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41da910>
2026-03-30 10:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fb8%252F2cb8111fdcb19994b7cab9efd3b82b69%252Fpa%252FCG08115_4d3f1ea3f9a1ab18b7480424e0ea3325.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_4d3f1ea3f9a1ab18b7480424e0ea3325.jpg saved to cache
2026-03-30 10:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51f869b4-4509-57d3-a042-637a4f5ba29e
2026-03-30 10:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FN84005> (referer: https://www.auto1.com/v1/car-details-view/FN84005/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_a165b387e6afd6704d5dad5d26325f1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 114a4e0b-e9e6-590e-b06b-17a955b4661e with identifier: FN84005
2026-03-30 10:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 114a4e0b-e9e6-590e-b06b-17a955b4661e with scrape type 1
2026-03-30 10:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 114a4e0b-e9e6-590e-b06b-17a955b4661e
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F7f%252Faf7f6617e1bcee061fdb5858678c1908%252Fpa%252FFN84005_5b0c6e2648674f8e0936705649e2c1e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_5b0c6e2648674f8e0936705649e2c1e5.jpg not downloaded yet
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F7f%252Faf7f6617e1bcee061fdb5858678c1908%252Fpa%252FFN84005_44daab638215741ed3875f3a129bd0b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_44daab638215741ed3875f3a129bd0b5.jpg not downloaded yet
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F7f%252Faf7f6617e1bcee061fdb5858678c1908%252Fpa%252FFN84005_f65e6b9838db781fd3a866d7def65c98.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_f65e6b9838db781fd3a866d7def65c98.jpg not downloaded yet
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F7f%252Faf7f6617e1bcee061fdb5858678c1908%252Fpa%252FFN84005_7d25706e8c1f0ad1d0e9c70a34c53595.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_7d25706e8c1f0ad1d0e9c70a34c53595.jpg not downloaded yet
2026-03-30 10:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL28178> (referer: https://www.auto1.com/v1/car-details-view/AL28178/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee3d190>
2026-03-30 10:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fb8%252F2cb8111fdcb19994b7cab9efd3b82b69%252Fpa%252FCG08115_a165b387e6afd6704d5dad5d26325f1b.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_a165b387e6afd6704d5dad5d26325f1b.jpg saved to cache
2026-03-30 10:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51f869b4-4509-57d3-a042-637a4f5ba29e
2026-03-30 10:46:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51f869b4-4509-57d3-a042-637a4f5ba29e, skipping ID generation
2026-03-30 10:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51f869b4-4509-57d3-a042-637a4f5ba29e with scrape type 1
2026-03-30 10:46:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51f869b4-4509-57d3-a042-637a4f5ba29e sending to next pipeline
2026-03-30 10:46:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51f869b4-4509-57d3-a042-637a4f5ba29e, identifier: CG08115
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F7f%252Faf7f6617e1bcee061fdb5858678c1908%252Fpa%252FFN84005_84abe8c3cab141e5c3afa37ed87acd82.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_84abe8c3cab141e5c3afa37ed87acd82.jpg not downloaded yet
2026-03-30 10:46:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51f869b4-4509-57d3-a042-637a4f5ba29e with identifier: CG08115
2026-03-30 10:46:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51f869b4-4509-57d3-a042-637a4f5ba29e with identifier: CG08115
2026-03-30 10:46:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51f869b4-4509-57d3-a042-637a4f5ba29e with identifier: CG08115 to the API
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_a165b387e6afd6704d5dad5d26325f1b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:10:14Z',
 'fuel_type': 'petrol',
 'id': '51f869b4-4509-57d3-a042-637a4f5ba29e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG08115',
 'listing': 'auction',
 'location': 'DE, Bitburg',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 202819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_a165b387e6afd6704d5dad5d26325f1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_4d3f1ea3f9a1ab18b7480424e0ea3325.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_f55574f07dc54a2c62e11ae75f5ea122.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_3a5279344748952b110ea3f75c42827f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_f973796a2b5797d3ce6df98fd79b4bc4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-08-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 City',
 'transmission': 'manual',
 'trim': 'City',
 'year': 2011}
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG08115%27 HTTP/1.1" 200 None
2026-03-30 10:46:09 [auto1.de] INFO: Saving data for CG08115: {'created_time': 1774867569.773969, 'last_price_update_time': 1774867569.773984, 'auction_closing_time': 1774969814.0}
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG08115') HTTP/1.1" 204 0
2026-03-30 10:46:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edbbb79d-7cd3-5692-ae38-68fa7b349f8d with identifier: AL28178
2026-03-30 10:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edbbb79d-7cd3-5692-ae38-68fa7b349f8d with scrape type 1
2026-03-30 10:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item edbbb79d-7cd3-5692-ae38-68fa7b349f8d
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa0%252F5aa08ae14d800344cb13351aa6d29317%252Fpa%252FAL28178_1ce863703ed2bf91aaa14862ee103bf9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a0/5aa08ae14d800344cb13351aa6d29317/pa/AL28178_1ce863703ed2bf91aaa14862ee103bf9.jpg already downloaded
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa0%252F5aa08ae14d800344cb13351aa6d29317%252Fpa%252FAL28178_ccab80f2a725de00b3bc3bff0f5dc5a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a0/5aa08ae14d800344cb13351aa6d29317/pa/AL28178_ccab80f2a725de00b3bc3bff0f5dc5a7.jpg already downloaded
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa0%252F5aa08ae14d800344cb13351aa6d29317%252Fpa%252FAL28178_5faf1c34da0ca02eb5fc3ad86cfae2db.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a0/5aa08ae14d800344cb13351aa6d29317/pa/AL28178_5faf1c34da0ca02eb5fc3ad86cfae2db.jpg already downloaded
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa0%252F5aa08ae14d800344cb13351aa6d29317%252Fpa%252FAL28178_80acc807946727defb8f3d0adce52671.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a0/5aa08ae14d800344cb13351aa6d29317/pa/AL28178_80acc807946727defb8f3d0adce52671.jpg already downloaded
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa0%252F5aa08ae14d800344cb13351aa6d29317%252Fpa%252FAL28178_84e07f20644d93b2566b97dada580086.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a0/5aa08ae14d800344cb13351aa6d29317/pa/AL28178_84e07f20644d93b2566b97dada580086.jpg already downloaded
2026-03-30 10:46:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edbbb79d-7cd3-5692-ae38-68fa7b349f8d, identifier: AL28178
2026-03-30 10:46:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edbbb79d-7cd3-5692-ae38-68fa7b349f8d with identifier: AL28178
2026-03-30 10:46:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edbbb79d-7cd3-5692-ae38-68fa7b349f8d with identifier: AL28178
2026-03-30 10:46:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edbbb79d-7cd3-5692-ae38-68fa7b349f8d with identifier: AL28178 to the API
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AL28178>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:24:55Z',
 'fuel_type': 'petrol',
 'id': 'edbbb79d-7cd3-5692-ae38-68fa7b349f8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL28178',
 'listing': 'auction',
 'location': 'DE, Bensheim',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 168252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img5a/a0/5aa08ae14d800344cb13351aa6d29317/pa/AL28178_1ce863703ed2bf91aaa14862ee103bf9.jpg',
                'https://img-pa.auto1.com/img5a/a0/5aa08ae14d800344cb13351aa6d29317/pa/AL28178_ccab80f2a725de00b3bc3bff0f5dc5a7.jpg',
                'https://img-pa.auto1.com/img5a/a0/5aa08ae14d800344cb13351aa6d29317/pa/AL28178_5faf1c34da0ca02eb5fc3ad86cfae2db.jpg',
                'https://img-pa.auto1.com/img5a/a0/5aa08ae14d800344cb13351aa6d29317/pa/AL28178_80acc807946727defb8f3d0adce52671.jpg',
                'https://img-pa.auto1.com/img5a/a0/5aa08ae14d800344cb13351aa6d29317/pa/AL28178_84e07f20644d93b2566b97dada580086.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edbbb79d-7cd3-5692-ae38-68fa7b349f8d/edbbb79d-7cd3-5692-ae38-68fa7b349f8d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a0/5aa08ae14d800344cb13351aa6d29317/pa/AL28178_1ce863703ed2bf91aaa14862ee103bf9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edbbb79d-7cd3-5692-ae38-68fa7b349f8d/edbbb79d-7cd3-5692-ae38-68fa7b349f8d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a0/5aa08ae14d800344cb13351aa6d29317/pa/AL28178_ccab80f2a725de00b3bc3bff0f5dc5a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edbbb79d-7cd3-5692-ae38-68fa7b349f8d/edbbb79d-7cd3-5692-ae38-68fa7b349f8d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a0/5aa08ae14d800344cb13351aa6d29317/pa/AL28178_5faf1c34da0ca02eb5fc3ad86cfae2db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edbbb79d-7cd3-5692-ae38-68fa7b349f8d/edbbb79d-7cd3-5692-ae38-68fa7b349f8d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a0/5aa08ae14d800344cb13351aa6d29317/pa/AL28178_80acc807946727defb8f3d0adce52671.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edbbb79d-7cd3-5692-ae38-68fa7b349f8d/edbbb79d-7cd3-5692-ae38-68fa7b349f8d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a0/5aa08ae14d800344cb13351aa6d29317/pa/AL28178_84e07f20644d93b2566b97dada580086.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost SYNC Edition',
 'transmission': 'manual',
 'trim': 'SYNC Edition',
 'year': 2014}
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL28178%27 HTTP/1.1" 200 None
2026-03-30 10:46:10 [auto1.de] INFO: Saving data for AL28178: {'created_time': 1774867570.362605, 'last_price_update_time': 1774867570.362616, 'auction_closing_time': 1774970695.0}
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL28178') HTTP/1.1" 204 0
2026-03-30 10:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_7d25706e8c1f0ad1d0e9c70a34c53595.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_84abe8c3cab141e5c3afa37ed87acd82.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef45450>
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114a4e0b-e9e6-590e-b06b-17a955b4661e/114a4e0b-e9e6-590e-b06b-17a955b4661e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F7f%252Faf7f6617e1bcee061fdb5858678c1908%252Fpa%252FFN84005_7d25706e8c1f0ad1d0e9c70a34c53595.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_7d25706e8c1f0ad1d0e9c70a34c53595.jpg saved to cache
2026-03-30 10:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 114a4e0b-e9e6-590e-b06b-17a955b4661e
2026-03-30 10:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_f65e6b9838db781fd3a866d7def65c98.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR08419/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee5c5d0>
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114a4e0b-e9e6-590e-b06b-17a955b4661e/114a4e0b-e9e6-590e-b06b-17a955b4661e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F7f%252Faf7f6617e1bcee061fdb5858678c1908%252Fpa%252FFN84005_84abe8c3cab141e5c3afa37ed87acd82.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_84abe8c3cab141e5c3afa37ed87acd82.jpg saved to cache
2026-03-30 10:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 114a4e0b-e9e6-590e-b06b-17a955b4661e
2026-03-30 10:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_44daab638215741ed3875f3a129bd0b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_5b0c6e2648674f8e0936705649e2c1e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41dabd0>
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114a4e0b-e9e6-590e-b06b-17a955b4661e/114a4e0b-e9e6-590e-b06b-17a955b4661e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F7f%252Faf7f6617e1bcee061fdb5858678c1908%252Fpa%252FFN84005_f65e6b9838db781fd3a866d7def65c98.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_f65e6b9838db781fd3a866d7def65c98.jpg saved to cache
2026-03-30 10:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 114a4e0b-e9e6-590e-b06b-17a955b4661e
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee47ba50>
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114a4e0b-e9e6-590e-b06b-17a955b4661e/114a4e0b-e9e6-590e-b06b-17a955b4661e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F7f%252Faf7f6617e1bcee061fdb5858678c1908%252Fpa%252FFN84005_44daab638215741ed3875f3a129bd0b5.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_44daab638215741ed3875f3a129bd0b5.jpg saved to cache
2026-03-30 10:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 114a4e0b-e9e6-590e-b06b-17a955b4661e
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefa6490>
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114a4e0b-e9e6-590e-b06b-17a955b4661e/114a4e0b-e9e6-590e-b06b-17a955b4661e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F7f%252Faf7f6617e1bcee061fdb5858678c1908%252Fpa%252FFN84005_5b0c6e2648674f8e0936705649e2c1e5.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_5b0c6e2648674f8e0936705649e2c1e5.jpg saved to cache
2026-03-30 10:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 114a4e0b-e9e6-590e-b06b-17a955b4661e
2026-03-30 10:46:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 114a4e0b-e9e6-590e-b06b-17a955b4661e, skipping ID generation
2026-03-30 10:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 114a4e0b-e9e6-590e-b06b-17a955b4661e with scrape type 1
2026-03-30 10:46:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 114a4e0b-e9e6-590e-b06b-17a955b4661e sending to next pipeline
2026-03-30 10:46:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 114a4e0b-e9e6-590e-b06b-17a955b4661e, identifier: FN84005
2026-03-30 10:46:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 114a4e0b-e9e6-590e-b06b-17a955b4661e with identifier: FN84005
2026-03-30 10:46:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 114a4e0b-e9e6-590e-b06b-17a955b4661e with identifier: FN84005
2026-03-30 10:46:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 114a4e0b-e9e6-590e-b06b-17a955b4661e with identifier: FN84005 to the API
2026-03-30 10:46:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_5b0c6e2648674f8e0936705649e2c1e5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:20:16Z',
 'fuel_type': 'petrol',
 'id': '114a4e0b-e9e6-590e-b06b-17a955b4661e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN84005',
 'listing': 'auction',
 'location': 'DE, Braunschweig',
 'make': 'BMW',
 'model': '1er',
 'odometer': 102999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_114a4e0b-e9e6-590e-b06b-17a955b4661e/114a4e0b-e9e6-590e-b06b-17a955b4661e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_5b0c6e2648674f8e0936705649e2c1e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_114a4e0b-e9e6-590e-b06b-17a955b4661e/114a4e0b-e9e6-590e-b06b-17a955b4661e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_44daab638215741ed3875f3a129bd0b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_114a4e0b-e9e6-590e-b06b-17a955b4661e/114a4e0b-e9e6-590e-b06b-17a955b4661e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_f65e6b9838db781fd3a866d7def65c98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_114a4e0b-e9e6-590e-b06b-17a955b4661e/114a4e0b-e9e6-590e-b06b-17a955b4661e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_7d25706e8c1f0ad1d0e9c70a34c53595.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_114a4e0b-e9e6-590e-b06b-17a955b4661e/114a4e0b-e9e6-590e-b06b-17a955b4661e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/7f/af7f6617e1bcee061fdb5858678c1908/pa/FN84005_84abe8c3cab141e5c3afa37ed87acd82.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN84005%27 HTTP/1.1" 200 None
2026-03-30 10:46:11 [auto1.de] INFO: Saving data for FN84005: {'created_time': 1774867571.39034, 'last_price_update_time': 1774867571.39035, 'auction_closing_time': 1774970416.0}
2026-03-30 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN84005') HTTP/1.1" 204 0
2026-03-30 10:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK73988> (referer: https://www.auto1.com/v1/car-details-view/XK73988/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7 with identifier: XK73988
2026-03-30 10:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7 with scrape type 1
2026-03-30 10:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_288edc22645ccd9236db1a7e56b63104.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_288edc22645ccd9236db1a7e56b63104.jpg not downloaded yet
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_5ca30368f462ce31945e7eeb74ebba9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_5ca30368f462ce31945e7eeb74ebba9e.jpg not downloaded yet
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_20293573b1e7d382e65c8720bc5912f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_20293573b1e7d382e65c8720bc5912f8.jpg not downloaded yet
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_8a603b4e85543cfec34193714e228ac6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_8a603b4e85543cfec34193714e228ac6.jpg not downloaded yet
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_ce947575f224c1162cd9d184a12e6da8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_ce947575f224c1162cd9d184a12e6da8.jpg not downloaded yet
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_508a46e480395ea0badbb325b4d9f1e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_508a46e480395ea0badbb325b4d9f1e5.jpg not downloaded yet
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_24732580daf7ab68a182ee384698dfd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_24732580daf7ab68a182ee384698dfd4.jpg not downloaded yet
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_3a43f944c91f4d16115ab40a5eb30d9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_3a43f944c91f4d16115ab40a5eb30d9b.jpg not downloaded yet
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_db2a422039a750727f1f55a27ef995a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_db2a422039a750727f1f55a27ef995a2.jpg not downloaded yet
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_69c9ac37574fd1661a03475dd451fb6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_69c9ac37574fd1661a03475dd451fb6c.jpg not downloaded yet
2026-03-30 10:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC17196/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_69c9ac37574fd1661a03475dd451fb6c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_db2a422039a750727f1f55a27ef995a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef7fc50>
2026-03-30 10:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_69c9ac37574fd1661a03475dd451fb6c.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_69c9ac37574fd1661a03475dd451fb6c.jpg saved to cache
2026-03-30 10:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7
2026-03-30 10:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef75390>
2026-03-30 10:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_db2a422039a750727f1f55a27ef995a2.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_db2a422039a750727f1f55a27ef995a2.jpg saved to cache
2026-03-30 10:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7
2026-03-30 10:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JP87174/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_3a43f944c91f4d16115ab40a5eb30d9b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_24732580daf7ab68a182ee384698dfd4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee80b50>
2026-03-30 10:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_3a43f944c91f4d16115ab40a5eb30d9b.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_3a43f944c91f4d16115ab40a5eb30d9b.jpg saved to cache
2026-03-30 10:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7
2026-03-30 10:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e9090>
2026-03-30 10:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_24732580daf7ab68a182ee384698dfd4.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_24732580daf7ab68a182ee384698dfd4.jpg saved to cache
2026-03-30 10:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7
2026-03-30 10:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY43496> (referer: https://www.auto1.com/v1/car-details-view/YY43496/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_508a46e480395ea0badbb325b4d9f1e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0741a7d-a896-5ff1-a0d2-2019f96fe5ca with identifier: YY43496
2026-03-30 10:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0741a7d-a896-5ff1-a0d2-2019f96fe5ca with scrape type 1
2026-03-30 10:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0741a7d-a896-5ff1-a0d2-2019f96fe5ca
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_9e688386e9e92b6696ad7f3b6ed5fa02.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_9e688386e9e92b6696ad7f3b6ed5fa02.jpg not downloaded yet
2026-03-30 10:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_ce947575f224c1162cd9d184a12e6da8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_3c54256c0d2824a02b932d7e24cf13df.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_3c54256c0d2824a02b932d7e24cf13df.jpg not downloaded yet
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_3398ea9beb3ec5e9cad9fe0d1c242a3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_3398ea9beb3ec5e9cad9fe0d1c242a3b.jpg not downloaded yet
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_57718f3d67ead2920bc37a53d414004e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_57718f3d67ead2920bc37a53d414004e.jpg not downloaded yet
2026-03-30 10:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CK11901/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_f71749f4e4d982878280198ceec5cea2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_f71749f4e4d982878280198ceec5cea2.jpg not downloaded yet
2026-03-30 10:46:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef75090>
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_508a46e480395ea0badbb325b4d9f1e5.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_508a46e480395ea0badbb325b4d9f1e5.jpg saved to cache
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_3daef6cd1f185a42316a9f8cab6f8712.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_3daef6cd1f185a42316a9f8cab6f8712.jpg not downloaded yet
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_9e688386e9e92b6696ad7f3b6ed5fa02.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_859baa47c6ddbbe41b75bd71c2cace03.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_859baa47c6ddbbe41b75bd71c2cace03.jpg not downloaded yet
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f593e750>
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_ce947575f224c1162cd9d184a12e6da8.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_ce947575f224c1162cd9d184a12e6da8.jpg saved to cache
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_317f3e1111a5c50de814323ac73b422c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_317f3e1111a5c50de814323ac73b422c.jpg not downloaded yet
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_57718f3d67ead2920bc37a53d414004e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_de7e0afe254c3ae0a52ae854bfbcba63.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_de7e0afe254c3ae0a52ae854bfbcba63.jpg not downloaded yet
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_42dee1838422d01f5898a836d5a7160b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_42dee1838422d01f5898a836d5a7160b.jpg not downloaded yet
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5913090>
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_9e688386e9e92b6696ad7f3b6ed5fa02.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_9e688386e9e92b6696ad7f3b6ed5fa02.jpg saved to cache
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0741a7d-a896-5ff1-a0d2-2019f96fe5ca
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_3daef6cd1f185a42316a9f8cab6f8712.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee615d0>
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_57718f3d67ead2920bc37a53d414004e.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_57718f3d67ead2920bc37a53d414004e.jpg saved to cache
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0741a7d-a896-5ff1-a0d2-2019f96fe5ca
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_859baa47c6ddbbe41b75bd71c2cace03.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_42dee1838422d01f5898a836d5a7160b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee90b50>
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_3daef6cd1f185a42316a9f8cab6f8712.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_3daef6cd1f185a42316a9f8cab6f8712.jpg saved to cache
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0741a7d-a896-5ff1-a0d2-2019f96fe5ca
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_de7e0afe254c3ae0a52ae854bfbcba63.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4222c90>
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_859baa47c6ddbbe41b75bd71c2cace03.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_859baa47c6ddbbe41b75bd71c2cace03.jpg saved to cache
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0741a7d-a896-5ff1-a0d2-2019f96fe5ca
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef77610>
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_42dee1838422d01f5898a836d5a7160b.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_42dee1838422d01f5898a836d5a7160b.jpg saved to cache
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c0741a7d-a896-5ff1-a0d2-2019f96fe5ca
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_317f3e1111a5c50de814323ac73b422c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd6510>
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_de7e0afe254c3ae0a52ae854bfbcba63.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_de7e0afe254c3ae0a52ae854bfbcba63.jpg saved to cache
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c0741a7d-a896-5ff1-a0d2-2019f96fe5ca
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_f71749f4e4d982878280198ceec5cea2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8cfd0>
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_317f3e1111a5c50de814323ac73b422c.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_317f3e1111a5c50de814323ac73b422c.jpg saved to cache
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0741a7d-a896-5ff1-a0d2-2019f96fe5ca
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_3398ea9beb3ec5e9cad9fe0d1c242a3b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4172310>
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_f71749f4e4d982878280198ceec5cea2.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_f71749f4e4d982878280198ceec5cea2.jpg saved to cache
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0741a7d-a896-5ff1-a0d2-2019f96fe5ca
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_3c54256c0d2824a02b932d7e24cf13df.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef74190>
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_3398ea9beb3ec5e9cad9fe0d1c242a3b.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_3398ea9beb3ec5e9cad9fe0d1c242a3b.jpg saved to cache
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0741a7d-a896-5ff1-a0d2-2019f96fe5ca
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_8a603b4e85543cfec34193714e228ac6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4198790>
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F1d%252F951d6424d1c6d6697345f2adcf7b9f7d%252Fpa%252FYY43496_3c54256c0d2824a02b932d7e24cf13df.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_3c54256c0d2824a02b932d7e24cf13df.jpg saved to cache
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0741a7d-a896-5ff1-a0d2-2019f96fe5ca
2026-03-30 10:46:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0741a7d-a896-5ff1-a0d2-2019f96fe5ca, skipping ID generation
2026-03-30 10:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0741a7d-a896-5ff1-a0d2-2019f96fe5ca with scrape type 1
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0741a7d-a896-5ff1-a0d2-2019f96fe5ca sending to next pipeline
2026-03-30 10:46:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0741a7d-a896-5ff1-a0d2-2019f96fe5ca, identifier: YY43496
2026-03-30 10:46:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0741a7d-a896-5ff1-a0d2-2019f96fe5ca with identifier: YY43496
2026-03-30 10:46:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0741a7d-a896-5ff1-a0d2-2019f96fe5ca with identifier: YY43496
2026-03-30 10:46:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0741a7d-a896-5ff1-a0d2-2019f96fe5ca with identifier: YY43496 to the API
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_3c54256c0d2824a02b932d7e24cf13df.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:02:00Z',
 'fuel_type': 'petrol',
 'id': 'c0741a7d-a896-5ff1-a0d2-2019f96fe5ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY43496',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 24521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_9e688386e9e92b6696ad7f3b6ed5fa02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_3c54256c0d2824a02b932d7e24cf13df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_3398ea9beb3ec5e9cad9fe0d1c242a3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_57718f3d67ead2920bc37a53d414004e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_f71749f4e4d982878280198ceec5cea2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_3daef6cd1f185a42316a9f8cab6f8712.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_859baa47c6ddbbe41b75bd71c2cace03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_317f3e1111a5c50de814323ac73b422c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_de7e0afe254c3ae0a52ae854bfbcba63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0741a7d-a896-5ff1-a0d2-2019f96fe5ca/c0741a7d-a896-5ff1-a0d2-2019f96fe5ca_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/1d/951d6424d1c6d6697345f2adcf7b9f7d/pa/YY43496_42dee1838422d01f5898a836d5a7160b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2024}
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY43496%27 HTTP/1.1" 200 None
2026-03-30 10:46:18 [auto1.de] INFO: Saving data for YY43496: {'created_time': 1774867578.539534, 'last_price_update_time': 1774867578.539545, 'auction_closing_time': 1774969320.0}
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY43496') HTTP/1.1" 204 0
2026-03-30 10:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_20293573b1e7d382e65c8720bc5912f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41982d0>
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_8a603b4e85543cfec34193714e228ac6.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_8a603b4e85543cfec34193714e228ac6.jpg saved to cache
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7
2026-03-30 10:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_5ca30368f462ce31945e7eeb74ebba9e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4222a90>
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_20293573b1e7d382e65c8720bc5912f8.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_20293573b1e7d382e65c8720bc5912f8.jpg saved to cache
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7
2026-03-30 10:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_288edc22645ccd9236db1a7e56b63104.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3ee10>
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_5ca30368f462ce31945e7eeb74ebba9e.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_5ca30368f462ce31945e7eeb74ebba9e.jpg saved to cache
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f9fd0>
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F68%252F2168c63a69c0aa1a58f21727cc487e0d%252Fpa%252FXK73988_288edc22645ccd9236db1a7e56b63104.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_288edc22645ccd9236db1a7e56b63104.jpg saved to cache
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7
2026-03-30 10:46:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7, skipping ID generation
2026-03-30 10:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7 with scrape type 1
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7 sending to next pipeline
2026-03-30 10:46:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7, identifier: XK73988
2026-03-30 10:46:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7 with identifier: XK73988
2026-03-30 10:46:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7 with identifier: XK73988
2026-03-30 10:46:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7 with identifier: XK73988 to the API
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_288edc22645ccd9236db1a7e56b63104.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 24,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:03:15Z',
 'fuel_type': 'hybrid',
 'id': '84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK73988',
 'listing': 'auction',
 'location': 'DE, Esslingen am Neckar',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 32226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_288edc22645ccd9236db1a7e56b63104.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_5ca30368f462ce31945e7eeb74ebba9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_20293573b1e7d382e65c8720bc5912f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_8a603b4e85543cfec34193714e228ac6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_ce947575f224c1162cd9d184a12e6da8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_508a46e480395ea0badbb325b4d9f1e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_24732580daf7ab68a182ee384698dfd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_3a43f944c91f4d16115ab40a5eb30d9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_db2a422039a750727f1f55a27ef995a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7/84c86ab9-fca5-555b-b2e0-a7c8aebcc1f7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/68/2168c63a69c0aa1a58f21727cc487e0d/pa/XK73988_69c9ac37574fd1661a03475dd451fb6c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 250e Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK73988%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [auto1.de] INFO: Saving data for XK73988: {'created_time': 1774867579.525935, 'last_price_update_time': 1774867579.525946, 'auction_closing_time': 1774969395.0}
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK73988') HTTP/1.1" 204 0
2026-03-30 10:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL02877> (referer: https://www.auto1.com/v1/car-details-view/XL02877/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9abea772-59f1-5bf5-9c28-4d9fad5109ba with identifier: XL02877
2026-03-30 10:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9abea772-59f1-5bf5-9c28-4d9fad5109ba with scrape type 1
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9abea772-59f1-5bf5-9c28-4d9fad5109ba
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_484def7695b02ccda7ff9814221e29da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_484def7695b02ccda7ff9814221e29da.jpg not downloaded yet
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_6cfc9fdc002bd84b2cef7811f2ce0b05.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_6cfc9fdc002bd84b2cef7811f2ce0b05.jpg not downloaded yet
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_ab5e65f9674e872596163ad3ba0307cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_ab5e65f9674e872596163ad3ba0307cd.jpg not downloaded yet
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_9096464444027eaa38527410d65a7978.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_9096464444027eaa38527410d65a7978.jpg not downloaded yet
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_295ba1737f2dc35e2a99552717b58d5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_295ba1737f2dc35e2a99552717b58d5d.jpg not downloaded yet
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_8bb4f6ed0056ab5588a3339908ca9432.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_8bb4f6ed0056ab5588a3339908ca9432.jpg not downloaded yet
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_4b0a4156ffc2a9b5370fee186955a45b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_4b0a4156ffc2a9b5370fee186955a45b.jpg not downloaded yet
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_5e0bca4182ab514c01dfa25f6a29399a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_5e0bca4182ab514c01dfa25f6a29399a.jpg not downloaded yet
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_2f3a39431d8888fd87c7f3011623e308.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_2f3a39431d8888fd87c7f3011623e308.jpg not downloaded yet
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_0363cbf1632bba3bb6a150fd1bfe75d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_0363cbf1632bba3bb6a150fd1bfe75d8.jpg not downloaded yet
2026-03-30 10:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK95635> (referer: https://www.auto1.com/v1/car-details-view/FK95635/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c7adaf4-da9b-5264-985b-627ecd4f8795 with identifier: FK95635
2026-03-30 10:46:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c7adaf4-da9b-5264-985b-627ecd4f8795 with scrape type 1
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2c7adaf4-da9b-5264-985b-627ecd4f8795
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fea%252F2fea8ee35fd1a0f7d0e76dd85ab67285%252Fpa%252FFK95635_42d50333bfc55819172516688b603f44.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_42d50333bfc55819172516688b603f44.jpg not downloaded yet
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fea%252F2fea8ee35fd1a0f7d0e76dd85ab67285%252Fpa%252FFK95635_b462d418f6007bb53ef2efff696c9204.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_b462d418f6007bb53ef2efff696c9204.jpg not downloaded yet
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fea%252F2fea8ee35fd1a0f7d0e76dd85ab67285%252Fpa%252FFK95635_12189851bb86dee30369a4102b0d8a35.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_12189851bb86dee30369a4102b0d8a35.jpg not downloaded yet
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fea%252F2fea8ee35fd1a0f7d0e76dd85ab67285%252Fpa%252FFK95635_08e73407e1a64fecfbf3cc11957cf6f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_08e73407e1a64fecfbf3cc11957cf6f8.jpg not downloaded yet
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fea%252F2fea8ee35fd1a0f7d0e76dd85ab67285%252Fpa%252FFK95635_31463cdb16cdc296482619773313e103.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_31463cdb16cdc296482619773313e103.jpg not downloaded yet
2026-03-30 10:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_0363cbf1632bba3bb6a150fd1bfe75d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_31463cdb16cdc296482619773313e103.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee847d0>
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_0363cbf1632bba3bb6a150fd1bfe75d8.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_0363cbf1632bba3bb6a150fd1bfe75d8.jpg saved to cache
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9abea772-59f1-5bf5-9c28-4d9fad5109ba
2026-03-30 10:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_08e73407e1a64fecfbf3cc11957cf6f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd56d0>
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7adaf4-da9b-5264-985b-627ecd4f8795/2c7adaf4-da9b-5264-985b-627ecd4f8795_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fea%252F2fea8ee35fd1a0f7d0e76dd85ab67285%252Fpa%252FFK95635_31463cdb16cdc296482619773313e103.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_31463cdb16cdc296482619773313e103.jpg saved to cache
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c7adaf4-da9b-5264-985b-627ecd4f8795
2026-03-30 10:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_12189851bb86dee30369a4102b0d8a35.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee12950>
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7adaf4-da9b-5264-985b-627ecd4f8795/2c7adaf4-da9b-5264-985b-627ecd4f8795_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fea%252F2fea8ee35fd1a0f7d0e76dd85ab67285%252Fpa%252FFK95635_08e73407e1a64fecfbf3cc11957cf6f8.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_08e73407e1a64fecfbf3cc11957cf6f8.jpg saved to cache
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c7adaf4-da9b-5264-985b-627ecd4f8795
2026-03-30 10:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_b462d418f6007bb53ef2efff696c9204.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee82790>
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7adaf4-da9b-5264-985b-627ecd4f8795/2c7adaf4-da9b-5264-985b-627ecd4f8795_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fea%252F2fea8ee35fd1a0f7d0e76dd85ab67285%252Fpa%252FFK95635_12189851bb86dee30369a4102b0d8a35.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_12189851bb86dee30369a4102b0d8a35.jpg saved to cache
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c7adaf4-da9b-5264-985b-627ecd4f8795
2026-03-30 10:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_42d50333bfc55819172516688b603f44.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee81910>
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7adaf4-da9b-5264-985b-627ecd4f8795/2c7adaf4-da9b-5264-985b-627ecd4f8795_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fea%252F2fea8ee35fd1a0f7d0e76dd85ab67285%252Fpa%252FFK95635_b462d418f6007bb53ef2efff696c9204.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_b462d418f6007bb53ef2efff696c9204.jpg saved to cache
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c7adaf4-da9b-5264-985b-627ecd4f8795
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd53d0>
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7adaf4-da9b-5264-985b-627ecd4f8795/2c7adaf4-da9b-5264-985b-627ecd4f8795_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fea%252F2fea8ee35fd1a0f7d0e76dd85ab67285%252Fpa%252FFK95635_42d50333bfc55819172516688b603f44.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_42d50333bfc55819172516688b603f44.jpg saved to cache
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c7adaf4-da9b-5264-985b-627ecd4f8795
2026-03-30 10:46:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c7adaf4-da9b-5264-985b-627ecd4f8795, skipping ID generation
2026-03-30 10:46:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c7adaf4-da9b-5264-985b-627ecd4f8795 with scrape type 1
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c7adaf4-da9b-5264-985b-627ecd4f8795 sending to next pipeline
2026-03-30 10:46:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c7adaf4-da9b-5264-985b-627ecd4f8795, identifier: FK95635
2026-03-30 10:46:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c7adaf4-da9b-5264-985b-627ecd4f8795 with identifier: FK95635
2026-03-30 10:46:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c7adaf4-da9b-5264-985b-627ecd4f8795 with identifier: FK95635
2026-03-30 10:46:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c7adaf4-da9b-5264-985b-627ecd4f8795 with identifier: FK95635 to the API
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_42d50333bfc55819172516688b603f44.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 194,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:36:50Z',
 'fuel_type': 'diesel',
 'id': '2c7adaf4-da9b-5264-985b-627ecd4f8795',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK95635',
 'listing': 'auction',
 'location': 'DE, Hamburg-Billstedt',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 332676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7adaf4-da9b-5264-985b-627ecd4f8795/2c7adaf4-da9b-5264-985b-627ecd4f8795_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_42d50333bfc55819172516688b603f44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7adaf4-da9b-5264-985b-627ecd4f8795/2c7adaf4-da9b-5264-985b-627ecd4f8795_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_b462d418f6007bb53ef2efff696c9204.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7adaf4-da9b-5264-985b-627ecd4f8795/2c7adaf4-da9b-5264-985b-627ecd4f8795_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_12189851bb86dee30369a4102b0d8a35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7adaf4-da9b-5264-985b-627ecd4f8795/2c7adaf4-da9b-5264-985b-627ecd4f8795_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_08e73407e1a64fecfbf3cc11957cf6f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7adaf4-da9b-5264-985b-627ecd4f8795/2c7adaf4-da9b-5264-985b-627ecd4f8795_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ea/2fea8ee35fd1a0f7d0e76dd85ab67285/pa/FK95635_31463cdb16cdc296482619773313e103.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2007}
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK95635%27 HTTP/1.1" 200 None
2026-03-30 10:46:22 [auto1.de] INFO: Saving data for FK95635: {'created_time': 1774867582.56548, 'last_price_update_time': 1774867582.565493, 'auction_closing_time': 1774971410.0}
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK95635') HTTP/1.1" 204 0
2026-03-30 10:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_2f3a39431d8888fd87c7f3011623e308.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8e850>
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_2f3a39431d8888fd87c7f3011623e308.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_2f3a39431d8888fd87c7f3011623e308.jpg saved to cache
2026-03-30 10:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9abea772-59f1-5bf5-9c28-4d9fad5109ba
2026-03-30 10:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_5e0bca4182ab514c01dfa25f6a29399a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414fd50>
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_5e0bca4182ab514c01dfa25f6a29399a.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_5e0bca4182ab514c01dfa25f6a29399a.jpg saved to cache
2026-03-30 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9abea772-59f1-5bf5-9c28-4d9fad5109ba
2026-03-30 10:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_4b0a4156ffc2a9b5370fee186955a45b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee63750>
2026-03-30 10:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_4b0a4156ffc2a9b5370fee186955a45b.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_4b0a4156ffc2a9b5370fee186955a45b.jpg saved to cache
2026-03-30 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9abea772-59f1-5bf5-9c28-4d9fad5109ba
2026-03-30 10:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LK64913/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_8bb4f6ed0056ab5588a3339908ca9432.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414f210>
2026-03-30 10:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_8bb4f6ed0056ab5588a3339908ca9432.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_8bb4f6ed0056ab5588a3339908ca9432.jpg saved to cache
2026-03-30 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9abea772-59f1-5bf5-9c28-4d9fad5109ba
2026-03-30 10:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_295ba1737f2dc35e2a99552717b58d5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_9096464444027eaa38527410d65a7978.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414e150>
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_295ba1737f2dc35e2a99552717b58d5d.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_295ba1737f2dc35e2a99552717b58d5d.jpg saved to cache
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9abea772-59f1-5bf5-9c28-4d9fad5109ba
2026-03-30 10:46:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4221b90>
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_9096464444027eaa38527410d65a7978.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_9096464444027eaa38527410d65a7978.jpg saved to cache
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9abea772-59f1-5bf5-9c28-4d9fad5109ba
2026-03-30 10:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW35819> (referer: https://www.auto1.com/v1/car-details-view/WW35819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 784b1f7b-8f39-5e70-8ff3-d1c237d8803f with identifier: WW35819
2026-03-30 10:46:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 784b1f7b-8f39-5e70-8ff3-d1c237d8803f with scrape type 1
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 784b1f7b-8f39-5e70-8ff3-d1c237d8803f
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F55%252Fd95564def112632405b6d46e0ea45a4e%252Fpa%252FWW35819_67bbb09a9efee9815cd995762e9d0395.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_67bbb09a9efee9815cd995762e9d0395.jpg not downloaded yet
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F55%252Fd95564def112632405b6d46e0ea45a4e%252Fpa%252FWW35819_087876b32907d8f9f67a3d15bf85c695.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_087876b32907d8f9f67a3d15bf85c695.jpg not downloaded yet
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F55%252Fd95564def112632405b6d46e0ea45a4e%252Fpa%252FWW35819_3137f66ce49888f02e010cdd45223030.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_3137f66ce49888f02e010cdd45223030.jpg not downloaded yet
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F55%252Fd95564def112632405b6d46e0ea45a4e%252Fpa%252FWW35819_54f0a6958fa4fdcf52343ffe1e85e0ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_54f0a6958fa4fdcf52343ffe1e85e0ad.jpg not downloaded yet
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F55%252Fd95564def112632405b6d46e0ea45a4e%252Fpa%252FWW35819_cf8fa5e25aa355fbbccb5bbe898b5721.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_cf8fa5e25aa355fbbccb5bbe898b5721.jpg not downloaded yet
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F55%252Fd95564def112632405b6d46e0ea45a4e%252Fpa%252FWW35819_d2a308ce3c87350c949f879eddd576ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_d2a308ce3c87350c949f879eddd576ca.jpg not downloaded yet
2026-03-30 10:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_ab5e65f9674e872596163ad3ba0307cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_d2a308ce3c87350c949f879eddd576ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_6cfc9fdc002bd84b2cef7811f2ce0b05.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef7dc10>
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_ab5e65f9674e872596163ad3ba0307cd.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_ab5e65f9674e872596163ad3ba0307cd.jpg saved to cache
2026-03-30 10:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9abea772-59f1-5bf5-9c28-4d9fad5109ba
2026-03-30 10:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_cf8fa5e25aa355fbbccb5bbe898b5721.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd6bd0>
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_784b1f7b-8f39-5e70-8ff3-d1c237d8803f/784b1f7b-8f39-5e70-8ff3-d1c237d8803f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F55%252Fd95564def112632405b6d46e0ea45a4e%252Fpa%252FWW35819_d2a308ce3c87350c949f879eddd576ca.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_d2a308ce3c87350c949f879eddd576ca.jpg saved to cache
2026-03-30 10:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 784b1f7b-8f39-5e70-8ff3-d1c237d8803f
2026-03-30 10:46:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7f7d0>
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_6cfc9fdc002bd84b2cef7811f2ce0b05.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_6cfc9fdc002bd84b2cef7811f2ce0b05.jpg saved to cache
2026-03-30 10:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9abea772-59f1-5bf5-9c28-4d9fad5109ba
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434fa10>
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_784b1f7b-8f39-5e70-8ff3-d1c237d8803f/784b1f7b-8f39-5e70-8ff3-d1c237d8803f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F55%252Fd95564def112632405b6d46e0ea45a4e%252Fpa%252FWW35819_cf8fa5e25aa355fbbccb5bbe898b5721.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_cf8fa5e25aa355fbbccb5bbe898b5721.jpg saved to cache
2026-03-30 10:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 784b1f7b-8f39-5e70-8ff3-d1c237d8803f
2026-03-30 10:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_3137f66ce49888f02e010cdd45223030.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_54f0a6958fa4fdcf52343ffe1e85e0ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_087876b32907d8f9f67a3d15bf85c695.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_67bbb09a9efee9815cd995762e9d0395.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee85390>
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_784b1f7b-8f39-5e70-8ff3-d1c237d8803f/784b1f7b-8f39-5e70-8ff3-d1c237d8803f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F55%252Fd95564def112632405b6d46e0ea45a4e%252Fpa%252FWW35819_3137f66ce49888f02e010cdd45223030.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_3137f66ce49888f02e010cdd45223030.jpg saved to cache
2026-03-30 10:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 784b1f7b-8f39-5e70-8ff3-d1c237d8803f
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429eb90>
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_784b1f7b-8f39-5e70-8ff3-d1c237d8803f/784b1f7b-8f39-5e70-8ff3-d1c237d8803f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F55%252Fd95564def112632405b6d46e0ea45a4e%252Fpa%252FWW35819_54f0a6958fa4fdcf52343ffe1e85e0ad.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_54f0a6958fa4fdcf52343ffe1e85e0ad.jpg saved to cache
2026-03-30 10:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 784b1f7b-8f39-5e70-8ff3-d1c237d8803f
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef77950>
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_784b1f7b-8f39-5e70-8ff3-d1c237d8803f/784b1f7b-8f39-5e70-8ff3-d1c237d8803f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F55%252Fd95564def112632405b6d46e0ea45a4e%252Fpa%252FWW35819_087876b32907d8f9f67a3d15bf85c695.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_087876b32907d8f9f67a3d15bf85c695.jpg saved to cache
2026-03-30 10:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 784b1f7b-8f39-5e70-8ff3-d1c237d8803f
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e8c10>
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_784b1f7b-8f39-5e70-8ff3-d1c237d8803f/784b1f7b-8f39-5e70-8ff3-d1c237d8803f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F55%252Fd95564def112632405b6d46e0ea45a4e%252Fpa%252FWW35819_67bbb09a9efee9815cd995762e9d0395.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_67bbb09a9efee9815cd995762e9d0395.jpg saved to cache
2026-03-30 10:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 784b1f7b-8f39-5e70-8ff3-d1c237d8803f
2026-03-30 10:46:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 784b1f7b-8f39-5e70-8ff3-d1c237d8803f, skipping ID generation
2026-03-30 10:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 784b1f7b-8f39-5e70-8ff3-d1c237d8803f with scrape type 1
2026-03-30 10:46:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 784b1f7b-8f39-5e70-8ff3-d1c237d8803f sending to next pipeline
2026-03-30 10:46:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 784b1f7b-8f39-5e70-8ff3-d1c237d8803f, identifier: WW35819
2026-03-30 10:46:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 784b1f7b-8f39-5e70-8ff3-d1c237d8803f with identifier: WW35819
2026-03-30 10:46:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 784b1f7b-8f39-5e70-8ff3-d1c237d8803f with identifier: WW35819
2026-03-30 10:46:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 784b1f7b-8f39-5e70-8ff3-d1c237d8803f with identifier: WW35819 to the API
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_67bbb09a9efee9815cd995762e9d0395.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:27:58Z',
 'fuel_type': 'petrol',
 'id': '784b1f7b-8f39-5e70-8ff3-d1c237d8803f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW35819',
 'listing': 'auction',
 'location': 'DE, Essen',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 105339,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_784b1f7b-8f39-5e70-8ff3-d1c237d8803f/784b1f7b-8f39-5e70-8ff3-d1c237d8803f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_67bbb09a9efee9815cd995762e9d0395.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_784b1f7b-8f39-5e70-8ff3-d1c237d8803f/784b1f7b-8f39-5e70-8ff3-d1c237d8803f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_087876b32907d8f9f67a3d15bf85c695.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_784b1f7b-8f39-5e70-8ff3-d1c237d8803f/784b1f7b-8f39-5e70-8ff3-d1c237d8803f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_3137f66ce49888f02e010cdd45223030.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_784b1f7b-8f39-5e70-8ff3-d1c237d8803f/784b1f7b-8f39-5e70-8ff3-d1c237d8803f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_54f0a6958fa4fdcf52343ffe1e85e0ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_784b1f7b-8f39-5e70-8ff3-d1c237d8803f/784b1f7b-8f39-5e70-8ff3-d1c237d8803f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_cf8fa5e25aa355fbbccb5bbe898b5721.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_784b1f7b-8f39-5e70-8ff3-d1c237d8803f/784b1f7b-8f39-5e70-8ff3-d1c237d8803f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/55/d95564def112632405b6d46e0ea45a4e/pa/WW35819_d2a308ce3c87350c949f879eddd576ca.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2015}
2026-03-30 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW35819%27 HTTP/1.1" 200 None
2026-03-30 10:46:26 [auto1.de] INFO: Saving data for WW35819: {'created_time': 1774867586.068232, 'last_price_update_time': 1774867586.068253, 'auction_closing_time': 1774970878.0}
2026-03-30 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW35819') HTTP/1.1" 204 0
2026-03-30 10:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_484def7695b02ccda7ff9814221e29da.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef7cb90>
2026-03-30 10:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F2b%252F112b4f62f3b5bb1339b198966f42218c%252Fpa%252FXL02877_484def7695b02ccda7ff9814221e29da.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_484def7695b02ccda7ff9814221e29da.jpg saved to cache
2026-03-30 10:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9abea772-59f1-5bf5-9c28-4d9fad5109ba
2026-03-30 10:46:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9abea772-59f1-5bf5-9c28-4d9fad5109ba, skipping ID generation
2026-03-30 10:46:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9abea772-59f1-5bf5-9c28-4d9fad5109ba with scrape type 1
2026-03-30 10:46:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9abea772-59f1-5bf5-9c28-4d9fad5109ba sending to next pipeline
2026-03-30 10:46:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9abea772-59f1-5bf5-9c28-4d9fad5109ba, identifier: XL02877
2026-03-30 10:46:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9abea772-59f1-5bf5-9c28-4d9fad5109ba with identifier: XL02877
2026-03-30 10:46:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9abea772-59f1-5bf5-9c28-4d9fad5109ba with identifier: XL02877
2026-03-30 10:46:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9abea772-59f1-5bf5-9c28-4d9fad5109ba with identifier: XL02877 to the API
2026-03-30 10:46:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_484def7695b02ccda7ff9814221e29da.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:39:30Z',
 'fuel_type': 'petrol',
 'id': '9abea772-59f1-5bf5-9c28-4d9fad5109ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL02877',
 'listing': 'auction',
 'location': 'DE, Erfurt',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 79876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3410965,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_484def7695b02ccda7ff9814221e29da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3319013,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_6cfc9fdc002bd84b2cef7811f2ce0b05.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3105095,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_ab5e65f9674e872596163ad3ba0307cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3121896,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_9096464444027eaa38527410d65a7978.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3296076,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_295ba1737f2dc35e2a99552717b58d5d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3259884,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_8bb4f6ed0056ab5588a3339908ca9432.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3121179,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_4b0a4156ffc2a9b5370fee186955a45b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3308141,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_5e0bca4182ab514c01dfa25f6a29399a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3061255,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_2f3a39431d8888fd87c7f3011623e308.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abea772-59f1-5bf5-9c28-4d9fad5109ba/9abea772-59f1-5bf5-9c28-4d9fad5109ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3409464,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/2b/112b4f62f3b5bb1339b198966f42218c/pa/XL02877_0363cbf1632bba3bb6a150fd1bfe75d8.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2012}
2026-03-30 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL02877%27 HTTP/1.1" 200 None
2026-03-30 10:46:26 [auto1.de] INFO: Saving data for XL02877: {'created_time': 1774867586.768162, 'last_price_update_time': 1774867586.768178, 'auction_closing_time': 1774971570.0}
2026-03-30 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL02877') HTTP/1.1" 204 0
2026-03-30 10:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YF96126/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR08419> (referer: https://www.auto1.com/v1/car-details-view/AR08419/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1851775d-844a-59b1-a7c0-b34175250d30 with identifier: AR08419
2026-03-30 10:46:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1851775d-844a-59b1-a7c0-b34175250d30 with scrape type 1
2026-03-30 10:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1851775d-844a-59b1-a7c0-b34175250d30
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F43%252F53430d8bac2716e7343e2b0fd372fd19%252Fpa%252FAR08419_d81a008729e196ddf6532bc16fe3b982.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_d81a008729e196ddf6532bc16fe3b982.jpg already downloaded
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F43%252F53430d8bac2716e7343e2b0fd372fd19%252Fpa%252FAR08419_1bf5558030f11dc31c3c52286569f3d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_1bf5558030f11dc31c3c52286569f3d8.jpg already downloaded
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F43%252F53430d8bac2716e7343e2b0fd372fd19%252Fpa%252FAR08419_521d179588b70d34cee393a32b40e334.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_521d179588b70d34cee393a32b40e334.jpg already downloaded
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F43%252F53430d8bac2716e7343e2b0fd372fd19%252Fpa%252FAR08419_162950eedca61b4f62ffdd445aeeb9fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_162950eedca61b4f62ffdd445aeeb9fa.jpg already downloaded
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F43%252F53430d8bac2716e7343e2b0fd372fd19%252Fpa%252FAR08419_0c63ba4d53416d77ca9ad06fa84fee1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_0c63ba4d53416d77ca9ad06fa84fee1b.jpg already downloaded
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F43%252F53430d8bac2716e7343e2b0fd372fd19%252Fpa%252FAR08419_c91c5d4b11b816fc9b4a31c1a6e91f34.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_c91c5d4b11b816fc9b4a31c1a6e91f34.jpg already downloaded
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F43%252F53430d8bac2716e7343e2b0fd372fd19%252Fpa%252FAR08419_8c554d0e3fa585d700f603e6a8a17af1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_8c554d0e3fa585d700f603e6a8a17af1.jpg already downloaded
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F43%252F53430d8bac2716e7343e2b0fd372fd19%252Fpa%252FAR08419_cb31169bf2ab1b184151a8ca1cbc771d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_cb31169bf2ab1b184151a8ca1cbc771d.jpg already downloaded
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F43%252F53430d8bac2716e7343e2b0fd372fd19%252Fpa%252FAR08419_7d695a073da64fc280ec6e0dfc5b5079.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_7d695a073da64fc280ec6e0dfc5b5079.jpg already downloaded
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F43%252F53430d8bac2716e7343e2b0fd372fd19%252Fpa%252FAR08419_2a19e704af4822cc875246a65d7993c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_2a19e704af4822cc875246a65d7993c7.jpg already downloaded
2026-03-30 10:46:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1851775d-844a-59b1-a7c0-b34175250d30, identifier: AR08419
2026-03-30 10:46:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1851775d-844a-59b1-a7c0-b34175250d30 with identifier: AR08419
2026-03-30 10:46:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1851775d-844a-59b1-a7c0-b34175250d30 with identifier: AR08419
2026-03-30 10:46:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1851775d-844a-59b1-a7c0-b34175250d30 with identifier: AR08419 to the API
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AR08419>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:00:35Z',
 'fuel_type': 'diesel',
 'id': '1851775d-844a-59b1-a7c0-b34175250d30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR08419',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 224427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_d81a008729e196ddf6532bc16fe3b982.jpg',
                'https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_1bf5558030f11dc31c3c52286569f3d8.jpg',
                'https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_521d179588b70d34cee393a32b40e334.jpg',
                'https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_162950eedca61b4f62ffdd445aeeb9fa.jpg',
                'https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_0c63ba4d53416d77ca9ad06fa84fee1b.jpg',
                'https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_c91c5d4b11b816fc9b4a31c1a6e91f34.jpg',
                'https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_8c554d0e3fa585d700f603e6a8a17af1.jpg',
                'https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_cb31169bf2ab1b184151a8ca1cbc771d.jpg',
                'https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_7d695a073da64fc280ec6e0dfc5b5079.jpg',
                'https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_2a19e704af4822cc875246a65d7993c7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1851775d-844a-59b1-a7c0-b34175250d30/1851775d-844a-59b1-a7c0-b34175250d30_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_d81a008729e196ddf6532bc16fe3b982.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1851775d-844a-59b1-a7c0-b34175250d30/1851775d-844a-59b1-a7c0-b34175250d30_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_1bf5558030f11dc31c3c52286569f3d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1851775d-844a-59b1-a7c0-b34175250d30/1851775d-844a-59b1-a7c0-b34175250d30_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_521d179588b70d34cee393a32b40e334.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1851775d-844a-59b1-a7c0-b34175250d30/1851775d-844a-59b1-a7c0-b34175250d30_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_162950eedca61b4f62ffdd445aeeb9fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1851775d-844a-59b1-a7c0-b34175250d30/1851775d-844a-59b1-a7c0-b34175250d30_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_0c63ba4d53416d77ca9ad06fa84fee1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1851775d-844a-59b1-a7c0-b34175250d30/1851775d-844a-59b1-a7c0-b34175250d30_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_c91c5d4b11b816fc9b4a31c1a6e91f34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1851775d-844a-59b1-a7c0-b34175250d30/1851775d-844a-59b1-a7c0-b34175250d30_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_8c554d0e3fa585d700f603e6a8a17af1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1851775d-844a-59b1-a7c0-b34175250d30/1851775d-844a-59b1-a7c0-b34175250d30_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_cb31169bf2ab1b184151a8ca1cbc771d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1851775d-844a-59b1-a7c0-b34175250d30/1851775d-844a-59b1-a7c0-b34175250d30_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_7d695a073da64fc280ec6e0dfc5b5079.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1851775d-844a-59b1-a7c0-b34175250d30/1851775d-844a-59b1-a7c0-b34175250d30_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52704,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img53/43/53430d8bac2716e7343e2b0fd372fd19/pa/AR08419_2a19e704af4822cc875246a65d7993c7.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Maxi Kasten EcoProfi',
 'transmission': 'manual',
 'trim': 'Maxi Kasten EcoProfi',
 'year': 2013}
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR08419%27 HTTP/1.1" 200 None
2026-03-30 10:46:33 [auto1.de] INFO: Saving data for AR08419: {'created_time': 1774867593.494316, 'last_price_update_time': 1774867593.494328, 'auction_closing_time': 1774969235.0}
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR08419') HTTP/1.1" 204 0
2026-03-30 10:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC17196> (referer: https://www.auto1.com/v1/car-details-view/BC17196/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf5fd150-09bc-5e72-a892-377092646cd7 with identifier: BC17196
2026-03-30 10:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf5fd150-09bc-5e72-a892-377092646cd7 with scrape type 1
2026-03-30 10:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf5fd150-09bc-5e72-a892-377092646cd7
2026-03-30 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcd%252Fafcd833321653b8b0923babfb0bab91d%252Fpa%252FBC17196_1c3ca771131684e925d2b417cbc27f7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_1c3ca771131684e925d2b417cbc27f7a.jpg already downloaded
2026-03-30 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcd%252Fafcd833321653b8b0923babfb0bab91d%252Fpa%252FBC17196_3178a1adfe3fd47d14dd473c81a0bd56.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_3178a1adfe3fd47d14dd473c81a0bd56.jpg already downloaded
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcd%252Fafcd833321653b8b0923babfb0bab91d%252Fpa%252FBC17196_b9a6b94c238e4a6ccd2c36415727a938.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_b9a6b94c238e4a6ccd2c36415727a938.jpg already downloaded
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcd%252Fafcd833321653b8b0923babfb0bab91d%252Fpa%252FBC17196_7845e48d3c61104e642da08cbff196e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_7845e48d3c61104e642da08cbff196e2.jpg already downloaded
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcd%252Fafcd833321653b8b0923babfb0bab91d%252Fpa%252FBC17196_180126dfce82747afdab92ba9d0e07f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_180126dfce82747afdab92ba9d0e07f5.jpg already downloaded
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcd%252Fafcd833321653b8b0923babfb0bab91d%252Fpa%252FBC17196_30926853036c9c6bafc3e373a32e5aee.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_30926853036c9c6bafc3e373a32e5aee.jpg already downloaded
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcd%252Fafcd833321653b8b0923babfb0bab91d%252Fpa%252FBC17196_f16371c7381e2a084710a2bcdff064c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_f16371c7381e2a084710a2bcdff064c9.jpg already downloaded
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcd%252Fafcd833321653b8b0923babfb0bab91d%252Fpa%252FBC17196_4d8d5f8211f7ff9d3658be21a37390f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_4d8d5f8211f7ff9d3658be21a37390f8.jpg already downloaded
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcd%252Fafcd833321653b8b0923babfb0bab91d%252Fpa%252FBC17196_4383c5216a43489ff30bec1dc5ca387d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_4383c5216a43489ff30bec1dc5ca387d.jpg already downloaded
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcd%252Fafcd833321653b8b0923babfb0bab91d%252Fpa%252FBC17196_9fe3dbc2d66b333deb73588cbe4a10e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_9fe3dbc2d66b333deb73588cbe4a10e4.jpg already downloaded
2026-03-30 10:46:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf5fd150-09bc-5e72-a892-377092646cd7, identifier: BC17196
2026-03-30 10:46:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf5fd150-09bc-5e72-a892-377092646cd7 with identifier: BC17196
2026-03-30 10:46:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf5fd150-09bc-5e72-a892-377092646cd7 with identifier: BC17196
2026-03-30 10:46:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf5fd150-09bc-5e72-a892-377092646cd7 with identifier: BC17196 to the API
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BC17196>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:45:55Z',
 'fuel_type': 'petrol',
 'id': 'cf5fd150-09bc-5e72-a892-377092646cd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC17196',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 46036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_1c3ca771131684e925d2b417cbc27f7a.jpg',
                'https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_3178a1adfe3fd47d14dd473c81a0bd56.jpg',
                'https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_b9a6b94c238e4a6ccd2c36415727a938.jpg',
                'https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_7845e48d3c61104e642da08cbff196e2.jpg',
                'https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_180126dfce82747afdab92ba9d0e07f5.jpg',
                'https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_30926853036c9c6bafc3e373a32e5aee.jpg',
                'https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_f16371c7381e2a084710a2bcdff064c9.jpg',
                'https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_4d8d5f8211f7ff9d3658be21a37390f8.jpg',
                'https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_4383c5216a43489ff30bec1dc5ca387d.jpg',
                'https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_9fe3dbc2d66b333deb73588cbe4a10e4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5fd150-09bc-5e72-a892-377092646cd7/cf5fd150-09bc-5e72-a892-377092646cd7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_1c3ca771131684e925d2b417cbc27f7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5fd150-09bc-5e72-a892-377092646cd7/cf5fd150-09bc-5e72-a892-377092646cd7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_3178a1adfe3fd47d14dd473c81a0bd56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5fd150-09bc-5e72-a892-377092646cd7/cf5fd150-09bc-5e72-a892-377092646cd7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_b9a6b94c238e4a6ccd2c36415727a938.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5fd150-09bc-5e72-a892-377092646cd7/cf5fd150-09bc-5e72-a892-377092646cd7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_7845e48d3c61104e642da08cbff196e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5fd150-09bc-5e72-a892-377092646cd7/cf5fd150-09bc-5e72-a892-377092646cd7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_180126dfce82747afdab92ba9d0e07f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5fd150-09bc-5e72-a892-377092646cd7/cf5fd150-09bc-5e72-a892-377092646cd7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_30926853036c9c6bafc3e373a32e5aee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5fd150-09bc-5e72-a892-377092646cd7/cf5fd150-09bc-5e72-a892-377092646cd7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_f16371c7381e2a084710a2bcdff064c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5fd150-09bc-5e72-a892-377092646cd7/cf5fd150-09bc-5e72-a892-377092646cd7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_4d8d5f8211f7ff9d3658be21a37390f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5fd150-09bc-5e72-a892-377092646cd7/cf5fd150-09bc-5e72-a892-377092646cd7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_4383c5216a43489ff30bec1dc5ca387d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5fd150-09bc-5e72-a892-377092646cd7/cf5fd150-09bc-5e72-a892-377092646cd7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd833321653b8b0923babfb0bab91d/pa/BC17196_9fe3dbc2d66b333deb73588cbe4a10e4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 Edition 1 AMG Line',
 'transmission': 'automatic',
 'trim': 'Edition 1 AMG Line',
 'year': 2020}
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC17196%27 HTTP/1.1" 200 None
2026-03-30 10:46:36 [auto1.de] INFO: Saving data for BC17196: {'created_time': 1774867596.537139, 'last_price_update_time': 1774867596.537149, 'auction_closing_time': 1774971955.0}
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC17196') HTTP/1.1" 204 0
2026-03-30 10:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CK11901> (referer: https://www.auto1.com/v1/car-details-view/CK11901/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b55122b-b5e0-51d6-82aa-758029e896a4 with identifier: CK11901
2026-03-30 10:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b55122b-b5e0-51d6-82aa-758029e896a4 with scrape type 1
2026-03-30 10:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b55122b-b5e0-51d6-82aa-758029e896a4
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F32%252F4d3231a7dc422c02fad0d1fe694a60f9%252Fpa%252FCK11901_6662e64d99f9e0c2fcb468180521e0f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_6662e64d99f9e0c2fcb468180521e0f3.jpg already downloaded
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F32%252F4d3231a7dc422c02fad0d1fe694a60f9%252Fpa%252FCK11901_48998c5f8571162069c3d897b7c497ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_48998c5f8571162069c3d897b7c497ef.jpg already downloaded
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F32%252F4d3231a7dc422c02fad0d1fe694a60f9%252Fpa%252FCK11901_3745d0eaf5e1483c4de669d8fccca044.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_3745d0eaf5e1483c4de669d8fccca044.jpg already downloaded
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F32%252F4d3231a7dc422c02fad0d1fe694a60f9%252Fpa%252FCK11901_66a823238d98ca5f7916a9235060fc5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_66a823238d98ca5f7916a9235060fc5f.jpg already downloaded
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F32%252F4d3231a7dc422c02fad0d1fe694a60f9%252Fpa%252FCK11901_529b4392bbfa5e2c3cca4889015dba08.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_529b4392bbfa5e2c3cca4889015dba08.jpg already downloaded
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F32%252F4d3231a7dc422c02fad0d1fe694a60f9%252Fpa%252FCK11901_16bb200ad19bbe1e11e10e3151f50ba4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_16bb200ad19bbe1e11e10e3151f50ba4.jpg already downloaded
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F32%252F4d3231a7dc422c02fad0d1fe694a60f9%252Fpa%252FCK11901_157b407f57a65651647eedd276e228dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_157b407f57a65651647eedd276e228dd.jpg already downloaded
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F32%252F4d3231a7dc422c02fad0d1fe694a60f9%252Fpa%252FCK11901_9e76cdec56149d75a54a2ae689fa6720.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_9e76cdec56149d75a54a2ae689fa6720.jpg already downloaded
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F32%252F4d3231a7dc422c02fad0d1fe694a60f9%252Fpa%252FCK11901_4dabf8cb7e9020953650827eeac359e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_4dabf8cb7e9020953650827eeac359e8.jpg already downloaded
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F32%252F4d3231a7dc422c02fad0d1fe694a60f9%252Fpa%252FCK11901_2608b5f6f0a3a7d43d6791406b181d5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_2608b5f6f0a3a7d43d6791406b181d5f.jpg already downloaded
2026-03-30 10:46:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b55122b-b5e0-51d6-82aa-758029e896a4, identifier: CK11901
2026-03-30 10:46:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b55122b-b5e0-51d6-82aa-758029e896a4 with identifier: CK11901
2026-03-30 10:46:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b55122b-b5e0-51d6-82aa-758029e896a4 with identifier: CK11901
2026-03-30 10:46:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b55122b-b5e0-51d6-82aa-758029e896a4 with identifier: CK11901 to the API
2026-03-30 10:46:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CK11901>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:31:21Z',
 'fuel_type': 'diesel',
 'id': '5b55122b-b5e0-51d6-82aa-758029e896a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK11901',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 44064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_6662e64d99f9e0c2fcb468180521e0f3.jpg',
                'https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_48998c5f8571162069c3d897b7c497ef.jpg',
                'https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_3745d0eaf5e1483c4de669d8fccca044.jpg',
                'https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_66a823238d98ca5f7916a9235060fc5f.jpg',
                'https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_529b4392bbfa5e2c3cca4889015dba08.jpg',
                'https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_16bb200ad19bbe1e11e10e3151f50ba4.jpg',
                'https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_157b407f57a65651647eedd276e228dd.jpg',
                'https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_9e76cdec56149d75a54a2ae689fa6720.jpg',
                'https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_4dabf8cb7e9020953650827eeac359e8.jpg',
                'https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_2608b5f6f0a3a7d43d6791406b181d5f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b55122b-b5e0-51d6-82aa-758029e896a4/5b55122b-b5e0-51d6-82aa-758029e896a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_6662e64d99f9e0c2fcb468180521e0f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b55122b-b5e0-51d6-82aa-758029e896a4/5b55122b-b5e0-51d6-82aa-758029e896a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_48998c5f8571162069c3d897b7c497ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b55122b-b5e0-51d6-82aa-758029e896a4/5b55122b-b5e0-51d6-82aa-758029e896a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_3745d0eaf5e1483c4de669d8fccca044.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b55122b-b5e0-51d6-82aa-758029e896a4/5b55122b-b5e0-51d6-82aa-758029e896a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_66a823238d98ca5f7916a9235060fc5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b55122b-b5e0-51d6-82aa-758029e896a4/5b55122b-b5e0-51d6-82aa-758029e896a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_529b4392bbfa5e2c3cca4889015dba08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b55122b-b5e0-51d6-82aa-758029e896a4/5b55122b-b5e0-51d6-82aa-758029e896a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_16bb200ad19bbe1e11e10e3151f50ba4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b55122b-b5e0-51d6-82aa-758029e896a4/5b55122b-b5e0-51d6-82aa-758029e896a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_157b407f57a65651647eedd276e228dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b55122b-b5e0-51d6-82aa-758029e896a4/5b55122b-b5e0-51d6-82aa-758029e896a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402919,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_9e76cdec56149d75a54a2ae689fa6720.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b55122b-b5e0-51d6-82aa-758029e896a4/5b55122b-b5e0-51d6-82aa-758029e896a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 510571,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_4dabf8cb7e9020953650827eeac359e8.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b55122b-b5e0-51d6-82aa-758029e896a4/5b55122b-b5e0-51d6-82aa-758029e896a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/32/4d3231a7dc422c02fad0d1fe694a60f9/pa/CK11901_2608b5f6f0a3a7d43d6791406b181d5f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Sportline 4x4',
 'transmission': 'automatic',
 'trim': 'Sportline 4x4',
 'year': 2023}
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK11901%27 HTTP/1.1" 200 None
2026-03-30 10:46:38 [auto1.de] INFO: Saving data for CK11901: {'created_time': 1774867598.169513, 'last_price_update_time': 1774867598.169527, 'auction_closing_time': 1774971081.0}
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK11901') HTTP/1.1" 204 0
2026-03-30 10:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JP87174> (referer: https://www.auto1.com/v1/car-details-view/JP87174/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f4a1e62-474b-5e39-9ed6-17e50d8831fd with identifier: JP87174
2026-03-30 10:46:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f4a1e62-474b-5e39-9ed6-17e50d8831fd with scrape type 1
2026-03-30 10:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f4a1e62-474b-5e39-9ed6-17e50d8831fd
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_8f0377ba4cf84eedd2c7d423f0a43055.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_8f0377ba4cf84eedd2c7d423f0a43055.jpg not downloaded yet
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_2ea3a957d9ceeb1e2a23eb9bde626866.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_2ea3a957d9ceeb1e2a23eb9bde626866.jpg not downloaded yet
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_a594f67942e3fb57905460625c3938fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_a594f67942e3fb57905460625c3938fc.jpg not downloaded yet
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_829dfbd97144c55c1a8490e6d744de77.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_829dfbd97144c55c1a8490e6d744de77.jpg not downloaded yet
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_848fc7fe6fdb4d4676498290dc3acf72.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_848fc7fe6fdb4d4676498290dc3acf72.jpg not downloaded yet
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_c320f4696fac5f7a8535fec39383565d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_c320f4696fac5f7a8535fec39383565d.jpg not downloaded yet
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_81167fed41a14161eaced7e97dd5e298.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_81167fed41a14161eaced7e97dd5e298.jpg not downloaded yet
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_426f81fd24f8eea13f03ef801bf9e133.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_426f81fd24f8eea13f03ef801bf9e133.jpg not downloaded yet
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_e108f3fb73fce68fcd8c3ed0ac5f70c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_e108f3fb73fce68fcd8c3ed0ac5f70c3.jpg not downloaded yet
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_2fdebdbb99ba6a0ed535bb740dbcb0df.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_2fdebdbb99ba6a0ed535bb740dbcb0df.jpg not downloaded yet
2026-03-30 10:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_8f0377ba4cf84eedd2c7d423f0a43055.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42b7b50>
2026-03-30 10:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_8f0377ba4cf84eedd2c7d423f0a43055.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_8f0377ba4cf84eedd2c7d423f0a43055.jpg saved to cache
2026-03-30 10:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f4a1e62-474b-5e39-9ed6-17e50d8831fd
2026-03-30 10:46:42 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.366(s), this was the 1st time calling it.
2026-03-30 10:46:42 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.23440391291723 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_2fdebdbb99ba6a0ed535bb740dbcb0df.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TP91786/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424f790>
2026-03-30 10:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_2fdebdbb99ba6a0ed535bb740dbcb0df.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_2fdebdbb99ba6a0ed535bb740dbcb0df.jpg saved to cache
2026-03-30 10:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f4a1e62-474b-5e39-9ed6-17e50d8831fd
2026-03-30 10:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_e108f3fb73fce68fcd8c3ed0ac5f70c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_426f81fd24f8eea13f03ef801bf9e133.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434d750>
2026-03-30 10:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_e108f3fb73fce68fcd8c3ed0ac5f70c3.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_e108f3fb73fce68fcd8c3ed0ac5f70c3.jpg saved to cache
2026-03-30 10:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f4a1e62-474b-5e39-9ed6-17e50d8831fd
2026-03-30 10:46:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4173a10>
2026-03-30 10:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_426f81fd24f8eea13f03ef801bf9e133.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_426f81fd24f8eea13f03ef801bf9e133.jpg saved to cache
2026-03-30 10:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f4a1e62-474b-5e39-9ed6-17e50d8831fd
2026-03-30 10:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_81167fed41a14161eaced7e97dd5e298.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef50e50>
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_81167fed41a14161eaced7e97dd5e298.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_81167fed41a14161eaced7e97dd5e298.jpg saved to cache
2026-03-30 10:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f4a1e62-474b-5e39-9ed6-17e50d8831fd
2026-03-30 10:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_c320f4696fac5f7a8535fec39383565d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee13f10>
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_c320f4696fac5f7a8535fec39383565d.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_c320f4696fac5f7a8535fec39383565d.jpg saved to cache
2026-03-30 10:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f4a1e62-474b-5e39-9ed6-17e50d8831fd
2026-03-30 10:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_848fc7fe6fdb4d4676498290dc3acf72.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41f2050>
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_848fc7fe6fdb4d4676498290dc3acf72.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_848fc7fe6fdb4d4676498290dc3acf72.jpg saved to cache
2026-03-30 10:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f4a1e62-474b-5e39-9ed6-17e50d8831fd
2026-03-30 10:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_829dfbd97144c55c1a8490e6d744de77.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.664(s), this was the 1st time calling it.
2026-03-30 10:46:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.721616290607225 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:46:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4173d10>
2026-03-30 10:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_829dfbd97144c55c1a8490e6d744de77.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_829dfbd97144c55c1a8490e6d744de77.jpg saved to cache
2026-03-30 10:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f4a1e62-474b-5e39-9ed6-17e50d8831fd
2026-03-30 10:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_a594f67942e3fb57905460625c3938fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeed1d10>
2026-03-30 10:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_a594f67942e3fb57905460625c3938fc.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_a594f67942e3fb57905460625c3938fc.jpg saved to cache
2026-03-30 10:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f4a1e62-474b-5e39-9ed6-17e50d8831fd
2026-03-30 10:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_2ea3a957d9ceeb1e2a23eb9bde626866.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef7f290>
2026-03-30 10:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fda%252F53da2a8e4691e39a34baa54b78dc1d6f%252Fpa%252FJP87174_2ea3a957d9ceeb1e2a23eb9bde626866.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_2ea3a957d9ceeb1e2a23eb9bde626866.jpg saved to cache
2026-03-30 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f4a1e62-474b-5e39-9ed6-17e50d8831fd
2026-03-30 10:46:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f4a1e62-474b-5e39-9ed6-17e50d8831fd, skipping ID generation
2026-03-30 10:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f4a1e62-474b-5e39-9ed6-17e50d8831fd with scrape type 1
2026-03-30 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f4a1e62-474b-5e39-9ed6-17e50d8831fd sending to next pipeline
2026-03-30 10:46:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f4a1e62-474b-5e39-9ed6-17e50d8831fd, identifier: JP87174
2026-03-30 10:46:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f4a1e62-474b-5e39-9ed6-17e50d8831fd with identifier: JP87174
2026-03-30 10:46:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f4a1e62-474b-5e39-9ed6-17e50d8831fd with identifier: JP87174
2026-03-30 10:46:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f4a1e62-474b-5e39-9ed6-17e50d8831fd with identifier: JP87174 to the API
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_2ea3a957d9ceeb1e2a23eb9bde626866.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:57:55Z',
 'fuel_type': 'diesel',
 'id': '8f4a1e62-474b-5e39-9ed6-17e50d8831fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP87174',
 'listing': 'auction',
 'location': 'DE, Kaiserslautern',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 248096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3171435,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_8f0377ba4cf84eedd2c7d423f0a43055.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3064739,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_2ea3a957d9ceeb1e2a23eb9bde626866.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3118375,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_a594f67942e3fb57905460625c3938fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2863454,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_829dfbd97144c55c1a8490e6d744de77.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2893900,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_848fc7fe6fdb4d4676498290dc3acf72.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2917832,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_c320f4696fac5f7a8535fec39383565d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2913096,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_81167fed41a14161eaced7e97dd5e298.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3167024,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_426f81fd24f8eea13f03ef801bf9e133.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3117838,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_e108f3fb73fce68fcd8c3ed0ac5f70c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f4a1e62-474b-5e39-9ed6-17e50d8831fd/8f4a1e62-474b-5e39-9ed6-17e50d8831fd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3041392,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/da/53da2a8e4691e39a34baa54b78dc1d6f/pa/JP87174_2fdebdbb99ba6a0ed535bb740dbcb0df.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2017}
2026-03-30 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP87174%27 HTTP/1.1" 200 None
2026-03-30 10:46:47 [auto1.de] INFO: Saving data for JP87174: {'created_time': 1774867607.507258, 'last_price_update_time': 1774867607.50727, 'auction_closing_time': 1774972675.0}
2026-03-30 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP87174') HTTP/1.1" 204 0
2026-03-30 10:46:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PF77669/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LK64913> (referer: https://www.auto1.com/v1/car-details-view/LK64913/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c04372c-47cd-5e0f-a092-8c96d55700c7 with identifier: LK64913
2026-03-30 10:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c04372c-47cd-5e0f-a092-8c96d55700c7 with scrape type 1
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0c04372c-47cd-5e0f-a092-8c96d55700c7
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe2%252F86e2d8688ef2b782385561a85b509314%252Fpa%252FLK64913_675a95c87159aa596ca9fd1a9fe75a2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_675a95c87159aa596ca9fd1a9fe75a2d.jpg not downloaded yet
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe2%252F86e2d8688ef2b782385561a85b509314%252Fpa%252FLK64913_3344d97e2131778d29be3b1c1653cc7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_3344d97e2131778d29be3b1c1653cc7f.jpg not downloaded yet
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe2%252F86e2d8688ef2b782385561a85b509314%252Fpa%252FLK64913_627696248236a9aa2802d1e2f038c49b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_627696248236a9aa2802d1e2f038c49b.jpg not downloaded yet
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe2%252F86e2d8688ef2b782385561a85b509314%252Fpa%252FLK64913_b2e37b07c6ad1cce457e077ce07fab26.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_b2e37b07c6ad1cce457e077ce07fab26.jpg not downloaded yet
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe2%252F86e2d8688ef2b782385561a85b509314%252Fpa%252FLK64913_d3c5ec9e2c4c1596005b9806bdce8b3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_d3c5ec9e2c4c1596005b9806bdce8b3e.jpg not downloaded yet
2026-03-30 10:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_3344d97e2131778d29be3b1c1653cc7f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_675a95c87159aa596ca9fd1a9fe75a2d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_b2e37b07c6ad1cce457e077ce07fab26.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_d3c5ec9e2c4c1596005b9806bdce8b3e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee12790>
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c04372c-47cd-5e0f-a092-8c96d55700c7/0c04372c-47cd-5e0f-a092-8c96d55700c7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe2%252F86e2d8688ef2b782385561a85b509314%252Fpa%252FLK64913_3344d97e2131778d29be3b1c1653cc7f.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_3344d97e2131778d29be3b1c1653cc7f.jpg saved to cache
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c04372c-47cd-5e0f-a092-8c96d55700c7
2026-03-30 10:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_627696248236a9aa2802d1e2f038c49b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef7c350>
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c04372c-47cd-5e0f-a092-8c96d55700c7/0c04372c-47cd-5e0f-a092-8c96d55700c7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe2%252F86e2d8688ef2b782385561a85b509314%252Fpa%252FLK64913_675a95c87159aa596ca9fd1a9fe75a2d.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_675a95c87159aa596ca9fd1a9fe75a2d.jpg saved to cache
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c04372c-47cd-5e0f-a092-8c96d55700c7
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45e2d0>
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c04372c-47cd-5e0f-a092-8c96d55700c7/0c04372c-47cd-5e0f-a092-8c96d55700c7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe2%252F86e2d8688ef2b782385561a85b509314%252Fpa%252FLK64913_b2e37b07c6ad1cce457e077ce07fab26.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_b2e37b07c6ad1cce457e077ce07fab26.jpg saved to cache
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c04372c-47cd-5e0f-a092-8c96d55700c7
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee4a3d0>
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c04372c-47cd-5e0f-a092-8c96d55700c7/0c04372c-47cd-5e0f-a092-8c96d55700c7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe2%252F86e2d8688ef2b782385561a85b509314%252Fpa%252FLK64913_d3c5ec9e2c4c1596005b9806bdce8b3e.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_d3c5ec9e2c4c1596005b9806bdce8b3e.jpg saved to cache
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c04372c-47cd-5e0f-a092-8c96d55700c7
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd64d0>
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c04372c-47cd-5e0f-a092-8c96d55700c7/0c04372c-47cd-5e0f-a092-8c96d55700c7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe2%252F86e2d8688ef2b782385561a85b509314%252Fpa%252FLK64913_627696248236a9aa2802d1e2f038c49b.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_627696248236a9aa2802d1e2f038c49b.jpg saved to cache
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c04372c-47cd-5e0f-a092-8c96d55700c7
2026-03-30 10:46:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c04372c-47cd-5e0f-a092-8c96d55700c7, skipping ID generation
2026-03-30 10:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c04372c-47cd-5e0f-a092-8c96d55700c7 with scrape type 1
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c04372c-47cd-5e0f-a092-8c96d55700c7 sending to next pipeline
2026-03-30 10:46:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c04372c-47cd-5e0f-a092-8c96d55700c7, identifier: LK64913
2026-03-30 10:46:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c04372c-47cd-5e0f-a092-8c96d55700c7 with identifier: LK64913
2026-03-30 10:46:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c04372c-47cd-5e0f-a092-8c96d55700c7 with identifier: LK64913
2026-03-30 10:46:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c04372c-47cd-5e0f-a092-8c96d55700c7 with identifier: LK64913 to the API
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_627696248236a9aa2802d1e2f038c49b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:46:07Z',
 'fuel_type': 'petrol',
 'id': '0c04372c-47cd-5e0f-a092-8c96d55700c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK64913',
 'listing': 'auction',
 'location': 'DE, Kempten (Allgäu)',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 153849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c04372c-47cd-5e0f-a092-8c96d55700c7/0c04372c-47cd-5e0f-a092-8c96d55700c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_675a95c87159aa596ca9fd1a9fe75a2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c04372c-47cd-5e0f-a092-8c96d55700c7/0c04372c-47cd-5e0f-a092-8c96d55700c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_3344d97e2131778d29be3b1c1653cc7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c04372c-47cd-5e0f-a092-8c96d55700c7/0c04372c-47cd-5e0f-a092-8c96d55700c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_627696248236a9aa2802d1e2f038c49b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c04372c-47cd-5e0f-a092-8c96d55700c7/0c04372c-47cd-5e0f-a092-8c96d55700c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_b2e37b07c6ad1cce457e077ce07fab26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c04372c-47cd-5e0f-a092-8c96d55700c7/0c04372c-47cd-5e0f-a092-8c96d55700c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/e2/86e2d8688ef2b782385561a85b509314/pa/LK64913_d3c5ec9e2c4c1596005b9806bdce8b3e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK64913%27 HTTP/1.1" 200 None
2026-03-30 10:46:52 [auto1.de] INFO: Saving data for LK64913: {'created_time': 1774867612.15707, 'last_price_update_time': 1774867612.157082, 'auction_closing_time': 1774971967.0}
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK64913') HTTP/1.1" 204 0
2026-03-30 10:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UM69054/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TL54182/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:53 [auto1.de] INFO: Channel: 24h | Page: 25 | totalHits: 9476 | hits on page: 40
2026-03-30 10:46:53 [auto1.de] INFO: Found listing with ID: UZ12630
2026-03-30 10:46:53 [auto1.de] INFO: Found listing with ID: EZ57191
2026-03-30 10:46:53 [auto1.de] INFO: Found listing with ID: AR08419
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR08419%27 HTTP/1.1" 200 None
2026-03-30 10:46:53 [auto1.de] INFO: Scrape type for AR08419: 0
2026-03-30 10:46:53 [auto1.de] INFO: Found listing with ID: DA80798
2026-03-30 10:46:53 [auto1.de] INFO: Found listing with ID: AA94538
2026-03-30 10:46:53 [auto1.de] INFO: Found listing with ID: FK95635
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK95635%27 HTTP/1.1" 200 None
2026-03-30 10:46:53 [auto1.de] INFO: Scrape type for FK95635: 0
2026-03-30 10:46:53 [auto1.de] INFO: Found listing with ID: AH51648
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH51648%27 HTTP/1.1" 200 None
2026-03-30 10:46:53 [auto1.de] INFO: Scrape type for AH51648: 0
2026-03-30 10:46:53 [auto1.de] INFO: Found listing with ID: VA91828
2026-03-30 10:46:53 [auto1.de] INFO: Found listing with ID: XL02877
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL02877%27 HTTP/1.1" 200 None
2026-03-30 10:46:53 [auto1.de] INFO: Scrape type for XL02877: 0
2026-03-30 10:46:53 [auto1.de] INFO: Found listing with ID: WW35819
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW35819%27 HTTP/1.1" 200 None
2026-03-30 10:46:53 [auto1.de] INFO: Scrape type for WW35819: 0
2026-03-30 10:46:53 [auto1.de] INFO: Found listing with ID: YY43496
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY43496%27 HTTP/1.1" 200 None
2026-03-30 10:46:53 [auto1.de] INFO: Scrape type for YY43496: 0
2026-03-30 10:46:53 [auto1.de] INFO: Found listing with ID: XN67118
2026-03-30 10:46:53 [auto1.de] INFO: Found listing with ID: CS82090
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS82090%27 HTTP/1.1" 200 None
2026-03-30 10:46:53 [auto1.de] INFO: Scrape type for CS82090: 2
2026-03-30 10:46:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff29d2d4-c40f-5769-b735-a1b2a08b3b0a with identifier: CS82090
2026-03-30 10:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff29d2d4-c40f-5769-b735-a1b2a08b3b0a with scrape type 2
2026-03-30 10:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff29d2d4-c40f-5769-b735-a1b2a08b3b0a with scrape type 2
2026-03-30 10:46:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff29d2d4-c40f-5769-b735-a1b2a08b3b0a, identifier: CS82090
2026-03-30 10:46:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff29d2d4-c40f-5769-b735-a1b2a08b3b0a with identifier: CS82090
2026-03-30 10:46:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff29d2d4-c40f-5769-b735-a1b2a08b3b0a with identifier: CS82090
2026-03-30 10:46:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff29d2d4-c40f-5769-b735-a1b2a08b3b0a with identifier: CS82090 to the API
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:40:52Z',
 'fuel_type': 'petrol',
 'id': 'ff29d2d4-c40f-5769-b735-a1b2a08b3b0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS82090',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 146779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-16',
 'seller_name': None,
 'title': 'Skoda Octavia 1.2 TSI Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2012}
2026-03-30 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS82090%27 HTTP/1.1" 200 None
2026-03-30 10:46:54 [auto1.de] INFO: Saving data for CS82090: {'auction_closing_time': 1774971652.0, 'created_time': 1773306695.981912, 'last_price_update_time': 1774867614.021891}
2026-03-30 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS82090') HTTP/1.1" 204 0
2026-03-30 10:46:54 [auto1.de] INFO: Found listing with ID: FT47423
2026-03-30 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT47423%27 HTTP/1.1" 200 None
2026-03-30 10:46:54 [auto1.de] INFO: Scrape type for FT47423: 1
2026-03-30 10:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MZ76661/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:54 [auto1.de] INFO: Found listing with ID: SD94329
2026-03-30 10:46:54 [auto1.de] INFO: Found listing with ID: FE58121
2026-03-30 10:46:54 [auto1.de] INFO: Found listing with ID: TR13013
2026-03-30 10:46:54 [auto1.de] INFO: Found listing with ID: BM23326
2026-03-30 10:46:54 [auto1.de] INFO: Found listing with ID: FJ52050
2026-03-30 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ52050%27 HTTP/1.1" 200 None
2026-03-30 10:46:54 [auto1.de] INFO: Scrape type for FJ52050: 2
2026-03-30 10:46:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee4cf52e-a668-5892-9f25-f9c5d58d97f7 with identifier: FJ52050
2026-03-30 10:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee4cf52e-a668-5892-9f25-f9c5d58d97f7 with scrape type 2
2026-03-30 10:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee4cf52e-a668-5892-9f25-f9c5d58d97f7 with scrape type 2
2026-03-30 10:46:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee4cf52e-a668-5892-9f25-f9c5d58d97f7, identifier: FJ52050
2026-03-30 10:46:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee4cf52e-a668-5892-9f25-f9c5d58d97f7 with identifier: FJ52050
2026-03-30 10:46:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee4cf52e-a668-5892-9f25-f9c5d58d97f7 with identifier: FJ52050
2026-03-30 10:46:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee4cf52e-a668-5892-9f25-f9c5d58d97f7 with identifier: FJ52050 to the API
2026-03-30 10:46:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:21:06Z',
 'fuel_type': 'diesel',
 'id': 'ee4cf52e-a668-5892-9f25-f9c5d58d97f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ52050',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 238327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2012}
2026-03-30 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ52050%27 HTTP/1.1" 200 None
2026-03-30 10:46:54 [auto1.de] INFO: Saving data for FJ52050: {'auction_closing_time': 1774970466.0, 'created_time': 1774293895.681529, 'last_price_update_time': 1774867614.78372}
2026-03-30 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ52050') HTTP/1.1" 204 0
2026-03-30 10:46:54 [auto1.de] INFO: Found listing with ID: HC12973
2026-03-30 10:46:54 [auto1.de] INFO: Found listing with ID: AR52532
2026-03-30 10:46:54 [auto1.de] INFO: Found listing with ID: VV99941
2026-03-30 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV99941%27 HTTP/1.1" 200 None
2026-03-30 10:46:54 [auto1.de] INFO: Scrape type for VV99941: 2
2026-03-30 10:46:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa822b14-0ca8-56cc-86be-3c13ff2afbe3 with identifier: VV99941
2026-03-30 10:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa822b14-0ca8-56cc-86be-3c13ff2afbe3 with scrape type 2
2026-03-30 10:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa822b14-0ca8-56cc-86be-3c13ff2afbe3 with scrape type 2
2026-03-30 10:46:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa822b14-0ca8-56cc-86be-3c13ff2afbe3, identifier: VV99941
2026-03-30 10:46:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa822b14-0ca8-56cc-86be-3c13ff2afbe3 with identifier: VV99941
2026-03-30 10:46:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa822b14-0ca8-56cc-86be-3c13ff2afbe3 with identifier: VV99941
2026-03-30 10:46:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa822b14-0ca8-56cc-86be-3c13ff2afbe3 with identifier: VV99941 to the API
2026-03-30 10:46:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:30:37Z',
 'fuel_type': 'diesel',
 'id': 'aa822b14-0ca8-56cc-86be-3c13ff2afbe3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV99941',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 136997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-26',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 250 d 4Matic BlueTEC',
 'transmission': 'automatic',
 'trim': '4Matic BlueTEC',
 'year': 2016}
2026-03-30 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV99941%27 HTTP/1.1" 200 None
2026-03-30 10:46:55 [auto1.de] INFO: Saving data for VV99941: {'auction_closing_time': 1774971037.0, 'created_time': 1774639456.92185, 'last_price_update_time': 1774867615.255491}
2026-03-30 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV99941') HTTP/1.1" 204 0
2026-03-30 10:46:55 [auto1.de] INFO: Found listing with ID: BK51820
2026-03-30 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK51820%27 HTTP/1.1" 200 None
2026-03-30 10:46:55 [auto1.de] INFO: Scrape type for BK51820: 2
2026-03-30 10:46:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2582c48d-85ef-5d42-af44-5be442092d3a with identifier: BK51820
2026-03-30 10:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2582c48d-85ef-5d42-af44-5be442092d3a with scrape type 2
2026-03-30 10:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2582c48d-85ef-5d42-af44-5be442092d3a with scrape type 2
2026-03-30 10:46:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2582c48d-85ef-5d42-af44-5be442092d3a, identifier: BK51820
2026-03-30 10:46:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2582c48d-85ef-5d42-af44-5be442092d3a with identifier: BK51820
2026-03-30 10:46:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2582c48d-85ef-5d42-af44-5be442092d3a with identifier: BK51820
2026-03-30 10:46:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2582c48d-85ef-5d42-af44-5be442092d3a with identifier: BK51820 to the API
2026-03-30 10:46:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:08:11Z',
 'fuel_type': 'petrol',
 'id': '2582c48d-85ef-5d42-af44-5be442092d3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK51820',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 108780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-01',
 'seller_name': None,
 'title': 'BMW 1er 118i Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2016}
2026-03-30 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK51820%27 HTTP/1.1" 200 None
2026-03-30 10:46:55 [auto1.de] INFO: Saving data for BK51820: {'auction_closing_time': 1774969691.0, 'created_time': 1773686248.116377, 'last_price_update_time': 1774867615.734316}
2026-03-30 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK51820') HTTP/1.1" 204 0
2026-03-30 10:46:55 [auto1.de] INFO: Found listing with ID: FT13435
2026-03-30 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT13435%27 HTTP/1.1" 200 None
2026-03-30 10:46:55 [auto1.de] INFO: Scrape type for FT13435: 2
2026-03-30 10:46:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67368759-e294-5b68-ab1f-7c9bb1f8027f with identifier: FT13435
2026-03-30 10:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67368759-e294-5b68-ab1f-7c9bb1f8027f with scrape type 2
2026-03-30 10:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67368759-e294-5b68-ab1f-7c9bb1f8027f with scrape type 2
2026-03-30 10:46:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67368759-e294-5b68-ab1f-7c9bb1f8027f, identifier: FT13435
2026-03-30 10:46:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67368759-e294-5b68-ab1f-7c9bb1f8027f with identifier: FT13435
2026-03-30 10:46:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67368759-e294-5b68-ab1f-7c9bb1f8027f with identifier: FT13435
2026-03-30 10:46:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67368759-e294-5b68-ab1f-7c9bb1f8027f with identifier: FT13435 to the API
2026-03-30 10:46:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:05:12Z',
 'fuel_type': 'diesel',
 'id': '67368759-e294-5b68-ab1f-7c9bb1f8027f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT13435',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 154062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-12',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT13435%27 HTTP/1.1" 200 None
2026-03-30 10:46:56 [auto1.de] INFO: Saving data for FT13435: {'auction_closing_time': 1774969512.0, 'created_time': 1774636913.633085, 'last_price_update_time': 1774867616.222272}
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT13435') HTTP/1.1" 204 0
2026-03-30 10:46:56 [auto1.de] INFO: Found listing with ID: AK78787
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK78787%27 HTTP/1.1" 200 None
2026-03-30 10:46:56 [auto1.de] INFO: Scrape type for AK78787: 2
2026-03-30 10:46:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b45ed1e-b77e-5b66-adeb-eef82b102a41 with identifier: AK78787
2026-03-30 10:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b45ed1e-b77e-5b66-adeb-eef82b102a41 with scrape type 2
2026-03-30 10:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b45ed1e-b77e-5b66-adeb-eef82b102a41 with scrape type 2
2026-03-30 10:46:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b45ed1e-b77e-5b66-adeb-eef82b102a41, identifier: AK78787
2026-03-30 10:46:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b45ed1e-b77e-5b66-adeb-eef82b102a41 with identifier: AK78787
2026-03-30 10:46:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b45ed1e-b77e-5b66-adeb-eef82b102a41 with identifier: AK78787
2026-03-30 10:46:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b45ed1e-b77e-5b66-adeb-eef82b102a41 with identifier: AK78787 to the API
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:49:11Z',
 'fuel_type': 'petrol',
 'id': '8b45ed1e-b77e-5b66-adeb-eef82b102a41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK78787',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 152464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-11',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2007}
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK78787%27 HTTP/1.1" 200 None
2026-03-30 10:46:56 [auto1.de] INFO: Saving data for AK78787: {'auction_closing_time': 1774972151.0, 'created_time': 1774294181.89747, 'last_price_update_time': 1774867616.790135}
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK78787') HTTP/1.1" 204 0
2026-03-30 10:46:56 [auto1.de] INFO: Found listing with ID: CB76983
2026-03-30 10:46:56 [auto1.de] INFO: Found listing with ID: MD89807
2026-03-30 10:46:56 [auto1.de] INFO: Found listing with ID: TV25506
2026-03-30 10:46:56 [auto1.de] INFO: Found listing with ID: DJ56370
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ56370%27 HTTP/1.1" 200 None
2026-03-30 10:46:56 [auto1.de] INFO: Scrape type for DJ56370: 1
2026-03-30 10:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FE23219/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:56 [auto1.de] INFO: Found listing with ID: RL37399
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL37399%27 HTTP/1.1" 200 None
2026-03-30 10:46:56 [auto1.de] INFO: Scrape type for RL37399: 1
2026-03-30 10:46:56 [auto1.de] INFO: Found listing with ID: XV64183
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV64183%27 HTTP/1.1" 200 None
2026-03-30 10:46:56 [auto1.de] INFO: Scrape type for XV64183: 1
2026-03-30 10:46:56 [auto1.de] INFO: Found listing with ID: SK74966
2026-03-30 10:46:56 [auto1.de] INFO: Found listing with ID: VL87987
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL87987%27 HTTP/1.1" 200 None
2026-03-30 10:46:56 [auto1.de] INFO: Scrape type for VL87987: 1
2026-03-30 10:46:56 [auto1.de] INFO: Found listing with ID: SJ67214
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ67214%27 HTTP/1.1" 200 None
2026-03-30 10:46:56 [auto1.de] INFO: Scrape type for SJ67214: 1
2026-03-30 10:46:56 [auto1.de] INFO: Found listing with ID: GS55217
2026-03-30 10:46:56 [auto1.de] INFO: Found listing with ID: VZ72237
2026-03-30 10:46:56 [auto1.de] INFO: Found listing with ID: XH62328
2026-03-30 10:46:56 [auto1.de] INFO: Found listing with ID: AG69292
2026-03-30 10:46:56 [auto1.de] INFO: Found listing with ID: FG17042
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG17042%27 HTTP/1.1" 200 None
2026-03-30 10:46:56 [auto1.de] INFO: Scrape type for FG17042: 1
2026-03-30 10:46:56 [auto1.de] INFO: Found listing with ID: HY62565
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY62565%27 HTTP/1.1" 200 None
2026-03-30 10:46:56 [auto1.de] INFO: Scrape type for HY62565: 2
2026-03-30 10:46:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 586aed2c-049b-59d2-b0e8-c29ccdd158c2 with identifier: HY62565
2026-03-30 10:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 586aed2c-049b-59d2-b0e8-c29ccdd158c2 with scrape type 2
2026-03-30 10:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 586aed2c-049b-59d2-b0e8-c29ccdd158c2 with scrape type 2
2026-03-30 10:46:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 586aed2c-049b-59d2-b0e8-c29ccdd158c2, identifier: HY62565
2026-03-30 10:46:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 586aed2c-049b-59d2-b0e8-c29ccdd158c2 with identifier: HY62565
2026-03-30 10:46:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 586aed2c-049b-59d2-b0e8-c29ccdd158c2 with identifier: HY62565
2026-03-30 10:46:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 586aed2c-049b-59d2-b0e8-c29ccdd158c2 with identifier: HY62565 to the API
2026-03-30 10:46:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:08:53Z',
 'fuel_type': 'petrol',
 'id': '586aed2c-049b-59d2-b0e8-c29ccdd158c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY62565',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 206858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-03',
 'seller_name': None,
 'title': 'Honda Jazz 1.4 Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2010}
2026-03-30 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY62565%27 HTTP/1.1" 200 None
2026-03-30 10:46:57 [auto1.de] INFO: Saving data for HY62565: {'auction_closing_time': 1774969733.0, 'created_time': 1773685864.502878, 'last_price_update_time': 1774867617.461399}
2026-03-30 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY62565') HTTP/1.1" 204 0
2026-03-30 10:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG12776/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH54966/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FC01690/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TL54182> (referer: https://www.auto1.com/v1/car-details-view/TL54182/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e99cd9a-db9b-5361-a26a-26fd4a044eaa with identifier: TL54182
2026-03-30 10:46:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e99cd9a-db9b-5361-a26a-26fd4a044eaa with scrape type 1
2026-03-30 10:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e99cd9a-db9b-5361-a26a-26fd4a044eaa
2026-03-30 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff8%252F0ff83711c182216836a7cfb81b39f8cc%252Fpa%252FTL54182_685947d50953f2c46c6be884f5651fd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_685947d50953f2c46c6be884f5651fd8.jpg already downloaded
2026-03-30 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff8%252F0ff83711c182216836a7cfb81b39f8cc%252Fpa%252FTL54182_b80676a73d1240162a47f3cfcde2e907.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_b80676a73d1240162a47f3cfcde2e907.jpg already downloaded
2026-03-30 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff8%252F0ff83711c182216836a7cfb81b39f8cc%252Fpa%252FTL54182_d5a815a2e0e3897c847dcecd01658d32.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_d5a815a2e0e3897c847dcecd01658d32.jpg already downloaded
2026-03-30 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff8%252F0ff83711c182216836a7cfb81b39f8cc%252Fpa%252FTL54182_d0cef5a2850328ce800d7082d26d729d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_d0cef5a2850328ce800d7082d26d729d.jpg already downloaded
2026-03-30 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff8%252F0ff83711c182216836a7cfb81b39f8cc%252Fpa%252FTL54182_28201252edf5c3bc06201e7779d3af7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_28201252edf5c3bc06201e7779d3af7e.jpg already downloaded
2026-03-30 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff8%252F0ff83711c182216836a7cfb81b39f8cc%252Fpa%252FTL54182_6190a7e1ecd740b8b830b907ae7be411.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_6190a7e1ecd740b8b830b907ae7be411.jpg already downloaded
2026-03-30 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff8%252F0ff83711c182216836a7cfb81b39f8cc%252Fpa%252FTL54182_d3c2642d66bd3e190e595b55f4104fbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_d3c2642d66bd3e190e595b55f4104fbb.jpg already downloaded
2026-03-30 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff8%252F0ff83711c182216836a7cfb81b39f8cc%252Fpa%252FTL54182_95eab11e5c4580ad8e7d15e2669d80ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_95eab11e5c4580ad8e7d15e2669d80ee.jpg already downloaded
2026-03-30 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff8%252F0ff83711c182216836a7cfb81b39f8cc%252Fpa%252FTL54182_a6648b8a016008062da8aaaf69a2f11b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_a6648b8a016008062da8aaaf69a2f11b.jpg already downloaded
2026-03-30 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff8%252F0ff83711c182216836a7cfb81b39f8cc%252Fpa%252FTL54182_512548fdaf623b03bade232302a1fcc6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_512548fdaf623b03bade232302a1fcc6.jpg already downloaded
2026-03-30 10:47:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e99cd9a-db9b-5361-a26a-26fd4a044eaa, identifier: TL54182
2026-03-30 10:47:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e99cd9a-db9b-5361-a26a-26fd4a044eaa with identifier: TL54182
2026-03-30 10:47:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e99cd9a-db9b-5361-a26a-26fd4a044eaa with identifier: TL54182
2026-03-30 10:47:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e99cd9a-db9b-5361-a26a-26fd4a044eaa with identifier: TL54182 to the API
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TL54182>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:53:56Z',
 'fuel_type': 'petrol',
 'id': '1e99cd9a-db9b-5361-a26a-26fd4a044eaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL54182',
 'listing': 'auction',
 'location': 'DE, Kitzingen',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 87579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_685947d50953f2c46c6be884f5651fd8.jpg',
                'https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_b80676a73d1240162a47f3cfcde2e907.jpg',
                'https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_d5a815a2e0e3897c847dcecd01658d32.jpg',
                'https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_d0cef5a2850328ce800d7082d26d729d.jpg',
                'https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_28201252edf5c3bc06201e7779d3af7e.jpg',
                'https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_6190a7e1ecd740b8b830b907ae7be411.jpg',
                'https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_d3c2642d66bd3e190e595b55f4104fbb.jpg',
                'https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_95eab11e5c4580ad8e7d15e2669d80ee.jpg',
                'https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_a6648b8a016008062da8aaaf69a2f11b.jpg',
                'https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_512548fdaf623b03bade232302a1fcc6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e99cd9a-db9b-5361-a26a-26fd4a044eaa/1e99cd9a-db9b-5361-a26a-26fd4a044eaa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2807804,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_685947d50953f2c46c6be884f5651fd8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e99cd9a-db9b-5361-a26a-26fd4a044eaa/1e99cd9a-db9b-5361-a26a-26fd4a044eaa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2835746,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_b80676a73d1240162a47f3cfcde2e907.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e99cd9a-db9b-5361-a26a-26fd4a044eaa/1e99cd9a-db9b-5361-a26a-26fd4a044eaa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2876542,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_d5a815a2e0e3897c847dcecd01658d32.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e99cd9a-db9b-5361-a26a-26fd4a044eaa/1e99cd9a-db9b-5361-a26a-26fd4a044eaa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_d0cef5a2850328ce800d7082d26d729d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e99cd9a-db9b-5361-a26a-26fd4a044eaa/1e99cd9a-db9b-5361-a26a-26fd4a044eaa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2586431,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_28201252edf5c3bc06201e7779d3af7e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e99cd9a-db9b-5361-a26a-26fd4a044eaa/1e99cd9a-db9b-5361-a26a-26fd4a044eaa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2719395,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_6190a7e1ecd740b8b830b907ae7be411.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e99cd9a-db9b-5361-a26a-26fd4a044eaa/1e99cd9a-db9b-5361-a26a-26fd4a044eaa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_d3c2642d66bd3e190e595b55f4104fbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e99cd9a-db9b-5361-a26a-26fd4a044eaa/1e99cd9a-db9b-5361-a26a-26fd4a044eaa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_95eab11e5c4580ad8e7d15e2669d80ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e99cd9a-db9b-5361-a26a-26fd4a044eaa/1e99cd9a-db9b-5361-a26a-26fd4a044eaa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2731464,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_a6648b8a016008062da8aaaf69a2f11b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e99cd9a-db9b-5361-a26a-26fd4a044eaa/1e99cd9a-db9b-5361-a26a-26fd4a044eaa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2544272,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f8/0ff83711c182216836a7cfb81b39f8cc/pa/TL54182_512548fdaf623b03bade232302a1fcc6.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2019}
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL54182%27 HTTP/1.1" 200 None
2026-03-30 10:47:00 [auto1.de] INFO: Saving data for TL54182: {'created_time': 1774867620.547575, 'last_price_update_time': 1774867620.547585, 'auction_closing_time': 1774972436.0}
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL54182') HTTP/1.1" 204 0
2026-03-30 10:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YF96126> (referer: https://www.auto1.com/v1/car-details-view/YF96126/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd336dd4-a656-51cd-ac8b-e039c5dda18a with identifier: YF96126
2026-03-30 10:47:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd336dd4-a656-51cd-ac8b-e039c5dda18a with scrape type 1
2026-03-30 10:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd336dd4-a656-51cd-ac8b-e039c5dda18a
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F9c%252Fae9ceba141ad6bbd3c635c85e3e19f21%252Fpa%252FYF96126_29215d1dd2d67dc469dae458689b14a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_29215d1dd2d67dc469dae458689b14a7.jpg already downloaded
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F9c%252Fae9ceba141ad6bbd3c635c85e3e19f21%252Fpa%252FYF96126_eb8cc1c495a6296fd0c20c72f1fcd631.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_eb8cc1c495a6296fd0c20c72f1fcd631.jpg already downloaded
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F9c%252Fae9ceba141ad6bbd3c635c85e3e19f21%252Fpa%252FYF96126_34affd77bee1faf61b7a47035b72fce6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_34affd77bee1faf61b7a47035b72fce6.jpg already downloaded
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F9c%252Fae9ceba141ad6bbd3c635c85e3e19f21%252Fpa%252FYF96126_d297162a9c4c622159bacd9fabd5ab94.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_d297162a9c4c622159bacd9fabd5ab94.jpg already downloaded
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F9c%252Fae9ceba141ad6bbd3c635c85e3e19f21%252Fpa%252FYF96126_25e608278df5fb3b0987f632f3e7d865.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_25e608278df5fb3b0987f632f3e7d865.jpg already downloaded
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F9c%252Fae9ceba141ad6bbd3c635c85e3e19f21%252Fpa%252FYF96126_f9e9bb9961f06477022a10de0743ab14.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_f9e9bb9961f06477022a10de0743ab14.jpg already downloaded
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F9c%252Fae9ceba141ad6bbd3c635c85e3e19f21%252Fpa%252FYF96126_c73e891b4a333c1e623efcfb2a6aa47e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_c73e891b4a333c1e623efcfb2a6aa47e.jpg already downloaded
2026-03-30 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F9c%252Fae9ceba141ad6bbd3c635c85e3e19f21%252Fpa%252FYF96126_1db6aa14f5c33f94ac694061b251c63d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_1db6aa14f5c33f94ac694061b251c63d.jpg already downloaded
2026-03-30 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F9c%252Fae9ceba141ad6bbd3c635c85e3e19f21%252Fpa%252FYF96126_34f026987c9c895a41dfeaa2e36d4084.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_34f026987c9c895a41dfeaa2e36d4084.jpg already downloaded
2026-03-30 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F9c%252Fae9ceba141ad6bbd3c635c85e3e19f21%252Fpa%252FYF96126_77abf55863dbc6824e90bfb62919811f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_77abf55863dbc6824e90bfb62919811f.jpg already downloaded
2026-03-30 10:47:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd336dd4-a656-51cd-ac8b-e039c5dda18a, identifier: YF96126
2026-03-30 10:47:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd336dd4-a656-51cd-ac8b-e039c5dda18a with identifier: YF96126
2026-03-30 10:47:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd336dd4-a656-51cd-ac8b-e039c5dda18a with identifier: YF96126
2026-03-30 10:47:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd336dd4-a656-51cd-ac8b-e039c5dda18a with identifier: YF96126 to the API
2026-03-30 10:47:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YF96126>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:48:56Z',
 'fuel_type': 'petrol',
 'id': 'bd336dd4-a656-51cd-ac8b-e039c5dda18a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF96126',
 'listing': 'auction',
 'location': 'Potsdam',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 38670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_29215d1dd2d67dc469dae458689b14a7.jpg',
                'https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_eb8cc1c495a6296fd0c20c72f1fcd631.jpg',
                'https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_34affd77bee1faf61b7a47035b72fce6.jpg',
                'https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_d297162a9c4c622159bacd9fabd5ab94.jpg',
                'https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_25e608278df5fb3b0987f632f3e7d865.jpg',
                'https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_f9e9bb9961f06477022a10de0743ab14.jpg',
                'https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_c73e891b4a333c1e623efcfb2a6aa47e.jpg',
                'https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_1db6aa14f5c33f94ac694061b251c63d.jpg',
                'https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_34f026987c9c895a41dfeaa2e36d4084.jpg',
                'https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_77abf55863dbc6824e90bfb62919811f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd336dd4-a656-51cd-ac8b-e039c5dda18a/bd336dd4-a656-51cd-ac8b-e039c5dda18a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2317095,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_29215d1dd2d67dc469dae458689b14a7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd336dd4-a656-51cd-ac8b-e039c5dda18a/bd336dd4-a656-51cd-ac8b-e039c5dda18a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_eb8cc1c495a6296fd0c20c72f1fcd631.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd336dd4-a656-51cd-ac8b-e039c5dda18a/bd336dd4-a656-51cd-ac8b-e039c5dda18a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_34affd77bee1faf61b7a47035b72fce6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd336dd4-a656-51cd-ac8b-e039c5dda18a/bd336dd4-a656-51cd-ac8b-e039c5dda18a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_d297162a9c4c622159bacd9fabd5ab94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd336dd4-a656-51cd-ac8b-e039c5dda18a/bd336dd4-a656-51cd-ac8b-e039c5dda18a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_25e608278df5fb3b0987f632f3e7d865.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd336dd4-a656-51cd-ac8b-e039c5dda18a/bd336dd4-a656-51cd-ac8b-e039c5dda18a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_f9e9bb9961f06477022a10de0743ab14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd336dd4-a656-51cd-ac8b-e039c5dda18a/bd336dd4-a656-51cd-ac8b-e039c5dda18a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_c73e891b4a333c1e623efcfb2a6aa47e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd336dd4-a656-51cd-ac8b-e039c5dda18a/bd336dd4-a656-51cd-ac8b-e039c5dda18a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_1db6aa14f5c33f94ac694061b251c63d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd336dd4-a656-51cd-ac8b-e039c5dda18a/bd336dd4-a656-51cd-ac8b-e039c5dda18a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_34f026987c9c895a41dfeaa2e36d4084.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd336dd4-a656-51cd-ac8b-e039c5dda18a/bd336dd4-a656-51cd-ac8b-e039c5dda18a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/9c/ae9ceba141ad6bbd3c635c85e3e19f21/pa/YF96126_77abf55863dbc6824e90bfb62919811f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Join',
 'transmission': 'manual',
 'trim': 'Join',
 'year': 2019}
2026-03-30 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF96126%27 HTTP/1.1" 200 None
2026-03-30 10:47:01 [auto1.de] INFO: Saving data for YF96126: {'created_time': 1774867621.964848, 'last_price_update_time': 1774867621.964859, 'auction_closing_time': 1774972136.0}
2026-03-30 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF96126') HTTP/1.1" 204 0
2026-03-30 10:47:04 [scrapy.extensions.logstats] INFO: Crawled 598 pages (at 34 pages/min), scraped 434 items (at 22 items/min)
2026-03-30 10:47:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UM69054> (referer: https://www.auto1.com/v1/car-details-view/UM69054/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c with identifier: UM69054
2026-03-30 10:47:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c with scrape type 1
2026-03-30 10:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_e42c48fd2f97ae10e6db9d885b178c73.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_e42c48fd2f97ae10e6db9d885b178c73.jpg not downloaded yet
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_d70a770101e9452c870e5d37693c306e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_d70a770101e9452c870e5d37693c306e.jpg not downloaded yet
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_c20751095febcd2ba40841f12a308d86.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_c20751095febcd2ba40841f12a308d86.jpg not downloaded yet
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_4e2a12c18675b869761887c21f30adff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_4e2a12c18675b869761887c21f30adff.jpg not downloaded yet
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_4817998be3f059ea67f110bb9d016792.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_4817998be3f059ea67f110bb9d016792.jpg not downloaded yet
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_f7766311631c9d82f53f17bd329ffe0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_f7766311631c9d82f53f17bd329ffe0a.jpg not downloaded yet
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_ab52fc36b0dfab53c3083891d670e3ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_ab52fc36b0dfab53c3083891d670e3ed.jpg not downloaded yet
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_98a3fe1a005ea6e608f6b3c92a9311ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_98a3fe1a005ea6e608f6b3c92a9311ef.jpg not downloaded yet
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_0bcae1b5a2d6027aabbc5f72c3aa9360.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_0bcae1b5a2d6027aabbc5f72c3aa9360.jpg not downloaded yet
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_1c64df7a1155f7a6cbd16e28ce7d8f2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_1c64df7a1155f7a6cbd16e28ce7d8f2b.jpg not downloaded yet
2026-03-30 10:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:07 [auto1.de] INFO: Channel: 24h | Page: 26 | totalHits: 9477 | hits on page: 40
2026-03-30 10:47:07 [auto1.de] INFO: Found listing with ID: HY62565
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY62565%27 HTTP/1.1" 200 None
2026-03-30 10:47:07 [auto1.de] INFO: Scrape type for HY62565: 0
2026-03-30 10:47:07 [auto1.de] INFO: Found listing with ID: EY90590
2026-03-30 10:47:07 [auto1.de] INFO: Found listing with ID: NM07390
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM07390%27 HTTP/1.1" 200 None
2026-03-30 10:47:07 [auto1.de] INFO: Scrape type for NM07390: 1
2026-03-30 10:47:07 [auto1.de] INFO: Found listing with ID: NL38495
2026-03-30 10:47:07 [auto1.de] INFO: Found listing with ID: BN14015
2026-03-30 10:47:07 [auto1.de] INFO: Found listing with ID: TE81781
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE81781%27 HTTP/1.1" 200 None
2026-03-30 10:47:07 [auto1.de] INFO: Scrape type for TE81781: 2
2026-03-30 10:47:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 396b83d5-fd83-572a-8b95-0acafc273be8 with identifier: TE81781
2026-03-30 10:47:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 396b83d5-fd83-572a-8b95-0acafc273be8 with scrape type 2
2026-03-30 10:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 396b83d5-fd83-572a-8b95-0acafc273be8 with scrape type 2
2026-03-30 10:47:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 396b83d5-fd83-572a-8b95-0acafc273be8, identifier: TE81781
2026-03-30 10:47:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 396b83d5-fd83-572a-8b95-0acafc273be8 with identifier: TE81781
2026-03-30 10:47:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 396b83d5-fd83-572a-8b95-0acafc273be8 with identifier: TE81781
2026-03-30 10:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 396b83d5-fd83-572a-8b95-0acafc273be8 with identifier: TE81781 to the API
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:10:14Z',
 'fuel_type': 'diesel',
 'id': '396b83d5-fd83-572a-8b95-0acafc273be8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE81781',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 77345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-23',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE81781%27 HTTP/1.1" 200 None
2026-03-30 10:47:08 [auto1.de] INFO: Saving data for TE81781: {'auction_closing_time': 1774969814.0, 'created_time': 1774637085.379155, 'last_price_update_time': 1774867628.325131}
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE81781') HTTP/1.1" 204 0
2026-03-30 10:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PF77669> (referer: https://www.auto1.com/v1/car-details-view/PF77669/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:08 [auto1.de] INFO: Found listing with ID: RZ03047
2026-03-30 10:47:08 [auto1.de] INFO: Found listing with ID: ZW58241
2026-03-30 10:47:08 [auto1.de] INFO: Found listing with ID: YS78642
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS78642%27 HTTP/1.1" 200 None
2026-03-30 10:47:08 [auto1.de] INFO: Scrape type for YS78642: 1
2026-03-30 10:47:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:08 [auto1.de] INFO: Found listing with ID: HK63697
2026-03-30 10:47:08 [auto1.de] INFO: Found listing with ID: VZ61460
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ61460%27 HTTP/1.1" 200 None
2026-03-30 10:47:08 [auto1.de] INFO: Scrape type for VZ61460: 1
2026-03-30 10:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MZ76661> (referer: https://www.auto1.com/v1/car-details-view/MZ76661/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:08 [auto1.de] INFO: Found listing with ID: MJ46471
2026-03-30 10:47:08 [auto1.de] INFO: Found listing with ID: PT32058
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT32058%27 HTTP/1.1" 200 None
2026-03-30 10:47:08 [auto1.de] INFO: Scrape type for PT32058: 1
2026-03-30 10:47:08 [auto1.de] INFO: Found listing with ID: BP66630
2026-03-30 10:47:08 [auto1.de] INFO: Found listing with ID: MJ72325
2026-03-30 10:47:08 [auto1.de] INFO: Found listing with ID: SP39385
2026-03-30 10:47:08 [auto1.de] INFO: Found listing with ID: YZ91982
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ91982%27 HTTP/1.1" 200 None
2026-03-30 10:47:08 [auto1.de] INFO: Scrape type for YZ91982: 1
2026-03-30 10:47:08 [auto1.de] INFO: Found listing with ID: ZA18764
2026-03-30 10:47:08 [auto1.de] INFO: Found listing with ID: RP13899
2026-03-30 10:47:08 [auto1.de] INFO: Found listing with ID: SC15486
2026-03-30 10:47:08 [auto1.de] INFO: Found listing with ID: SS95122
2026-03-30 10:47:08 [auto1.de] INFO: Found listing with ID: WA56629
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA56629%27 HTTP/1.1" 200 None
2026-03-30 10:47:08 [auto1.de] INFO: Scrape type for WA56629: 1
2026-03-30 10:47:08 [auto1.de] INFO: Found listing with ID: JL46781
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL46781%27 HTTP/1.1" 200 None
2026-03-30 10:47:08 [auto1.de] INFO: Scrape type for JL46781: 1
2026-03-30 10:47:08 [auto1.de] INFO: Found listing with ID: BB80176
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB80176%27 HTTP/1.1" 200 None
2026-03-30 10:47:08 [auto1.de] INFO: Scrape type for BB80176: 2
2026-03-30 10:47:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f47021b-9bc4-59ad-8d79-3475b834fd4a with identifier: BB80176
2026-03-30 10:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f47021b-9bc4-59ad-8d79-3475b834fd4a with scrape type 2
2026-03-30 10:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f47021b-9bc4-59ad-8d79-3475b834fd4a with scrape type 2
2026-03-30 10:47:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f47021b-9bc4-59ad-8d79-3475b834fd4a, identifier: BB80176
2026-03-30 10:47:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f47021b-9bc4-59ad-8d79-3475b834fd4a with identifier: BB80176
2026-03-30 10:47:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f47021b-9bc4-59ad-8d79-3475b834fd4a with identifier: BB80176
2026-03-30 10:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f47021b-9bc4-59ad-8d79-3475b834fd4a with identifier: BB80176 to the API
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:20:26Z',
 'fuel_type': 'diesel',
 'id': '5f47021b-9bc4-59ad-8d79-3475b834fd4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB80176',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Kombi',
 'odometer': 146221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-27',
 'seller_name': None,
 'title': 'Volkswagen T6 Kombi 2.0 TDI lang FWD',
 'transmission': 'manual',
 'trim': 'lang FWD',
 'year': 2021}
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB80176%27 HTTP/1.1" 200 None
2026-03-30 10:47:08 [auto1.de] INFO: Saving data for BB80176: {'auction_closing_time': 1774970426.0, 'created_time': 1773741233.762859, 'last_price_update_time': 1774867628.890049}
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB80176') HTTP/1.1" 204 0
2026-03-30 10:47:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e173ad7-a61c-51fb-855c-3ad80870d08c with identifier: PF77669
2026-03-30 10:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e173ad7-a61c-51fb-855c-3ad80870d08c with scrape type 1
2026-03-30 10:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e173ad7-a61c-51fb-855c-3ad80870d08c
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633148a3b1183f8294f905ac3647180%252Fpa%252FPF77669_df6f067030bfa0972aaf7fcba8adb248.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_df6f067030bfa0972aaf7fcba8adb248.jpg already downloaded
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633148a3b1183f8294f905ac3647180%252Fpa%252FPF77669_96d5dd16d007f47b2e38bc6670a19660.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_96d5dd16d007f47b2e38bc6670a19660.jpg already downloaded
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633148a3b1183f8294f905ac3647180%252Fpa%252FPF77669_292e480af9f0f12dc8d4e98fee226092.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_292e480af9f0f12dc8d4e98fee226092.jpg already downloaded
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633148a3b1183f8294f905ac3647180%252Fpa%252FPF77669_4aae7075d7630202f84709c4bf897e8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_4aae7075d7630202f84709c4bf897e8f.jpg already downloaded
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633148a3b1183f8294f905ac3647180%252Fpa%252FPF77669_2f80c7ca3f2fd6a70b23e4f14a45eb99.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_2f80c7ca3f2fd6a70b23e4f14a45eb99.jpg already downloaded
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633148a3b1183f8294f905ac3647180%252Fpa%252FPF77669_1774ac99b591cc15204653943bb2b2d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_1774ac99b591cc15204653943bb2b2d4.jpg already downloaded
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633148a3b1183f8294f905ac3647180%252Fpa%252FPF77669_956a4322163097d938ec626ce5ebd296.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_956a4322163097d938ec626ce5ebd296.jpg already downloaded
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633148a3b1183f8294f905ac3647180%252Fpa%252FPF77669_f2c89689622013f1185aee1359813adc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_f2c89689622013f1185aee1359813adc.jpg already downloaded
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633148a3b1183f8294f905ac3647180%252Fpa%252FPF77669_b2891664765dd30bc0a5b6b55b15e69d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_b2891664765dd30bc0a5b6b55b15e69d.jpg already downloaded
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633148a3b1183f8294f905ac3647180%252Fpa%252FPF77669_bc56752f8db8bbd93eab395a80ba2b66.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_bc56752f8db8bbd93eab395a80ba2b66.jpg already downloaded
2026-03-30 10:47:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e173ad7-a61c-51fb-855c-3ad80870d08c, identifier: PF77669
2026-03-30 10:47:09 [auto1.de] INFO: Found listing with ID: JT25474
2026-03-30 10:47:09 [auto1.de] INFO: Found listing with ID: NU82917
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU82917%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [auto1.de] INFO: Scrape type for NU82917: 1
2026-03-30 10:47:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e173ad7-a61c-51fb-855c-3ad80870d08c with identifier: PF77669
2026-03-30 10:47:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e173ad7-a61c-51fb-855c-3ad80870d08c with identifier: PF77669
2026-03-30 10:47:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e173ad7-a61c-51fb-855c-3ad80870d08c with identifier: PF77669 to the API
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PF77669>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:00:00Z',
 'fuel_type': 'petrol',
 'id': '2e173ad7-a61c-51fb-855c-3ad80870d08c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF77669',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 112709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_df6f067030bfa0972aaf7fcba8adb248.jpg',
                'https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_96d5dd16d007f47b2e38bc6670a19660.jpg',
                'https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_292e480af9f0f12dc8d4e98fee226092.jpg',
                'https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_4aae7075d7630202f84709c4bf897e8f.jpg',
                'https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_2f80c7ca3f2fd6a70b23e4f14a45eb99.jpg',
                'https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_1774ac99b591cc15204653943bb2b2d4.jpg',
                'https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_956a4322163097d938ec626ce5ebd296.jpg',
                'https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_f2c89689622013f1185aee1359813adc.jpg',
                'https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_b2891664765dd30bc0a5b6b55b15e69d.jpg',
                'https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_bc56752f8db8bbd93eab395a80ba2b66.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e173ad7-a61c-51fb-855c-3ad80870d08c/2e173ad7-a61c-51fb-855c-3ad80870d08c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_df6f067030bfa0972aaf7fcba8adb248.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e173ad7-a61c-51fb-855c-3ad80870d08c/2e173ad7-a61c-51fb-855c-3ad80870d08c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_96d5dd16d007f47b2e38bc6670a19660.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e173ad7-a61c-51fb-855c-3ad80870d08c/2e173ad7-a61c-51fb-855c-3ad80870d08c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_292e480af9f0f12dc8d4e98fee226092.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e173ad7-a61c-51fb-855c-3ad80870d08c/2e173ad7-a61c-51fb-855c-3ad80870d08c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2459864,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_4aae7075d7630202f84709c4bf897e8f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e173ad7-a61c-51fb-855c-3ad80870d08c/2e173ad7-a61c-51fb-855c-3ad80870d08c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2527151,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_2f80c7ca3f2fd6a70b23e4f14a45eb99.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e173ad7-a61c-51fb-855c-3ad80870d08c/2e173ad7-a61c-51fb-855c-3ad80870d08c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_1774ac99b591cc15204653943bb2b2d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e173ad7-a61c-51fb-855c-3ad80870d08c/2e173ad7-a61c-51fb-855c-3ad80870d08c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_956a4322163097d938ec626ce5ebd296.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e173ad7-a61c-51fb-855c-3ad80870d08c/2e173ad7-a61c-51fb-855c-3ad80870d08c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_f2c89689622013f1185aee1359813adc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e173ad7-a61c-51fb-855c-3ad80870d08c/2e173ad7-a61c-51fb-855c-3ad80870d08c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2429088,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_b2891664765dd30bc0a5b6b55b15e69d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e173ad7-a61c-51fb-855c-3ad80870d08c/2e173ad7-a61c-51fb-855c-3ad80870d08c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633148a3b1183f8294f905ac3647180/pa/PF77669_bc56752f8db8bbd93eab395a80ba2b66.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2015}
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF77669%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [auto1.de] INFO: Saving data for PF77669: {'created_time': 1774867629.66818, 'last_price_update_time': 1774867629.668193, 'auction_closing_time': 1774969200.0}
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF77669') HTTP/1.1" 204 0
2026-03-30 10:47:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2ea26d8-ec30-5598-97f4-ff14adb43fcf with identifier: MZ76661
2026-03-30 10:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2ea26d8-ec30-5598-97f4-ff14adb43fcf with scrape type 1
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2ea26d8-ec30-5598-97f4-ff14adb43fcf
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F74%252F4774596c99b8a3bcdbed969324f51306%252Fpa%252FMZ76661_57bb94e93e3286309af60682db1c9d86.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_57bb94e93e3286309af60682db1c9d86.jpg already downloaded
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F74%252F4774596c99b8a3bcdbed969324f51306%252Fpa%252FMZ76661_40f9ae7c605609f0dd657e3dec9c5fea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_40f9ae7c605609f0dd657e3dec9c5fea.jpg already downloaded
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F74%252F4774596c99b8a3bcdbed969324f51306%252Fpa%252FMZ76661_5cd97101b488cbfeec59fb4bf78fa248.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_5cd97101b488cbfeec59fb4bf78fa248.jpg already downloaded
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F74%252F4774596c99b8a3bcdbed969324f51306%252Fpa%252FMZ76661_43fce25fab7f7a2eb0aa231adfeb8c6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_43fce25fab7f7a2eb0aa231adfeb8c6a.jpg already downloaded
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F74%252F4774596c99b8a3bcdbed969324f51306%252Fpa%252FMZ76661_4e1199158906d110ecc5312f52ab5716.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_4e1199158906d110ecc5312f52ab5716.jpg already downloaded
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F74%252F4774596c99b8a3bcdbed969324f51306%252Fpa%252FMZ76661_673daa1e508faf00d6970521832e8f75.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_673daa1e508faf00d6970521832e8f75.jpg already downloaded
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F74%252F4774596c99b8a3bcdbed969324f51306%252Fpa%252FMZ76661_158d3d76a3378d50eea93fef62c90911.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_158d3d76a3378d50eea93fef62c90911.jpg already downloaded
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F74%252F4774596c99b8a3bcdbed969324f51306%252Fpa%252FMZ76661_5ded9537579c304b3117a5c30a3c4e75.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_5ded9537579c304b3117a5c30a3c4e75.jpg already downloaded
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F74%252F4774596c99b8a3bcdbed969324f51306%252Fpa%252FMZ76661_9868eace4d62a56dd96286f417690daa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_9868eace4d62a56dd96286f417690daa.jpg already downloaded
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F74%252F4774596c99b8a3bcdbed969324f51306%252Fpa%252FMZ76661_d8740faa949c1a6e16bfa6599b914d06.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_d8740faa949c1a6e16bfa6599b914d06.jpg already downloaded
2026-03-30 10:47:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2ea26d8-ec30-5598-97f4-ff14adb43fcf, identifier: MZ76661
2026-03-30 10:47:10 [auto1.de] INFO: Found listing with ID: HV98245
2026-03-30 10:47:10 [auto1.de] INFO: Found listing with ID: PN04057
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN04057%27 HTTP/1.1" 200 None
2026-03-30 10:47:10 [auto1.de] INFO: Scrape type for PN04057: 1
2026-03-30 10:47:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2ea26d8-ec30-5598-97f4-ff14adb43fcf with identifier: MZ76661
2026-03-30 10:47:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2ea26d8-ec30-5598-97f4-ff14adb43fcf with identifier: MZ76661
2026-03-30 10:47:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2ea26d8-ec30-5598-97f4-ff14adb43fcf with identifier: MZ76661 to the API
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MZ76661>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:03:40Z',
 'fuel_type': 'petrol',
 'id': 'b2ea26d8-ec30-5598-97f4-ff14adb43fcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ76661',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Nissan',
 'model': 'Pulsar',
 'odometer': 149602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_57bb94e93e3286309af60682db1c9d86.jpg',
                'https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_40f9ae7c605609f0dd657e3dec9c5fea.jpg',
                'https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_5cd97101b488cbfeec59fb4bf78fa248.jpg',
                'https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_43fce25fab7f7a2eb0aa231adfeb8c6a.jpg',
                'https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_4e1199158906d110ecc5312f52ab5716.jpg',
                'https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_673daa1e508faf00d6970521832e8f75.jpg',
                'https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_158d3d76a3378d50eea93fef62c90911.jpg',
                'https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_5ded9537579c304b3117a5c30a3c4e75.jpg',
                'https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_9868eace4d62a56dd96286f417690daa.jpg',
                'https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_d8740faa949c1a6e16bfa6599b914d06.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2ea26d8-ec30-5598-97f4-ff14adb43fcf/b2ea26d8-ec30-5598-97f4-ff14adb43fcf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_57bb94e93e3286309af60682db1c9d86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2ea26d8-ec30-5598-97f4-ff14adb43fcf/b2ea26d8-ec30-5598-97f4-ff14adb43fcf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_40f9ae7c605609f0dd657e3dec9c5fea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2ea26d8-ec30-5598-97f4-ff14adb43fcf/b2ea26d8-ec30-5598-97f4-ff14adb43fcf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_5cd97101b488cbfeec59fb4bf78fa248.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2ea26d8-ec30-5598-97f4-ff14adb43fcf/b2ea26d8-ec30-5598-97f4-ff14adb43fcf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_43fce25fab7f7a2eb0aa231adfeb8c6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2ea26d8-ec30-5598-97f4-ff14adb43fcf/b2ea26d8-ec30-5598-97f4-ff14adb43fcf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_4e1199158906d110ecc5312f52ab5716.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2ea26d8-ec30-5598-97f4-ff14adb43fcf/b2ea26d8-ec30-5598-97f4-ff14adb43fcf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_673daa1e508faf00d6970521832e8f75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2ea26d8-ec30-5598-97f4-ff14adb43fcf/b2ea26d8-ec30-5598-97f4-ff14adb43fcf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_158d3d76a3378d50eea93fef62c90911.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2ea26d8-ec30-5598-97f4-ff14adb43fcf/b2ea26d8-ec30-5598-97f4-ff14adb43fcf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_5ded9537579c304b3117a5c30a3c4e75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2ea26d8-ec30-5598-97f4-ff14adb43fcf/b2ea26d8-ec30-5598-97f4-ff14adb43fcf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_9868eace4d62a56dd96286f417690daa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2ea26d8-ec30-5598-97f4-ff14adb43fcf/b2ea26d8-ec30-5598-97f4-ff14adb43fcf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/74/4774596c99b8a3bcdbed969324f51306/pa/MZ76661_d8740faa949c1a6e16bfa6599b914d06.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Pulsar 1.6 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2018}
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ76661%27 HTTP/1.1" 200 None
2026-03-30 10:47:10 [auto1.de] INFO: Saving data for MZ76661: {'created_time': 1774867630.43925, 'last_price_update_time': 1774867630.439261, 'auction_closing_time': 1774969420.0}
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ76661') HTTP/1.1" 204 0
2026-03-30 10:47:10 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.584(s), this was the 1st time calling it.
2026-03-30 10:47:10 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.786151677327974 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:47:10 [auto1.de] INFO: Found listing with ID: XJ50079
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ50079%27 HTTP/1.1" 200 None
2026-03-30 10:47:10 [auto1.de] INFO: Scrape type for XJ50079: 1
2026-03-30 10:47:10 [auto1.de] INFO: Found listing with ID: YX18346
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX18346%27 HTTP/1.1" 200 None
2026-03-30 10:47:10 [auto1.de] INFO: Scrape type for YX18346: 2
2026-03-30 10:47:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e5d00c4-262c-5d24-9d90-ebc971b0b89d with identifier: YX18346
2026-03-30 10:47:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e5d00c4-262c-5d24-9d90-ebc971b0b89d with scrape type 2
2026-03-30 10:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e5d00c4-262c-5d24-9d90-ebc971b0b89d with scrape type 2
2026-03-30 10:47:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e5d00c4-262c-5d24-9d90-ebc971b0b89d, identifier: YX18346
2026-03-30 10:47:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e5d00c4-262c-5d24-9d90-ebc971b0b89d with identifier: YX18346
2026-03-30 10:47:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e5d00c4-262c-5d24-9d90-ebc971b0b89d with identifier: YX18346
2026-03-30 10:47:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e5d00c4-262c-5d24-9d90-ebc971b0b89d with identifier: YX18346 to the API
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 156,
 'expiration_date': '2026-03-31T15:29:20Z',
 'fuel_type': 'petrol',
 'id': '9e5d00c4-262c-5d24-9d90-ebc971b0b89d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX18346',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 90465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-04',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2020}
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX18346%27 HTTP/1.1" 200 None
2026-03-30 10:47:10 [auto1.de] INFO: Saving data for YX18346: {'auction_closing_time': 1774970960.0, 'created_time': 1774292094.042074, 'last_price_update_time': 1774867630.906075}
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YX18346') HTTP/1.1" 204 0
2026-03-30 10:47:10 [auto1.de] INFO: Found listing with ID: WZ74602
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ74602%27 HTTP/1.1" 200 None
2026-03-30 10:47:10 [auto1.de] INFO: Scrape type for WZ74602: 1
2026-03-30 10:47:10 [auto1.de] INFO: Found listing with ID: XA87570
2026-03-30 10:47:10 [auto1.de] INFO: Found listing with ID: VT43145
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT43145%27 HTTP/1.1" 200 None
2026-03-30 10:47:10 [auto1.de] INFO: Scrape type for VT43145: 1
2026-03-30 10:47:10 [auto1.de] INFO: Found listing with ID: GF38956
2026-03-30 10:47:10 [auto1.de] INFO: Found listing with ID: AL88930
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL88930%27 HTTP/1.1" 200 None
2026-03-30 10:47:10 [auto1.de] INFO: Scrape type for AL88930: 1
2026-03-30 10:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_1c64df7a1155f7a6cbd16e28ce7d8f2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:10 [auto1.de] INFO: Found listing with ID: VS83958
2026-03-30 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS83958%27 HTTP/1.1" 200 None
2026-03-30 10:47:11 [auto1.de] INFO: Scrape type for VS83958: 2
2026-03-30 10:47:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad5eba30-660e-560d-b54b-3871331b7a60 with identifier: VS83958
2026-03-30 10:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad5eba30-660e-560d-b54b-3871331b7a60 with scrape type 2
2026-03-30 10:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad5eba30-660e-560d-b54b-3871331b7a60 with scrape type 2
2026-03-30 10:47:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad5eba30-660e-560d-b54b-3871331b7a60, identifier: VS83958
2026-03-30 10:47:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad5eba30-660e-560d-b54b-3871331b7a60 with identifier: VS83958
2026-03-30 10:47:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad5eba30-660e-560d-b54b-3871331b7a60 with identifier: VS83958
2026-03-30 10:47:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad5eba30-660e-560d-b54b-3871331b7a60 with identifier: VS83958 to the API
2026-03-30 10:47:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:52:27Z',
 'fuel_type': 'diesel',
 'id': 'ad5eba30-660e-560d-b54b-3871331b7a60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS83958',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 211822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-10',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CDI BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueTEC Avantgarde',
 'year': 2015}
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS83958%27 HTTP/1.1" 200 None
2026-03-30 10:47:12 [auto1.de] INFO: Saving data for VS83958: {'auction_closing_time': 1774972347.0, 'created_time': 1774294787.913831, 'last_price_update_time': 1774867632.24196}
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS83958') HTTP/1.1" 204 0
2026-03-30 10:47:12 [auto1.de] INFO: Found listing with ID: FF76143
2026-03-30 10:47:12 [auto1.de] INFO: Found listing with ID: YG75934
2026-03-30 10:47:12 [auto1.de] INFO: Found listing with ID: TL58821
2026-03-30 10:47:12 [auto1.de] INFO: Found listing with ID: SG04043
2026-03-30 10:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FE23219> (referer: https://www.auto1.com/v1/car-details-view/FE23219/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FT47423/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429f090>
2026-03-30 10:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_1c64df7a1155f7a6cbd16e28ce7d8f2b.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_1c64df7a1155f7a6cbd16e28ce7d8f2b.jpg saved to cache
2026-03-30 10:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c
2026-03-30 10:47:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL37399/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61b8f700-9712-52f6-bd20-63655ab9a2ad with identifier: FE23219
2026-03-30 10:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61b8f700-9712-52f6-bd20-63655ab9a2ad with scrape type 1
2026-03-30 10:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 61b8f700-9712-52f6-bd20-63655ab9a2ad
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_0054fffc796ef9452e1d5e9617895515.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_0054fffc796ef9452e1d5e9617895515.jpg not downloaded yet
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_208760a8c5211db29d160842dc4a8445.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_208760a8c5211db29d160842dc4a8445.jpg not downloaded yet
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_500924eb847bf27faf1a47053f603eda.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_500924eb847bf27faf1a47053f603eda.jpg not downloaded yet
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_ca1ed3f0843c82cf1a30086953fc13bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_ca1ed3f0843c82cf1a30086953fc13bb.jpg not downloaded yet
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_1ab4b373eb2e7b0a67d4b1b15cfdd4e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_1ab4b373eb2e7b0a67d4b1b15cfdd4e8.jpg not downloaded yet
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_efa55e3816c44cb6f9cab94a54e7efcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_efa55e3816c44cb6f9cab94a54e7efcc.jpg not downloaded yet
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_b8986c9b949f8b54c54668cd2799b670.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_b8986c9b949f8b54c54668cd2799b670.jpg not downloaded yet
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_8ce586b317e777824ce36cc08b2a7362.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_8ce586b317e777824ce36cc08b2a7362.jpg not downloaded yet
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_4afb98f2712514b5d58db9d3285f2599.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_4afb98f2712514b5d58db9d3285f2599.jpg not downloaded yet
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_cb48e2458cec1b2ac0086de4fb6117dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_cb48e2458cec1b2ac0086de4fb6117dd.jpg not downloaded yet
2026-03-30 10:47:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG17042/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_cb48e2458cec1b2ac0086de4fb6117dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14035ab7d0>
2026-03-30 10:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_cb48e2458cec1b2ac0086de4fb6117dd.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_cb48e2458cec1b2ac0086de4fb6117dd.jpg saved to cache
2026-03-30 10:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 61b8f700-9712-52f6-bd20-63655ab9a2ad
2026-03-30 10:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH54966> (referer: https://www.auto1.com/v1/car-details-view/EH54966/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80a3d178-2960-561a-92e8-9b6faac2eac0 with identifier: EH54966
2026-03-30 10:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80a3d178-2960-561a-92e8-9b6faac2eac0 with scrape type 1
2026-03-30 10:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 80a3d178-2960-561a-92e8-9b6faac2eac0
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb7%252F88b7817c11fdd50f3a422f9debd5925a%252Fpa%252FEH54966_ddd9c518af9041d4e09e5855809f9970.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_ddd9c518af9041d4e09e5855809f9970.jpg not downloaded yet
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb7%252F88b7817c11fdd50f3a422f9debd5925a%252Fpa%252FEH54966_87f07ee19534a7554e27d45fd6ad7bbe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_87f07ee19534a7554e27d45fd6ad7bbe.jpg not downloaded yet
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb7%252F88b7817c11fdd50f3a422f9debd5925a%252Fpa%252FEH54966_5a85c7033cdfbc7c66d5fd7852d92229.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_5a85c7033cdfbc7c66d5fd7852d92229.jpg not downloaded yet
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb7%252F88b7817c11fdd50f3a422f9debd5925a%252Fpa%252FEH54966_f04399eb5e2391ba26692d235bc05926.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_f04399eb5e2391ba26692d235bc05926.jpg not downloaded yet
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb7%252F88b7817c11fdd50f3a422f9debd5925a%252Fpa%252FEH54966_2d1bb83260da95681f94ba562ba0fd0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_2d1bb83260da95681f94ba562ba0fd0e.jpg not downloaded yet
2026-03-30 10:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_4afb98f2712514b5d58db9d3285f2599.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_2d1bb83260da95681f94ba562ba0fd0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:19 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.162(s), this was the 1st time calling it.
2026-03-30 10:47:19 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.067116781018527 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:47:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45eb90>
2026-03-30 10:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_4afb98f2712514b5d58db9d3285f2599.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_4afb98f2712514b5d58db9d3285f2599.jpg saved to cache
2026-03-30 10:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 61b8f700-9712-52f6-bd20-63655ab9a2ad
2026-03-30 10:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_f04399eb5e2391ba26692d235bc05926.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419bdd0>
2026-03-30 10:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80a3d178-2960-561a-92e8-9b6faac2eac0/80a3d178-2960-561a-92e8-9b6faac2eac0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb7%252F88b7817c11fdd50f3a422f9debd5925a%252Fpa%252FEH54966_2d1bb83260da95681f94ba562ba0fd0e.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_2d1bb83260da95681f94ba562ba0fd0e.jpg saved to cache
2026-03-30 10:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80a3d178-2960-561a-92e8-9b6faac2eac0
2026-03-30 10:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_5a85c7033cdfbc7c66d5fd7852d92229.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee400ed0>
2026-03-30 10:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80a3d178-2960-561a-92e8-9b6faac2eac0/80a3d178-2960-561a-92e8-9b6faac2eac0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb7%252F88b7817c11fdd50f3a422f9debd5925a%252Fpa%252FEH54966_f04399eb5e2391ba26692d235bc05926.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_f04399eb5e2391ba26692d235bc05926.jpg saved to cache
2026-03-30 10:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80a3d178-2960-561a-92e8-9b6faac2eac0
2026-03-30 10:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_87f07ee19534a7554e27d45fd6ad7bbe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee41b10>
2026-03-30 10:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80a3d178-2960-561a-92e8-9b6faac2eac0/80a3d178-2960-561a-92e8-9b6faac2eac0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb7%252F88b7817c11fdd50f3a422f9debd5925a%252Fpa%252FEH54966_5a85c7033cdfbc7c66d5fd7852d92229.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_5a85c7033cdfbc7c66d5fd7852d92229.jpg saved to cache
2026-03-30 10:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80a3d178-2960-561a-92e8-9b6faac2eac0
2026-03-30 10:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_ddd9c518af9041d4e09e5855809f9970.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429dd90>
2026-03-30 10:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80a3d178-2960-561a-92e8-9b6faac2eac0/80a3d178-2960-561a-92e8-9b6faac2eac0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb7%252F88b7817c11fdd50f3a422f9debd5925a%252Fpa%252FEH54966_87f07ee19534a7554e27d45fd6ad7bbe.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_87f07ee19534a7554e27d45fd6ad7bbe.jpg saved to cache
2026-03-30 10:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80a3d178-2960-561a-92e8-9b6faac2eac0
2026-03-30 10:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7f650>
2026-03-30 10:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80a3d178-2960-561a-92e8-9b6faac2eac0/80a3d178-2960-561a-92e8-9b6faac2eac0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb7%252F88b7817c11fdd50f3a422f9debd5925a%252Fpa%252FEH54966_ddd9c518af9041d4e09e5855809f9970.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_ddd9c518af9041d4e09e5855809f9970.jpg saved to cache
2026-03-30 10:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80a3d178-2960-561a-92e8-9b6faac2eac0
2026-03-30 10:47:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80a3d178-2960-561a-92e8-9b6faac2eac0, skipping ID generation
2026-03-30 10:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80a3d178-2960-561a-92e8-9b6faac2eac0 with scrape type 1
2026-03-30 10:47:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80a3d178-2960-561a-92e8-9b6faac2eac0 sending to next pipeline
2026-03-30 10:47:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80a3d178-2960-561a-92e8-9b6faac2eac0, identifier: EH54966
2026-03-30 10:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80a3d178-2960-561a-92e8-9b6faac2eac0 with identifier: EH54966
2026-03-30 10:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80a3d178-2960-561a-92e8-9b6faac2eac0 with identifier: EH54966
2026-03-30 10:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80a3d178-2960-561a-92e8-9b6faac2eac0 with identifier: EH54966 to the API
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_ddd9c518af9041d4e09e5855809f9970.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:03:13Z',
 'fuel_type': 'diesel',
 'id': '80a3d178-2960-561a-92e8-9b6faac2eac0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH54966',
 'listing': 'auction',
 'location': 'DE, Osnabrück',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 184443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80a3d178-2960-561a-92e8-9b6faac2eac0/80a3d178-2960-561a-92e8-9b6faac2eac0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_ddd9c518af9041d4e09e5855809f9970.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80a3d178-2960-561a-92e8-9b6faac2eac0/80a3d178-2960-561a-92e8-9b6faac2eac0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_87f07ee19534a7554e27d45fd6ad7bbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80a3d178-2960-561a-92e8-9b6faac2eac0/80a3d178-2960-561a-92e8-9b6faac2eac0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_5a85c7033cdfbc7c66d5fd7852d92229.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80a3d178-2960-561a-92e8-9b6faac2eac0/80a3d178-2960-561a-92e8-9b6faac2eac0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_f04399eb5e2391ba26692d235bc05926.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80a3d178-2960-561a-92e8-9b6faac2eac0/80a3d178-2960-561a-92e8-9b6faac2eac0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/b7/88b7817c11fdd50f3a422f9debd5925a/pa/EH54966_2d1bb83260da95681f94ba562ba0fd0e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH54966%27 HTTP/1.1" 200 None
2026-03-30 10:47:20 [auto1.de] INFO: Saving data for EH54966: {'created_time': 1774867640.983367, 'last_price_update_time': 1774867640.983379, 'auction_closing_time': 1774969393.0}
2026-03-30 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH54966') HTTP/1.1" 204 0
2026-03-30 10:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FC01690> (referer: https://www.auto1.com/v1/car-details-view/FC01690/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_8ce586b317e777824ce36cc08b2a7362.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7c62636-fc01-5c88-868c-fd58e5042a9d with identifier: FC01690
2026-03-30 10:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7c62636-fc01-5c88-868c-fd58e5042a9d with scrape type 1
2026-03-30 10:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7c62636-fc01-5c88-868c-fd58e5042a9d
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F54%252F5854cfc39c21101e2a0e0cf160401687%252Fpa%252FFC01690_662490c184d82274d4746b0287c81bc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_662490c184d82274d4746b0287c81bc9.jpg already downloaded
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F54%252F5854cfc39c21101e2a0e0cf160401687%252Fpa%252FFC01690_eaa6d0efa2851c080ff0573ac74bf38d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_eaa6d0efa2851c080ff0573ac74bf38d.jpg already downloaded
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F54%252F5854cfc39c21101e2a0e0cf160401687%252Fpa%252FFC01690_6770132501ba6e779a1a3e468a3e97cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_6770132501ba6e779a1a3e468a3e97cd.jpg already downloaded
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F54%252F5854cfc39c21101e2a0e0cf160401687%252Fpa%252FFC01690_a5b98e70cacef044a04268c74a3eac37.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_a5b98e70cacef044a04268c74a3eac37.jpg already downloaded
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F54%252F5854cfc39c21101e2a0e0cf160401687%252Fpa%252FFC01690_70cb94c4a9c45aca053053e2a3d80dc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_70cb94c4a9c45aca053053e2a3d80dc7.jpg already downloaded
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F54%252F5854cfc39c21101e2a0e0cf160401687%252Fpa%252FFC01690_21732dda934bf48cd2f71ec81dbd67fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_21732dda934bf48cd2f71ec81dbd67fc.jpg already downloaded
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F54%252F5854cfc39c21101e2a0e0cf160401687%252Fpa%252FFC01690_731ec638d38a3cfa8c2da892d56a074c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_731ec638d38a3cfa8c2da892d56a074c.jpg already downloaded
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F54%252F5854cfc39c21101e2a0e0cf160401687%252Fpa%252FFC01690_b0551a0eec42d2e6d96e5480ecfc5e28.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_b0551a0eec42d2e6d96e5480ecfc5e28.jpg already downloaded
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F54%252F5854cfc39c21101e2a0e0cf160401687%252Fpa%252FFC01690_684c5bd4bf400232156a1bd239d12a15.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_684c5bd4bf400232156a1bd239d12a15.jpg already downloaded
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F54%252F5854cfc39c21101e2a0e0cf160401687%252Fpa%252FFC01690_25990746a525239a110e56ebc155a41c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_25990746a525239a110e56ebc155a41c.jpg already downloaded
2026-03-30 10:47:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7c62636-fc01-5c88-868c-fd58e5042a9d, identifier: FC01690
2026-03-30 10:47:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7c62636-fc01-5c88-868c-fd58e5042a9d with identifier: FC01690
2026-03-30 10:47:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7c62636-fc01-5c88-868c-fd58e5042a9d with identifier: FC01690
2026-03-30 10:47:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7c62636-fc01-5c88-868c-fd58e5042a9d with identifier: FC01690 to the API
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FC01690>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:56:50Z',
 'fuel_type': 'petrol',
 'id': 'b7c62636-fc01-5c88-868c-fd58e5042a9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC01690',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 150652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_662490c184d82274d4746b0287c81bc9.jpg',
                'https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_eaa6d0efa2851c080ff0573ac74bf38d.jpg',
                'https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_6770132501ba6e779a1a3e468a3e97cd.jpg',
                'https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_a5b98e70cacef044a04268c74a3eac37.jpg',
                'https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_70cb94c4a9c45aca053053e2a3d80dc7.jpg',
                'https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_21732dda934bf48cd2f71ec81dbd67fc.jpg',
                'https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_731ec638d38a3cfa8c2da892d56a074c.jpg',
                'https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_b0551a0eec42d2e6d96e5480ecfc5e28.jpg',
                'https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_684c5bd4bf400232156a1bd239d12a15.jpg',
                'https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_25990746a525239a110e56ebc155a41c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c62636-fc01-5c88-868c-fd58e5042a9d/b7c62636-fc01-5c88-868c-fd58e5042a9d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_662490c184d82274d4746b0287c81bc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c62636-fc01-5c88-868c-fd58e5042a9d/b7c62636-fc01-5c88-868c-fd58e5042a9d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_eaa6d0efa2851c080ff0573ac74bf38d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c62636-fc01-5c88-868c-fd58e5042a9d/b7c62636-fc01-5c88-868c-fd58e5042a9d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2646861,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_6770132501ba6e779a1a3e468a3e97cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c62636-fc01-5c88-868c-fd58e5042a9d/b7c62636-fc01-5c88-868c-fd58e5042a9d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_a5b98e70cacef044a04268c74a3eac37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c62636-fc01-5c88-868c-fd58e5042a9d/b7c62636-fc01-5c88-868c-fd58e5042a9d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_70cb94c4a9c45aca053053e2a3d80dc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c62636-fc01-5c88-868c-fd58e5042a9d/b7c62636-fc01-5c88-868c-fd58e5042a9d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_21732dda934bf48cd2f71ec81dbd67fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c62636-fc01-5c88-868c-fd58e5042a9d/b7c62636-fc01-5c88-868c-fd58e5042a9d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_731ec638d38a3cfa8c2da892d56a074c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c62636-fc01-5c88-868c-fd58e5042a9d/b7c62636-fc01-5c88-868c-fd58e5042a9d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_b0551a0eec42d2e6d96e5480ecfc5e28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c62636-fc01-5c88-868c-fd58e5042a9d/b7c62636-fc01-5c88-868c-fd58e5042a9d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_684c5bd4bf400232156a1bd239d12a15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c62636-fc01-5c88-868c-fd58e5042a9d/b7c62636-fc01-5c88-868c-fd58e5042a9d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/54/5854cfc39c21101e2a0e0cf160401687/pa/FC01690_25990746a525239a110e56ebc155a41c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Luxe',
 'transmission': 'manual',
 'trim': 'Luxe',
 'year': 2013}
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC01690%27 HTTP/1.1" 200 None
2026-03-30 10:47:21 [auto1.de] INFO: Saving data for FC01690: {'created_time': 1774867641.726412, 'last_price_update_time': 1774867641.726424, 'auction_closing_time': 1774972610.0}
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC01690') HTTP/1.1" 204 0
2026-03-30 10:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BX30024/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3e650>
2026-03-30 10:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_8ce586b317e777824ce36cc08b2a7362.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_8ce586b317e777824ce36cc08b2a7362.jpg saved to cache
2026-03-30 10:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 61b8f700-9712-52f6-bd20-63655ab9a2ad
2026-03-30 10:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_b8986c9b949f8b54c54668cd2799b670.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef76010>
2026-03-30 10:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_b8986c9b949f8b54c54668cd2799b670.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_b8986c9b949f8b54c54668cd2799b670.jpg saved to cache
2026-03-30 10:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 61b8f700-9712-52f6-bd20-63655ab9a2ad
2026-03-30 10:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_efa55e3816c44cb6f9cab94a54e7efcc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefe9c50>
2026-03-30 10:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_efa55e3816c44cb6f9cab94a54e7efcc.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_efa55e3816c44cb6f9cab94a54e7efcc.jpg saved to cache
2026-03-30 10:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61b8f700-9712-52f6-bd20-63655ab9a2ad
2026-03-30 10:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_1ab4b373eb2e7b0a67d4b1b15cfdd4e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NM07390/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f9490>
2026-03-30 10:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_1ab4b373eb2e7b0a67d4b1b15cfdd4e8.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_1ab4b373eb2e7b0a67d4b1b15cfdd4e8.jpg saved to cache
2026-03-30 10:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 61b8f700-9712-52f6-bd20-63655ab9a2ad
2026-03-30 10:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_ca1ed3f0843c82cf1a30086953fc13bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_500924eb847bf27faf1a47053f603eda.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef7cd10>
2026-03-30 10:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_ca1ed3f0843c82cf1a30086953fc13bb.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_ca1ed3f0843c82cf1a30086953fc13bb.jpg saved to cache
2026-03-30 10:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61b8f700-9712-52f6-bd20-63655ab9a2ad
2026-03-30 10:47:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeed2cd0>
2026-03-30 10:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_500924eb847bf27faf1a47053f603eda.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_500924eb847bf27faf1a47053f603eda.jpg saved to cache
2026-03-30 10:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61b8f700-9712-52f6-bd20-63655ab9a2ad
2026-03-30 10:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS78642/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_208760a8c5211db29d160842dc4a8445.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f411f590>
2026-03-30 10:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_208760a8c5211db29d160842dc4a8445.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_208760a8c5211db29d160842dc4a8445.jpg saved to cache
2026-03-30 10:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61b8f700-9712-52f6-bd20-63655ab9a2ad
2026-03-30 10:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ67214/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_0054fffc796ef9452e1d5e9617895515.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4142fd0>
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fcd%252F6ccdc27aea015aa087ef1223abe46aad%252Fpa%252FFE23219_0054fffc796ef9452e1d5e9617895515.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_0054fffc796ef9452e1d5e9617895515.jpg saved to cache
2026-03-30 10:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61b8f700-9712-52f6-bd20-63655ab9a2ad
2026-03-30 10:47:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61b8f700-9712-52f6-bd20-63655ab9a2ad, skipping ID generation
2026-03-30 10:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61b8f700-9712-52f6-bd20-63655ab9a2ad with scrape type 1
2026-03-30 10:47:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61b8f700-9712-52f6-bd20-63655ab9a2ad sending to next pipeline
2026-03-30 10:47:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61b8f700-9712-52f6-bd20-63655ab9a2ad, identifier: FE23219
2026-03-30 10:47:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61b8f700-9712-52f6-bd20-63655ab9a2ad with identifier: FE23219
2026-03-30 10:47:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61b8f700-9712-52f6-bd20-63655ab9a2ad with identifier: FE23219
2026-03-30 10:47:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61b8f700-9712-52f6-bd20-63655ab9a2ad with identifier: FE23219 to the API
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_0054fffc796ef9452e1d5e9617895515.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:27:12Z',
 'fuel_type': 'petrol',
 'id': '61b8f700-9712-52f6-bd20-63655ab9a2ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE23219',
 'listing': 'auction',
 'location': 'DE, München',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 78342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3125860,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_0054fffc796ef9452e1d5e9617895515.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2732287,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_208760a8c5211db29d160842dc4a8445.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2718061,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_500924eb847bf27faf1a47053f603eda.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2530011,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_ca1ed3f0843c82cf1a30086953fc13bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2715367,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_1ab4b373eb2e7b0a67d4b1b15cfdd4e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2667547,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_efa55e3816c44cb6f9cab94a54e7efcc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2626797,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_b8986c9b949f8b54c54668cd2799b670.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2519250,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_8ce586b317e777824ce36cc08b2a7362.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2935986,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_4afb98f2712514b5d58db9d3285f2599.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8f700-9712-52f6-bd20-63655ab9a2ad/61b8f700-9712-52f6-bd20-63655ab9a2ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2902412,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/cd/6ccdc27aea015aa087ef1223abe46aad/pa/FE23219_cb48e2458cec1b2ac0086de4fb6117dd.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Yeti 1.2 TSI Ambition Plus Edition',
 'transmission': 'manual',
 'trim': 'Ambition Plus Edition',
 'year': 2011}
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE23219%27 HTTP/1.1" 200 None
2026-03-30 10:47:24 [auto1.de] INFO: Saving data for FE23219: {'created_time': 1774867644.674146, 'last_price_update_time': 1774867644.674157, 'auction_closing_time': 1774970832.0}
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE23219') HTTP/1.1" 204 0
2026-03-30 10:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG12776> (referer: https://www.auto1.com/v1/car-details-view/AG12776/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 800d748f-c8c9-5561-97bb-5a79c63d03c9 with identifier: AG12776
2026-03-30 10:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 800d748f-c8c9-5561-97bb-5a79c63d03c9 with scrape type 1
2026-03-30 10:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 800d748f-c8c9-5561-97bb-5a79c63d03c9
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_1b320f876c4de247a4ce480a42b0f760.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_1b320f876c4de247a4ce480a42b0f760.jpg not downloaded yet
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_3234160adfb8bef32b7abc060491a24f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_3234160adfb8bef32b7abc060491a24f.jpg not downloaded yet
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_cf4d0a5e7269deab075f84bc9bb2aa66.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_cf4d0a5e7269deab075f84bc9bb2aa66.jpg not downloaded yet
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_fa71d4ace2531d1779da591cbef6a21f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_fa71d4ace2531d1779da591cbef6a21f.jpg not downloaded yet
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_db9b2d140a34e7a95a19753a6900733e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_db9b2d140a34e7a95a19753a6900733e.jpg not downloaded yet
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_7c5b49c0764d5aa30da6a02c74544ad4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_7c5b49c0764d5aa30da6a02c74544ad4.jpg not downloaded yet
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_ef3b5f548a5c8c2043b805b189862042.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_ef3b5f548a5c8c2043b805b189862042.jpg not downloaded yet
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_4042d3c07db61885307ba01d063f3323.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_4042d3c07db61885307ba01d063f3323.jpg not downloaded yet
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_4434151f9678a43f25925468998940f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_4434151f9678a43f25925468998940f3.jpg not downloaded yet
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_46fbd6ea1a05ac1f7802cc930acaf0e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_46fbd6ea1a05ac1f7802cc930acaf0e2.jpg not downloaded yet
2026-03-30 10:47:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XJ50079/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_46fbd6ea1a05ac1f7802cc930acaf0e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeedc590>
2026-03-30 10:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_46fbd6ea1a05ac1f7802cc930acaf0e2.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_46fbd6ea1a05ac1f7802cc930acaf0e2.jpg saved to cache
2026-03-30 10:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 800d748f-c8c9-5561-97bb-5a79c63d03c9
2026-03-30 10:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UU82160/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_4434151f9678a43f25925468998940f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429ef90>
2026-03-30 10:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_4434151f9678a43f25925468998940f3.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_4434151f9678a43f25925468998940f3.jpg saved to cache
2026-03-30 10:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 800d748f-c8c9-5561-97bb-5a79c63d03c9
2026-03-30 10:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL88930/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_4042d3c07db61885307ba01d063f3323.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414d410>
2026-03-30 10:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_4042d3c07db61885307ba01d063f3323.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_4042d3c07db61885307ba01d063f3323.jpg saved to cache
2026-03-30 10:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 800d748f-c8c9-5561-97bb-5a79c63d03c9
2026-03-30 10:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL37399> (referer: https://www.auto1.com/v1/car-details-view/RL37399/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e334f0dc-cebd-5b39-b462-91a427315dc3 with identifier: RL37399
2026-03-30 10:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e334f0dc-cebd-5b39-b462-91a427315dc3 with scrape type 1
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e334f0dc-cebd-5b39-b462-91a427315dc3
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_b6e49829a8df51cb40ab6d403de728bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_b6e49829a8df51cb40ab6d403de728bd.jpg not downloaded yet
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_d6d914640f25aa8d17acfb930b3e2fb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_d6d914640f25aa8d17acfb930b3e2fb9.jpg not downloaded yet
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_bbee168a245466a2fd91f59c88367d2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_bbee168a245466a2fd91f59c88367d2e.jpg not downloaded yet
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_fee353caf9059b680b6d45e0b05caaeb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_fee353caf9059b680b6d45e0b05caaeb.jpg not downloaded yet
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_e6232d6d3551e93809d98e9d648e843d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_e6232d6d3551e93809d98e9d648e843d.jpg not downloaded yet
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_c509c40dbd85ac97c158830ed84e82a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_c509c40dbd85ac97c158830ed84e82a3.jpg not downloaded yet
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_90a4b431c3fc8c142229fd4f48b2e29b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_90a4b431c3fc8c142229fd4f48b2e29b.jpg not downloaded yet
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_806de901be5db2b6f2c4ab6ffb3c83dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_806de901be5db2b6f2c4ab6ffb3c83dc.jpg not downloaded yet
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_e9725ca4685e376f8b44677245f3cf59.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_e9725ca4685e376f8b44677245f3cf59.jpg not downloaded yet
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_59a12209240b55908c58e54b0a73f0c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_59a12209240b55908c58e54b0a73f0c7.jpg not downloaded yet
2026-03-30 10:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_ef3b5f548a5c8c2043b805b189862042.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424ddd0>
2026-03-30 10:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_ef3b5f548a5c8c2043b805b189862042.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_ef3b5f548a5c8c2043b805b189862042.jpg saved to cache
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 800d748f-c8c9-5561-97bb-5a79c63d03c9
2026-03-30 10:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_59a12209240b55908c58e54b0a73f0c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee5ec90>
2026-03-30 10:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_59a12209240b55908c58e54b0a73f0c7.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_59a12209240b55908c58e54b0a73f0c7.jpg saved to cache
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e334f0dc-cebd-5b39-b462-91a427315dc3
2026-03-30 10:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_e9725ca4685e376f8b44677245f3cf59.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4001d0>
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_e9725ca4685e376f8b44677245f3cf59.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_e9725ca4685e376f8b44677245f3cf59.jpg saved to cache
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e334f0dc-cebd-5b39-b462-91a427315dc3
2026-03-30 10:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NM07390> (referer: https://www.auto1.com/v1/car-details-view/NM07390/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b0fe33d-f189-5589-b5a1-9aa671df84b0 with identifier: NM07390
2026-03-30 10:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b0fe33d-f189-5589-b5a1-9aa671df84b0 with scrape type 1
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0b0fe33d-f189-5589-b5a1-9aa671df84b0
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75ef31a4f96cc54cc5975efd62880a%252Fpa%252FNM07390_e070fe1e92ad841a642189f12ba42ec7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_e070fe1e92ad841a642189f12ba42ec7.jpg already downloaded
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75ef31a4f96cc54cc5975efd62880a%252Fpa%252FNM07390_a8d8ef731293594079f1c680d088d365.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_a8d8ef731293594079f1c680d088d365.jpg already downloaded
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75ef31a4f96cc54cc5975efd62880a%252Fpa%252FNM07390_e2e6297cd5c702ffb63b6e13e3c91abe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_e2e6297cd5c702ffb63b6e13e3c91abe.jpg already downloaded
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75ef31a4f96cc54cc5975efd62880a%252Fpa%252FNM07390_fdfccf4f243a46fdbca01a72e7eb327e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_fdfccf4f243a46fdbca01a72e7eb327e.jpg already downloaded
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75ef31a4f96cc54cc5975efd62880a%252Fpa%252FNM07390_6fe7ea773e0da24602db99ccb0a7907c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_6fe7ea773e0da24602db99ccb0a7907c.jpg already downloaded
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75ef31a4f96cc54cc5975efd62880a%252Fpa%252FNM07390_06b813b6717ad0a1c737760b316ce17d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_06b813b6717ad0a1c737760b316ce17d.jpg already downloaded
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75ef31a4f96cc54cc5975efd62880a%252Fpa%252FNM07390_c5641c038a2327f7b6d29e33a49cac6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_c5641c038a2327f7b6d29e33a49cac6e.jpg already downloaded
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75ef31a4f96cc54cc5975efd62880a%252Fpa%252FNM07390_cf82ddbb0d7249289bcf6cc6e7c3979b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_cf82ddbb0d7249289bcf6cc6e7c3979b.jpg already downloaded
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75ef31a4f96cc54cc5975efd62880a%252Fpa%252FNM07390_1d140cfcae4d62d5a1cbaa11695618e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_1d140cfcae4d62d5a1cbaa11695618e8.jpg already downloaded
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75ef31a4f96cc54cc5975efd62880a%252Fpa%252FNM07390_6af1f780ddc11eb4f97496dad9c89bcd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_6af1f780ddc11eb4f97496dad9c89bcd.jpg already downloaded
2026-03-30 10:47:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b0fe33d-f189-5589-b5a1-9aa671df84b0, identifier: NM07390
2026-03-30 10:47:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b0fe33d-f189-5589-b5a1-9aa671df84b0 with identifier: NM07390
2026-03-30 10:47:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b0fe33d-f189-5589-b5a1-9aa671df84b0 with identifier: NM07390
2026-03-30 10:47:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b0fe33d-f189-5589-b5a1-9aa671df84b0 with identifier: NM07390 to the API
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NM07390>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2026-03-31T15:27:31Z',
 'fuel_type': 'petrol',
 'id': '0b0fe33d-f189-5589-b5a1-9aa671df84b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM07390',
 'listing': 'auction',
 'location': 'DE, Lahr',
 'make': 'Fiat',
 'model': '500',
 'odometer': 27756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_e070fe1e92ad841a642189f12ba42ec7.jpg',
                'https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_a8d8ef731293594079f1c680d088d365.jpg',
                'https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_e2e6297cd5c702ffb63b6e13e3c91abe.jpg',
                'https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_fdfccf4f243a46fdbca01a72e7eb327e.jpg',
                'https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_6fe7ea773e0da24602db99ccb0a7907c.jpg',
                'https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_06b813b6717ad0a1c737760b316ce17d.jpg',
                'https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_c5641c038a2327f7b6d29e33a49cac6e.jpg',
                'https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_cf82ddbb0d7249289bcf6cc6e7c3979b.jpg',
                'https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_1d140cfcae4d62d5a1cbaa11695618e8.jpg',
                'https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_6af1f780ddc11eb4f97496dad9c89bcd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0fe33d-f189-5589-b5a1-9aa671df84b0/0b0fe33d-f189-5589-b5a1-9aa671df84b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_e070fe1e92ad841a642189f12ba42ec7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0fe33d-f189-5589-b5a1-9aa671df84b0/0b0fe33d-f189-5589-b5a1-9aa671df84b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_a8d8ef731293594079f1c680d088d365.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0fe33d-f189-5589-b5a1-9aa671df84b0/0b0fe33d-f189-5589-b5a1-9aa671df84b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_e2e6297cd5c702ffb63b6e13e3c91abe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0fe33d-f189-5589-b5a1-9aa671df84b0/0b0fe33d-f189-5589-b5a1-9aa671df84b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_fdfccf4f243a46fdbca01a72e7eb327e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0fe33d-f189-5589-b5a1-9aa671df84b0/0b0fe33d-f189-5589-b5a1-9aa671df84b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_6fe7ea773e0da24602db99ccb0a7907c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0fe33d-f189-5589-b5a1-9aa671df84b0/0b0fe33d-f189-5589-b5a1-9aa671df84b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_06b813b6717ad0a1c737760b316ce17d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0fe33d-f189-5589-b5a1-9aa671df84b0/0b0fe33d-f189-5589-b5a1-9aa671df84b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_c5641c038a2327f7b6d29e33a49cac6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0fe33d-f189-5589-b5a1-9aa671df84b0/0b0fe33d-f189-5589-b5a1-9aa671df84b0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_cf82ddbb0d7249289bcf6cc6e7c3979b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0fe33d-f189-5589-b5a1-9aa671df84b0/0b0fe33d-f189-5589-b5a1-9aa671df84b0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_1d140cfcae4d62d5a1cbaa11695618e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0fe33d-f189-5589-b5a1-9aa671df84b0/0b0fe33d-f189-5589-b5a1-9aa671df84b0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75ef31a4f96cc54cc5975efd62880a/pa/NM07390_6af1f780ddc11eb4f97496dad9c89bcd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-05',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2022}
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM07390%27 HTTP/1.1" 200 None
2026-03-30 10:47:38 [auto1.de] INFO: Saving data for NM07390: {'created_time': 1774867658.987, 'last_price_update_time': 1774867658.987011, 'auction_closing_time': 1774970851.0}
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM07390') HTTP/1.1" 204 0
2026-03-30 10:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK06421> (referer: https://www.auto1.com/v1/car-details-view/RK06421/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_806de901be5db2b6f2c4ab6ffb3c83dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_90a4b431c3fc8c142229fd4f48b2e29b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45954182-d13a-5e20-8805-7e1eac0d5db9 with identifier: RK06421
2026-03-30 10:47:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45954182-d13a-5e20-8805-7e1eac0d5db9 with scrape type 1
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 45954182-d13a-5e20-8805-7e1eac0d5db9
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_f8ac4da900c96f3a775e0785be52413b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_f8ac4da900c96f3a775e0785be52413b.jpg not downloaded yet
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_87fecb752a39675c6a82881c56b1b68f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_87fecb752a39675c6a82881c56b1b68f.jpg not downloaded yet
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_57510cea7ab1b47a832930dc6948c6fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_57510cea7ab1b47a832930dc6948c6fc.jpg not downloaded yet
2026-03-30 10:47:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41c5390>
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_806de901be5db2b6f2c4ab6ffb3c83dc.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_806de901be5db2b6f2c4ab6ffb3c83dc.jpg saved to cache
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e334f0dc-cebd-5b39-b462-91a427315dc3
2026-03-30 10:47:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea3f90>
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_90a4b431c3fc8c142229fd4f48b2e29b.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_90a4b431c3fc8c142229fd4f48b2e29b.jpg saved to cache
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e334f0dc-cebd-5b39-b462-91a427315dc3
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_9f015553506e76f855c22050863e45fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_9f015553506e76f855c22050863e45fa.jpg not downloaded yet
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_01aac59d2cf0e2bb9c3c17c048e10b4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_01aac59d2cf0e2bb9c3c17c048e10b4f.jpg not downloaded yet
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_bffa668add0c1e8cceed5984d55d7f68.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_bffa668add0c1e8cceed5984d55d7f68.jpg not downloaded yet
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_43a692fedd698fb038817e3fb80b8994.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_43a692fedd698fb038817e3fb80b8994.jpg not downloaded yet
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_4af51e679ee9c457767bf7b40d376570.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_4af51e679ee9c457767bf7b40d376570.jpg not downloaded yet
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_7cbe4ee8a51ff48f547dc7cde429fd3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_7cbe4ee8a51ff48f547dc7cde429fd3d.jpg not downloaded yet
2026-03-30 10:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_9f015553506e76f855c22050863e45fa.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_2e33f01c01776675e29b06c395b4a523.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_2e33f01c01776675e29b06c395b4a523.jpg not downloaded yet
2026-03-30 10:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_c509c40dbd85ac97c158830ed84e82a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_e6232d6d3551e93809d98e9d648e843d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef588d0>
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_9f015553506e76f855c22050863e45fa.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_9f015553506e76f855c22050863e45fa.jpg saved to cache
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45954182-d13a-5e20-8805-7e1eac0d5db9
2026-03-30 10:47:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9e0d0>
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_c509c40dbd85ac97c158830ed84e82a3.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_c509c40dbd85ac97c158830ed84e82a3.jpg saved to cache
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e334f0dc-cebd-5b39-b462-91a427315dc3
2026-03-30 10:47:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424ea10>
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_e6232d6d3551e93809d98e9d648e843d.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_e6232d6d3551e93809d98e9d648e843d.jpg saved to cache
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e334f0dc-cebd-5b39-b462-91a427315dc3
2026-03-30 10:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG17042> (referer: https://www.auto1.com/v1/car-details-view/FG17042/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_7cbe4ee8a51ff48f547dc7cde429fd3d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bf43369-6023-529d-a670-296194b71c6a with identifier: FG17042
2026-03-30 10:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bf43369-6023-529d-a670-296194b71c6a with scrape type 1
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7bf43369-6023-529d-a670-296194b71c6a
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbc%252F66bc72e0ef93321c3fe6255562138ba7%252Fpa%252FFG17042_52ab533228964203390e88ce39e31020.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_52ab533228964203390e88ce39e31020.jpg already downloaded
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbc%252F66bc72e0ef93321c3fe6255562138ba7%252Fpa%252FFG17042_4d6c9793a5f10e94dae701355581c8b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_4d6c9793a5f10e94dae701355581c8b4.jpg already downloaded
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbc%252F66bc72e0ef93321c3fe6255562138ba7%252Fpa%252FFG17042_9f26b08210d48d668b76e714d752db3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_9f26b08210d48d668b76e714d752db3e.jpg already downloaded
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbc%252F66bc72e0ef93321c3fe6255562138ba7%252Fpa%252FFG17042_c3493dc337e824fd518b0f3f244c936c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_c3493dc337e824fd518b0f3f244c936c.jpg already downloaded
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbc%252F66bc72e0ef93321c3fe6255562138ba7%252Fpa%252FFG17042_3453b6d2867e0916606a9684ae89a78e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_3453b6d2867e0916606a9684ae89a78e.jpg already downloaded
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbc%252F66bc72e0ef93321c3fe6255562138ba7%252Fpa%252FFG17042_ef0ac0cc06c81acf83b87d210f324525.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_ef0ac0cc06c81acf83b87d210f324525.jpg already downloaded
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbc%252F66bc72e0ef93321c3fe6255562138ba7%252Fpa%252FFG17042_eefe70c89d57abe71360987070ce69b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_eefe70c89d57abe71360987070ce69b4.jpg already downloaded
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbc%252F66bc72e0ef93321c3fe6255562138ba7%252Fpa%252FFG17042_bf5ffa19a628b2749f9b6d844ed237de.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_bf5ffa19a628b2749f9b6d844ed237de.jpg already downloaded
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbc%252F66bc72e0ef93321c3fe6255562138ba7%252Fpa%252FFG17042_c580271c06bb54d78491a46ad22c7bca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_c580271c06bb54d78491a46ad22c7bca.jpg already downloaded
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbc%252F66bc72e0ef93321c3fe6255562138ba7%252Fpa%252FFG17042_a3c447e07b311faae53421abd9608e4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_a3c447e07b311faae53421abd9608e4f.jpg already downloaded
2026-03-30 10:47:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bf43369-6023-529d-a670-296194b71c6a, identifier: FG17042
2026-03-30 10:47:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bf43369-6023-529d-a670-296194b71c6a with identifier: FG17042
2026-03-30 10:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bf43369-6023-529d-a670-296194b71c6a with identifier: FG17042
2026-03-30 10:47:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bf43369-6023-529d-a670-296194b71c6a with identifier: FG17042 to the API
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FG17042>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:07:29Z',
 'fuel_type': 'petrol',
 'id': '7bf43369-6023-529d-a670-296194b71c6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG17042',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 70064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_52ab533228964203390e88ce39e31020.jpg',
                'https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_4d6c9793a5f10e94dae701355581c8b4.jpg',
                'https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_9f26b08210d48d668b76e714d752db3e.jpg',
                'https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_c3493dc337e824fd518b0f3f244c936c.jpg',
                'https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_3453b6d2867e0916606a9684ae89a78e.jpg',
                'https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_ef0ac0cc06c81acf83b87d210f324525.jpg',
                'https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_eefe70c89d57abe71360987070ce69b4.jpg',
                'https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_bf5ffa19a628b2749f9b6d844ed237de.jpg',
                'https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_c580271c06bb54d78491a46ad22c7bca.jpg',
                'https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_a3c447e07b311faae53421abd9608e4f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf43369-6023-529d-a670-296194b71c6a/7bf43369-6023-529d-a670-296194b71c6a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_52ab533228964203390e88ce39e31020.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf43369-6023-529d-a670-296194b71c6a/7bf43369-6023-529d-a670-296194b71c6a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_4d6c9793a5f10e94dae701355581c8b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf43369-6023-529d-a670-296194b71c6a/7bf43369-6023-529d-a670-296194b71c6a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_9f26b08210d48d668b76e714d752db3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf43369-6023-529d-a670-296194b71c6a/7bf43369-6023-529d-a670-296194b71c6a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_c3493dc337e824fd518b0f3f244c936c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf43369-6023-529d-a670-296194b71c6a/7bf43369-6023-529d-a670-296194b71c6a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_3453b6d2867e0916606a9684ae89a78e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf43369-6023-529d-a670-296194b71c6a/7bf43369-6023-529d-a670-296194b71c6a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_ef0ac0cc06c81acf83b87d210f324525.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf43369-6023-529d-a670-296194b71c6a/7bf43369-6023-529d-a670-296194b71c6a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_eefe70c89d57abe71360987070ce69b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf43369-6023-529d-a670-296194b71c6a/7bf43369-6023-529d-a670-296194b71c6a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_bf5ffa19a628b2749f9b6d844ed237de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf43369-6023-529d-a670-296194b71c6a/7bf43369-6023-529d-a670-296194b71c6a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_c580271c06bb54d78491a46ad22c7bca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf43369-6023-529d-a670-296194b71c6a/7bf43369-6023-529d-a670-296194b71c6a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/bc/66bc72e0ef93321c3fe6255562138ba7/pa/FG17042_a3c447e07b311faae53421abd9608e4f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG17042%27 HTTP/1.1" 200 None
2026-03-30 10:47:40 [auto1.de] INFO: Saving data for FG17042: {'created_time': 1774867660.676947, 'last_price_update_time': 1774867660.67696, 'auction_closing_time': 1774969649.0}
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG17042') HTTP/1.1" 204 0
2026-03-30 10:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WZ74602/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58fb590>
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_7cbe4ee8a51ff48f547dc7cde429fd3d.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_7cbe4ee8a51ff48f547dc7cde429fd3d.jpg saved to cache
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 45954182-d13a-5e20-8805-7e1eac0d5db9
2026-03-30 10:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_2e33f01c01776675e29b06c395b4a523.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_4af51e679ee9c457767bf7b40d376570.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_bffa668add0c1e8cceed5984d55d7f68.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424ef90>
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_2e33f01c01776675e29b06c395b4a523.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_2e33f01c01776675e29b06c395b4a523.jpg saved to cache
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 45954182-d13a-5e20-8805-7e1eac0d5db9
2026-03-30 10:47:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee47b150>
2026-03-30 10:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_4af51e679ee9c457767bf7b40d376570.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_4af51e679ee9c457767bf7b40d376570.jpg saved to cache
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 45954182-d13a-5e20-8805-7e1eac0d5db9
2026-03-30 10:47:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3ad90>
2026-03-30 10:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_bffa668add0c1e8cceed5984d55d7f68.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_bffa668add0c1e8cceed5984d55d7f68.jpg saved to cache
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 45954182-d13a-5e20-8805-7e1eac0d5db9
2026-03-30 10:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BX30024> (referer: https://www.auto1.com/v1/car-details-view/BX30024/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_01aac59d2cf0e2bb9c3c17c048e10b4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50de0d4f-7163-50df-997c-edb67c390a90 with identifier: BX30024
2026-03-30 10:47:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50de0d4f-7163-50df-997c-edb67c390a90 with scrape type 1
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 50de0d4f-7163-50df-997c-edb67c390a90
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F20%252Fe720d3f3d8a2eb33b639afcaad57a4da%252Fpa%252FBX30024_27ae8ee1c2527eb7161e4342f9fb84cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_27ae8ee1c2527eb7161e4342f9fb84cd.jpg already downloaded
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F20%252Fe720d3f3d8a2eb33b639afcaad57a4da%252Fpa%252FBX30024_b96f4ec29e1c1fb825b2ce22f212ddd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_b96f4ec29e1c1fb825b2ce22f212ddd1.jpg already downloaded
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F20%252Fe720d3f3d8a2eb33b639afcaad57a4da%252Fpa%252FBX30024_526827e0199a5a09f609983bb8e3c008.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_526827e0199a5a09f609983bb8e3c008.jpg already downloaded
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F20%252Fe720d3f3d8a2eb33b639afcaad57a4da%252Fpa%252FBX30024_f8724663a835860edc89c2d33466e06a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_f8724663a835860edc89c2d33466e06a.jpg already downloaded
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F20%252Fe720d3f3d8a2eb33b639afcaad57a4da%252Fpa%252FBX30024_b29aa3b3cdfafd8a4b740f80d649d213.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_b29aa3b3cdfafd8a4b740f80d649d213.jpg already downloaded
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F20%252Fe720d3f3d8a2eb33b639afcaad57a4da%252Fpa%252FBX30024_d5feb73c7d121acaa67b41ac80969f4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_d5feb73c7d121acaa67b41ac80969f4c.jpg already downloaded
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F20%252Fe720d3f3d8a2eb33b639afcaad57a4da%252Fpa%252FBX30024_aa109b657328cadb3db12214e2b9e341.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_aa109b657328cadb3db12214e2b9e341.jpg already downloaded
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F20%252Fe720d3f3d8a2eb33b639afcaad57a4da%252Fpa%252FBX30024_10972a24958c017214c4b4b6e265e5cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_10972a24958c017214c4b4b6e265e5cf.jpg already downloaded
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F20%252Fe720d3f3d8a2eb33b639afcaad57a4da%252Fpa%252FBX30024_6150d73e83da753d5cb8683de8ad4ce2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_6150d73e83da753d5cb8683de8ad4ce2.jpg already downloaded
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F20%252Fe720d3f3d8a2eb33b639afcaad57a4da%252Fpa%252FBX30024_15acac922be3bde35929ebc89e5944ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_15acac922be3bde35929ebc89e5944ae.jpg already downloaded
2026-03-30 10:47:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50de0d4f-7163-50df-997c-edb67c390a90, identifier: BX30024
2026-03-30 10:47:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50de0d4f-7163-50df-997c-edb67c390a90 with identifier: BX30024
2026-03-30 10:47:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50de0d4f-7163-50df-997c-edb67c390a90 with identifier: BX30024
2026-03-30 10:47:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50de0d4f-7163-50df-997c-edb67c390a90 with identifier: BX30024 to the API
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BX30024>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:50:01Z',
 'fuel_type': 'petrol',
 'id': '50de0d4f-7163-50df-997c-edb67c390a90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX30024',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 126582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_27ae8ee1c2527eb7161e4342f9fb84cd.jpg',
                'https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_b96f4ec29e1c1fb825b2ce22f212ddd1.jpg',
                'https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_526827e0199a5a09f609983bb8e3c008.jpg',
                'https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_f8724663a835860edc89c2d33466e06a.jpg',
                'https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_b29aa3b3cdfafd8a4b740f80d649d213.jpg',
                'https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_d5feb73c7d121acaa67b41ac80969f4c.jpg',
                'https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_aa109b657328cadb3db12214e2b9e341.jpg',
                'https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_10972a24958c017214c4b4b6e265e5cf.jpg',
                'https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_6150d73e83da753d5cb8683de8ad4ce2.jpg',
                'https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_15acac922be3bde35929ebc89e5944ae.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50de0d4f-7163-50df-997c-edb67c390a90/50de0d4f-7163-50df-997c-edb67c390a90_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_27ae8ee1c2527eb7161e4342f9fb84cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50de0d4f-7163-50df-997c-edb67c390a90/50de0d4f-7163-50df-997c-edb67c390a90_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_b96f4ec29e1c1fb825b2ce22f212ddd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50de0d4f-7163-50df-997c-edb67c390a90/50de0d4f-7163-50df-997c-edb67c390a90_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_526827e0199a5a09f609983bb8e3c008.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50de0d4f-7163-50df-997c-edb67c390a90/50de0d4f-7163-50df-997c-edb67c390a90_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2683185,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_f8724663a835860edc89c2d33466e06a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50de0d4f-7163-50df-997c-edb67c390a90/50de0d4f-7163-50df-997c-edb67c390a90_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_b29aa3b3cdfafd8a4b740f80d649d213.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50de0d4f-7163-50df-997c-edb67c390a90/50de0d4f-7163-50df-997c-edb67c390a90_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_d5feb73c7d121acaa67b41ac80969f4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50de0d4f-7163-50df-997c-edb67c390a90/50de0d4f-7163-50df-997c-edb67c390a90_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2937156,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_aa109b657328cadb3db12214e2b9e341.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50de0d4f-7163-50df-997c-edb67c390a90/50de0d4f-7163-50df-997c-edb67c390a90_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_10972a24958c017214c4b4b6e265e5cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50de0d4f-7163-50df-997c-edb67c390a90/50de0d4f-7163-50df-997c-edb67c390a90_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2715033,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_6150d73e83da753d5cb8683de8ad4ce2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50de0d4f-7163-50df-997c-edb67c390a90/50de0d4f-7163-50df-997c-edb67c390a90_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e720d3f3d8a2eb33b639afcaad57a4da/pa/BX30024_15acac922be3bde35929ebc89e5944ae.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A1 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2014}
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX30024%27 HTTP/1.1" 200 None
2026-03-30 10:47:42 [auto1.de] INFO: Saving data for BX30024: {'created_time': 1774867662.293801, 'last_price_update_time': 1774867662.293811, 'auction_closing_time': 1774972201.0}
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX30024') HTTP/1.1" 204 0
2026-03-30 10:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS78642> (referer: https://www.auto1.com/v1/car-details-view/YS78642/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_43a692fedd698fb038817e3fb80b8994.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42b7810>
2026-03-30 10:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_01aac59d2cf0e2bb9c3c17c048e10b4f.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_01aac59d2cf0e2bb9c3c17c048e10b4f.jpg saved to cache
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45954182-d13a-5e20-8805-7e1eac0d5db9
2026-03-30 10:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ67214> (referer: https://www.auto1.com/v1/car-details-view/SJ67214/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29 with identifier: YS78642
2026-03-30 10:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29 with scrape type 1
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_8d60502ef270a9bf0c3c5cf05cac684a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_8d60502ef270a9bf0c3c5cf05cac684a.jpg not downloaded yet
2026-03-30 10:47:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42b7610>
2026-03-30 10:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_43a692fedd698fb038817e3fb80b8994.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_43a692fedd698fb038817e3fb80b8994.jpg saved to cache
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 45954182-d13a-5e20-8805-7e1eac0d5db9
2026-03-30 10:47:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_ffd1d49824b7ad8de96ae03aea035f3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_ffd1d49824b7ad8de96ae03aea035f3b.jpg not downloaded yet
2026-03-30 10:47:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 113d937b-55cc-594b-afaf-208a24dd648f with identifier: SJ67214
2026-03-30 10:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 113d937b-55cc-594b-afaf-208a24dd648f with scrape type 1
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 113d937b-55cc-594b-afaf-208a24dd648f
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F22%252Ffe22a113e30785b62dd9c048780daf94%252Fpa%252FSJ67214_15b1127420383cea6242c354841f94ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_15b1127420383cea6242c354841f94ad.jpg not downloaded yet
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_0e7537824b681e1c0ae13ef3e7334bde.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_0e7537824b681e1c0ae13ef3e7334bde.jpg not downloaded yet
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F22%252Ffe22a113e30785b62dd9c048780daf94%252Fpa%252FSJ67214_b4bd13db1584524387f34214b154c0ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_b4bd13db1584524387f34214b154c0ab.jpg not downloaded yet
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_57f54c94bd00ed5fee19b82a2bd28ec7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_57f54c94bd00ed5fee19b82a2bd28ec7.jpg not downloaded yet
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F22%252Ffe22a113e30785b62dd9c048780daf94%252Fpa%252FSJ67214_39219c727c38cd0af179e2cec83e6ad1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_39219c727c38cd0af179e2cec83e6ad1.jpg not downloaded yet
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_3e8bbc2be1f58c51d09c9095e0f7cb50.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_3e8bbc2be1f58c51d09c9095e0f7cb50.jpg not downloaded yet
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F22%252Ffe22a113e30785b62dd9c048780daf94%252Fpa%252FSJ67214_f12b7af474635a2e27a6386662c38f65.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_f12b7af474635a2e27a6386662c38f65.jpg not downloaded yet
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_785b04545c743c55ce33ca4cab4ae7c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_785b04545c743c55ce33ca4cab4ae7c6.jpg not downloaded yet
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F22%252Ffe22a113e30785b62dd9c048780daf94%252Fpa%252FSJ67214_055a48714b8460b924f5859170cfcf1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_055a48714b8460b924f5859170cfcf1a.jpg not downloaded yet
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_9ce5ab791922c3a2eddc5e0e6fdcf8e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_9ce5ab791922c3a2eddc5e0e6fdcf8e3.jpg not downloaded yet
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_17e3f90972d1366aad2e6199d13cdd86.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_17e3f90972d1366aad2e6199d13cdd86.jpg not downloaded yet
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_dacb743248905341f2673fb9ad0f6a95.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_dacb743248905341f2673fb9ad0f6a95.jpg not downloaded yet
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_ca316723304f939518a54c5e5fd632d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_ca316723304f939518a54c5e5fd632d9.jpg not downloaded yet
2026-03-30 10:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_57510cea7ab1b47a832930dc6948c6fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_f8ac4da900c96f3a775e0785be52413b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_87fecb752a39675c6a82881c56b1b68f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_fee353caf9059b680b6d45e0b05caaeb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_d6d914640f25aa8d17acfb930b3e2fb9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_bbee168a245466a2fd91f59c88367d2e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee478950>
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_57510cea7ab1b47a832930dc6948c6fc.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_57510cea7ab1b47a832930dc6948c6fc.jpg saved to cache
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45954182-d13a-5e20-8805-7e1eac0d5db9
2026-03-30 10:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_b6e49829a8df51cb40ab6d403de728bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XJ50079> (referer: https://www.auto1.com/v1/car-details-view/XJ50079/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee92f90>
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_f8ac4da900c96f3a775e0785be52413b.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_f8ac4da900c96f3a775e0785be52413b.jpg saved to cache
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45954182-d13a-5e20-8805-7e1eac0d5db9
2026-03-30 10:47:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef1a90>
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8a%252Fd18a302900a31a8ec1556ee8034a9df7%252Fpa%252FRK06421_87fecb752a39675c6a82881c56b1b68f.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_87fecb752a39675c6a82881c56b1b68f.jpg saved to cache
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45954182-d13a-5e20-8805-7e1eac0d5db9
2026-03-30 10:47:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45954182-d13a-5e20-8805-7e1eac0d5db9, skipping ID generation
2026-03-30 10:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45954182-d13a-5e20-8805-7e1eac0d5db9 with scrape type 1
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45954182-d13a-5e20-8805-7e1eac0d5db9 sending to next pipeline
2026-03-30 10:47:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45954182-d13a-5e20-8805-7e1eac0d5db9, identifier: RK06421
2026-03-30 10:47:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414f150>
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_fee353caf9059b680b6d45e0b05caaeb.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_fee353caf9059b680b6d45e0b05caaeb.jpg saved to cache
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e334f0dc-cebd-5b39-b462-91a427315dc3
2026-03-30 10:47:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef7d090>
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_d6d914640f25aa8d17acfb930b3e2fb9.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_d6d914640f25aa8d17acfb930b3e2fb9.jpg saved to cache
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e334f0dc-cebd-5b39-b462-91a427315dc3
2026-03-30 10:47:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee481f50>
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_bbee168a245466a2fd91f59c88367d2e.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_bbee168a245466a2fd91f59c88367d2e.jpg saved to cache
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e334f0dc-cebd-5b39-b462-91a427315dc3
2026-03-30 10:47:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45954182-d13a-5e20-8805-7e1eac0d5db9 with identifier: RK06421
2026-03-30 10:47:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45954182-d13a-5e20-8805-7e1eac0d5db9 with identifier: RK06421
2026-03-30 10:47:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45954182-d13a-5e20-8805-7e1eac0d5db9 with identifier: RK06421 to the API
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_87fecb752a39675c6a82881c56b1b68f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:24:23Z',
 'fuel_type': 'diesel',
 'id': '45954182-d13a-5e20-8805-7e1eac0d5db9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK06421',
 'listing': 'auction',
 'location': 'DE, München',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 191010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2701338,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_f8ac4da900c96f3a775e0785be52413b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2501144,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_87fecb752a39675c6a82881c56b1b68f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2472948,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_57510cea7ab1b47a832930dc6948c6fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_9f015553506e76f855c22050863e45fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2633080,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_01aac59d2cf0e2bb9c3c17c048e10b4f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2603309,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_bffa668add0c1e8cceed5984d55d7f68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2314375,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_43a692fedd698fb038817e3fb80b8994.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2865352,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_4af51e679ee9c457767bf7b40d376570.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2475657,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_7cbe4ee8a51ff48f547dc7cde429fd3d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45954182-d13a-5e20-8805-7e1eac0d5db9/45954182-d13a-5e20-8805-7e1eac0d5db9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2413474,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/8a/d18a302900a31a8ec1556ee8034a9df7/pa/RK06421_2e33f01c01776675e29b06c395b4a523.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-22',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2016}
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK06421%27 HTTP/1.1" 200 None
2026-03-30 10:47:44 [auto1.de] INFO: Saving data for RK06421: {'created_time': 1774867664.325011, 'last_price_update_time': 1774867664.325022, 'auction_closing_time': 1774970663.0}
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK06421') HTTP/1.1" 204 0
2026-03-30 10:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT43145/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL88930> (referer: https://www.auto1.com/v1/car-details-view/AL88930/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9dfd0>
2026-03-30 10:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F43%252F7343b8e75dd943a4148da05d42c18a0d%252Fpa%252FRL37399_b6e49829a8df51cb40ab6d403de728bd.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_b6e49829a8df51cb40ab6d403de728bd.jpg saved to cache
2026-03-30 10:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e334f0dc-cebd-5b39-b462-91a427315dc3
2026-03-30 10:47:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e334f0dc-cebd-5b39-b462-91a427315dc3, skipping ID generation
2026-03-30 10:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e334f0dc-cebd-5b39-b462-91a427315dc3 with scrape type 1
2026-03-30 10:47:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e334f0dc-cebd-5b39-b462-91a427315dc3 sending to next pipeline
2026-03-30 10:47:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e334f0dc-cebd-5b39-b462-91a427315dc3, identifier: RL37399
2026-03-30 10:47:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f55d67a-2fc9-599a-939a-f9ff26f3f5e6 with identifier: XJ50079
2026-03-30 10:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f55d67a-2fc9-599a-939a-f9ff26f3f5e6 with scrape type 1
2026-03-30 10:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3f55d67a-2fc9-599a-939a-f9ff26f3f5e6
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F23%252F8e2341012f9d0593f1935a83007a8dd9%252Fpa%252FXJ50079_00feca15a600d9b92a5a9c67e3c0e710.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_00feca15a600d9b92a5a9c67e3c0e710.jpg not downloaded yet
2026-03-30 10:47:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e334f0dc-cebd-5b39-b462-91a427315dc3 with identifier: RL37399
2026-03-30 10:47:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e334f0dc-cebd-5b39-b462-91a427315dc3 with identifier: RL37399
2026-03-30 10:47:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e334f0dc-cebd-5b39-b462-91a427315dc3 with identifier: RL37399 to the API
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_b6e49829a8df51cb40ab6d403de728bd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:20:24Z',
 'fuel_type': 'petrol',
 'id': 'e334f0dc-cebd-5b39-b462-91a427315dc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL37399',
 'listing': 'auction',
 'location': 'DE, Düsseldorf',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 35179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2768864,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_b6e49829a8df51cb40ab6d403de728bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2613989,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_d6d914640f25aa8d17acfb930b3e2fb9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2663293,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_bbee168a245466a2fd91f59c88367d2e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2489102,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_fee353caf9059b680b6d45e0b05caaeb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2671680,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_e6232d6d3551e93809d98e9d648e843d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2737200,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_c509c40dbd85ac97c158830ed84e82a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2508742,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_90a4b431c3fc8c142229fd4f48b2e29b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2561972,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_806de901be5db2b6f2c4ab6ffb3c83dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2825199,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_e9725ca4685e376f8b44677245f3cf59.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e334f0dc-cebd-5b39-b462-91a427315dc3/e334f0dc-cebd-5b39-b462-91a427315dc3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2703257,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/43/7343b8e75dd943a4148da05d42c18a0d/pa/RL37399_59a12209240b55908c58e54b0a73f0c7.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL37399%27 HTTP/1.1" 200 None
2026-03-30 10:47:44 [auto1.de] INFO: Saving data for RL37399: {'created_time': 1774867664.939438, 'last_price_update_time': 1774867664.939449, 'auction_closing_time': 1774970424.0}
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL37399') HTTP/1.1" 204 0
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F23%252F8e2341012f9d0593f1935a83007a8dd9%252Fpa%252FXJ50079_c883ec916a981c453a7047cf750f2e03.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_c883ec916a981c453a7047cf750f2e03.jpg not downloaded yet
2026-03-30 10:47:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9461df3-1613-5d31-8fcc-ac3de9c30b9f with identifier: AL88930
2026-03-30 10:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9461df3-1613-5d31-8fcc-ac3de9c30b9f with scrape type 1
2026-03-30 10:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e9461df3-1613-5d31-8fcc-ac3de9c30b9f
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F16%252Fd3161632bd5fc77e42b384f4f98cd7e2%252Fpa%252FAL88930_f17ac9dde32ac7d86f99c85caf1416a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_f17ac9dde32ac7d86f99c85caf1416a9.jpg not downloaded yet
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F23%252F8e2341012f9d0593f1935a83007a8dd9%252Fpa%252FXJ50079_9498ecf7548ce7f762a72193721e5baf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_9498ecf7548ce7f762a72193721e5baf.jpg not downloaded yet
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F16%252Fd3161632bd5fc77e42b384f4f98cd7e2%252Fpa%252FAL88930_6dd4f891ef0515543a5c79fdd9f7b595.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_6dd4f891ef0515543a5c79fdd9f7b595.jpg not downloaded yet
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F23%252F8e2341012f9d0593f1935a83007a8dd9%252Fpa%252FXJ50079_7308e9edd05240036a25bbb11e4d70f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_7308e9edd05240036a25bbb11e4d70f3.jpg not downloaded yet
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F16%252Fd3161632bd5fc77e42b384f4f98cd7e2%252Fpa%252FAL88930_e4351990eb77ad50288fe38bf487821f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_e4351990eb77ad50288fe38bf487821f.jpg not downloaded yet
2026-03-30 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_00feca15a600d9b92a5a9c67e3c0e710.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F23%252F8e2341012f9d0593f1935a83007a8dd9%252Fpa%252FXJ50079_2ada7b17c0f1bce124d57871d25992b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_2ada7b17c0f1bce124d57871d25992b8.jpg not downloaded yet
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F16%252Fd3161632bd5fc77e42b384f4f98cd7e2%252Fpa%252FAL88930_8c23024e30f13c6ecefc7192872f5a1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_8c23024e30f13c6ecefc7192872f5a1c.jpg not downloaded yet
2026-03-30 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_f12b7af474635a2e27a6386662c38f65.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F16%252Fd3161632bd5fc77e42b384f4f98cd7e2%252Fpa%252FAL88930_9eba55af6e0144f5b8651f5fa2099872.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_9eba55af6e0144f5b8651f5fa2099872.jpg not downloaded yet
2026-03-30 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_9ce5ab791922c3a2eddc5e0e6fdcf8e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_17e3f90972d1366aad2e6199d13cdd86.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_dacb743248905341f2673fb9ad0f6a95.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee415350>
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f55d67a-2fc9-599a-939a-f9ff26f3f5e6/3f55d67a-2fc9-599a-939a-f9ff26f3f5e6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F23%252F8e2341012f9d0593f1935a83007a8dd9%252Fpa%252FXJ50079_00feca15a600d9b92a5a9c67e3c0e710.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_00feca15a600d9b92a5a9c67e3c0e710.jpg saved to cache
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f55d67a-2fc9-599a-939a-f9ff26f3f5e6
2026-03-30 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_055a48714b8460b924f5859170cfcf1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_7308e9edd05240036a25bbb11e4d70f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_8c23024e30f13c6ecefc7192872f5a1c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee410d0>
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113d937b-55cc-594b-afaf-208a24dd648f/113d937b-55cc-594b-afaf-208a24dd648f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F22%252Ffe22a113e30785b62dd9c048780daf94%252Fpa%252FSJ67214_f12b7af474635a2e27a6386662c38f65.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_f12b7af474635a2e27a6386662c38f65.jpg saved to cache
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 113d937b-55cc-594b-afaf-208a24dd648f
2026-03-30 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_9eba55af6e0144f5b8651f5fa2099872.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_39219c727c38cd0af179e2cec83e6ad1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_e4351990eb77ad50288fe38bf487821f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_2ada7b17c0f1bce124d57871d25992b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419cfd0>
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_9ce5ab791922c3a2eddc5e0e6fdcf8e3.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_9ce5ab791922c3a2eddc5e0e6fdcf8e3.jpg saved to cache
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434c590>
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_17e3f90972d1366aad2e6199d13cdd86.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_17e3f90972d1366aad2e6199d13cdd86.jpg saved to cache
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29
2026-03-30 10:47:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef511d0>
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_dacb743248905341f2673fb9ad0f6a95.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_dacb743248905341f2673fb9ad0f6a95.jpg saved to cache
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29
2026-03-30 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_6dd4f891ef0515543a5c79fdd9f7b595.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_f17ac9dde32ac7d86f99c85caf1416a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_9498ecf7548ce7f762a72193721e5baf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_c883ec916a981c453a7047cf750f2e03.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3fa310>
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113d937b-55cc-594b-afaf-208a24dd648f/113d937b-55cc-594b-afaf-208a24dd648f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F22%252Ffe22a113e30785b62dd9c048780daf94%252Fpa%252FSJ67214_055a48714b8460b924f5859170cfcf1a.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_055a48714b8460b924f5859170cfcf1a.jpg saved to cache
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 113d937b-55cc-594b-afaf-208a24dd648f
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428ed10>
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f55d67a-2fc9-599a-939a-f9ff26f3f5e6/3f55d67a-2fc9-599a-939a-f9ff26f3f5e6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F23%252F8e2341012f9d0593f1935a83007a8dd9%252Fpa%252FXJ50079_7308e9edd05240036a25bbb11e4d70f3.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_7308e9edd05240036a25bbb11e4d70f3.jpg saved to cache
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f55d67a-2fc9-599a-939a-f9ff26f3f5e6
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee01710>
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9461df3-1613-5d31-8fcc-ac3de9c30b9f/e9461df3-1613-5d31-8fcc-ac3de9c30b9f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F16%252Fd3161632bd5fc77e42b384f4f98cd7e2%252Fpa%252FAL88930_8c23024e30f13c6ecefc7192872f5a1c.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_8c23024e30f13c6ecefc7192872f5a1c.jpg saved to cache
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9461df3-1613-5d31-8fcc-ac3de9c30b9f
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee03450>
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9461df3-1613-5d31-8fcc-ac3de9c30b9f/e9461df3-1613-5d31-8fcc-ac3de9c30b9f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F16%252Fd3161632bd5fc77e42b384f4f98cd7e2%252Fpa%252FAL88930_9eba55af6e0144f5b8651f5fa2099872.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_9eba55af6e0144f5b8651f5fa2099872.jpg saved to cache
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9461df3-1613-5d31-8fcc-ac3de9c30b9f
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb1690>
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113d937b-55cc-594b-afaf-208a24dd648f/113d937b-55cc-594b-afaf-208a24dd648f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F22%252Ffe22a113e30785b62dd9c048780daf94%252Fpa%252FSJ67214_39219c727c38cd0af179e2cec83e6ad1.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_39219c727c38cd0af179e2cec83e6ad1.jpg saved to cache
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 113d937b-55cc-594b-afaf-208a24dd648f
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef84490>
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9461df3-1613-5d31-8fcc-ac3de9c30b9f/e9461df3-1613-5d31-8fcc-ac3de9c30b9f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F16%252Fd3161632bd5fc77e42b384f4f98cd7e2%252Fpa%252FAL88930_e4351990eb77ad50288fe38bf487821f.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_e4351990eb77ad50288fe38bf487821f.jpg saved to cache
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9461df3-1613-5d31-8fcc-ac3de9c30b9f
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428a790>
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f55d67a-2fc9-599a-939a-f9ff26f3f5e6/3f55d67a-2fc9-599a-939a-f9ff26f3f5e6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F23%252F8e2341012f9d0593f1935a83007a8dd9%252Fpa%252FXJ50079_2ada7b17c0f1bce124d57871d25992b8.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_2ada7b17c0f1bce124d57871d25992b8.jpg saved to cache
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f55d67a-2fc9-599a-939a-f9ff26f3f5e6
2026-03-30 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_57f54c94bd00ed5fee19b82a2bd28ec7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_b4bd13db1584524387f34214b154c0ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PN04057/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee417450>
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9461df3-1613-5d31-8fcc-ac3de9c30b9f/e9461df3-1613-5d31-8fcc-ac3de9c30b9f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F16%252Fd3161632bd5fc77e42b384f4f98cd7e2%252Fpa%252FAL88930_6dd4f891ef0515543a5c79fdd9f7b595.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_6dd4f891ef0515543a5c79fdd9f7b595.jpg saved to cache
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9461df3-1613-5d31-8fcc-ac3de9c30b9f
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefa7710>
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9461df3-1613-5d31-8fcc-ac3de9c30b9f/e9461df3-1613-5d31-8fcc-ac3de9c30b9f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F16%252Fd3161632bd5fc77e42b384f4f98cd7e2%252Fpa%252FAL88930_f17ac9dde32ac7d86f99c85caf1416a9.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_f17ac9dde32ac7d86f99c85caf1416a9.jpg saved to cache
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9461df3-1613-5d31-8fcc-ac3de9c30b9f
2026-03-30 10:47:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9461df3-1613-5d31-8fcc-ac3de9c30b9f, skipping ID generation
2026-03-30 10:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9461df3-1613-5d31-8fcc-ac3de9c30b9f with scrape type 1
2026-03-30 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9461df3-1613-5d31-8fcc-ac3de9c30b9f sending to next pipeline
2026-03-30 10:47:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9461df3-1613-5d31-8fcc-ac3de9c30b9f, identifier: AL88930
2026-03-30 10:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4347210>
2026-03-30 10:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f55d67a-2fc9-599a-939a-f9ff26f3f5e6/3f55d67a-2fc9-599a-939a-f9ff26f3f5e6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F23%252F8e2341012f9d0593f1935a83007a8dd9%252Fpa%252FXJ50079_9498ecf7548ce7f762a72193721e5baf.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_9498ecf7548ce7f762a72193721e5baf.jpg saved to cache
2026-03-30 10:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f55d67a-2fc9-599a-939a-f9ff26f3f5e6
2026-03-30 10:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef76190>
2026-03-30 10:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f55d67a-2fc9-599a-939a-f9ff26f3f5e6/3f55d67a-2fc9-599a-939a-f9ff26f3f5e6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F23%252F8e2341012f9d0593f1935a83007a8dd9%252Fpa%252FXJ50079_c883ec916a981c453a7047cf750f2e03.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_c883ec916a981c453a7047cf750f2e03.jpg saved to cache
2026-03-30 10:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f55d67a-2fc9-599a-939a-f9ff26f3f5e6
2026-03-30 10:47:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f55d67a-2fc9-599a-939a-f9ff26f3f5e6, skipping ID generation
2026-03-30 10:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f55d67a-2fc9-599a-939a-f9ff26f3f5e6 with scrape type 1
2026-03-30 10:47:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f55d67a-2fc9-599a-939a-f9ff26f3f5e6 sending to next pipeline
2026-03-30 10:47:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f55d67a-2fc9-599a-939a-f9ff26f3f5e6, identifier: XJ50079
2026-03-30 10:47:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9461df3-1613-5d31-8fcc-ac3de9c30b9f with identifier: AL88930
2026-03-30 10:47:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9461df3-1613-5d31-8fcc-ac3de9c30b9f with identifier: AL88930
2026-03-30 10:47:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9461df3-1613-5d31-8fcc-ac3de9c30b9f with identifier: AL88930 to the API
2026-03-30 10:47:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_f17ac9dde32ac7d86f99c85caf1416a9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:28:47Z',
 'fuel_type': 'diesel',
 'id': 'e9461df3-1613-5d31-8fcc-ac3de9c30b9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL88930',
 'listing': 'auction',
 'location': 'DE, Kamen',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 198842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9461df3-1613-5d31-8fcc-ac3de9c30b9f/e9461df3-1613-5d31-8fcc-ac3de9c30b9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_f17ac9dde32ac7d86f99c85caf1416a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9461df3-1613-5d31-8fcc-ac3de9c30b9f/e9461df3-1613-5d31-8fcc-ac3de9c30b9f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_6dd4f891ef0515543a5c79fdd9f7b595.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9461df3-1613-5d31-8fcc-ac3de9c30b9f/e9461df3-1613-5d31-8fcc-ac3de9c30b9f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_e4351990eb77ad50288fe38bf487821f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9461df3-1613-5d31-8fcc-ac3de9c30b9f/e9461df3-1613-5d31-8fcc-ac3de9c30b9f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_8c23024e30f13c6ecefc7192872f5a1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9461df3-1613-5d31-8fcc-ac3de9c30b9f/e9461df3-1613-5d31-8fcc-ac3de9c30b9f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/16/d3161632bd5fc77e42b384f4f98cd7e2/pa/AL88930_9eba55af6e0144f5b8651f5fa2099872.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-30 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL88930%27 HTTP/1.1" 200 None
2026-03-30 10:47:46 [auto1.de] INFO: Saving data for AL88930: {'created_time': 1774867666.640457, 'last_price_update_time': 1774867666.640468, 'auction_closing_time': 1774970927.0}
2026-03-30 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL88930') HTTP/1.1" 204 0
2026-03-30 10:47:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f55d67a-2fc9-599a-939a-f9ff26f3f5e6 with identifier: XJ50079
2026-03-30 10:47:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f55d67a-2fc9-599a-939a-f9ff26f3f5e6 with identifier: XJ50079
2026-03-30 10:47:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f55d67a-2fc9-599a-939a-f9ff26f3f5e6 with identifier: XJ50079 to the API
2026-03-30 10:47:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_c883ec916a981c453a7047cf750f2e03.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:43:00Z',
 'fuel_type': 'petrol',
 'id': '3f55d67a-2fc9-599a-939a-f9ff26f3f5e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ50079',
 'listing': 'auction',
 'location': 'DE, Kiel',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 105238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f55d67a-2fc9-599a-939a-f9ff26f3f5e6/3f55d67a-2fc9-599a-939a-f9ff26f3f5e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_00feca15a600d9b92a5a9c67e3c0e710.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f55d67a-2fc9-599a-939a-f9ff26f3f5e6/3f55d67a-2fc9-599a-939a-f9ff26f3f5e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_c883ec916a981c453a7047cf750f2e03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f55d67a-2fc9-599a-939a-f9ff26f3f5e6/3f55d67a-2fc9-599a-939a-f9ff26f3f5e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_9498ecf7548ce7f762a72193721e5baf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f55d67a-2fc9-599a-939a-f9ff26f3f5e6/3f55d67a-2fc9-599a-939a-f9ff26f3f5e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_7308e9edd05240036a25bbb11e4d70f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f55d67a-2fc9-599a-939a-f9ff26f3f5e6/3f55d67a-2fc9-599a-939a-f9ff26f3f5e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/23/8e2341012f9d0593f1935a83007a8dd9/pa/XJ50079_2ada7b17c0f1bce124d57871d25992b8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-07-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2006}
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ50079%27 HTTP/1.1" 200 None
2026-03-30 10:47:47 [auto1.de] INFO: Saving data for XJ50079: {'created_time': 1774867667.016285, 'last_price_update_time': 1774867667.016295, 'auction_closing_time': 1774971780.0}
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ50079') HTTP/1.1" 204 0
2026-03-30 10:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_785b04545c743c55ce33ca4cab4ae7c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WZ74602> (referer: https://www.auto1.com/v1/car-details-view/WZ74602/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_15b1127420383cea6242c354841f94ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_0e7537824b681e1c0ae13ef3e7334bde.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT43145> (referer: https://www.auto1.com/v1/car-details-view/VT43145/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee415d90>
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_57f54c94bd00ed5fee19b82a2bd28ec7.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_57f54c94bd00ed5fee19b82a2bd28ec7.jpg saved to cache
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4185d0>
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113d937b-55cc-594b-afaf-208a24dd648f/113d937b-55cc-594b-afaf-208a24dd648f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F22%252Ffe22a113e30785b62dd9c048780daf94%252Fpa%252FSJ67214_b4bd13db1584524387f34214b154c0ab.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_b4bd13db1584524387f34214b154c0ab.jpg saved to cache
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 113d937b-55cc-594b-afaf-208a24dd648f
2026-03-30 10:47:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429ed10>
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_785b04545c743c55ce33ca4cab4ae7c6.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_785b04545c743c55ce33ca4cab4ae7c6.jpg saved to cache
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29
2026-03-30 10:47:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cc7f7d6-23f3-5338-8f2a-0fe515c216e2 with identifier: WZ74602
2026-03-30 10:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cc7f7d6-23f3-5338-8f2a-0fe515c216e2 with scrape type 1
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9cc7f7d6-23f3-5338-8f2a-0fe515c216e2
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F64%252F7a64e71f6289416fe33bf01a76f75712%252Fpa%252FWZ74602_a0d1bf96dbf91446f746ec58c41c7f80.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/64/7a64e71f6289416fe33bf01a76f75712/pa/WZ74602_a0d1bf96dbf91446f746ec58c41c7f80.jpg already downloaded
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F64%252F7a64e71f6289416fe33bf01a76f75712%252Fpa%252FWZ74602_64380601c5e3c28f62353281fad478b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/64/7a64e71f6289416fe33bf01a76f75712/pa/WZ74602_64380601c5e3c28f62353281fad478b5.jpg already downloaded
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F64%252F7a64e71f6289416fe33bf01a76f75712%252Fpa%252FWZ74602_3d2a3abad24332de3b5f2d72e9fd9364.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/64/7a64e71f6289416fe33bf01a76f75712/pa/WZ74602_3d2a3abad24332de3b5f2d72e9fd9364.jpg already downloaded
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F64%252F7a64e71f6289416fe33bf01a76f75712%252Fpa%252FWZ74602_1ceee586f3b8b590b3b1be0adc346f74.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/64/7a64e71f6289416fe33bf01a76f75712/pa/WZ74602_1ceee586f3b8b590b3b1be0adc346f74.jpg already downloaded
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F64%252F7a64e71f6289416fe33bf01a76f75712%252Fpa%252FWZ74602_9ba9c4d0eca03f9b472802e66648d24d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/64/7a64e71f6289416fe33bf01a76f75712/pa/WZ74602_9ba9c4d0eca03f9b472802e66648d24d.jpg already downloaded
2026-03-30 10:47:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9cc7f7d6-23f3-5338-8f2a-0fe515c216e2, identifier: WZ74602
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd4450>
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113d937b-55cc-594b-afaf-208a24dd648f/113d937b-55cc-594b-afaf-208a24dd648f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F22%252Ffe22a113e30785b62dd9c048780daf94%252Fpa%252FSJ67214_15b1127420383cea6242c354841f94ad.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_15b1127420383cea6242c354841f94ad.jpg saved to cache
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 113d937b-55cc-594b-afaf-208a24dd648f
2026-03-30 10:47:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 113d937b-55cc-594b-afaf-208a24dd648f, skipping ID generation
2026-03-30 10:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 113d937b-55cc-594b-afaf-208a24dd648f with scrape type 1
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 113d937b-55cc-594b-afaf-208a24dd648f sending to next pipeline
2026-03-30 10:47:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 113d937b-55cc-594b-afaf-208a24dd648f, identifier: SJ67214
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee95390>
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_0e7537824b681e1c0ae13ef3e7334bde.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_0e7537824b681e1c0ae13ef3e7334bde.jpg saved to cache
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29
2026-03-30 10:47:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 046611e3-b40d-5f98-be4c-f2f24998fc5c with identifier: VT43145
2026-03-30 10:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 046611e3-b40d-5f98-be4c-f2f24998fc5c with scrape type 1
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 046611e3-b40d-5f98-be4c-f2f24998fc5c
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F3d%252Fff3d743d5aa329a6317ff766791aa2bb%252Fpa%252FVT43145_40c5b1b5b744035a3d3f70454680ef27.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/3d/ff3d743d5aa329a6317ff766791aa2bb/pa/VT43145_40c5b1b5b744035a3d3f70454680ef27.jpg already downloaded
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F3d%252Fff3d743d5aa329a6317ff766791aa2bb%252Fpa%252FVT43145_286dcb36c6ab719c8ed60b92953dac0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/3d/ff3d743d5aa329a6317ff766791aa2bb/pa/VT43145_286dcb36c6ab719c8ed60b92953dac0c.jpg already downloaded
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F3d%252Fff3d743d5aa329a6317ff766791aa2bb%252Fpa%252FVT43145_4e44cd66a6340d9433747c5a0ebd5d29.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/3d/ff3d743d5aa329a6317ff766791aa2bb/pa/VT43145_4e44cd66a6340d9433747c5a0ebd5d29.jpg already downloaded
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F3d%252Fff3d743d5aa329a6317ff766791aa2bb%252Fpa%252FVT43145_107f97fc703be0f4ba12bbff2e4dda38.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/3d/ff3d743d5aa329a6317ff766791aa2bb/pa/VT43145_107f97fc703be0f4ba12bbff2e4dda38.jpg already downloaded
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F3d%252Fff3d743d5aa329a6317ff766791aa2bb%252Fpa%252FVT43145_cc6543ba76b4c7df9d2cee39ac49c51c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/3d/ff3d743d5aa329a6317ff766791aa2bb/pa/VT43145_cc6543ba76b4c7df9d2cee39ac49c51c.jpg already downloaded
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F3d%252Fff3d743d5aa329a6317ff766791aa2bb%252Fpa%252FVT43145_39eb6f809c0107334d522038af248aea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/3d/ff3d743d5aa329a6317ff766791aa2bb/pa/VT43145_39eb6f809c0107334d522038af248aea.jpg already downloaded
2026-03-30 10:47:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 046611e3-b40d-5f98-be4c-f2f24998fc5c, identifier: VT43145
2026-03-30 10:47:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9cc7f7d6-23f3-5338-8f2a-0fe515c216e2 with identifier: WZ74602
2026-03-30 10:47:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9cc7f7d6-23f3-5338-8f2a-0fe515c216e2 with identifier: WZ74602
2026-03-30 10:47:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9cc7f7d6-23f3-5338-8f2a-0fe515c216e2 with identifier: WZ74602 to the API
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WZ74602>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:59:19Z',
 'fuel_type': 'petrol',
 'id': '9cc7f7d6-23f3-5338-8f2a-0fe515c216e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ74602',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 135258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img7a/64/7a64e71f6289416fe33bf01a76f75712/pa/WZ74602_a0d1bf96dbf91446f746ec58c41c7f80.jpg',
                'https://img-pa.auto1.com/img7a/64/7a64e71f6289416fe33bf01a76f75712/pa/WZ74602_64380601c5e3c28f62353281fad478b5.jpg',
                'https://img-pa.auto1.com/img7a/64/7a64e71f6289416fe33bf01a76f75712/pa/WZ74602_3d2a3abad24332de3b5f2d72e9fd9364.jpg',
                'https://img-pa.auto1.com/img7a/64/7a64e71f6289416fe33bf01a76f75712/pa/WZ74602_1ceee586f3b8b590b3b1be0adc346f74.jpg',
                'https://img-pa.auto1.com/img7a/64/7a64e71f6289416fe33bf01a76f75712/pa/WZ74602_9ba9c4d0eca03f9b472802e66648d24d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cc7f7d6-23f3-5338-8f2a-0fe515c216e2/9cc7f7d6-23f3-5338-8f2a-0fe515c216e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/64/7a64e71f6289416fe33bf01a76f75712/pa/WZ74602_a0d1bf96dbf91446f746ec58c41c7f80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cc7f7d6-23f3-5338-8f2a-0fe515c216e2/9cc7f7d6-23f3-5338-8f2a-0fe515c216e2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/64/7a64e71f6289416fe33bf01a76f75712/pa/WZ74602_64380601c5e3c28f62353281fad478b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cc7f7d6-23f3-5338-8f2a-0fe515c216e2/9cc7f7d6-23f3-5338-8f2a-0fe515c216e2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/64/7a64e71f6289416fe33bf01a76f75712/pa/WZ74602_3d2a3abad24332de3b5f2d72e9fd9364.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cc7f7d6-23f3-5338-8f2a-0fe515c216e2/9cc7f7d6-23f3-5338-8f2a-0fe515c216e2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/64/7a64e71f6289416fe33bf01a76f75712/pa/WZ74602_1ceee586f3b8b590b3b1be0adc346f74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cc7f7d6-23f3-5338-8f2a-0fe515c216e2/9cc7f7d6-23f3-5338-8f2a-0fe515c216e2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/64/7a64e71f6289416fe33bf01a76f75712/pa/WZ74602_9ba9c4d0eca03f9b472802e66648d24d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2008}
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ74602%27 HTTP/1.1" 200 None
2026-03-30 10:47:48 [auto1.de] INFO: Saving data for WZ74602: {'created_time': 1774867668.289829, 'last_price_update_time': 1774867668.289843, 'auction_closing_time': 1774972759.0}
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ74602') HTTP/1.1" 204 0
2026-03-30 10:47:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 113d937b-55cc-594b-afaf-208a24dd648f with identifier: SJ67214
2026-03-30 10:47:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 113d937b-55cc-594b-afaf-208a24dd648f with identifier: SJ67214
2026-03-30 10:47:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 113d937b-55cc-594b-afaf-208a24dd648f with identifier: SJ67214 to the API
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_15b1127420383cea6242c354841f94ad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:54:22Z',
 'fuel_type': 'petrol',
 'id': '113d937b-55cc-594b-afaf-208a24dd648f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ67214',
 'listing': 'auction',
 'location': 'DE, Neubrandenburg',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 78849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113d937b-55cc-594b-afaf-208a24dd648f/113d937b-55cc-594b-afaf-208a24dd648f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_15b1127420383cea6242c354841f94ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113d937b-55cc-594b-afaf-208a24dd648f/113d937b-55cc-594b-afaf-208a24dd648f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_b4bd13db1584524387f34214b154c0ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113d937b-55cc-594b-afaf-208a24dd648f/113d937b-55cc-594b-afaf-208a24dd648f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_39219c727c38cd0af179e2cec83e6ad1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113d937b-55cc-594b-afaf-208a24dd648f/113d937b-55cc-594b-afaf-208a24dd648f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_f12b7af474635a2e27a6386662c38f65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113d937b-55cc-594b-afaf-208a24dd648f/113d937b-55cc-594b-afaf-208a24dd648f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/22/fe22a113e30785b62dd9c048780daf94/pa/SJ67214_055a48714b8460b924f5859170cfcf1a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Picanto 1.1 Start',
 'transmission': 'manual',
 'trim': 'Start',
 'year': 2009}
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ67214%27 HTTP/1.1" 200 None
2026-03-30 10:47:48 [auto1.de] INFO: Saving data for SJ67214: {'created_time': 1774867668.686819, 'last_price_update_time': 1774867668.686832, 'auction_closing_time': 1774972462.0}
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ67214') HTTP/1.1" 204 0
2026-03-30 10:47:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 046611e3-b40d-5f98-be4c-f2f24998fc5c with identifier: VT43145
2026-03-30 10:47:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 046611e3-b40d-5f98-be4c-f2f24998fc5c with identifier: VT43145
2026-03-30 10:47:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 046611e3-b40d-5f98-be4c-f2f24998fc5c with identifier: VT43145 to the API
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VT43145>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:15:46Z',
 'fuel_type': 'diesel',
 'id': '046611e3-b40d-5f98-be4c-f2f24998fc5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT43145',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 242775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgff/3d/ff3d743d5aa329a6317ff766791aa2bb/pa/VT43145_40c5b1b5b744035a3d3f70454680ef27.jpg',
                'https://img-pa.auto1.com/imgff/3d/ff3d743d5aa329a6317ff766791aa2bb/pa/VT43145_286dcb36c6ab719c8ed60b92953dac0c.jpg',
                'https://img-pa.auto1.com/imgff/3d/ff3d743d5aa329a6317ff766791aa2bb/pa/VT43145_4e44cd66a6340d9433747c5a0ebd5d29.jpg',
                'https://img-pa.auto1.com/imgff/3d/ff3d743d5aa329a6317ff766791aa2bb/pa/VT43145_107f97fc703be0f4ba12bbff2e4dda38.jpg',
                'https://img-pa.auto1.com/imgff/3d/ff3d743d5aa329a6317ff766791aa2bb/pa/VT43145_cc6543ba76b4c7df9d2cee39ac49c51c.jpg',
                'https://img-pa.auto1.com/imgff/3d/ff3d743d5aa329a6317ff766791aa2bb/pa/VT43145_39eb6f809c0107334d522038af248aea.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_046611e3-b40d-5f98-be4c-f2f24998fc5c/046611e3-b40d-5f98-be4c-f2f24998fc5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/3d/ff3d743d5aa329a6317ff766791aa2bb/pa/VT43145_40c5b1b5b744035a3d3f70454680ef27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_046611e3-b40d-5f98-be4c-f2f24998fc5c/046611e3-b40d-5f98-be4c-f2f24998fc5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/3d/ff3d743d5aa329a6317ff766791aa2bb/pa/VT43145_286dcb36c6ab719c8ed60b92953dac0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_046611e3-b40d-5f98-be4c-f2f24998fc5c/046611e3-b40d-5f98-be4c-f2f24998fc5c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/3d/ff3d743d5aa329a6317ff766791aa2bb/pa/VT43145_4e44cd66a6340d9433747c5a0ebd5d29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_046611e3-b40d-5f98-be4c-f2f24998fc5c/046611e3-b40d-5f98-be4c-f2f24998fc5c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/3d/ff3d743d5aa329a6317ff766791aa2bb/pa/VT43145_107f97fc703be0f4ba12bbff2e4dda38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_046611e3-b40d-5f98-be4c-f2f24998fc5c/046611e3-b40d-5f98-be4c-f2f24998fc5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/3d/ff3d743d5aa329a6317ff766791aa2bb/pa/VT43145_cc6543ba76b4c7df9d2cee39ac49c51c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_046611e3-b40d-5f98-be4c-f2f24998fc5c/046611e3-b40d-5f98-be4c-f2f24998fc5c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/3d/ff3d743d5aa329a6317ff766791aa2bb/pa/VT43145_39eb6f809c0107334d522038af248aea.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2011}
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT43145%27 HTTP/1.1" 200 None
2026-03-30 10:47:49 [auto1.de] INFO: Saving data for VT43145: {'created_time': 1774867669.076838, 'last_price_update_time': 1774867669.07685, 'auction_closing_time': 1774970146.0}
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT43145') HTTP/1.1" 204 0
2026-03-30 10:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ56370/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_ca316723304f939518a54c5e5fd632d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_3e8bbc2be1f58c51d09c9095e0f7cb50.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_7c5b49c0764d5aa30da6a02c74544ad4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_8d60502ef270a9bf0c3c5cf05cac684a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_ffd1d49824b7ad8de96ae03aea035f3b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_db9b2d140a34e7a95a19753a6900733e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_fa71d4ace2531d1779da591cbef6a21f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_cf4d0a5e7269deab075f84bc9bb2aa66.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41c7d10>
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_ca316723304f939518a54c5e5fd632d9.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_ca316723304f939518a54c5e5fd632d9.jpg saved to cache
2026-03-30 10:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29
2026-03-30 10:47:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee3f090>
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_3e8bbc2be1f58c51d09c9095e0f7cb50.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_3e8bbc2be1f58c51d09c9095e0f7cb50.jpg saved to cache
2026-03-30 10:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29
2026-03-30 10:47:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee32d10>
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_7c5b49c0764d5aa30da6a02c74544ad4.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_7c5b49c0764d5aa30da6a02c74544ad4.jpg saved to cache
2026-03-30 10:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 800d748f-c8c9-5561-97bb-5a79c63d03c9
2026-03-30 10:47:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41db350>
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_8d60502ef270a9bf0c3c5cf05cac684a.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_8d60502ef270a9bf0c3c5cf05cac684a.jpg saved to cache
2026-03-30 10:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29
2026-03-30 10:47:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee02450>
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F16%252Fc7162d626da6925e032a8894607ca9c5%252Fpa%252FYS78642_ffd1d49824b7ad8de96ae03aea035f3b.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_ffd1d49824b7ad8de96ae03aea035f3b.jpg saved to cache
2026-03-30 10:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29
2026-03-30 10:47:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29, skipping ID generation
2026-03-30 10:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29 with scrape type 1
2026-03-30 10:47:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29 sending to next pipeline
2026-03-30 10:47:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29, identifier: YS78642
2026-03-30 10:47:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428b550>
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_db9b2d140a34e7a95a19753a6900733e.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_db9b2d140a34e7a95a19753a6900733e.jpg saved to cache
2026-03-30 10:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 800d748f-c8c9-5561-97bb-5a79c63d03c9
2026-03-30 10:47:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee32610>
2026-03-30 10:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_fa71d4ace2531d1779da591cbef6a21f.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_fa71d4ace2531d1779da591cbef6a21f.jpg saved to cache
2026-03-30 10:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 800d748f-c8c9-5561-97bb-5a79c63d03c9
2026-03-30 10:47:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb1950>
2026-03-30 10:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_cf4d0a5e7269deab075f84bc9bb2aa66.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_cf4d0a5e7269deab075f84bc9bb2aa66.jpg saved to cache
2026-03-30 10:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 800d748f-c8c9-5561-97bb-5a79c63d03c9
2026-03-30 10:47:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29 with identifier: YS78642
2026-03-30 10:47:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29 with identifier: YS78642
2026-03-30 10:47:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2cef7ff6-0a20-5c99-8d22-f68e0c3abb29 with identifier: YS78642 to the API
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_ffd1d49824b7ad8de96ae03aea035f3b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:54:04Z',
 'fuel_type': 'petrol',
 'id': '2cef7ff6-0a20-5c99-8d22-f68e0c3abb29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS78642',
 'listing': 'auction',
 'location': 'DE, Aurich',
 'make': 'BMW',
 'model': '1er',
 'odometer': 151860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2560119,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_8d60502ef270a9bf0c3c5cf05cac684a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2635511,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_ffd1d49824b7ad8de96ae03aea035f3b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_0e7537824b681e1c0ae13ef3e7334bde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_57f54c94bd00ed5fee19b82a2bd28ec7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2655906,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_3e8bbc2be1f58c51d09c9095e0f7cb50.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2679396,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_785b04545c743c55ce33ca4cab4ae7c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261010,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_9ce5ab791922c3a2eddc5e0e6fdcf8e3.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_17e3f90972d1366aad2e6199d13cdd86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2824272,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_dacb743248905341f2673fb9ad0f6a95.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cef7ff6-0a20-5c99-8d22-f68e0c3abb29/2cef7ff6-0a20-5c99-8d22-f68e0c3abb29_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2970864,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/16/c7162d626da6925e032a8894607ca9c5/pa/YS78642_ca316723304f939518a54c5e5fd632d9.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS78642%27 HTTP/1.1" 200 None
2026-03-30 10:47:50 [auto1.de] INFO: Saving data for YS78642: {'created_time': 1774867670.646517, 'last_price_update_time': 1774867670.646529, 'auction_closing_time': 1774972444.0}
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS78642') HTTP/1.1" 204 0
2026-03-30 10:47:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_1b320f876c4de247a4ce480a42b0f760.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_3234160adfb8bef32b7abc060491a24f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd5310>
2026-03-30 10:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_1b320f876c4de247a4ce480a42b0f760.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_1b320f876c4de247a4ce480a42b0f760.jpg saved to cache
2026-03-30 10:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 800d748f-c8c9-5561-97bb-5a79c63d03c9
2026-03-30 10:47:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4345390>
2026-03-30 10:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F55%252F26557bd0d5724b77147267bdee9490f5%252Fpa%252FAG12776_3234160adfb8bef32b7abc060491a24f.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_3234160adfb8bef32b7abc060491a24f.jpg saved to cache
2026-03-30 10:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 800d748f-c8c9-5561-97bb-5a79c63d03c9
2026-03-30 10:47:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 800d748f-c8c9-5561-97bb-5a79c63d03c9, skipping ID generation
2026-03-30 10:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 800d748f-c8c9-5561-97bb-5a79c63d03c9 with scrape type 1
2026-03-30 10:47:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 800d748f-c8c9-5561-97bb-5a79c63d03c9 sending to next pipeline
2026-03-30 10:47:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 800d748f-c8c9-5561-97bb-5a79c63d03c9, identifier: AG12776
2026-03-30 10:47:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 800d748f-c8c9-5561-97bb-5a79c63d03c9 with identifier: AG12776
2026-03-30 10:47:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 800d748f-c8c9-5561-97bb-5a79c63d03c9 with identifier: AG12776
2026-03-30 10:47:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 800d748f-c8c9-5561-97bb-5a79c63d03c9 with identifier: AG12776 to the API
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_3234160adfb8bef32b7abc060491a24f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 230,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:23:41Z',
 'fuel_type': 'diesel',
 'id': '800d748f-c8c9-5561-97bb-5a79c63d03c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG12776',
 'listing': 'auction',
 'location': 'DE, Lübeck',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse Marco Polo',
 'odometer': 52684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3038573,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_1b320f876c4de247a4ce480a42b0f760.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3025374,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_3234160adfb8bef32b7abc060491a24f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2897217,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_cf4d0a5e7269deab075f84bc9bb2aa66.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2645336,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_fa71d4ace2531d1779da591cbef6a21f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2630459,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_db9b2d140a34e7a95a19753a6900733e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2226731,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_7c5b49c0764d5aa30da6a02c74544ad4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2331119,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_ef3b5f548a5c8c2043b805b189862042.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2339962,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_4042d3c07db61885307ba01d063f3323.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2842225,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_4434151f9678a43f25925468998940f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800d748f-c8c9-5561-97bb-5a79c63d03c9/800d748f-c8c9-5561-97bb-5a79c63d03c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2764209,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/55/26557bd0d5724b77147267bdee9490f5/pa/AG12776_46fbd6ea1a05ac1f7802cc930acaf0e2.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse Marco Polo V 250 d 4Matic EDITION',
 'transmission': 'automatic',
 'trim': '4Matic EDITION',
 'year': 2020}
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG12776%27 HTTP/1.1" 200 None
2026-03-30 10:47:51 [auto1.de] INFO: Saving data for AG12776: {'created_time': 1774867671.605341, 'last_price_update_time': 1774867671.605352, 'auction_closing_time': 1774970621.0}
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG12776') HTTP/1.1" 204 0
2026-03-30 10:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FT47423> (referer: https://www.auto1.com/v1/car-details-view/FT47423/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_98a3fe1a005ea6e608f6b3c92a9311ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_ab52fc36b0dfab53c3083891d670e3ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_0bcae1b5a2d6027aabbc5f72c3aa9360.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d73d6c68-bd68-5d4d-b9de-5f6eedfebae9 with identifier: FT47423
2026-03-30 10:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d73d6c68-bd68-5d4d-b9de-5f6eedfebae9 with scrape type 1
2026-03-30 10:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d73d6c68-bd68-5d4d-b9de-5f6eedfebae9
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_26bd57aa2f870be984efafa90ef1f4b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_26bd57aa2f870be984efafa90ef1f4b9.jpg not downloaded yet
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_1a4c2acc33ed3915c79012ee871553a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_1a4c2acc33ed3915c79012ee871553a3.jpg not downloaded yet
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_5808b0ea2a4b7e8dd4694acfcf5a6df7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_5808b0ea2a4b7e8dd4694acfcf5a6df7.jpg not downloaded yet
2026-03-30 10:47:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41727d0>
2026-03-30 10:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_98a3fe1a005ea6e608f6b3c92a9311ef.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_98a3fe1a005ea6e608f6b3c92a9311ef.jpg saved to cache
2026-03-30 10:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c
2026-03-30 10:47:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef5ed0>
2026-03-30 10:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_ab52fc36b0dfab53c3083891d670e3ed.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_ab52fc36b0dfab53c3083891d670e3ed.jpg saved to cache
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c
2026-03-30 10:47:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a2fd0>
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_0bcae1b5a2d6027aabbc5f72c3aa9360.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_0bcae1b5a2d6027aabbc5f72c3aa9360.jpg saved to cache
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_fc7148a97cfa915d62907a1e784ff6f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_fc7148a97cfa915d62907a1e784ff6f7.jpg not downloaded yet
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_7d453b979dcc58ae72199bf10c78e23f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_7d453b979dcc58ae72199bf10c78e23f.jpg not downloaded yet
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_168d71d699d1ca0a80a38049a817b44c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_168d71d699d1ca0a80a38049a817b44c.jpg not downloaded yet
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_e1e0a91a40896e5fd56cf9eb436985e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_e1e0a91a40896e5fd56cf9eb436985e1.jpg not downloaded yet
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_58a3ea9992cb697577d2e99ad9c3bd4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_58a3ea9992cb697577d2e99ad9c3bd4e.jpg not downloaded yet
2026-03-30 10:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_fc7148a97cfa915d62907a1e784ff6f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_deaf163b4fb451f06d862b07d8f82286.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_deaf163b4fb451f06d862b07d8f82286.jpg not downloaded yet
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_865d34ddaaaad70f6454be6e995f27b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_865d34ddaaaad70f6454be6e995f27b4.jpg not downloaded yet
2026-03-30 10:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_f7766311631c9d82f53f17bd329ffe0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_4817998be3f059ea67f110bb9d016792.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_c20751095febcd2ba40841f12a308d86.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_4e2a12c18675b869761887c21f30adff.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a2590>
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_fc7148a97cfa915d62907a1e784ff6f7.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_fc7148a97cfa915d62907a1e784ff6f7.jpg saved to cache
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d73d6c68-bd68-5d4d-b9de-5f6eedfebae9
2026-03-30 10:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_58a3ea9992cb697577d2e99ad9c3bd4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_865d34ddaaaad70f6454be6e995f27b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43281d0>
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_f7766311631c9d82f53f17bd329ffe0a.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_f7766311631c9d82f53f17bd329ffe0a.jpg saved to cache
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c
2026-03-30 10:47:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414d590>
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_4817998be3f059ea67f110bb9d016792.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_4817998be3f059ea67f110bb9d016792.jpg saved to cache
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c
2026-03-30 10:47:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee62090>
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_c20751095febcd2ba40841f12a308d86.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_c20751095febcd2ba40841f12a308d86.jpg saved to cache
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c
2026-03-30 10:47:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4143550>
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_4e2a12c18675b869761887c21f30adff.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_4e2a12c18675b869761887c21f30adff.jpg saved to cache
2026-03-30 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb7910>
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_58a3ea9992cb697577d2e99ad9c3bd4e.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_58a3ea9992cb697577d2e99ad9c3bd4e.jpg saved to cache
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d73d6c68-bd68-5d4d-b9de-5f6eedfebae9
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9e550>
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_865d34ddaaaad70f6454be6e995f27b4.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_865d34ddaaaad70f6454be6e995f27b4.jpg saved to cache
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d73d6c68-bd68-5d4d-b9de-5f6eedfebae9
2026-03-30 10:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_5808b0ea2a4b7e8dd4694acfcf5a6df7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_e1e0a91a40896e5fd56cf9eb436985e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_168d71d699d1ca0a80a38049a817b44c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_deaf163b4fb451f06d862b07d8f82286.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_7d453b979dcc58ae72199bf10c78e23f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ56370> (referer: https://www.auto1.com/v1/car-details-view/DJ56370/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NU82917/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_26bd57aa2f870be984efafa90ef1f4b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_1a4c2acc33ed3915c79012ee871553a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4228590>
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_5808b0ea2a4b7e8dd4694acfcf5a6df7.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_5808b0ea2a4b7e8dd4694acfcf5a6df7.jpg saved to cache
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d73d6c68-bd68-5d4d-b9de-5f6eedfebae9
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb3050>
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_e1e0a91a40896e5fd56cf9eb436985e1.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_e1e0a91a40896e5fd56cf9eb436985e1.jpg saved to cache
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d73d6c68-bd68-5d4d-b9de-5f6eedfebae9
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd6b90>
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_168d71d699d1ca0a80a38049a817b44c.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_168d71d699d1ca0a80a38049a817b44c.jpg saved to cache
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d73d6c68-bd68-5d4d-b9de-5f6eedfebae9
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41fc150>
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_deaf163b4fb451f06d862b07d8f82286.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_deaf163b4fb451f06d862b07d8f82286.jpg saved to cache
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d73d6c68-bd68-5d4d-b9de-5f6eedfebae9
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f3f90>
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_7d453b979dcc58ae72199bf10c78e23f.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_7d453b979dcc58ae72199bf10c78e23f.jpg saved to cache
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d73d6c68-bd68-5d4d-b9de-5f6eedfebae9
2026-03-30 10:47:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1557fd1a-5585-56dd-99ef-964e9e7107fa with identifier: DJ56370
2026-03-30 10:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1557fd1a-5585-56dd-99ef-964e9e7107fa with scrape type 1
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1557fd1a-5585-56dd-99ef-964e9e7107fa
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_bd32030f0cf64da92ec671d12196812d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_bd32030f0cf64da92ec671d12196812d.jpg not downloaded yet
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41fd450>
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_26bd57aa2f870be984efafa90ef1f4b9.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_26bd57aa2f870be984efafa90ef1f4b9.jpg saved to cache
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d73d6c68-bd68-5d4d-b9de-5f6eedfebae9
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4394450>
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F91%252Fc0917245e038da3c0633700988e56ab8%252Fpa%252FFT47423_1a4c2acc33ed3915c79012ee871553a3.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_1a4c2acc33ed3915c79012ee871553a3.jpg saved to cache
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d73d6c68-bd68-5d4d-b9de-5f6eedfebae9
2026-03-30 10:47:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d73d6c68-bd68-5d4d-b9de-5f6eedfebae9, skipping ID generation
2026-03-30 10:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d73d6c68-bd68-5d4d-b9de-5f6eedfebae9 with scrape type 1
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d73d6c68-bd68-5d4d-b9de-5f6eedfebae9 sending to next pipeline
2026-03-30 10:47:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d73d6c68-bd68-5d4d-b9de-5f6eedfebae9, identifier: FT47423
2026-03-30 10:47:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d73d6c68-bd68-5d4d-b9de-5f6eedfebae9 with identifier: FT47423
2026-03-30 10:47:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d73d6c68-bd68-5d4d-b9de-5f6eedfebae9 with identifier: FT47423
2026-03-30 10:47:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d73d6c68-bd68-5d4d-b9de-5f6eedfebae9 with identifier: FT47423 to the API
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_1a4c2acc33ed3915c79012ee871553a3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 207,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:23:16Z',
 'fuel_type': 'petrol',
 'id': 'd73d6c68-bd68-5d4d-b9de-5f6eedfebae9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT47423',
 'listing': 'auction',
 'location': 'DE, Hannover',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 196993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_26bd57aa2f870be984efafa90ef1f4b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_1a4c2acc33ed3915c79012ee871553a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_5808b0ea2a4b7e8dd4694acfcf5a6df7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_fc7148a97cfa915d62907a1e784ff6f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_7d453b979dcc58ae72199bf10c78e23f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_168d71d699d1ca0a80a38049a817b44c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_e1e0a91a40896e5fd56cf9eb436985e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_58a3ea9992cb697577d2e99ad9c3bd4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_deaf163b4fb451f06d862b07d8f82286.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73d6c68-bd68-5d4d-b9de-5f6eedfebae9/d73d6c68-bd68-5d4d-b9de-5f6eedfebae9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/91/c0917245e038da3c0633700988e56ab8/pa/FT47423_865d34ddaaaad70f6454be6e995f27b4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-01-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Kompressor Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2007}
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT47423%27 HTTP/1.1" 200 None
2026-03-30 10:47:54 [auto1.de] INFO: Saving data for FT47423: {'created_time': 1774867674.155875, 'last_price_update_time': 1774867674.155886, 'auction_closing_time': 1774970596.0}
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT47423') HTTP/1.1" 204 0
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_3d08f351768db6eea29ea991c25a876c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_3d08f351768db6eea29ea991c25a876c.jpg not downloaded yet
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_75f7504e754ddddb543e0b48899ae0a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_75f7504e754ddddb543e0b48899ae0a9.jpg not downloaded yet
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_e1884d684c56c84c195e72a652d1c2a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_e1884d684c56c84c195e72a652d1c2a3.jpg not downloaded yet
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_e52cfa7505ceb0ba6c6d90d233dc410e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_e52cfa7505ceb0ba6c6d90d233dc410e.jpg not downloaded yet
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_d20d5a246b6187603bc1ce88fa2d7bff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_d20d5a246b6187603bc1ce88fa2d7bff.jpg not downloaded yet
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_bd79fa48ae2d9b0005f9b4a991842c1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_bd79fa48ae2d9b0005f9b4a991842c1f.jpg not downloaded yet
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_359924ecb138b4a68348570fa3733714.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_359924ecb138b4a68348570fa3733714.jpg not downloaded yet
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_9bc9bb75451562965c87e59a1b574e23.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_9bc9bb75451562965c87e59a1b574e23.jpg not downloaded yet
2026-03-30 10:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_e42c48fd2f97ae10e6db9d885b178c73.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_532aeb007d446f5a6db2125a26dab73f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_532aeb007d446f5a6db2125a26dab73f.jpg not downloaded yet
2026-03-30 10:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_d70a770101e9452c870e5d37693c306e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeee0790>
2026-03-30 10:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_e42c48fd2f97ae10e6db9d885b178c73.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_e42c48fd2f97ae10e6db9d885b178c73.jpg saved to cache
2026-03-30 10:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c
2026-03-30 10:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_3d08f351768db6eea29ea991c25a876c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414c910>
2026-03-30 10:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F0d%252Ff30d74f587e6734c4eefd26e63304903%252Fpa%252FUM69054_d70a770101e9452c870e5d37693c306e.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_d70a770101e9452c870e5d37693c306e.jpg saved to cache
2026-03-30 10:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c
2026-03-30 10:47:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c, skipping ID generation
2026-03-30 10:47:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c with scrape type 1
2026-03-30 10:47:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c sending to next pipeline
2026-03-30 10:47:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c, identifier: UM69054
2026-03-30 10:47:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c with identifier: UM69054
2026-03-30 10:47:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c with identifier: UM69054
2026-03-30 10:47:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10ef2f52-d65e-5b0f-b44a-f096e7f85f9c with identifier: UM69054 to the API
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_d70a770101e9452c870e5d37693c306e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:23:02Z',
 'fuel_type': 'petrol',
 'id': '10ef2f52-d65e-5b0f-b44a-f096e7f85f9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM69054',
 'listing': 'auction',
 'location': 'DE, Stade',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 29938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2905545,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_e42c48fd2f97ae10e6db9d885b178c73.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2984801,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_d70a770101e9452c870e5d37693c306e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2820015,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_c20751095febcd2ba40841f12a308d86.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2902411,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_4e2a12c18675b869761887c21f30adff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2659309,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_4817998be3f059ea67f110bb9d016792.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2359673,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_f7766311631c9d82f53f17bd329ffe0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2214150,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_ab52fc36b0dfab53c3083891d670e3ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2465457,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_98a3fe1a005ea6e608f6b3c92a9311ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2905309,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_0bcae1b5a2d6027aabbc5f72c3aa9360.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10ef2f52-d65e-5b0f-b44a-f096e7f85f9c/10ef2f52-d65e-5b0f-b44a-f096e7f85f9c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2737689,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/0d/f30d74f587e6734c4eefd26e63304903/pa/UM69054_1c64df7a1155f7a6cbd16e28ce7d8f2b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI VZ',
 'transmission': 'automatic',
 'trim': 'VZ',
 'year': 2022}
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM69054%27 HTTP/1.1" 200 None
2026-03-30 10:47:55 [auto1.de] INFO: Saving data for UM69054: {'created_time': 1774867675.267743, 'last_price_update_time': 1774867675.267756, 'auction_closing_time': 1774970582.0}
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM69054') HTTP/1.1" 204 0
2026-03-30 10:47:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41ff790>
2026-03-30 10:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_3d08f351768db6eea29ea991c25a876c.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_3d08f351768db6eea29ea991c25a876c.jpg saved to cache
2026-03-30 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1557fd1a-5585-56dd-99ef-964e9e7107fa
2026-03-30 10:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA56629/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_bd32030f0cf64da92ec671d12196812d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_359924ecb138b4a68348570fa3733714.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef47950>
2026-03-30 10:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_bd32030f0cf64da92ec671d12196812d.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_bd32030f0cf64da92ec671d12196812d.jpg saved to cache
2026-03-30 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1557fd1a-5585-56dd-99ef-964e9e7107fa
2026-03-30 10:47:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f14035abad0>
2026-03-30 10:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_359924ecb138b4a68348570fa3733714.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_359924ecb138b4a68348570fa3733714.jpg saved to cache
2026-03-30 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1557fd1a-5585-56dd-99ef-964e9e7107fa
2026-03-30 10:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_d20d5a246b6187603bc1ce88fa2d7bff.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_9bc9bb75451562965c87e59a1b574e23.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_bd79fa48ae2d9b0005f9b4a991842c1f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_532aeb007d446f5a6db2125a26dab73f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee479e10>
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_d20d5a246b6187603bc1ce88fa2d7bff.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_d20d5a246b6187603bc1ce88fa2d7bff.jpg saved to cache
2026-03-30 10:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1557fd1a-5585-56dd-99ef-964e9e7107fa
2026-03-30 10:47:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee04c10>
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_9bc9bb75451562965c87e59a1b574e23.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_9bc9bb75451562965c87e59a1b574e23.jpg saved to cache
2026-03-30 10:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1557fd1a-5585-56dd-99ef-964e9e7107fa
2026-03-30 10:47:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429d590>
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_bd79fa48ae2d9b0005f9b4a991842c1f.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_bd79fa48ae2d9b0005f9b4a991842c1f.jpg saved to cache
2026-03-30 10:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1557fd1a-5585-56dd-99ef-964e9e7107fa
2026-03-30 10:47:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefa6b50>
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_532aeb007d446f5a6db2125a26dab73f.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_532aeb007d446f5a6db2125a26dab73f.jpg saved to cache
2026-03-30 10:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1557fd1a-5585-56dd-99ef-964e9e7107fa
2026-03-30 10:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_e52cfa7505ceb0ba6c6d90d233dc410e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4347cd0>
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_e52cfa7505ceb0ba6c6d90d233dc410e.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_e52cfa7505ceb0ba6c6d90d233dc410e.jpg saved to cache
2026-03-30 10:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1557fd1a-5585-56dd-99ef-964e9e7107fa
2026-03-30 10:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_e1884d684c56c84c195e72a652d1c2a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_75f7504e754ddddb543e0b48899ae0a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee820d0>
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_e1884d684c56c84c195e72a652d1c2a3.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_e1884d684c56c84c195e72a652d1c2a3.jpg saved to cache
2026-03-30 10:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1557fd1a-5585-56dd-99ef-964e9e7107fa
2026-03-30 10:47:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee403810>
2026-03-30 10:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fececbaab2402623f187ebf7e6a9c1697%252Fpa%252FDJ56370_75f7504e754ddddb543e0b48899ae0a9.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_75f7504e754ddddb543e0b48899ae0a9.jpg saved to cache
2026-03-30 10:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1557fd1a-5585-56dd-99ef-964e9e7107fa
2026-03-30 10:47:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1557fd1a-5585-56dd-99ef-964e9e7107fa, skipping ID generation
2026-03-30 10:47:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1557fd1a-5585-56dd-99ef-964e9e7107fa with scrape type 1
2026-03-30 10:47:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1557fd1a-5585-56dd-99ef-964e9e7107fa sending to next pipeline
2026-03-30 10:47:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1557fd1a-5585-56dd-99ef-964e9e7107fa, identifier: DJ56370
2026-03-30 10:47:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1557fd1a-5585-56dd-99ef-964e9e7107fa with identifier: DJ56370
2026-03-30 10:47:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1557fd1a-5585-56dd-99ef-964e9e7107fa with identifier: DJ56370
2026-03-30 10:47:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1557fd1a-5585-56dd-99ef-964e9e7107fa with identifier: DJ56370 to the API
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_75f7504e754ddddb543e0b48899ae0a9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '0.7L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:02:26Z',
 'fuel_type': 'petrol',
 'id': '1557fd1a-5585-56dd-99ef-964e9e7107fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ56370',
 'listing': 'auction',
 'location': 'DE, Donaueschingen',
 'make': 'Smart',
 'model': 'Roadster',
 'odometer': 71779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2910786,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_bd32030f0cf64da92ec671d12196812d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2836859,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_3d08f351768db6eea29ea991c25a876c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3002713,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_75f7504e754ddddb543e0b48899ae0a9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2939203,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_e1884d684c56c84c195e72a652d1c2a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2983279,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_e52cfa7505ceb0ba6c6d90d233dc410e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2402704,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_d20d5a246b6187603bc1ce88fa2d7bff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2297976,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_bd79fa48ae2d9b0005f9b4a991842c1f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2268247,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_359924ecb138b4a68348570fa3733714.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2643397,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_9bc9bb75451562965c87e59a1b574e23.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1557fd1a-5585-56dd-99ef-964e9e7107fa/1557fd1a-5585-56dd-99ef-964e9e7107fa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3046585,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ececbaab2402623f187ebf7e6a9c1697/pa/DJ56370_532aeb007d446f5a6db2125a26dab73f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-09-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart Roadster Roadster',
 'transmission': 'automatic',
 'trim': '',
 'year': 2003}
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ56370%27 HTTP/1.1" 200 None
2026-03-30 10:47:57 [auto1.de] INFO: Saving data for DJ56370: {'created_time': 1774867677.582486, 'last_price_update_time': 1774867677.582498, 'auction_closing_time': 1774969346.0}
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ56370') HTTP/1.1" 204 0
2026-03-30 10:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YZ91982/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ61460/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UU82160> (referer: https://www.auto1.com/v1/car-details-view/UU82160/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d855a028-f158-54ec-b7ba-bb874e31d6e2 with identifier: UU82160
2026-03-30 10:48:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d855a028-f158-54ec-b7ba-bb874e31d6e2 with scrape type 1
2026-03-30 10:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d855a028-f158-54ec-b7ba-bb874e31d6e2
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_33ca18f8cc24a0199f5211f09dc3f8bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_33ca18f8cc24a0199f5211f09dc3f8bc.jpg not downloaded yet
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_287609e085d7de14bf418eb7b3d6476c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_287609e085d7de14bf418eb7b3d6476c.jpg not downloaded yet
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_3c9d663d0ea6149a83f70bba804e3e21.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_3c9d663d0ea6149a83f70bba804e3e21.jpg not downloaded yet
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_844b052201f52f0a970aa8c725b365b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_844b052201f52f0a970aa8c725b365b6.jpg not downloaded yet
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_767baa001cc71fb156a1aee97cf79fb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_767baa001cc71fb156a1aee97cf79fb7.jpg not downloaded yet
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_52be9034d84f13fe86af5f3abff7440c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_52be9034d84f13fe86af5f3abff7440c.jpg not downloaded yet
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_5d1f3648b813689bf6df00ba7faa1545.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_5d1f3648b813689bf6df00ba7faa1545.jpg not downloaded yet
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_f1a76dd30bb51a7e5d7f1a28c89e2d7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_f1a76dd30bb51a7e5d7f1a28c89e2d7c.jpg not downloaded yet
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_b6a4b12432075a8a4a87e133de63ea16.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_b6a4b12432075a8a4a87e133de63ea16.jpg not downloaded yet
2026-03-30 10:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_287609e085d7de14bf418eb7b3d6476c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_0ed0f2d35facd1cd22ed30b25b4e5c8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_0ed0f2d35facd1cd22ed30b25b4e5c8e.jpg not downloaded yet
2026-03-30 10:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_33ca18f8cc24a0199f5211f09dc3f8bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_3c9d663d0ea6149a83f70bba804e3e21.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_844b052201f52f0a970aa8c725b365b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_767baa001cc71fb156a1aee97cf79fb7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_5d1f3648b813689bf6df00ba7faa1545.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_52be9034d84f13fe86af5f3abff7440c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee5f310>
2026-03-30 10:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_287609e085d7de14bf418eb7b3d6476c.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_287609e085d7de14bf418eb7b3d6476c.jpg saved to cache
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d855a028-f158-54ec-b7ba-bb874e31d6e2
2026-03-30 10:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_0ed0f2d35facd1cd22ed30b25b4e5c8e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_b6a4b12432075a8a4a87e133de63ea16.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_f1a76dd30bb51a7e5d7f1a28c89e2d7c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeee1890>
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_33ca18f8cc24a0199f5211f09dc3f8bc.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_33ca18f8cc24a0199f5211f09dc3f8bc.jpg saved to cache
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d855a028-f158-54ec-b7ba-bb874e31d6e2
2026-03-30 10:48:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee97a10>
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_3c9d663d0ea6149a83f70bba804e3e21.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_3c9d663d0ea6149a83f70bba804e3e21.jpg saved to cache
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d855a028-f158-54ec-b7ba-bb874e31d6e2
2026-03-30 10:48:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4290dd0>
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_844b052201f52f0a970aa8c725b365b6.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_844b052201f52f0a970aa8c725b365b6.jpg saved to cache
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d855a028-f158-54ec-b7ba-bb874e31d6e2
2026-03-30 10:48:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f413b010>
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_767baa001cc71fb156a1aee97cf79fb7.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_767baa001cc71fb156a1aee97cf79fb7.jpg saved to cache
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d855a028-f158-54ec-b7ba-bb874e31d6e2
2026-03-30 10:48:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41c5890>
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_5d1f3648b813689bf6df00ba7faa1545.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_5d1f3648b813689bf6df00ba7faa1545.jpg saved to cache
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d855a028-f158-54ec-b7ba-bb874e31d6e2
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417f0d0>
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_52be9034d84f13fe86af5f3abff7440c.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_52be9034d84f13fe86af5f3abff7440c.jpg saved to cache
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d855a028-f158-54ec-b7ba-bb874e31d6e2
2026-03-30 10:48:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee491050>
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_0ed0f2d35facd1cd22ed30b25b4e5c8e.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_0ed0f2d35facd1cd22ed30b25b4e5c8e.jpg saved to cache
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d855a028-f158-54ec-b7ba-bb874e31d6e2
2026-03-30 10:48:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4174490>
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_b6a4b12432075a8a4a87e133de63ea16.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_b6a4b12432075a8a4a87e133de63ea16.jpg saved to cache
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d855a028-f158-54ec-b7ba-bb874e31d6e2
2026-03-30 10:48:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f480a710>
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Faa%252Fc6aa7c8f8f463a8d40228d8a95b19308%252Fpa%252FUU82160_f1a76dd30bb51a7e5d7f1a28c89e2d7c.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_f1a76dd30bb51a7e5d7f1a28c89e2d7c.jpg saved to cache
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d855a028-f158-54ec-b7ba-bb874e31d6e2
2026-03-30 10:48:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d855a028-f158-54ec-b7ba-bb874e31d6e2, skipping ID generation
2026-03-30 10:48:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d855a028-f158-54ec-b7ba-bb874e31d6e2 with scrape type 1
2026-03-30 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d855a028-f158-54ec-b7ba-bb874e31d6e2 sending to next pipeline
2026-03-30 10:48:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d855a028-f158-54ec-b7ba-bb874e31d6e2, identifier: UU82160
2026-03-30 10:48:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d855a028-f158-54ec-b7ba-bb874e31d6e2 with identifier: UU82160
2026-03-30 10:48:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d855a028-f158-54ec-b7ba-bb874e31d6e2 with identifier: UU82160
2026-03-30 10:48:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d855a028-f158-54ec-b7ba-bb874e31d6e2 with identifier: UU82160 to the API
2026-03-30 10:48:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_f1a76dd30bb51a7e5d7f1a28c89e2d7c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:11:13Z',
 'fuel_type': 'diesel',
 'id': 'd855a028-f158-54ec-b7ba-bb874e31d6e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU82160',
 'listing': 'auction',
 'location': 'DE, Sulzbach-Rosenberg',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 267650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378177,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_33ca18f8cc24a0199f5211f09dc3f8bc.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384578,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_287609e085d7de14bf418eb7b3d6476c.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346022,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_3c9d663d0ea6149a83f70bba804e3e21.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300854,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_844b052201f52f0a970aa8c725b365b6.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383419,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_767baa001cc71fb156a1aee97cf79fb7.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_52be9034d84f13fe86af5f3abff7440c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314129,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_5d1f3648b813689bf6df00ba7faa1545.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380460,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_f1a76dd30bb51a7e5d7f1a28c89e2d7c.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375387,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_b6a4b12432075a8a4a87e133de63ea16.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d855a028-f158-54ec-b7ba-bb874e31d6e2/d855a028-f158-54ec-b7ba-bb874e31d6e2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367599,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa7c8f8f463a8d40228d8a95b19308/pa/UU82160_0ed0f2d35facd1cd22ed30b25b4e5c8e.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2015}
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU82160%27 HTTP/1.1" 200 None
2026-03-30 10:48:04 [auto1.de] INFO: Saving data for UU82160: {'created_time': 1774867684.266792, 'last_price_update_time': 1774867684.266802, 'auction_closing_time': 1774969873.0}
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UU82160') HTTP/1.1" 204 0
2026-03-30 10:48:04 [scrapy.extensions.logstats] INFO: Crawled 638 pages (at 40 pages/min), scraped 459 items (at 25 items/min)
2026-03-30 10:48:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NU82917> (referer: https://www.auto1.com/v1/car-details-view/NU82917/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d646d82-ff72-5736-b9c0-1f1a1db30c26 with identifier: NU82917
2026-03-30 10:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d646d82-ff72-5736-b9c0-1f1a1db30c26 with scrape type 1
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d646d82-ff72-5736-b9c0-1f1a1db30c26
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_1c3ca2767a3dbd3c22335d7bc0acaf12.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_1c3ca2767a3dbd3c22335d7bc0acaf12.jpg not downloaded yet
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_6238853ff28b1c261cee687838905d27.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_6238853ff28b1c261cee687838905d27.jpg not downloaded yet
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_f5b3e1e65e16f5e5d12e36daf9a60c1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_f5b3e1e65e16f5e5d12e36daf9a60c1c.jpg not downloaded yet
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_deb75822f0ca89200a4ad20af7182628.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_deb75822f0ca89200a4ad20af7182628.jpg not downloaded yet
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_5007324a0bc0abcd8b672a185e6f245b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_5007324a0bc0abcd8b672a185e6f245b.jpg not downloaded yet
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_91c43b752decf0230da9be3e79d31b9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_91c43b752decf0230da9be3e79d31b9d.jpg not downloaded yet
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_d3d50f2804062e5d187f77e9eef3c0b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_d3d50f2804062e5d187f77e9eef3c0b3.jpg not downloaded yet
2026-03-30 10:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_6238853ff28b1c261cee687838905d27.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_3e676b6ba2cdaf4949d1538f31375622.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_3e676b6ba2cdaf4949d1538f31375622.jpg not downloaded yet
2026-03-30 10:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_1c3ca2767a3dbd3c22335d7bc0acaf12.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_f7910406062b690f0cd469de5a4aa09f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_f7910406062b690f0cd469de5a4aa09f.jpg not downloaded yet
2026-03-30 10:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_f5b3e1e65e16f5e5d12e36daf9a60c1c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_2b31bc8d8a03aef325f65197d87b42e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_2b31bc8d8a03aef325f65197d87b42e1.jpg not downloaded yet
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4195a10>
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_6238853ff28b1c261cee687838905d27.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_6238853ff28b1c261cee687838905d27.jpg saved to cache
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d646d82-ff72-5736-b9c0-1f1a1db30c26
2026-03-30 10:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_deb75822f0ca89200a4ad20af7182628.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_3e676b6ba2cdaf4949d1538f31375622.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_f7910406062b690f0cd469de5a4aa09f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4196e90>
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_1c3ca2767a3dbd3c22335d7bc0acaf12.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_1c3ca2767a3dbd3c22335d7bc0acaf12.jpg saved to cache
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d646d82-ff72-5736-b9c0-1f1a1db30c26
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeed2bd0>
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_f5b3e1e65e16f5e5d12e36daf9a60c1c.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_f5b3e1e65e16f5e5d12e36daf9a60c1c.jpg saved to cache
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d646d82-ff72-5736-b9c0-1f1a1db30c26
2026-03-30 10:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_2b31bc8d8a03aef325f65197d87b42e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_91c43b752decf0230da9be3e79d31b9d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_5007324a0bc0abcd8b672a185e6f245b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_d3d50f2804062e5d187f77e9eef3c0b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee482210>
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_deb75822f0ca89200a4ad20af7182628.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_deb75822f0ca89200a4ad20af7182628.jpg saved to cache
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d646d82-ff72-5736-b9c0-1f1a1db30c26
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4827d0>
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_3e676b6ba2cdaf4949d1538f31375622.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_3e676b6ba2cdaf4949d1538f31375622.jpg saved to cache
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d646d82-ff72-5736-b9c0-1f1a1db30c26
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef0c5d0>
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_f7910406062b690f0cd469de5a4aa09f.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_f7910406062b690f0cd469de5a4aa09f.jpg saved to cache
2026-03-30 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6d646d82-ff72-5736-b9c0-1f1a1db30c26
2026-03-30 10:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45ddd0>
2026-03-30 10:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_2b31bc8d8a03aef325f65197d87b42e1.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_2b31bc8d8a03aef325f65197d87b42e1.jpg saved to cache
2026-03-30 10:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6d646d82-ff72-5736-b9c0-1f1a1db30c26
2026-03-30 10:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d6dd0>
2026-03-30 10:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_91c43b752decf0230da9be3e79d31b9d.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_91c43b752decf0230da9be3e79d31b9d.jpg saved to cache
2026-03-30 10:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d646d82-ff72-5736-b9c0-1f1a1db30c26
2026-03-30 10:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef76ad0>
2026-03-30 10:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_5007324a0bc0abcd8b672a185e6f245b.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_5007324a0bc0abcd8b672a185e6f245b.jpg saved to cache
2026-03-30 10:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d646d82-ff72-5736-b9c0-1f1a1db30c26
2026-03-30 10:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef77c50>
2026-03-30 10:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fe3%252F9be3485b337055e9d4aa26d25905c831%252Fpa%252FNU82917_d3d50f2804062e5d187f77e9eef3c0b3.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_d3d50f2804062e5d187f77e9eef3c0b3.jpg saved to cache
2026-03-30 10:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d646d82-ff72-5736-b9c0-1f1a1db30c26
2026-03-30 10:48:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d646d82-ff72-5736-b9c0-1f1a1db30c26, skipping ID generation
2026-03-30 10:48:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d646d82-ff72-5736-b9c0-1f1a1db30c26 with scrape type 1
2026-03-30 10:48:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d646d82-ff72-5736-b9c0-1f1a1db30c26 sending to next pipeline
2026-03-30 10:48:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d646d82-ff72-5736-b9c0-1f1a1db30c26, identifier: NU82917
2026-03-30 10:48:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d646d82-ff72-5736-b9c0-1f1a1db30c26 with identifier: NU82917
2026-03-30 10:48:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d646d82-ff72-5736-b9c0-1f1a1db30c26 with identifier: NU82917
2026-03-30 10:48:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d646d82-ff72-5736-b9c0-1f1a1db30c26 with identifier: NU82917 to the API
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_d3d50f2804062e5d187f77e9eef3c0b3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:17:32Z',
 'fuel_type': 'petrol',
 'id': '6d646d82-ff72-5736-b9c0-1f1a1db30c26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU82917',
 'listing': 'auction',
 'location': 'DE, Hagen',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 49112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_1c3ca2767a3dbd3c22335d7bc0acaf12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_6238853ff28b1c261cee687838905d27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_f5b3e1e65e16f5e5d12e36daf9a60c1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_deb75822f0ca89200a4ad20af7182628.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_5007324a0bc0abcd8b672a185e6f245b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_91c43b752decf0230da9be3e79d31b9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_d3d50f2804062e5d187f77e9eef3c0b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_3e676b6ba2cdaf4949d1538f31375622.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_f7910406062b690f0cd469de5a4aa09f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d646d82-ff72-5736-b9c0-1f1a1db30c26/6d646d82-ff72-5736-b9c0-1f1a1db30c26_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/e3/9be3485b337055e9d4aa26d25905c831/pa/NU82917_2b31bc8d8a03aef325f65197d87b42e1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS Line',
 'transmission': 'manual',
 'trim': 'GS Line',
 'year': 2021}
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU82917%27 HTTP/1.1" 200 None
2026-03-30 10:48:05 [auto1.de] INFO: Saving data for NU82917: {'created_time': 1774867685.800889, 'last_price_update_time': 1774867685.800899, 'auction_closing_time': 1774970252.0}
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU82917') HTTP/1.1" 204 0
2026-03-30 10:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA56629> (referer: https://www.auto1.com/v1/car-details-view/WA56629/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 982f4693-a787-58cc-b9c7-b81347f4c177 with identifier: WA56629
2026-03-30 10:48:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 982f4693-a787-58cc-b9c7-b81347f4c177 with scrape type 1
2026-03-30 10:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 982f4693-a787-58cc-b9c7-b81347f4c177
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F48%252Fdc4872202c62a927887352f08b70a1c1%252Fpa%252FWA56629_e4486c52c333444e393c1c24924cad5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_e4486c52c333444e393c1c24924cad5d.jpg not downloaded yet
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F48%252Fdc4872202c62a927887352f08b70a1c1%252Fpa%252FWA56629_dcb7fe79b8ade9227162dcd8692ae5af.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_dcb7fe79b8ade9227162dcd8692ae5af.jpg already downloaded
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F48%252Fdc4872202c62a927887352f08b70a1c1%252Fpa%252FWA56629_2945d2e56473713c4f44900fe9bf5829.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_2945d2e56473713c4f44900fe9bf5829.jpg not downloaded yet
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F48%252Fdc4872202c62a927887352f08b70a1c1%252Fpa%252FWA56629_9d3756659699dfd6fbd00bc987c5e5d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_9d3756659699dfd6fbd00bc987c5e5d8.jpg not downloaded yet
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F48%252Fdc4872202c62a927887352f08b70a1c1%252Fpa%252FWA56629_d0ed10607bb45655b303084ef3c0d97e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_d0ed10607bb45655b303084ef3c0d97e.jpg already downloaded
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F48%252Fdc4872202c62a927887352f08b70a1c1%252Fpa%252FWA56629_9a115f10c5eeec290556d4755c0e607d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_9a115f10c5eeec290556d4755c0e607d.jpg not downloaded yet
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F48%252Fdc4872202c62a927887352f08b70a1c1%252Fpa%252FWA56629_483bfeacf8220a78f20ffa61ee3b0b78.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_483bfeacf8220a78f20ffa61ee3b0b78.jpg not downloaded yet
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F48%252Fdc4872202c62a927887352f08b70a1c1%252Fpa%252FWA56629_370238c55fb72ddb6ca6e14b1371c99b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_370238c55fb72ddb6ca6e14b1371c99b.jpg not downloaded yet
2026-03-30 10:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_e4486c52c333444e393c1c24924cad5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F48%252Fdc4872202c62a927887352f08b70a1c1%252Fpa%252FWA56629_08a9e6b9f85a319ed87e0982d6bfc67f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_08a9e6b9f85a319ed87e0982d6bfc67f.jpg not downloaded yet
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F48%252Fdc4872202c62a927887352f08b70a1c1%252Fpa%252FWA56629_ba3c7ed097df2aa136492fdd595d74f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_ba3c7ed097df2aa136492fdd595d74f0.jpg not downloaded yet
2026-03-30 10:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_2945d2e56473713c4f44900fe9bf5829.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee60d10>
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_982f4693-a787-58cc-b9c7-b81347f4c177/982f4693-a787-58cc-b9c7-b81347f4c177_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F48%252Fdc4872202c62a927887352f08b70a1c1%252Fpa%252FWA56629_e4486c52c333444e393c1c24924cad5d.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_e4486c52c333444e393c1c24924cad5d.jpg saved to cache
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 982f4693-a787-58cc-b9c7-b81347f4c177
2026-03-30 10:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_9a115f10c5eeec290556d4755c0e607d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_9d3756659699dfd6fbd00bc987c5e5d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_370238c55fb72ddb6ca6e14b1371c99b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8ef10>
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_982f4693-a787-58cc-b9c7-b81347f4c177/982f4693-a787-58cc-b9c7-b81347f4c177_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F48%252Fdc4872202c62a927887352f08b70a1c1%252Fpa%252FWA56629_2945d2e56473713c4f44900fe9bf5829.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_2945d2e56473713c4f44900fe9bf5829.jpg saved to cache
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 982f4693-a787-58cc-b9c7-b81347f4c177
2026-03-30 10:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_483bfeacf8220a78f20ffa61ee3b0b78.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_08a9e6b9f85a319ed87e0982d6bfc67f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_ba3c7ed097df2aa136492fdd595d74f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417f610>
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_982f4693-a787-58cc-b9c7-b81347f4c177/982f4693-a787-58cc-b9c7-b81347f4c177_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F48%252Fdc4872202c62a927887352f08b70a1c1%252Fpa%252FWA56629_9a115f10c5eeec290556d4755c0e607d.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_9a115f10c5eeec290556d4755c0e607d.jpg saved to cache
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 982f4693-a787-58cc-b9c7-b81347f4c177
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeed4d0>
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_982f4693-a787-58cc-b9c7-b81347f4c177/982f4693-a787-58cc-b9c7-b81347f4c177_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F48%252Fdc4872202c62a927887352f08b70a1c1%252Fpa%252FWA56629_9d3756659699dfd6fbd00bc987c5e5d8.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_9d3756659699dfd6fbd00bc987c5e5d8.jpg saved to cache
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 982f4693-a787-58cc-b9c7-b81347f4c177
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8fa50>
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_982f4693-a787-58cc-b9c7-b81347f4c177/982f4693-a787-58cc-b9c7-b81347f4c177_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F48%252Fdc4872202c62a927887352f08b70a1c1%252Fpa%252FWA56629_370238c55fb72ddb6ca6e14b1371c99b.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_370238c55fb72ddb6ca6e14b1371c99b.jpg saved to cache
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 982f4693-a787-58cc-b9c7-b81347f4c177
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4187250>
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_982f4693-a787-58cc-b9c7-b81347f4c177/982f4693-a787-58cc-b9c7-b81347f4c177_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F48%252Fdc4872202c62a927887352f08b70a1c1%252Fpa%252FWA56629_483bfeacf8220a78f20ffa61ee3b0b78.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_483bfeacf8220a78f20ffa61ee3b0b78.jpg saved to cache
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 982f4693-a787-58cc-b9c7-b81347f4c177
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee86cd0>
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_982f4693-a787-58cc-b9c7-b81347f4c177/982f4693-a787-58cc-b9c7-b81347f4c177_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F48%252Fdc4872202c62a927887352f08b70a1c1%252Fpa%252FWA56629_08a9e6b9f85a319ed87e0982d6bfc67f.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_08a9e6b9f85a319ed87e0982d6bfc67f.jpg saved to cache
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 982f4693-a787-58cc-b9c7-b81347f4c177
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb4550>
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_982f4693-a787-58cc-b9c7-b81347f4c177/982f4693-a787-58cc-b9c7-b81347f4c177_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F48%252Fdc4872202c62a927887352f08b70a1c1%252Fpa%252FWA56629_ba3c7ed097df2aa136492fdd595d74f0.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_ba3c7ed097df2aa136492fdd595d74f0.jpg saved to cache
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 982f4693-a787-58cc-b9c7-b81347f4c177
2026-03-30 10:48:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 982f4693-a787-58cc-b9c7-b81347f4c177, skipping ID generation
2026-03-30 10:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 982f4693-a787-58cc-b9c7-b81347f4c177 with scrape type 1
2026-03-30 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 982f4693-a787-58cc-b9c7-b81347f4c177 sending to next pipeline
2026-03-30 10:48:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 982f4693-a787-58cc-b9c7-b81347f4c177, identifier: WA56629
2026-03-30 10:48:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 982f4693-a787-58cc-b9c7-b81347f4c177 with identifier: WA56629
2026-03-30 10:48:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 982f4693-a787-58cc-b9c7-b81347f4c177 with identifier: WA56629
2026-03-30 10:48:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 982f4693-a787-58cc-b9c7-b81347f4c177 with identifier: WA56629 to the API
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_ba3c7ed097df2aa136492fdd595d74f0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:17:05Z',
 'fuel_type': 'petrol',
 'id': '982f4693-a787-58cc-b9c7-b81347f4c177',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA56629',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 140623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982f4693-a787-58cc-b9c7-b81347f4c177/982f4693-a787-58cc-b9c7-b81347f4c177_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_e4486c52c333444e393c1c24924cad5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982f4693-a787-58cc-b9c7-b81347f4c177/982f4693-a787-58cc-b9c7-b81347f4c177_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_dcb7fe79b8ade9227162dcd8692ae5af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982f4693-a787-58cc-b9c7-b81347f4c177/982f4693-a787-58cc-b9c7-b81347f4c177_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_2945d2e56473713c4f44900fe9bf5829.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982f4693-a787-58cc-b9c7-b81347f4c177/982f4693-a787-58cc-b9c7-b81347f4c177_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_9d3756659699dfd6fbd00bc987c5e5d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982f4693-a787-58cc-b9c7-b81347f4c177/982f4693-a787-58cc-b9c7-b81347f4c177_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_d0ed10607bb45655b303084ef3c0d97e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982f4693-a787-58cc-b9c7-b81347f4c177/982f4693-a787-58cc-b9c7-b81347f4c177_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_9a115f10c5eeec290556d4755c0e607d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982f4693-a787-58cc-b9c7-b81347f4c177/982f4693-a787-58cc-b9c7-b81347f4c177_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_483bfeacf8220a78f20ffa61ee3b0b78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982f4693-a787-58cc-b9c7-b81347f4c177/982f4693-a787-58cc-b9c7-b81347f4c177_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_370238c55fb72ddb6ca6e14b1371c99b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982f4693-a787-58cc-b9c7-b81347f4c177/982f4693-a787-58cc-b9c7-b81347f4c177_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_08a9e6b9f85a319ed87e0982d6bfc67f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982f4693-a787-58cc-b9c7-b81347f4c177/982f4693-a787-58cc-b9c7-b81347f4c177_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/48/dc4872202c62a927887352f08b70a1c1/pa/WA56629_ba3c7ed097df2aa136492fdd595d74f0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-01-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A1 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-30 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA56629%27 HTTP/1.1" 200 None
2026-03-30 10:48:07 [auto1.de] INFO: Saving data for WA56629: {'created_time': 1774867687.046894, 'last_price_update_time': 1774867687.046904, 'auction_closing_time': 1774970225.0}
2026-03-30 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA56629') HTTP/1.1" 204 0
2026-03-30 10:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VL87987/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YZ91982> (referer: https://www.auto1.com/v1/car-details-view/YZ91982/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:07 [auto1.de] INFO: Channel: 24h | Page: 27 | totalHits: 9488 | hits on page: 40
2026-03-30 10:48:07 [auto1.de] INFO: Found listing with ID: YX18346
2026-03-30 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX18346%27 HTTP/1.1" 200 None
2026-03-30 10:48:07 [auto1.de] INFO: Scrape type for YX18346: 0
2026-03-30 10:48:07 [auto1.de] INFO: Found listing with ID: WZ74602
2026-03-30 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ74602%27 HTTP/1.1" 200 None
2026-03-30 10:48:07 [auto1.de] INFO: Scrape type for WZ74602: 0
2026-03-30 10:48:07 [auto1.de] INFO: Found listing with ID: XA87570
2026-03-30 10:48:07 [auto1.de] INFO: Found listing with ID: VT43145
2026-03-30 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT43145%27 HTTP/1.1" 200 None
2026-03-30 10:48:07 [auto1.de] INFO: Scrape type for VT43145: 0
2026-03-30 10:48:07 [auto1.de] INFO: Found listing with ID: GF38956
2026-03-30 10:48:07 [auto1.de] INFO: Found listing with ID: AL88930
2026-03-30 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL88930%27 HTTP/1.1" 200 None
2026-03-30 10:48:07 [auto1.de] INFO: Scrape type for AL88930: 0
2026-03-30 10:48:07 [auto1.de] INFO: Found listing with ID: VS83958
2026-03-30 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS83958%27 HTTP/1.1" 200 None
2026-03-30 10:48:07 [auto1.de] INFO: Scrape type for VS83958: 0
2026-03-30 10:48:07 [auto1.de] INFO: Found listing with ID: FF76143
2026-03-30 10:48:07 [auto1.de] INFO: Found listing with ID: YG75934
2026-03-30 10:48:07 [auto1.de] INFO: Found listing with ID: TL58821
2026-03-30 10:48:07 [auto1.de] INFO: Found listing with ID: SG04043
2026-03-30 10:48:07 [auto1.de] INFO: Found listing with ID: HU65226
2026-03-30 10:48:07 [auto1.de] INFO: Found listing with ID: WS10443
2026-03-30 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS10443%27 HTTP/1.1" 200 None
2026-03-30 10:48:07 [auto1.de] INFO: Scrape type for WS10443: 2
2026-03-30 10:48:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d76a4d8-8e26-5f24-b143-533a6ab5f74f with identifier: WS10443
2026-03-30 10:48:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d76a4d8-8e26-5f24-b143-533a6ab5f74f with scrape type 2
2026-03-30 10:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d76a4d8-8e26-5f24-b143-533a6ab5f74f with scrape type 2
2026-03-30 10:48:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d76a4d8-8e26-5f24-b143-533a6ab5f74f, identifier: WS10443
2026-03-30 10:48:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d76a4d8-8e26-5f24-b143-533a6ab5f74f with identifier: WS10443
2026-03-30 10:48:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d76a4d8-8e26-5f24-b143-533a6ab5f74f with identifier: WS10443
2026-03-30 10:48:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d76a4d8-8e26-5f24-b143-533a6ab5f74f with identifier: WS10443 to the API
2026-03-30 10:48:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:00:10Z',
 'fuel_type': 'petrol',
 'id': '0d76a4d8-8e26-5f24-b143-533a6ab5f74f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS10443',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 41661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-13',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake Mild-Hybrid AMG '
          'Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS10443%27 HTTP/1.1" 200 None
2026-03-30 10:48:08 [auto1.de] INFO: Saving data for WS10443: {'auction_closing_time': 1774969210.0, 'created_time': 1773776260.082388, 'last_price_update_time': 1774867688.167764}
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS10443') HTTP/1.1" 204 0
2026-03-30 10:48:08 [auto1.de] INFO: Found listing with ID: WP98376
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP98376%27 HTTP/1.1" 200 None
2026-03-30 10:48:08 [auto1.de] INFO: Scrape type for WP98376: 1
2026-03-30 10:48:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c32f88a1-1f01-5add-84b8-2d484eafdcf7 with identifier: YZ91982
2026-03-30 10:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32f88a1-1f01-5add-84b8-2d484eafdcf7 with scrape type 1
2026-03-30 10:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c32f88a1-1f01-5add-84b8-2d484eafdcf7
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_f1336b8e226de7935dbb550f72b246fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_f1336b8e226de7935dbb550f72b246fe.jpg not downloaded yet
2026-03-30 10:48:08 [auto1.de] INFO: Found listing with ID: JV19654
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV19654%27 HTTP/1.1" 200 None
2026-03-30 10:48:08 [auto1.de] INFO: Scrape type for JV19654: 1
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_ff70ce9f804bce79a595d7cd0b77d0e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_ff70ce9f804bce79a595d7cd0b77d0e2.jpg not downloaded yet
2026-03-30 10:48:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:08 [auto1.de] INFO: Found listing with ID: SN93122
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN93122%27 HTTP/1.1" 200 None
2026-03-30 10:48:08 [auto1.de] INFO: Scrape type for SN93122: 2
2026-03-30 10:48:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff6d0a74-ab2d-5982-9636-0da360c76341 with identifier: SN93122
2026-03-30 10:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff6d0a74-ab2d-5982-9636-0da360c76341 with scrape type 2
2026-03-30 10:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff6d0a74-ab2d-5982-9636-0da360c76341 with scrape type 2
2026-03-30 10:48:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff6d0a74-ab2d-5982-9636-0da360c76341, identifier: SN93122
2026-03-30 10:48:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff6d0a74-ab2d-5982-9636-0da360c76341 with identifier: SN93122
2026-03-30 10:48:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff6d0a74-ab2d-5982-9636-0da360c76341 with identifier: SN93122
2026-03-30 10:48:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff6d0a74-ab2d-5982-9636-0da360c76341 with identifier: SN93122 to the API
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-31T15:23:23Z',
 'fuel_type': 'petrol',
 'id': 'ff6d0a74-ab2d-5982-9636-0da360c76341',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN93122',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 103148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-14',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2017}
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN93122%27 HTTP/1.1" 200 None
2026-03-30 10:48:08 [auto1.de] INFO: Saving data for SN93122: {'auction_closing_time': 1774970603.0, 'created_time': 1773686340.688915, 'last_price_update_time': 1774867688.876063}
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN93122') HTTP/1.1" 204 0
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_5e677666c9ff597df1b1f2b97918b02e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_5e677666c9ff597df1b1f2b97918b02e.jpg not downloaded yet
2026-03-30 10:48:08 [auto1.de] INFO: Found listing with ID: GB96559
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB96559%27 HTTP/1.1" 200 None
2026-03-30 10:48:08 [auto1.de] INFO: Scrape type for GB96559: 2
2026-03-30 10:48:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a845f4f6-2909-5169-ba7b-af05d3c02da5 with identifier: GB96559
2026-03-30 10:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a845f4f6-2909-5169-ba7b-af05d3c02da5 with scrape type 2
2026-03-30 10:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a845f4f6-2909-5169-ba7b-af05d3c02da5 with scrape type 2
2026-03-30 10:48:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a845f4f6-2909-5169-ba7b-af05d3c02da5, identifier: GB96559
2026-03-30 10:48:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a845f4f6-2909-5169-ba7b-af05d3c02da5 with identifier: GB96559
2026-03-30 10:48:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a845f4f6-2909-5169-ba7b-af05d3c02da5 with identifier: GB96559
2026-03-30 10:48:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a845f4f6-2909-5169-ba7b-af05d3c02da5 with identifier: GB96559 to the API
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:23:40Z',
 'fuel_type': 'petrol',
 'id': 'a845f4f6-2909-5169-ba7b-af05d3c02da5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB96559',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 72150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-15',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.2 TSI Kasten BlueMotion',
 'transmission': 'manual',
 'trim': 'Kasten BlueMotion',
 'year': 2017}
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB96559%27 HTTP/1.1" 200 None
2026-03-30 10:48:09 [auto1.de] INFO: Saving data for GB96559: {'auction_closing_time': 1774970620.0, 'created_time': 1773345090.456744, 'last_price_update_time': 1774867689.377383}
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB96559') HTTP/1.1" 204 0
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_a9f8ec2352552ed92461eba613362248.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_a9f8ec2352552ed92461eba613362248.jpg not downloaded yet
2026-03-30 10:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT32058/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_f1336b8e226de7935dbb550f72b246fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:09 [auto1.de] INFO: Found listing with ID: EV09512
2026-03-30 10:48:09 [auto1.de] INFO: Found listing with ID: RE55721
2026-03-30 10:48:09 [auto1.de] INFO: Found listing with ID: LD73259
2026-03-30 10:48:09 [auto1.de] INFO: Found listing with ID: UP63503
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP63503%27 HTTP/1.1" 200 None
2026-03-30 10:48:09 [auto1.de] INFO: Scrape type for UP63503: 1
2026-03-30 10:48:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_6901bbae980f388ce1775e0b9398581c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_6901bbae980f388ce1775e0b9398581c.jpg not downloaded yet
2026-03-30 10:48:09 [auto1.de] INFO: Found listing with ID: ZP04224
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP04224%27 HTTP/1.1" 200 None
2026-03-30 10:48:09 [auto1.de] INFO: Scrape type for ZP04224: 1
2026-03-30 10:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_ff70ce9f804bce79a595d7cd0b77d0e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_e42561b185274efe0674d727872e2e93.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_e42561b185274efe0674d727872e2e93.jpg not downloaded yet
2026-03-30 10:48:09 [auto1.de] INFO: Found listing with ID: LW34128
2026-03-30 10:48:09 [auto1.de] INFO: Found listing with ID: MM56350
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM56350%27 HTTP/1.1" 200 None
2026-03-30 10:48:09 [auto1.de] INFO: Scrape type for MM56350: 1
2026-03-30 10:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4141490>
2026-03-30 10:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_f1336b8e226de7935dbb550f72b246fe.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_f1336b8e226de7935dbb550f72b246fe.jpg saved to cache
2026-03-30 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c32f88a1-1f01-5add-84b8-2d484eafdcf7
2026-03-30 10:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_5e677666c9ff597df1b1f2b97918b02e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_bc89040421055ae7fb31e7d610297f4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_bc89040421055ae7fb31e7d610297f4a.jpg not downloaded yet
2026-03-30 10:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_a9f8ec2352552ed92461eba613362248.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:09 [auto1.de] INFO: Found listing with ID: DE11265
2026-03-30 10:48:09 [auto1.de] INFO: Found listing with ID: DT27807
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT27807%27 HTTP/1.1" 200 None
2026-03-30 10:48:09 [auto1.de] INFO: Scrape type for DT27807: 1
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_37fa5164ca94e52acc49fdaadb231f85.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_37fa5164ca94e52acc49fdaadb231f85.jpg not downloaded yet
2026-03-30 10:48:09 [auto1.de] INFO: Found listing with ID: NY24901
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY24901%27 HTTP/1.1" 200 None
2026-03-30 10:48:09 [auto1.de] INFO: Scrape type for NY24901: 1
2026-03-30 10:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee45fa10>
2026-03-30 10:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_ff70ce9f804bce79a595d7cd0b77d0e2.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_ff70ce9f804bce79a595d7cd0b77d0e2.jpg saved to cache
2026-03-30 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c32f88a1-1f01-5add-84b8-2d484eafdcf7
2026-03-30 10:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_6901bbae980f388ce1775e0b9398581c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_8672b5f3ba49eb31a36caaa56aa5c911.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_8672b5f3ba49eb31a36caaa56aa5c911.jpg not downloaded yet
2026-03-30 10:48:09 [auto1.de] INFO: Found listing with ID: LD79008
2026-03-30 10:48:09 [auto1.de] INFO: Found listing with ID: UB71876
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB71876%27 HTTP/1.1" 200 None
2026-03-30 10:48:09 [auto1.de] INFO: Scrape type for UB71876: 1
2026-03-30 10:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_e42561b185274efe0674d727872e2e93.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_0f85566608c7fb8f4c7b6427bb7d7f80.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_0f85566608c7fb8f4c7b6427bb7d7f80.jpg not downloaded yet
2026-03-30 10:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefdf910>
2026-03-30 10:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_5e677666c9ff597df1b1f2b97918b02e.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_5e677666c9ff597df1b1f2b97918b02e.jpg saved to cache
2026-03-30 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c32f88a1-1f01-5add-84b8-2d484eafdcf7
2026-03-30 10:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429ed90>
2026-03-30 10:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_a9f8ec2352552ed92461eba613362248.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_a9f8ec2352552ed92461eba613362248.jpg saved to cache
2026-03-30 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c32f88a1-1f01-5add-84b8-2d484eafdcf7
2026-03-30 10:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_bc89040421055ae7fb31e7d610297f4a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:09 [auto1.de] INFO: Found listing with ID: XE47955
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE47955%27 HTTP/1.1" 200 None
2026-03-30 10:48:09 [auto1.de] INFO: Scrape type for XE47955: 2
2026-03-30 10:48:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d1f0258-57b8-53ec-96ea-15fc4136bb69 with identifier: XE47955
2026-03-30 10:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d1f0258-57b8-53ec-96ea-15fc4136bb69 with scrape type 2
2026-03-30 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d1f0258-57b8-53ec-96ea-15fc4136bb69 with scrape type 2
2026-03-30 10:48:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d1f0258-57b8-53ec-96ea-15fc4136bb69, identifier: XE47955
2026-03-30 10:48:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d1f0258-57b8-53ec-96ea-15fc4136bb69 with identifier: XE47955
2026-03-30 10:48:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d1f0258-57b8-53ec-96ea-15fc4136bb69 with identifier: XE47955
2026-03-30 10:48:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d1f0258-57b8-53ec-96ea-15fc4136bb69 with identifier: XE47955 to the API
2026-03-30 10:48:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:15:42Z',
 'fuel_type': 'petrol',
 'id': '1d1f0258-57b8-53ec-96ea-15fc4136bb69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE47955',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 81667,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-23',
 'seller_name': None,
 'title': 'BMW 1er 118i Edition Sport Line Shadow',
 'transmission': 'manual',
 'trim': 'Edition Sport Line Shadow',
 'year': 2018}
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE47955%27 HTTP/1.1" 200 None
2026-03-30 10:48:11 [auto1.de] INFO: Saving data for XE47955: {'auction_closing_time': 1774970142.0, 'created_time': 1774262612.237655, 'last_price_update_time': 1774867691.036023}
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE47955') HTTP/1.1" 204 0
2026-03-30 10:48:11 [auto1.de] INFO: Found listing with ID: MU52688
2026-03-30 10:48:11 [auto1.de] INFO: Found listing with ID: UW30611
2026-03-30 10:48:11 [auto1.de] INFO: Found listing with ID: AA93259
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA93259%27 HTTP/1.1" 200 None
2026-03-30 10:48:11 [auto1.de] INFO: Scrape type for AA93259: 1
2026-03-30 10:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ61460> (referer: https://www.auto1.com/v1/car-details-view/VZ61460/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1403994550>
2026-03-30 10:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_6901bbae980f388ce1775e0b9398581c.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_6901bbae980f388ce1775e0b9398581c.jpg saved to cache
2026-03-30 10:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c32f88a1-1f01-5add-84b8-2d484eafdcf7
2026-03-30 10:48:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_8672b5f3ba49eb31a36caaa56aa5c911.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:11 [auto1.de] INFO: Found listing with ID: ZK65162
2026-03-30 10:48:11 [auto1.de] INFO: Found listing with ID: PW27553
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW27553%27 HTTP/1.1" 200 None
2026-03-30 10:48:11 [auto1.de] INFO: Scrape type for PW27553: 2
2026-03-30 10:48:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b4e7e1b-f7a0-5b84-92c5-ff5ccefd4261 with identifier: PW27553
2026-03-30 10:48:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b4e7e1b-f7a0-5b84-92c5-ff5ccefd4261 with scrape type 2
2026-03-30 10:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b4e7e1b-f7a0-5b84-92c5-ff5ccefd4261 with scrape type 2
2026-03-30 10:48:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b4e7e1b-f7a0-5b84-92c5-ff5ccefd4261, identifier: PW27553
2026-03-30 10:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4288750>
2026-03-30 10:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_e42561b185274efe0674d727872e2e93.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_e42561b185274efe0674d727872e2e93.jpg saved to cache
2026-03-30 10:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c32f88a1-1f01-5add-84b8-2d484eafdcf7
2026-03-30 10:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef7e050>
2026-03-30 10:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_bc89040421055ae7fb31e7d610297f4a.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_bc89040421055ae7fb31e7d610297f4a.jpg saved to cache
2026-03-30 10:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c32f88a1-1f01-5add-84b8-2d484eafdcf7
2026-03-30 10:48:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b4e7e1b-f7a0-5b84-92c5-ff5ccefd4261 with identifier: PW27553
2026-03-30 10:48:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b4e7e1b-f7a0-5b84-92c5-ff5ccefd4261 with identifier: PW27553
2026-03-30 10:48:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b4e7e1b-f7a0-5b84-92c5-ff5ccefd4261 with identifier: PW27553 to the API
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:44:27Z',
 'fuel_type': 'diesel',
 'id': '2b4e7e1b-f7a0-5b84-92c5-ff5ccefd4261',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW27553',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 122484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-24',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW27553%27 HTTP/1.1" 200 None
2026-03-30 10:48:11 [auto1.de] INFO: Saving data for PW27553: {'auction_closing_time': 1774971867.0, 'created_time': 1774379102.075825, 'last_price_update_time': 1774867691.783631}
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW27553') HTTP/1.1" 204 0
2026-03-30 10:48:11 [auto1.de] INFO: Found listing with ID: ZK45501
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK45501%27 HTTP/1.1" 200 None
2026-03-30 10:48:11 [auto1.de] INFO: Scrape type for ZK45501: 1
2026-03-30 10:48:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a75f8df1-10ae-5148-8e33-893237c74c2e with identifier: VZ61460
2026-03-30 10:48:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a75f8df1-10ae-5148-8e33-893237c74c2e with scrape type 1
2026-03-30 10:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a75f8df1-10ae-5148-8e33-893237c74c2e
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_e8a02575beaca3b71f39523813f04b99.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_e8a02575beaca3b71f39523813f04b99.jpg not downloaded yet
2026-03-30 10:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb3ad0>
2026-03-30 10:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_8672b5f3ba49eb31a36caaa56aa5c911.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_8672b5f3ba49eb31a36caaa56aa5c911.jpg saved to cache
2026-03-30 10:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c32f88a1-1f01-5add-84b8-2d484eafdcf7
2026-03-30 10:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_0f85566608c7fb8f4c7b6427bb7d7f80.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:11 [auto1.de] INFO: Found listing with ID: ZE40043
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE40043%27 HTTP/1.1" 200 None
2026-03-30 10:48:11 [auto1.de] INFO: Scrape type for ZE40043: 2
2026-03-30 10:48:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c15a9020-5236-5441-9380-70be625fedf5 with identifier: ZE40043
2026-03-30 10:48:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c15a9020-5236-5441-9380-70be625fedf5 with scrape type 2
2026-03-30 10:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c15a9020-5236-5441-9380-70be625fedf5 with scrape type 2
2026-03-30 10:48:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c15a9020-5236-5441-9380-70be625fedf5, identifier: ZE40043
2026-03-30 10:48:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c15a9020-5236-5441-9380-70be625fedf5 with identifier: ZE40043
2026-03-30 10:48:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c15a9020-5236-5441-9380-70be625fedf5 with identifier: ZE40043
2026-03-30 10:48:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c15a9020-5236-5441-9380-70be625fedf5 with identifier: ZE40043 to the API
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 159,
 'expiration_date': '2026-03-31T15:52:03Z',
 'fuel_type': 'petrol',
 'id': 'c15a9020-5236-5441-9380-70be625fedf5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE40043',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 73087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-24',
 'seller_name': None,
 'title': 'Renault Scenic 1.3 TCe BOSE-Edition',
 'transmission': 'automatic',
 'trim': 'BOSE-Edition',
 'year': 2019}
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE40043%27 HTTP/1.1" 200 None
2026-03-30 10:48:12 [auto1.de] INFO: Saving data for ZE40043: {'auction_closing_time': 1774972323.0, 'created_time': 1773687149.800783, 'last_price_update_time': 1774867692.529166}
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE40043') HTTP/1.1" 204 0
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_ad41e8d5d0e8979acacf686dce4b995c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_ad41e8d5d0e8979acacf686dce4b995c.jpg not downloaded yet
2026-03-30 10:48:12 [auto1.de] INFO: Found listing with ID: BM56205
2026-03-30 10:48:12 [auto1.de] INFO: Found listing with ID: YS37212
2026-03-30 10:48:12 [auto1.de] INFO: Found listing with ID: CA33728
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA33728%27 HTTP/1.1" 200 None
2026-03-30 10:48:12 [auto1.de] INFO: Scrape type for CA33728: 1
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_dadc1bc2a000aac548ed63efe8e0dac2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_dadc1bc2a000aac548ed63efe8e0dac2.jpg not downloaded yet
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_e3eea090115ffb2817d624bdfa76fdb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_e3eea090115ffb2817d624bdfa76fdb7.jpg not downloaded yet
2026-03-30 10:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f417f150>
2026-03-30 10:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_0f85566608c7fb8f4c7b6427bb7d7f80.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_0f85566608c7fb8f4c7b6427bb7d7f80.jpg saved to cache
2026-03-30 10:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c32f88a1-1f01-5add-84b8-2d484eafdcf7
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_623c2ba06817f8e2961c3c058879142c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_623c2ba06817f8e2961c3c058879142c.jpg not downloaded yet
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_87c45f68af4685659c2726ba136d4ffa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_87c45f68af4685659c2726ba136d4ffa.jpg not downloaded yet
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_4f71dd1602e13bef306d4da7caedb075.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_4f71dd1602e13bef306d4da7caedb075.jpg not downloaded yet
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_be9bc39c254438c9c392f4ed9497253e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_be9bc39c254438c9c392f4ed9497253e.jpg not downloaded yet
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_ec312d7b13c8d16ba2dc5e522e65dbd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_ec312d7b13c8d16ba2dc5e522e65dbd0.jpg not downloaded yet
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_1000797b89b6e4ea52eb22a267c8befb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_1000797b89b6e4ea52eb22a267c8befb.jpg not downloaded yet
2026-03-30 10:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_37fa5164ca94e52acc49fdaadb231f85.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_1000797b89b6e4ea52eb22a267c8befb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f47fb510>
2026-03-30 10:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F49%252Ff94948135009effd8f0ad93a626f5c93%252Fpa%252FYZ91982_37fa5164ca94e52acc49fdaadb231f85.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_37fa5164ca94e52acc49fdaadb231f85.jpg saved to cache
2026-03-30 10:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c32f88a1-1f01-5add-84b8-2d484eafdcf7
2026-03-30 10:48:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c32f88a1-1f01-5add-84b8-2d484eafdcf7, skipping ID generation
2026-03-30 10:48:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32f88a1-1f01-5add-84b8-2d484eafdcf7 with scrape type 1
2026-03-30 10:48:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c32f88a1-1f01-5add-84b8-2d484eafdcf7 sending to next pipeline
2026-03-30 10:48:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c32f88a1-1f01-5add-84b8-2d484eafdcf7, identifier: YZ91982
2026-03-30 10:48:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c32f88a1-1f01-5add-84b8-2d484eafdcf7 with identifier: YZ91982
2026-03-30 10:48:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c32f88a1-1f01-5add-84b8-2d484eafdcf7 with identifier: YZ91982
2026-03-30 10:48:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c32f88a1-1f01-5add-84b8-2d484eafdcf7 with identifier: YZ91982 to the API
2026-03-30 10:48:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_37fa5164ca94e52acc49fdaadb231f85.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:28:22Z',
 'fuel_type': 'petrol',
 'id': 'c32f88a1-1f01-5add-84b8-2d484eafdcf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ91982',
 'listing': 'auction',
 'location': 'DE, Worms',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 133290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_f1336b8e226de7935dbb550f72b246fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_ff70ce9f804bce79a595d7cd0b77d0e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_5e677666c9ff597df1b1f2b97918b02e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_a9f8ec2352552ed92461eba613362248.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_6901bbae980f388ce1775e0b9398581c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_e42561b185274efe0674d727872e2e93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_bc89040421055ae7fb31e7d610297f4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2842285,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_37fa5164ca94e52acc49fdaadb231f85.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_8672b5f3ba49eb31a36caaa56aa5c911.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32f88a1-1f01-5add-84b8-2d484eafdcf7/c32f88a1-1f01-5add-84b8-2d484eafdcf7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/49/f94948135009effd8f0ad93a626f5c93/pa/YZ91982_0f85566608c7fb8f4c7b6427bb7d7f80.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-30 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ91982%27 HTTP/1.1" 200 None
2026-03-30 10:48:13 [auto1.de] INFO: Saving data for YZ91982: {'created_time': 1774867693.710468, 'last_price_update_time': 1774867693.710479, 'auction_closing_time': 1774970902.0}
2026-03-30 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ91982') HTTP/1.1" 204 0
2026-03-30 10:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_ec312d7b13c8d16ba2dc5e522e65dbd0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JV19654/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP98376/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7db10>
2026-03-30 10:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_1000797b89b6e4ea52eb22a267c8befb.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_1000797b89b6e4ea52eb22a267c8befb.jpg saved to cache
2026-03-30 10:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a75f8df1-10ae-5148-8e33-893237c74c2e
2026-03-30 10:48:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419a510>
2026-03-30 10:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_ec312d7b13c8d16ba2dc5e522e65dbd0.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_ec312d7b13c8d16ba2dc5e522e65dbd0.jpg saved to cache
2026-03-30 10:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a75f8df1-10ae-5148-8e33-893237c74c2e
2026-03-30 10:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_4f71dd1602e13bef306d4da7caedb075.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_be9bc39c254438c9c392f4ed9497253e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_87c45f68af4685659c2726ba136d4ffa.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_e3eea090115ffb2817d624bdfa76fdb7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_dadc1bc2a000aac548ed63efe8e0dac2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_623c2ba06817f8e2961c3c058879142c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee5df90>
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_4f71dd1602e13bef306d4da7caedb075.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_4f71dd1602e13bef306d4da7caedb075.jpg saved to cache
2026-03-30 10:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a75f8df1-10ae-5148-8e33-893237c74c2e
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e8190>
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_be9bc39c254438c9c392f4ed9497253e.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_be9bc39c254438c9c392f4ed9497253e.jpg saved to cache
2026-03-30 10:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a75f8df1-10ae-5148-8e33-893237c74c2e
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4232110>
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_87c45f68af4685659c2726ba136d4ffa.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_87c45f68af4685659c2726ba136d4ffa.jpg saved to cache
2026-03-30 10:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a75f8df1-10ae-5148-8e33-893237c74c2e
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee417b10>
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_e3eea090115ffb2817d624bdfa76fdb7.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_e3eea090115ffb2817d624bdfa76fdb7.jpg saved to cache
2026-03-30 10:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a75f8df1-10ae-5148-8e33-893237c74c2e
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4396b90>
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_dadc1bc2a000aac548ed63efe8e0dac2.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_dadc1bc2a000aac548ed63efe8e0dac2.jpg saved to cache
2026-03-30 10:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a75f8df1-10ae-5148-8e33-893237c74c2e
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414fb90>
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_623c2ba06817f8e2961c3c058879142c.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_623c2ba06817f8e2961c3c058879142c.jpg saved to cache
2026-03-30 10:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a75f8df1-10ae-5148-8e33-893237c74c2e
2026-03-30 10:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UP63503/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_ad41e8d5d0e8979acacf686dce4b995c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_e8a02575beaca3b71f39523813f04b99.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e3e90>
2026-03-30 10:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_ad41e8d5d0e8979acacf686dce4b995c.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_ad41e8d5d0e8979acacf686dce4b995c.jpg saved to cache
2026-03-30 10:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a75f8df1-10ae-5148-8e33-893237c74c2e
2026-03-30 10:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef53750>
2026-03-30 10:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F97%252F8d9772b0231273eff503d3190392408f%252Fpa%252FVZ61460_e8a02575beaca3b71f39523813f04b99.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_e8a02575beaca3b71f39523813f04b99.jpg saved to cache
2026-03-30 10:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a75f8df1-10ae-5148-8e33-893237c74c2e
2026-03-30 10:48:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a75f8df1-10ae-5148-8e33-893237c74c2e, skipping ID generation
2026-03-30 10:48:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a75f8df1-10ae-5148-8e33-893237c74c2e with scrape type 1
2026-03-30 10:48:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a75f8df1-10ae-5148-8e33-893237c74c2e sending to next pipeline
2026-03-30 10:48:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a75f8df1-10ae-5148-8e33-893237c74c2e, identifier: VZ61460
2026-03-30 10:48:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a75f8df1-10ae-5148-8e33-893237c74c2e with identifier: VZ61460
2026-03-30 10:48:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a75f8df1-10ae-5148-8e33-893237c74c2e with identifier: VZ61460
2026-03-30 10:48:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a75f8df1-10ae-5148-8e33-893237c74c2e with identifier: VZ61460 to the API
2026-03-30 10:48:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_e8a02575beaca3b71f39523813f04b99.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:51:42Z',
 'fuel_type': 'diesel',
 'id': 'a75f8df1-10ae-5148-8e33-893237c74c2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ61460',
 'listing': 'auction',
 'location': 'DE, Trier',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 171531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_e8a02575beaca3b71f39523813f04b99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_ad41e8d5d0e8979acacf686dce4b995c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_dadc1bc2a000aac548ed63efe8e0dac2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_e3eea090115ffb2817d624bdfa76fdb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_623c2ba06817f8e2961c3c058879142c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_87c45f68af4685659c2726ba136d4ffa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_4f71dd1602e13bef306d4da7caedb075.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_be9bc39c254438c9c392f4ed9497253e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_ec312d7b13c8d16ba2dc5e522e65dbd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a75f8df1-10ae-5148-8e33-893237c74c2e/a75f8df1-10ae-5148-8e33-893237c74c2e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/97/8d9772b0231273eff503d3190392408f/pa/VZ61460_1000797b89b6e4ea52eb22a267c8befb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Countryman Cooper SD ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2014}
2026-03-30 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ61460%27 HTTP/1.1" 200 None
2026-03-30 10:48:15 [auto1.de] INFO: Saving data for VZ61460: {'created_time': 1774867695.736589, 'last_price_update_time': 1774867695.7366, 'auction_closing_time': 1774972302.0}
2026-03-30 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ61460') HTTP/1.1" 204 0
2026-03-30 10:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VL87987> (referer: https://www.auto1.com/v1/car-details-view/VL87987/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ffad47d-811a-5b2f-b4dd-1b7953b30536 with identifier: VL87987
2026-03-30 10:48:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ffad47d-811a-5b2f-b4dd-1b7953b30536 with scrape type 1
2026-03-30 10:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ffad47d-811a-5b2f-b4dd-1b7953b30536
2026-03-30 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fd7%252Ff7d7a7122f05807959508af20cdc5b13%252Fpa%252FVL87987_797ac6b6ebf1807568578c349750965e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_797ac6b6ebf1807568578c349750965e.jpg already downloaded
2026-03-30 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fd7%252Ff7d7a7122f05807959508af20cdc5b13%252Fpa%252FVL87987_f7300f609f7b9422ebd9d7cafa51728f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_f7300f609f7b9422ebd9d7cafa51728f.jpg already downloaded
2026-03-30 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fd7%252Ff7d7a7122f05807959508af20cdc5b13%252Fpa%252FVL87987_b65ac3c82209cbdbfe42923a576474e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_b65ac3c82209cbdbfe42923a576474e1.jpg already downloaded
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fd7%252Ff7d7a7122f05807959508af20cdc5b13%252Fpa%252FVL87987_9ff5b3e4782e2a56fcad261ee3b09c50.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_9ff5b3e4782e2a56fcad261ee3b09c50.jpg already downloaded
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fd7%252Ff7d7a7122f05807959508af20cdc5b13%252Fpa%252FVL87987_6eb37ff6df5ace74bf92f7b5b842ac08.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_6eb37ff6df5ace74bf92f7b5b842ac08.jpg already downloaded
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fd7%252Ff7d7a7122f05807959508af20cdc5b13%252Fpa%252FVL87987_79c36cf8de6594bb604c1c01e3312ef6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_79c36cf8de6594bb604c1c01e3312ef6.jpg already downloaded
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fd7%252Ff7d7a7122f05807959508af20cdc5b13%252Fpa%252FVL87987_d84d81ec55971e690cc640663f68a873.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_d84d81ec55971e690cc640663f68a873.jpg already downloaded
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fd7%252Ff7d7a7122f05807959508af20cdc5b13%252Fpa%252FVL87987_3c2165572559be7fcfff25f98f27f823.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_3c2165572559be7fcfff25f98f27f823.jpg already downloaded
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fd7%252Ff7d7a7122f05807959508af20cdc5b13%252Fpa%252FVL87987_437f6a1e1311f771cb2ed39d142da7fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_437f6a1e1311f771cb2ed39d142da7fe.jpg already downloaded
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fd7%252Ff7d7a7122f05807959508af20cdc5b13%252Fpa%252FVL87987_5c1df8298dda024c63df17c0aea5873f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_5c1df8298dda024c63df17c0aea5873f.jpg already downloaded
2026-03-30 10:48:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ffad47d-811a-5b2f-b4dd-1b7953b30536, identifier: VL87987
2026-03-30 10:48:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ffad47d-811a-5b2f-b4dd-1b7953b30536 with identifier: VL87987
2026-03-30 10:48:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ffad47d-811a-5b2f-b4dd-1b7953b30536 with identifier: VL87987
2026-03-30 10:48:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ffad47d-811a-5b2f-b4dd-1b7953b30536 with identifier: VL87987 to the API
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VL87987>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:04:12Z',
 'fuel_type': 'diesel',
 'id': '7ffad47d-811a-5b2f-b4dd-1b7953b30536',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL87987',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 185016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_797ac6b6ebf1807568578c349750965e.jpg',
                'https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_f7300f609f7b9422ebd9d7cafa51728f.jpg',
                'https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_b65ac3c82209cbdbfe42923a576474e1.jpg',
                'https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_9ff5b3e4782e2a56fcad261ee3b09c50.jpg',
                'https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_6eb37ff6df5ace74bf92f7b5b842ac08.jpg',
                'https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_79c36cf8de6594bb604c1c01e3312ef6.jpg',
                'https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_d84d81ec55971e690cc640663f68a873.jpg',
                'https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_3c2165572559be7fcfff25f98f27f823.jpg',
                'https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_437f6a1e1311f771cb2ed39d142da7fe.jpg',
                'https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_5c1df8298dda024c63df17c0aea5873f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffad47d-811a-5b2f-b4dd-1b7953b30536/7ffad47d-811a-5b2f-b4dd-1b7953b30536_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_797ac6b6ebf1807568578c349750965e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffad47d-811a-5b2f-b4dd-1b7953b30536/7ffad47d-811a-5b2f-b4dd-1b7953b30536_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_f7300f609f7b9422ebd9d7cafa51728f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffad47d-811a-5b2f-b4dd-1b7953b30536/7ffad47d-811a-5b2f-b4dd-1b7953b30536_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_b65ac3c82209cbdbfe42923a576474e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffad47d-811a-5b2f-b4dd-1b7953b30536/7ffad47d-811a-5b2f-b4dd-1b7953b30536_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_9ff5b3e4782e2a56fcad261ee3b09c50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffad47d-811a-5b2f-b4dd-1b7953b30536/7ffad47d-811a-5b2f-b4dd-1b7953b30536_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_6eb37ff6df5ace74bf92f7b5b842ac08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffad47d-811a-5b2f-b4dd-1b7953b30536/7ffad47d-811a-5b2f-b4dd-1b7953b30536_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_79c36cf8de6594bb604c1c01e3312ef6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffad47d-811a-5b2f-b4dd-1b7953b30536/7ffad47d-811a-5b2f-b4dd-1b7953b30536_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_d84d81ec55971e690cc640663f68a873.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffad47d-811a-5b2f-b4dd-1b7953b30536/7ffad47d-811a-5b2f-b4dd-1b7953b30536_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_3c2165572559be7fcfff25f98f27f823.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffad47d-811a-5b2f-b4dd-1b7953b30536/7ffad47d-811a-5b2f-b4dd-1b7953b30536_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_437f6a1e1311f771cb2ed39d142da7fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffad47d-811a-5b2f-b4dd-1b7953b30536/7ffad47d-811a-5b2f-b4dd-1b7953b30536_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/d7/f7d7a7122f05807959508af20cdc5b13/pa/VL87987_5c1df8298dda024c63df17c0aea5873f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL87987%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [auto1.de] INFO: Saving data for VL87987: {'created_time': 1774867697.614718, 'last_price_update_time': 1774867697.614729, 'auction_closing_time': 1774969452.0}
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL87987') HTTP/1.1" 204 0
2026-03-30 10:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT32058> (referer: https://www.auto1.com/v1/car-details-view/PT32058/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afc75a7f-e439-518d-892a-38c108d374cb with identifier: PT32058
2026-03-30 10:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afc75a7f-e439-518d-892a-38c108d374cb with scrape type 1
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item afc75a7f-e439-518d-892a-38c108d374cb
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_877a259a1f3e453a4d3e25f3f46aa144.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_877a259a1f3e453a4d3e25f3f46aa144.jpg not downloaded yet
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_818d7d02f846b5c7e0d3a75e72d07314.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_818d7d02f846b5c7e0d3a75e72d07314.jpg not downloaded yet
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_6b837e4edaca76aec2b1e77b7be6b1ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_6b837e4edaca76aec2b1e77b7be6b1ba.jpg not downloaded yet
2026-03-30 10:48:17 [auto1.de] INFO: Channel: 24h | Page: 28 | totalHits: 9490 | hits on page: 40
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_f782191eab73bbb7a39499789f239858.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_f782191eab73bbb7a39499789f239858.jpg not downloaded yet
2026-03-30 10:48:17 [auto1.de] INFO: Found listing with ID: YS37212
2026-03-30 10:48:17 [auto1.de] INFO: Found listing with ID: CA33728
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_664b3de8167bc6dcd0750fc8791d1efc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_664b3de8167bc6dcd0750fc8791d1efc.jpg not downloaded yet
2026-03-30 10:48:17 [auto1.de] INFO: Found listing with ID: BZ49239
2026-03-30 10:48:17 [auto1.de] INFO: Found listing with ID: XT33273
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT33273%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [auto1.de] INFO: Scrape type for XT33273: 2
2026-03-30 10:48:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e1a4914-aabd-55bb-a82c-ad37cdb7ac5a with identifier: XT33273
2026-03-30 10:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e1a4914-aabd-55bb-a82c-ad37cdb7ac5a with scrape type 2
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e1a4914-aabd-55bb-a82c-ad37cdb7ac5a with scrape type 2
2026-03-30 10:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e1a4914-aabd-55bb-a82c-ad37cdb7ac5a, identifier: XT33273
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_e11e58fa1065407dcf6b1798fa421394.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_e11e58fa1065407dcf6b1798fa421394.jpg not downloaded yet
2026-03-30 10:48:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e1a4914-aabd-55bb-a82c-ad37cdb7ac5a with identifier: XT33273
2026-03-30 10:48:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e1a4914-aabd-55bb-a82c-ad37cdb7ac5a with identifier: XT33273
2026-03-30 10:48:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e1a4914-aabd-55bb-a82c-ad37cdb7ac5a with identifier: XT33273 to the API
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:58:53Z',
 'fuel_type': 'diesel',
 'id': '5e1a4914-aabd-55bb-a82c-ad37cdb7ac5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT33273',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 128069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-02',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT33273%27 HTTP/1.1" 200 None
2026-03-30 10:48:18 [auto1.de] INFO: Saving data for XT33273: {'auction_closing_time': 1774972733.0, 'created_time': 1774294205.413355, 'last_price_update_time': 1774867698.474216}
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT33273') HTTP/1.1" 204 0
2026-03-30 10:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_877a259a1f3e453a4d3e25f3f46aa144.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:18 [auto1.de] INFO: Found listing with ID: TW14426
2026-03-30 10:48:18 [auto1.de] INFO: Found listing with ID: VG43555
2026-03-30 10:48:18 [auto1.de] INFO: Found listing with ID: KS92375
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS92375%27 HTTP/1.1" 200 None
2026-03-30 10:48:18 [auto1.de] INFO: Scrape type for KS92375: 1
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_eb6226162d29ca97f29ffb39654d271d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_eb6226162d29ca97f29ffb39654d271d.jpg not downloaded yet
2026-03-30 10:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP04224/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:18 [auto1.de] INFO: Found listing with ID: BR48226
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR48226%27 HTTP/1.1" 200 None
2026-03-30 10:48:18 [auto1.de] INFO: Scrape type for BR48226: 1
2026-03-30 10:48:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_5c99afaeeeb409f3405ca1c0da523298.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_5c99afaeeeb409f3405ca1c0da523298.jpg not downloaded yet
2026-03-30 10:48:18 [auto1.de] INFO: Found listing with ID: YM49760
2026-03-30 10:48:18 [auto1.de] INFO: Found listing with ID: TW11648
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW11648%27 HTTP/1.1" 200 None
2026-03-30 10:48:18 [auto1.de] INFO: Scrape type for TW11648: 2
2026-03-30 10:48:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e7e18b5-5f40-59d6-b47c-ee80d4fb2223 with identifier: TW11648
2026-03-30 10:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e7e18b5-5f40-59d6-b47c-ee80d4fb2223 with scrape type 2
2026-03-30 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e7e18b5-5f40-59d6-b47c-ee80d4fb2223 with scrape type 2
2026-03-30 10:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e7e18b5-5f40-59d6-b47c-ee80d4fb2223, identifier: TW11648
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_ed6d8149750a94766a7a319e00c15e37.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_ed6d8149750a94766a7a319e00c15e37.jpg not downloaded yet
2026-03-30 10:48:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e7e18b5-5f40-59d6-b47c-ee80d4fb2223 with identifier: TW11648
2026-03-30 10:48:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e7e18b5-5f40-59d6-b47c-ee80d4fb2223 with identifier: TW11648
2026-03-30 10:48:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e7e18b5-5f40-59d6-b47c-ee80d4fb2223 with identifier: TW11648 to the API
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:29:22Z',
 'fuel_type': 'petrol',
 'id': '0e7e18b5-5f40-59d6-b47c-ee80d4fb2223',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW11648',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 15013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-24',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2023}
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW11648%27 HTTP/1.1" 200 None
2026-03-30 10:48:19 [auto1.de] INFO: Saving data for TW11648: {'auction_closing_time': 1774970962.0, 'created_time': 1774348763.474252, 'last_price_update_time': 1774867699.195997}
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW11648') HTTP/1.1" 204 0
2026-03-30 10:48:19 [auto1.de] INFO: Found listing with ID: YL97472
2026-03-30 10:48:19 [auto1.de] INFO: Found listing with ID: FU73631
2026-03-30 10:48:19 [auto1.de] INFO: Found listing with ID: JH65946
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH65946%27 HTTP/1.1" 200 None
2026-03-30 10:48:19 [auto1.de] INFO: Scrape type for JH65946: 2
2026-03-30 10:48:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e396671-3a37-5c12-99d7-c36d98baf8d0 with identifier: JH65946
2026-03-30 10:48:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e396671-3a37-5c12-99d7-c36d98baf8d0 with scrape type 2
2026-03-30 10:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e396671-3a37-5c12-99d7-c36d98baf8d0 with scrape type 2
2026-03-30 10:48:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e396671-3a37-5c12-99d7-c36d98baf8d0, identifier: JH65946
2026-03-30 10:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_664b3de8167bc6dcd0750fc8791d1efc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_41cfef04ecc0fa4276d45b9ce9dfcc3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_41cfef04ecc0fa4276d45b9ce9dfcc3f.jpg not downloaded yet
2026-03-30 10:48:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e396671-3a37-5c12-99d7-c36d98baf8d0 with identifier: JH65946
2026-03-30 10:48:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e396671-3a37-5c12-99d7-c36d98baf8d0 with identifier: JH65946
2026-03-30 10:48:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e396671-3a37-5c12-99d7-c36d98baf8d0 with identifier: JH65946 to the API
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:12:00Z',
 'fuel_type': 'diesel',
 'id': '2e396671-3a37-5c12-99d7-c36d98baf8d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH65946',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 157519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-23',
 'seller_name': None,
 'title': 'Jeep Cherokee 2.0 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2014}
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH65946%27 HTTP/1.1" 200 None
2026-03-30 10:48:19 [auto1.de] INFO: Saving data for JH65946: {'auction_closing_time': 1774969920.0, 'created_time': 1773307568.833896, 'last_price_update_time': 1774867699.702584}
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH65946') HTTP/1.1" 204 0
2026-03-30 10:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AA93259/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_eb6226162d29ca97f29ffb39654d271d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:19 [auto1.de] INFO: Found listing with ID: VV39146
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV39146%27 HTTP/1.1" 200 None
2026-03-30 10:48:19 [auto1.de] INFO: Scrape type for VV39146: 2
2026-03-30 10:48:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56628f2d-5467-53dd-ba13-e682f4944911 with identifier: VV39146
2026-03-30 10:48:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56628f2d-5467-53dd-ba13-e682f4944911 with scrape type 2
2026-03-30 10:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56628f2d-5467-53dd-ba13-e682f4944911 with scrape type 2
2026-03-30 10:48:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56628f2d-5467-53dd-ba13-e682f4944911, identifier: VV39146
2026-03-30 10:48:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee94290>
2026-03-30 10:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_877a259a1f3e453a4d3e25f3f46aa144.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_877a259a1f3e453a4d3e25f3f46aa144.jpg saved to cache
2026-03-30 10:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afc75a7f-e439-518d-892a-38c108d374cb
2026-03-30 10:48:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56628f2d-5467-53dd-ba13-e682f4944911 with identifier: VV39146
2026-03-30 10:48:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56628f2d-5467-53dd-ba13-e682f4944911 with identifier: VV39146
2026-03-30 10:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56628f2d-5467-53dd-ba13-e682f4944911 with identifier: VV39146 to the API
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:19:16Z',
 'fuel_type': 'diesel',
 'id': '56628f2d-5467-53dd-ba13-e682f4944911',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV39146',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 272868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-31',
 'seller_name': None,
 'title': 'Opel Zafira 1.9 CDTI Innovation "110 Jahre"',
 'transmission': 'automatic',
 'trim': 'Innovation "110 Jahre"',
 'year': 2009}
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV39146%27 HTTP/1.1" 200 None
2026-03-30 10:48:21 [auto1.de] INFO: Saving data for VV39146: {'auction_closing_time': 1774970356.0, 'created_time': 1774378015.117575, 'last_price_update_time': 1774867701.039199}
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV39146') HTTP/1.1" 204 0
2026-03-30 10:48:21 [auto1.de] INFO: Found listing with ID: VD77751
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD77751%27 HTTP/1.1" 200 None
2026-03-30 10:48:21 [auto1.de] INFO: Scrape type for VD77751: 1
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f411f2d0>
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_664b3de8167bc6dcd0750fc8791d1efc.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_664b3de8167bc6dcd0750fc8791d1efc.jpg saved to cache
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item afc75a7f-e439-518d-892a-38c108d374cb
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4173390>
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_eb6226162d29ca97f29ffb39654d271d.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_eb6226162d29ca97f29ffb39654d271d.jpg saved to cache
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item afc75a7f-e439-518d-892a-38c108d374cb
2026-03-30 10:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_ed6d8149750a94766a7a319e00c15e37.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:21 [auto1.de] INFO: Found listing with ID: LK02148
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK02148%27 HTTP/1.1" 200 None
2026-03-30 10:48:21 [auto1.de] INFO: Scrape type for LK02148: 1
2026-03-30 10:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_5c99afaeeeb409f3405ca1c0da523298.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:21 [auto1.de] INFO: Found listing with ID: LT03056
2026-03-30 10:48:21 [auto1.de] INFO: Found listing with ID: WC05131
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC05131%27 HTTP/1.1" 200 None
2026-03-30 10:48:21 [auto1.de] INFO: Scrape type for WC05131: 1
2026-03-30 10:48:21 [auto1.de] INFO: Found listing with ID: WJ42337
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ42337%27 HTTP/1.1" 200 None
2026-03-30 10:48:21 [auto1.de] INFO: Scrape type for WJ42337: 2
2026-03-30 10:48:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19f11c10-c685-510b-b203-a4817891b3b0 with identifier: WJ42337
2026-03-30 10:48:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19f11c10-c685-510b-b203-a4817891b3b0 with scrape type 2
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19f11c10-c685-510b-b203-a4817891b3b0 with scrape type 2
2026-03-30 10:48:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19f11c10-c685-510b-b203-a4817891b3b0, identifier: WJ42337
2026-03-30 10:48:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19f11c10-c685-510b-b203-a4817891b3b0 with identifier: WJ42337
2026-03-30 10:48:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19f11c10-c685-510b-b203-a4817891b3b0 with identifier: WJ42337
2026-03-30 10:48:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19f11c10-c685-510b-b203-a4817891b3b0 with identifier: WJ42337 to the API
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:54:41Z',
 'fuel_type': 'petrol',
 'id': '19f11c10-c685-510b-b203-a4817891b3b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ42337',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Bravo',
 'odometer': 123434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-30',
 'seller_name': None,
 'title': 'Fiat Bravo 1.4 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2012}
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ42337%27 HTTP/1.1" 200 None
2026-03-30 10:48:21 [auto1.de] INFO: Saving data for WJ42337: {'auction_closing_time': 1774972481.0, 'created_time': 1773133818.454064, 'last_price_update_time': 1774867701.719445}
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ42337') HTTP/1.1" 204 0
2026-03-30 10:48:21 [auto1.de] INFO: Found listing with ID: RW28042
2026-03-30 10:48:21 [auto1.de] INFO: Found listing with ID: CK31014
2026-03-30 10:48:21 [auto1.de] INFO: Found listing with ID: RX27248
2026-03-30 10:48:21 [auto1.de] INFO: Found listing with ID: PU61252
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU61252%27 HTTP/1.1" 200 None
2026-03-30 10:48:21 [auto1.de] INFO: Scrape type for PU61252: 1
2026-03-30 10:48:21 [auto1.de] INFO: Found listing with ID: XS62323
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS62323%27 HTTP/1.1" 200 None
2026-03-30 10:48:21 [auto1.de] INFO: Scrape type for XS62323: 1
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee486090>
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_ed6d8149750a94766a7a319e00c15e37.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_ed6d8149750a94766a7a319e00c15e37.jpg saved to cache
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item afc75a7f-e439-518d-892a-38c108d374cb
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee479590>
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_5c99afaeeeb409f3405ca1c0da523298.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_5c99afaeeeb409f3405ca1c0da523298.jpg saved to cache
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item afc75a7f-e439-518d-892a-38c108d374cb
2026-03-30 10:48:21 [auto1.de] INFO: Found listing with ID: ZB77986
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB77986%27 HTTP/1.1" 200 None
2026-03-30 10:48:21 [auto1.de] INFO: Scrape type for ZB77986: 1
2026-03-30 10:48:21 [auto1.de] INFO: Found listing with ID: CH93356
2026-03-30 10:48:21 [auto1.de] INFO: Found listing with ID: HT15412
2026-03-30 10:48:21 [auto1.de] INFO: Found listing with ID: PG90707
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG90707%27 HTTP/1.1" 200 None
2026-03-30 10:48:22 [auto1.de] INFO: Scrape type for PG90707: 1
2026-03-30 10:48:22 [auto1.de] INFO: Found listing with ID: NA40709
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA40709%27 HTTP/1.1" 200 None
2026-03-30 10:48:22 [auto1.de] INFO: Scrape type for NA40709: 1
2026-03-30 10:48:22 [auto1.de] INFO: Found listing with ID: PM09523
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM09523%27 HTTP/1.1" 200 None
2026-03-30 10:48:22 [auto1.de] INFO: Scrape type for PM09523: 1
2026-03-30 10:48:22 [auto1.de] INFO: Found listing with ID: UG67497
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG67497%27 HTTP/1.1" 200 None
2026-03-30 10:48:22 [auto1.de] INFO: Scrape type for UG67497: 1
2026-03-30 10:48:22 [auto1.de] INFO: Found listing with ID: RL98194
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL98194%27 HTTP/1.1" 200 None
2026-03-30 10:48:22 [auto1.de] INFO: Scrape type for RL98194: 1
2026-03-30 10:48:22 [auto1.de] INFO: Found listing with ID: VJ31329
2026-03-30 10:48:22 [auto1.de] INFO: Found listing with ID: RL00966
2026-03-30 10:48:22 [auto1.de] INFO: Found listing with ID: RD74576
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD74576%27 HTTP/1.1" 200 None
2026-03-30 10:48:22 [auto1.de] INFO: Scrape type for RD74576: 2
2026-03-30 10:48:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a024e87-62c7-532c-b5c0-38df268b68ec with identifier: RD74576
2026-03-30 10:48:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a024e87-62c7-532c-b5c0-38df268b68ec with scrape type 2
2026-03-30 10:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a024e87-62c7-532c-b5c0-38df268b68ec with scrape type 2
2026-03-30 10:48:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a024e87-62c7-532c-b5c0-38df268b68ec, identifier: RD74576
2026-03-30 10:48:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a024e87-62c7-532c-b5c0-38df268b68ec with identifier: RD74576
2026-03-30 10:48:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a024e87-62c7-532c-b5c0-38df268b68ec with identifier: RD74576
2026-03-30 10:48:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a024e87-62c7-532c-b5c0-38df268b68ec with identifier: RD74576 to the API
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-31T15:01:23Z',
 'fuel_type': 'petrol',
 'id': '6a024e87-62c7-532c-b5c0-38df268b68ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD74576',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 83676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-15',
 'seller_name': None,
 'title': 'Hyundai i30 2.0 TGDI N Performance',
 'transmission': 'manual',
 'trim': 'N Performance',
 'year': 2019}
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD74576%27 HTTP/1.1" 200 None
2026-03-30 10:48:22 [auto1.de] INFO: Saving data for RD74576: {'auction_closing_time': 1774969283.0, 'created_time': 1774467291.201434, 'last_price_update_time': 1774867702.8728}
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD74576') HTTP/1.1" 204 0
2026-03-30 10:48:22 [auto1.de] INFO: Found listing with ID: NA95375
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA95375%27 HTTP/1.1" 200 None
2026-03-30 10:48:22 [auto1.de] INFO: Scrape type for NA95375: 2
2026-03-30 10:48:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 723bcffd-4bf9-58a0-b866-caadad76e9bc with identifier: NA95375
2026-03-30 10:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 723bcffd-4bf9-58a0-b866-caadad76e9bc with scrape type 2
2026-03-30 10:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 723bcffd-4bf9-58a0-b866-caadad76e9bc with scrape type 2
2026-03-30 10:48:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 723bcffd-4bf9-58a0-b866-caadad76e9bc, identifier: NA95375
2026-03-30 10:48:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 723bcffd-4bf9-58a0-b866-caadad76e9bc with identifier: NA95375
2026-03-30 10:48:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 723bcffd-4bf9-58a0-b866-caadad76e9bc with identifier: NA95375
2026-03-30 10:48:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 723bcffd-4bf9-58a0-b866-caadad76e9bc with identifier: NA95375 to the API
2026-03-30 10:48:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:46:27Z',
 'fuel_type': 'diesel',
 'id': '723bcffd-4bf9-58a0-b866-caadad76e9bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA95375',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 166652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-20',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CDI 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': '4Matic Avantgarde',
 'year': 2013}
2026-03-30 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA95375%27 HTTP/1.1" 200 None
2026-03-30 10:48:23 [auto1.de] INFO: Saving data for NA95375: {'auction_closing_time': 1774971987.0, 'created_time': 1774636915.520442, 'last_price_update_time': 1774867703.401735}
2026-03-30 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA95375') HTTP/1.1" 204 0
2026-03-30 10:48:23 [auto1.de] INFO: Found listing with ID: HN30434
2026-03-30 10:48:23 [auto1.de] INFO: Found listing with ID: CB39322
2026-03-30 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB39322%27 HTTP/1.1" 200 None
2026-03-30 10:48:23 [auto1.de] INFO: Scrape type for CB39322: 1
2026-03-30 10:48:23 [auto1.de] INFO: Found listing with ID: CC70846
2026-03-30 10:48:23 [auto1.de] INFO: Found listing with ID: NJ97251
2026-03-30 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ97251%27 HTTP/1.1" 200 None
2026-03-30 10:48:23 [auto1.de] INFO: Scrape type for NJ97251: 2
2026-03-30 10:48:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ee85bbb-f6e4-5e70-810b-6e44172e3867 with identifier: NJ97251
2026-03-30 10:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ee85bbb-f6e4-5e70-810b-6e44172e3867 with scrape type 2
2026-03-30 10:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ee85bbb-f6e4-5e70-810b-6e44172e3867 with scrape type 2
2026-03-30 10:48:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ee85bbb-f6e4-5e70-810b-6e44172e3867, identifier: NJ97251
2026-03-30 10:48:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ee85bbb-f6e4-5e70-810b-6e44172e3867 with identifier: NJ97251
2026-03-30 10:48:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ee85bbb-f6e4-5e70-810b-6e44172e3867 with identifier: NJ97251
2026-03-30 10:48:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ee85bbb-f6e4-5e70-810b-6e44172e3867 with identifier: NJ97251 to the API
2026-03-30 10:48:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:53:06Z',
 'fuel_type': 'hybrid',
 'id': '9ee85bbb-f6e4-5e70-810b-6e44172e3867',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ97251',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 51579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium X',
 'transmission': 'automatic',
 'trim': 'Titanium X',
 'year': 2021}
2026-03-30 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ97251%27 HTTP/1.1" 200 None
2026-03-30 10:48:23 [auto1.de] INFO: Saving data for NJ97251: {'auction_closing_time': 1774972386.0, 'created_time': 1774463672.942481, 'last_price_update_time': 1774867703.899208}
2026-03-30 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ97251') HTTP/1.1" 204 0
2026-03-30 10:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM56350/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP98376> (referer: https://www.auto1.com/v1/car-details-view/WP98376/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8799789-0d52-50ea-bdd4-121716d899ed with identifier: WP98376
2026-03-30 10:48:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8799789-0d52-50ea-bdd4-121716d899ed with scrape type 1
2026-03-30 10:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8799789-0d52-50ea-bdd4-121716d899ed
2026-03-30 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_51c5e07e92778c8fd444c35792b33bf1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_51c5e07e92778c8fd444c35792b33bf1.jpg not downloaded yet
2026-03-30 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_c14cc60edfb0f2ce7c1880fffbe4ccd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_c14cc60edfb0f2ce7c1880fffbe4ccd5.jpg not downloaded yet
2026-03-30 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_684dd83b96c901d6330d21d0e3f638e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_684dd83b96c901d6330d21d0e3f638e3.jpg not downloaded yet
2026-03-30 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_90bd2201682bb848b4c703d2f7a28135.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_90bd2201682bb848b4c703d2f7a28135.jpg not downloaded yet
2026-03-30 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_c064a8de09270ec17a3483ae61fc643f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_c064a8de09270ec17a3483ae61fc643f.jpg not downloaded yet
2026-03-30 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_e2648b5aca3840f135d944e02ebeaa28.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_e2648b5aca3840f135d944e02ebeaa28.jpg not downloaded yet
2026-03-30 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_db6fdf3f269816eb9cd5fd74757d1398.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_db6fdf3f269816eb9cd5fd74757d1398.jpg not downloaded yet
2026-03-30 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_ec4953063f95f900c4212f30f24f62c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_ec4953063f95f900c4212f30f24f62c7.jpg not downloaded yet
2026-03-30 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_ffb4cf45cc0068e445640c50a1469a17.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_ffb4cf45cc0068e445640c50a1469a17.jpg not downloaded yet
2026-03-30 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_2ef18005c4db587d1eb7b114feca0986.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_2ef18005c4db587d1eb7b114feca0986.jpg not downloaded yet
2026-03-30 10:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB71876/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_2ef18005c4db587d1eb7b114feca0986.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea3d10>
2026-03-30 10:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_2ef18005c4db587d1eb7b114feca0986.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_2ef18005c4db587d1eb7b114feca0986.jpg saved to cache
2026-03-30 10:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8799789-0d52-50ea-bdd4-121716d899ed
2026-03-30 10:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_ffb4cf45cc0068e445640c50a1469a17.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7ee10>
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_ffb4cf45cc0068e445640c50a1469a17.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_ffb4cf45cc0068e445640c50a1469a17.jpg saved to cache
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8799789-0d52-50ea-bdd4-121716d899ed
2026-03-30 10:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK45501/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA33728/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_ec4953063f95f900c4212f30f24f62c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee02390>
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_ec4953063f95f900c4212f30f24f62c7.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_ec4953063f95f900c4212f30f24f62c7.jpg saved to cache
2026-03-30 10:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8799789-0d52-50ea-bdd4-121716d899ed
2026-03-30 10:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_db6fdf3f269816eb9cd5fd74757d1398.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4008d0>
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_db6fdf3f269816eb9cd5fd74757d1398.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_db6fdf3f269816eb9cd5fd74757d1398.jpg saved to cache
2026-03-30 10:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8799789-0d52-50ea-bdd4-121716d899ed
2026-03-30 10:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY24901/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_e2648b5aca3840f135d944e02ebeaa28.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7d910>
2026-03-30 10:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_e2648b5aca3840f135d944e02ebeaa28.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_e2648b5aca3840f135d944e02ebeaa28.jpg saved to cache
2026-03-30 10:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8799789-0d52-50ea-bdd4-121716d899ed
2026-03-30 10:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_c064a8de09270ec17a3483ae61fc643f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee482810>
2026-03-30 10:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_c064a8de09270ec17a3483ae61fc643f.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_c064a8de09270ec17a3483ae61fc643f.jpg saved to cache
2026-03-30 10:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8799789-0d52-50ea-bdd4-121716d899ed
2026-03-30 10:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR48226/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_90bd2201682bb848b4c703d2f7a28135.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee02610>
2026-03-30 10:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_90bd2201682bb848b4c703d2f7a28135.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_90bd2201682bb848b4c703d2f7a28135.jpg saved to cache
2026-03-30 10:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8799789-0d52-50ea-bdd4-121716d899ed
2026-03-30 10:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DT27807/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_684dd83b96c901d6330d21d0e3f638e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VD77751/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4197750>
2026-03-30 10:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_684dd83b96c901d6330d21d0e3f638e3.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_684dd83b96c901d6330d21d0e3f638e3.jpg saved to cache
2026-03-30 10:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8799789-0d52-50ea-bdd4-121716d899ed
2026-03-30 10:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_c14cc60edfb0f2ce7c1880fffbe4ccd5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f597cbd0>
2026-03-30 10:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_c14cc60edfb0f2ce7c1880fffbe4ccd5.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_c14cc60edfb0f2ce7c1880fffbe4ccd5.jpg saved to cache
2026-03-30 10:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8799789-0d52-50ea-bdd4-121716d899ed
2026-03-30 10:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UP63503> (referer: https://www.auto1.com/v1/car-details-view/UP63503/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa300d3f-dc66-54e3-9282-142dd4d25014 with identifier: UP63503
2026-03-30 10:48:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa300d3f-dc66-54e3-9282-142dd4d25014 with scrape type 1
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa300d3f-dc66-54e3-9282-142dd4d25014
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_e421b8814beebd6dba995ac47a91dde9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_e421b8814beebd6dba995ac47a91dde9.jpg not downloaded yet
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_80c0ee9e2f2b2f1553c1e7e0d1924598.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_80c0ee9e2f2b2f1553c1e7e0d1924598.jpg not downloaded yet
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_1b3b160a6a1ea64ce4570b143fde5af9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_1b3b160a6a1ea64ce4570b143fde5af9.jpg not downloaded yet
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_5240d0474c2ba9e87a368fa29de073ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_5240d0474c2ba9e87a368fa29de073ad.jpg not downloaded yet
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_7593436e9243ce4d59bbefe698b858c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_7593436e9243ce4d59bbefe698b858c6.jpg not downloaded yet
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_672329c41eb36eab0c839c70945a27d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_672329c41eb36eab0c839c70945a27d5.jpg not downloaded yet
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_ef1ed9d8e9009dfbd7665b6cb3bacf29.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_ef1ed9d8e9009dfbd7665b6cb3bacf29.jpg not downloaded yet
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_dc033fb8d08554a2fa488f89ed141d62.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_dc033fb8d08554a2fa488f89ed141d62.jpg not downloaded yet
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_8cbd812c2a2c38df08596f375019adc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_8cbd812c2a2c38df08596f375019adc0.jpg not downloaded yet
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_7a7a05b899b80aff1d755a01389157e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_7a7a05b899b80aff1d755a01389157e3.jpg not downloaded yet
2026-03-30 10:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_51c5e07e92778c8fd444c35792b33bf1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee482510>
2026-03-30 10:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fae%252F09ae351700dc7385c739b768ed187bd5%252Fpa%252FWP98376_51c5e07e92778c8fd444c35792b33bf1.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_51c5e07e92778c8fd444c35792b33bf1.jpg saved to cache
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8799789-0d52-50ea-bdd4-121716d899ed
2026-03-30 10:48:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8799789-0d52-50ea-bdd4-121716d899ed, skipping ID generation
2026-03-30 10:48:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8799789-0d52-50ea-bdd4-121716d899ed with scrape type 1
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8799789-0d52-50ea-bdd4-121716d899ed sending to next pipeline
2026-03-30 10:48:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8799789-0d52-50ea-bdd4-121716d899ed, identifier: WP98376
2026-03-30 10:48:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8799789-0d52-50ea-bdd4-121716d899ed with identifier: WP98376
2026-03-30 10:48:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8799789-0d52-50ea-bdd4-121716d899ed with identifier: WP98376
2026-03-30 10:48:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8799789-0d52-50ea-bdd4-121716d899ed with identifier: WP98376 to the API
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_51c5e07e92778c8fd444c35792b33bf1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:16:31Z',
 'fuel_type': 'petrol',
 'id': 'd8799789-0d52-50ea-bdd4-121716d899ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP98376',
 'listing': 'auction',
 'location': 'DE, Kamen',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 158679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3155936,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_51c5e07e92778c8fd444c35792b33bf1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3043896,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_c14cc60edfb0f2ce7c1880fffbe4ccd5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3080629,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_684dd83b96c901d6330d21d0e3f638e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3075757,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_90bd2201682bb848b4c703d2f7a28135.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3017533,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_c064a8de09270ec17a3483ae61fc643f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_e2648b5aca3840f135d944e02ebeaa28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2496322,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_db6fdf3f269816eb9cd5fd74757d1398.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2577978,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_ec4953063f95f900c4212f30f24f62c7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3073525,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_ffb4cf45cc0068e445640c50a1469a17.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8799789-0d52-50ea-bdd4-121716d899ed/d8799789-0d52-50ea-bdd4-121716d899ed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/ae/09ae351700dc7385c739b768ed187bd5/pa/WP98376_2ef18005c4db587d1eb7b114feca0986.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TSI GTI adidas',
 'transmission': 'manual',
 'trim': 'GTI adidas',
 'year': 2010}
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP98376%27 HTTP/1.1" 200 None
2026-03-30 10:48:36 [auto1.de] INFO: Saving data for WP98376: {'created_time': 1774867716.208958, 'last_price_update_time': 1774867716.208966, 'auction_closing_time': 1774970191.0}
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP98376') HTTP/1.1" 204 0
2026-03-30 10:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LK02148/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_7a7a05b899b80aff1d755a01389157e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee86090>
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_7a7a05b899b80aff1d755a01389157e3.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_7a7a05b899b80aff1d755a01389157e3.jpg saved to cache
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa300d3f-dc66-54e3-9282-142dd4d25014
2026-03-30 10:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_dc033fb8d08554a2fa488f89ed141d62.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9d650>
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_dc033fb8d08554a2fa488f89ed141d62.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_dc033fb8d08554a2fa488f89ed141d62.jpg saved to cache
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa300d3f-dc66-54e3-9282-142dd4d25014
2026-03-30 10:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_8cbd812c2a2c38df08596f375019adc0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42abbd0>
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_8cbd812c2a2c38df08596f375019adc0.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_8cbd812c2a2c38df08596f375019adc0.jpg saved to cache
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa300d3f-dc66-54e3-9282-142dd4d25014
2026-03-30 10:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_ef1ed9d8e9009dfbd7665b6cb3bacf29.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4196550>
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_ef1ed9d8e9009dfbd7665b6cb3bacf29.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_ef1ed9d8e9009dfbd7665b6cb3bacf29.jpg saved to cache
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa300d3f-dc66-54e3-9282-142dd4d25014
2026-03-30 10:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_672329c41eb36eab0c839c70945a27d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd5790>
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_672329c41eb36eab0c839c70945a27d5.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_672329c41eb36eab0c839c70945a27d5.jpg saved to cache
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa300d3f-dc66-54e3-9282-142dd4d25014
2026-03-30 10:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_7593436e9243ce4d59bbefe698b858c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41956d0>
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_7593436e9243ce4d59bbefe698b858c6.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_7593436e9243ce4d59bbefe698b858c6.jpg saved to cache
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa300d3f-dc66-54e3-9282-142dd4d25014
2026-03-30 10:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_5240d0474c2ba9e87a368fa29de073ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9c0d0>
2026-03-30 10:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_5240d0474c2ba9e87a368fa29de073ad.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_5240d0474c2ba9e87a368fa29de073ad.jpg saved to cache
2026-03-30 10:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa300d3f-dc66-54e3-9282-142dd4d25014
2026-03-30 10:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB39322/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XV64183/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_1b3b160a6a1ea64ce4570b143fde5af9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL98194/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea2490>
2026-03-30 10:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_1b3b160a6a1ea64ce4570b143fde5af9.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_1b3b160a6a1ea64ce4570b143fde5af9.jpg saved to cache
2026-03-30 10:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa300d3f-dc66-54e3-9282-142dd4d25014
2026-03-30 10:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_e421b8814beebd6dba995ac47a91dde9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_80c0ee9e2f2b2f1553c1e7e0d1924598.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef502d0>
2026-03-30 10:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_e421b8814beebd6dba995ac47a91dde9.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_e421b8814beebd6dba995ac47a91dde9.jpg saved to cache
2026-03-30 10:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa300d3f-dc66-54e3-9282-142dd4d25014
2026-03-30 10:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB71876> (referer: https://www.auto1.com/v1/car-details-view/UB71876/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d6150>
2026-03-30 10:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fa1%252F81a1372f5605efc4c24304fb78e493a7%252Fpa%252FUP63503_80c0ee9e2f2b2f1553c1e7e0d1924598.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_80c0ee9e2f2b2f1553c1e7e0d1924598.jpg saved to cache
2026-03-30 10:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa300d3f-dc66-54e3-9282-142dd4d25014
2026-03-30 10:48:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa300d3f-dc66-54e3-9282-142dd4d25014, skipping ID generation
2026-03-30 10:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa300d3f-dc66-54e3-9282-142dd4d25014 with scrape type 1
2026-03-30 10:48:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa300d3f-dc66-54e3-9282-142dd4d25014 sending to next pipeline
2026-03-30 10:48:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa300d3f-dc66-54e3-9282-142dd4d25014, identifier: UP63503
2026-03-30 10:48:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa300d3f-dc66-54e3-9282-142dd4d25014 with identifier: UP63503
2026-03-30 10:48:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa300d3f-dc66-54e3-9282-142dd4d25014 with identifier: UP63503
2026-03-30 10:48:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa300d3f-dc66-54e3-9282-142dd4d25014 with identifier: UP63503 to the API
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_80c0ee9e2f2b2f1553c1e7e0d1924598.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:48:58Z',
 'fuel_type': 'petrol',
 'id': 'aa300d3f-dc66-54e3-9282-142dd4d25014',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP63503',
 'listing': 'auction',
 'location': 'DE, Deggendorf',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 125110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2657802,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_e421b8814beebd6dba995ac47a91dde9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2814269,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_80c0ee9e2f2b2f1553c1e7e0d1924598.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2833057,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_1b3b160a6a1ea64ce4570b143fde5af9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2713845,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_5240d0474c2ba9e87a368fa29de073ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2737386,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_7593436e9243ce4d59bbefe698b858c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2793090,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_672329c41eb36eab0c839c70945a27d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2788612,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_ef1ed9d8e9009dfbd7665b6cb3bacf29.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2808014,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_dc033fb8d08554a2fa488f89ed141d62.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2684152,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_8cbd812c2a2c38df08596f375019adc0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa300d3f-dc66-54e3-9282-142dd4d25014/aa300d3f-dc66-54e3-9282-142dd4d25014_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2865727,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/a1/81a1372f5605efc4c24304fb78e493a7/pa/UP63503_7a7a05b899b80aff1d755a01389157e3.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2016}
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP63503%27 HTTP/1.1" 200 None
2026-03-30 10:48:39 [auto1.de] INFO: Saving data for UP63503: {'created_time': 1774867719.57418, 'last_price_update_time': 1774867719.57419, 'auction_closing_time': 1774972138.0}
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP63503') HTTP/1.1" 204 0
2026-03-30 10:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA33728> (referer: https://www.auto1.com/v1/car-details-view/CA33728/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14fe0efc-c1bb-57d6-9396-a69e9bdc519d with identifier: UB71876
2026-03-30 10:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14fe0efc-c1bb-57d6-9396-a69e9bdc519d with scrape type 1
2026-03-30 10:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14fe0efc-c1bb-57d6-9396-a69e9bdc519d
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_2a84c4aa1c115d4c934df794101a0ea7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_2a84c4aa1c115d4c934df794101a0ea7.jpg not downloaded yet
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_fc5da9deac40431546628b0d8696ae12.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_fc5da9deac40431546628b0d8696ae12.jpg not downloaded yet
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_e142817d07e501e4b5aae5a8d5fb3960.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_e142817d07e501e4b5aae5a8d5fb3960.jpg not downloaded yet
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_fef7e32e896d1d9f071202d3e7425878.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_fef7e32e896d1d9f071202d3e7425878.jpg not downloaded yet
2026-03-30 10:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK45501> (referer: https://www.auto1.com/v1/car-details-view/ZK45501/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36ba424a-0106-5d63-857e-86729de7e7ad with identifier: CA33728
2026-03-30 10:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36ba424a-0106-5d63-857e-86729de7e7ad with scrape type 1
2026-03-30 10:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 36ba424a-0106-5d63-857e-86729de7e7ad
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F23%252F8923026f9d4b3e1c9c7ca6a3829b5343%252Fpa%252FCA33728_608154e59d0e6f4543f3d971e927c10e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/23/8923026f9d4b3e1c9c7ca6a3829b5343/pa/CA33728_608154e59d0e6f4543f3d971e927c10e.jpg already downloaded
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F23%252F8923026f9d4b3e1c9c7ca6a3829b5343%252Fpa%252FCA33728_6ed9cac0507d435b52126c9537709588.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/23/8923026f9d4b3e1c9c7ca6a3829b5343/pa/CA33728_6ed9cac0507d435b52126c9537709588.jpg already downloaded
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F23%252F8923026f9d4b3e1c9c7ca6a3829b5343%252Fpa%252FCA33728_b9c13666dcf726a0705a1d21b69df382.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/23/8923026f9d4b3e1c9c7ca6a3829b5343/pa/CA33728_b9c13666dcf726a0705a1d21b69df382.jpg already downloaded
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F23%252F8923026f9d4b3e1c9c7ca6a3829b5343%252Fpa%252FCA33728_9e62853f71a43ed68e9b2c361e83f95e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/23/8923026f9d4b3e1c9c7ca6a3829b5343/pa/CA33728_9e62853f71a43ed68e9b2c361e83f95e.jpg already downloaded
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F23%252F8923026f9d4b3e1c9c7ca6a3829b5343%252Fpa%252FCA33728_84cc49d3ed1e484948fd43a47f4eb430.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/23/8923026f9d4b3e1c9c7ca6a3829b5343/pa/CA33728_84cc49d3ed1e484948fd43a47f4eb430.jpg already downloaded
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F23%252F8923026f9d4b3e1c9c7ca6a3829b5343%252Fpa%252FCA33728_300297f9c6e1af1b147dc4bc5185d252.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/23/8923026f9d4b3e1c9c7ca6a3829b5343/pa/CA33728_300297f9c6e1af1b147dc4bc5185d252.jpg already downloaded
2026-03-30 10:48:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36ba424a-0106-5d63-857e-86729de7e7ad, identifier: CA33728
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_fd558d8c86f77fc544e24305157c5cb4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_fd558d8c86f77fc544e24305157c5cb4.jpg not downloaded yet
2026-03-30 10:48:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36ba424a-0106-5d63-857e-86729de7e7ad with identifier: CA33728
2026-03-30 10:48:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36ba424a-0106-5d63-857e-86729de7e7ad with identifier: CA33728
2026-03-30 10:48:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36ba424a-0106-5d63-857e-86729de7e7ad with identifier: CA33728 to the API
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CA33728>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:30:18Z',
 'fuel_type': 'petrol',
 'id': '36ba424a-0106-5d63-857e-86729de7e7ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA33728',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 221275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img89/23/8923026f9d4b3e1c9c7ca6a3829b5343/pa/CA33728_608154e59d0e6f4543f3d971e927c10e.jpg',
                'https://img-pa.auto1.com/img89/23/8923026f9d4b3e1c9c7ca6a3829b5343/pa/CA33728_6ed9cac0507d435b52126c9537709588.jpg',
                'https://img-pa.auto1.com/img89/23/8923026f9d4b3e1c9c7ca6a3829b5343/pa/CA33728_b9c13666dcf726a0705a1d21b69df382.jpg',
                'https://img-pa.auto1.com/img89/23/8923026f9d4b3e1c9c7ca6a3829b5343/pa/CA33728_9e62853f71a43ed68e9b2c361e83f95e.jpg',
                'https://img-pa.auto1.com/img89/23/8923026f9d4b3e1c9c7ca6a3829b5343/pa/CA33728_84cc49d3ed1e484948fd43a47f4eb430.jpg',
                'https://img-pa.auto1.com/img89/23/8923026f9d4b3e1c9c7ca6a3829b5343/pa/CA33728_300297f9c6e1af1b147dc4bc5185d252.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ba424a-0106-5d63-857e-86729de7e7ad/36ba424a-0106-5d63-857e-86729de7e7ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/23/8923026f9d4b3e1c9c7ca6a3829b5343/pa/CA33728_608154e59d0e6f4543f3d971e927c10e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ba424a-0106-5d63-857e-86729de7e7ad/36ba424a-0106-5d63-857e-86729de7e7ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/23/8923026f9d4b3e1c9c7ca6a3829b5343/pa/CA33728_6ed9cac0507d435b52126c9537709588.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ba424a-0106-5d63-857e-86729de7e7ad/36ba424a-0106-5d63-857e-86729de7e7ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/23/8923026f9d4b3e1c9c7ca6a3829b5343/pa/CA33728_b9c13666dcf726a0705a1d21b69df382.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ba424a-0106-5d63-857e-86729de7e7ad/36ba424a-0106-5d63-857e-86729de7e7ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/23/8923026f9d4b3e1c9c7ca6a3829b5343/pa/CA33728_9e62853f71a43ed68e9b2c361e83f95e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ba424a-0106-5d63-857e-86729de7e7ad/36ba424a-0106-5d63-857e-86729de7e7ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/23/8923026f9d4b3e1c9c7ca6a3829b5343/pa/CA33728_84cc49d3ed1e484948fd43a47f4eb430.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ba424a-0106-5d63-857e-86729de7e7ad/36ba424a-0106-5d63-857e-86729de7e7ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/23/8923026f9d4b3e1c9c7ca6a3829b5343/pa/CA33728_300297f9c6e1af1b147dc4bc5185d252.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Jazz 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA33728%27 HTTP/1.1" 200 None
2026-03-30 10:48:40 [auto1.de] INFO: Saving data for CA33728: {'created_time': 1774867720.305228, 'last_price_update_time': 1774867720.305242, 'auction_closing_time': 1774971018.0}
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA33728') HTTP/1.1" 204 0
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_8f921b0f632d3a3a74b960ccf4c5b738.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_8f921b0f632d3a3a74b960ccf4c5b738.jpg not downloaded yet
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_c8284c4703d4d7b0ff6f8ff0dc364362.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_c8284c4703d4d7b0ff6f8ff0dc364362.jpg not downloaded yet
2026-03-30 10:48:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12547a9a-c705-52f5-a857-23663bbc2fd7 with identifier: ZK45501
2026-03-30 10:48:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12547a9a-c705-52f5-a857-23663bbc2fd7 with scrape type 1
2026-03-30 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 12547a9a-c705-52f5-a857-23663bbc2fd7
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_0795f46783806adf3e050bd309167504.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_0795f46783806adf3e050bd309167504.jpg not downloaded yet
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_3be57218e4ccbf52ea9184eb6b093623.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_3be57218e4ccbf52ea9184eb6b093623.jpg not downloaded yet
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_97b5fb92737329ea7bb8dfebd743cce7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_97b5fb92737329ea7bb8dfebd743cce7.jpg not downloaded yet
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_639daa9183b084a30c8407526b99d6a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_639daa9183b084a30c8407526b99d6a8.jpg not downloaded yet
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_4b4deab5a451bb1f49107cd798057100.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_4b4deab5a451bb1f49107cd798057100.jpg not downloaded yet
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_5e5e2ecbceea8c5cf9f64cd6eafcd8ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_5e5e2ecbceea8c5cf9f64cd6eafcd8ca.jpg not downloaded yet
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_fe456bbe206dc64b00e50c0fcba9a10a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_fe456bbe206dc64b00e50c0fcba9a10a.jpg not downloaded yet
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_253beebf00af992613deae20e6763e45.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_253beebf00af992613deae20e6763e45.jpg not downloaded yet
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_22273136d0a96cf3d573bd937705f3ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_22273136d0a96cf3d573bd937705f3ac.jpg not downloaded yet
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_14e0860cd96a3c5d5629f296b18444da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_14e0860cd96a3c5d5629f296b18444da.jpg not downloaded yet
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_4621cd3322fdcd346323f6564d8263f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_4621cd3322fdcd346323f6564d8263f2.jpg not downloaded yet
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_fb96e0fc4e9aa1b5fb54a58d810b889c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_fb96e0fc4e9aa1b5fb54a58d810b889c.jpg not downloaded yet
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_22b2a87836e07df2911efa985c7fa2b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_22b2a87836e07df2911efa985c7fa2b8.jpg not downloaded yet
2026-03-30 10:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_fef7e32e896d1d9f071202d3e7425878.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_22b2a87836e07df2911efa985c7fa2b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeee1c50>
2026-03-30 10:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_fef7e32e896d1d9f071202d3e7425878.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_fef7e32e896d1d9f071202d3e7425878.jpg saved to cache
2026-03-30 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14fe0efc-c1bb-57d6-9396-a69e9bdc519d
2026-03-30 10:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_fb96e0fc4e9aa1b5fb54a58d810b889c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3eae90>
2026-03-30 10:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_22b2a87836e07df2911efa985c7fa2b8.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_22b2a87836e07df2911efa985c7fa2b8.jpg saved to cache
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 12547a9a-c705-52f5-a857-23663bbc2fd7
2026-03-30 10:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_4621cd3322fdcd346323f6564d8263f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee486790>
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_fb96e0fc4e9aa1b5fb54a58d810b889c.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_fb96e0fc4e9aa1b5fb54a58d810b889c.jpg saved to cache
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 12547a9a-c705-52f5-a857-23663bbc2fd7
2026-03-30 10:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY24901> (referer: https://www.auto1.com/v1/car-details-view/NY24901/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd5b10>
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_4621cd3322fdcd346323f6564d8263f2.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_4621cd3322fdcd346323f6564d8263f2.jpg saved to cache
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 12547a9a-c705-52f5-a857-23663bbc2fd7
2026-03-30 10:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_22273136d0a96cf3d573bd937705f3ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36a9bd9b-2882-5388-a1a2-f63e536ffd85 with identifier: NY24901
2026-03-30 10:48:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36a9bd9b-2882-5388-a1a2-f63e536ffd85 with scrape type 1
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36a9bd9b-2882-5388-a1a2-f63e536ffd85
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_73309dffdd702f48197bc77e44954b23.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_73309dffdd702f48197bc77e44954b23.jpg not downloaded yet
2026-03-30 10:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_253beebf00af992613deae20e6763e45.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_bd4f862c8a3a6e6f2c0ea0121eab0d6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_bd4f862c8a3a6e6f2c0ea0121eab0d6f.jpg not downloaded yet
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_064a6e2a5bfc8d67610655df09c9f456.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_064a6e2a5bfc8d67610655df09c9f456.jpg not downloaded yet
2026-03-30 10:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_14e0860cd96a3c5d5629f296b18444da.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_5a951785b6b0a831d0793a5d70490bdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_5a951785b6b0a831d0793a5d70490bdc.jpg not downloaded yet
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_1400e7f5409605b108319e30ec0b4c5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_1400e7f5409605b108319e30ec0b4c5a.jpg not downloaded yet
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41f15d0>
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_22273136d0a96cf3d573bd937705f3ac.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_22273136d0a96cf3d573bd937705f3ac.jpg saved to cache
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12547a9a-c705-52f5-a857-23663bbc2fd7
2026-03-30 10:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_73309dffdd702f48197bc77e44954b23.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_5282b7d91e418c7328eedfebcbba785d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_5282b7d91e418c7328eedfebcbba785d.jpg not downloaded yet
2026-03-30 10:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_064a6e2a5bfc8d67610655df09c9f456.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_0a965a352ec451d95e64c9c8fc407747.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_0a965a352ec451d95e64c9c8fc407747.jpg not downloaded yet
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_04d6930e8e93b14ca046a5c3480ef28d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_04d6930e8e93b14ca046a5c3480ef28d.jpg not downloaded yet
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3e390>
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_253beebf00af992613deae20e6763e45.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_253beebf00af992613deae20e6763e45.jpg saved to cache
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12547a9a-c705-52f5-a857-23663bbc2fd7
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee82b10>
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_14e0860cd96a3c5d5629f296b18444da.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_14e0860cd96a3c5d5629f296b18444da.jpg saved to cache
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 12547a9a-c705-52f5-a857-23663bbc2fd7
2026-03-30 10:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_1400e7f5409605b108319e30ec0b4c5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_d28b5619e485a185e8435e1adcb23e9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_d28b5619e485a185e8435e1adcb23e9a.jpg not downloaded yet
2026-03-30 10:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_5a951785b6b0a831d0793a5d70490bdc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_afec11e25dc86022bf72c39bb57cd7c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_afec11e25dc86022bf72c39bb57cd7c7.jpg not downloaded yet
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42b6550>
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_73309dffdd702f48197bc77e44954b23.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_73309dffdd702f48197bc77e44954b23.jpg saved to cache
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36a9bd9b-2882-5388-a1a2-f63e536ffd85
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef38910>
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_064a6e2a5bfc8d67610655df09c9f456.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_064a6e2a5bfc8d67610655df09c9f456.jpg saved to cache
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36a9bd9b-2882-5388-a1a2-f63e536ffd85
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeebe050>
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_1400e7f5409605b108319e30ec0b4c5a.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_1400e7f5409605b108319e30ec0b4c5a.jpg saved to cache
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36a9bd9b-2882-5388-a1a2-f63e536ffd85
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeed2810>
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_5a951785b6b0a831d0793a5d70490bdc.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_5a951785b6b0a831d0793a5d70490bdc.jpg saved to cache
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36a9bd9b-2882-5388-a1a2-f63e536ffd85
2026-03-30 10:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_04d6930e8e93b14ca046a5c3480ef28d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_d28b5619e485a185e8435e1adcb23e9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_afec11e25dc86022bf72c39bb57cd7c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_0a965a352ec451d95e64c9c8fc407747.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd7a50>
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_04d6930e8e93b14ca046a5c3480ef28d.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_04d6930e8e93b14ca046a5c3480ef28d.jpg saved to cache
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36a9bd9b-2882-5388-a1a2-f63e536ffd85
2026-03-30 10:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_bd4f862c8a3a6e6f2c0ea0121eab0d6f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4199510>
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_d28b5619e485a185e8435e1adcb23e9a.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_d28b5619e485a185e8435e1adcb23e9a.jpg saved to cache
2026-03-30 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36a9bd9b-2882-5388-a1a2-f63e536ffd85
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4174310>
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_afec11e25dc86022bf72c39bb57cd7c7.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_afec11e25dc86022bf72c39bb57cd7c7.jpg saved to cache
2026-03-30 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36a9bd9b-2882-5388-a1a2-f63e536ffd85
2026-03-30 10:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_fe456bbe206dc64b00e50c0fcba9a10a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a3610>
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_0a965a352ec451d95e64c9c8fc407747.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_0a965a352ec451d95e64c9c8fc407747.jpg saved to cache
2026-03-30 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36a9bd9b-2882-5388-a1a2-f63e536ffd85
2026-03-30 10:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VD77751> (referer: https://www.auto1.com/v1/car-details-view/VD77751/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeed6d0>
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_bd4f862c8a3a6e6f2c0ea0121eab0d6f.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_bd4f862c8a3a6e6f2c0ea0121eab0d6f.jpg saved to cache
2026-03-30 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36a9bd9b-2882-5388-a1a2-f63e536ffd85
2026-03-30 10:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_5282b7d91e418c7328eedfebcbba785d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419cdd0>
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_fe456bbe206dc64b00e50c0fcba9a10a.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_fe456bbe206dc64b00e50c0fcba9a10a.jpg saved to cache
2026-03-30 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12547a9a-c705-52f5-a857-23663bbc2fd7
2026-03-30 10:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_4b4deab5a451bb1f49107cd798057100.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6ac1913-e626-5979-9d77-af3eb7f11c25 with identifier: VD77751
2026-03-30 10:48:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6ac1913-e626-5979-9d77-af3eb7f11c25 with scrape type 1
2026-03-30 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b6ac1913-e626-5979-9d77-af3eb7f11c25
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F4d%252Fd04ded43a63833d5a71b29db4f0987dc%252Fpa%252FVD77751_ba769ed5dd9bd0f4d5527f3e542dff4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/4d/d04ded43a63833d5a71b29db4f0987dc/pa/VD77751_ba769ed5dd9bd0f4d5527f3e542dff4f.jpg already downloaded
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F4d%252Fd04ded43a63833d5a71b29db4f0987dc%252Fpa%252FVD77751_670e66aa4b04d977ea6303c5951e7d70.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/4d/d04ded43a63833d5a71b29db4f0987dc/pa/VD77751_670e66aa4b04d977ea6303c5951e7d70.jpg already downloaded
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F4d%252Fd04ded43a63833d5a71b29db4f0987dc%252Fpa%252FVD77751_d0ac26078d40d1fa751ee352077bdcd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/4d/d04ded43a63833d5a71b29db4f0987dc/pa/VD77751_d0ac26078d40d1fa751ee352077bdcd2.jpg already downloaded
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F4d%252Fd04ded43a63833d5a71b29db4f0987dc%252Fpa%252FVD77751_5f96574c521433ac7b9503aeb4d9089c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/4d/d04ded43a63833d5a71b29db4f0987dc/pa/VD77751_5f96574c521433ac7b9503aeb4d9089c.jpg already downloaded
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F4d%252Fd04ded43a63833d5a71b29db4f0987dc%252Fpa%252FVD77751_7693f26fa09bada32583bfaf4bc486a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/4d/d04ded43a63833d5a71b29db4f0987dc/pa/VD77751_7693f26fa09bada32583bfaf4bc486a7.jpg already downloaded
2026-03-30 10:48:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6ac1913-e626-5979-9d77-af3eb7f11c25, identifier: VD77751
2026-03-30 10:48:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6ac1913-e626-5979-9d77-af3eb7f11c25 with identifier: VD77751
2026-03-30 10:48:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6ac1913-e626-5979-9d77-af3eb7f11c25 with identifier: VD77751
2026-03-30 10:48:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6ac1913-e626-5979-9d77-af3eb7f11c25 with identifier: VD77751 to the API
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VD77751>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.8L',
 'engine_horse_power': 193,
 'expiration_date': '2026-03-31T15:44:20Z',
 'fuel_type': 'petrol',
 'id': 'b6ac1913-e626-5979-9d77-af3eb7f11c25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD77751',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 185044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgd0/4d/d04ded43a63833d5a71b29db4f0987dc/pa/VD77751_ba769ed5dd9bd0f4d5527f3e542dff4f.jpg',
                'https://img-pa.auto1.com/imgd0/4d/d04ded43a63833d5a71b29db4f0987dc/pa/VD77751_670e66aa4b04d977ea6303c5951e7d70.jpg',
                'https://img-pa.auto1.com/imgd0/4d/d04ded43a63833d5a71b29db4f0987dc/pa/VD77751_d0ac26078d40d1fa751ee352077bdcd2.jpg',
                'https://img-pa.auto1.com/imgd0/4d/d04ded43a63833d5a71b29db4f0987dc/pa/VD77751_5f96574c521433ac7b9503aeb4d9089c.jpg',
                'https://img-pa.auto1.com/imgd0/4d/d04ded43a63833d5a71b29db4f0987dc/pa/VD77751_7693f26fa09bada32583bfaf4bc486a7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6ac1913-e626-5979-9d77-af3eb7f11c25/b6ac1913-e626-5979-9d77-af3eb7f11c25_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/4d/d04ded43a63833d5a71b29db4f0987dc/pa/VD77751_ba769ed5dd9bd0f4d5527f3e542dff4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6ac1913-e626-5979-9d77-af3eb7f11c25/b6ac1913-e626-5979-9d77-af3eb7f11c25_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/4d/d04ded43a63833d5a71b29db4f0987dc/pa/VD77751_670e66aa4b04d977ea6303c5951e7d70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6ac1913-e626-5979-9d77-af3eb7f11c25/b6ac1913-e626-5979-9d77-af3eb7f11c25_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/4d/d04ded43a63833d5a71b29db4f0987dc/pa/VD77751_d0ac26078d40d1fa751ee352077bdcd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6ac1913-e626-5979-9d77-af3eb7f11c25/b6ac1913-e626-5979-9d77-af3eb7f11c25_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/4d/d04ded43a63833d5a71b29db4f0987dc/pa/VD77751_5f96574c521433ac7b9503aeb4d9089c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6ac1913-e626-5979-9d77-af3eb7f11c25/b6ac1913-e626-5979-9d77-af3eb7f11c25_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/4d/d04ded43a63833d5a71b29db4f0987dc/pa/VD77751_7693f26fa09bada32583bfaf4bc486a7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1997-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.8 V6',
 'transmission': 'automatic',
 'trim': '',
 'year': 1997}
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD77751%27 HTTP/1.1" 200 None
2026-03-30 10:48:42 [auto1.de] INFO: Saving data for VD77751: {'created_time': 1774867722.805878, 'last_price_update_time': 1774867722.805888, 'auction_closing_time': 1774971860.0}
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VD77751') HTTP/1.1" 204 0
2026-03-30 10:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LK02148> (referer: https://www.auto1.com/v1/car-details-view/LK02148/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3ebf90>
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F93%252F6593bd47b566550071d42b01ad2e0fb9%252Fpa%252FNY24901_5282b7d91e418c7328eedfebcbba785d.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_5282b7d91e418c7328eedfebcbba785d.jpg saved to cache
2026-03-30 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36a9bd9b-2882-5388-a1a2-f63e536ffd85
2026-03-30 10:48:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36a9bd9b-2882-5388-a1a2-f63e536ffd85, skipping ID generation
2026-03-30 10:48:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36a9bd9b-2882-5388-a1a2-f63e536ffd85 with scrape type 1
2026-03-30 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36a9bd9b-2882-5388-a1a2-f63e536ffd85 sending to next pipeline
2026-03-30 10:48:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36a9bd9b-2882-5388-a1a2-f63e536ffd85, identifier: NY24901
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4140e10>
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_4b4deab5a451bb1f49107cd798057100.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_4b4deab5a451bb1f49107cd798057100.jpg saved to cache
2026-03-30 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12547a9a-c705-52f5-a857-23663bbc2fd7
2026-03-30 10:48:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36a9bd9b-2882-5388-a1a2-f63e536ffd85 with identifier: NY24901
2026-03-30 10:48:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36a9bd9b-2882-5388-a1a2-f63e536ffd85 with identifier: NY24901
2026-03-30 10:48:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36a9bd9b-2882-5388-a1a2-f63e536ffd85 with identifier: NY24901 to the API
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_5282b7d91e418c7328eedfebcbba785d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:41:38Z',
 'fuel_type': 'petrol',
 'id': '36a9bd9b-2882-5388-a1a2-f63e536ffd85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY24901',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 26365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 45,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_73309dffdd702f48197bc77e44954b23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_bd4f862c8a3a6e6f2c0ea0121eab0d6f.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_064a6e2a5bfc8d67610655df09c9f456.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_5a951785b6b0a831d0793a5d70490bdc.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_1400e7f5409605b108319e30ec0b4c5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_5282b7d91e418c7328eedfebcbba785d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_0a965a352ec451d95e64c9c8fc407747.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_04d6930e8e93b14ca046a5c3480ef28d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_d28b5619e485a185e8435e1adcb23e9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9bd9b-2882-5388-a1a2-f63e536ffd85/36a9bd9b-2882-5388-a1a2-f63e536ffd85_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/93/6593bd47b566550071d42b01ad2e0fb9/pa/NY24901_afec11e25dc86022bf72c39bb57cd7c7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2024}
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY24901%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [auto1.de] INFO: Saving data for NY24901: {'created_time': 1774867723.662047, 'last_price_update_time': 1774867723.66206, 'auction_closing_time': 1774971698.0}
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY24901') HTTP/1.1" 204 0
2026-03-30 10:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_97b5fb92737329ea7bb8dfebd743cce7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5fedb96-1e83-5892-ab8c-ca959d78acca with identifier: LK02148
2026-03-30 10:48:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5fedb96-1e83-5892-ab8c-ca959d78acca with scrape type 1
2026-03-30 10:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a5fedb96-1e83-5892-ab8c-ca959d78acca
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F75%252F4f75968f9ce20dd2e021cac07b31c04f%252Fpa%252FLK02148_2fa4276bde98d3a0db9c2cbd877bf0e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_2fa4276bde98d3a0db9c2cbd877bf0e1.jpg already downloaded
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F75%252F4f75968f9ce20dd2e021cac07b31c04f%252Fpa%252FLK02148_e52f88ea0e2924ee582f64a72bc2faa0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_e52f88ea0e2924ee582f64a72bc2faa0.jpg already downloaded
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F75%252F4f75968f9ce20dd2e021cac07b31c04f%252Fpa%252FLK02148_4e6d464a85a392f17c91d82e7aa61aa2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_4e6d464a85a392f17c91d82e7aa61aa2.jpg already downloaded
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F75%252F4f75968f9ce20dd2e021cac07b31c04f%252Fpa%252FLK02148_aaf44977c7c256f0bdf184f5039dc31b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_aaf44977c7c256f0bdf184f5039dc31b.jpg already downloaded
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F75%252F4f75968f9ce20dd2e021cac07b31c04f%252Fpa%252FLK02148_7b4780276f9733c7be393a0109cd4cbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_7b4780276f9733c7be393a0109cd4cbd.jpg already downloaded
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F75%252F4f75968f9ce20dd2e021cac07b31c04f%252Fpa%252FLK02148_b3feff05a321da56ba150e491e0dca15.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_b3feff05a321da56ba150e491e0dca15.jpg already downloaded
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F75%252F4f75968f9ce20dd2e021cac07b31c04f%252Fpa%252FLK02148_c8c3928f2fb05361c482579cd8115efc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_c8c3928f2fb05361c482579cd8115efc.jpg already downloaded
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F75%252F4f75968f9ce20dd2e021cac07b31c04f%252Fpa%252FLK02148_ff7107c7d21b9a3ffb7dc151b4a098af.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_ff7107c7d21b9a3ffb7dc151b4a098af.jpg already downloaded
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F75%252F4f75968f9ce20dd2e021cac07b31c04f%252Fpa%252FLK02148_b62c79c89c001bd77e79498a4b9fc56c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_b62c79c89c001bd77e79498a4b9fc56c.jpg already downloaded
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F75%252F4f75968f9ce20dd2e021cac07b31c04f%252Fpa%252FLK02148_247c920252d6b358f54c9a326f864ec0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_247c920252d6b358f54c9a326f864ec0.jpg already downloaded
2026-03-30 10:48:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5fedb96-1e83-5892-ab8c-ca959d78acca, identifier: LK02148
2026-03-30 10:48:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5fedb96-1e83-5892-ab8c-ca959d78acca with identifier: LK02148
2026-03-30 10:48:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5fedb96-1e83-5892-ab8c-ca959d78acca with identifier: LK02148
2026-03-30 10:48:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5fedb96-1e83-5892-ab8c-ca959d78acca with identifier: LK02148 to the API
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LK02148>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:01:25Z',
 'fuel_type': 'diesel',
 'id': 'a5fedb96-1e83-5892-ab8c-ca959d78acca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK02148',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 214525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_2fa4276bde98d3a0db9c2cbd877bf0e1.jpg',
                'https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_e52f88ea0e2924ee582f64a72bc2faa0.jpg',
                'https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_4e6d464a85a392f17c91d82e7aa61aa2.jpg',
                'https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_aaf44977c7c256f0bdf184f5039dc31b.jpg',
                'https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_7b4780276f9733c7be393a0109cd4cbd.jpg',
                'https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_b3feff05a321da56ba150e491e0dca15.jpg',
                'https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_c8c3928f2fb05361c482579cd8115efc.jpg',
                'https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_ff7107c7d21b9a3ffb7dc151b4a098af.jpg',
                'https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_b62c79c89c001bd77e79498a4b9fc56c.jpg',
                'https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_247c920252d6b358f54c9a326f864ec0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5fedb96-1e83-5892-ab8c-ca959d78acca/a5fedb96-1e83-5892-ab8c-ca959d78acca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_2fa4276bde98d3a0db9c2cbd877bf0e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5fedb96-1e83-5892-ab8c-ca959d78acca/a5fedb96-1e83-5892-ab8c-ca959d78acca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2751272,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_e52f88ea0e2924ee582f64a72bc2faa0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5fedb96-1e83-5892-ab8c-ca959d78acca/a5fedb96-1e83-5892-ab8c-ca959d78acca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2942621,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_4e6d464a85a392f17c91d82e7aa61aa2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5fedb96-1e83-5892-ab8c-ca959d78acca/a5fedb96-1e83-5892-ab8c-ca959d78acca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2897674,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_aaf44977c7c256f0bdf184f5039dc31b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5fedb96-1e83-5892-ab8c-ca959d78acca/a5fedb96-1e83-5892-ab8c-ca959d78acca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2954001,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_7b4780276f9733c7be393a0109cd4cbd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5fedb96-1e83-5892-ab8c-ca959d78acca/a5fedb96-1e83-5892-ab8c-ca959d78acca_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2861789,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_b3feff05a321da56ba150e491e0dca15.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5fedb96-1e83-5892-ab8c-ca959d78acca/a5fedb96-1e83-5892-ab8c-ca959d78acca_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_c8c3928f2fb05361c482579cd8115efc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5fedb96-1e83-5892-ab8c-ca959d78acca/a5fedb96-1e83-5892-ab8c-ca959d78acca_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2858680,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_ff7107c7d21b9a3ffb7dc151b4a098af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5fedb96-1e83-5892-ab8c-ca959d78acca/a5fedb96-1e83-5892-ab8c-ca959d78acca_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2790554,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_b62c79c89c001bd77e79498a4b9fc56c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5fedb96-1e83-5892-ab8c-ca959d78acca/a5fedb96-1e83-5892-ab8c-ca959d78acca_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2931508,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/75/4f75968f9ce20dd2e021cac07b31c04f/pa/LK02148_247c920252d6b358f54c9a326f864ec0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2014}
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK02148%27 HTTP/1.1" 200 None
2026-03-30 10:48:44 [auto1.de] INFO: Saving data for LK02148: {'created_time': 1774867724.341471, 'last_price_update_time': 1774867724.341487, 'auction_closing_time': 1774969285.0}
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK02148') HTTP/1.1" 204 0
2026-03-30 10:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefb4a50>
2026-03-30 10:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_97b5fb92737329ea7bb8dfebd743cce7.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_97b5fb92737329ea7bb8dfebd743cce7.jpg saved to cache
2026-03-30 10:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12547a9a-c705-52f5-a857-23663bbc2fd7
2026-03-30 10:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_0795f46783806adf3e050bd309167504.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_5e5e2ecbceea8c5cf9f64cd6eafcd8ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_639daa9183b084a30c8407526b99d6a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM56350> (referer: https://www.auto1.com/v1/car-details-view/MM56350/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_3be57218e4ccbf52ea9184eb6b093623.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef0fa90>
2026-03-30 10:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F00%252F8300f47844b903ae9c16eb049ffdeb4e%252Fpa%252FZK45501_0795f46783806adf3e050bd309167504.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_0795f46783806adf3e050bd309167504.jpg saved to cache
2026-03-30 10:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12547a9a-c705-52f5-a857-23663bbc2fd7
2026-03-30 10:48:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12547a9a-c705-52f5-a857-23663bbc2fd7, skipping ID generation
2026-03-30 10:48:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12547a9a-c705-52f5-a857-23663bbc2fd7 with scrape type 1
2026-03-30 10:48:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12547a9a-c705-52f5-a857-23663bbc2fd7 sending to next pipeline
2026-03-30 10:48:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12547a9a-c705-52f5-a857-23663bbc2fd7, identifier: ZK45501
2026-03-30 10:48:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12547a9a-c705-52f5-a857-23663bbc2fd7 with identifier: ZK45501
2026-03-30 10:48:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12547a9a-c705-52f5-a857-23663bbc2fd7 with identifier: ZK45501
2026-03-30 10:48:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12547a9a-c705-52f5-a857-23663bbc2fd7 with identifier: ZK45501 to the API
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_0795f46783806adf3e050bd309167504.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:17:10Z',
 'fuel_type': 'diesel',
 'id': '12547a9a-c705-52f5-a857-23663bbc2fd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK45501',
 'listing': 'auction',
 'location': 'DE, Gummersbach',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 135675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_0795f46783806adf3e050bd309167504.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_97b5fb92737329ea7bb8dfebd743cce7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_4b4deab5a451bb1f49107cd798057100.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_fe456bbe206dc64b00e50c0fcba9a10a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_253beebf00af992613deae20e6763e45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_22273136d0a96cf3d573bd937705f3ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_14e0860cd96a3c5d5629f296b18444da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_4621cd3322fdcd346323f6564d8263f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_fb96e0fc4e9aa1b5fb54a58d810b889c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12547a9a-c705-52f5-a857-23663bbc2fd7/12547a9a-c705-52f5-a857-23663bbc2fd7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/00/8300f47844b903ae9c16eb049ffdeb4e/pa/ZK45501_22b2a87836e07df2911efa985c7fa2b8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 CRDi Finale AWD',
 'transmission': 'manual',
 'trim': 'Finale AWD',
 'year': 2015}
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK45501%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [auto1.de] INFO: Saving data for ZK45501: {'created_time': 1774867725.040862, 'last_price_update_time': 1774867725.040882, 'auction_closing_time': 1774970230.0}
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK45501') HTTP/1.1" 204 0
2026-03-30 10:48:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee483610>
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_5e5e2ecbceea8c5cf9f64cd6eafcd8ca.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_5e5e2ecbceea8c5cf9f64cd6eafcd8ca.jpg saved to cache
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14fe0efc-c1bb-57d6-9396-a69e9bdc519d
2026-03-30 10:48:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef388d0>
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_639daa9183b084a30c8407526b99d6a8.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_639daa9183b084a30c8407526b99d6a8.jpg saved to cache
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14fe0efc-c1bb-57d6-9396-a69e9bdc519d
2026-03-30 10:48:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55 with identifier: MM56350
2026-03-30 10:48:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55 with scrape type 1
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_30bb0717927bfaccbc5ce41d277308ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_30bb0717927bfaccbc5ce41d277308ca.jpg not downloaded yet
2026-03-30 10:48:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee415c50>
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_3be57218e4ccbf52ea9184eb6b093623.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_3be57218e4ccbf52ea9184eb6b093623.jpg saved to cache
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14fe0efc-c1bb-57d6-9396-a69e9bdc519d
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_f6d6d2a904bea735cd810c6c384f9862.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_f6d6d2a904bea735cd810c6c384f9862.jpg not downloaded yet
2026-03-30 10:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JV19654> (referer: https://www.auto1.com/v1/car-details-view/JV19654/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_aea459008419448ddf48de14692a54ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_aea459008419448ddf48de14692a54ac.jpg not downloaded yet
2026-03-30 10:48:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_cca18c4e6f5c2d8dfe37771384f41383.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_cca18c4e6f5c2d8dfe37771384f41383.jpg not downloaded yet
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_40bbf76c5c95ff2714a6203761c78100.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_40bbf76c5c95ff2714a6203761c78100.jpg not downloaded yet
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_8463605e353b97af4aff194a1d7a87bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_8463605e353b97af4aff194a1d7a87bc.jpg not downloaded yet
2026-03-30 10:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_30bb0717927bfaccbc5ce41d277308ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_a1bff4a15976e1c7c9a76c670e85c085.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_a1bff4a15976e1c7c9a76c670e85c085.jpg not downloaded yet
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_d4a6a98cae625868d6ad1af7a8f9bf93.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_d4a6a98cae625868d6ad1af7a8f9bf93.jpg not downloaded yet
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_5265a7b60f1911c419017224ca00101a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_5265a7b60f1911c419017224ca00101a.jpg not downloaded yet
2026-03-30 10:48:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b56a6af0-bef3-5389-a19f-340f8709acbe with identifier: JV19654
2026-03-30 10:48:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b56a6af0-bef3-5389-a19f-340f8709acbe with scrape type 1
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b56a6af0-bef3-5389-a19f-340f8709acbe
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_b1bb5cc63bdb0fe5af37a20cf3c144a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_b1bb5cc63bdb0fe5af37a20cf3c144a1.jpg not downloaded yet
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_6af76a23edf2d85f43924b5871e09e24.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_6af76a23edf2d85f43924b5871e09e24.jpg not downloaded yet
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_5f2ef2c88dcfac781e4cdc5361a6692e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_5f2ef2c88dcfac781e4cdc5361a6692e.jpg not downloaded yet
2026-03-30 10:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_f6d6d2a904bea735cd810c6c384f9862.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_8463605e353b97af4aff194a1d7a87bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_25978a47825e245cb7e87ba61244014d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_25978a47825e245cb7e87ba61244014d.jpg not downloaded yet
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef7c110>
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_30bb0717927bfaccbc5ce41d277308ca.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_30bb0717927bfaccbc5ce41d277308ca.jpg saved to cache
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_41a280345b1bd8494e21efd4f6b84e2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_41a280345b1bd8494e21efd4f6b84e2c.jpg not downloaded yet
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_b631d2c14a03b00c4011fc872004804e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_b631d2c14a03b00c4011fc872004804e.jpg not downloaded yet
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_3bd2ec18defba1b4905045e4ee240c67.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_3bd2ec18defba1b4905045e4ee240c67.jpg not downloaded yet
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee04a10>
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_f6d6d2a904bea735cd810c6c384f9862.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_f6d6d2a904bea735cd810c6c384f9862.jpg saved to cache
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea1450>
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_8463605e353b97af4aff194a1d7a87bc.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_8463605e353b97af4aff194a1d7a87bc.jpg saved to cache
2026-03-30 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_b43d4613c9cafbe870f12b3e64630039.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_b43d4613c9cafbe870f12b3e64630039.jpg not downloaded yet
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_4dab3618180c2ec350c0c8ce6cda8a16.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_4dab3618180c2ec350c0c8ce6cda8a16.jpg not downloaded yet
2026-03-30 10:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_6af76a23edf2d85f43924b5871e09e24.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_cf49954fd26e2e2228b7576a1afb32af.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_cf49954fd26e2e2228b7576a1afb32af.jpg not downloaded yet
2026-03-30 10:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_5f2ef2c88dcfac781e4cdc5361a6692e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_e01c52bb2c881c04798238c3bd946ef1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_e01c52bb2c881c04798238c3bd946ef1.jpg not downloaded yet
2026-03-30 10:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_c8284c4703d4d7b0ff6f8ff0dc364362.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_8f921b0f632d3a3a74b960ccf4c5b738.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_fd558d8c86f77fc544e24305157c5cb4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_e142817d07e501e4b5aae5a8d5fb3960.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419fdd0>
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_6af76a23edf2d85f43924b5871e09e24.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_6af76a23edf2d85f43924b5871e09e24.jpg saved to cache
2026-03-30 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55
2026-03-30 10:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_e01c52bb2c881c04798238c3bd946ef1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_4dab3618180c2ec350c0c8ce6cda8a16.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefdded0>
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_5f2ef2c88dcfac781e4cdc5361a6692e.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_5f2ef2c88dcfac781e4cdc5361a6692e.jpg saved to cache
2026-03-30 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b56a6af0-bef3-5389-a19f-340f8709acbe
2026-03-30 10:48:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9c3d0>
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_c8284c4703d4d7b0ff6f8ff0dc364362.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_c8284c4703d4d7b0ff6f8ff0dc364362.jpg saved to cache
2026-03-30 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14fe0efc-c1bb-57d6-9396-a69e9bdc519d
2026-03-30 10:48:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434f7d0>
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_8f921b0f632d3a3a74b960ccf4c5b738.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_8f921b0f632d3a3a74b960ccf4c5b738.jpg saved to cache
2026-03-30 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14fe0efc-c1bb-57d6-9396-a69e9bdc519d
2026-03-30 10:48:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee96010>
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_fd558d8c86f77fc544e24305157c5cb4.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_fd558d8c86f77fc544e24305157c5cb4.jpg saved to cache
2026-03-30 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14fe0efc-c1bb-57d6-9396-a69e9bdc519d
2026-03-30 10:48:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef74e10>
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_e142817d07e501e4b5aae5a8d5fb3960.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_e142817d07e501e4b5aae5a8d5fb3960.jpg saved to cache
2026-03-30 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14fe0efc-c1bb-57d6-9396-a69e9bdc519d
2026-03-30 10:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_cf49954fd26e2e2228b7576a1afb32af.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeebdcd0>
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_e01c52bb2c881c04798238c3bd946ef1.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_e01c52bb2c881c04798238c3bd946ef1.jpg saved to cache
2026-03-30 10:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b56a6af0-bef3-5389-a19f-340f8709acbe
2026-03-30 10:48:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424e850>
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_4dab3618180c2ec350c0c8ce6cda8a16.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_4dab3618180c2ec350c0c8ce6cda8a16.jpg saved to cache
2026-03-30 10:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b56a6af0-bef3-5389-a19f-340f8709acbe
2026-03-30 10:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR48226> (referer: https://www.auto1.com/v1/car-details-view/BR48226/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4025d0>
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_cf49954fd26e2e2228b7576a1afb32af.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_cf49954fd26e2e2228b7576a1afb32af.jpg saved to cache
2026-03-30 10:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b56a6af0-bef3-5389-a19f-340f8709acbe
2026-03-30 10:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_b631d2c14a03b00c4011fc872004804e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_41a280345b1bd8494e21efd4f6b84e2c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_b1bb5cc63bdb0fe5af37a20cf3c144a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_25978a47825e245cb7e87ba61244014d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_b43d4613c9cafbe870f12b3e64630039.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_3bd2ec18defba1b4905045e4ee240c67.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 136a91d8-710f-5f65-8bef-436760d9f8b8 with identifier: BR48226
2026-03-30 10:48:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 136a91d8-710f-5f65-8bef-436760d9f8b8 with scrape type 1
2026-03-30 10:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 136a91d8-710f-5f65-8bef-436760d9f8b8
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_8544e2570f3d8d40c571ba5e2b010266.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_8544e2570f3d8d40c571ba5e2b010266.jpg not downloaded yet
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_1b6b437f85a585ba75ef811f03959939.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_1b6b437f85a585ba75ef811f03959939.jpg not downloaded yet
2026-03-30 10:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_a1bff4a15976e1c7c9a76c670e85c085.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_2492cf3e0f34d43fbb842f80557de3d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_2492cf3e0f34d43fbb842f80557de3d0.jpg not downloaded yet
2026-03-30 10:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_aea459008419448ddf48de14692a54ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_d4a6a98cae625868d6ad1af7a8f9bf93.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_4dfd1eb95090fcb1dcc0a099065c3efb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_4dfd1eb95090fcb1dcc0a099065c3efb.jpg not downloaded yet
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_4b62bcbfecc5a6c844e46a6e2460fa1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_4b62bcbfecc5a6c844e46a6e2460fa1e.jpg not downloaded yet
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_5f762594d37807c228ea59d8cb0e355d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_5f762594d37807c228ea59d8cb0e355d.jpg not downloaded yet
2026-03-30 10:48:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4831710>
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_b631d2c14a03b00c4011fc872004804e.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_b631d2c14a03b00c4011fc872004804e.jpg saved to cache
2026-03-30 10:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b56a6af0-bef3-5389-a19f-340f8709acbe
2026-03-30 10:48:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef2190>
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_41a280345b1bd8494e21efd4f6b84e2c.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_41a280345b1bd8494e21efd4f6b84e2c.jpg saved to cache
2026-03-30 10:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b56a6af0-bef3-5389-a19f-340f8709acbe
2026-03-30 10:48:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4255e90>
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_b1bb5cc63bdb0fe5af37a20cf3c144a1.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_b1bb5cc63bdb0fe5af37a20cf3c144a1.jpg saved to cache
2026-03-30 10:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b56a6af0-bef3-5389-a19f-340f8709acbe
2026-03-30 10:48:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a69d0>
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_25978a47825e245cb7e87ba61244014d.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_25978a47825e245cb7e87ba61244014d.jpg saved to cache
2026-03-30 10:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b56a6af0-bef3-5389-a19f-340f8709acbe
2026-03-30 10:48:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4256cd0>
2026-03-30 10:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_b43d4613c9cafbe870f12b3e64630039.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_b43d4613c9cafbe870f12b3e64630039.jpg saved to cache
2026-03-30 10:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b56a6af0-bef3-5389-a19f-340f8709acbe
2026-03-30 10:48:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee429750>
2026-03-30 10:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F02%252Fa6026feab78b28f341246f0585a0293a%252Fpa%252FJV19654_3bd2ec18defba1b4905045e4ee240c67.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_3bd2ec18defba1b4905045e4ee240c67.jpg saved to cache
2026-03-30 10:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b56a6af0-bef3-5389-a19f-340f8709acbe
2026-03-30 10:48:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b56a6af0-bef3-5389-a19f-340f8709acbe, skipping ID generation
2026-03-30 10:48:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b56a6af0-bef3-5389-a19f-340f8709acbe with scrape type 1
2026-03-30 10:48:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b56a6af0-bef3-5389-a19f-340f8709acbe sending to next pipeline
2026-03-30 10:48:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b56a6af0-bef3-5389-a19f-340f8709acbe, identifier: JV19654
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_898e5543f587458633662d36c807974a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_898e5543f587458633662d36c807974a.jpg not downloaded yet
2026-03-30 10:48:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b56a6af0-bef3-5389-a19f-340f8709acbe with identifier: JV19654
2026-03-30 10:48:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b56a6af0-bef3-5389-a19f-340f8709acbe with identifier: JV19654
2026-03-30 10:48:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b56a6af0-bef3-5389-a19f-340f8709acbe with identifier: JV19654 to the API
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_3bd2ec18defba1b4905045e4ee240c67.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:42:06Z',
 'fuel_type': 'diesel',
 'id': 'b56a6af0-bef3-5389-a19f-340f8709acbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV19654',
 'listing': 'auction',
 'location': 'DE, Sulzbach-Rosenberg',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 38623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 413385,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_b1bb5cc63bdb0fe5af37a20cf3c144a1.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438940,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_5f2ef2c88dcfac781e4cdc5361a6692e.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 397008,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_25978a47825e245cb7e87ba61244014d.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356813,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_41a280345b1bd8494e21efd4f6b84e2c.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381343,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_b631d2c14a03b00c4011fc872004804e.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421845,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_3bd2ec18defba1b4905045e4ee240c67.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394497,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_b43d4613c9cafbe870f12b3e64630039.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437747,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_4dab3618180c2ec350c0c8ce6cda8a16.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 415268,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_cf49954fd26e2e2228b7576a1afb32af.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b56a6af0-bef3-5389-a19f-340f8709acbe/b56a6af0-bef3-5389-a19f-340f8709acbe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357314,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/02/a6026feab78b28f341246f0585a0293a/pa/JV19654_e01c52bb2c881c04798238c3bd946ef1.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Style 4Motion',
 'year': 2021}
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV19654%27 HTTP/1.1" 200 None
2026-03-30 10:48:48 [auto1.de] INFO: Saving data for JV19654: {'created_time': 1774867728.877647, 'last_price_update_time': 1774867728.877658, 'auction_closing_time': 1774971726.0}
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV19654') HTTP/1.1" 204 0
2026-03-30 10:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_1b6b437f85a585ba75ef811f03959939.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_8544e2570f3d8d40c571ba5e2b010266.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_2492cf3e0f34d43fbb842f80557de3d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_40bbf76c5c95ff2714a6203761c78100.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_5265a7b60f1911c419017224ca00101a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_cca18c4e6f5c2d8dfe37771384f41383.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_c6fb8961a8a5145de5e3fb5dec7a5241.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_c6fb8961a8a5145de5e3fb5dec7a5241.jpg not downloaded yet
2026-03-30 10:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG67497/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DT27807> (referer: https://www.auto1.com/v1/car-details-view/DT27807/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee91250>
2026-03-30 10:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_a1bff4a15976e1c7c9a76c670e85c085.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_a1bff4a15976e1c7c9a76c670e85c085.jpg saved to cache
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4924d0>
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_aea459008419448ddf48de14692a54ac.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_aea459008419448ddf48de14692a54ac.jpg saved to cache
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d1d10>
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_d4a6a98cae625868d6ad1af7a8f9bf93.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_d4a6a98cae625868d6ad1af7a8f9bf93.jpg saved to cache
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_cfb37795e0a28cb0c0af8deda94250cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_cfb37795e0a28cb0c0af8deda94250cc.jpg not downloaded yet
2026-03-30 10:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_5f762594d37807c228ea59d8cb0e355d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_4dfd1eb95090fcb1dcc0a099065c3efb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_4b62bcbfecc5a6c844e46a6e2460fa1e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_2651c2a4566a8d83b11f5af9d686253a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_2651c2a4566a8d83b11f5af9d686253a.jpg not downloaded yet
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee441d10>
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_1b6b437f85a585ba75ef811f03959939.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_1b6b437f85a585ba75ef811f03959939.jpg saved to cache
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 136a91d8-710f-5f65-8bef-436760d9f8b8
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef607d0>
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_8544e2570f3d8d40c571ba5e2b010266.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_8544e2570f3d8d40c571ba5e2b010266.jpg saved to cache
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 136a91d8-710f-5f65-8bef-436760d9f8b8
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefed210>
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_2492cf3e0f34d43fbb842f80557de3d0.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_2492cf3e0f34d43fbb842f80557de3d0.jpg saved to cache
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 136a91d8-710f-5f65-8bef-436760d9f8b8
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4594d0>
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_40bbf76c5c95ff2714a6203761c78100.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_40bbf76c5c95ff2714a6203761c78100.jpg saved to cache
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f433dc50>
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_5265a7b60f1911c419017224ca00101a.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_5265a7b60f1911c419017224ca00101a.jpg saved to cache
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefee690>
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F45%252F8c45983fa696b04ff6b37137acfc223f%252Fpa%252FMM56350_cca18c4e6f5c2d8dfe37771384f41383.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_cca18c4e6f5c2d8dfe37771384f41383.jpg saved to cache
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55
2026-03-30 10:48:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55, skipping ID generation
2026-03-30 10:48:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55 with scrape type 1
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55 sending to next pipeline
2026-03-30 10:48:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55, identifier: MM56350
2026-03-30 10:48:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91bc8fdd-851e-532b-ad2a-4b09b2c2368a with identifier: DT27807
2026-03-30 10:48:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91bc8fdd-851e-532b-ad2a-4b09b2c2368a with scrape type 1
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91bc8fdd-851e-532b-ad2a-4b09b2c2368a
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_1b763366c89d22b5be17d202bc9e4204.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_1b763366c89d22b5be17d202bc9e4204.jpg not downloaded yet
2026-03-30 10:48:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55 with identifier: MM56350
2026-03-30 10:48:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55 with identifier: MM56350
2026-03-30 10:48:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55 with identifier: MM56350 to the API
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_cca18c4e6f5c2d8dfe37771384f41383.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 219,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:02:25Z',
 'fuel_type': 'diesel',
 'id': '97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM56350',
 'listing': 'auction',
 'location': 'DE, Wismar',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 159608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_30bb0717927bfaccbc5ce41d277308ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_f6d6d2a904bea735cd810c6c384f9862.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_aea459008419448ddf48de14692a54ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_cca18c4e6f5c2d8dfe37771384f41383.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_40bbf76c5c95ff2714a6203761c78100.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_8463605e353b97af4aff194a1d7a87bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_a1bff4a15976e1c7c9a76c670e85c085.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_d4a6a98cae625868d6ad1af7a8f9bf93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_5265a7b60f1911c419017224ca00101a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55/97b0a4d6-7f56-5bd4-bb7b-2b5dc56b2c55_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/45/8c45983fa696b04ff6b37137acfc223f/pa/MM56350_6af76a23edf2d85f43924b5871e09e24.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-09',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Comfortline 4Motion',
 'transmission': 'automatic',
 'trim': 'Comfortline 4Motion',
 'year': 2014}
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM56350%27 HTTP/1.1" 200 None
2026-03-30 10:48:49 [auto1.de] INFO: Saving data for MM56350: {'created_time': 1774867729.941054, 'last_price_update_time': 1774867729.941069, 'auction_closing_time': 1774969345.0}
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM56350') HTTP/1.1" 204 0
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_377d89712c873f71922d1bd0bd5165bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_377d89712c873f71922d1bd0bd5165bc.jpg not downloaded yet
2026-03-30 10:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_cfb37795e0a28cb0c0af8deda94250cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_898e5543f587458633662d36c807974a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_c6fb8961a8a5145de5e3fb5dec7a5241.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefefa50>
2026-03-30 10:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_5f762594d37807c228ea59d8cb0e355d.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_5f762594d37807c228ea59d8cb0e355d.jpg saved to cache
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 136a91d8-710f-5f65-8bef-436760d9f8b8
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419d490>
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_4dfd1eb95090fcb1dcc0a099065c3efb.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_4dfd1eb95090fcb1dcc0a099065c3efb.jpg saved to cache
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 136a91d8-710f-5f65-8bef-436760d9f8b8
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef50210>
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_4b62bcbfecc5a6c844e46a6e2460fa1e.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_4b62bcbfecc5a6c844e46a6e2460fa1e.jpg saved to cache
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 136a91d8-710f-5f65-8bef-436760d9f8b8
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_78ef6c9e48a7e4be59c9c2fce79e8a2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_78ef6c9e48a7e4be59c9c2fce79e8a2f.jpg not downloaded yet
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_b158bb36b3ee6f73cf944ffc06f39792.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_b158bb36b3ee6f73cf944ffc06f39792.jpg not downloaded yet
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419ec10>
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_cfb37795e0a28cb0c0af8deda94250cc.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_cfb37795e0a28cb0c0af8deda94250cc.jpg saved to cache
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 136a91d8-710f-5f65-8bef-436760d9f8b8
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41ead10>
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_898e5543f587458633662d36c807974a.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_898e5543f587458633662d36c807974a.jpg saved to cache
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 136a91d8-710f-5f65-8bef-436760d9f8b8
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefecd10>
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_c6fb8961a8a5145de5e3fb5dec7a5241.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_c6fb8961a8a5145de5e3fb5dec7a5241.jpg saved to cache
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 136a91d8-710f-5f65-8bef-436760d9f8b8
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_963909b63d9bc0ea63e2c97cec3ea9f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_963909b63d9bc0ea63e2c97cec3ea9f0.jpg not downloaded yet
2026-03-30 10:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_1b763366c89d22b5be17d202bc9e4204.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_662336a0f3cb3d6053aa89bd6c13e7ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_662336a0f3cb3d6053aa89bd6c13e7ff.jpg not downloaded yet
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_de947a5513616b77d45e921767836efc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_de947a5513616b77d45e921767836efc.jpg not downloaded yet
2026-03-30 10:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_2651c2a4566a8d83b11f5af9d686253a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_31e3bbdf4742f1ea6b03807133c091af.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_31e3bbdf4742f1ea6b03807133c091af.jpg not downloaded yet
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_8fab0a37ad93eec76092ced92fb5d02a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_8fab0a37ad93eec76092ced92fb5d02a.jpg not downloaded yet
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_449b661cd73754e6cb437efe02dcd5c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_449b661cd73754e6cb437efe02dcd5c3.jpg not downloaded yet
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f437bdd0>
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_1b763366c89d22b5be17d202bc9e4204.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_1b763366c89d22b5be17d202bc9e4204.jpg saved to cache
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91bc8fdd-851e-532b-ad2a-4b09b2c2368a
2026-03-30 10:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_b158bb36b3ee6f73cf944ffc06f39792.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a1ed0>
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fde%252F6bde2d8aaac027061a3b0beda9cd61a9%252Fpa%252FBR48226_2651c2a4566a8d83b11f5af9d686253a.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_2651c2a4566a8d83b11f5af9d686253a.jpg saved to cache
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 136a91d8-710f-5f65-8bef-436760d9f8b8
2026-03-30 10:48:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 136a91d8-710f-5f65-8bef-436760d9f8b8, skipping ID generation
2026-03-30 10:48:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 136a91d8-710f-5f65-8bef-436760d9f8b8 with scrape type 1
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 136a91d8-710f-5f65-8bef-436760d9f8b8 sending to next pipeline
2026-03-30 10:48:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 136a91d8-710f-5f65-8bef-436760d9f8b8, identifier: BR48226
2026-03-30 10:48:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 136a91d8-710f-5f65-8bef-436760d9f8b8 with identifier: BR48226
2026-03-30 10:48:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 136a91d8-710f-5f65-8bef-436760d9f8b8 with identifier: BR48226
2026-03-30 10:48:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 136a91d8-710f-5f65-8bef-436760d9f8b8 with identifier: BR48226 to the API
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_2651c2a4566a8d83b11f5af9d686253a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:31:27Z',
 'fuel_type': 'electro',
 'id': '136a91d8-710f-5f65-8bef-436760d9f8b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR48226',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 13,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_8544e2570f3d8d40c571ba5e2b010266.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_1b6b437f85a585ba75ef811f03959939.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_2492cf3e0f34d43fbb842f80557de3d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_4dfd1eb95090fcb1dcc0a099065c3efb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_4b62bcbfecc5a6c844e46a6e2460fa1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_5f762594d37807c228ea59d8cb0e355d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_898e5543f587458633662d36c807974a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_c6fb8961a8a5145de5e3fb5dec7a5241.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_cfb37795e0a28cb0c0af8deda94250cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136a91d8-710f-5f65-8bef-436760d9f8b8/136a91d8-710f-5f65-8bef-436760d9f8b8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/de/6bde2d8aaac027061a3b0beda9cd61a9/pa/BR48226_2651c2a4566a8d83b11f5af9d686253a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-12-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR48226%27 HTTP/1.1" 200 None
2026-03-30 10:48:51 [auto1.de] INFO: Saving data for BR48226: {'created_time': 1774867731.289842, 'last_price_update_time': 1774867731.289853, 'auction_closing_time': 1774971087.0}
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR48226') HTTP/1.1" 204 0
2026-03-30 10:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_de947a5513616b77d45e921767836efc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c08bd0>
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_b158bb36b3ee6f73cf944ffc06f39792.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_b158bb36b3ee6f73cf944ffc06f39792.jpg saved to cache
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91bc8fdd-851e-532b-ad2a-4b09b2c2368a
2026-03-30 10:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB39322> (referer: https://www.auto1.com/v1/car-details-view/CB39322/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_fc5da9deac40431546628b0d8696ae12.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_2a84c4aa1c115d4c934df794101a0ea7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_449b661cd73754e6cb437efe02dcd5c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4278a90>
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_de947a5513616b77d45e921767836efc.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_de947a5513616b77d45e921767836efc.jpg saved to cache
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 91bc8fdd-851e-532b-ad2a-4b09b2c2368a
2026-03-30 10:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_8fab0a37ad93eec76092ced92fb5d02a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_662336a0f3cb3d6053aa89bd6c13e7ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_31e3bbdf4742f1ea6b03807133c091af.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a6c7814-162c-502f-a2aa-38ef6447092c with identifier: CB39322
2026-03-30 10:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a6c7814-162c-502f-a2aa-38ef6447092c with scrape type 1
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a6c7814-162c-502f-a2aa-38ef6447092c
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fdd%252Fd5dd21881479f796160d5a4ecb41fd0f%252Fpa%252FCB39322_d68f4c5f725e6e67ed667cd08d5f3e2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_d68f4c5f725e6e67ed667cd08d5f3e2e.jpg already downloaded
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fdd%252Fd5dd21881479f796160d5a4ecb41fd0f%252Fpa%252FCB39322_30e901a31afc56f8d10b0aed3c764afa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_30e901a31afc56f8d10b0aed3c764afa.jpg already downloaded
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fdd%252Fd5dd21881479f796160d5a4ecb41fd0f%252Fpa%252FCB39322_8eafb4c0638d4dfe04f1e790124af518.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_8eafb4c0638d4dfe04f1e790124af518.jpg already downloaded
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fdd%252Fd5dd21881479f796160d5a4ecb41fd0f%252Fpa%252FCB39322_e8838f7b08939030adb938f50d148b02.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_e8838f7b08939030adb938f50d148b02.jpg already downloaded
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fdd%252Fd5dd21881479f796160d5a4ecb41fd0f%252Fpa%252FCB39322_0e7de644c5413d35629a696ff5e824a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_0e7de644c5413d35629a696ff5e824a0.jpg already downloaded
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fdd%252Fd5dd21881479f796160d5a4ecb41fd0f%252Fpa%252FCB39322_31cca49e301fbf352b83afaa66c497ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_31cca49e301fbf352b83afaa66c497ac.jpg already downloaded
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fdd%252Fd5dd21881479f796160d5a4ecb41fd0f%252Fpa%252FCB39322_6a65e119e5d4af11042d9a455e0207dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_6a65e119e5d4af11042d9a455e0207dc.jpg already downloaded
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fdd%252Fd5dd21881479f796160d5a4ecb41fd0f%252Fpa%252FCB39322_c7ada9334440e41dba2dd4ffa45b5715.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_c7ada9334440e41dba2dd4ffa45b5715.jpg already downloaded
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fdd%252Fd5dd21881479f796160d5a4ecb41fd0f%252Fpa%252FCB39322_b35106b517f01503571169d1eefc5587.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_b35106b517f01503571169d1eefc5587.jpg already downloaded
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fdd%252Fd5dd21881479f796160d5a4ecb41fd0f%252Fpa%252FCB39322_4dcb695e98dc96d774b4b7fac08e63da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_4dcb695e98dc96d774b4b7fac08e63da.jpg already downloaded
2026-03-30 10:48:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a6c7814-162c-502f-a2aa-38ef6447092c, identifier: CB39322
2026-03-30 10:48:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4278510>
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_fc5da9deac40431546628b0d8696ae12.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_fc5da9deac40431546628b0d8696ae12.jpg saved to cache
2026-03-30 10:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14fe0efc-c1bb-57d6-9396-a69e9bdc519d
2026-03-30 10:48:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4215390>
2026-03-30 10:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F03%252Fb103e644d5e2b9bf45431a54a6df8a1a%252Fpa%252FUB71876_2a84c4aa1c115d4c934df794101a0ea7.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_2a84c4aa1c115d4c934df794101a0ea7.jpg saved to cache
2026-03-30 10:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14fe0efc-c1bb-57d6-9396-a69e9bdc519d
2026-03-30 10:48:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14fe0efc-c1bb-57d6-9396-a69e9bdc519d, skipping ID generation
2026-03-30 10:48:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14fe0efc-c1bb-57d6-9396-a69e9bdc519d with scrape type 1
2026-03-30 10:48:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14fe0efc-c1bb-57d6-9396-a69e9bdc519d sending to next pipeline
2026-03-30 10:48:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14fe0efc-c1bb-57d6-9396-a69e9bdc519d, identifier: UB71876
2026-03-30 10:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a0d90>
2026-03-30 10:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_449b661cd73754e6cb437efe02dcd5c3.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_449b661cd73754e6cb437efe02dcd5c3.jpg saved to cache
2026-03-30 10:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 91bc8fdd-851e-532b-ad2a-4b09b2c2368a
2026-03-30 10:48:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a6c7814-162c-502f-a2aa-38ef6447092c with identifier: CB39322
2026-03-30 10:48:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a6c7814-162c-502f-a2aa-38ef6447092c with identifier: CB39322
2026-03-30 10:48:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a6c7814-162c-502f-a2aa-38ef6447092c with identifier: CB39322 to the API
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CB39322>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:43:24Z',
 'fuel_type': 'diesel',
 'id': '2a6c7814-162c-502f-a2aa-38ef6447092c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB39322',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 123438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_d68f4c5f725e6e67ed667cd08d5f3e2e.jpg',
                'https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_30e901a31afc56f8d10b0aed3c764afa.jpg',
                'https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_8eafb4c0638d4dfe04f1e790124af518.jpg',
                'https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_e8838f7b08939030adb938f50d148b02.jpg',
                'https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_0e7de644c5413d35629a696ff5e824a0.jpg',
                'https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_31cca49e301fbf352b83afaa66c497ac.jpg',
                'https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_6a65e119e5d4af11042d9a455e0207dc.jpg',
                'https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_c7ada9334440e41dba2dd4ffa45b5715.jpg',
                'https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_b35106b517f01503571169d1eefc5587.jpg',
                'https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_4dcb695e98dc96d774b4b7fac08e63da.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a6c7814-162c-502f-a2aa-38ef6447092c/2a6c7814-162c-502f-a2aa-38ef6447092c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_d68f4c5f725e6e67ed667cd08d5f3e2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a6c7814-162c-502f-a2aa-38ef6447092c/2a6c7814-162c-502f-a2aa-38ef6447092c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_30e901a31afc56f8d10b0aed3c764afa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a6c7814-162c-502f-a2aa-38ef6447092c/2a6c7814-162c-502f-a2aa-38ef6447092c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_8eafb4c0638d4dfe04f1e790124af518.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a6c7814-162c-502f-a2aa-38ef6447092c/2a6c7814-162c-502f-a2aa-38ef6447092c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_e8838f7b08939030adb938f50d148b02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a6c7814-162c-502f-a2aa-38ef6447092c/2a6c7814-162c-502f-a2aa-38ef6447092c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_0e7de644c5413d35629a696ff5e824a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a6c7814-162c-502f-a2aa-38ef6447092c/2a6c7814-162c-502f-a2aa-38ef6447092c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_31cca49e301fbf352b83afaa66c497ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a6c7814-162c-502f-a2aa-38ef6447092c/2a6c7814-162c-502f-a2aa-38ef6447092c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_6a65e119e5d4af11042d9a455e0207dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a6c7814-162c-502f-a2aa-38ef6447092c/2a6c7814-162c-502f-a2aa-38ef6447092c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_c7ada9334440e41dba2dd4ffa45b5715.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a6c7814-162c-502f-a2aa-38ef6447092c/2a6c7814-162c-502f-a2aa-38ef6447092c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_b35106b517f01503571169d1eefc5587.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a6c7814-162c-502f-a2aa-38ef6447092c/2a6c7814-162c-502f-a2aa-38ef6447092c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/dd/d5dd21881479f796160d5a4ecb41fd0f/pa/CB39322_4dcb695e98dc96d774b4b7fac08e63da.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2018}
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB39322%27 HTTP/1.1" 200 None
2026-03-30 10:48:52 [auto1.de] INFO: Saving data for CB39322: {'created_time': 1774867732.882753, 'last_price_update_time': 1774867732.882766, 'auction_closing_time': 1774971804.0}
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CB39322') HTTP/1.1" 204 0
2026-03-30 10:48:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14fe0efc-c1bb-57d6-9396-a69e9bdc519d with identifier: UB71876
2026-03-30 10:48:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14fe0efc-c1bb-57d6-9396-a69e9bdc519d with identifier: UB71876
2026-03-30 10:48:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14fe0efc-c1bb-57d6-9396-a69e9bdc519d with identifier: UB71876 to the API
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_2a84c4aa1c115d4c934df794101a0ea7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:20:57Z',
 'fuel_type': 'petrol',
 'id': '14fe0efc-c1bb-57d6-9396-a69e9bdc519d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB71876',
 'listing': 'auction',
 'location': 'DE, Bernburg (Saale)',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 80930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3098116,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_2a84c4aa1c115d4c934df794101a0ea7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3122919,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_fc5da9deac40431546628b0d8696ae12.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3209751,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_e142817d07e501e4b5aae5a8d5fb3960.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3043912,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_fef7e32e896d1d9f071202d3e7425878.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2934151,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_fd558d8c86f77fc544e24305157c5cb4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3243320,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_8f921b0f632d3a3a74b960ccf4c5b738.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3076100,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_c8284c4703d4d7b0ff6f8ff0dc364362.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2998106,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_3be57218e4ccbf52ea9184eb6b093623.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3170221,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_639daa9183b084a30c8407526b99d6a8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14fe0efc-c1bb-57d6-9396-a69e9bdc519d/14fe0efc-c1bb-57d6-9396-a69e9bdc519d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3089193,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/03/b103e644d5e2b9bf45431a54a6df8a1a/pa/UB71876_5e5e2ecbceea8c5cf9f64cd6eafcd8ca.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TSI Clever 4x4',
 'transmission': 'automatic',
 'trim': 'Clever 4x4',
 'year': 2021}
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB71876%27 HTTP/1.1" 200 None
2026-03-30 10:48:53 [auto1.de] INFO: Saving data for UB71876: {'created_time': 1774867733.288414, 'last_price_update_time': 1774867733.288424, 'auction_closing_time': 1774970457.0}
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB71876') HTTP/1.1" 204 0
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43261d0>
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_8fab0a37ad93eec76092ced92fb5d02a.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_8fab0a37ad93eec76092ced92fb5d02a.jpg saved to cache
2026-03-30 10:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 91bc8fdd-851e-532b-ad2a-4b09b2c2368a
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeede290>
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_662336a0f3cb3d6053aa89bd6c13e7ff.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_662336a0f3cb3d6053aa89bd6c13e7ff.jpg saved to cache
2026-03-30 10:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91bc8fdd-851e-532b-ad2a-4b09b2c2368a
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419ff90>
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_31e3bbdf4742f1ea6b03807133c091af.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_31e3bbdf4742f1ea6b03807133c091af.jpg saved to cache
2026-03-30 10:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 91bc8fdd-851e-532b-ad2a-4b09b2c2368a
2026-03-30 10:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_377d89712c873f71922d1bd0bd5165bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_78ef6c9e48a7e4be59c9c2fce79e8a2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_963909b63d9bc0ea63e2c97cec3ea9f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_41cfef04ecc0fa4276d45b9ce9dfcc3f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41febd0>
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_377d89712c873f71922d1bd0bd5165bc.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_377d89712c873f71922d1bd0bd5165bc.jpg saved to cache
2026-03-30 10:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91bc8fdd-851e-532b-ad2a-4b09b2c2368a
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeee26d0>
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_78ef6c9e48a7e4be59c9c2fce79e8a2f.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_78ef6c9e48a7e4be59c9c2fce79e8a2f.jpg saved to cache
2026-03-30 10:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91bc8fdd-851e-532b-ad2a-4b09b2c2368a
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41e9d50>
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F32%252Ffe325ff70d982f13a656a65ed4fc2103%252Fpa%252FDT27807_963909b63d9bc0ea63e2c97cec3ea9f0.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_963909b63d9bc0ea63e2c97cec3ea9f0.jpg saved to cache
2026-03-30 10:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91bc8fdd-851e-532b-ad2a-4b09b2c2368a
2026-03-30 10:48:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91bc8fdd-851e-532b-ad2a-4b09b2c2368a, skipping ID generation
2026-03-30 10:48:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91bc8fdd-851e-532b-ad2a-4b09b2c2368a with scrape type 1
2026-03-30 10:48:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91bc8fdd-851e-532b-ad2a-4b09b2c2368a sending to next pipeline
2026-03-30 10:48:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91bc8fdd-851e-532b-ad2a-4b09b2c2368a, identifier: DT27807
2026-03-30 10:48:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91bc8fdd-851e-532b-ad2a-4b09b2c2368a with identifier: DT27807
2026-03-30 10:48:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91bc8fdd-851e-532b-ad2a-4b09b2c2368a with identifier: DT27807
2026-03-30 10:48:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91bc8fdd-851e-532b-ad2a-4b09b2c2368a with identifier: DT27807 to the API
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_963909b63d9bc0ea63e2c97cec3ea9f0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 286,
 'expiration_date': '2026-03-31T15:24:57Z',
 'fuel_type': 'electro',
 'id': '91bc8fdd-851e-532b-ad2a-4b09b2c2368a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT27807',
 'listing': 'auction',
 'location': 'DE',
 'make': 'BMW',
 'model': 'iX3',
 'odometer': 92704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_1b763366c89d22b5be17d202bc9e4204.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_377d89712c873f71922d1bd0bd5165bc.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_78ef6c9e48a7e4be59c9c2fce79e8a2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_b158bb36b3ee6f73cf944ffc06f39792.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_963909b63d9bc0ea63e2c97cec3ea9f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_662336a0f3cb3d6053aa89bd6c13e7ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_de947a5513616b77d45e921767836efc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_31e3bbdf4742f1ea6b03807133c091af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_8fab0a37ad93eec76092ced92fb5d02a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bc8fdd-851e-532b-ad2a-4b09b2c2368a/91bc8fdd-851e-532b-ad2a-4b09b2c2368a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/32/fe325ff70d982f13a656a65ed4fc2103/pa/DT27807_449b661cd73754e6cb437efe02dcd5c3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW iX3 electric drive 210 kW Inspiring',
 'transmission': 'automatic',
 'trim': 'Inspiring',
 'year': 2022}
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT27807%27 HTTP/1.1" 200 None
2026-03-30 10:48:55 [auto1.de] INFO: Saving data for DT27807: {'created_time': 1774867735.162538, 'last_price_update_time': 1774867735.162553, 'auction_closing_time': 1774970697.0}
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT27807') HTTP/1.1" 204 0
2026-03-30 10:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PG90707/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM09523/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee77110>
2026-03-30 10:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_41cfef04ecc0fa4276d45b9ce9dfcc3f.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_41cfef04ecc0fa4276d45b9ce9dfcc3f.jpg saved to cache
2026-03-30 10:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item afc75a7f-e439-518d-892a-38c108d374cb
2026-03-30 10:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_f782191eab73bbb7a39499789f239858.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_e11e58fa1065407dcf6b1798fa421394.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4149790>
2026-03-30 10:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_f782191eab73bbb7a39499789f239858.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_f782191eab73bbb7a39499789f239858.jpg saved to cache
2026-03-30 10:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item afc75a7f-e439-518d-892a-38c108d374cb
2026-03-30 10:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4335ed0>
2026-03-30 10:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_e11e58fa1065407dcf6b1798fa421394.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_e11e58fa1065407dcf6b1798fa421394.jpg saved to cache
2026-03-30 10:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item afc75a7f-e439-518d-892a-38c108d374cb
2026-03-30 10:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZB77986/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XS62323/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_6b837e4edaca76aec2b1e77b7be6b1ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JL46781/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_818d7d02f846b5c7e0d3a75e72d07314.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41e8e90>
2026-03-30 10:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_6b837e4edaca76aec2b1e77b7be6b1ba.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_6b837e4edaca76aec2b1e77b7be6b1ba.jpg saved to cache
2026-03-30 10:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item afc75a7f-e439-518d-892a-38c108d374cb
2026-03-30 10:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43358d0>
2026-03-30 10:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1b%252Fef1b03145f07207bad3ec5cf97acb0f3%252Fpa%252FPT32058_818d7d02f846b5c7e0d3a75e72d07314.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_818d7d02f846b5c7e0d3a75e72d07314.jpg saved to cache
2026-03-30 10:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item afc75a7f-e439-518d-892a-38c108d374cb
2026-03-30 10:48:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: afc75a7f-e439-518d-892a-38c108d374cb, skipping ID generation
2026-03-30 10:48:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afc75a7f-e439-518d-892a-38c108d374cb with scrape type 1
2026-03-30 10:48:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afc75a7f-e439-518d-892a-38c108d374cb sending to next pipeline
2026-03-30 10:48:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afc75a7f-e439-518d-892a-38c108d374cb, identifier: PT32058
2026-03-30 10:48:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afc75a7f-e439-518d-892a-38c108d374cb with identifier: PT32058
2026-03-30 10:48:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afc75a7f-e439-518d-892a-38c108d374cb with identifier: PT32058
2026-03-30 10:48:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afc75a7f-e439-518d-892a-38c108d374cb with identifier: PT32058 to the API
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_818d7d02f846b5c7e0d3a75e72d07314.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:24:26Z',
 'fuel_type': 'petrol',
 'id': 'afc75a7f-e439-518d-892a-38c108d374cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT32058',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 96477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_877a259a1f3e453a4d3e25f3f46aa144.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_818d7d02f846b5c7e0d3a75e72d07314.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_6b837e4edaca76aec2b1e77b7be6b1ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_f782191eab73bbb7a39499789f239858.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_664b3de8167bc6dcd0750fc8791d1efc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_e11e58fa1065407dcf6b1798fa421394.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_eb6226162d29ca97f29ffb39654d271d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_5c99afaeeeb409f3405ca1c0da523298.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_ed6d8149750a94766a7a319e00c15e37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc75a7f-e439-518d-892a-38c108d374cb/afc75a7f-e439-518d-892a-38c108d374cb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/1b/ef1b03145f07207bad3ec5cf97acb0f3/pa/PT32058_41cfef04ecc0fa4276d45b9ce9dfcc3f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.3 TCe Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2020}
2026-03-30 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT32058%27 HTTP/1.1" 200 None
2026-03-30 10:48:57 [auto1.de] INFO: Saving data for PT32058: {'created_time': 1774867737.012861, 'last_price_update_time': 1774867737.012873, 'auction_closing_time': 1774970666.0}
2026-03-30 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT32058') HTTP/1.1" 204 0
2026-03-30 10:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WC05131/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU61252/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG67497> (referer: https://www.auto1.com/v1/car-details-view/UG67497/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AA93259> (referer: https://www.auto1.com/v1/car-details-view/AA93259/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a112729e-f655-5de9-8177-d341b7fc17b0 with identifier: UG67497
2026-03-30 10:49:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a112729e-f655-5de9-8177-d341b7fc17b0 with scrape type 1
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a112729e-f655-5de9-8177-d341b7fc17b0
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_93d5ff76fbb6ae868d2662bdc14e8575.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_93d5ff76fbb6ae868d2662bdc14e8575.jpg not downloaded yet
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_37d254666ebd97bd867c1703a4351304.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_37d254666ebd97bd867c1703a4351304.jpg not downloaded yet
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_45480b7c80cae8fcc1e659910a255596.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_45480b7c80cae8fcc1e659910a255596.jpg not downloaded yet
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_77ab3c664604c3a393dae745a4d969cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_77ab3c664604c3a393dae745a4d969cc.jpg not downloaded yet
2026-03-30 10:49:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f26d155e-8d63-5894-a9c1-a0cba0db939b with identifier: AA93259
2026-03-30 10:49:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f26d155e-8d63-5894-a9c1-a0cba0db939b with scrape type 1
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f26d155e-8d63-5894-a9c1-a0cba0db939b
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_d8b38941f639d14abdec1eaffd5c2625.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_d8b38941f639d14abdec1eaffd5c2625.jpg not downloaded yet
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_106e9d3ba7e1cc63874269f6616df2e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_106e9d3ba7e1cc63874269f6616df2e1.jpg not downloaded yet
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_4006e15af38e715968df257560af08b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_4006e15af38e715968df257560af08b1.jpg not downloaded yet
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_8996eb29230895e75cffc455b00b71cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_8996eb29230895e75cffc455b00b71cc.jpg not downloaded yet
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_bc5c91a2c12c97ce968762a58cbf75ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_bc5c91a2c12c97ce968762a58cbf75ed.jpg not downloaded yet
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_6ec655dd90ba6f4d7aa29a74582718a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_6ec655dd90ba6f4d7aa29a74582718a9.jpg not downloaded yet
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_e8dd9863aeedb9c54c7b6dba356dbec7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_e8dd9863aeedb9c54c7b6dba356dbec7.jpg not downloaded yet
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_308f16133f48899e34e1e257147d94eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_308f16133f48899e34e1e257147d94eb.jpg not downloaded yet
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_14600c4389100e8296440289b2ad1280.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_14600c4389100e8296440289b2ad1280.jpg not downloaded yet
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_bb226d9bc2c8d78b44421a0d253d0f24.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_bb226d9bc2c8d78b44421a0d253d0f24.jpg not downloaded yet
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_a4f655306b4fe29fee99fb1800a2b7e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_a4f655306b4fe29fee99fb1800a2b7e2.jpg not downloaded yet
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_4b4af5482cab2c6b4a5c93c1ed13777e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_4b4af5482cab2c6b4a5c93c1ed13777e.jpg not downloaded yet
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_d6d6339169742d5de20040655b690c00.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_d6d6339169742d5de20040655b690c00.jpg not downloaded yet
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_05f53506c6980b8670d0628b0b41a054.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_05f53506c6980b8670d0628b0b41a054.jpg not downloaded yet
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_4873bbe94723bb68d2463de196242607.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_4873bbe94723bb68d2463de196242607.jpg not downloaded yet
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_d278f614e1df3c15dbb9ee2e03847ccc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_d278f614e1df3c15dbb9ee2e03847ccc.jpg not downloaded yet
2026-03-30 10:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_93d5ff76fbb6ae868d2662bdc14e8575.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_d278f614e1df3c15dbb9ee2e03847ccc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429dc90>
2026-03-30 10:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_93d5ff76fbb6ae868d2662bdc14e8575.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_93d5ff76fbb6ae868d2662bdc14e8575.jpg saved to cache
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a112729e-f655-5de9-8177-d341b7fc17b0
2026-03-30 10:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_4873bbe94723bb68d2463de196242607.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefee390>
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_d278f614e1df3c15dbb9ee2e03847ccc.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_d278f614e1df3c15dbb9ee2e03847ccc.jpg saved to cache
2026-03-30 10:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f26d155e-8d63-5894-a9c1-a0cba0db939b
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f480a8d0>
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_4873bbe94723bb68d2463de196242607.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_4873bbe94723bb68d2463de196242607.jpg saved to cache
2026-03-30 10:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f26d155e-8d63-5894-a9c1-a0cba0db939b
2026-03-30 10:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_05f53506c6980b8670d0628b0b41a054.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_d6d6339169742d5de20040655b690c00.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429ce90>
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_05f53506c6980b8670d0628b0b41a054.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_05f53506c6980b8670d0628b0b41a054.jpg saved to cache
2026-03-30 10:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f26d155e-8d63-5894-a9c1-a0cba0db939b
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f437a010>
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_d6d6339169742d5de20040655b690c00.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_d6d6339169742d5de20040655b690c00.jpg saved to cache
2026-03-30 10:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f26d155e-8d63-5894-a9c1-a0cba0db939b
2026-03-30 10:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_4b4af5482cab2c6b4a5c93c1ed13777e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_a4f655306b4fe29fee99fb1800a2b7e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429fcd0>
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_4b4af5482cab2c6b4a5c93c1ed13777e.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_4b4af5482cab2c6b4a5c93c1ed13777e.jpg saved to cache
2026-03-30 10:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a112729e-f655-5de9-8177-d341b7fc17b0
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4787d0>
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_a4f655306b4fe29fee99fb1800a2b7e2.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_a4f655306b4fe29fee99fb1800a2b7e2.jpg saved to cache
2026-03-30 10:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f26d155e-8d63-5894-a9c1-a0cba0db939b
2026-03-30 10:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XV64183> (referer: https://www.auto1.com/v1/car-details-view/XV64183/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_bb226d9bc2c8d78b44421a0d253d0f24.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_14600c4389100e8296440289b2ad1280.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77795a94-d9db-5759-953d-18b0200d52c6 with identifier: XV64183
2026-03-30 10:49:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77795a94-d9db-5759-953d-18b0200d52c6 with scrape type 1
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 77795a94-d9db-5759-953d-18b0200d52c6
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_c9af29508ca3e805f3d49440743a2993.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_c9af29508ca3e805f3d49440743a2993.jpg not downloaded yet
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_d3b4fd132579c14d240614559b546ccd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_d3b4fd132579c14d240614559b546ccd.jpg not downloaded yet
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_bb76206a0b8ac8802685d08a1d9d54fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_bb76206a0b8ac8802685d08a1d9d54fe.jpg not downloaded yet
2026-03-30 10:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_e8dd9863aeedb9c54c7b6dba356dbec7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_7d9439dbd73f723a8276150fb9730e35.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_7d9439dbd73f723a8276150fb9730e35.jpg not downloaded yet
2026-03-30 10:49:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8e950>
2026-03-30 10:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_bb226d9bc2c8d78b44421a0d253d0f24.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_bb226d9bc2c8d78b44421a0d253d0f24.jpg saved to cache
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a112729e-f655-5de9-8177-d341b7fc17b0
2026-03-30 10:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefe2810>
2026-03-30 10:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_14600c4389100e8296440289b2ad1280.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_14600c4389100e8296440289b2ad1280.jpg saved to cache
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f26d155e-8d63-5894-a9c1-a0cba0db939b
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_a9775ee80ea9c7a38af078a52fea91d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_a9775ee80ea9c7a38af078a52fea91d3.jpg not downloaded yet
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_1ad00330a7556d0c7929fa20c081a80a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_1ad00330a7556d0c7929fa20c081a80a.jpg not downloaded yet
2026-03-30 10:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP04224> (referer: https://www.auto1.com/v1/car-details-view/ZP04224/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef50890>
2026-03-30 10:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_e8dd9863aeedb9c54c7b6dba356dbec7.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_e8dd9863aeedb9c54c7b6dba356dbec7.jpg saved to cache
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f26d155e-8d63-5894-a9c1-a0cba0db939b
2026-03-30 10:49:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_62203c878c0f487937002d4700d71275.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_62203c878c0f487937002d4700d71275.jpg not downloaded yet
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_a5084a15408b8629fad9c9e8c82da65e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_a5084a15408b8629fad9c9e8c82da65e.jpg not downloaded yet
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_fa5b78f42c79df09f8c269f90349c6b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_fa5b78f42c79df09f8c269f90349c6b6.jpg not downloaded yet
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_643b11c85549a6f26585320553e909e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_643b11c85549a6f26585320553e909e6.jpg not downloaded yet
2026-03-30 10:49:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9df3380-3223-56d6-8af7-abedee98a4d9 with identifier: ZP04224
2026-03-30 10:49:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9df3380-3223-56d6-8af7-abedee98a4d9 with scrape type 1
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d9df3380-3223-56d6-8af7-abedee98a4d9
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F9c%252F209cc0df92fbabc4a287f4d95859fc66%252Fpa%252FZP04224_fba8a5856317667b03c79918b97290a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/9c/209cc0df92fbabc4a287f4d95859fc66/pa/ZP04224_fba8a5856317667b03c79918b97290a8.jpg already downloaded
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F9c%252F209cc0df92fbabc4a287f4d95859fc66%252Fpa%252FZP04224_3b213f5983c3889d9c2c2c840cbfd6a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/9c/209cc0df92fbabc4a287f4d95859fc66/pa/ZP04224_3b213f5983c3889d9c2c2c840cbfd6a2.jpg already downloaded
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F9c%252F209cc0df92fbabc4a287f4d95859fc66%252Fpa%252FZP04224_5318d58de14bb31192db37b3182b3c5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/9c/209cc0df92fbabc4a287f4d95859fc66/pa/ZP04224_5318d58de14bb31192db37b3182b3c5b.jpg already downloaded
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F9c%252F209cc0df92fbabc4a287f4d95859fc66%252Fpa%252FZP04224_ffb3893a9f1733607fe060659aa5b46e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/9c/209cc0df92fbabc4a287f4d95859fc66/pa/ZP04224_ffb3893a9f1733607fe060659aa5b46e.jpg already downloaded
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F9c%252F209cc0df92fbabc4a287f4d95859fc66%252Fpa%252FZP04224_d6f4f007bebaab0dbb9cfdd3aa846a8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/9c/209cc0df92fbabc4a287f4d95859fc66/pa/ZP04224_d6f4f007bebaab0dbb9cfdd3aa846a8d.jpg already downloaded
2026-03-30 10:49:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9df3380-3223-56d6-8af7-abedee98a4d9, identifier: ZP04224
2026-03-30 10:49:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9df3380-3223-56d6-8af7-abedee98a4d9 with identifier: ZP04224
2026-03-30 10:49:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9df3380-3223-56d6-8af7-abedee98a4d9 with identifier: ZP04224
2026-03-30 10:49:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9df3380-3223-56d6-8af7-abedee98a4d9 with identifier: ZP04224 to the API
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZP04224>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:50:13Z',
 'fuel_type': 'petrol',
 'id': 'd9df3380-3223-56d6-8af7-abedee98a4d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP04224',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 141052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img20/9c/209cc0df92fbabc4a287f4d95859fc66/pa/ZP04224_fba8a5856317667b03c79918b97290a8.jpg',
                'https://img-pa.auto1.com/img20/9c/209cc0df92fbabc4a287f4d95859fc66/pa/ZP04224_3b213f5983c3889d9c2c2c840cbfd6a2.jpg',
                'https://img-pa.auto1.com/img20/9c/209cc0df92fbabc4a287f4d95859fc66/pa/ZP04224_5318d58de14bb31192db37b3182b3c5b.jpg',
                'https://img-pa.auto1.com/img20/9c/209cc0df92fbabc4a287f4d95859fc66/pa/ZP04224_ffb3893a9f1733607fe060659aa5b46e.jpg',
                'https://img-pa.auto1.com/img20/9c/209cc0df92fbabc4a287f4d95859fc66/pa/ZP04224_d6f4f007bebaab0dbb9cfdd3aa846a8d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9df3380-3223-56d6-8af7-abedee98a4d9/d9df3380-3223-56d6-8af7-abedee98a4d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/9c/209cc0df92fbabc4a287f4d95859fc66/pa/ZP04224_fba8a5856317667b03c79918b97290a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9df3380-3223-56d6-8af7-abedee98a4d9/d9df3380-3223-56d6-8af7-abedee98a4d9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/9c/209cc0df92fbabc4a287f4d95859fc66/pa/ZP04224_3b213f5983c3889d9c2c2c840cbfd6a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9df3380-3223-56d6-8af7-abedee98a4d9/d9df3380-3223-56d6-8af7-abedee98a4d9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/9c/209cc0df92fbabc4a287f4d95859fc66/pa/ZP04224_5318d58de14bb31192db37b3182b3c5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9df3380-3223-56d6-8af7-abedee98a4d9/d9df3380-3223-56d6-8af7-abedee98a4d9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/9c/209cc0df92fbabc4a287f4d95859fc66/pa/ZP04224_ffb3893a9f1733607fe060659aa5b46e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9df3380-3223-56d6-8af7-abedee98a4d9/d9df3380-3223-56d6-8af7-abedee98a4d9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/9c/209cc0df92fbabc4a287f4d95859fc66/pa/ZP04224_d6f4f007bebaab0dbb9cfdd3aa846a8d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-08-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.6 TomTom Edition',
 'transmission': 'manual',
 'trim': 'TomTom Edition',
 'year': 2011}
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP04224%27 HTTP/1.1" 200 None
2026-03-30 10:49:03 [auto1.de] INFO: Saving data for ZP04224: {'created_time': 1774867743.176157, 'last_price_update_time': 1774867743.176169, 'auction_closing_time': 1774972213.0}
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP04224') HTTP/1.1" 204 0
2026-03-30 10:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_308f16133f48899e34e1e257147d94eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_bb76206a0b8ac8802685d08a1d9d54fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_1ad00330a7556d0c7929fa20c081a80a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PG90707> (referer: https://www.auto1.com/v1/car-details-view/PG90707/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef53d90>
2026-03-30 10:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_308f16133f48899e34e1e257147d94eb.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_308f16133f48899e34e1e257147d94eb.jpg saved to cache
2026-03-30 10:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a112729e-f655-5de9-8177-d341b7fc17b0
2026-03-30 10:49:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41ea350>
2026-03-30 10:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_bb76206a0b8ac8802685d08a1d9d54fe.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_bb76206a0b8ac8802685d08a1d9d54fe.jpg saved to cache
2026-03-30 10:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 77795a94-d9db-5759-953d-18b0200d52c6
2026-03-30 10:49:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeee2810>
2026-03-30 10:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_1ad00330a7556d0c7929fa20c081a80a.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_1ad00330a7556d0c7929fa20c081a80a.jpg saved to cache
2026-03-30 10:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 77795a94-d9db-5759-953d-18b0200d52c6
2026-03-30 10:49:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 645f6971-62ef-5406-96d1-b9b83aee7edb with identifier: PG90707
2026-03-30 10:49:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 645f6971-62ef-5406-96d1-b9b83aee7edb with scrape type 1
2026-03-30 10:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 645f6971-62ef-5406-96d1-b9b83aee7edb
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_dd72dafb140b015bbd482aab9477d397.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_dd72dafb140b015bbd482aab9477d397.jpg not downloaded yet
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_7e1b4d9afd185626dc84a1693d8c6080.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_7e1b4d9afd185626dc84a1693d8c6080.jpg not downloaded yet
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_b767d435761bc61b41e2846a03cb1caf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_b767d435761bc61b41e2846a03cb1caf.jpg not downloaded yet
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_a8e085a1554885866e7cd7a2811f82ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_a8e085a1554885866e7cd7a2811f82ac.jpg not downloaded yet
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_6709d1385d876fd8599e42ac71fe1daf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_6709d1385d876fd8599e42ac71fe1daf.jpg not downloaded yet
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_b327dd3772ad17266bf353155a0e5c0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_b327dd3772ad17266bf353155a0e5c0d.jpg not downloaded yet
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_a935ca54b6dcfa025b8ec2bdddf73200.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_a935ca54b6dcfa025b8ec2bdddf73200.jpg not downloaded yet
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_476519fdb8e0964e4a6fbdaad08b8226.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_476519fdb8e0964e4a6fbdaad08b8226.jpg not downloaded yet
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_ce02dacbdedb2f2824a09109d2a608dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_ce02dacbdedb2f2824a09109d2a608dc.jpg not downloaded yet
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_0b4b7b2b1dbb9922330658e7e7407508.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_0b4b7b2b1dbb9922330658e7e7407508.jpg not downloaded yet
2026-03-30 10:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_643b11c85549a6f26585320553e909e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_dd72dafb140b015bbd482aab9477d397.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4337a10>
2026-03-30 10:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_643b11c85549a6f26585320553e909e6.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_643b11c85549a6f26585320553e909e6.jpg saved to cache
2026-03-30 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 77795a94-d9db-5759-953d-18b0200d52c6
2026-03-30 10:49:04 [scrapy.extensions.logstats] INFO: Crawled 692 pages (at 54 pages/min), scraped 493 items (at 34 items/min)
2026-03-30 10:49:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_fa5b78f42c79df09f8c269f90349c6b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee76990>
2026-03-30 10:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_dd72dafb140b015bbd482aab9477d397.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_dd72dafb140b015bbd482aab9477d397.jpg saved to cache
2026-03-30 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 645f6971-62ef-5406-96d1-b9b83aee7edb
2026-03-30 10:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_a5084a15408b8629fad9c9e8c82da65e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL98194> (referer: https://www.auto1.com/v1/car-details-view/RL98194/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4222bd0>
2026-03-30 10:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_fa5b78f42c79df09f8c269f90349c6b6.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_fa5b78f42c79df09f8c269f90349c6b6.jpg saved to cache
2026-03-30 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 77795a94-d9db-5759-953d-18b0200d52c6
2026-03-30 10:49:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e30d0>
2026-03-30 10:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_a5084a15408b8629fad9c9e8c82da65e.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_a5084a15408b8629fad9c9e8c82da65e.jpg saved to cache
2026-03-30 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 77795a94-d9db-5759-953d-18b0200d52c6
2026-03-30 10:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM09523> (referer: https://www.auto1.com/v1/car-details-view/PM09523/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29508527-7cd3-5522-867f-1239637688b4 with identifier: RL98194
2026-03-30 10:49:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29508527-7cd3-5522-867f-1239637688b4 with scrape type 1
2026-03-30 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 29508527-7cd3-5522-867f-1239637688b4
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F77%252Fe277e15d4931b7649bf914eea3febf4f%252Fpa%252FRL98194_fd87c754332d7c8264909586ae250fbe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_fd87c754332d7c8264909586ae250fbe.jpg already downloaded
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F77%252Fe277e15d4931b7649bf914eea3febf4f%252Fpa%252FRL98194_4c6bac15f7de12792f122773ec29c4fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_4c6bac15f7de12792f122773ec29c4fc.jpg already downloaded
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F77%252Fe277e15d4931b7649bf914eea3febf4f%252Fpa%252FRL98194_2b121c9fec0e0eca5cb8e94eaed84663.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_2b121c9fec0e0eca5cb8e94eaed84663.jpg already downloaded
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F77%252Fe277e15d4931b7649bf914eea3febf4f%252Fpa%252FRL98194_2e4f04cf7cb59cf4a5f5dff606294b8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_2e4f04cf7cb59cf4a5f5dff606294b8b.jpg already downloaded
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F77%252Fe277e15d4931b7649bf914eea3febf4f%252Fpa%252FRL98194_39cbe9e016dbfd1a8a966428bb4f9a4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_39cbe9e016dbfd1a8a966428bb4f9a4b.jpg already downloaded
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F77%252Fe277e15d4931b7649bf914eea3febf4f%252Fpa%252FRL98194_03da7eb4f7cf04df41966c69f5c56b54.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_03da7eb4f7cf04df41966c69f5c56b54.jpg already downloaded
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F77%252Fe277e15d4931b7649bf914eea3febf4f%252Fpa%252FRL98194_8290f471cfb8c5462b59e9bba36fb67a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_8290f471cfb8c5462b59e9bba36fb67a.jpg already downloaded
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F77%252Fe277e15d4931b7649bf914eea3febf4f%252Fpa%252FRL98194_aa7951a17a9426000373164b0f52983f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_aa7951a17a9426000373164b0f52983f.jpg already downloaded
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F77%252Fe277e15d4931b7649bf914eea3febf4f%252Fpa%252FRL98194_89078f2b228fd732c3409e5f268712fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_89078f2b228fd732c3409e5f268712fd.jpg already downloaded
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F77%252Fe277e15d4931b7649bf914eea3febf4f%252Fpa%252FRL98194_095db2dcb0a7189e583898a64ef3b4c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_095db2dcb0a7189e583898a64ef3b4c7.jpg already downloaded
2026-03-30 10:49:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29508527-7cd3-5522-867f-1239637688b4, identifier: RL98194
2026-03-30 10:49:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29508527-7cd3-5522-867f-1239637688b4 with identifier: RL98194
2026-03-30 10:49:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29508527-7cd3-5522-867f-1239637688b4 with identifier: RL98194
2026-03-30 10:49:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29508527-7cd3-5522-867f-1239637688b4 with identifier: RL98194 to the API
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RL98194>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:24:37Z',
 'fuel_type': 'petrol',
 'id': '29508527-7cd3-5522-867f-1239637688b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL98194',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 96465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_fd87c754332d7c8264909586ae250fbe.jpg',
                'https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_4c6bac15f7de12792f122773ec29c4fc.jpg',
                'https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_2b121c9fec0e0eca5cb8e94eaed84663.jpg',
                'https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_2e4f04cf7cb59cf4a5f5dff606294b8b.jpg',
                'https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_39cbe9e016dbfd1a8a966428bb4f9a4b.jpg',
                'https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_03da7eb4f7cf04df41966c69f5c56b54.jpg',
                'https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_8290f471cfb8c5462b59e9bba36fb67a.jpg',
                'https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_aa7951a17a9426000373164b0f52983f.jpg',
                'https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_89078f2b228fd732c3409e5f268712fd.jpg',
                'https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_095db2dcb0a7189e583898a64ef3b4c7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29508527-7cd3-5522-867f-1239637688b4/29508527-7cd3-5522-867f-1239637688b4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_fd87c754332d7c8264909586ae250fbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29508527-7cd3-5522-867f-1239637688b4/29508527-7cd3-5522-867f-1239637688b4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_4c6bac15f7de12792f122773ec29c4fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29508527-7cd3-5522-867f-1239637688b4/29508527-7cd3-5522-867f-1239637688b4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_2b121c9fec0e0eca5cb8e94eaed84663.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29508527-7cd3-5522-867f-1239637688b4/29508527-7cd3-5522-867f-1239637688b4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_2e4f04cf7cb59cf4a5f5dff606294b8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29508527-7cd3-5522-867f-1239637688b4/29508527-7cd3-5522-867f-1239637688b4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_39cbe9e016dbfd1a8a966428bb4f9a4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29508527-7cd3-5522-867f-1239637688b4/29508527-7cd3-5522-867f-1239637688b4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_03da7eb4f7cf04df41966c69f5c56b54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29508527-7cd3-5522-867f-1239637688b4/29508527-7cd3-5522-867f-1239637688b4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_8290f471cfb8c5462b59e9bba36fb67a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29508527-7cd3-5522-867f-1239637688b4/29508527-7cd3-5522-867f-1239637688b4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_aa7951a17a9426000373164b0f52983f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29508527-7cd3-5522-867f-1239637688b4/29508527-7cd3-5522-867f-1239637688b4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_89078f2b228fd732c3409e5f268712fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29508527-7cd3-5522-867f-1239637688b4/29508527-7cd3-5522-867f-1239637688b4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/77/e277e15d4931b7649bf914eea3febf4f/pa/RL98194_095db2dcb0a7189e583898a64ef3b4c7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Picanto 1.2 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2017}
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL98194%27 HTTP/1.1" 200 None
2026-03-30 10:49:05 [auto1.de] INFO: Saving data for RL98194: {'created_time': 1774867745.386158, 'last_price_update_time': 1774867745.38617, 'auction_closing_time': 1774970677.0}
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL98194') HTTP/1.1" 204 0
2026-03-30 10:49:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d494afd-1388-569f-953f-994946d0803f with identifier: PM09523
2026-03-30 10:49:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d494afd-1388-569f-953f-994946d0803f with scrape type 1
2026-03-30 10:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2d494afd-1388-569f-953f-994946d0803f
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_75bb6d5677d80a34f25fca301db0f270.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_75bb6d5677d80a34f25fca301db0f270.jpg not downloaded yet
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_6cee4fc295dc76bbb9a89b2e108e1fe2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_6cee4fc295dc76bbb9a89b2e108e1fe2.jpg not downloaded yet
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_d0fdf756e243e2c728021e0bebb77a93.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_d0fdf756e243e2c728021e0bebb77a93.jpg not downloaded yet
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_26c0a1fe7bbbd1bdb7f1a796670903bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_26c0a1fe7bbbd1bdb7f1a796670903bb.jpg not downloaded yet
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_d4da09be890f75d55249f0780b55f09a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_d4da09be890f75d55249f0780b55f09a.jpg not downloaded yet
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_bb7e9ab55d7cc2b10b732dc9d270ad02.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_bb7e9ab55d7cc2b10b732dc9d270ad02.jpg not downloaded yet
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_d16b4c43547e668557917ec50502ea09.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_d16b4c43547e668557917ec50502ea09.jpg not downloaded yet
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_1c3eadbdcd9be926437d9455d984e8a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_1c3eadbdcd9be926437d9455d984e8a4.jpg not downloaded yet
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_cf72d3ae5e835feafa0a2318127feb92.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_cf72d3ae5e835feafa0a2318127feb92.jpg not downloaded yet
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_8e7ac492e171080451d40f2d5e4d6bb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_8e7ac492e171080451d40f2d5e4d6bb6.jpg not downloaded yet
2026-03-30 10:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_0b4b7b2b1dbb9922330658e7e7407508.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_ce02dacbdedb2f2824a09109d2a608dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_a935ca54b6dcfa025b8ec2bdddf73200.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_476519fdb8e0964e4a6fbdaad08b8226.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_6709d1385d876fd8599e42ac71fe1daf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_b327dd3772ad17266bf353155a0e5c0d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_8e7ac492e171080451d40f2d5e4d6bb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee706d0>
2026-03-30 10:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_0b4b7b2b1dbb9922330658e7e7407508.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_0b4b7b2b1dbb9922330658e7e7407508.jpg saved to cache
2026-03-30 10:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 645f6971-62ef-5406-96d1-b9b83aee7edb
2026-03-30 10:49:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8d290>
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_ce02dacbdedb2f2824a09109d2a608dc.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_ce02dacbdedb2f2824a09109d2a608dc.jpg saved to cache
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 645f6971-62ef-5406-96d1-b9b83aee7edb
2026-03-30 10:49:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef0c50>
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_a935ca54b6dcfa025b8ec2bdddf73200.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_a935ca54b6dcfa025b8ec2bdddf73200.jpg saved to cache
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 645f6971-62ef-5406-96d1-b9b83aee7edb
2026-03-30 10:49:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3a950>
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_476519fdb8e0964e4a6fbdaad08b8226.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_476519fdb8e0964e4a6fbdaad08b8226.jpg saved to cache
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 645f6971-62ef-5406-96d1-b9b83aee7edb
2026-03-30 10:49:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428d8d0>
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_6709d1385d876fd8599e42ac71fe1daf.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_6709d1385d876fd8599e42ac71fe1daf.jpg saved to cache
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 645f6971-62ef-5406-96d1-b9b83aee7edb
2026-03-30 10:49:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef1e10>
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_b327dd3772ad17266bf353155a0e5c0d.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_b327dd3772ad17266bf353155a0e5c0d.jpg saved to cache
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 645f6971-62ef-5406-96d1-b9b83aee7edb
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5bdfdd0>
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_8e7ac492e171080451d40f2d5e4d6bb6.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_8e7ac492e171080451d40f2d5e4d6bb6.jpg saved to cache
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2d494afd-1388-569f-953f-994946d0803f
2026-03-30 10:49:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.870(s), this was the 1st time calling it.
2026-03-30 10:49:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.674463346289473 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XS62323> (referer: https://www.auto1.com/v1/car-details-view/XS62323/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_d16b4c43547e668557917ec50502ea09.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2978e76e-362a-5bd9-8891-5e6e51a4aad5 with identifier: XS62323
2026-03-30 10:49:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2978e76e-362a-5bd9-8891-5e6e51a4aad5 with scrape type 1
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2978e76e-362a-5bd9-8891-5e6e51a4aad5
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F25%252F49250b042dee7ca9c3bcaa992fc1dd79%252Fpa%252FXS62323_f076e9e9b75434539d90469d381ed158.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_f076e9e9b75434539d90469d381ed158.jpg already downloaded
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F25%252F49250b042dee7ca9c3bcaa992fc1dd79%252Fpa%252FXS62323_a10be96856b0ec25491b2e970503818a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_a10be96856b0ec25491b2e970503818a.jpg already downloaded
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F25%252F49250b042dee7ca9c3bcaa992fc1dd79%252Fpa%252FXS62323_0cb82af24853430c9b18ca4e0326ddd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_0cb82af24853430c9b18ca4e0326ddd1.jpg already downloaded
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F25%252F49250b042dee7ca9c3bcaa992fc1dd79%252Fpa%252FXS62323_80f20b693aa08d0911d2a4c0c202e7ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_80f20b693aa08d0911d2a4c0c202e7ba.jpg already downloaded
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F25%252F49250b042dee7ca9c3bcaa992fc1dd79%252Fpa%252FXS62323_ae452beb319300e21bb2e22c0000658e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_ae452beb319300e21bb2e22c0000658e.jpg already downloaded
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F25%252F49250b042dee7ca9c3bcaa992fc1dd79%252Fpa%252FXS62323_e61612b629d71491dc67539087698efe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_e61612b629d71491dc67539087698efe.jpg already downloaded
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F25%252F49250b042dee7ca9c3bcaa992fc1dd79%252Fpa%252FXS62323_75c9b4d985d6cafa217fa11fe19ddabc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_75c9b4d985d6cafa217fa11fe19ddabc.jpg already downloaded
2026-03-30 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F25%252F49250b042dee7ca9c3bcaa992fc1dd79%252Fpa%252FXS62323_803d571f154d5cedc380378b8a9f895e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_803d571f154d5cedc380378b8a9f895e.jpg already downloaded
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F25%252F49250b042dee7ca9c3bcaa992fc1dd79%252Fpa%252FXS62323_8fcd3d7db249a9903c9276210102622b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_8fcd3d7db249a9903c9276210102622b.jpg already downloaded
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F25%252F49250b042dee7ca9c3bcaa992fc1dd79%252Fpa%252FXS62323_9ba0e228fb6b57f257cba4690a8b3b3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_9ba0e228fb6b57f257cba4690a8b3b3a.jpg already downloaded
2026-03-30 10:49:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2978e76e-362a-5bd9-8891-5e6e51a4aad5, identifier: XS62323
2026-03-30 10:49:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2978e76e-362a-5bd9-8891-5e6e51a4aad5 with identifier: XS62323
2026-03-30 10:49:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2978e76e-362a-5bd9-8891-5e6e51a4aad5 with identifier: XS62323
2026-03-30 10:49:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2978e76e-362a-5bd9-8891-5e6e51a4aad5 with identifier: XS62323 to the API
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XS62323>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:16:14Z',
 'fuel_type': 'petrol',
 'id': '2978e76e-362a-5bd9-8891-5e6e51a4aad5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS62323',
 'listing': 'auction',
 'location': 'DE, Saarlouis',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 63497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_f076e9e9b75434539d90469d381ed158.jpg',
                'https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_a10be96856b0ec25491b2e970503818a.jpg',
                'https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_0cb82af24853430c9b18ca4e0326ddd1.jpg',
                'https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_80f20b693aa08d0911d2a4c0c202e7ba.jpg',
                'https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_ae452beb319300e21bb2e22c0000658e.jpg',
                'https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_e61612b629d71491dc67539087698efe.jpg',
                'https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_75c9b4d985d6cafa217fa11fe19ddabc.jpg',
                'https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_803d571f154d5cedc380378b8a9f895e.jpg',
                'https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_8fcd3d7db249a9903c9276210102622b.jpg',
                'https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_9ba0e228fb6b57f257cba4690a8b3b3a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2978e76e-362a-5bd9-8891-5e6e51a4aad5/2978e76e-362a-5bd9-8891-5e6e51a4aad5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_f076e9e9b75434539d90469d381ed158.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2978e76e-362a-5bd9-8891-5e6e51a4aad5/2978e76e-362a-5bd9-8891-5e6e51a4aad5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_a10be96856b0ec25491b2e970503818a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2978e76e-362a-5bd9-8891-5e6e51a4aad5/2978e76e-362a-5bd9-8891-5e6e51a4aad5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_0cb82af24853430c9b18ca4e0326ddd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2978e76e-362a-5bd9-8891-5e6e51a4aad5/2978e76e-362a-5bd9-8891-5e6e51a4aad5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_80f20b693aa08d0911d2a4c0c202e7ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2978e76e-362a-5bd9-8891-5e6e51a4aad5/2978e76e-362a-5bd9-8891-5e6e51a4aad5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_ae452beb319300e21bb2e22c0000658e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2978e76e-362a-5bd9-8891-5e6e51a4aad5/2978e76e-362a-5bd9-8891-5e6e51a4aad5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_e61612b629d71491dc67539087698efe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2978e76e-362a-5bd9-8891-5e6e51a4aad5/2978e76e-362a-5bd9-8891-5e6e51a4aad5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_75c9b4d985d6cafa217fa11fe19ddabc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2978e76e-362a-5bd9-8891-5e6e51a4aad5/2978e76e-362a-5bd9-8891-5e6e51a4aad5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_803d571f154d5cedc380378b8a9f895e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2978e76e-362a-5bd9-8891-5e6e51a4aad5/2978e76e-362a-5bd9-8891-5e6e51a4aad5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_8fcd3d7db249a9903c9276210102622b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2978e76e-362a-5bd9-8891-5e6e51a4aad5/2978e76e-362a-5bd9-8891-5e6e51a4aad5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/25/49250b042dee7ca9c3bcaa992fc1dd79/pa/XS62323_9ba0e228fb6b57f257cba4690a8b3b3a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Xcellence',
 'transmission': 'automatic',
 'trim': 'Xcellence',
 'year': 2019}
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS62323%27 HTTP/1.1" 200 None
2026-03-30 10:49:07 [auto1.de] INFO: Saving data for XS62323: {'created_time': 1774867747.493709, 'last_price_update_time': 1774867747.493721, 'auction_closing_time': 1774970174.0}
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS62323') HTTP/1.1" 204 0
2026-03-30 10:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419d490>
2026-03-30 10:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_d16b4c43547e668557917ec50502ea09.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_d16b4c43547e668557917ec50502ea09.jpg saved to cache
2026-03-30 10:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d494afd-1388-569f-953f-994946d0803f
2026-03-30 10:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_26c0a1fe7bbbd1bdb7f1a796670903bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_1c3eadbdcd9be926437d9455d984e8a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_d4da09be890f75d55249f0780b55f09a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_d0fdf756e243e2c728021e0bebb77a93.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_bb7e9ab55d7cc2b10b732dc9d270ad02.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_cf72d3ae5e835feafa0a2318127feb92.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_6cee4fc295dc76bbb9a89b2e108e1fe2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee11710>
2026-03-30 10:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_26c0a1fe7bbbd1bdb7f1a796670903bb.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_26c0a1fe7bbbd1bdb7f1a796670903bb.jpg saved to cache
2026-03-30 10:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d494afd-1388-569f-953f-994946d0803f
2026-03-30 10:49:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41f08d0>
2026-03-30 10:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_1c3eadbdcd9be926437d9455d984e8a4.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_1c3eadbdcd9be926437d9455d984e8a4.jpg saved to cache
2026-03-30 10:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d494afd-1388-569f-953f-994946d0803f
2026-03-30 10:49:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee737d0>
2026-03-30 10:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_d4da09be890f75d55249f0780b55f09a.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_d4da09be890f75d55249f0780b55f09a.jpg saved to cache
2026-03-30 10:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d494afd-1388-569f-953f-994946d0803f
2026-03-30 10:49:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9c610>
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_d0fdf756e243e2c728021e0bebb77a93.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_d0fdf756e243e2c728021e0bebb77a93.jpg saved to cache
2026-03-30 10:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d494afd-1388-569f-953f-994946d0803f
2026-03-30 10:49:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4347a10>
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_bb7e9ab55d7cc2b10b732dc9d270ad02.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_bb7e9ab55d7cc2b10b732dc9d270ad02.jpg saved to cache
2026-03-30 10:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d494afd-1388-569f-953f-994946d0803f
2026-03-30 10:49:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee73810>
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_cf72d3ae5e835feafa0a2318127feb92.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_cf72d3ae5e835feafa0a2318127feb92.jpg saved to cache
2026-03-30 10:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2d494afd-1388-569f-953f-994946d0803f
2026-03-30 10:49:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef9fe10>
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_6cee4fc295dc76bbb9a89b2e108e1fe2.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_6cee4fc295dc76bbb9a89b2e108e1fe2.jpg saved to cache
2026-03-30 10:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d494afd-1388-569f-953f-994946d0803f
2026-03-30 10:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KS92375/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_75bb6d5677d80a34f25fca301db0f270.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee73790>
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F19%252Fcc19f267fc0c2c502035335c19477998%252Fpa%252FPM09523_75bb6d5677d80a34f25fca301db0f270.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_75bb6d5677d80a34f25fca301db0f270.jpg saved to cache
2026-03-30 10:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d494afd-1388-569f-953f-994946d0803f
2026-03-30 10:49:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d494afd-1388-569f-953f-994946d0803f, skipping ID generation
2026-03-30 10:49:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d494afd-1388-569f-953f-994946d0803f with scrape type 1
2026-03-30 10:49:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d494afd-1388-569f-953f-994946d0803f sending to next pipeline
2026-03-30 10:49:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d494afd-1388-569f-953f-994946d0803f, identifier: PM09523
2026-03-30 10:49:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d494afd-1388-569f-953f-994946d0803f with identifier: PM09523
2026-03-30 10:49:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d494afd-1388-569f-953f-994946d0803f with identifier: PM09523
2026-03-30 10:49:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d494afd-1388-569f-953f-994946d0803f with identifier: PM09523 to the API
2026-03-30 10:49:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_75bb6d5677d80a34f25fca301db0f270.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:28:03Z',
 'fuel_type': 'diesel',
 'id': '2d494afd-1388-569f-953f-994946d0803f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM09523',
 'listing': 'auction',
 'location': 'DE, Eisenach',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 84665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2435331,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_75bb6d5677d80a34f25fca301db0f270.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2420924,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_6cee4fc295dc76bbb9a89b2e108e1fe2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2363722,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_d0fdf756e243e2c728021e0bebb77a93.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2462843,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_26c0a1fe7bbbd1bdb7f1a796670903bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2419250,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_d4da09be890f75d55249f0780b55f09a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2372081,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_bb7e9ab55d7cc2b10b732dc9d270ad02.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_d16b4c43547e668557917ec50502ea09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2472718,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_1c3eadbdcd9be926437d9455d984e8a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2457417,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_cf72d3ae5e835feafa0a2318127feb92.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d494afd-1388-569f-953f-994946d0803f/2d494afd-1388-569f-953f-994946d0803f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/19/cc19f267fc0c2c502035335c19477998/pa/PM09523_8e7ac492e171080451d40f2d5e4d6bb6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Premium Edition',
 'transmission': 'automatic',
 'trim': 'Premium Edition',
 'year': 2018}
2026-03-30 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM09523%27 HTTP/1.1" 200 None
2026-03-30 10:49:09 [auto1.de] INFO: Saving data for PM09523: {'created_time': 1774867749.360342, 'last_price_update_time': 1774867749.360352, 'auction_closing_time': 1774970883.0}
2026-03-30 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM09523') HTTP/1.1" 204 0
2026-03-30 10:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_a9775ee80ea9c7a38af078a52fea91d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_d3b4fd132579c14d240614559b546ccd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_62203c878c0f487937002d4700d71275.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_7d9439dbd73f723a8276150fb9730e35.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_c9af29508ca3e805f3d49440743a2993.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_7e1b4d9afd185626dc84a1693d8c6080.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_a8e085a1554885866e7cd7a2811f82ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_b767d435761bc61b41e2846a03cb1caf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef9c510>
2026-03-30 10:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_a9775ee80ea9c7a38af078a52fea91d3.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_a9775ee80ea9c7a38af078a52fea91d3.jpg saved to cache
2026-03-30 10:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 77795a94-d9db-5759-953d-18b0200d52c6
2026-03-30 10:49:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414b010>
2026-03-30 10:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_d3b4fd132579c14d240614559b546ccd.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_d3b4fd132579c14d240614559b546ccd.jpg saved to cache
2026-03-30 10:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 77795a94-d9db-5759-953d-18b0200d52c6
2026-03-30 10:49:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4394990>
2026-03-30 10:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_62203c878c0f487937002d4700d71275.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_62203c878c0f487937002d4700d71275.jpg saved to cache
2026-03-30 10:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 77795a94-d9db-5759-953d-18b0200d52c6
2026-03-30 10:49:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4196610>
2026-03-30 10:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_7d9439dbd73f723a8276150fb9730e35.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_7d9439dbd73f723a8276150fb9730e35.jpg saved to cache
2026-03-30 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 77795a94-d9db-5759-953d-18b0200d52c6
2026-03-30 10:49:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4195a90>
2026-03-30 10:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fec%252F1cecf2d5acda86d504285a4aec4de533%252Fpa%252FXV64183_c9af29508ca3e805f3d49440743a2993.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_c9af29508ca3e805f3d49440743a2993.jpg saved to cache
2026-03-30 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77795a94-d9db-5759-953d-18b0200d52c6
2026-03-30 10:49:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77795a94-d9db-5759-953d-18b0200d52c6, skipping ID generation
2026-03-30 10:49:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77795a94-d9db-5759-953d-18b0200d52c6 with scrape type 1
2026-03-30 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77795a94-d9db-5759-953d-18b0200d52c6 sending to next pipeline
2026-03-30 10:49:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77795a94-d9db-5759-953d-18b0200d52c6, identifier: XV64183
2026-03-30 10:49:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee773d0>
2026-03-30 10:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_7e1b4d9afd185626dc84a1693d8c6080.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_7e1b4d9afd185626dc84a1693d8c6080.jpg saved to cache
2026-03-30 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 645f6971-62ef-5406-96d1-b9b83aee7edb
2026-03-30 10:49:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9c810>
2026-03-30 10:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_a8e085a1554885866e7cd7a2811f82ac.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_a8e085a1554885866e7cd7a2811f82ac.jpg saved to cache
2026-03-30 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 645f6971-62ef-5406-96d1-b9b83aee7edb
2026-03-30 10:49:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41fe790>
2026-03-30 10:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5a%252F215a105d239a97ddb57b44b628c7b240%252Fpa%252FPG90707_b767d435761bc61b41e2846a03cb1caf.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_b767d435761bc61b41e2846a03cb1caf.jpg saved to cache
2026-03-30 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 645f6971-62ef-5406-96d1-b9b83aee7edb
2026-03-30 10:49:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 645f6971-62ef-5406-96d1-b9b83aee7edb, skipping ID generation
2026-03-30 10:49:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 645f6971-62ef-5406-96d1-b9b83aee7edb with scrape type 1
2026-03-30 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 645f6971-62ef-5406-96d1-b9b83aee7edb sending to next pipeline
2026-03-30 10:49:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 645f6971-62ef-5406-96d1-b9b83aee7edb, identifier: PG90707
2026-03-30 10:49:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77795a94-d9db-5759-953d-18b0200d52c6 with identifier: XV64183
2026-03-30 10:49:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77795a94-d9db-5759-953d-18b0200d52c6 with identifier: XV64183
2026-03-30 10:49:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77795a94-d9db-5759-953d-18b0200d52c6 with identifier: XV64183 to the API
2026-03-30 10:49:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_c9af29508ca3e805f3d49440743a2993.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:30:35Z',
 'fuel_type': 'petrol',
 'id': '77795a94-d9db-5759-953d-18b0200d52c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV64183',
 'listing': 'auction',
 'location': 'DE, Potsdam',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 102108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2556642,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_c9af29508ca3e805f3d49440743a2993.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2159496,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_d3b4fd132579c14d240614559b546ccd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2492554,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_bb76206a0b8ac8802685d08a1d9d54fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2565806,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_7d9439dbd73f723a8276150fb9730e35.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2541678,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_a9775ee80ea9c7a38af078a52fea91d3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2590087,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_1ad00330a7556d0c7929fa20c081a80a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2433677,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_62203c878c0f487937002d4700d71275.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2630871,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_a5084a15408b8629fad9c9e8c82da65e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2652478,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_fa5b78f42c79df09f8c269f90349c6b6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77795a94-d9db-5759-953d-18b0200d52c6/77795a94-d9db-5759-953d-18b0200d52c6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2631519,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ec/1cecf2d5acda86d504285a4aec4de533/pa/XV64183_643b11c85549a6f26585320553e909e6.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2018}
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV64183%27 HTTP/1.1" 200 None
2026-03-30 10:49:11 [auto1.de] INFO: Saving data for XV64183: {'created_time': 1774867751.184072, 'last_price_update_time': 1774867751.184082, 'auction_closing_time': 1774971035.0}
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV64183') HTTP/1.1" 204 0
2026-03-30 10:49:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 645f6971-62ef-5406-96d1-b9b83aee7edb with identifier: PG90707
2026-03-30 10:49:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 645f6971-62ef-5406-96d1-b9b83aee7edb with identifier: PG90707
2026-03-30 10:49:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 645f6971-62ef-5406-96d1-b9b83aee7edb with identifier: PG90707 to the API
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_b767d435761bc61b41e2846a03cb1caf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 178,
 'expiration_date': '2026-03-31T15:06:58Z',
 'fuel_type': 'petrol',
 'id': '645f6971-62ef-5406-96d1-b9b83aee7edb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG90707',
 'listing': 'auction',
 'location': 'DE, Halle',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 23179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3081982,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_dd72dafb140b015bbd482aab9477d397.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3219184,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_7e1b4d9afd185626dc84a1693d8c6080.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3217201,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_b767d435761bc61b41e2846a03cb1caf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3064782,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_a8e085a1554885866e7cd7a2811f82ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3175085,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_6709d1385d876fd8599e42ac71fe1daf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3099706,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_b327dd3772ad17266bf353155a0e5c0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3068743,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_a935ca54b6dcfa025b8ec2bdddf73200.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3194452,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_476519fdb8e0964e4a6fbdaad08b8226.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3104982,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_ce02dacbdedb2f2824a09109d2a608dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_645f6971-62ef-5406-96d1-b9b83aee7edb/645f6971-62ef-5406-96d1-b9b83aee7edb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3039020,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img21/5a/215a105d239a97ddb57b44b628c7b240/pa/PG90707_0b4b7b2b1dbb9922330658e7e7407508.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Clubman Cooper S John Cooper Works Trim',
 'transmission': 'automatic',
 'trim': 'John Cooper Works Trim',
 'year': 2023}
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG90707%27 HTTP/1.1" 200 None
2026-03-30 10:49:11 [auto1.de] INFO: Saving data for PG90707: {'created_time': 1774867751.579571, 'last_price_update_time': 1774867751.579584, 'auction_closing_time': 1774969618.0}
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG90707') HTTP/1.1" 204 0
2026-03-30 10:49:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZB77986> (referer: https://www.auto1.com/v1/car-details-view/ZB77986/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_6ec655dd90ba6f4d7aa29a74582718a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_d8b38941f639d14abdec1eaffd5c2625.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_bc5c91a2c12c97ce968762a58cbf75ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_4006e15af38e715968df257560af08b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee87373c-9dcf-52a9-8ac9-77072143136d with identifier: ZB77986
2026-03-30 10:49:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee87373c-9dcf-52a9-8ac9-77072143136d with scrape type 1
2026-03-30 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee87373c-9dcf-52a9-8ac9-77072143136d
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ff4%252Fcaf48173138ed4cf40d4e93c66b7880b%252Fpa%252FZB77986_3a80e04793412a0e5a79047b1c5624c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_3a80e04793412a0e5a79047b1c5624c7.jpg already downloaded
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ff4%252Fcaf48173138ed4cf40d4e93c66b7880b%252Fpa%252FZB77986_c5344b17716b6da15c5b554cea26a7b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_c5344b17716b6da15c5b554cea26a7b0.jpg already downloaded
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ff4%252Fcaf48173138ed4cf40d4e93c66b7880b%252Fpa%252FZB77986_c8871ecc4b71f26c8f2d00aeda71531f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_c8871ecc4b71f26c8f2d00aeda71531f.jpg already downloaded
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ff4%252Fcaf48173138ed4cf40d4e93c66b7880b%252Fpa%252FZB77986_c2896015ee4eae02c4d55b093a58649c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_c2896015ee4eae02c4d55b093a58649c.jpg already downloaded
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ff4%252Fcaf48173138ed4cf40d4e93c66b7880b%252Fpa%252FZB77986_818e7afcbdfff6a6e0b072e4a45ec946.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_818e7afcbdfff6a6e0b072e4a45ec946.jpg already downloaded
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ff4%252Fcaf48173138ed4cf40d4e93c66b7880b%252Fpa%252FZB77986_7159bc6b46f7329b8f7785a5b7a3fd95.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_7159bc6b46f7329b8f7785a5b7a3fd95.jpg already downloaded
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ff4%252Fcaf48173138ed4cf40d4e93c66b7880b%252Fpa%252FZB77986_cccb92057b8260fb6bd4c8834257bb83.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_cccb92057b8260fb6bd4c8834257bb83.jpg already downloaded
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ff4%252Fcaf48173138ed4cf40d4e93c66b7880b%252Fpa%252FZB77986_91e5660bffde2d0bf177daa1065d02a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_91e5660bffde2d0bf177daa1065d02a5.jpg already downloaded
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ff4%252Fcaf48173138ed4cf40d4e93c66b7880b%252Fpa%252FZB77986_fdc84a4c75e53ce9425e13903f0475da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_fdc84a4c75e53ce9425e13903f0475da.jpg already downloaded
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ff4%252Fcaf48173138ed4cf40d4e93c66b7880b%252Fpa%252FZB77986_f0beffc3b573030a126aec796a98dc82.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_f0beffc3b573030a126aec796a98dc82.jpg already downloaded
2026-03-30 10:49:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee87373c-9dcf-52a9-8ac9-77072143136d, identifier: ZB77986
2026-03-30 10:49:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee87373c-9dcf-52a9-8ac9-77072143136d with identifier: ZB77986
2026-03-30 10:49:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee87373c-9dcf-52a9-8ac9-77072143136d with identifier: ZB77986
2026-03-30 10:49:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee87373c-9dcf-52a9-8ac9-77072143136d with identifier: ZB77986 to the API
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZB77986>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:32:17Z',
 'fuel_type': 'diesel',
 'id': 'ee87373c-9dcf-52a9-8ac9-77072143136d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB77986',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 219683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_3a80e04793412a0e5a79047b1c5624c7.jpg',
                'https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_c5344b17716b6da15c5b554cea26a7b0.jpg',
                'https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_c8871ecc4b71f26c8f2d00aeda71531f.jpg',
                'https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_c2896015ee4eae02c4d55b093a58649c.jpg',
                'https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_818e7afcbdfff6a6e0b072e4a45ec946.jpg',
                'https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_7159bc6b46f7329b8f7785a5b7a3fd95.jpg',
                'https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_cccb92057b8260fb6bd4c8834257bb83.jpg',
                'https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_91e5660bffde2d0bf177daa1065d02a5.jpg',
                'https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_fdc84a4c75e53ce9425e13903f0475da.jpg',
                'https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_f0beffc3b573030a126aec796a98dc82.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee87373c-9dcf-52a9-8ac9-77072143136d/ee87373c-9dcf-52a9-8ac9-77072143136d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_3a80e04793412a0e5a79047b1c5624c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee87373c-9dcf-52a9-8ac9-77072143136d/ee87373c-9dcf-52a9-8ac9-77072143136d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_c5344b17716b6da15c5b554cea26a7b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee87373c-9dcf-52a9-8ac9-77072143136d/ee87373c-9dcf-52a9-8ac9-77072143136d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2286105,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_c8871ecc4b71f26c8f2d00aeda71531f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee87373c-9dcf-52a9-8ac9-77072143136d/ee87373c-9dcf-52a9-8ac9-77072143136d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_c2896015ee4eae02c4d55b093a58649c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee87373c-9dcf-52a9-8ac9-77072143136d/ee87373c-9dcf-52a9-8ac9-77072143136d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2181197,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_818e7afcbdfff6a6e0b072e4a45ec946.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee87373c-9dcf-52a9-8ac9-77072143136d/ee87373c-9dcf-52a9-8ac9-77072143136d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_7159bc6b46f7329b8f7785a5b7a3fd95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee87373c-9dcf-52a9-8ac9-77072143136d/ee87373c-9dcf-52a9-8ac9-77072143136d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_cccb92057b8260fb6bd4c8834257bb83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee87373c-9dcf-52a9-8ac9-77072143136d/ee87373c-9dcf-52a9-8ac9-77072143136d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2387670,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_91e5660bffde2d0bf177daa1065d02a5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee87373c-9dcf-52a9-8ac9-77072143136d/ee87373c-9dcf-52a9-8ac9-77072143136d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_fdc84a4c75e53ce9425e13903f0475da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee87373c-9dcf-52a9-8ac9-77072143136d/ee87373c-9dcf-52a9-8ac9-77072143136d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/f4/caf48173138ed4cf40d4e93c66b7880b/pa/ZB77986_f0beffc3b573030a126aec796a98dc82.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-29',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi 300 L2 Tourneo Titanium',
 'transmission': 'manual',
 'trim': '300 L2 Tourneo Titanium',
 'year': 2015}
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB77986%27 HTTP/1.1" 200 None
2026-03-30 10:49:12 [auto1.de] INFO: Saving data for ZB77986: {'created_time': 1774867752.395042, 'last_price_update_time': 1774867752.395052, 'auction_closing_time': 1774971137.0}
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB77986') HTTP/1.1" 204 0
2026-03-30 10:49:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f422be90>
2026-03-30 10:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_6ec655dd90ba6f4d7aa29a74582718a9.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_6ec655dd90ba6f4d7aa29a74582718a9.jpg saved to cache
2026-03-30 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a112729e-f655-5de9-8177-d341b7fc17b0
2026-03-30 10:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f436f450>
2026-03-30 10:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_d8b38941f639d14abdec1eaffd5c2625.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_d8b38941f639d14abdec1eaffd5c2625.jpg saved to cache
2026-03-30 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f26d155e-8d63-5894-a9c1-a0cba0db939b
2026-03-30 10:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee32350>
2026-03-30 10:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_bc5c91a2c12c97ce968762a58cbf75ed.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_bc5c91a2c12c97ce968762a58cbf75ed.jpg saved to cache
2026-03-30 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f26d155e-8d63-5894-a9c1-a0cba0db939b
2026-03-30 10:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41a0b50>
2026-03-30 10:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F10%252Fb910d7cc3146c7be90e284b9a901d8c5%252Fpa%252FAA93259_4006e15af38e715968df257560af08b1.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_4006e15af38e715968df257560af08b1.jpg saved to cache
2026-03-30 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f26d155e-8d63-5894-a9c1-a0cba0db939b
2026-03-30 10:49:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f26d155e-8d63-5894-a9c1-a0cba0db939b, skipping ID generation
2026-03-30 10:49:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f26d155e-8d63-5894-a9c1-a0cba0db939b with scrape type 1
2026-03-30 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f26d155e-8d63-5894-a9c1-a0cba0db939b sending to next pipeline
2026-03-30 10:49:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f26d155e-8d63-5894-a9c1-a0cba0db939b, identifier: AA93259
2026-03-30 10:49:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f26d155e-8d63-5894-a9c1-a0cba0db939b with identifier: AA93259
2026-03-30 10:49:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f26d155e-8d63-5894-a9c1-a0cba0db939b with identifier: AA93259
2026-03-30 10:49:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f26d155e-8d63-5894-a9c1-a0cba0db939b with identifier: AA93259 to the API
2026-03-30 10:49:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_4006e15af38e715968df257560af08b1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:53:51Z',
 'fuel_type': 'electro',
 'id': 'f26d155e-8d63-5894-a9c1-a0cba0db939b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA93259',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 55803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_d8b38941f639d14abdec1eaffd5c2625.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_4006e15af38e715968df257560af08b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_bc5c91a2c12c97ce968762a58cbf75ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_e8dd9863aeedb9c54c7b6dba356dbec7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_14600c4389100e8296440289b2ad1280.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_a4f655306b4fe29fee99fb1800a2b7e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_d6d6339169742d5de20040655b690c00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_05f53506c6980b8670d0628b0b41a054.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_4873bbe94723bb68d2463de196242607.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d155e-8d63-5894-a9c1-a0cba0db939b/f26d155e-8d63-5894-a9c1-a0cba0db939b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/10/b910d7cc3146c7be90e284b9a901d8c5/pa/AA93259_d278f614e1df3c15dbb9ee2e03847ccc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 electric drive 100 kW e-Shine',
 'transmission': 'automatic',
 'trim': 'e-Shine',
 'year': 2022}
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA93259%27 HTTP/1.1" 200 None
2026-03-30 10:49:13 [auto1.de] INFO: Saving data for AA93259: {'created_time': 1774867753.144624, 'last_price_update_time': 1774867753.144635, 'auction_closing_time': 1774972431.0}
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA93259') HTTP/1.1" 204 0
2026-03-30 10:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_77ab3c664604c3a393dae745a4d969cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_106e9d3ba7e1cc63874269f6616df2e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_8996eb29230895e75cffc455b00b71cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_37d254666ebd97bd867c1703a4351304.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_45480b7c80cae8fcc1e659910a255596.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5cd67d0>
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_77ab3c664604c3a393dae745a4d969cc.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_77ab3c664604c3a393dae745a4d969cc.jpg saved to cache
2026-03-30 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a112729e-f655-5de9-8177-d341b7fc17b0
2026-03-30 10:49:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43a8ad0>
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_106e9d3ba7e1cc63874269f6616df2e1.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_106e9d3ba7e1cc63874269f6616df2e1.jpg saved to cache
2026-03-30 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a112729e-f655-5de9-8177-d341b7fc17b0
2026-03-30 10:49:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4230ad0>
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_8996eb29230895e75cffc455b00b71cc.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_8996eb29230895e75cffc455b00b71cc.jpg saved to cache
2026-03-30 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a112729e-f655-5de9-8177-d341b7fc17b0
2026-03-30 10:49:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea1c50>
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_37d254666ebd97bd867c1703a4351304.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_37d254666ebd97bd867c1703a4351304.jpg saved to cache
2026-03-30 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a112729e-f655-5de9-8177-d341b7fc17b0
2026-03-30 10:49:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41962d0>
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F42%252F6542c61fe6be2db4bb1186e62d39cf41%252Fpa%252FUG67497_45480b7c80cae8fcc1e659910a255596.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_45480b7c80cae8fcc1e659910a255596.jpg saved to cache
2026-03-30 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a112729e-f655-5de9-8177-d341b7fc17b0
2026-03-30 10:49:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a112729e-f655-5de9-8177-d341b7fc17b0, skipping ID generation
2026-03-30 10:49:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a112729e-f655-5de9-8177-d341b7fc17b0 with scrape type 1
2026-03-30 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a112729e-f655-5de9-8177-d341b7fc17b0 sending to next pipeline
2026-03-30 10:49:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a112729e-f655-5de9-8177-d341b7fc17b0, identifier: UG67497
2026-03-30 10:49:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a112729e-f655-5de9-8177-d341b7fc17b0 with identifier: UG67497
2026-03-30 10:49:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a112729e-f655-5de9-8177-d341b7fc17b0 with identifier: UG67497
2026-03-30 10:49:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a112729e-f655-5de9-8177-d341b7fc17b0 with identifier: UG67497 to the API
2026-03-30 10:49:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_45480b7c80cae8fcc1e659910a255596.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:55:26Z',
 'fuel_type': 'petrol',
 'id': 'a112729e-f655-5de9-8177-d341b7fc17b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG67497',
 'listing': 'auction',
 'location': 'DE, Friedrichshafen',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 170818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2829661,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_93d5ff76fbb6ae868d2662bdc14e8575.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2893176,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_37d254666ebd97bd867c1703a4351304.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2855592,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_45480b7c80cae8fcc1e659910a255596.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2447633,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_77ab3c664604c3a393dae745a4d969cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2579664,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_106e9d3ba7e1cc63874269f6616df2e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2558756,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_8996eb29230895e75cffc455b00b71cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2543536,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_6ec655dd90ba6f4d7aa29a74582718a9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2829172,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_308f16133f48899e34e1e257147d94eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2921287,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_bb226d9bc2c8d78b44421a0d253d0f24.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a112729e-f655-5de9-8177-d341b7fc17b0/a112729e-f655-5de9-8177-d341b7fc17b0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2658933,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/42/6542c61fe6be2db4bb1186e62d39cf41/pa/UG67497_4b4af5482cab2c6b4a5c93c1ed13777e.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Lounge BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2015}
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG67497%27 HTTP/1.1" 200 None
2026-03-30 10:49:15 [auto1.de] INFO: Saving data for UG67497: {'created_time': 1774867755.047463, 'last_price_update_time': 1774867755.047473, 'auction_closing_time': 1774972526.0}
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG67497') HTTP/1.1" 204 0
2026-03-30 10:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU61252> (referer: https://www.auto1.com/v1/car-details-view/PU61252/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1 with identifier: PU61252
2026-03-30 10:49:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1 with scrape type 1
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff3%252F3ff3a7fd5dd6fde2a2443d617802eff4%252Fpa%252FPU61252_edf60903d7188aa29300e5d92bd111df.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_edf60903d7188aa29300e5d92bd111df.jpg not downloaded yet
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff3%252F3ff3a7fd5dd6fde2a2443d617802eff4%252Fpa%252FPU61252_f6d941ce7ef8337c80706b39e170bb20.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_f6d941ce7ef8337c80706b39e170bb20.jpg not downloaded yet
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff3%252F3ff3a7fd5dd6fde2a2443d617802eff4%252Fpa%252FPU61252_cf2121a4f5439aa661b753831e6b06f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_cf2121a4f5439aa661b753831e6b06f9.jpg not downloaded yet
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff3%252F3ff3a7fd5dd6fde2a2443d617802eff4%252Fpa%252FPU61252_411bacc90890a9c11f4c1dc8ad37d73c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_411bacc90890a9c11f4c1dc8ad37d73c.jpg not downloaded yet
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff3%252F3ff3a7fd5dd6fde2a2443d617802eff4%252Fpa%252FPU61252_0bf40ee14b5e9649ef99ad49bad0c048.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_0bf40ee14b5e9649ef99ad49bad0c048.jpg not downloaded yet
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff3%252F3ff3a7fd5dd6fde2a2443d617802eff4%252Fpa%252FPU61252_feafce6842dca3355dbf7538068ed001.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_feafce6842dca3355dbf7538068ed001.jpg not downloaded yet
2026-03-30 10:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_edf60903d7188aa29300e5d92bd111df.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_cf2121a4f5439aa661b753831e6b06f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_feafce6842dca3355dbf7538068ed001.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4167150>
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1/7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff3%252F3ff3a7fd5dd6fde2a2443d617802eff4%252Fpa%252FPU61252_edf60903d7188aa29300e5d92bd111df.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_edf60903d7188aa29300e5d92bd111df.jpg saved to cache
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1
2026-03-30 10:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_411bacc90890a9c11f4c1dc8ad37d73c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea0ad0>
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1/7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff3%252F3ff3a7fd5dd6fde2a2443d617802eff4%252Fpa%252FPU61252_cf2121a4f5439aa661b753831e6b06f9.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_cf2121a4f5439aa661b753831e6b06f9.jpg saved to cache
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1
2026-03-30 10:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_f6d941ce7ef8337c80706b39e170bb20.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3b0d0>
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1/7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff3%252F3ff3a7fd5dd6fde2a2443d617802eff4%252Fpa%252FPU61252_feafce6842dca3355dbf7538068ed001.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_feafce6842dca3355dbf7538068ed001.jpg saved to cache
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1
2026-03-30 10:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_0bf40ee14b5e9649ef99ad49bad0c048.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeed0ed0>
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1/7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff3%252F3ff3a7fd5dd6fde2a2443d617802eff4%252Fpa%252FPU61252_411bacc90890a9c11f4c1dc8ad37d73c.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_411bacc90890a9c11f4c1dc8ad37d73c.jpg saved to cache
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea0810>
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1/7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff3%252F3ff3a7fd5dd6fde2a2443d617802eff4%252Fpa%252FPU61252_f6d941ce7ef8337c80706b39e170bb20.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_f6d941ce7ef8337c80706b39e170bb20.jpg saved to cache
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee482690>
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1/7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff3%252F3ff3a7fd5dd6fde2a2443d617802eff4%252Fpa%252FPU61252_0bf40ee14b5e9649ef99ad49bad0c048.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_0bf40ee14b5e9649ef99ad49bad0c048.jpg saved to cache
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1
2026-03-30 10:49:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1, skipping ID generation
2026-03-30 10:49:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1 with scrape type 1
2026-03-30 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1 sending to next pipeline
2026-03-30 10:49:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1, identifier: PU61252
2026-03-30 10:49:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1 with identifier: PU61252
2026-03-30 10:49:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1 with identifier: PU61252
2026-03-30 10:49:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1 with identifier: PU61252 to the API
2026-03-30 10:49:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_0bf40ee14b5e9649ef99ad49bad0c048.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:18:10Z',
 'fuel_type': 'petrol',
 'id': '7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU61252',
 'listing': 'auction',
 'location': 'DE, Bensheim',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 135099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1/7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_edf60903d7188aa29300e5d92bd111df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1/7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_f6d941ce7ef8337c80706b39e170bb20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1/7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_cf2121a4f5439aa661b753831e6b06f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1/7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_411bacc90890a9c11f4c1dc8ad37d73c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1/7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_0bf40ee14b5e9649ef99ad49bad0c048.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1/7cabd197-6ab7-5ec6-a5b3-d8f5e702e4f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f3/3ff3a7fd5dd6fde2a2443d617802eff4/pa/PU61252_feafce6842dca3355dbf7538068ed001.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.1 Inform',
 'transmission': 'manual',
 'trim': 'Inform',
 'year': 2009}
2026-03-30 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU61252%27 HTTP/1.1" 200 None
2026-03-30 10:49:16 [auto1.de] INFO: Saving data for PU61252: {'created_time': 1774867756.303678, 'last_price_update_time': 1774867756.303689, 'auction_closing_time': 1774970290.0}
2026-03-30 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU61252') HTTP/1.1" 204 0
2026-03-30 10:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WC05131> (referer: https://www.auto1.com/v1/car-details-view/WC05131/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:16 [auto1.de] INFO: Channel: 24h | Page: 29 | totalHits: 9496 | hits on page: 40
2026-03-30 10:49:16 [auto1.de] INFO: Found listing with ID: RD74576
2026-03-30 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD74576%27 HTTP/1.1" 200 None
2026-03-30 10:49:16 [auto1.de] INFO: Scrape type for RD74576: 0
2026-03-30 10:49:16 [auto1.de] INFO: Found listing with ID: NA95375
2026-03-30 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA95375%27 HTTP/1.1" 200 None
2026-03-30 10:49:16 [auto1.de] INFO: Scrape type for NA95375: 0
2026-03-30 10:49:16 [auto1.de] INFO: Found listing with ID: HN30434
2026-03-30 10:49:16 [auto1.de] INFO: Found listing with ID: CB39322
2026-03-30 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB39322%27 HTTP/1.1" 200 None
2026-03-30 10:49:16 [auto1.de] INFO: Scrape type for CB39322: 0
2026-03-30 10:49:16 [auto1.de] INFO: Found listing with ID: CC70846
2026-03-30 10:49:16 [auto1.de] INFO: Found listing with ID: NJ97251
2026-03-30 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ97251%27 HTTP/1.1" 200 None
2026-03-30 10:49:16 [auto1.de] INFO: Scrape type for NJ97251: 0
2026-03-30 10:49:16 [auto1.de] INFO: Found listing with ID: AJ07817
2026-03-30 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ07817%27 HTTP/1.1" 200 None
2026-03-30 10:49:16 [auto1.de] INFO: Scrape type for AJ07817: 2
2026-03-30 10:49:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2470cfcf-f6d4-586c-9b50-1611414fc64e with identifier: AJ07817
2026-03-30 10:49:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2470cfcf-f6d4-586c-9b50-1611414fc64e with scrape type 2
2026-03-30 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2470cfcf-f6d4-586c-9b50-1611414fc64e with scrape type 2
2026-03-30 10:49:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2470cfcf-f6d4-586c-9b50-1611414fc64e, identifier: AJ07817
2026-03-30 10:49:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2470cfcf-f6d4-586c-9b50-1611414fc64e with identifier: AJ07817
2026-03-30 10:49:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2470cfcf-f6d4-586c-9b50-1611414fc64e with identifier: AJ07817
2026-03-30 10:49:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2470cfcf-f6d4-586c-9b50-1611414fc64e with identifier: AJ07817 to the API
2026-03-30 10:49:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:30:44Z',
 'fuel_type': 'hybrid',
 'id': '2470cfcf-f6d4-586c-9b50-1611414fc64e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ07817',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 59748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-17',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium X',
 'transmission': 'automatic',
 'trim': 'Titanium X',
 'year': 2022}
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ07817%27 HTTP/1.1" 200 None
2026-03-30 10:49:17 [auto1.de] INFO: Saving data for AJ07817: {'auction_closing_time': 1774971044.0, 'created_time': 1774463670.47931, 'last_price_update_time': 1774867757.071328}
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ07817') HTTP/1.1" 204 0
2026-03-30 10:49:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3d7c9da-a51c-5119-832e-1cbcbe4f7c93 with identifier: WC05131
2026-03-30 10:49:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3d7c9da-a51c-5119-832e-1cbcbe4f7c93 with scrape type 1
2026-03-30 10:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3d7c9da-a51c-5119-832e-1cbcbe4f7c93
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_2f83cdb301a0f8807f8af60b8b8ab5ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_2f83cdb301a0f8807f8af60b8b8ab5ca.jpg not downloaded yet
2026-03-30 10:49:17 [auto1.de] INFO: Found listing with ID: MR26269
2026-03-30 10:49:17 [auto1.de] INFO: Found listing with ID: PD71569
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD71569%27 HTTP/1.1" 200 None
2026-03-30 10:49:17 [auto1.de] INFO: Scrape type for PD71569: 1
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_62102333f559c0975a729de87bddd62f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_62102333f559c0975a729de87bddd62f.jpg not downloaded yet
2026-03-30 10:49:17 [auto1.de] INFO: Found listing with ID: PS41324
2026-03-30 10:49:17 [auto1.de] INFO: Found listing with ID: NJ32517
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ32517%27 HTTP/1.1" 200 None
2026-03-30 10:49:17 [auto1.de] INFO: Scrape type for NJ32517: 2
2026-03-30 10:49:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4ce8be1-1c07-536a-9ba2-bbd744e79cef with identifier: NJ32517
2026-03-30 10:49:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4ce8be1-1c07-536a-9ba2-bbd744e79cef with scrape type 2
2026-03-30 10:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4ce8be1-1c07-536a-9ba2-bbd744e79cef with scrape type 2
2026-03-30 10:49:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4ce8be1-1c07-536a-9ba2-bbd744e79cef, identifier: NJ32517
2026-03-30 10:49:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4ce8be1-1c07-536a-9ba2-bbd744e79cef with identifier: NJ32517
2026-03-30 10:49:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4ce8be1-1c07-536a-9ba2-bbd744e79cef with identifier: NJ32517
2026-03-30 10:49:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4ce8be1-1c07-536a-9ba2-bbd744e79cef with identifier: NJ32517 to the API
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:44:10Z',
 'fuel_type': 'petrol',
 'id': 'f4ce8be1-1c07-536a-9ba2-bbd744e79cef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ32517',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 209198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-30',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 5 Star Edition',
 'transmission': 'manual',
 'trim': '5 Star Edition',
 'year': 2013}
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ32517%27 HTTP/1.1" 200 None
2026-03-30 10:49:17 [auto1.de] INFO: Saving data for NJ32517: {'auction_closing_time': 1774971850.0, 'created_time': 1773984680.86599, 'last_price_update_time': 1774867757.722433}
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ32517') HTTP/1.1" 204 0
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_8c136d8dd673098f4b68374fb5b8080a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_8c136d8dd673098f4b68374fb5b8080a.jpg not downloaded yet
2026-03-30 10:49:17 [auto1.de] INFO: Found listing with ID: TY96424
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY96424%27 HTTP/1.1" 200 None
2026-03-30 10:49:17 [auto1.de] INFO: Scrape type for TY96424: 2
2026-03-30 10:49:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e626c93f-4838-5531-b303-efe3957e32e3 with identifier: TY96424
2026-03-30 10:49:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e626c93f-4838-5531-b303-efe3957e32e3 with scrape type 2
2026-03-30 10:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e626c93f-4838-5531-b303-efe3957e32e3 with scrape type 2
2026-03-30 10:49:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e626c93f-4838-5531-b303-efe3957e32e3, identifier: TY96424
2026-03-30 10:49:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e626c93f-4838-5531-b303-efe3957e32e3 with identifier: TY96424
2026-03-30 10:49:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e626c93f-4838-5531-b303-efe3957e32e3 with identifier: TY96424
2026-03-30 10:49:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e626c93f-4838-5531-b303-efe3957e32e3 with identifier: TY96424 to the API
2026-03-30 10:49:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e626c93f-4838-5531-b303-efe3957e32e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY96424',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 363191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-05',
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Comfortline lang 4Motion',
 'transmission': 'manual',
 'trim': 'Comfortline lang 4Motion',
 'year': 2016}
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY96424%27 HTTP/1.1" 200 None
2026-03-30 10:49:18 [auto1.de] INFO: Saving data for TY96424: {'auction_closing_time': 1774969200.0, 'created_time': 1774434731.171678, 'last_price_update_time': 1774867758.181131}
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY96424') HTTP/1.1" 204 0
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_5bd277fd7b2d44d2ac4a890659c77c64.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_5bd277fd7b2d44d2ac4a890659c77c64.jpg not downloaded yet
2026-03-30 10:49:18 [auto1.de] INFO: Found listing with ID: CM85827
2026-03-30 10:49:18 [auto1.de] INFO: Found listing with ID: JU24263
2026-03-30 10:49:18 [auto1.de] INFO: Found listing with ID: NH24337
2026-03-30 10:49:18 [auto1.de] INFO: Found listing with ID: XT31842
2026-03-30 10:49:18 [auto1.de] INFO: Found listing with ID: UU93742
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU93742%27 HTTP/1.1" 200 None
2026-03-30 10:49:18 [auto1.de] INFO: Scrape type for UU93742: 2
2026-03-30 10:49:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffe1b269-852f-5b58-a1d7-02845f8bc9a5 with identifier: UU93742
2026-03-30 10:49:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffe1b269-852f-5b58-a1d7-02845f8bc9a5 with scrape type 2
2026-03-30 10:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffe1b269-852f-5b58-a1d7-02845f8bc9a5 with scrape type 2
2026-03-30 10:49:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffe1b269-852f-5b58-a1d7-02845f8bc9a5, identifier: UU93742
2026-03-30 10:49:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffe1b269-852f-5b58-a1d7-02845f8bc9a5 with identifier: UU93742
2026-03-30 10:49:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffe1b269-852f-5b58-a1d7-02845f8bc9a5 with identifier: UU93742
2026-03-30 10:49:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffe1b269-852f-5b58-a1d7-02845f8bc9a5 with identifier: UU93742 to the API
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:15:56Z',
 'fuel_type': 'petrol',
 'id': 'ffe1b269-852f-5b58-a1d7-02845f8bc9a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU93742',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 98522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-20',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU93742%27 HTTP/1.1" 200 None
2026-03-30 10:49:18 [auto1.de] INFO: Saving data for UU93742: {'auction_closing_time': 1774970156.0, 'created_time': 1774378217.045321, 'last_price_update_time': 1774867758.677478}
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UU93742') HTTP/1.1" 204 0
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_4ccdfb87a91b70f91df171c9541f27c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_4ccdfb87a91b70f91df171c9541f27c4.jpg not downloaded yet
2026-03-30 10:49:18 [auto1.de] INFO: Found listing with ID: UX23501
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX23501%27 HTTP/1.1" 200 None
2026-03-30 10:49:18 [auto1.de] INFO: Scrape type for UX23501: 2
2026-03-30 10:49:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa4fb98d-b840-59e3-a6bc-85b2e2a6d625 with identifier: UX23501
2026-03-30 10:49:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa4fb98d-b840-59e3-a6bc-85b2e2a6d625 with scrape type 2
2026-03-30 10:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa4fb98d-b840-59e3-a6bc-85b2e2a6d625 with scrape type 2
2026-03-30 10:49:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa4fb98d-b840-59e3-a6bc-85b2e2a6d625, identifier: UX23501
2026-03-30 10:49:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa4fb98d-b840-59e3-a6bc-85b2e2a6d625 with identifier: UX23501
2026-03-30 10:49:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa4fb98d-b840-59e3-a6bc-85b2e2a6d625 with identifier: UX23501
2026-03-30 10:49:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa4fb98d-b840-59e3-a6bc-85b2e2a6d625 with identifier: UX23501 to the API
2026-03-30 10:49:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:15:43Z',
 'fuel_type': 'diesel',
 'id': 'aa4fb98d-b840-59e3-a6bc-85b2e2a6d625',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX23501',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 158528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2016}
2026-03-30 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX23501%27 HTTP/1.1" 200 None
2026-03-30 10:49:19 [auto1.de] INFO: Saving data for UX23501: {'auction_closing_time': 1774970143.0, 'created_time': 1773302601.98499, 'last_price_update_time': 1774867759.198489}
2026-03-30 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX23501') HTTP/1.1" 204 0
2026-03-30 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_eaa19892accbb9cc8c73738bea5594a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_eaa19892accbb9cc8c73738bea5594a6.jpg not downloaded yet
2026-03-30 10:49:19 [auto1.de] INFO: Found listing with ID: NE88394
2026-03-30 10:49:19 [auto1.de] INFO: Found listing with ID: VJ35492
2026-03-30 10:49:19 [auto1.de] INFO: Found listing with ID: ZF59355
2026-03-30 10:49:19 [auto1.de] INFO: Found listing with ID: CV85999
2026-03-30 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV85999%27 HTTP/1.1" 200 None
2026-03-30 10:49:19 [auto1.de] INFO: Scrape type for CV85999: 2
2026-03-30 10:49:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec088556-cd5b-5007-a746-88c65155df00 with identifier: CV85999
2026-03-30 10:49:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec088556-cd5b-5007-a746-88c65155df00 with scrape type 2
2026-03-30 10:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec088556-cd5b-5007-a746-88c65155df00 with scrape type 2
2026-03-30 10:49:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec088556-cd5b-5007-a746-88c65155df00, identifier: CV85999
2026-03-30 10:49:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec088556-cd5b-5007-a746-88c65155df00 with identifier: CV85999
2026-03-30 10:49:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec088556-cd5b-5007-a746-88c65155df00 with identifier: CV85999
2026-03-30 10:49:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec088556-cd5b-5007-a746-88c65155df00 with identifier: CV85999 to the API
2026-03-30 10:49:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:23:10Z',
 'fuel_type': 'petrol',
 'id': 'ec088556-cd5b-5007-a746-88c65155df00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV85999',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 73170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-16',
 'seller_name': None,
 'title': 'MINI Clubman One',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-30 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV85999%27 HTTP/1.1" 200 None
2026-03-30 10:49:19 [auto1.de] INFO: Saving data for CV85999: {'auction_closing_time': 1774970590.0, 'created_time': 1774467249.652989, 'last_price_update_time': 1774867759.819031}
2026-03-30 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV85999') HTTP/1.1" 204 0
2026-03-30 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_db7fe77a0f2f80646199115c559851eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_db7fe77a0f2f80646199115c559851eb.jpg not downloaded yet
2026-03-30 10:49:19 [auto1.de] INFO: Found listing with ID: HZ65828
2026-03-30 10:49:19 [auto1.de] INFO: Found listing with ID: EY69917
2026-03-30 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY69917%27 HTTP/1.1" 200 None
2026-03-30 10:49:19 [auto1.de] INFO: Scrape type for EY69917: 2
2026-03-30 10:49:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b72912a6-59fa-5f74-b7ec-ad45b24ba23e with identifier: EY69917
2026-03-30 10:49:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b72912a6-59fa-5f74-b7ec-ad45b24ba23e with scrape type 2
2026-03-30 10:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b72912a6-59fa-5f74-b7ec-ad45b24ba23e with scrape type 2
2026-03-30 10:49:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b72912a6-59fa-5f74-b7ec-ad45b24ba23e, identifier: EY69917
2026-03-30 10:49:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b72912a6-59fa-5f74-b7ec-ad45b24ba23e with identifier: EY69917
2026-03-30 10:49:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b72912a6-59fa-5f74-b7ec-ad45b24ba23e with identifier: EY69917
2026-03-30 10:49:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b72912a6-59fa-5f74-b7ec-ad45b24ba23e with identifier: EY69917 to the API
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:32:04Z',
 'fuel_type': 'diesel',
 'id': 'b72912a6-59fa-5f74-b7ec-ad45b24ba23e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY69917',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 245811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-05',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY69917%27 HTTP/1.1" 200 None
2026-03-30 10:49:20 [auto1.de] INFO: Saving data for EY69917: {'auction_closing_time': 1774971124.0, 'created_time': 1774379620.567098, 'last_price_update_time': 1774867760.297485}
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY69917') HTTP/1.1" 204 0
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_98a43414a5622d01880d9d5e298dfef7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_98a43414a5622d01880d9d5e298dfef7.jpg not downloaded yet
2026-03-30 10:49:20 [auto1.de] INFO: Found listing with ID: CP53358
2026-03-30 10:49:20 [auto1.de] INFO: Found listing with ID: WM77148
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM77148%27 HTTP/1.1" 200 None
2026-03-30 10:49:20 [auto1.de] INFO: Scrape type for WM77148: 2
2026-03-30 10:49:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d21b937-a3ed-5ed5-bc83-d92ae10c688b with identifier: WM77148
2026-03-30 10:49:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d21b937-a3ed-5ed5-bc83-d92ae10c688b with scrape type 2
2026-03-30 10:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d21b937-a3ed-5ed5-bc83-d92ae10c688b with scrape type 2
2026-03-30 10:49:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d21b937-a3ed-5ed5-bc83-d92ae10c688b, identifier: WM77148
2026-03-30 10:49:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d21b937-a3ed-5ed5-bc83-d92ae10c688b with identifier: WM77148
2026-03-30 10:49:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d21b937-a3ed-5ed5-bc83-d92ae10c688b with identifier: WM77148
2026-03-30 10:49:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d21b937-a3ed-5ed5-bc83-d92ae10c688b with identifier: WM77148 to the API
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 173,
 'expiration_date': '2026-03-31T15:43:25Z',
 'fuel_type': 'diesel',
 'id': '6d21b937-a3ed-5ed5-bc83-d92ae10c688b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM77148',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 83999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-15',
 'seller_name': None,
 'title': 'Renault Laguna 2.0 dCi Energy GT',
 'transmission': 'manual',
 'trim': 'GT',
 'year': 2015}
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM77148%27 HTTP/1.1" 200 None
2026-03-30 10:49:20 [auto1.de] INFO: Saving data for WM77148: {'auction_closing_time': 1774971805.0, 'created_time': 1773302854.662591, 'last_price_update_time': 1774867760.750142}
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM77148') HTTP/1.1" 204 0
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_6ef43f1f94269c15399cc70fe75b8547.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_6ef43f1f94269c15399cc70fe75b8547.jpg not downloaded yet
2026-03-30 10:49:20 [auto1.de] INFO: Found listing with ID: JJ72378
2026-03-30 10:49:20 [auto1.de] INFO: Found listing with ID: HC12239
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC12239%27 HTTP/1.1" 200 None
2026-03-30 10:49:20 [auto1.de] INFO: Scrape type for HC12239: 2
2026-03-30 10:49:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 903bfe17-34db-55e5-95c2-b1b7850dcf02 with identifier: HC12239
2026-03-30 10:49:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 903bfe17-34db-55e5-95c2-b1b7850dcf02 with scrape type 2
2026-03-30 10:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 903bfe17-34db-55e5-95c2-b1b7850dcf02 with scrape type 2
2026-03-30 10:49:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 903bfe17-34db-55e5-95c2-b1b7850dcf02, identifier: HC12239
2026-03-30 10:49:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 903bfe17-34db-55e5-95c2-b1b7850dcf02 with identifier: HC12239
2026-03-30 10:49:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 903bfe17-34db-55e5-95c2-b1b7850dcf02 with identifier: HC12239
2026-03-30 10:49:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 903bfe17-34db-55e5-95c2-b1b7850dcf02 with identifier: HC12239 to the API
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:05:40Z',
 'fuel_type': 'diesel',
 'id': '903bfe17-34db-55e5-95c2-b1b7850dcf02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC12239',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 310488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC12239%27 HTTP/1.1" 200 None
2026-03-30 10:49:21 [auto1.de] INFO: Saving data for HC12239: {'auction_closing_time': 1774969540.0, 'created_time': 1774031527.758934, 'last_price_update_time': 1774867761.239506}
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC12239') HTTP/1.1" 204 0
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_dc9b6b5f74bf11d2e3f81c4bb923a226.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_dc9b6b5f74bf11d2e3f81c4bb923a226.jpg not downloaded yet
2026-03-30 10:49:21 [auto1.de] INFO: Found listing with ID: BS35535
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS35535%27 HTTP/1.1" 200 None
2026-03-30 10:49:21 [auto1.de] INFO: Scrape type for BS35535: 2
2026-03-30 10:49:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c87be409-ad5a-5fdf-8ed7-42e93ae74951 with identifier: BS35535
2026-03-30 10:49:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c87be409-ad5a-5fdf-8ed7-42e93ae74951 with scrape type 2
2026-03-30 10:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c87be409-ad5a-5fdf-8ed7-42e93ae74951 with scrape type 2
2026-03-30 10:49:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c87be409-ad5a-5fdf-8ed7-42e93ae74951, identifier: BS35535
2026-03-30 10:49:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c87be409-ad5a-5fdf-8ed7-42e93ae74951 with identifier: BS35535
2026-03-30 10:49:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c87be409-ad5a-5fdf-8ed7-42e93ae74951 with identifier: BS35535
2026-03-30 10:49:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c87be409-ad5a-5fdf-8ed7-42e93ae74951 with identifier: BS35535 to the API
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:30:58Z',
 'fuel_type': 'petrol',
 'id': 'c87be409-ad5a-5fdf-8ed7-42e93ae74951',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS35535',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 82697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-12',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS35535%27 HTTP/1.1" 200 None
2026-03-30 10:49:21 [auto1.de] INFO: Saving data for BS35535: {'auction_closing_time': 1774971058.0, 'created_time': 1774379435.406497, 'last_price_update_time': 1774867761.743207}
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS35535') HTTP/1.1" 204 0
2026-03-30 10:49:21 [auto1.de] INFO: Found listing with ID: WR71017
2026-03-30 10:49:21 [auto1.de] INFO: Found listing with ID: VX44094
2026-03-30 10:49:21 [auto1.de] INFO: Found listing with ID: XE29778
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE29778%27 HTTP/1.1" 200 None
2026-03-30 10:49:21 [auto1.de] INFO: Scrape type for XE29778: 2
2026-03-30 10:49:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e94bf52e-c04e-5a0f-b073-6d2dc3251b94 with identifier: XE29778
2026-03-30 10:49:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e94bf52e-c04e-5a0f-b073-6d2dc3251b94 with scrape type 2
2026-03-30 10:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e94bf52e-c04e-5a0f-b073-6d2dc3251b94 with scrape type 2
2026-03-30 10:49:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e94bf52e-c04e-5a0f-b073-6d2dc3251b94, identifier: XE29778
2026-03-30 10:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e94bf52e-c04e-5a0f-b073-6d2dc3251b94 with identifier: XE29778
2026-03-30 10:49:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e94bf52e-c04e-5a0f-b073-6d2dc3251b94 with identifier: XE29778
2026-03-30 10:49:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e94bf52e-c04e-5a0f-b073-6d2dc3251b94 with identifier: XE29778 to the API
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:47:16Z',
 'fuel_type': 'petrol',
 'id': 'e94bf52e-c04e-5a0f-b073-6d2dc3251b94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE29778',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 87205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-02',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2005}
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE29778%27 HTTP/1.1" 200 None
2026-03-30 10:49:22 [auto1.de] INFO: Saving data for XE29778: {'auction_closing_time': 1774972036.0, 'created_time': 1773343065.596073, 'last_price_update_time': 1774867762.295608}
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE29778') HTTP/1.1" 204 0
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: UH83431
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH83431%27 HTTP/1.1" 200 None
2026-03-30 10:49:22 [auto1.de] INFO: Scrape type for UH83431: 2
2026-03-30 10:49:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae0dabc2-cfcb-5598-982a-1e2e0e9fa4dd with identifier: UH83431
2026-03-30 10:49:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae0dabc2-cfcb-5598-982a-1e2e0e9fa4dd with scrape type 2
2026-03-30 10:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae0dabc2-cfcb-5598-982a-1e2e0e9fa4dd with scrape type 2
2026-03-30 10:49:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae0dabc2-cfcb-5598-982a-1e2e0e9fa4dd, identifier: UH83431
2026-03-30 10:49:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae0dabc2-cfcb-5598-982a-1e2e0e9fa4dd with identifier: UH83431
2026-03-30 10:49:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae0dabc2-cfcb-5598-982a-1e2e0e9fa4dd with identifier: UH83431
2026-03-30 10:49:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae0dabc2-cfcb-5598-982a-1e2e0e9fa4dd with identifier: UH83431 to the API
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:53:42Z',
 'fuel_type': 'diesel',
 'id': 'ae0dabc2-cfcb-5598-982a-1e2e0e9fa4dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH83431',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 181958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-30',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi Titanium AWD',
 'transmission': 'manual',
 'trim': 'Titanium AWD',
 'year': 2016}
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH83431%27 HTTP/1.1" 200 None
2026-03-30 10:49:22 [auto1.de] INFO: Saving data for UH83431: {'auction_closing_time': 1774972422.0, 'created_time': 1773342031.667592, 'last_price_update_time': 1774867762.752458}
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH83431') HTTP/1.1" 204 0
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: RV28657
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: LP84561
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: CP09804
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP09804%27 HTTP/1.1" 200 None
2026-03-30 10:49:22 [auto1.de] INFO: Scrape type for CP09804: 2
2026-03-30 10:49:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deee550c-9782-52a2-925f-2d90b82f24c3 with identifier: CP09804
2026-03-30 10:49:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deee550c-9782-52a2-925f-2d90b82f24c3 with scrape type 2
2026-03-30 10:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item deee550c-9782-52a2-925f-2d90b82f24c3 with scrape type 2
2026-03-30 10:49:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: deee550c-9782-52a2-925f-2d90b82f24c3, identifier: CP09804
2026-03-30 10:49:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: deee550c-9782-52a2-925f-2d90b82f24c3 with identifier: CP09804
2026-03-30 10:49:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: deee550c-9782-52a2-925f-2d90b82f24c3 with identifier: CP09804
2026-03-30 10:49:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: deee550c-9782-52a2-925f-2d90b82f24c3 with identifier: CP09804 to the API
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:24:19Z',
 'fuel_type': 'petrol',
 'id': 'deee550c-9782-52a2-925f-2d90b82f24c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP09804',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 207368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-01-09',
 'seller_name': None,
 'title': 'BMW 3er 320Ci',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP09804%27 HTTP/1.1" 200 None
2026-03-30 10:49:23 [auto1.de] INFO: Saving data for CP09804: {'auction_closing_time': 1774970659.0, 'created_time': 1774378110.851085, 'last_price_update_time': 1774867763.216574}
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP09804') HTTP/1.1" 204 0
2026-03-30 10:49:23 [auto1.de] INFO: Channel: 24h | Page: 30 | totalHits: 9497 | hits on page: 40
2026-03-30 10:49:23 [auto1.de] INFO: Found listing with ID: VA30007
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA30007%27 HTTP/1.1" 200 None
2026-03-30 10:49:23 [auto1.de] INFO: Scrape type for VA30007: 2
2026-03-30 10:49:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa245c2f-28bb-5300-8be3-7893abeb3000 with identifier: VA30007
2026-03-30 10:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa245c2f-28bb-5300-8be3-7893abeb3000 with scrape type 2
2026-03-30 10:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa245c2f-28bb-5300-8be3-7893abeb3000 with scrape type 2
2026-03-30 10:49:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa245c2f-28bb-5300-8be3-7893abeb3000, identifier: VA30007
2026-03-30 10:49:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa245c2f-28bb-5300-8be3-7893abeb3000 with identifier: VA30007
2026-03-30 10:49:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa245c2f-28bb-5300-8be3-7893abeb3000 with identifier: VA30007
2026-03-30 10:49:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa245c2f-28bb-5300-8be3-7893abeb3000 with identifier: VA30007 to the API
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'other',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-31T15:56:03Z',
 'fuel_type': 'hybrid',
 'id': 'aa245c2f-28bb-5300-8be3-7893abeb3000',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA30007',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 48504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-19',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Plug-in Hybrid Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2022}
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA30007%27 HTTP/1.1" 200 None
2026-03-30 10:49:23 [auto1.de] INFO: Saving data for VA30007: {'auction_closing_time': 1774972563.0, 'created_time': 1774463653.421972, 'last_price_update_time': 1774867763.67636}
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA30007') HTTP/1.1" 204 0
2026-03-30 10:49:23 [auto1.de] INFO: Found listing with ID: EL91919
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91919%27 HTTP/1.1" 200 None
2026-03-30 10:49:23 [auto1.de] INFO: Scrape type for EL91919: 2
2026-03-30 10:49:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34e2fa4a-109d-526e-909f-bf4c1996e2a8 with identifier: EL91919
2026-03-30 10:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34e2fa4a-109d-526e-909f-bf4c1996e2a8 with scrape type 2
2026-03-30 10:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34e2fa4a-109d-526e-909f-bf4c1996e2a8 with scrape type 2
2026-03-30 10:49:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34e2fa4a-109d-526e-909f-bf4c1996e2a8, identifier: EL91919
2026-03-30 10:49:23 [auto1.de] INFO: Found listing with ID: EC56413
2026-03-30 10:49:23 [auto1.de] INFO: Found listing with ID: AX98840
2026-03-30 10:49:23 [auto1.de] INFO: Found listing with ID: EL91919
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91919%27 HTTP/1.1" 200 None
2026-03-30 10:49:23 [auto1.de] INFO: Scrape type for EL91919: 2
2026-03-30 10:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34e2fa4a-109d-526e-909f-bf4c1996e2a8 with scrape type 2
2026-03-30 10:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34e2fa4a-109d-526e-909f-bf4c1996e2a8 with scrape type 2
2026-03-30 10:49:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34e2fa4a-109d-526e-909f-bf4c1996e2a8, identifier: EL91919
2026-03-30 10:49:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34e2fa4a-109d-526e-909f-bf4c1996e2a8 with identifier: EL91919
2026-03-30 10:49:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34e2fa4a-109d-526e-909f-bf4c1996e2a8 with identifier: EL91919
2026-03-30 10:49:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34e2fa4a-109d-526e-909f-bf4c1996e2a8 with identifier: EL91919 to the API
2026-03-30 10:49:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:05:49Z',
 'fuel_type': 'diesel',
 'id': '34e2fa4a-109d-526e-909f-bf4c1996e2a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL91919',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 177678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-09',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2015}
2026-03-30 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91919%27 HTTP/1.1" 200 None
2026-03-30 10:49:24 [auto1.de] INFO: Saving data for EL91919: {'auction_closing_time': 1774969549.0, 'created_time': 1774463670.153035, 'last_price_update_time': 1774867764.671984}
2026-03-30 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL91919') HTTP/1.1" 204 0
2026-03-30 10:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NA40709/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34e2fa4a-109d-526e-909f-bf4c1996e2a8 with identifier: EL91919
2026-03-30 10:49:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34e2fa4a-109d-526e-909f-bf4c1996e2a8 with identifier: EL91919
2026-03-30 10:49:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34e2fa4a-109d-526e-909f-bf4c1996e2a8 with identifier: EL91919 to the API
2026-03-30 10:49:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:05:49Z',
 'fuel_type': 'diesel',
 'id': '34e2fa4a-109d-526e-909f-bf4c1996e2a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL91919',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 177678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-09',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2015}
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91919%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [auto1.de] INFO: Saving data for EL91919: {'auction_closing_time': 1774969549.0, 'created_time': 1774463670.153035, 'last_price_update_time': 1774867765.068641}
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL91919') HTTP/1.1" 204 0
2026-03-30 10:49:25 [auto1.de] INFO: Found listing with ID: NG38920
2026-03-30 10:49:25 [auto1.de] INFO: Found listing with ID: LW90861
2026-03-30 10:49:25 [auto1.de] INFO: Found listing with ID: AM86665
2026-03-30 10:49:25 [auto1.de] INFO: Found listing with ID: RZ82466
2026-03-30 10:49:25 [auto1.de] INFO: Found listing with ID: RD11154
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD11154%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [auto1.de] INFO: Scrape type for RD11154: 2
2026-03-30 10:49:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d373598d-114c-50b6-bf5e-84776e77bbfd with identifier: RD11154
2026-03-30 10:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d373598d-114c-50b6-bf5e-84776e77bbfd with scrape type 2
2026-03-30 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d373598d-114c-50b6-bf5e-84776e77bbfd with scrape type 2
2026-03-30 10:49:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d373598d-114c-50b6-bf5e-84776e77bbfd, identifier: RD11154
2026-03-30 10:49:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d373598d-114c-50b6-bf5e-84776e77bbfd with identifier: RD11154
2026-03-30 10:49:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d373598d-114c-50b6-bf5e-84776e77bbfd with identifier: RD11154
2026-03-30 10:49:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d373598d-114c-50b6-bf5e-84776e77bbfd with identifier: RD11154 to the API
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:17:34Z',
 'fuel_type': 'petrol',
 'id': 'd373598d-114c-50b6-bf5e-84776e77bbfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD11154',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 56510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-22',
 'seller_name': None,
 'title': 'Hyundai i20 1.4 Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2018}
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD11154%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [auto1.de] INFO: Saving data for RD11154: {'auction_closing_time': 1774970254.0, 'created_time': 1774379968.516042, 'last_price_update_time': 1774867765.502659}
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD11154') HTTP/1.1" 204 0
2026-03-30 10:49:25 [auto1.de] INFO: Found listing with ID: JU90963
2026-03-30 10:49:25 [auto1.de] INFO: Found listing with ID: XL53582
2026-03-30 10:49:25 [auto1.de] INFO: Found listing with ID: JW22409
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW22409%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [auto1.de] INFO: Scrape type for JW22409: 2
2026-03-30 10:49:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 605ba021-67ab-5be9-9579-8446dbad6477 with identifier: JW22409
2026-03-30 10:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 605ba021-67ab-5be9-9579-8446dbad6477 with scrape type 2
2026-03-30 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 605ba021-67ab-5be9-9579-8446dbad6477 with scrape type 2
2026-03-30 10:49:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 605ba021-67ab-5be9-9579-8446dbad6477, identifier: JW22409
2026-03-30 10:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PD71569/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 605ba021-67ab-5be9-9579-8446dbad6477 with identifier: JW22409
2026-03-30 10:49:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 605ba021-67ab-5be9-9579-8446dbad6477 with identifier: JW22409
2026-03-30 10:49:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 605ba021-67ab-5be9-9579-8446dbad6477 with identifier: JW22409 to the API
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:55:05Z',
 'fuel_type': 'petrol',
 'id': '605ba021-67ab-5be9-9579-8446dbad6477',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW22409',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 186921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-07',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2009}
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW22409%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [auto1.de] INFO: Saving data for JW22409: {'auction_closing_time': 1774972505.0, 'created_time': 1774466152.645656, 'last_price_update_time': 1774867765.933498}
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW22409') HTTP/1.1" 204 0
2026-03-30 10:49:25 [auto1.de] INFO: Found listing with ID: KZ90725
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ90725%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [auto1.de] INFO: Scrape type for KZ90725: 2
2026-03-30 10:49:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 872082ce-46b5-579c-8216-ff01a20dae57 with identifier: KZ90725
2026-03-30 10:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 872082ce-46b5-579c-8216-ff01a20dae57 with scrape type 2
2026-03-30 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 872082ce-46b5-579c-8216-ff01a20dae57 with scrape type 2
2026-03-30 10:49:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 872082ce-46b5-579c-8216-ff01a20dae57, identifier: KZ90725
2026-03-30 10:49:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 872082ce-46b5-579c-8216-ff01a20dae57 with identifier: KZ90725
2026-03-30 10:49:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 872082ce-46b5-579c-8216-ff01a20dae57 with identifier: KZ90725
2026-03-30 10:49:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 872082ce-46b5-579c-8216-ff01a20dae57 with identifier: KZ90725 to the API
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-31T15:43:44Z',
 'fuel_type': 'petrol',
 'id': '872082ce-46b5-579c-8216-ff01a20dae57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ90725',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 249269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-10',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2007}
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ90725%27 HTTP/1.1" 200 None
2026-03-30 10:49:26 [auto1.de] INFO: Saving data for KZ90725: {'auction_closing_time': 1774971824.0, 'created_time': 1774467718.003512, 'last_price_update_time': 1774867766.369595}
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ90725') HTTP/1.1" 204 0
2026-03-30 10:49:26 [auto1.de] INFO: Found listing with ID: JG32595
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG32595%27 HTTP/1.1" 200 None
2026-03-30 10:49:26 [auto1.de] INFO: Scrape type for JG32595: 2
2026-03-30 10:49:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d36662b-d76e-5d06-8bcb-ee9c8b51798f with identifier: JG32595
2026-03-30 10:49:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d36662b-d76e-5d06-8bcb-ee9c8b51798f with scrape type 2
2026-03-30 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d36662b-d76e-5d06-8bcb-ee9c8b51798f with scrape type 2
2026-03-30 10:49:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d36662b-d76e-5d06-8bcb-ee9c8b51798f, identifier: JG32595
2026-03-30 10:49:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d36662b-d76e-5d06-8bcb-ee9c8b51798f with identifier: JG32595
2026-03-30 10:49:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d36662b-d76e-5d06-8bcb-ee9c8b51798f with identifier: JG32595
2026-03-30 10:49:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d36662b-d76e-5d06-8bcb-ee9c8b51798f with identifier: JG32595 to the API
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:59:18Z',
 'fuel_type': 'petrol',
 'id': '5d36662b-d76e-5d06-8bcb-ee9c8b51798f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG32595',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 151778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-17',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG32595%27 HTTP/1.1" 200 None
2026-03-30 10:49:26 [auto1.de] INFO: Saving data for JG32595: {'auction_closing_time': 1774972758.0, 'created_time': 1774467223.16136, 'last_price_update_time': 1774867766.827192}
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG32595') HTTP/1.1" 204 0
2026-03-30 10:49:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:26 [auto1.de] INFO: Found listing with ID: LY83688
2026-03-30 10:49:26 [auto1.de] INFO: Found listing with ID: FJ03790
2026-03-30 10:49:26 [auto1.de] INFO: Found listing with ID: YT23335
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT23335%27 HTTP/1.1" 200 None
2026-03-30 10:49:26 [auto1.de] INFO: Scrape type for YT23335: 2
2026-03-30 10:49:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9788890d-7231-52ec-8e0d-48427cbbd887 with identifier: YT23335
2026-03-30 10:49:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9788890d-7231-52ec-8e0d-48427cbbd887 with scrape type 2
2026-03-30 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9788890d-7231-52ec-8e0d-48427cbbd887 with scrape type 2
2026-03-30 10:49:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9788890d-7231-52ec-8e0d-48427cbbd887, identifier: YT23335
2026-03-30 10:49:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9788890d-7231-52ec-8e0d-48427cbbd887 with identifier: YT23335
2026-03-30 10:49:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9788890d-7231-52ec-8e0d-48427cbbd887 with identifier: YT23335
2026-03-30 10:49:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9788890d-7231-52ec-8e0d-48427cbbd887 with identifier: YT23335 to the API
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:35:17Z',
 'fuel_type': 'petrol',
 'id': '9788890d-7231-52ec-8e0d-48427cbbd887',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT23335',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 190012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-21',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT23335%27 HTTP/1.1" 200 None
2026-03-30 10:49:27 [auto1.de] INFO: Saving data for YT23335: {'auction_closing_time': 1774971317.0, 'created_time': 1773306001.100292, 'last_price_update_time': 1774867767.311382}
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT23335') HTTP/1.1" 204 0
2026-03-30 10:49:27 [auto1.de] INFO: Found listing with ID: EN47002
2026-03-30 10:49:27 [auto1.de] INFO: Found listing with ID: VW07628
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW07628%27 HTTP/1.1" 200 None
2026-03-30 10:49:27 [auto1.de] INFO: Scrape type for VW07628: 2
2026-03-30 10:49:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4642ed74-8404-566b-9df1-6e758089e4bd with identifier: VW07628
2026-03-30 10:49:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4642ed74-8404-566b-9df1-6e758089e4bd with scrape type 2
2026-03-30 10:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4642ed74-8404-566b-9df1-6e758089e4bd with scrape type 2
2026-03-30 10:49:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4642ed74-8404-566b-9df1-6e758089e4bd, identifier: VW07628
2026-03-30 10:49:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4642ed74-8404-566b-9df1-6e758089e4bd with identifier: VW07628
2026-03-30 10:49:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4642ed74-8404-566b-9df1-6e758089e4bd with identifier: VW07628
2026-03-30 10:49:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4642ed74-8404-566b-9df1-6e758089e4bd with identifier: VW07628 to the API
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 374,
 'expiration_date': '2026-03-31T15:09:07Z',
 'fuel_type': 'petrol',
 'id': '4642ed74-8404-566b-9df1-6e758089e4bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW07628',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 40509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-24',
 'seller_name': None,
 'title': 'BMW 4er M440i Gran Coupe Mild-Hybrid xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2023}
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW07628%27 HTTP/1.1" 200 None
2026-03-30 10:49:27 [auto1.de] INFO: Saving data for VW07628: {'auction_closing_time': 1774969747.0, 'created_time': 1774291656.476849, 'last_price_update_time': 1774867767.891747}
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW07628') HTTP/1.1" 204 0
2026-03-30 10:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_2f83cdb301a0f8807f8af60b8b8ab5ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:27 [auto1.de] INFO: Found listing with ID: SN07258
2026-03-30 10:49:27 [auto1.de] INFO: Found listing with ID: PP91076
2026-03-30 10:49:27 [auto1.de] INFO: Found listing with ID: LM68672
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM68672%27 HTTP/1.1" 200 None
2026-03-30 10:49:27 [auto1.de] INFO: Scrape type for LM68672: 2
2026-03-30 10:49:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aad08bfd-6cd4-5977-86e2-20e3fb7242f8 with identifier: LM68672
2026-03-30 10:49:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aad08bfd-6cd4-5977-86e2-20e3fb7242f8 with scrape type 2
2026-03-30 10:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aad08bfd-6cd4-5977-86e2-20e3fb7242f8 with scrape type 2
2026-03-30 10:49:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aad08bfd-6cd4-5977-86e2-20e3fb7242f8, identifier: LM68672
2026-03-30 10:49:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aad08bfd-6cd4-5977-86e2-20e3fb7242f8 with identifier: LM68672
2026-03-30 10:49:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aad08bfd-6cd4-5977-86e2-20e3fb7242f8 with identifier: LM68672
2026-03-30 10:49:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aad08bfd-6cd4-5977-86e2-20e3fb7242f8 with identifier: LM68672 to the API
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:50:39Z',
 'fuel_type': 'diesel',
 'id': 'aad08bfd-6cd4-5977-86e2-20e3fb7242f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM68672',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 169816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-10',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2018}
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM68672%27 HTTP/1.1" 200 None
2026-03-30 10:49:28 [auto1.de] INFO: Saving data for LM68672: {'auction_closing_time': 1774972239.0, 'created_time': 1773135055.885974, 'last_price_update_time': 1774867768.391501}
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM68672') HTTP/1.1" 204 0
2026-03-30 10:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_62102333f559c0975a729de87bddd62f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:28 [auto1.de] INFO: Found listing with ID: TM22078
2026-03-30 10:49:28 [auto1.de] INFO: Found listing with ID: XR50139
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR50139%27 HTTP/1.1" 200 None
2026-03-30 10:49:28 [auto1.de] INFO: Scrape type for XR50139: 2
2026-03-30 10:49:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2428359d-ecdb-56bf-846f-9e8fe303a9c7 with identifier: XR50139
2026-03-30 10:49:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2428359d-ecdb-56bf-846f-9e8fe303a9c7 with scrape type 2
2026-03-30 10:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2428359d-ecdb-56bf-846f-9e8fe303a9c7 with scrape type 2
2026-03-30 10:49:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2428359d-ecdb-56bf-846f-9e8fe303a9c7, identifier: XR50139
2026-03-30 10:49:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2428359d-ecdb-56bf-846f-9e8fe303a9c7 with identifier: XR50139
2026-03-30 10:49:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2428359d-ecdb-56bf-846f-9e8fe303a9c7 with identifier: XR50139
2026-03-30 10:49:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2428359d-ecdb-56bf-846f-9e8fe303a9c7 with identifier: XR50139 to the API
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:48:28Z',
 'fuel_type': 'diesel',
 'id': '2428359d-ecdb-56bf-846f-9e8fe303a9c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR50139',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 292622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR50139%27 HTTP/1.1" 200 None
2026-03-30 10:49:28 [auto1.de] INFO: Saving data for XR50139: {'auction_closing_time': 1774972108.0, 'created_time': 1774434753.942209, 'last_price_update_time': 1774867768.853107}
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR50139') HTTP/1.1" 204 0
2026-03-30 10:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_5bd277fd7b2d44d2ac4a890659c77c64.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:28 [auto1.de] INFO: Found listing with ID: VZ82726
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ82726%27 HTTP/1.1" 200 None
2026-03-30 10:49:28 [auto1.de] INFO: Scrape type for VZ82726: 2
2026-03-30 10:49:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b98043e5-5d14-5632-820a-b08079ab85a1 with identifier: VZ82726
2026-03-30 10:49:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98043e5-5d14-5632-820a-b08079ab85a1 with scrape type 2
2026-03-30 10:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b98043e5-5d14-5632-820a-b08079ab85a1 with scrape type 2
2026-03-30 10:49:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b98043e5-5d14-5632-820a-b08079ab85a1, identifier: VZ82726
2026-03-30 10:49:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea20d0>
2026-03-30 10:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_2f83cdb301a0f8807f8af60b8b8ab5ca.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_2f83cdb301a0f8807f8af60b8b8ab5ca.jpg saved to cache
2026-03-30 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3d7c9da-a51c-5119-832e-1cbcbe4f7c93
2026-03-30 10:49:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b98043e5-5d14-5632-820a-b08079ab85a1 with identifier: VZ82726
2026-03-30 10:49:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b98043e5-5d14-5632-820a-b08079ab85a1 with identifier: VZ82726
2026-03-30 10:49:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b98043e5-5d14-5632-820a-b08079ab85a1 with identifier: VZ82726 to the API
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-31T15:00:26Z',
 'fuel_type': 'petrol',
 'id': 'b98043e5-5d14-5632-820a-b08079ab85a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ82726',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Modus',
 'odometer': 121671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-26',
 'seller_name': None,
 'title': 'Renault Modus 1.6 Exception',
 'transmission': 'manual',
 'trim': 'Exception',
 'year': 2007}
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ82726%27 HTTP/1.1" 200 None
2026-03-30 10:49:29 [auto1.de] INFO: Saving data for VZ82726: {'auction_closing_time': 1774969226.0, 'created_time': 1774467035.353746, 'last_price_update_time': 1774867769.433457}
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ82726') HTTP/1.1" 204 0
2026-03-30 10:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_8c136d8dd673098f4b68374fb5b8080a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:29 [auto1.de] INFO: Found listing with ID: TN91877
2026-03-30 10:49:29 [auto1.de] INFO: Found listing with ID: LU41152
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU41152%27 HTTP/1.1" 200 None
2026-03-30 10:49:29 [auto1.de] INFO: Scrape type for LU41152: 2
2026-03-30 10:49:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d60439c7-9498-52a8-a83f-02f024bd4328 with identifier: LU41152
2026-03-30 10:49:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d60439c7-9498-52a8-a83f-02f024bd4328 with scrape type 2
2026-03-30 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d60439c7-9498-52a8-a83f-02f024bd4328 with scrape type 2
2026-03-30 10:49:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d60439c7-9498-52a8-a83f-02f024bd4328, identifier: LU41152
2026-03-30 10:49:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429d6d0>
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_62102333f559c0975a729de87bddd62f.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_62102333f559c0975a729de87bddd62f.jpg saved to cache
2026-03-30 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3d7c9da-a51c-5119-832e-1cbcbe4f7c93
2026-03-30 10:49:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d60439c7-9498-52a8-a83f-02f024bd4328 with identifier: LU41152
2026-03-30 10:49:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d60439c7-9498-52a8-a83f-02f024bd4328 with identifier: LU41152
2026-03-30 10:49:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d60439c7-9498-52a8-a83f-02f024bd4328 with identifier: LU41152 to the API
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:54:41Z',
 'fuel_type': 'diesel',
 'id': 'd60439c7-9498-52a8-a83f-02f024bd4328',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU41152',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 94836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-06',
 'seller_name': None,
 'title': 'Citroen C5 2.0 Blue-HDi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2015}
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU41152%27 HTTP/1.1" 200 None
2026-03-30 10:49:30 [auto1.de] INFO: Saving data for LU41152: {'auction_closing_time': 1774972481.0, 'created_time': 1773466645.385043, 'last_price_update_time': 1774867770.099405}
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU41152') HTTP/1.1" 204 0
2026-03-30 10:49:30 [auto1.de] INFO: Found listing with ID: XE44885
2026-03-30 10:49:30 [auto1.de] INFO: Found listing with ID: XN01413
2026-03-30 10:49:30 [auto1.de] INFO: Found listing with ID: FD63285
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD63285%27 HTTP/1.1" 200 None
2026-03-30 10:49:30 [auto1.de] INFO: Scrape type for FD63285: 2
2026-03-30 10:49:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9139f0a-68b5-5d17-8124-bb4269b63b9c with identifier: FD63285
2026-03-30 10:49:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9139f0a-68b5-5d17-8124-bb4269b63b9c with scrape type 2
2026-03-30 10:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9139f0a-68b5-5d17-8124-bb4269b63b9c with scrape type 2
2026-03-30 10:49:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9139f0a-68b5-5d17-8124-bb4269b63b9c, identifier: FD63285
2026-03-30 10:49:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4278790>
2026-03-30 10:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_5bd277fd7b2d44d2ac4a890659c77c64.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_5bd277fd7b2d44d2ac4a890659c77c64.jpg saved to cache
2026-03-30 10:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3d7c9da-a51c-5119-832e-1cbcbe4f7c93
2026-03-30 10:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_4ccdfb87a91b70f91df171c9541f27c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9139f0a-68b5-5d17-8124-bb4269b63b9c with identifier: FD63285
2026-03-30 10:49:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9139f0a-68b5-5d17-8124-bb4269b63b9c with identifier: FD63285
2026-03-30 10:49:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9139f0a-68b5-5d17-8124-bb4269b63b9c with identifier: FD63285 to the API
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:31:32Z',
 'fuel_type': 'petrol',
 'id': 'd9139f0a-68b5-5d17-8124-bb4269b63b9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD63285',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 136198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-06-01',
 'seller_name': None,
 'title': 'Peugeot 206 1.6 CC Platinum',
 'transmission': 'automatic',
 'trim': 'CC Platinum',
 'year': 2003}
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD63285%27 HTTP/1.1" 200 None
2026-03-30 10:49:30 [auto1.de] INFO: Saving data for FD63285: {'auction_closing_time': 1774971092.0, 'created_time': 1774294741.640226, 'last_price_update_time': 1774867770.736751}
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD63285') HTTP/1.1" 204 0
2026-03-30 10:49:30 [auto1.de] INFO: Found listing with ID: ZD44688
2026-03-30 10:49:30 [auto1.de] INFO: Found listing with ID: UK45844
2026-03-30 10:49:30 [auto1.de] INFO: Found listing with ID: UT70754
2026-03-30 10:49:30 [auto1.de] INFO: Found listing with ID: VF29678
2026-03-30 10:49:30 [auto1.de] INFO: Found listing with ID: CK03122
2026-03-30 10:49:30 [auto1.de] INFO: Found listing with ID: RW07323
2026-03-30 10:49:30 [auto1.de] INFO: Found listing with ID: BV43542
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV43542%27 HTTP/1.1" 200 None
2026-03-30 10:49:30 [auto1.de] INFO: Scrape type for BV43542: 2
2026-03-30 10:49:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b25e4c6-91ad-5d0e-beff-a3b0aab91f09 with identifier: BV43542
2026-03-30 10:49:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b25e4c6-91ad-5d0e-beff-a3b0aab91f09 with scrape type 2
2026-03-30 10:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b25e4c6-91ad-5d0e-beff-a3b0aab91f09 with scrape type 2
2026-03-30 10:49:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b25e4c6-91ad-5d0e-beff-a3b0aab91f09, identifier: BV43542
2026-03-30 10:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_db7fe77a0f2f80646199115c559851eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_98a43414a5622d01880d9d5e298dfef7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b25e4c6-91ad-5d0e-beff-a3b0aab91f09 with identifier: BV43542
2026-03-30 10:49:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b25e4c6-91ad-5d0e-beff-a3b0aab91f09 with identifier: BV43542
2026-03-30 10:49:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b25e4c6-91ad-5d0e-beff-a3b0aab91f09 with identifier: BV43542 to the API
2026-03-30 10:49:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:25:08Z',
 'fuel_type': 'petrol',
 'id': '2b25e4c6-91ad-5d0e-beff-a3b0aab91f09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV43542',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 184534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-12',
 'seller_name': None,
 'title': 'Audi A6 2.4 V6',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-30 10:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV43542%27 HTTP/1.1" 200 None
2026-03-30 10:49:31 [auto1.de] INFO: Saving data for BV43542: {'auction_closing_time': 1774970708.0, 'created_time': 1774435449.483037, 'last_price_update_time': 1774867771.96232}
2026-03-30 10:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV43542') HTTP/1.1" 204 0
2026-03-30 10:49:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42891d0>
2026-03-30 10:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_8c136d8dd673098f4b68374fb5b8080a.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_8c136d8dd673098f4b68374fb5b8080a.jpg saved to cache
2026-03-30 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3d7c9da-a51c-5119-832e-1cbcbe4f7c93
2026-03-30 10:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_eaa19892accbb9cc8c73738bea5594a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:32 [auto1.de] INFO: Found listing with ID: DA98939
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA98939%27 HTTP/1.1" 200 None
2026-03-30 10:49:32 [auto1.de] INFO: Scrape type for DA98939: 1
2026-03-30 10:49:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefebe10>
2026-03-30 10:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_4ccdfb87a91b70f91df171c9541f27c4.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_4ccdfb87a91b70f91df171c9541f27c4.jpg saved to cache
2026-03-30 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3d7c9da-a51c-5119-832e-1cbcbe4f7c93
2026-03-30 10:49:32 [auto1.de] INFO: Found listing with ID: KS95343
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS95343%27 HTTP/1.1" 200 None
2026-03-30 10:49:32 [auto1.de] INFO: Scrape type for KS95343: 2
2026-03-30 10:49:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a1e96f2-77d1-5cce-9649-f3fb214fea99 with identifier: KS95343
2026-03-30 10:49:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a1e96f2-77d1-5cce-9649-f3fb214fea99 with scrape type 2
2026-03-30 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a1e96f2-77d1-5cce-9649-f3fb214fea99 with scrape type 2
2026-03-30 10:49:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a1e96f2-77d1-5cce-9649-f3fb214fea99, identifier: KS95343
2026-03-30 10:49:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a1e96f2-77d1-5cce-9649-f3fb214fea99 with identifier: KS95343
2026-03-30 10:49:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a1e96f2-77d1-5cce-9649-f3fb214fea99 with identifier: KS95343
2026-03-30 10:49:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a1e96f2-77d1-5cce-9649-f3fb214fea99 with identifier: KS95343 to the API
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:02:08Z',
 'fuel_type': 'petrol',
 'id': '5a1e96f2-77d1-5cce-9649-f3fb214fea99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS95343',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 134036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-28',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2007}
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS95343%27 HTTP/1.1" 200 None
2026-03-30 10:49:32 [auto1.de] INFO: Saving data for KS95343: {'auction_closing_time': 1774969328.0, 'created_time': 1773304804.444057, 'last_price_update_time': 1774867772.69993}
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS95343') HTTP/1.1" 204 0
2026-03-30 10:49:32 [auto1.de] INFO: Found listing with ID: KG16630
2026-03-30 10:49:32 [auto1.de] INFO: Found listing with ID: KT16474
2026-03-30 10:49:32 [auto1.de] INFO: Found listing with ID: JV44337
2026-03-30 10:49:32 [auto1.de] INFO: Found listing with ID: XY75153
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY75153%27 HTTP/1.1" 200 None
2026-03-30 10:49:32 [auto1.de] INFO: Scrape type for XY75153: 2
2026-03-30 10:49:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f20b738-cac6-54a2-9695-8c634ff3b08a with identifier: XY75153
2026-03-30 10:49:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f20b738-cac6-54a2-9695-8c634ff3b08a with scrape type 2
2026-03-30 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f20b738-cac6-54a2-9695-8c634ff3b08a with scrape type 2
2026-03-30 10:49:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f20b738-cac6-54a2-9695-8c634ff3b08a, identifier: XY75153
2026-03-30 10:49:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee458950>
2026-03-30 10:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_db7fe77a0f2f80646199115c559851eb.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_db7fe77a0f2f80646199115c559851eb.jpg saved to cache
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3d7c9da-a51c-5119-832e-1cbcbe4f7c93
2026-03-30 10:49:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef453d0>
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_98a43414a5622d01880d9d5e298dfef7.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_98a43414a5622d01880d9d5e298dfef7.jpg saved to cache
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3d7c9da-a51c-5119-832e-1cbcbe4f7c93
2026-03-30 10:49:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefc9e10>
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_eaa19892accbb9cc8c73738bea5594a6.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_eaa19892accbb9cc8c73738bea5594a6.jpg saved to cache
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3d7c9da-a51c-5119-832e-1cbcbe4f7c93
2026-03-30 10:49:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f20b738-cac6-54a2-9695-8c634ff3b08a with identifier: XY75153
2026-03-30 10:49:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f20b738-cac6-54a2-9695-8c634ff3b08a with identifier: XY75153
2026-03-30 10:49:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f20b738-cac6-54a2-9695-8c634ff3b08a with identifier: XY75153 to the API
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 148,
 'expiration_date': '2026-03-31T15:34:54Z',
 'fuel_type': 'diesel',
 'id': '4f20b738-cac6-54a2-9695-8c634ff3b08a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY75153',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 112414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-28',
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 JTD 150',
 'transmission': 'automatic',
 'trim': '150',
 'year': 2016}
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY75153%27 HTTP/1.1" 200 None
2026-03-30 10:49:33 [auto1.de] INFO: Saving data for XY75153: {'auction_closing_time': 1774971294.0, 'created_time': 1773657751.938706, 'last_price_update_time': 1774867773.604747}
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY75153') HTTP/1.1" 204 0
2026-03-30 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NA40709> (referer: https://www.auto1.com/v1/car-details-view/NA40709/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PD71569> (referer: https://www.auto1.com/v1/car-details-view/PD71569/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_6ef43f1f94269c15399cc70fe75b8547.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_dc9b6b5f74bf11d2e3f81c4bb923a226.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ff396d1-ed13-5ffa-ad1c-2adb96d2407b with identifier: NA40709
2026-03-30 10:49:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ff396d1-ed13-5ffa-ad1c-2adb96d2407b with scrape type 1
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2ff396d1-ed13-5ffa-ad1c-2adb96d2407b
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fc9%252F10c971e439892b36146b33b88c52b8a8%252Fpa%252FNA40709_6bbc26eb87e4cefe13328ce3eb068521.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/c9/10c971e439892b36146b33b88c52b8a8/pa/NA40709_6bbc26eb87e4cefe13328ce3eb068521.jpg already downloaded
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fc9%252F10c971e439892b36146b33b88c52b8a8%252Fpa%252FNA40709_c589bea0e2856199767fd8bce8443d99.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/c9/10c971e439892b36146b33b88c52b8a8/pa/NA40709_c589bea0e2856199767fd8bce8443d99.jpg already downloaded
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fc9%252F10c971e439892b36146b33b88c52b8a8%252Fpa%252FNA40709_b0de8391b4d024a493e415da6a4117c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/c9/10c971e439892b36146b33b88c52b8a8/pa/NA40709_b0de8391b4d024a493e415da6a4117c7.jpg already downloaded
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fc9%252F10c971e439892b36146b33b88c52b8a8%252Fpa%252FNA40709_66d4bc0239f815949463f8183fa7ac5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/c9/10c971e439892b36146b33b88c52b8a8/pa/NA40709_66d4bc0239f815949463f8183fa7ac5e.jpg already downloaded
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fc9%252F10c971e439892b36146b33b88c52b8a8%252Fpa%252FNA40709_2f2521971325e6195374cc0c8c6e57f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/c9/10c971e439892b36146b33b88c52b8a8/pa/NA40709_2f2521971325e6195374cc0c8c6e57f8.jpg already downloaded
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fc9%252F10c971e439892b36146b33b88c52b8a8%252Fpa%252FNA40709_c715391da5f8b1fb62229373c2781569.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/c9/10c971e439892b36146b33b88c52b8a8/pa/NA40709_c715391da5f8b1fb62229373c2781569.jpg already downloaded
2026-03-30 10:49:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ff396d1-ed13-5ffa-ad1c-2adb96d2407b, identifier: NA40709
2026-03-30 10:49:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ff396d1-ed13-5ffa-ad1c-2adb96d2407b with identifier: NA40709
2026-03-30 10:49:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ff396d1-ed13-5ffa-ad1c-2adb96d2407b with identifier: NA40709
2026-03-30 10:49:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ff396d1-ed13-5ffa-ad1c-2adb96d2407b with identifier: NA40709 to the API
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NA40709>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 197,
 'expiration_date': '2026-03-31T15:23:53Z',
 'fuel_type': 'diesel',
 'id': '2ff396d1-ed13-5ffa-ad1c-2adb96d2407b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA40709',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'BMW',
 'model': '5er',
 'odometer': 296003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img10/c9/10c971e439892b36146b33b88c52b8a8/pa/NA40709_6bbc26eb87e4cefe13328ce3eb068521.jpg',
                'https://img-pa.auto1.com/img10/c9/10c971e439892b36146b33b88c52b8a8/pa/NA40709_c589bea0e2856199767fd8bce8443d99.jpg',
                'https://img-pa.auto1.com/img10/c9/10c971e439892b36146b33b88c52b8a8/pa/NA40709_b0de8391b4d024a493e415da6a4117c7.jpg',
                'https://img-pa.auto1.com/img10/c9/10c971e439892b36146b33b88c52b8a8/pa/NA40709_66d4bc0239f815949463f8183fa7ac5e.jpg',
                'https://img-pa.auto1.com/img10/c9/10c971e439892b36146b33b88c52b8a8/pa/NA40709_2f2521971325e6195374cc0c8c6e57f8.jpg',
                'https://img-pa.auto1.com/img10/c9/10c971e439892b36146b33b88c52b8a8/pa/NA40709_c715391da5f8b1fb62229373c2781569.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ff396d1-ed13-5ffa-ad1c-2adb96d2407b/2ff396d1-ed13-5ffa-ad1c-2adb96d2407b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/c9/10c971e439892b36146b33b88c52b8a8/pa/NA40709_6bbc26eb87e4cefe13328ce3eb068521.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ff396d1-ed13-5ffa-ad1c-2adb96d2407b/2ff396d1-ed13-5ffa-ad1c-2adb96d2407b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/c9/10c971e439892b36146b33b88c52b8a8/pa/NA40709_c589bea0e2856199767fd8bce8443d99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ff396d1-ed13-5ffa-ad1c-2adb96d2407b/2ff396d1-ed13-5ffa-ad1c-2adb96d2407b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/c9/10c971e439892b36146b33b88c52b8a8/pa/NA40709_b0de8391b4d024a493e415da6a4117c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ff396d1-ed13-5ffa-ad1c-2adb96d2407b/2ff396d1-ed13-5ffa-ad1c-2adb96d2407b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/c9/10c971e439892b36146b33b88c52b8a8/pa/NA40709_66d4bc0239f815949463f8183fa7ac5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ff396d1-ed13-5ffa-ad1c-2adb96d2407b/2ff396d1-ed13-5ffa-ad1c-2adb96d2407b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/c9/10c971e439892b36146b33b88c52b8a8/pa/NA40709_2f2521971325e6195374cc0c8c6e57f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ff396d1-ed13-5ffa-ad1c-2adb96d2407b/2ff396d1-ed13-5ffa-ad1c-2adb96d2407b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/c9/10c971e439892b36146b33b88c52b8a8/pa/NA40709_c715391da5f8b1fb62229373c2781569.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-08-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 5er 525d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2009}
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA40709%27 HTTP/1.1" 200 None
2026-03-30 10:49:34 [auto1.de] INFO: Saving data for NA40709: {'created_time': 1774867774.448409, 'last_price_update_time': 1774867774.448448, 'auction_closing_time': 1774970633.0}
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA40709') HTTP/1.1" 204 0
2026-03-30 10:49:34 [auto1.de] INFO: Channel: 24h | Page: 31 | totalHits: 9501 | hits on page: 40
2026-03-30 10:49:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0950d9f-bcf0-5513-ae6d-11d0de45f5e0 with identifier: PD71569
2026-03-30 10:49:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0950d9f-bcf0-5513-ae6d-11d0de45f5e0 with scrape type 1
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0950d9f-bcf0-5513-ae6d-11d0de45f5e0
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb5%252Feab5c232b014cbd39c04a811b433441d%252Fpa%252FPD71569_4ec8a098764b2af39e1b4dc4bc6090cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_4ec8a098764b2af39e1b4dc4bc6090cb.jpg already downloaded
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb5%252Feab5c232b014cbd39c04a811b433441d%252Fpa%252FPD71569_d1b1546f4d91cdaf0b054791602a6681.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_d1b1546f4d91cdaf0b054791602a6681.jpg already downloaded
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb5%252Feab5c232b014cbd39c04a811b433441d%252Fpa%252FPD71569_cf28a4fc0152bf342ce3ef2cfc101877.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_cf28a4fc0152bf342ce3ef2cfc101877.jpg already downloaded
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb5%252Feab5c232b014cbd39c04a811b433441d%252Fpa%252FPD71569_1b9dbe7bb8a2087e58afda7b883996eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_1b9dbe7bb8a2087e58afda7b883996eb.jpg already downloaded
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb5%252Feab5c232b014cbd39c04a811b433441d%252Fpa%252FPD71569_81a26dcc689323f018774a01205bd868.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_81a26dcc689323f018774a01205bd868.jpg already downloaded
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb5%252Feab5c232b014cbd39c04a811b433441d%252Fpa%252FPD71569_b5d105d310d7b3736a461c0175211826.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_b5d105d310d7b3736a461c0175211826.jpg already downloaded
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb5%252Feab5c232b014cbd39c04a811b433441d%252Fpa%252FPD71569_0dffcebcac06cc921aa5d9c2adf779a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_0dffcebcac06cc921aa5d9c2adf779a0.jpg already downloaded
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb5%252Feab5c232b014cbd39c04a811b433441d%252Fpa%252FPD71569_a100ca4d7a957fb67b319e263bf664c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_a100ca4d7a957fb67b319e263bf664c4.jpg already downloaded
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb5%252Feab5c232b014cbd39c04a811b433441d%252Fpa%252FPD71569_b55ec68fe84a1823de9e1f3c202ac105.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_b55ec68fe84a1823de9e1f3c202ac105.jpg already downloaded
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb5%252Feab5c232b014cbd39c04a811b433441d%252Fpa%252FPD71569_f93780feda43237d610b99a584499182.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_f93780feda43237d610b99a584499182.jpg already downloaded
2026-03-30 10:49:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0950d9f-bcf0-5513-ae6d-11d0de45f5e0, identifier: PD71569
2026-03-30 10:49:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefb5810>
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_6ef43f1f94269c15399cc70fe75b8547.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_6ef43f1f94269c15399cc70fe75b8547.jpg saved to cache
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3d7c9da-a51c-5119-832e-1cbcbe4f7c93
2026-03-30 10:49:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f425b810>
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F61%252Fae6140304daeaf50cb41d05bb99bb68a%252Fpa%252FWC05131_dc9b6b5f74bf11d2e3f81c4bb923a226.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_dc9b6b5f74bf11d2e3f81c4bb923a226.jpg saved to cache
2026-03-30 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3d7c9da-a51c-5119-832e-1cbcbe4f7c93
2026-03-30 10:49:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3d7c9da-a51c-5119-832e-1cbcbe4f7c93, skipping ID generation
2026-03-30 10:49:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3d7c9da-a51c-5119-832e-1cbcbe4f7c93 with scrape type 1
2026-03-30 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3d7c9da-a51c-5119-832e-1cbcbe4f7c93 sending to next pipeline
2026-03-30 10:49:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3d7c9da-a51c-5119-832e-1cbcbe4f7c93, identifier: WC05131
2026-03-30 10:49:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0950d9f-bcf0-5513-ae6d-11d0de45f5e0 with identifier: PD71569
2026-03-30 10:49:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0950d9f-bcf0-5513-ae6d-11d0de45f5e0 with identifier: PD71569
2026-03-30 10:49:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0950d9f-bcf0-5513-ae6d-11d0de45f5e0 with identifier: PD71569 to the API
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PD71569>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:13:37Z',
 'fuel_type': 'petrol',
 'id': 'c0950d9f-bcf0-5513-ae6d-11d0de45f5e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD71569',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 107835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_4ec8a098764b2af39e1b4dc4bc6090cb.jpg',
                'https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_d1b1546f4d91cdaf0b054791602a6681.jpg',
                'https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_cf28a4fc0152bf342ce3ef2cfc101877.jpg',
                'https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_1b9dbe7bb8a2087e58afda7b883996eb.jpg',
                'https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_81a26dcc689323f018774a01205bd868.jpg',
                'https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_b5d105d310d7b3736a461c0175211826.jpg',
                'https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_0dffcebcac06cc921aa5d9c2adf779a0.jpg',
                'https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_a100ca4d7a957fb67b319e263bf664c4.jpg',
                'https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_b55ec68fe84a1823de9e1f3c202ac105.jpg',
                'https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_f93780feda43237d610b99a584499182.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0950d9f-bcf0-5513-ae6d-11d0de45f5e0/c0950d9f-bcf0-5513-ae6d-11d0de45f5e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_4ec8a098764b2af39e1b4dc4bc6090cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0950d9f-bcf0-5513-ae6d-11d0de45f5e0/c0950d9f-bcf0-5513-ae6d-11d0de45f5e0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_d1b1546f4d91cdaf0b054791602a6681.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0950d9f-bcf0-5513-ae6d-11d0de45f5e0/c0950d9f-bcf0-5513-ae6d-11d0de45f5e0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_cf28a4fc0152bf342ce3ef2cfc101877.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0950d9f-bcf0-5513-ae6d-11d0de45f5e0/c0950d9f-bcf0-5513-ae6d-11d0de45f5e0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_1b9dbe7bb8a2087e58afda7b883996eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0950d9f-bcf0-5513-ae6d-11d0de45f5e0/c0950d9f-bcf0-5513-ae6d-11d0de45f5e0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_81a26dcc689323f018774a01205bd868.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0950d9f-bcf0-5513-ae6d-11d0de45f5e0/c0950d9f-bcf0-5513-ae6d-11d0de45f5e0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_b5d105d310d7b3736a461c0175211826.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0950d9f-bcf0-5513-ae6d-11d0de45f5e0/c0950d9f-bcf0-5513-ae6d-11d0de45f5e0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_0dffcebcac06cc921aa5d9c2adf779a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0950d9f-bcf0-5513-ae6d-11d0de45f5e0/c0950d9f-bcf0-5513-ae6d-11d0de45f5e0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_a100ca4d7a957fb67b319e263bf664c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0950d9f-bcf0-5513-ae6d-11d0de45f5e0/c0950d9f-bcf0-5513-ae6d-11d0de45f5e0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_b55ec68fe84a1823de9e1f3c202ac105.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0950d9f-bcf0-5513-ae6d-11d0de45f5e0/c0950d9f-bcf0-5513-ae6d-11d0de45f5e0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b5/eab5c232b014cbd39c04a811b433441d/pa/PD71569_f93780feda43237d610b99a584499182.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2019}
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD71569%27 HTTP/1.1" 200 None
2026-03-30 10:49:35 [auto1.de] INFO: Saving data for PD71569: {'created_time': 1774867775.46985, 'last_price_update_time': 1774867775.469859, 'auction_closing_time': 1774970017.0}
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD71569') HTTP/1.1" 204 0
2026-03-30 10:49:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3d7c9da-a51c-5119-832e-1cbcbe4f7c93 with identifier: WC05131
2026-03-30 10:49:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3d7c9da-a51c-5119-832e-1cbcbe4f7c93 with identifier: WC05131
2026-03-30 10:49:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3d7c9da-a51c-5119-832e-1cbcbe4f7c93 with identifier: WC05131 to the API
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_dc9b6b5f74bf11d2e3f81c4bb923a226.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 211,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:19:05Z',
 'fuel_type': 'petrol',
 'id': 'd3d7c9da-a51c-5119-832e-1cbcbe4f7c93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC05131',
 'listing': 'auction',
 'location': 'DE, Duisburg',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 34397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2385190,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_2f83cdb301a0f8807f8af60b8b8ab5ca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2290505,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_62102333f559c0975a729de87bddd62f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2494688,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_8c136d8dd673098f4b68374fb5b8080a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2196879,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_5bd277fd7b2d44d2ac4a890659c77c64.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2463163,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_4ccdfb87a91b70f91df171c9541f27c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2487846,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_eaa19892accbb9cc8c73738bea5594a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2279290,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_db7fe77a0f2f80646199115c559851eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2159787,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_98a43414a5622d01880d9d5e298dfef7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2453043,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_6ef43f1f94269c15399cc70fe75b8547.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d7c9da-a51c-5119-832e-1cbcbe4f7c93/d3d7c9da-a51c-5119-832e-1cbcbe4f7c93_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2342170,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/61/ae6140304daeaf50cb41d05bb99bb68a/pa/WC05131_dc9b6b5f74bf11d2e3f81c4bb923a226.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-05-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Kompressor Sport Edition Classic',
 'transmission': 'automatic',
 'trim': 'Sport Edition Classic',
 'year': 2005}
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC05131%27 HTTP/1.1" 200 None
2026-03-30 10:49:35 [auto1.de] INFO: Saving data for WC05131: {'created_time': 1774867775.889279, 'last_price_update_time': 1774867775.889291, 'auction_closing_time': 1774970345.0}
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC05131') HTTP/1.1" 204 0
2026-03-30 10:49:35 [auto1.de] INFO: Found listing with ID: KG16630
2026-03-30 10:49:35 [auto1.de] INFO: Found listing with ID: KT16474
2026-03-30 10:49:35 [auto1.de] INFO: Found listing with ID: JV44337
2026-03-30 10:49:35 [auto1.de] INFO: Found listing with ID: XY75153
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY75153%27 HTTP/1.1" 200 None
2026-03-30 10:49:35 [auto1.de] INFO: Scrape type for XY75153: 0
2026-03-30 10:49:35 [auto1.de] INFO: Found listing with ID: TV61303
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV61303%27 HTTP/1.1" 200 None
2026-03-30 10:49:35 [auto1.de] INFO: Scrape type for TV61303: 2
2026-03-30 10:49:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7634395d-7550-567a-a593-ec66ccd50838 with identifier: TV61303
2026-03-30 10:49:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7634395d-7550-567a-a593-ec66ccd50838 with scrape type 2
2026-03-30 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7634395d-7550-567a-a593-ec66ccd50838 with scrape type 2
2026-03-30 10:49:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7634395d-7550-567a-a593-ec66ccd50838, identifier: TV61303
2026-03-30 10:49:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7634395d-7550-567a-a593-ec66ccd50838 with identifier: TV61303
2026-03-30 10:49:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7634395d-7550-567a-a593-ec66ccd50838 with identifier: TV61303
2026-03-30 10:49:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7634395d-7550-567a-a593-ec66ccd50838 with identifier: TV61303 to the API
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:19:27Z',
 'fuel_type': 'diesel',
 'id': '7634395d-7550-567a-a593-ec66ccd50838',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV61303',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 236305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-09',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2006}
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV61303%27 HTTP/1.1" 200 None
2026-03-30 10:49:36 [auto1.de] INFO: Saving data for TV61303: {'auction_closing_time': 1774970367.0, 'created_time': 1774294016.77654, 'last_price_update_time': 1774867776.378822}
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV61303') HTTP/1.1" 204 0
2026-03-30 10:49:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:36 [auto1.de] INFO: Found listing with ID: VF93957
2026-03-30 10:49:36 [auto1.de] INFO: Found listing with ID: FK10195
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK10195%27 HTTP/1.1" 200 None
2026-03-30 10:49:36 [auto1.de] INFO: Scrape type for FK10195: 2
2026-03-30 10:49:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95706942-4f55-53e3-bffc-aa17f89b2d99 with identifier: FK10195
2026-03-30 10:49:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95706942-4f55-53e3-bffc-aa17f89b2d99 with scrape type 2
2026-03-30 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95706942-4f55-53e3-bffc-aa17f89b2d99 with scrape type 2
2026-03-30 10:49:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95706942-4f55-53e3-bffc-aa17f89b2d99, identifier: FK10195
2026-03-30 10:49:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95706942-4f55-53e3-bffc-aa17f89b2d99 with identifier: FK10195
2026-03-30 10:49:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95706942-4f55-53e3-bffc-aa17f89b2d99 with identifier: FK10195
2026-03-30 10:49:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95706942-4f55-53e3-bffc-aa17f89b2d99 with identifier: FK10195 to the API
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:34:52Z',
 'fuel_type': 'petrol',
 'id': '95706942-4f55-53e3-bffc-aa17f89b2d99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK10195',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 57168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-24',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK10195%27 HTTP/1.1" 200 None
2026-03-30 10:49:36 [auto1.de] INFO: Saving data for FK10195: {'auction_closing_time': 1774971292.0, 'created_time': 1773303768.263277, 'last_price_update_time': 1774867776.879572}
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK10195') HTTP/1.1" 204 0
2026-03-30 10:49:36 [auto1.de] INFO: Found listing with ID: ZL86875
2026-03-30 10:49:36 [auto1.de] INFO: Found listing with ID: GG51597
2026-03-30 10:49:36 [auto1.de] INFO: Found listing with ID: WD56041
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD56041%27 HTTP/1.1" 200 None
2026-03-30 10:49:36 [auto1.de] INFO: Scrape type for WD56041: 2
2026-03-30 10:49:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f2dae68-9346-577f-ad8a-6e5ef25c188d with identifier: WD56041
2026-03-30 10:49:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f2dae68-9346-577f-ad8a-6e5ef25c188d with scrape type 2
2026-03-30 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f2dae68-9346-577f-ad8a-6e5ef25c188d with scrape type 2
2026-03-30 10:49:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f2dae68-9346-577f-ad8a-6e5ef25c188d, identifier: WD56041
2026-03-30 10:49:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f2dae68-9346-577f-ad8a-6e5ef25c188d with identifier: WD56041
2026-03-30 10:49:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f2dae68-9346-577f-ad8a-6e5ef25c188d with identifier: WD56041
2026-03-30 10:49:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f2dae68-9346-577f-ad8a-6e5ef25c188d with identifier: WD56041 to the API
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:21:15Z',
 'fuel_type': 'diesel',
 'id': '8f2dae68-9346-577f-ad8a-6e5ef25c188d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD56041',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 100786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-10',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2020}
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD56041%27 HTTP/1.1" 200 None
2026-03-30 10:49:37 [auto1.de] INFO: Saving data for WD56041: {'auction_closing_time': 1774970475.0, 'created_time': 1774467286.274928, 'last_price_update_time': 1774867777.349603}
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD56041') HTTP/1.1" 204 0
2026-03-30 10:49:37 [auto1.de] INFO: Found listing with ID: HR80015
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR80015%27 HTTP/1.1" 200 None
2026-03-30 10:49:37 [auto1.de] INFO: Scrape type for HR80015: 2
2026-03-30 10:49:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 312acaf1-dd21-50b0-8342-ceac6d6d0c46 with identifier: HR80015
2026-03-30 10:49:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 312acaf1-dd21-50b0-8342-ceac6d6d0c46 with scrape type 2
2026-03-30 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 312acaf1-dd21-50b0-8342-ceac6d6d0c46 with scrape type 2
2026-03-30 10:49:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 312acaf1-dd21-50b0-8342-ceac6d6d0c46, identifier: HR80015
2026-03-30 10:49:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 312acaf1-dd21-50b0-8342-ceac6d6d0c46 with identifier: HR80015
2026-03-30 10:49:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 312acaf1-dd21-50b0-8342-ceac6d6d0c46 with identifier: HR80015
2026-03-30 10:49:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 312acaf1-dd21-50b0-8342-ceac6d6d0c46 with identifier: HR80015 to the API
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:50:31Z',
 'fuel_type': 'petrol',
 'id': '312acaf1-dd21-50b0-8342-ceac6d6d0c46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR80015',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 198461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-01-10',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.6 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2002}
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR80015%27 HTTP/1.1" 200 None
2026-03-30 10:49:37 [auto1.de] INFO: Saving data for HR80015: {'auction_closing_time': 1774972231.0, 'created_time': 1774550592.773627, 'last_price_update_time': 1774867777.828399}
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR80015') HTTP/1.1" 204 0
2026-03-30 10:49:37 [auto1.de] INFO: Found listing with ID: BB20772
2026-03-30 10:49:37 [auto1.de] INFO: Found listing with ID: EA72382
2026-03-30 10:49:37 [auto1.de] INFO: Found listing with ID: MS41783
2026-03-30 10:49:37 [auto1.de] INFO: Found listing with ID: BV26090
2026-03-30 10:49:37 [auto1.de] INFO: Found listing with ID: RU30790
2026-03-30 10:49:37 [auto1.de] INFO: Found listing with ID: LK30881
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK30881%27 HTTP/1.1" 200 None
2026-03-30 10:49:37 [auto1.de] INFO: Scrape type for LK30881: 2
2026-03-30 10:49:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3644a55e-d0b9-5158-94ea-431f9df675e3 with identifier: LK30881
2026-03-30 10:49:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3644a55e-d0b9-5158-94ea-431f9df675e3 with scrape type 2
2026-03-30 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3644a55e-d0b9-5158-94ea-431f9df675e3 with scrape type 2
2026-03-30 10:49:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3644a55e-d0b9-5158-94ea-431f9df675e3, identifier: LK30881
2026-03-30 10:49:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3644a55e-d0b9-5158-94ea-431f9df675e3 with identifier: LK30881
2026-03-30 10:49:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3644a55e-d0b9-5158-94ea-431f9df675e3 with identifier: LK30881
2026-03-30 10:49:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3644a55e-d0b9-5158-94ea-431f9df675e3 with identifier: LK30881 to the API
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:59:09Z',
 'fuel_type': 'petrol',
 'id': '3644a55e-d0b9-5158-94ea-431f9df675e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK30881',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 47503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-10-29',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4',
 'transmission': 'manual',
 'trim': '',
 'year': 2001}
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK30881%27 HTTP/1.1" 200 None
2026-03-30 10:49:38 [auto1.de] INFO: Saving data for LK30881: {'auction_closing_time': 1774972749.0, 'created_time': 1774293851.849516, 'last_price_update_time': 1774867778.376422}
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK30881') HTTP/1.1" 204 0
2026-03-30 10:49:38 [auto1.de] INFO: Found listing with ID: EX42379
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX42379%27 HTTP/1.1" 200 None
2026-03-30 10:49:38 [auto1.de] INFO: Scrape type for EX42379: 2
2026-03-30 10:49:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c55f54a9-c9ec-5ece-988c-961c9342ef00 with identifier: EX42379
2026-03-30 10:49:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c55f54a9-c9ec-5ece-988c-961c9342ef00 with scrape type 2
2026-03-30 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c55f54a9-c9ec-5ece-988c-961c9342ef00 with scrape type 2
2026-03-30 10:49:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c55f54a9-c9ec-5ece-988c-961c9342ef00, identifier: EX42379
2026-03-30 10:49:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c55f54a9-c9ec-5ece-988c-961c9342ef00 with identifier: EX42379
2026-03-30 10:49:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c55f54a9-c9ec-5ece-988c-961c9342ef00 with identifier: EX42379
2026-03-30 10:49:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c55f54a9-c9ec-5ece-988c-961c9342ef00 with identifier: EX42379 to the API
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:39:42Z',
 'fuel_type': 'petrol',
 'id': 'c55f54a9-c9ec-5ece-988c-961c9342ef00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX42379',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 111391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-23',
 'seller_name': None,
 'title': 'Kia Rio 1.4 FIFA World Cup Edition',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2014}
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX42379%27 HTTP/1.1" 200 None
2026-03-30 10:49:38 [auto1.de] INFO: Saving data for EX42379: {'auction_closing_time': 1774971582.0, 'created_time': 1773429127.281046, 'last_price_update_time': 1774867778.844484}
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX42379') HTTP/1.1" 204 0
2026-03-30 10:49:38 [auto1.de] INFO: Found listing with ID: PV07453
2026-03-30 10:49:38 [auto1.de] INFO: Found listing with ID: CJ76479
2026-03-30 10:49:38 [auto1.de] INFO: Found listing with ID: XF29574
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF29574%27 HTTP/1.1" 200 None
2026-03-30 10:49:38 [auto1.de] INFO: Scrape type for XF29574: 2
2026-03-30 10:49:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02604f8b-0ded-5e2f-856b-9d49740551c0 with identifier: XF29574
2026-03-30 10:49:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02604f8b-0ded-5e2f-856b-9d49740551c0 with scrape type 2
2026-03-30 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02604f8b-0ded-5e2f-856b-9d49740551c0 with scrape type 2
2026-03-30 10:49:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02604f8b-0ded-5e2f-856b-9d49740551c0, identifier: XF29574
2026-03-30 10:49:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02604f8b-0ded-5e2f-856b-9d49740551c0 with identifier: XF29574
2026-03-30 10:49:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02604f8b-0ded-5e2f-856b-9d49740551c0 with identifier: XF29574
2026-03-30 10:49:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02604f8b-0ded-5e2f-856b-9d49740551c0 with identifier: XF29574 to the API
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:57:02Z',
 'fuel_type': 'petrol',
 'id': '02604f8b-0ded-5e2f-856b-9d49740551c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF29574',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 187914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-24',
 'seller_name': None,
 'title': 'Honda Civic 1.0 VTEC Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2018}
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF29574%27 HTTP/1.1" 200 None
2026-03-30 10:49:39 [auto1.de] INFO: Saving data for XF29574: {'auction_closing_time': 1774972622.0, 'created_time': 1774377367.631129, 'last_price_update_time': 1774867779.338699}
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF29574') HTTP/1.1" 204 0
2026-03-30 10:49:39 [auto1.de] INFO: Found listing with ID: DR25105
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR25105%27 HTTP/1.1" 200 None
2026-03-30 10:49:39 [auto1.de] INFO: Scrape type for DR25105: 2
2026-03-30 10:49:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2737f504-7213-5eda-8904-4a9290b0ff04 with identifier: DR25105
2026-03-30 10:49:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2737f504-7213-5eda-8904-4a9290b0ff04 with scrape type 2
2026-03-30 10:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2737f504-7213-5eda-8904-4a9290b0ff04 with scrape type 2
2026-03-30 10:49:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2737f504-7213-5eda-8904-4a9290b0ff04, identifier: DR25105
2026-03-30 10:49:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2737f504-7213-5eda-8904-4a9290b0ff04 with identifier: DR25105
2026-03-30 10:49:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2737f504-7213-5eda-8904-4a9290b0ff04 with identifier: DR25105
2026-03-30 10:49:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2737f504-7213-5eda-8904-4a9290b0ff04 with identifier: DR25105 to the API
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:23:08Z',
 'fuel_type': 'petrol',
 'id': '2737f504-7213-5eda-8904-4a9290b0ff04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR25105',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 154824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR25105%27 HTTP/1.1" 200 None
2026-03-30 10:49:39 [auto1.de] INFO: Saving data for DR25105: {'auction_closing_time': 1774970588.0, 'created_time': 1773917252.090441, 'last_price_update_time': 1774867779.82069}
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR25105') HTTP/1.1" 204 0
2026-03-30 10:49:39 [auto1.de] INFO: Found listing with ID: BM74248
2026-03-30 10:49:39 [auto1.de] INFO: Found listing with ID: PR18701
2026-03-30 10:49:39 [auto1.de] INFO: Found listing with ID: PZ85127
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ85127%27 HTTP/1.1" 200 None
2026-03-30 10:49:39 [auto1.de] INFO: Scrape type for PZ85127: 2
2026-03-30 10:49:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72ccc7eb-804f-5b1e-b1d1-e7037ff4b49e with identifier: PZ85127
2026-03-30 10:49:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72ccc7eb-804f-5b1e-b1d1-e7037ff4b49e with scrape type 2
2026-03-30 10:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72ccc7eb-804f-5b1e-b1d1-e7037ff4b49e with scrape type 2
2026-03-30 10:49:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72ccc7eb-804f-5b1e-b1d1-e7037ff4b49e, identifier: PZ85127
2026-03-30 10:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA98939/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72ccc7eb-804f-5b1e-b1d1-e7037ff4b49e with identifier: PZ85127
2026-03-30 10:49:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72ccc7eb-804f-5b1e-b1d1-e7037ff4b49e with identifier: PZ85127
2026-03-30 10:49:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72ccc7eb-804f-5b1e-b1d1-e7037ff4b49e with identifier: PZ85127 to the API
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 285,
 'expiration_date': '2026-03-31T15:08:03Z',
 'fuel_type': 'diesel',
 'id': '72ccc7eb-804f-5b1e-b1d1-e7037ff4b49e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ85127',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 183093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-24',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 350 d Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2020}
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ85127%27 HTTP/1.1" 200 None
2026-03-30 10:49:40 [auto1.de] INFO: Saving data for PZ85127: {'auction_closing_time': 1774969683.0, 'created_time': 1773688456.295418, 'last_price_update_time': 1774867780.372088}
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ85127') HTTP/1.1" 204 0
2026-03-30 10:49:40 [auto1.de] INFO: Found listing with ID: YX62865
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX62865%27 HTTP/1.1" 200 None
2026-03-30 10:49:40 [auto1.de] INFO: Scrape type for YX62865: 2
2026-03-30 10:49:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 102d5c3a-039e-5388-aa16-1a329b1efd8b with identifier: YX62865
2026-03-30 10:49:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 102d5c3a-039e-5388-aa16-1a329b1efd8b with scrape type 2
2026-03-30 10:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 102d5c3a-039e-5388-aa16-1a329b1efd8b with scrape type 2
2026-03-30 10:49:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 102d5c3a-039e-5388-aa16-1a329b1efd8b, identifier: YX62865
2026-03-30 10:49:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 102d5c3a-039e-5388-aa16-1a329b1efd8b with identifier: YX62865
2026-03-30 10:49:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 102d5c3a-039e-5388-aa16-1a329b1efd8b with identifier: YX62865
2026-03-30 10:49:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 102d5c3a-039e-5388-aa16-1a329b1efd8b with identifier: YX62865 to the API
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-31T15:48:16Z',
 'fuel_type': 'diesel',
 'id': '102d5c3a-039e-5388-aa16-1a329b1efd8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX62865',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 111693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-23',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2018}
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX62865%27 HTTP/1.1" 200 None
2026-03-30 10:49:40 [auto1.de] INFO: Saving data for YX62865: {'auction_closing_time': 1774972096.0, 'created_time': 1774463723.51128, 'last_price_update_time': 1774867780.790773}
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YX62865') HTTP/1.1" 204 0
2026-03-30 10:49:40 [auto1.de] INFO: Found listing with ID: CZ38094
2026-03-30 10:49:40 [auto1.de] INFO: Found listing with ID: FJ62780
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ62780%27 HTTP/1.1" 200 None
2026-03-30 10:49:40 [auto1.de] INFO: Scrape type for FJ62780: 2
2026-03-30 10:49:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc54d74f-0a39-5658-b316-07c9ab997a1a with identifier: FJ62780
2026-03-30 10:49:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc54d74f-0a39-5658-b316-07c9ab997a1a with scrape type 2
2026-03-30 10:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc54d74f-0a39-5658-b316-07c9ab997a1a with scrape type 2
2026-03-30 10:49:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc54d74f-0a39-5658-b316-07c9ab997a1a, identifier: FJ62780
2026-03-30 10:49:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc54d74f-0a39-5658-b316-07c9ab997a1a with identifier: FJ62780
2026-03-30 10:49:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc54d74f-0a39-5658-b316-07c9ab997a1a with identifier: FJ62780
2026-03-30 10:49:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc54d74f-0a39-5658-b316-07c9ab997a1a with identifier: FJ62780 to the API
2026-03-30 10:49:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:20:32Z',
 'fuel_type': 'petrol',
 'id': 'cc54d74f-0a39-5658-b316-07c9ab997a1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ62780',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 164139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-04',
 'seller_name': None,
 'title': 'BMW 3er 325i',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ62780%27 HTTP/1.1" 200 None
2026-03-30 10:49:41 [auto1.de] INFO: Saving data for FJ62780: {'auction_closing_time': 1774970432.0, 'created_time': 1774466389.224061, 'last_price_update_time': 1774867781.48529}
2026-03-30 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ62780') HTTP/1.1" 204 0
2026-03-30 10:49:41 [auto1.de] INFO: Found listing with ID: DU13236
2026-03-30 10:49:41 [auto1.de] INFO: Found listing with ID: TE24428
2026-03-30 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE24428%27 HTTP/1.1" 200 None
2026-03-30 10:49:41 [auto1.de] INFO: Scrape type for TE24428: 1
2026-03-30 10:49:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:41 [auto1.de] INFO: Found listing with ID: ZW65017
2026-03-30 10:49:41 [auto1.de] INFO: Found listing with ID: PH75397
2026-03-30 10:49:41 [auto1.de] INFO: Found listing with ID: XG61094
2026-03-30 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG61094%27 HTTP/1.1" 200 None
2026-03-30 10:49:41 [auto1.de] INFO: Scrape type for XG61094: 2
2026-03-30 10:49:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e1aef9d-33e8-51c2-8d28-c29b3f65c29a with identifier: XG61094
2026-03-30 10:49:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e1aef9d-33e8-51c2-8d28-c29b3f65c29a with scrape type 2
2026-03-30 10:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e1aef9d-33e8-51c2-8d28-c29b3f65c29a with scrape type 2
2026-03-30 10:49:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e1aef9d-33e8-51c2-8d28-c29b3f65c29a, identifier: XG61094
2026-03-30 10:49:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e1aef9d-33e8-51c2-8d28-c29b3f65c29a with identifier: XG61094
2026-03-30 10:49:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e1aef9d-33e8-51c2-8d28-c29b3f65c29a with identifier: XG61094
2026-03-30 10:49:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e1aef9d-33e8-51c2-8d28-c29b3f65c29a with identifier: XG61094 to the API
2026-03-30 10:49:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:23:01Z',
 'fuel_type': 'petrol',
 'id': '8e1aef9d-33e8-51c2-8d28-c29b3f65c29a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG61094',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 110424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-24',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Sports-Line AWD',
 'transmission': 'automatic',
 'trim': 'Sports-Line AWD',
 'year': 2016}
2026-03-30 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG61094%27 HTTP/1.1" 200 None
2026-03-30 10:49:41 [auto1.de] INFO: Saving data for XG61094: {'auction_closing_time': 1774970581.0, 'created_time': 1773343064.951208, 'last_price_update_time': 1774867781.929065}
2026-03-30 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG61094') HTTP/1.1" 204 0
2026-03-30 10:49:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:42 [auto1.de] INFO: Found listing with ID: TJ05805
2026-03-30 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ05805%27 HTTP/1.1" 200 None
2026-03-30 10:49:42 [auto1.de] INFO: Scrape type for TJ05805: 2
2026-03-30 10:49:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f9f7b15-9dd8-530d-aa5c-325066a3d035 with identifier: TJ05805
2026-03-30 10:49:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f9f7b15-9dd8-530d-aa5c-325066a3d035 with scrape type 2
2026-03-30 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f9f7b15-9dd8-530d-aa5c-325066a3d035 with scrape type 2
2026-03-30 10:49:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f9f7b15-9dd8-530d-aa5c-325066a3d035, identifier: TJ05805
2026-03-30 10:49:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f9f7b15-9dd8-530d-aa5c-325066a3d035 with identifier: TJ05805
2026-03-30 10:49:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f9f7b15-9dd8-530d-aa5c-325066a3d035 with identifier: TJ05805
2026-03-30 10:49:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f9f7b15-9dd8-530d-aa5c-325066a3d035 with identifier: TJ05805 to the API
2026-03-30 10:49:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:02:49Z',
 'fuel_type': 'petrol',
 'id': '3f9f7b15-9dd8-530d-aa5c-325066a3d035',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ05805',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 119629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-26',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Kenko',
 'transmission': 'manual',
 'trim': 'Kenko',
 'year': 2013}
2026-03-30 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ05805%27 HTTP/1.1" 200 None
2026-03-30 10:49:42 [auto1.de] INFO: Saving data for TJ05805: {'auction_closing_time': 1774969369.0, 'created_time': 1773426672.117205, 'last_price_update_time': 1774867782.48856}
2026-03-30 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ05805') HTTP/1.1" 204 0
2026-03-30 10:49:42 [auto1.de] INFO: Found listing with ID: JN43536
2026-03-30 10:49:42 [auto1.de] INFO: Found listing with ID: GE17394
2026-03-30 10:49:42 [auto1.de] INFO: Found listing with ID: BV83779
2026-03-30 10:49:42 [auto1.de] INFO: Found listing with ID: YS11001
2026-03-30 10:49:42 [auto1.de] INFO: Found listing with ID: MN62628
2026-03-30 10:49:42 [auto1.de] INFO: Found listing with ID: CV94580
2026-03-30 10:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA98939> (referer: https://www.auto1.com/v1/car-details-view/DA98939/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdad675c-5591-5270-b8ab-daa7a3cc4168 with identifier: DA98939
2026-03-30 10:49:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdad675c-5591-5270-b8ab-daa7a3cc4168 with scrape type 1
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bdad675c-5591-5270-b8ab-daa7a3cc4168
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_0e551907e888ad5bf36e7f47e55f3f4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_0e551907e888ad5bf36e7f47e55f3f4a.jpg not downloaded yet
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_59eb8260fc0a8e807a2d143dc0ea0b66.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_59eb8260fc0a8e807a2d143dc0ea0b66.jpg not downloaded yet
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_681cd025a2df24c5803c113544658319.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_681cd025a2df24c5803c113544658319.jpg not downloaded yet
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_692ed6046426afdec071ac43b67fdf86.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_692ed6046426afdec071ac43b67fdf86.jpg not downloaded yet
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_b82d877ab50b516c47a2c99e1553c6cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_b82d877ab50b516c47a2c99e1553c6cf.jpg not downloaded yet
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_32715c81154754907e7b37753f92cbfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_32715c81154754907e7b37753f92cbfe.jpg not downloaded yet
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_d1249668321f09309569da2adebc48fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_d1249668321f09309569da2adebc48fb.jpg not downloaded yet
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_479fd5632d821763b81d2ab799b09e07.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_479fd5632d821763b81d2ab799b09e07.jpg not downloaded yet
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_92d5004e2599a18274f01a1b355e2e91.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_92d5004e2599a18274f01a1b355e2e91.jpg not downloaded yet
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_aa9a72f137913e280f380c364ccf7711.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_aa9a72f137913e280f380c364ccf7711.jpg not downloaded yet
2026-03-30 10:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_59eb8260fc0a8e807a2d143dc0ea0b66.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_0e551907e888ad5bf36e7f47e55f3f4a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_479fd5632d821763b81d2ab799b09e07.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_32715c81154754907e7b37753f92cbfe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_692ed6046426afdec071ac43b67fdf86.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef3cd90>
2026-03-30 10:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_59eb8260fc0a8e807a2d143dc0ea0b66.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_59eb8260fc0a8e807a2d143dc0ea0b66.jpg saved to cache
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bdad675c-5591-5270-b8ab-daa7a3cc4168
2026-03-30 10:49:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428cd50>
2026-03-30 10:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_0e551907e888ad5bf36e7f47e55f3f4a.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_0e551907e888ad5bf36e7f47e55f3f4a.jpg saved to cache
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bdad675c-5591-5270-b8ab-daa7a3cc4168
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4216390>
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_479fd5632d821763b81d2ab799b09e07.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_479fd5632d821763b81d2ab799b09e07.jpg saved to cache
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bdad675c-5591-5270-b8ab-daa7a3cc4168
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42329d0>
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_32715c81154754907e7b37753f92cbfe.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_32715c81154754907e7b37753f92cbfe.jpg saved to cache
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bdad675c-5591-5270-b8ab-daa7a3cc4168
2026-03-30 10:49:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7d410>
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_692ed6046426afdec071ac43b67fdf86.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_692ed6046426afdec071ac43b67fdf86.jpg saved to cache
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bdad675c-5591-5270-b8ab-daa7a3cc4168
2026-03-30 10:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_681cd025a2df24c5803c113544658319.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_92d5004e2599a18274f01a1b355e2e91.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_d1249668321f09309569da2adebc48fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_b82d877ab50b516c47a2c99e1553c6cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_aa9a72f137913e280f380c364ccf7711.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414d490>
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_681cd025a2df24c5803c113544658319.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_681cd025a2df24c5803c113544658319.jpg saved to cache
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bdad675c-5591-5270-b8ab-daa7a3cc4168
2026-03-30 10:49:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef5a190>
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_92d5004e2599a18274f01a1b355e2e91.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_92d5004e2599a18274f01a1b355e2e91.jpg saved to cache
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bdad675c-5591-5270-b8ab-daa7a3cc4168
2026-03-30 10:49:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefdc910>
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_d1249668321f09309569da2adebc48fb.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_d1249668321f09309569da2adebc48fb.jpg saved to cache
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bdad675c-5591-5270-b8ab-daa7a3cc4168
2026-03-30 10:49:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43ab990>
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_b82d877ab50b516c47a2c99e1553c6cf.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_b82d877ab50b516c47a2c99e1553c6cf.jpg saved to cache
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bdad675c-5591-5270-b8ab-daa7a3cc4168
2026-03-30 10:49:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f65debd0>
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F385277b1f4a81554386a0cdcd3e6d22f%252Fpa%252FDA98939_aa9a72f137913e280f380c364ccf7711.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_aa9a72f137913e280f380c364ccf7711.jpg saved to cache
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bdad675c-5591-5270-b8ab-daa7a3cc4168
2026-03-30 10:49:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bdad675c-5591-5270-b8ab-daa7a3cc4168, skipping ID generation
2026-03-30 10:49:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdad675c-5591-5270-b8ab-daa7a3cc4168 with scrape type 1
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bdad675c-5591-5270-b8ab-daa7a3cc4168 sending to next pipeline
2026-03-30 10:49:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdad675c-5591-5270-b8ab-daa7a3cc4168, identifier: DA98939
2026-03-30 10:49:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdad675c-5591-5270-b8ab-daa7a3cc4168 with identifier: DA98939
2026-03-30 10:49:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdad675c-5591-5270-b8ab-daa7a3cc4168 with identifier: DA98939
2026-03-30 10:49:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdad675c-5591-5270-b8ab-daa7a3cc4168 with identifier: DA98939 to the API
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_aa9a72f137913e280f380c364ccf7711.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:32:15Z',
 'fuel_type': 'petrol',
 'id': 'bdad675c-5591-5270-b8ab-daa7a3cc4168',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA98939',
 'listing': 'auction',
 'location': 'DE, Oldenburg',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 81206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2261875,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_0e551907e888ad5bf36e7f47e55f3f4a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_59eb8260fc0a8e807a2d143dc0ea0b66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2360913,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_681cd025a2df24c5803c113544658319.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2282058,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_692ed6046426afdec071ac43b67fdf86.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2300953,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_b82d877ab50b516c47a2c99e1553c6cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_32715c81154754907e7b37753f92cbfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2261202,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_d1249668321f09309569da2adebc48fb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_479fd5632d821763b81d2ab799b09e07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2276004,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_92d5004e2599a18274f01a1b355e2e91.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdad675c-5591-5270-b8ab-daa7a3cc4168/bdad675c-5591-5270-b8ab-daa7a3cc4168_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2313963,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/52/385277b1f4a81554386a0cdcd3e6d22f/pa/DA98939_aa9a72f137913e280f380c364ccf7711.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Adam 1.4 Slam',
 'transmission': 'manual',
 'trim': 'Slam',
 'year': 2014}
2026-03-30 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA98939%27 HTTP/1.1" 200 None
2026-03-30 10:49:46 [auto1.de] INFO: Saving data for DA98939: {'created_time': 1774867786.076478, 'last_price_update_time': 1774867786.07649, 'auction_closing_time': 1774971135.0}
2026-03-30 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA98939') HTTP/1.1" 204 0
2026-03-30 10:49:59 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.434(s), this was the 1st time calling it.
2026-03-30 10:49:59 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.485888973433392 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:50:04 [scrapy.extensions.logstats] INFO: Crawled 707 pages (at 15 pages/min), scraped 549 items (at 56 items/min)
2026-03-30 10:50:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:50:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TE24428/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KS92375> (referer: https://www.auto1.com/v1/car-details-view/KS92375/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 999a931d-383e-5c23-957a-44c188909021 with identifier: KS92375
2026-03-30 10:50:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 999a931d-383e-5c23-957a-44c188909021 with scrape type 1
2026-03-30 10:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 999a931d-383e-5c23-957a-44c188909021
2026-03-30 10:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fb6%252Fbab661a2dd180e3ff157fc068c3e8a58%252Fpa%252FKS92375_2940d7911d4ed626489c55f03b6a7297.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_2940d7911d4ed626489c55f03b6a7297.jpg already downloaded
2026-03-30 10:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fb6%252Fbab661a2dd180e3ff157fc068c3e8a58%252Fpa%252FKS92375_10372d6a6016079e98cc88733046a1c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_10372d6a6016079e98cc88733046a1c8.jpg already downloaded
2026-03-30 10:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fb6%252Fbab661a2dd180e3ff157fc068c3e8a58%252Fpa%252FKS92375_d111e28c65a356a4b181af2ae75618dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_d111e28c65a356a4b181af2ae75618dc.jpg already downloaded
2026-03-30 10:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fb6%252Fbab661a2dd180e3ff157fc068c3e8a58%252Fpa%252FKS92375_f3b1733715b4e555942e3120dc46637c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_f3b1733715b4e555942e3120dc46637c.jpg already downloaded
2026-03-30 10:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fb6%252Fbab661a2dd180e3ff157fc068c3e8a58%252Fpa%252FKS92375_7c57c1deffdb7f7e0cefb8f02be69072.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_7c57c1deffdb7f7e0cefb8f02be69072.jpg already downloaded
2026-03-30 10:50:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 999a931d-383e-5c23-957a-44c188909021, identifier: KS92375
2026-03-30 10:50:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 999a931d-383e-5c23-957a-44c188909021 with identifier: KS92375
2026-03-30 10:50:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 999a931d-383e-5c23-957a-44c188909021 with identifier: KS92375
2026-03-30 10:50:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 999a931d-383e-5c23-957a-44c188909021 with identifier: KS92375 to the API
2026-03-30 10:50:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KS92375>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:33:52Z',
 'fuel_type': 'diesel',
 'id': '999a931d-383e-5c23-957a-44c188909021',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS92375',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 241257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_2940d7911d4ed626489c55f03b6a7297.jpg',
                'https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_10372d6a6016079e98cc88733046a1c8.jpg',
                'https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_d111e28c65a356a4b181af2ae75618dc.jpg',
                'https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_f3b1733715b4e555942e3120dc46637c.jpg',
                'https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_7c57c1deffdb7f7e0cefb8f02be69072.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_999a931d-383e-5c23-957a-44c188909021/999a931d-383e-5c23-957a-44c188909021_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_2940d7911d4ed626489c55f03b6a7297.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_999a931d-383e-5c23-957a-44c188909021/999a931d-383e-5c23-957a-44c188909021_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_10372d6a6016079e98cc88733046a1c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_999a931d-383e-5c23-957a-44c188909021/999a931d-383e-5c23-957a-44c188909021_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_d111e28c65a356a4b181af2ae75618dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_999a931d-383e-5c23-957a-44c188909021/999a931d-383e-5c23-957a-44c188909021_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_f3b1733715b4e555942e3120dc46637c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_999a931d-383e-5c23-957a-44c188909021/999a931d-383e-5c23-957a-44c188909021_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 152258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_7c57c1deffdb7f7e0cefb8f02be69072.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI GreenLine',
 'transmission': 'manual',
 'trim': 'GreenLine',
 'year': 2013}
2026-03-30 10:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS92375%27 HTTP/1.1" 200 None
2026-03-30 10:50:19 [auto1.de] INFO: Saving data for KS92375: {'created_time': 1774867819.003147, 'last_price_update_time': 1774867819.003159, 'auction_closing_time': 1774971232.0}
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS92375') HTTP/1.1" 204 0
2026-03-30 10:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TE24428> (referer: https://www.auto1.com/v1/car-details-view/TE24428/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2e78463-b674-5897-9209-1f3ba0a8bc66 with identifier: TE24428
2026-03-30 10:50:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2e78463-b674-5897-9209-1f3ba0a8bc66 with scrape type 1
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2e78463-b674-5897-9209-1f3ba0a8bc66
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_690c4890e65c4d285fa82ce5012b7c9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_690c4890e65c4d285fa82ce5012b7c9f.jpg not downloaded yet
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_03d342ac254353e7524e5c521335295e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_03d342ac254353e7524e5c521335295e.jpg not downloaded yet
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_624a638de6f3c514a701e41cef0136d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_624a638de6f3c514a701e41cef0136d8.jpg not downloaded yet
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_f1874564f7a9c1419c18d11daf435a4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_f1874564f7a9c1419c18d11daf435a4f.jpg not downloaded yet
2026-03-30 10:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_03d342ac254353e7524e5c521335295e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_690c4890e65c4d285fa82ce5012b7c9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_0ba96ba6551ac58025cfa1fc11216268.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_0ba96ba6551ac58025cfa1fc11216268.jpg not downloaded yet
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_ec54d4a860075f9010c217fde17b5cfb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_ec54d4a860075f9010c217fde17b5cfb.jpg not downloaded yet
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_10b6e5c3dc80bbecfdb33db3a172c0f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_10b6e5c3dc80bbecfdb33db3a172c0f7.jpg not downloaded yet
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_5c54cb6ed716159f021e467dabc8868f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_5c54cb6ed716159f021e467dabc8868f.jpg not downloaded yet
2026-03-30 10:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_f1874564f7a9c1419c18d11daf435a4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_624a638de6f3c514a701e41cef0136d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_9b7527a43b324aa33218abec4607a99b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_9b7527a43b324aa33218abec4607a99b.jpg not downloaded yet
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_d8167a1a0bbabe144c44cee426c4d656.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_d8167a1a0bbabe144c44cee426c4d656.jpg not downloaded yet
2026-03-30 10:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_ec54d4a860075f9010c217fde17b5cfb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42aa710>
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_03d342ac254353e7524e5c521335295e.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_03d342ac254353e7524e5c521335295e.jpg saved to cache
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2e78463-b674-5897-9209-1f3ba0a8bc66
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee416650>
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_690c4890e65c4d285fa82ce5012b7c9f.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_690c4890e65c4d285fa82ce5012b7c9f.jpg saved to cache
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2e78463-b674-5897-9209-1f3ba0a8bc66
2026-03-30 10:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_0ba96ba6551ac58025cfa1fc11216268.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_10b6e5c3dc80bbecfdb33db3a172c0f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_5c54cb6ed716159f021e467dabc8868f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41bf3d0>
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_f1874564f7a9c1419c18d11daf435a4f.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_f1874564f7a9c1419c18d11daf435a4f.jpg saved to cache
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2e78463-b674-5897-9209-1f3ba0a8bc66
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee47ab50>
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_624a638de6f3c514a701e41cef0136d8.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_624a638de6f3c514a701e41cef0136d8.jpg saved to cache
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2e78463-b674-5897-9209-1f3ba0a8bc66
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee41010>
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_ec54d4a860075f9010c217fde17b5cfb.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_ec54d4a860075f9010c217fde17b5cfb.jpg saved to cache
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2e78463-b674-5897-9209-1f3ba0a8bc66
2026-03-30 10:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_9b7527a43b324aa33218abec4607a99b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_d8167a1a0bbabe144c44cee426c4d656.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee47ae90>
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_0ba96ba6551ac58025cfa1fc11216268.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_0ba96ba6551ac58025cfa1fc11216268.jpg saved to cache
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2e78463-b674-5897-9209-1f3ba0a8bc66
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f425bd90>
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_10b6e5c3dc80bbecfdb33db3a172c0f7.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_10b6e5c3dc80bbecfdb33db3a172c0f7.jpg saved to cache
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2e78463-b674-5897-9209-1f3ba0a8bc66
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef52550>
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_5c54cb6ed716159f021e467dabc8868f.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_5c54cb6ed716159f021e467dabc8868f.jpg saved to cache
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2e78463-b674-5897-9209-1f3ba0a8bc66
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefed9d0>
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_9b7527a43b324aa33218abec4607a99b.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_9b7527a43b324aa33218abec4607a99b.jpg saved to cache
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2e78463-b674-5897-9209-1f3ba0a8bc66
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f422ab10>
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe9%252F74e9b53af5d0e70801a96b182be1e2ac%252Fpa%252FTE24428_d8167a1a0bbabe144c44cee426c4d656.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_d8167a1a0bbabe144c44cee426c4d656.jpg saved to cache
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2e78463-b674-5897-9209-1f3ba0a8bc66
2026-03-30 10:50:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2e78463-b674-5897-9209-1f3ba0a8bc66, skipping ID generation
2026-03-30 10:50:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2e78463-b674-5897-9209-1f3ba0a8bc66 with scrape type 1
2026-03-30 10:50:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2e78463-b674-5897-9209-1f3ba0a8bc66 sending to next pipeline
2026-03-30 10:50:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2e78463-b674-5897-9209-1f3ba0a8bc66, identifier: TE24428
2026-03-30 10:50:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2e78463-b674-5897-9209-1f3ba0a8bc66 with identifier: TE24428
2026-03-30 10:50:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2e78463-b674-5897-9209-1f3ba0a8bc66 with identifier: TE24428
2026-03-30 10:50:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2e78463-b674-5897-9209-1f3ba0a8bc66 with identifier: TE24428 to the API
2026-03-30 10:50:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_d8167a1a0bbabe144c44cee426c4d656.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:34:07Z',
 'fuel_type': 'petrol',
 'id': 'a2e78463-b674-5897-9209-1f3ba0a8bc66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE24428',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 51290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 65,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_690c4890e65c4d285fa82ce5012b7c9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_03d342ac254353e7524e5c521335295e.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_624a638de6f3c514a701e41cef0136d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_f1874564f7a9c1419c18d11daf435a4f.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_0ba96ba6551ac58025cfa1fc11216268.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_ec54d4a860075f9010c217fde17b5cfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_10b6e5c3dc80bbecfdb33db3a172c0f7.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_5c54cb6ed716159f021e467dabc8868f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_9b7527a43b324aa33218abec4607a99b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e78463-b674-5897-9209-1f3ba0a8bc66/a2e78463-b674-5897-9209-1f3ba0a8bc66_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e9/74e9b53af5d0e70801a96b182be1e2ac/pa/TE24428_d8167a1a0bbabe144c44cee426c4d656.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-03-30 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE24428%27 HTTP/1.1" 200 None
2026-03-30 10:50:20 [auto1.de] INFO: Saving data for TE24428: {'created_time': 1774867820.493286, 'last_price_update_time': 1774867820.493299, 'auction_closing_time': 1774971247.0}
2026-03-30 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE24428') HTTP/1.1" 204 0
2026-03-30 10:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PN04057> (referer: https://www.auto1.com/v1/car-details-view/PN04057/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55f4f740-331c-5d7d-b099-55dc4120539c with identifier: PN04057
2026-03-30 10:50:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55f4f740-331c-5d7d-b099-55dc4120539c with scrape type 1
2026-03-30 10:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55f4f740-331c-5d7d-b099-55dc4120539c
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_20ca77c7d8ac39bdaa2239d502dc0db2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_20ca77c7d8ac39bdaa2239d502dc0db2.jpg not downloaded yet
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_6a436d8bca1a0ddd9e0f0d6450773125.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_6a436d8bca1a0ddd9e0f0d6450773125.jpg not downloaded yet
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_2f122180184a5c548262c3a7f9c61c13.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_2f122180184a5c548262c3a7f9c61c13.jpg not downloaded yet
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_3ffc6c60d63a61cc95c5b66704c5c79b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_3ffc6c60d63a61cc95c5b66704c5c79b.jpg not downloaded yet
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_e16a833c811b98ed067c42f894c2b63a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_e16a833c811b98ed067c42f894c2b63a.jpg not downloaded yet
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_87630555fbecb2f9c711c0229b195091.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_87630555fbecb2f9c711c0229b195091.jpg not downloaded yet
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_ed785b12a33e064f1d1493a4a2302f78.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_ed785b12a33e064f1d1493a4a2302f78.jpg not downloaded yet
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_e63fc19f7a4d44012c4c9fceb3015c48.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_e63fc19f7a4d44012c4c9fceb3015c48.jpg not downloaded yet
2026-03-30 10:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_20ca77c7d8ac39bdaa2239d502dc0db2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_6a436d8bca1a0ddd9e0f0d6450773125.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_30803936707b9a737dd88585a5fb591f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_30803936707b9a737dd88585a5fb591f.jpg not downloaded yet
2026-03-30 10:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_3ffc6c60d63a61cc95c5b66704c5c79b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_2f122180184a5c548262c3a7f9c61c13.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_da5b7d47b6232b34c7145e2a9ce690ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_da5b7d47b6232b34c7145e2a9ce690ee.jpg not downloaded yet
2026-03-30 10:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_e16a833c811b98ed067c42f894c2b63a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_87630555fbecb2f9c711c0229b195091.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_30803936707b9a737dd88585a5fb591f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_ed785b12a33e064f1d1493a4a2302f78.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_e63fc19f7a4d44012c4c9fceb3015c48.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef58410>
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_20ca77c7d8ac39bdaa2239d502dc0db2.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_20ca77c7d8ac39bdaa2239d502dc0db2.jpg saved to cache
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55f4f740-331c-5d7d-b099-55dc4120539c
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee13350>
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_6a436d8bca1a0ddd9e0f0d6450773125.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_6a436d8bca1a0ddd9e0f0d6450773125.jpg saved to cache
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55f4f740-331c-5d7d-b099-55dc4120539c
2026-03-30 10:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_da5b7d47b6232b34c7145e2a9ce690ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef04d0>
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_3ffc6c60d63a61cc95c5b66704c5c79b.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_3ffc6c60d63a61cc95c5b66704c5c79b.jpg saved to cache
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55f4f740-331c-5d7d-b099-55dc4120539c
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9f990>
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_2f122180184a5c548262c3a7f9c61c13.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_2f122180184a5c548262c3a7f9c61c13.jpg saved to cache
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55f4f740-331c-5d7d-b099-55dc4120539c
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4148cd0>
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_e16a833c811b98ed067c42f894c2b63a.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_e16a833c811b98ed067c42f894c2b63a.jpg saved to cache
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55f4f740-331c-5d7d-b099-55dc4120539c
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43780d0>
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_87630555fbecb2f9c711c0229b195091.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_87630555fbecb2f9c711c0229b195091.jpg saved to cache
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55f4f740-331c-5d7d-b099-55dc4120539c
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4139590>
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_30803936707b9a737dd88585a5fb591f.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_30803936707b9a737dd88585a5fb591f.jpg saved to cache
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55f4f740-331c-5d7d-b099-55dc4120539c
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9f650>
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_ed785b12a33e064f1d1493a4a2302f78.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_ed785b12a33e064f1d1493a4a2302f78.jpg saved to cache
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55f4f740-331c-5d7d-b099-55dc4120539c
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee72990>
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_e63fc19f7a4d44012c4c9fceb3015c48.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_e63fc19f7a4d44012c4c9fceb3015c48.jpg saved to cache
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55f4f740-331c-5d7d-b099-55dc4120539c
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5959790>
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fba%252F37bae5f0fb43b18bbd19e3fb80ce7b07%252Fpa%252FPN04057_da5b7d47b6232b34c7145e2a9ce690ee.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_da5b7d47b6232b34c7145e2a9ce690ee.jpg saved to cache
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55f4f740-331c-5d7d-b099-55dc4120539c
2026-03-30 10:50:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55f4f740-331c-5d7d-b099-55dc4120539c, skipping ID generation
2026-03-30 10:50:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55f4f740-331c-5d7d-b099-55dc4120539c with scrape type 1
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55f4f740-331c-5d7d-b099-55dc4120539c sending to next pipeline
2026-03-30 10:50:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55f4f740-331c-5d7d-b099-55dc4120539c, identifier: PN04057
2026-03-30 10:50:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55f4f740-331c-5d7d-b099-55dc4120539c with identifier: PN04057
2026-03-30 10:50:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55f4f740-331c-5d7d-b099-55dc4120539c with identifier: PN04057
2026-03-30 10:50:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55f4f740-331c-5d7d-b099-55dc4120539c with identifier: PN04057 to the API
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_da5b7d47b6232b34c7145e2a9ce690ee.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:26:15Z',
 'fuel_type': 'petrol',
 'id': '55f4f740-331c-5d7d-b099-55dc4120539c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN04057',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 75081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_20ca77c7d8ac39bdaa2239d502dc0db2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_6a436d8bca1a0ddd9e0f0d6450773125.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_2f122180184a5c548262c3a7f9c61c13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_3ffc6c60d63a61cc95c5b66704c5c79b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_e16a833c811b98ed067c42f894c2b63a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_87630555fbecb2f9c711c0229b195091.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_ed785b12a33e064f1d1493a4a2302f78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_e63fc19f7a4d44012c4c9fceb3015c48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_30803936707b9a737dd88585a5fb591f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f4f740-331c-5d7d-b099-55dc4120539c/55f4f740-331c-5d7d-b099-55dc4120539c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/ba/37bae5f0fb43b18bbd19e3fb80ce7b07/pa/PN04057_da5b7d47b6232b34c7145e2a9ce690ee.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.2 TSI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2017}
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN04057%27 HTTP/1.1" 200 None
2026-03-30 10:50:43 [auto1.de] INFO: Saving data for PN04057: {'created_time': 1774867843.000979, 'last_price_update_time': 1774867843.00099, 'auction_closing_time': 1774970775.0}
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN04057') HTTP/1.1" 204 0
2026-03-30 10:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:46 [auto1.de] INFO: Channel: 24h | Page: 32 | totalHits: 9504 | hits on page: 40
2026-03-30 10:50:46 [auto1.de] INFO: Found listing with ID: YS11001
2026-03-30 10:50:46 [auto1.de] INFO: Found listing with ID: MN62628
2026-03-30 10:50:46 [auto1.de] INFO: Found listing with ID: CV94580
2026-03-30 10:50:46 [auto1.de] INFO: Found listing with ID: GV44074
2026-03-30 10:50:46 [auto1.de] INFO: Found listing with ID: VD76950
2026-03-30 10:50:46 [auto1.de] INFO: Found listing with ID: HU95609
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU95609%27 HTTP/1.1" 200 None
2026-03-30 10:50:46 [auto1.de] INFO: Scrape type for HU95609: 1
2026-03-30 10:50:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:46 [auto1.de] INFO: Found listing with ID: PN76408
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN76408%27 HTTP/1.1" 200 None
2026-03-30 10:50:46 [auto1.de] INFO: Scrape type for PN76408: 2
2026-03-30 10:50:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44fb1de3-d696-5c20-accb-9082428da04c with identifier: PN76408
2026-03-30 10:50:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44fb1de3-d696-5c20-accb-9082428da04c with scrape type 2
2026-03-30 10:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44fb1de3-d696-5c20-accb-9082428da04c with scrape type 2
2026-03-30 10:50:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44fb1de3-d696-5c20-accb-9082428da04c, identifier: PN76408
2026-03-30 10:50:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44fb1de3-d696-5c20-accb-9082428da04c with identifier: PN76408
2026-03-30 10:50:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44fb1de3-d696-5c20-accb-9082428da04c with identifier: PN76408
2026-03-30 10:50:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44fb1de3-d696-5c20-accb-9082428da04c with identifier: PN76408 to the API
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:57:11Z',
 'fuel_type': 'petrol',
 'id': '44fb1de3-d696-5c20-accb-9082428da04c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN76408',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 239895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-19',
 'seller_name': None,
 'title': 'Skoda Roomster 1.2 TSI Style Plus Edition',
 'transmission': 'manual',
 'trim': 'Style Plus Edition',
 'year': 2011}
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN76408%27 HTTP/1.1" 200 None
2026-03-30 10:50:46 [auto1.de] INFO: Saving data for PN76408: {'auction_closing_time': 1774972631.0, 'created_time': 1774377984.551701, 'last_price_update_time': 1774867846.917807}
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN76408') HTTP/1.1" 204 0
2026-03-30 10:50:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:47 [auto1.de] INFO: Found listing with ID: TR77666
2026-03-30 10:50:47 [auto1.de] INFO: Found listing with ID: VK05734
2026-03-30 10:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK05734%27 HTTP/1.1" 200 None
2026-03-30 10:50:47 [auto1.de] INFO: Scrape type for VK05734: 2
2026-03-30 10:50:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c803a08-a34f-580a-9840-ddba3b302dc1 with identifier: VK05734
2026-03-30 10:50:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c803a08-a34f-580a-9840-ddba3b302dc1 with scrape type 2
2026-03-30 10:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c803a08-a34f-580a-9840-ddba3b302dc1 with scrape type 2
2026-03-30 10:50:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c803a08-a34f-580a-9840-ddba3b302dc1, identifier: VK05734
2026-03-30 10:50:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c803a08-a34f-580a-9840-ddba3b302dc1 with identifier: VK05734
2026-03-30 10:50:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c803a08-a34f-580a-9840-ddba3b302dc1 with identifier: VK05734
2026-03-30 10:50:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c803a08-a34f-580a-9840-ddba3b302dc1 with identifier: VK05734 to the API
2026-03-30 10:50:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:52:32Z',
 'fuel_type': 'diesel',
 'id': '3c803a08-a34f-580a-9840-ddba3b302dc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK05734',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 50447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-31',
 'seller_name': None,
 'title': 'Audi A5 Sportback 40 TDI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-30 10:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK05734%27 HTTP/1.1" 200 None
2026-03-30 10:50:47 [auto1.de] INFO: Saving data for VK05734: {'auction_closing_time': 1774972352.0, 'created_time': 1774264766.253082, 'last_price_update_time': 1774867847.551043}
2026-03-30 10:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK05734') HTTP/1.1" 204 0
2026-03-30 10:50:47 [auto1.de] INFO: Found listing with ID: RZ52182
2026-03-30 10:50:47 [auto1.de] INFO: Found listing with ID: ZX86337
2026-03-30 10:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX86337%27 HTTP/1.1" 200 None
2026-03-30 10:50:47 [auto1.de] INFO: Scrape type for ZX86337: 2
2026-03-30 10:50:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 874f7353-386a-551f-b67f-bd3349a224c0 with identifier: ZX86337
2026-03-30 10:50:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 874f7353-386a-551f-b67f-bd3349a224c0 with scrape type 2
2026-03-30 10:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 874f7353-386a-551f-b67f-bd3349a224c0 with scrape type 2
2026-03-30 10:50:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 874f7353-386a-551f-b67f-bd3349a224c0, identifier: ZX86337
2026-03-30 10:50:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 874f7353-386a-551f-b67f-bd3349a224c0 with identifier: ZX86337
2026-03-30 10:50:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 874f7353-386a-551f-b67f-bd3349a224c0 with identifier: ZX86337
2026-03-30 10:50:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 874f7353-386a-551f-b67f-bd3349a224c0 with identifier: ZX86337 to the API
2026-03-30 10:50:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:09:23Z',
 'fuel_type': 'petrol',
 'id': '874f7353-386a-551f-b67f-bd3349a224c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX86337',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 170816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-28',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2011}
2026-03-30 10:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX86337%27 HTTP/1.1" 200 None
2026-03-30 10:50:48 [auto1.de] INFO: Saving data for ZX86337: {'auction_closing_time': 1774969763.0, 'created_time': 1774639211.88346, 'last_price_update_time': 1774867848.000702}
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX86337') HTTP/1.1" 204 0
2026-03-30 10:50:48 [auto1.de] INFO: Found listing with ID: WX81960
2026-03-30 10:50:48 [auto1.de] INFO: Found listing with ID: YU65678
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU65678%27 HTTP/1.1" 200 None
2026-03-30 10:50:48 [auto1.de] INFO: Scrape type for YU65678: 2
2026-03-30 10:50:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfa3ae42-8877-585b-b0a4-520caa88a198 with identifier: YU65678
2026-03-30 10:50:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfa3ae42-8877-585b-b0a4-520caa88a198 with scrape type 2
2026-03-30 10:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfa3ae42-8877-585b-b0a4-520caa88a198 with scrape type 2
2026-03-30 10:50:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfa3ae42-8877-585b-b0a4-520caa88a198, identifier: YU65678
2026-03-30 10:50:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfa3ae42-8877-585b-b0a4-520caa88a198 with identifier: YU65678
2026-03-30 10:50:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfa3ae42-8877-585b-b0a4-520caa88a198 with identifier: YU65678
2026-03-30 10:50:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfa3ae42-8877-585b-b0a4-520caa88a198 with identifier: YU65678 to the API
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-31T15:45:09Z',
 'fuel_type': 'petrol',
 'id': 'cfa3ae42-8877-585b-b0a4-520caa88a198',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU65678',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 147652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-01',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2005}
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU65678%27 HTTP/1.1" 200 None
2026-03-30 10:50:48 [auto1.de] INFO: Saving data for YU65678: {'auction_closing_time': 1774971909.0, 'created_time': 1774466175.992838, 'last_price_update_time': 1774867848.480006}
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU65678') HTTP/1.1" 204 0
2026-03-30 10:50:48 [auto1.de] INFO: Found listing with ID: DL07796
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL07796%27 HTTP/1.1" 200 None
2026-03-30 10:50:48 [auto1.de] INFO: Scrape type for DL07796: 2
2026-03-30 10:50:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c15999e-4154-5e02-b72c-e9f3f980d4b4 with identifier: DL07796
2026-03-30 10:50:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c15999e-4154-5e02-b72c-e9f3f980d4b4 with scrape type 2
2026-03-30 10:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c15999e-4154-5e02-b72c-e9f3f980d4b4 with scrape type 2
2026-03-30 10:50:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c15999e-4154-5e02-b72c-e9f3f980d4b4, identifier: DL07796
2026-03-30 10:50:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c15999e-4154-5e02-b72c-e9f3f980d4b4 with identifier: DL07796
2026-03-30 10:50:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c15999e-4154-5e02-b72c-e9f3f980d4b4 with identifier: DL07796
2026-03-30 10:50:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c15999e-4154-5e02-b72c-e9f3f980d4b4 with identifier: DL07796 to the API
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:09:04Z',
 'fuel_type': 'diesel',
 'id': '2c15999e-4154-5e02-b72c-e9f3f980d4b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL07796',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 244763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-08',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 320 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL07796%27 HTTP/1.1" 200 None
2026-03-30 10:50:48 [auto1.de] INFO: Saving data for DL07796: {'auction_closing_time': 1774969744.0, 'created_time': 1774463660.208001, 'last_price_update_time': 1774867848.967605}
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL07796') HTTP/1.1" 204 0
2026-03-30 10:50:48 [auto1.de] INFO: Found listing with ID: ZR68100
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR68100%27 HTTP/1.1" 200 None
2026-03-30 10:50:48 [auto1.de] INFO: Scrape type for ZR68100: 2
2026-03-30 10:50:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65174bb3-7949-5103-9f77-16bbf94e88a6 with identifier: ZR68100
2026-03-30 10:50:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65174bb3-7949-5103-9f77-16bbf94e88a6 with scrape type 2
2026-03-30 10:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65174bb3-7949-5103-9f77-16bbf94e88a6 with scrape type 2
2026-03-30 10:50:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65174bb3-7949-5103-9f77-16bbf94e88a6, identifier: ZR68100
2026-03-30 10:50:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65174bb3-7949-5103-9f77-16bbf94e88a6 with identifier: ZR68100
2026-03-30 10:50:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65174bb3-7949-5103-9f77-16bbf94e88a6 with identifier: ZR68100
2026-03-30 10:50:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65174bb3-7949-5103-9f77-16bbf94e88a6 with identifier: ZR68100 to the API
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-31T15:36:46Z',
 'fuel_type': 'petrol',
 'id': '65174bb3-7949-5103-9f77-16bbf94e88a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR68100',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 91438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-21',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2011}
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR68100%27 HTTP/1.1" 200 None
2026-03-30 10:50:49 [auto1.de] INFO: Saving data for ZR68100: {'auction_closing_time': 1774971406.0, 'created_time': 1773687952.951399, 'last_price_update_time': 1774867849.465723}
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR68100') HTTP/1.1" 204 0
2026-03-30 10:50:49 [auto1.de] INFO: Found listing with ID: TN69182
2026-03-30 10:50:49 [auto1.de] INFO: Found listing with ID: XV50693
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV50693%27 HTTP/1.1" 200 None
2026-03-30 10:50:49 [auto1.de] INFO: Scrape type for XV50693: 2
2026-03-30 10:50:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40372ec8-d97a-5188-9e27-76bbf73d299a with identifier: XV50693
2026-03-30 10:50:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40372ec8-d97a-5188-9e27-76bbf73d299a with scrape type 2
2026-03-30 10:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40372ec8-d97a-5188-9e27-76bbf73d299a with scrape type 2
2026-03-30 10:50:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40372ec8-d97a-5188-9e27-76bbf73d299a, identifier: XV50693
2026-03-30 10:50:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40372ec8-d97a-5188-9e27-76bbf73d299a with identifier: XV50693
2026-03-30 10:50:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40372ec8-d97a-5188-9e27-76bbf73d299a with identifier: XV50693
2026-03-30 10:50:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40372ec8-d97a-5188-9e27-76bbf73d299a with identifier: XV50693 to the API
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:29:54Z',
 'fuel_type': 'petrol',
 'id': '40372ec8-d97a-5188-9e27-76bbf73d299a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV50693',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 59073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-29',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV50693%27 HTTP/1.1" 200 None
2026-03-30 10:50:49 [auto1.de] INFO: Saving data for XV50693: {'auction_closing_time': 1774970994.0, 'created_time': 1773662230.80642, 'last_price_update_time': 1774867849.933188}
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV50693') HTTP/1.1" 204 0
2026-03-30 10:50:49 [auto1.de] INFO: Found listing with ID: LL82191
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL82191%27 HTTP/1.1" 200 None
2026-03-30 10:50:49 [auto1.de] INFO: Scrape type for LL82191: 2
2026-03-30 10:50:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25f2cae1-3637-5288-bcbf-8629ed07d72e with identifier: LL82191
2026-03-30 10:50:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25f2cae1-3637-5288-bcbf-8629ed07d72e with scrape type 2
2026-03-30 10:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25f2cae1-3637-5288-bcbf-8629ed07d72e with scrape type 2
2026-03-30 10:50:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25f2cae1-3637-5288-bcbf-8629ed07d72e, identifier: LL82191
2026-03-30 10:50:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25f2cae1-3637-5288-bcbf-8629ed07d72e with identifier: LL82191
2026-03-30 10:50:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25f2cae1-3637-5288-bcbf-8629ed07d72e with identifier: LL82191
2026-03-30 10:50:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25f2cae1-3637-5288-bcbf-8629ed07d72e with identifier: LL82191 to the API
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:49:48Z',
 'fuel_type': 'petrol',
 'id': '25f2cae1-3637-5288-bcbf-8629ed07d72e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL82191',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 140363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-17',
 'seller_name': None,
 'title': 'Dacia Logan MCV 1.6 Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2008}
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL82191%27 HTTP/1.1" 200 None
2026-03-30 10:50:50 [auto1.de] INFO: Saving data for LL82191: {'auction_closing_time': 1774972188.0, 'created_time': 1774293942.563437, 'last_price_update_time': 1774867850.388022}
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL82191') HTTP/1.1" 204 0
2026-03-30 10:50:50 [auto1.de] INFO: Found listing with ID: LD74655
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD74655%27 HTTP/1.1" 200 None
2026-03-30 10:50:50 [auto1.de] INFO: Scrape type for LD74655: 2
2026-03-30 10:50:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b878aa3a-8cf3-56d9-87c6-1d92b72114e1 with identifier: LD74655
2026-03-30 10:50:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b878aa3a-8cf3-56d9-87c6-1d92b72114e1 with scrape type 2
2026-03-30 10:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b878aa3a-8cf3-56d9-87c6-1d92b72114e1 with scrape type 2
2026-03-30 10:50:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b878aa3a-8cf3-56d9-87c6-1d92b72114e1, identifier: LD74655
2026-03-30 10:50:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b878aa3a-8cf3-56d9-87c6-1d92b72114e1 with identifier: LD74655
2026-03-30 10:50:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b878aa3a-8cf3-56d9-87c6-1d92b72114e1 with identifier: LD74655
2026-03-30 10:50:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b878aa3a-8cf3-56d9-87c6-1d92b72114e1 with identifier: LD74655 to the API
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:52:42Z',
 'fuel_type': 'petrol',
 'id': 'b878aa3a-8cf3-56d9-87c6-1d92b72114e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD74655',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 194820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': None,
 'title': 'Renault Megane 1.3 TCe BOSE-Edition',
 'transmission': 'automatic',
 'trim': 'BOSE-Edition',
 'year': 2018}
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD74655%27 HTTP/1.1" 200 None
2026-03-30 10:50:51 [auto1.de] INFO: Saving data for LD74655: {'auction_closing_time': 1774972362.0, 'created_time': 1773685830.534852, 'last_price_update_time': 1774867851.081237}
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD74655') HTTP/1.1" 204 0
2026-03-30 10:50:51 [auto1.de] INFO: Found listing with ID: KS17982
2026-03-30 10:50:51 [auto1.de] INFO: Found listing with ID: FX77489
2026-03-30 10:50:51 [auto1.de] INFO: Found listing with ID: MG35847
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG35847%27 HTTP/1.1" 200 None
2026-03-30 10:50:51 [auto1.de] INFO: Scrape type for MG35847: 2
2026-03-30 10:50:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc6d7933-b897-547f-b744-472a68f4ec3f with identifier: MG35847
2026-03-30 10:50:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc6d7933-b897-547f-b744-472a68f4ec3f with scrape type 2
2026-03-30 10:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc6d7933-b897-547f-b744-472a68f4ec3f with scrape type 2
2026-03-30 10:50:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc6d7933-b897-547f-b744-472a68f4ec3f, identifier: MG35847
2026-03-30 10:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc6d7933-b897-547f-b744-472a68f4ec3f with identifier: MG35847
2026-03-30 10:50:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc6d7933-b897-547f-b744-472a68f4ec3f with identifier: MG35847
2026-03-30 10:50:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc6d7933-b897-547f-b744-472a68f4ec3f with identifier: MG35847 to the API
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:47:18Z',
 'fuel_type': 'hybrid',
 'id': 'dc6d7933-b897-547f-b744-472a68f4ec3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG35847',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 55534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-19',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid Prime 4WD',
 'transmission': 'automatic',
 'trim': 'Prime 4WD',
 'year': 2021}
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG35847%27 HTTP/1.1" 200 None
2026-03-30 10:50:51 [auto1.de] INFO: Saving data for MG35847: {'auction_closing_time': 1774972038.0, 'created_time': 1774467736.367387, 'last_price_update_time': 1774867851.966624}
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG35847') HTTP/1.1" 204 0
2026-03-30 10:50:51 [auto1.de] INFO: Found listing with ID: GP35592
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP35592%27 HTTP/1.1" 200 None
2026-03-30 10:50:52 [auto1.de] INFO: Scrape type for GP35592: 2
2026-03-30 10:50:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05e4b261-8ca7-5f5e-8717-c60ebb3ad3bb with identifier: GP35592
2026-03-30 10:50:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05e4b261-8ca7-5f5e-8717-c60ebb3ad3bb with scrape type 2
2026-03-30 10:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05e4b261-8ca7-5f5e-8717-c60ebb3ad3bb with scrape type 2
2026-03-30 10:50:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05e4b261-8ca7-5f5e-8717-c60ebb3ad3bb, identifier: GP35592
2026-03-30 10:50:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05e4b261-8ca7-5f5e-8717-c60ebb3ad3bb with identifier: GP35592
2026-03-30 10:50:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05e4b261-8ca7-5f5e-8717-c60ebb3ad3bb with identifier: GP35592
2026-03-30 10:50:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05e4b261-8ca7-5f5e-8717-c60ebb3ad3bb with identifier: GP35592 to the API
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:36:47Z',
 'fuel_type': 'petrol',
 'id': '05e4b261-8ca7-5f5e-8717-c60ebb3ad3bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP35592',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 105700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-29',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Cool & Sound',
 'transmission': 'manual',
 'trim': 'Cool & Sound',
 'year': 2016}
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP35592%27 HTTP/1.1" 200 None
2026-03-30 10:50:52 [auto1.de] INFO: Saving data for GP35592: {'auction_closing_time': 1774971407.0, 'created_time': 1773305934.61695, 'last_price_update_time': 1774867852.413987}
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP35592') HTTP/1.1" 204 0
2026-03-30 10:50:52 [auto1.de] INFO: Found listing with ID: FY18796
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY18796%27 HTTP/1.1" 200 None
2026-03-30 10:50:52 [auto1.de] INFO: Scrape type for FY18796: 2
2026-03-30 10:50:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a09b8de7-3a5d-5a2c-920b-ba516d931164 with identifier: FY18796
2026-03-30 10:50:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a09b8de7-3a5d-5a2c-920b-ba516d931164 with scrape type 2
2026-03-30 10:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a09b8de7-3a5d-5a2c-920b-ba516d931164 with scrape type 2
2026-03-30 10:50:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a09b8de7-3a5d-5a2c-920b-ba516d931164, identifier: FY18796
2026-03-30 10:50:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a09b8de7-3a5d-5a2c-920b-ba516d931164 with identifier: FY18796
2026-03-30 10:50:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a09b8de7-3a5d-5a2c-920b-ba516d931164 with identifier: FY18796
2026-03-30 10:50:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a09b8de7-3a5d-5a2c-920b-ba516d931164 with identifier: FY18796 to the API
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-31T15:34:08Z',
 'fuel_type': 'hybrid',
 'id': 'a09b8de7-3a5d-5a2c-920b-ba516d931164',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY18796',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 47428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-25',
 'seller_name': None,
 'title': 'BMW 3er 330e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY18796%27 HTTP/1.1" 200 None
2026-03-30 10:50:52 [auto1.de] INFO: Saving data for FY18796: {'auction_closing_time': 1774971248.0, 'created_time': 1773686739.102755, 'last_price_update_time': 1774867852.864685}
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY18796') HTTP/1.1" 204 0
2026-03-30 10:50:52 [auto1.de] INFO: Channel: 24h | Page: 33 | totalHits: 9504 | hits on page: 40
2026-03-30 10:50:52 [auto1.de] INFO: Found listing with ID: CC51739
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC51739%27 HTTP/1.1" 200 None
2026-03-30 10:50:52 [auto1.de] INFO: Scrape type for CC51739: 2
2026-03-30 10:50:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf6eacc0-72dc-5f20-b01c-c81983c6f36c with identifier: CC51739
2026-03-30 10:50:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf6eacc0-72dc-5f20-b01c-c81983c6f36c with scrape type 2
2026-03-30 10:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf6eacc0-72dc-5f20-b01c-c81983c6f36c with scrape type 2
2026-03-30 10:50:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf6eacc0-72dc-5f20-b01c-c81983c6f36c, identifier: CC51739
2026-03-30 10:50:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf6eacc0-72dc-5f20-b01c-c81983c6f36c with identifier: CC51739
2026-03-30 10:50:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf6eacc0-72dc-5f20-b01c-c81983c6f36c with identifier: CC51739
2026-03-30 10:50:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf6eacc0-72dc-5f20-b01c-c81983c6f36c with identifier: CC51739 to the API
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:26:00Z',
 'fuel_type': 'diesel',
 'id': 'cf6eacc0-72dc-5f20-b01c-c81983c6f36c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC51739',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 111718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-28',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2018}
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC51739%27 HTTP/1.1" 200 None
2026-03-30 10:50:53 [auto1.de] INFO: Saving data for CC51739: {'auction_closing_time': 1774970760.0, 'created_time': 1774464673.57373, 'last_price_update_time': 1774867853.392434}
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC51739') HTTP/1.1" 204 0
2026-03-30 10:50:53 [auto1.de] INFO: Found listing with ID: KF01282
2026-03-30 10:50:53 [auto1.de] INFO: Found listing with ID: XJ37654
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ37654%27 HTTP/1.1" 200 None
2026-03-30 10:50:53 [auto1.de] INFO: Scrape type for XJ37654: 2
2026-03-30 10:50:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18d2fd19-7629-55be-bbc3-a653dc8edc58 with identifier: XJ37654
2026-03-30 10:50:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18d2fd19-7629-55be-bbc3-a653dc8edc58 with scrape type 2
2026-03-30 10:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18d2fd19-7629-55be-bbc3-a653dc8edc58 with scrape type 2
2026-03-30 10:50:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18d2fd19-7629-55be-bbc3-a653dc8edc58, identifier: XJ37654
2026-03-30 10:50:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:53 [auto1.de] INFO: Found listing with ID: KN33134
2026-03-30 10:50:53 [auto1.de] INFO: Found listing with ID: BM72660
2026-03-30 10:50:53 [auto1.de] INFO: Found listing with ID: HM06155
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM06155%27 HTTP/1.1" 200 None
2026-03-30 10:50:53 [auto1.de] INFO: Scrape type for HM06155: 2
2026-03-30 10:50:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6f84079-ae85-50a3-861c-02ec4bdedc44 with identifier: HM06155
2026-03-30 10:50:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6f84079-ae85-50a3-861c-02ec4bdedc44 with scrape type 2
2026-03-30 10:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6f84079-ae85-50a3-861c-02ec4bdedc44 with scrape type 2
2026-03-30 10:50:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6f84079-ae85-50a3-861c-02ec4bdedc44, identifier: HM06155
2026-03-30 10:50:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18d2fd19-7629-55be-bbc3-a653dc8edc58 with identifier: XJ37654
2026-03-30 10:50:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18d2fd19-7629-55be-bbc3-a653dc8edc58 with identifier: XJ37654
2026-03-30 10:50:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18d2fd19-7629-55be-bbc3-a653dc8edc58 with identifier: XJ37654 to the API
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-31T15:15:34Z',
 'fuel_type': 'petrol',
 'id': '18d2fd19-7629-55be-bbc3-a653dc8edc58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ37654',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 121024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-01',
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 TFSI Mild-Hybrid quattro 55',
 'transmission': 'automatic',
 'trim': 'quattro 55',
 'year': 2019}
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ37654%27 HTTP/1.1" 200 None
2026-03-30 10:50:53 [auto1.de] INFO: Saving data for XJ37654: {'auction_closing_time': 1774970134.0, 'created_time': 1773659843.439563, 'last_price_update_time': 1774867853.909583}
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ37654') HTTP/1.1" 204 0
2026-03-30 10:50:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6f84079-ae85-50a3-861c-02ec4bdedc44 with identifier: HM06155
2026-03-30 10:50:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6f84079-ae85-50a3-861c-02ec4bdedc44 with identifier: HM06155
2026-03-30 10:50:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6f84079-ae85-50a3-861c-02ec4bdedc44 with identifier: HM06155 to the API
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:10:36Z',
 'fuel_type': 'diesel',
 'id': 'e6f84079-ae85-50a3-861c-02ec4bdedc44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM06155',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 107293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seller_name': None,
 'title': 'Opel Crossland X 1.5 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2019}
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM06155%27 HTTP/1.1" 200 None
2026-03-30 10:50:54 [auto1.de] INFO: Saving data for HM06155: {'auction_closing_time': 1774969836.0, 'created_time': 1774467283.427411, 'last_price_update_time': 1774867854.345991}
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM06155') HTTP/1.1" 204 0
2026-03-30 10:50:54 [auto1.de] INFO: Found listing with ID: PU06584
2026-03-30 10:50:54 [auto1.de] INFO: Found listing with ID: JA95391
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA95391%27 HTTP/1.1" 200 None
2026-03-30 10:50:54 [auto1.de] INFO: Scrape type for JA95391: 2
2026-03-30 10:50:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d28cfaf-9282-59d6-916e-fb8d0256cfee with identifier: JA95391
2026-03-30 10:50:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d28cfaf-9282-59d6-916e-fb8d0256cfee with scrape type 2
2026-03-30 10:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d28cfaf-9282-59d6-916e-fb8d0256cfee with scrape type 2
2026-03-30 10:50:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d28cfaf-9282-59d6-916e-fb8d0256cfee, identifier: JA95391
2026-03-30 10:50:54 [auto1.de] INFO: Found listing with ID: GL23186
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL23186%27 HTTP/1.1" 200 None
2026-03-30 10:50:54 [auto1.de] INFO: Scrape type for GL23186: 2
2026-03-30 10:50:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 083d0ef8-22bb-5747-8de0-ddbe1d42e027 with identifier: GL23186
2026-03-30 10:50:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 083d0ef8-22bb-5747-8de0-ddbe1d42e027 with scrape type 2
2026-03-30 10:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 083d0ef8-22bb-5747-8de0-ddbe1d42e027 with scrape type 2
2026-03-30 10:50:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 083d0ef8-22bb-5747-8de0-ddbe1d42e027, identifier: GL23186
2026-03-30 10:50:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d28cfaf-9282-59d6-916e-fb8d0256cfee with identifier: JA95391
2026-03-30 10:50:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d28cfaf-9282-59d6-916e-fb8d0256cfee with identifier: JA95391
2026-03-30 10:50:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d28cfaf-9282-59d6-916e-fb8d0256cfee with identifier: JA95391 to the API
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:58:29Z',
 'fuel_type': 'petrol',
 'id': '2d28cfaf-9282-59d6-916e-fb8d0256cfee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA95391',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Tonale',
 'odometer': 16967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-06',
 'seller_name': None,
 'title': 'Alfa Romeo Tonale 1.5 Mild-Hybrid Sprint',
 'transmission': 'automatic',
 'trim': 'Sprint',
 'year': 2022}
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA95391%27 HTTP/1.1" 200 None
2026-03-30 10:50:54 [auto1.de] INFO: Saving data for JA95391: {'auction_closing_time': 1774972709.0, 'created_time': 1773345050.694149, 'last_price_update_time': 1774867854.976321}
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA95391') HTTP/1.1" 204 0
2026-03-30 10:50:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 083d0ef8-22bb-5747-8de0-ddbe1d42e027 with identifier: GL23186
2026-03-30 10:50:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 083d0ef8-22bb-5747-8de0-ddbe1d42e027 with identifier: GL23186
2026-03-30 10:50:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 083d0ef8-22bb-5747-8de0-ddbe1d42e027 with identifier: GL23186 to the API
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:43:14Z',
 'fuel_type': 'petrol',
 'id': '083d0ef8-22bb-5747-8de0-ddbe1d42e027',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL23186',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 205494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-29',
 'seller_name': None,
 'title': 'BMW 6er 630i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL23186%27 HTTP/1.1" 200 None
2026-03-30 10:50:55 [auto1.de] INFO: Saving data for GL23186: {'auction_closing_time': 1774971794.0, 'created_time': 1773468987.171221, 'last_price_update_time': 1774867855.346185}
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL23186') HTTP/1.1" 204 0
2026-03-30 10:50:55 [auto1.de] INFO: Found listing with ID: MR13527
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR13527%27 HTTP/1.1" 200 None
2026-03-30 10:50:55 [auto1.de] INFO: Scrape type for MR13527: 2
2026-03-30 10:50:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcaa4f45-1068-5383-8ef8-da029f9d1eca with identifier: MR13527
2026-03-30 10:50:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcaa4f45-1068-5383-8ef8-da029f9d1eca with scrape type 2
2026-03-30 10:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcaa4f45-1068-5383-8ef8-da029f9d1eca with scrape type 2
2026-03-30 10:50:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcaa4f45-1068-5383-8ef8-da029f9d1eca, identifier: MR13527
2026-03-30 10:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HU95609/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:55 [auto1.de] INFO: Found listing with ID: FU60583
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU60583%27 HTTP/1.1" 200 None
2026-03-30 10:50:55 [auto1.de] INFO: Scrape type for FU60583: 2
2026-03-30 10:50:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44c2981e-ad64-547a-afd6-22aa4642ffad with identifier: FU60583
2026-03-30 10:50:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44c2981e-ad64-547a-afd6-22aa4642ffad with scrape type 2
2026-03-30 10:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44c2981e-ad64-547a-afd6-22aa4642ffad with scrape type 2
2026-03-30 10:50:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44c2981e-ad64-547a-afd6-22aa4642ffad, identifier: FU60583
2026-03-30 10:50:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcaa4f45-1068-5383-8ef8-da029f9d1eca with identifier: MR13527
2026-03-30 10:50:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcaa4f45-1068-5383-8ef8-da029f9d1eca with identifier: MR13527
2026-03-30 10:50:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcaa4f45-1068-5383-8ef8-da029f9d1eca with identifier: MR13527 to the API
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-31T15:38:14Z',
 'fuel_type': 'diesel',
 'id': 'fcaa4f45-1068-5383-8ef8-da029f9d1eca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR13527',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 165929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-20',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 3.0 CRD Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2012}
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR13527%27 HTTP/1.1" 200 None
2026-03-30 10:50:55 [auto1.de] INFO: Saving data for MR13527: {'auction_closing_time': 1774971494.0, 'created_time': 1774435227.827562, 'last_price_update_time': 1774867855.939992}
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR13527') HTTP/1.1" 204 0
2026-03-30 10:50:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44c2981e-ad64-547a-afd6-22aa4642ffad with identifier: FU60583
2026-03-30 10:50:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44c2981e-ad64-547a-afd6-22aa4642ffad with identifier: FU60583
2026-03-30 10:50:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44c2981e-ad64-547a-afd6-22aa4642ffad with identifier: FU60583 to the API
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:27:56Z',
 'fuel_type': 'petrol',
 'id': '44c2981e-ad64-547a-afd6-22aa4642ffad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU60583',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 91585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-25',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU60583%27 HTTP/1.1" 200 None
2026-03-30 10:50:56 [auto1.de] INFO: Saving data for FU60583: {'auction_closing_time': 1774970876.0, 'created_time': 1773468965.394587, 'last_price_update_time': 1774867856.27549}
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU60583') HTTP/1.1" 204 0
2026-03-30 10:50:56 [auto1.de] INFO: Found listing with ID: XG57506
2026-03-30 10:50:56 [auto1.de] INFO: Found listing with ID: TW00393
2026-03-30 10:50:56 [auto1.de] INFO: Found listing with ID: RL24974
2026-03-30 10:50:56 [auto1.de] INFO: Found listing with ID: HU31000
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU31000%27 HTTP/1.1" 200 None
2026-03-30 10:50:56 [auto1.de] INFO: Scrape type for HU31000: 2
2026-03-30 10:50:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b8b2249-155a-53b2-9d52-3d63865b7884 with identifier: HU31000
2026-03-30 10:50:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b8b2249-155a-53b2-9d52-3d63865b7884 with scrape type 2
2026-03-30 10:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b8b2249-155a-53b2-9d52-3d63865b7884 with scrape type 2
2026-03-30 10:50:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b8b2249-155a-53b2-9d52-3d63865b7884, identifier: HU31000
2026-03-30 10:50:56 [auto1.de] INFO: Found listing with ID: SZ82893
2026-03-30 10:50:56 [auto1.de] INFO: Found listing with ID: UR83555
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR83555%27 HTTP/1.1" 200 None
2026-03-30 10:50:56 [auto1.de] INFO: Scrape type for UR83555: 2
2026-03-30 10:50:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6bdbf3c-08bc-5b8a-bacd-b467e1d5ef9a with identifier: UR83555
2026-03-30 10:50:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6bdbf3c-08bc-5b8a-bacd-b467e1d5ef9a with scrape type 2
2026-03-30 10:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6bdbf3c-08bc-5b8a-bacd-b467e1d5ef9a with scrape type 2
2026-03-30 10:50:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6bdbf3c-08bc-5b8a-bacd-b467e1d5ef9a, identifier: UR83555
2026-03-30 10:50:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b8b2249-155a-53b2-9d52-3d63865b7884 with identifier: HU31000
2026-03-30 10:50:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b8b2249-155a-53b2-9d52-3d63865b7884 with identifier: HU31000
2026-03-30 10:50:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b8b2249-155a-53b2-9d52-3d63865b7884 with identifier: HU31000 to the API
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:31:38Z',
 'fuel_type': 'diesel',
 'id': '7b8b2249-155a-53b2-9d52-3d63865b7884',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU31000',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 65835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-12',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2023}
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU31000%27 HTTP/1.1" 200 None
2026-03-30 10:50:56 [auto1.de] INFO: Saving data for HU31000: {'auction_closing_time': 1774971098.0, 'created_time': 1773741313.346504, 'last_price_update_time': 1774867856.865106}
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU31000') HTTP/1.1" 204 0
2026-03-30 10:50:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6bdbf3c-08bc-5b8a-bacd-b467e1d5ef9a with identifier: UR83555
2026-03-30 10:50:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6bdbf3c-08bc-5b8a-bacd-b467e1d5ef9a with identifier: UR83555
2026-03-30 10:50:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6bdbf3c-08bc-5b8a-bacd-b467e1d5ef9a with identifier: UR83555 to the API
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:41:59Z',
 'fuel_type': 'petrol',
 'id': 'f6bdbf3c-08bc-5b8a-bacd-b467e1d5ef9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR83555',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 28357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-04',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2024}
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR83555%27 HTTP/1.1" 200 None
2026-03-30 10:50:57 [auto1.de] INFO: Saving data for UR83555: {'auction_closing_time': 1774971719.0, 'created_time': 1774377249.873182, 'last_price_update_time': 1774867857.326795}
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR83555') HTTP/1.1" 204 0
2026-03-30 10:50:57 [auto1.de] INFO: Found listing with ID: GX87864
2026-03-30 10:50:57 [auto1.de] INFO: Found listing with ID: SC34211
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC34211%27 HTTP/1.1" 200 None
2026-03-30 10:50:57 [auto1.de] INFO: Scrape type for SC34211: 2
2026-03-30 10:50:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13e6d278-4c49-5f87-99e9-9943ae300aee with identifier: SC34211
2026-03-30 10:50:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13e6d278-4c49-5f87-99e9-9943ae300aee with scrape type 2
2026-03-30 10:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13e6d278-4c49-5f87-99e9-9943ae300aee with scrape type 2
2026-03-30 10:50:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13e6d278-4c49-5f87-99e9-9943ae300aee, identifier: SC34211
2026-03-30 10:50:57 [auto1.de] INFO: Found listing with ID: WZ84002
2026-03-30 10:50:57 [auto1.de] INFO: Found listing with ID: BU83638
2026-03-30 10:50:57 [auto1.de] INFO: Found listing with ID: SR37454
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR37454%27 HTTP/1.1" 200 None
2026-03-30 10:50:57 [auto1.de] INFO: Scrape type for SR37454: 2
2026-03-30 10:50:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a52ef9ab-143a-58c0-9b63-dc09797224ad with identifier: SR37454
2026-03-30 10:50:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a52ef9ab-143a-58c0-9b63-dc09797224ad with scrape type 2
2026-03-30 10:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a52ef9ab-143a-58c0-9b63-dc09797224ad with scrape type 2
2026-03-30 10:50:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a52ef9ab-143a-58c0-9b63-dc09797224ad, identifier: SR37454
2026-03-30 10:50:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13e6d278-4c49-5f87-99e9-9943ae300aee with identifier: SC34211
2026-03-30 10:50:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13e6d278-4c49-5f87-99e9-9943ae300aee with identifier: SC34211
2026-03-30 10:50:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13e6d278-4c49-5f87-99e9-9943ae300aee with identifier: SC34211 to the API
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:32:06Z',
 'fuel_type': 'petrol',
 'id': '13e6d278-4c49-5f87-99e9-9943ae300aee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC34211',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 137346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-20',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.0 TSI Monte Carlo',
 'transmission': 'manual',
 'trim': 'Monte Carlo',
 'year': 2018}
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC34211%27 HTTP/1.1" 200 None
2026-03-30 10:50:57 [auto1.de] INFO: Saving data for SC34211: {'auction_closing_time': 1774971126.0, 'created_time': 1773945055.856491, 'last_price_update_time': 1774867857.958089}
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC34211') HTTP/1.1" 204 0
2026-03-30 10:50:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a52ef9ab-143a-58c0-9b63-dc09797224ad with identifier: SR37454
2026-03-30 10:50:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a52ef9ab-143a-58c0-9b63-dc09797224ad with identifier: SR37454
2026-03-30 10:50:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a52ef9ab-143a-58c0-9b63-dc09797224ad with identifier: SR37454 to the API
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:03:15Z',
 'fuel_type': 'diesel',
 'id': 'a52ef9ab-143a-58c0-9b63-dc09797224ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR37454',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 175634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-04',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2017}
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR37454%27 HTTP/1.1" 200 None
2026-03-30 10:50:58 [auto1.de] INFO: Saving data for SR37454: {'auction_closing_time': 1774969395.0, 'created_time': 1773346155.368236, 'last_price_update_time': 1774867858.367796}
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR37454') HTTP/1.1" 204 0
2026-03-30 10:50:58 [auto1.de] INFO: Found listing with ID: AL34825
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL34825%27 HTTP/1.1" 200 None
2026-03-30 10:50:58 [auto1.de] INFO: Scrape type for AL34825: 2
2026-03-30 10:50:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1faa6d15-579c-5767-9028-dbf53bdd5d45 with identifier: AL34825
2026-03-30 10:50:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1faa6d15-579c-5767-9028-dbf53bdd5d45 with scrape type 2
2026-03-30 10:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1faa6d15-579c-5767-9028-dbf53bdd5d45 with scrape type 2
2026-03-30 10:50:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1faa6d15-579c-5767-9028-dbf53bdd5d45, identifier: AL34825
2026-03-30 10:50:58 [auto1.de] INFO: Found listing with ID: BX73975
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX73975%27 HTTP/1.1" 200 None
2026-03-30 10:50:58 [auto1.de] INFO: Scrape type for BX73975: 2
2026-03-30 10:50:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad7f5f66-e056-5790-8fe4-bf9e5b6a7a86 with identifier: BX73975
2026-03-30 10:50:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad7f5f66-e056-5790-8fe4-bf9e5b6a7a86 with scrape type 2
2026-03-30 10:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad7f5f66-e056-5790-8fe4-bf9e5b6a7a86 with scrape type 2
2026-03-30 10:50:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad7f5f66-e056-5790-8fe4-bf9e5b6a7a86, identifier: BX73975
2026-03-30 10:50:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1faa6d15-579c-5767-9028-dbf53bdd5d45 with identifier: AL34825
2026-03-30 10:50:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1faa6d15-579c-5767-9028-dbf53bdd5d45 with identifier: AL34825
2026-03-30 10:50:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1faa6d15-579c-5767-9028-dbf53bdd5d45 with identifier: AL34825 to the API
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:35:04Z',
 'fuel_type': 'petrol',
 'id': '1faa6d15-579c-5767-9028-dbf53bdd5d45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL34825',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 41241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2021}
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL34825%27 HTTP/1.1" 200 None
2026-03-30 10:50:58 [auto1.de] INFO: Saving data for AL34825: {'auction_closing_time': 1774971304.0, 'created_time': 1774380031.252097, 'last_price_update_time': 1774867858.959205}
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL34825') HTTP/1.1" 204 0
2026-03-30 10:50:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad7f5f66-e056-5790-8fe4-bf9e5b6a7a86 with identifier: BX73975
2026-03-30 10:50:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad7f5f66-e056-5790-8fe4-bf9e5b6a7a86 with identifier: BX73975
2026-03-30 10:50:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad7f5f66-e056-5790-8fe4-bf9e5b6a7a86 with identifier: BX73975 to the API
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:33:12Z',
 'fuel_type': 'diesel',
 'id': 'ad7f5f66-e056-5790-8fe4-bf9e5b6a7a86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX73975',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 195061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-14',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Exklusiv',
 'transmission': 'manual',
 'trim': 'Exklusiv',
 'year': 2016}
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX73975%27 HTTP/1.1" 200 None
2026-03-30 10:50:59 [auto1.de] INFO: Saving data for BX73975: {'auction_closing_time': 1774971192.0, 'created_time': 1773137826.449526, 'last_price_update_time': 1774867859.370466}
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX73975') HTTP/1.1" 204 0
2026-03-30 10:50:59 [auto1.de] INFO: Found listing with ID: TB55378
2026-03-30 10:50:59 [auto1.de] INFO: Found listing with ID: EA46191
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA46191%27 HTTP/1.1" 200 None
2026-03-30 10:50:59 [auto1.de] INFO: Scrape type for EA46191: 2
2026-03-30 10:50:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3289cc97-7e6d-514a-a5bf-d8c729c6d1da with identifier: EA46191
2026-03-30 10:50:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3289cc97-7e6d-514a-a5bf-d8c729c6d1da with scrape type 2
2026-03-30 10:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3289cc97-7e6d-514a-a5bf-d8c729c6d1da with scrape type 2
2026-03-30 10:50:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3289cc97-7e6d-514a-a5bf-d8c729c6d1da, identifier: EA46191
2026-03-30 10:50:59 [auto1.de] INFO: Found listing with ID: DL80467
2026-03-30 10:50:59 [auto1.de] INFO: Found listing with ID: FX59217
2026-03-30 10:50:59 [auto1.de] INFO: Found listing with ID: KP93453
2026-03-30 10:50:59 [auto1.de] INFO: Found listing with ID: UN87828
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN87828%27 HTTP/1.1" 200 None
2026-03-30 10:50:59 [auto1.de] INFO: Scrape type for UN87828: 2
2026-03-30 10:50:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 077eaf0d-e6ea-58b0-885e-971f375259d4 with identifier: UN87828
2026-03-30 10:50:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 077eaf0d-e6ea-58b0-885e-971f375259d4 with scrape type 2
2026-03-30 10:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 077eaf0d-e6ea-58b0-885e-971f375259d4 with scrape type 2
2026-03-30 10:50:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 077eaf0d-e6ea-58b0-885e-971f375259d4, identifier: UN87828
2026-03-30 10:50:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3289cc97-7e6d-514a-a5bf-d8c729c6d1da with identifier: EA46191
2026-03-30 10:50:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3289cc97-7e6d-514a-a5bf-d8c729c6d1da with identifier: EA46191
2026-03-30 10:50:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3289cc97-7e6d-514a-a5bf-d8c729c6d1da with identifier: EA46191 to the API
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:42:07Z',
 'fuel_type': 'diesel',
 'id': '3289cc97-7e6d-514a-a5bf-d8c729c6d1da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA46191',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 169738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-02',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2017}
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA46191%27 HTTP/1.1" 200 None
2026-03-30 10:50:59 [auto1.de] INFO: Saving data for EA46191: {'auction_closing_time': 1774971727.0, 'created_time': 1773688624.2093, 'last_price_update_time': 1774867859.966624}
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA46191') HTTP/1.1" 204 0
2026-03-30 10:51:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 077eaf0d-e6ea-58b0-885e-971f375259d4 with identifier: UN87828
2026-03-30 10:51:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 077eaf0d-e6ea-58b0-885e-971f375259d4 with identifier: UN87828
2026-03-30 10:51:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 077eaf0d-e6ea-58b0-885e-971f375259d4 with identifier: UN87828 to the API
2026-03-30 10:51:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:17:57Z',
 'fuel_type': 'petrol',
 'id': '077eaf0d-e6ea-58b0-885e-971f375259d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN87828',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 7206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-02',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 Mild-Hybrid Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2023}
2026-03-30 10:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN87828%27 HTTP/1.1" 200 None
2026-03-30 10:51:00 [auto1.de] INFO: Saving data for UN87828: {'auction_closing_time': 1774970277.0, 'created_time': 1773345123.43834, 'last_price_update_time': 1774867860.752874}
2026-03-30 10:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN87828') HTTP/1.1" 204 0
2026-03-30 10:51:00 [auto1.de] INFO: Found listing with ID: YV13376
2026-03-30 10:51:00 [auto1.de] INFO: Found listing with ID: PE88762
2026-03-30 10:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE88762%27 HTTP/1.1" 200 None
2026-03-30 10:51:00 [auto1.de] INFO: Scrape type for PE88762: 2
2026-03-30 10:51:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddb5d0ef-e658-59ec-a0db-8496a372ecbd with identifier: PE88762
2026-03-30 10:51:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddb5d0ef-e658-59ec-a0db-8496a372ecbd with scrape type 2
2026-03-30 10:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddb5d0ef-e658-59ec-a0db-8496a372ecbd with scrape type 2
2026-03-30 10:51:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ddb5d0ef-e658-59ec-a0db-8496a372ecbd, identifier: PE88762
2026-03-30 10:51:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ddb5d0ef-e658-59ec-a0db-8496a372ecbd with identifier: PE88762
2026-03-30 10:51:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ddb5d0ef-e658-59ec-a0db-8496a372ecbd with identifier: PE88762
2026-03-30 10:51:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ddb5d0ef-e658-59ec-a0db-8496a372ecbd with identifier: PE88762 to the API
2026-03-30 10:51:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:34:48Z',
 'fuel_type': 'petrol',
 'id': 'ddb5d0ef-e658-59ec-a0db-8496a372ecbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE88762',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 12344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-27',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS',
 'transmission': 'automatic',
 'trim': 'GS',
 'year': 2024}
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE88762%27 HTTP/1.1" 200 None
2026-03-30 10:51:01 [auto1.de] INFO: Saving data for PE88762: {'auction_closing_time': 1774971288.0, 'created_time': 1773343384.602634, 'last_price_update_time': 1774867861.226262}
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE88762') HTTP/1.1" 204 0
2026-03-30 10:51:01 [auto1.de] INFO: Found listing with ID: CP40147
2026-03-30 10:51:01 [auto1.de] INFO: Found listing with ID: YR22562
2026-03-30 10:51:01 [auto1.de] INFO: Found listing with ID: YT76473
2026-03-30 10:51:01 [auto1.de] INFO: Found listing with ID: NZ33655
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ33655%27 HTTP/1.1" 200 None
2026-03-30 10:51:01 [auto1.de] INFO: Scrape type for NZ33655: 2
2026-03-30 10:51:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4e84353-c9c7-5f57-abc7-d91e0007aff4 with identifier: NZ33655
2026-03-30 10:51:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4e84353-c9c7-5f57-abc7-d91e0007aff4 with scrape type 2
2026-03-30 10:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4e84353-c9c7-5f57-abc7-d91e0007aff4 with scrape type 2
2026-03-30 10:51:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4e84353-c9c7-5f57-abc7-d91e0007aff4, identifier: NZ33655
2026-03-30 10:51:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4e84353-c9c7-5f57-abc7-d91e0007aff4 with identifier: NZ33655
2026-03-30 10:51:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4e84353-c9c7-5f57-abc7-d91e0007aff4 with identifier: NZ33655
2026-03-30 10:51:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4e84353-c9c7-5f57-abc7-d91e0007aff4 with identifier: NZ33655 to the API
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:57:30Z',
 'fuel_type': 'petrol',
 'id': 'f4e84353-c9c7-5f57-abc7-d91e0007aff4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ33655',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 107175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-05',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2014}
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ33655%27 HTTP/1.1" 200 None
2026-03-30 10:51:01 [auto1.de] INFO: Saving data for NZ33655: {'auction_closing_time': 1774972650.0, 'created_time': 1774379642.24971, 'last_price_update_time': 1774867861.667404}
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ33655') HTTP/1.1" 204 0
2026-03-30 10:51:01 [auto1.de] INFO: Found listing with ID: UV04779
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV04779%27 HTTP/1.1" 200 None
2026-03-30 10:51:01 [auto1.de] INFO: Scrape type for UV04779: 2
2026-03-30 10:51:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a031d14e-8d59-515a-b274-80a9b473318d with identifier: UV04779
2026-03-30 10:51:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a031d14e-8d59-515a-b274-80a9b473318d with scrape type 2
2026-03-30 10:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a031d14e-8d59-515a-b274-80a9b473318d with scrape type 2
2026-03-30 10:51:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a031d14e-8d59-515a-b274-80a9b473318d, identifier: UV04779
2026-03-30 10:51:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a031d14e-8d59-515a-b274-80a9b473318d with identifier: UV04779
2026-03-30 10:51:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a031d14e-8d59-515a-b274-80a9b473318d with identifier: UV04779
2026-03-30 10:51:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a031d14e-8d59-515a-b274-80a9b473318d with identifier: UV04779 to the API
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:50:44Z',
 'fuel_type': 'diesel',
 'id': 'a031d14e-8d59-515a-b274-80a9b473318d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV04779',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 211837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-13',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2016}
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV04779%27 HTTP/1.1" 200 None
2026-03-30 10:51:02 [auto1.de] INFO: Saving data for UV04779: {'auction_closing_time': 1774972244.0, 'created_time': 1773303240.241489, 'last_price_update_time': 1774867862.132387}
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV04779') HTTP/1.1" 204 0
2026-03-30 10:51:02 [auto1.de] INFO: Found listing with ID: FD94929
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD94929%27 HTTP/1.1" 200 None
2026-03-30 10:51:02 [auto1.de] INFO: Scrape type for FD94929: 2
2026-03-30 10:51:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e0d34b7-6bf7-517a-b428-5c92cc291a9e with identifier: FD94929
2026-03-30 10:51:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e0d34b7-6bf7-517a-b428-5c92cc291a9e with scrape type 2
2026-03-30 10:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e0d34b7-6bf7-517a-b428-5c92cc291a9e with scrape type 2
2026-03-30 10:51:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e0d34b7-6bf7-517a-b428-5c92cc291a9e, identifier: FD94929
2026-03-30 10:51:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e0d34b7-6bf7-517a-b428-5c92cc291a9e with identifier: FD94929
2026-03-30 10:51:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e0d34b7-6bf7-517a-b428-5c92cc291a9e with identifier: FD94929
2026-03-30 10:51:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e0d34b7-6bf7-517a-b428-5c92cc291a9e with identifier: FD94929 to the API
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-31T15:02:55Z',
 'fuel_type': 'petrol',
 'id': '2e0d34b7-6bf7-517a-b428-5c92cc291a9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD94929',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 158084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-25',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TSI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD94929%27 HTTP/1.1" 200 None
2026-03-30 10:51:02 [auto1.de] INFO: Saving data for FD94929: {'auction_closing_time': 1774969375.0, 'created_time': 1773400755.156187, 'last_price_update_time': 1774867862.683197}
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD94929') HTTP/1.1" 204 0
2026-03-30 10:51:02 [auto1.de] INFO: Found listing with ID: KK41609
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK41609%27 HTTP/1.1" 200 None
2026-03-30 10:51:02 [auto1.de] INFO: Scrape type for KK41609: 2
2026-03-30 10:51:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 900fb8b0-419b-5f37-a423-3a852f696a30 with identifier: KK41609
2026-03-30 10:51:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 900fb8b0-419b-5f37-a423-3a852f696a30 with scrape type 2
2026-03-30 10:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 900fb8b0-419b-5f37-a423-3a852f696a30 with scrape type 2
2026-03-30 10:51:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 900fb8b0-419b-5f37-a423-3a852f696a30, identifier: KK41609
2026-03-30 10:51:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 900fb8b0-419b-5f37-a423-3a852f696a30 with identifier: KK41609
2026-03-30 10:51:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 900fb8b0-419b-5f37-a423-3a852f696a30 with identifier: KK41609
2026-03-30 10:51:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 900fb8b0-419b-5f37-a423-3a852f696a30 with identifier: KK41609 to the API
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:04:57Z',
 'fuel_type': 'diesel',
 'id': '900fb8b0-419b-5f37-a423-3a852f696a30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK41609',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 81573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-29',
 'seller_name': None,
 'title': 'Ford Fiesta 1.5 TDCi Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2017}
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK41609%27 HTTP/1.1" 200 None
2026-03-30 10:51:03 [auto1.de] INFO: Saving data for KK41609: {'auction_closing_time': 1774969497.0, 'created_time': 1773303593.608637, 'last_price_update_time': 1774867863.157321}
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK41609') HTTP/1.1" 204 0
2026-03-30 10:51:03 [auto1.de] INFO: Found listing with ID: HU48157
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU48157%27 HTTP/1.1" 200 None
2026-03-30 10:51:03 [auto1.de] INFO: Scrape type for HU48157: 2
2026-03-30 10:51:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99bc752d-622a-58f6-806a-13f10e9b5596 with identifier: HU48157
2026-03-30 10:51:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99bc752d-622a-58f6-806a-13f10e9b5596 with scrape type 2
2026-03-30 10:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99bc752d-622a-58f6-806a-13f10e9b5596 with scrape type 2
2026-03-30 10:51:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99bc752d-622a-58f6-806a-13f10e9b5596, identifier: HU48157
2026-03-30 10:51:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99bc752d-622a-58f6-806a-13f10e9b5596 with identifier: HU48157
2026-03-30 10:51:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99bc752d-622a-58f6-806a-13f10e9b5596 with identifier: HU48157
2026-03-30 10:51:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99bc752d-622a-58f6-806a-13f10e9b5596 with identifier: HU48157 to the API
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:04:27Z',
 'fuel_type': 'petrol',
 'id': '99bc752d-622a-58f6-806a-13f10e9b5596',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU48157',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 77510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-06',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2017}
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU48157%27 HTTP/1.1" 200 None
2026-03-30 10:51:03 [auto1.de] INFO: Saving data for HU48157: {'auction_closing_time': 1774969467.0, 'created_time': 1773984684.425209, 'last_price_update_time': 1774867863.642878}
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU48157') HTTP/1.1" 204 0
2026-03-30 10:51:03 [auto1.de] INFO: Found listing with ID: ZE90872
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE90872%27 HTTP/1.1" 200 None
2026-03-30 10:51:03 [auto1.de] INFO: Scrape type for ZE90872: 2
2026-03-30 10:51:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1254fb64-ead5-598d-b66e-463c6c038e25 with identifier: ZE90872
2026-03-30 10:51:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1254fb64-ead5-598d-b66e-463c6c038e25 with scrape type 2
2026-03-30 10:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1254fb64-ead5-598d-b66e-463c6c038e25 with scrape type 2
2026-03-30 10:51:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1254fb64-ead5-598d-b66e-463c6c038e25, identifier: ZE90872
2026-03-30 10:51:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1254fb64-ead5-598d-b66e-463c6c038e25 with identifier: ZE90872
2026-03-30 10:51:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1254fb64-ead5-598d-b66e-463c6c038e25 with identifier: ZE90872
2026-03-30 10:51:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1254fb64-ead5-598d-b66e-463c6c038e25 with identifier: ZE90872 to the API
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:58:58Z',
 'fuel_type': 'petrol',
 'id': '1254fb64-ead5-598d-b66e-463c6c038e25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE90872',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 105420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-06-10',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2003}
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE90872%27 HTTP/1.1" 200 None
2026-03-30 10:51:04 [auto1.de] INFO: Saving data for ZE90872: {'auction_closing_time': 1774972738.0, 'created_time': 1774330266.65391, 'last_price_update_time': 1774867864.092228}
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE90872') HTTP/1.1" 204 0
2026-03-30 10:51:04 [auto1.de] INFO: Found listing with ID: BK48500
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK48500%27 HTTP/1.1" 200 None
2026-03-30 10:51:04 [auto1.de] INFO: Scrape type for BK48500: 2
2026-03-30 10:51:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7f957fd-fe15-5952-87d2-f3ee7e21678b with identifier: BK48500
2026-03-30 10:51:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7f957fd-fe15-5952-87d2-f3ee7e21678b with scrape type 2
2026-03-30 10:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7f957fd-fe15-5952-87d2-f3ee7e21678b with scrape type 2
2026-03-30 10:51:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7f957fd-fe15-5952-87d2-f3ee7e21678b, identifier: BK48500
2026-03-30 10:51:04 [scrapy.extensions.logstats] INFO: Crawled 714 pages (at 7 pages/min), scraped 586 items (at 37 items/min)
2026-03-30 10:51:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:51:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7f957fd-fe15-5952-87d2-f3ee7e21678b with identifier: BK48500
2026-03-30 10:51:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7f957fd-fe15-5952-87d2-f3ee7e21678b with identifier: BK48500
2026-03-30 10:51:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7f957fd-fe15-5952-87d2-f3ee7e21678b with identifier: BK48500 to the API
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:05:27Z',
 'fuel_type': 'diesel',
 'id': 'c7f957fd-fe15-5952-87d2-f3ee7e21678b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK48500',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 200737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-21',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK48500%27 HTTP/1.1" 200 None
2026-03-30 10:51:04 [auto1.de] INFO: Saving data for BK48500: {'auction_closing_time': 1774969527.0, 'created_time': 1773307624.631845, 'last_price_update_time': 1774867864.636242}
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK48500') HTTP/1.1" 204 0
2026-03-30 10:51:04 [auto1.de] INFO: Found listing with ID: AT18561
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT18561%27 HTTP/1.1" 200 None
2026-03-30 10:51:04 [auto1.de] INFO: Scrape type for AT18561: 2
2026-03-30 10:51:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c993886-2778-5167-ab97-a79ff745de1b with identifier: AT18561
2026-03-30 10:51:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c993886-2778-5167-ab97-a79ff745de1b with scrape type 2
2026-03-30 10:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c993886-2778-5167-ab97-a79ff745de1b with scrape type 2
2026-03-30 10:51:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c993886-2778-5167-ab97-a79ff745de1b, identifier: AT18561
2026-03-30 10:51:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c993886-2778-5167-ab97-a79ff745de1b with identifier: AT18561
2026-03-30 10:51:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c993886-2778-5167-ab97-a79ff745de1b with identifier: AT18561
2026-03-30 10:51:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c993886-2778-5167-ab97-a79ff745de1b with identifier: AT18561 to the API
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:41:15Z',
 'fuel_type': 'petrol',
 'id': '3c993886-2778-5167-ab97-a79ff745de1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT18561',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 136850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-30',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TSI FR-Line',
 'transmission': 'automatic',
 'trim': 'FR-Line',
 'year': 2018}
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT18561%27 HTTP/1.1" 200 None
2026-03-30 10:51:05 [auto1.de] INFO: Saving data for AT18561: {'auction_closing_time': 1774971675.0, 'created_time': 1773685939.274426, 'last_price_update_time': 1774867865.135639}
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT18561') HTTP/1.1" 204 0
2026-03-30 10:51:05 [auto1.de] INFO: Found listing with ID: UV49850
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV49850%27 HTTP/1.1" 200 None
2026-03-30 10:51:05 [auto1.de] INFO: Scrape type for UV49850: 2
2026-03-30 10:51:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37fd9b1b-a749-5c9b-9c78-cae99cf881c9 with identifier: UV49850
2026-03-30 10:51:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37fd9b1b-a749-5c9b-9c78-cae99cf881c9 with scrape type 2
2026-03-30 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37fd9b1b-a749-5c9b-9c78-cae99cf881c9 with scrape type 2
2026-03-30 10:51:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37fd9b1b-a749-5c9b-9c78-cae99cf881c9, identifier: UV49850
2026-03-30 10:51:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37fd9b1b-a749-5c9b-9c78-cae99cf881c9 with identifier: UV49850
2026-03-30 10:51:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37fd9b1b-a749-5c9b-9c78-cae99cf881c9 with identifier: UV49850
2026-03-30 10:51:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37fd9b1b-a749-5c9b-9c78-cae99cf881c9 with identifier: UV49850 to the API
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:01:06Z',
 'fuel_type': 'petrol',
 'id': '37fd9b1b-a749-5c9b-9c78-cae99cf881c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV49850',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 109708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-09',
 'seller_name': None,
 'title': 'Renault Scenic 1.2 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2013}
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV49850%27 HTTP/1.1" 200 None
2026-03-30 10:51:05 [auto1.de] INFO: Saving data for UV49850: {'auction_closing_time': 1774969266.0, 'created_time': 1773774864.726769, 'last_price_update_time': 1774867865.593968}
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV49850') HTTP/1.1" 204 0
2026-03-30 10:51:05 [auto1.de] INFO: Found listing with ID: AX09860
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX09860%27 HTTP/1.1" 200 None
2026-03-30 10:51:05 [auto1.de] INFO: Scrape type for AX09860: 2
2026-03-30 10:51:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95800d54-1be6-55df-a63e-6eb9b6542ccd with identifier: AX09860
2026-03-30 10:51:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95800d54-1be6-55df-a63e-6eb9b6542ccd with scrape type 2
2026-03-30 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95800d54-1be6-55df-a63e-6eb9b6542ccd with scrape type 2
2026-03-30 10:51:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95800d54-1be6-55df-a63e-6eb9b6542ccd, identifier: AX09860
2026-03-30 10:51:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95800d54-1be6-55df-a63e-6eb9b6542ccd with identifier: AX09860
2026-03-30 10:51:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95800d54-1be6-55df-a63e-6eb9b6542ccd with identifier: AX09860
2026-03-30 10:51:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95800d54-1be6-55df-a63e-6eb9b6542ccd with identifier: AX09860 to the API
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:45:53Z',
 'fuel_type': 'diesel',
 'id': '95800d54-1be6-55df-a63e-6eb9b6542ccd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX09860',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 184707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-30',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro Sport selection',
 'transmission': 'automatic',
 'trim': 'quattro Sport selection',
 'year': 2013}
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX09860%27 HTTP/1.1" 200 None
2026-03-30 10:51:06 [auto1.de] INFO: Saving data for AX09860: {'auction_closing_time': 1774971953.0, 'created_time': 1774350263.630872, 'last_price_update_time': 1774867866.062369}
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX09860') HTTP/1.1" 204 0
2026-03-30 10:51:06 [auto1.de] INFO: Found listing with ID: BT59614
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT59614%27 HTTP/1.1" 200 None
2026-03-30 10:51:06 [auto1.de] INFO: Scrape type for BT59614: 2
2026-03-30 10:51:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2ed9be0-2258-57c5-9c7a-b490e9832941 with identifier: BT59614
2026-03-30 10:51:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2ed9be0-2258-57c5-9c7a-b490e9832941 with scrape type 2
2026-03-30 10:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2ed9be0-2258-57c5-9c7a-b490e9832941 with scrape type 2
2026-03-30 10:51:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2ed9be0-2258-57c5-9c7a-b490e9832941, identifier: BT59614
2026-03-30 10:51:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2ed9be0-2258-57c5-9c7a-b490e9832941 with identifier: BT59614
2026-03-30 10:51:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2ed9be0-2258-57c5-9c7a-b490e9832941 with identifier: BT59614
2026-03-30 10:51:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2ed9be0-2258-57c5-9c7a-b490e9832941 with identifier: BT59614 to the API
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:43:55Z',
 'fuel_type': 'petrol',
 'id': 'f2ed9be0-2258-57c5-9c7a-b490e9832941',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT59614',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-30',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Turbo Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2009}
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT59614%27 HTTP/1.1" 200 None
2026-03-30 10:51:06 [auto1.de] INFO: Saving data for BT59614: {'auction_closing_time': 1774971835.0, 'created_time': 1774348725.485729, 'last_price_update_time': 1774867866.53788}
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT59614') HTTP/1.1" 204 0
2026-03-30 10:51:06 [auto1.de] INFO: Found listing with ID: KY40781
2026-03-30 10:51:06 [auto1.de] INFO: Found listing with ID: JP65265
2026-03-30 10:51:06 [auto1.de] INFO: Found listing with ID: WV72742
2026-03-30 10:51:06 [auto1.de] INFO: Found listing with ID: MW79572
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW79572%27 HTTP/1.1" 200 None
2026-03-30 10:51:06 [auto1.de] INFO: Scrape type for MW79572: 2
2026-03-30 10:51:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e6cb7f5-e10c-5c6a-9115-2900c37e2979 with identifier: MW79572
2026-03-30 10:51:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e6cb7f5-e10c-5c6a-9115-2900c37e2979 with scrape type 2
2026-03-30 10:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e6cb7f5-e10c-5c6a-9115-2900c37e2979 with scrape type 2
2026-03-30 10:51:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e6cb7f5-e10c-5c6a-9115-2900c37e2979, identifier: MW79572
2026-03-30 10:51:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e6cb7f5-e10c-5c6a-9115-2900c37e2979 with identifier: MW79572
2026-03-30 10:51:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e6cb7f5-e10c-5c6a-9115-2900c37e2979 with identifier: MW79572
2026-03-30 10:51:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e6cb7f5-e10c-5c6a-9115-2900c37e2979 with identifier: MW79572 to the API
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:39:38Z',
 'fuel_type': 'petrol',
 'id': '5e6cb7f5-e10c-5c6a-9115-2900c37e2979',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW79572',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 188377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1988-04-28',
 'seller_name': None,
 'title': 'BMW 5er 525i',
 'transmission': 'automatic',
 'trim': '',
 'year': 1988}
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW79572%27 HTTP/1.1" 200 None
2026-03-30 10:51:06 [auto1.de] INFO: Saving data for MW79572: {'auction_closing_time': 1774971578.0, 'created_time': 1773687871.889774, 'last_price_update_time': 1774867866.99387}
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW79572') HTTP/1.1" 204 0
2026-03-30 10:51:07 [auto1.de] INFO: Found listing with ID: EU16436
2026-03-30 10:51:07 [auto1.de] INFO: Found listing with ID: PV40119
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV40119%27 HTTP/1.1" 200 None
2026-03-30 10:51:07 [auto1.de] INFO: Scrape type for PV40119: 2
2026-03-30 10:51:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d2db1e9-77e4-5411-adb3-ba6af0090749 with identifier: PV40119
2026-03-30 10:51:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d2db1e9-77e4-5411-adb3-ba6af0090749 with scrape type 2
2026-03-30 10:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d2db1e9-77e4-5411-adb3-ba6af0090749 with scrape type 2
2026-03-30 10:51:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d2db1e9-77e4-5411-adb3-ba6af0090749, identifier: PV40119
2026-03-30 10:51:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d2db1e9-77e4-5411-adb3-ba6af0090749 with identifier: PV40119
2026-03-30 10:51:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d2db1e9-77e4-5411-adb3-ba6af0090749 with identifier: PV40119
2026-03-30 10:51:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d2db1e9-77e4-5411-adb3-ba6af0090749 with identifier: PV40119 to the API
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:47:18Z',
 'fuel_type': 'petrol',
 'id': '7d2db1e9-77e4-5411-adb3-ba6af0090749',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV40119',
 'listing': 'auction',
 'make': 'Porsche',
 'model': '718 Cayman',
 'odometer': 70402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-29',
 'seller_name': None,
 'title': 'Porsche 718 Cayman 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV40119%27 HTTP/1.1" 200 None
2026-03-30 10:51:07 [auto1.de] INFO: Saving data for PV40119: {'auction_closing_time': 1774972038.0, 'created_time': 1774377644.666353, 'last_price_update_time': 1774867867.586446}
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV40119') HTTP/1.1" 204 0
2026-03-30 10:51:07 [auto1.de] INFO: Found listing with ID: WJ34554
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ34554%27 HTTP/1.1" 200 None
2026-03-30 10:51:07 [auto1.de] INFO: Scrape type for WJ34554: 2
2026-03-30 10:51:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c566479-5b53-5999-a97f-de3903255449 with identifier: WJ34554
2026-03-30 10:51:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c566479-5b53-5999-a97f-de3903255449 with scrape type 2
2026-03-30 10:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c566479-5b53-5999-a97f-de3903255449 with scrape type 2
2026-03-30 10:51:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c566479-5b53-5999-a97f-de3903255449, identifier: WJ34554
2026-03-30 10:51:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c566479-5b53-5999-a97f-de3903255449 with identifier: WJ34554
2026-03-30 10:51:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c566479-5b53-5999-a97f-de3903255449 with identifier: WJ34554
2026-03-30 10:51:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c566479-5b53-5999-a97f-de3903255449 with identifier: WJ34554 to the API
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:25:10Z',
 'fuel_type': 'petrol',
 'id': '8c566479-5b53-5999-a97f-de3903255449',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ34554',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 41486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-02',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 TGDI YES!',
 'transmission': 'automatic',
 'trim': 'YES!',
 'year': 2020}
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ34554%27 HTTP/1.1" 200 None
2026-03-30 10:51:08 [auto1.de] INFO: Saving data for WJ34554: {'auction_closing_time': 1774970710.0, 'created_time': 1773303674.815459, 'last_price_update_time': 1774867868.15683}
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ34554') HTTP/1.1" 204 0
2026-03-30 10:51:08 [auto1.de] INFO: Found listing with ID: WB03660
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB03660%27 HTTP/1.1" 200 None
2026-03-30 10:51:08 [auto1.de] INFO: Scrape type for WB03660: 2
2026-03-30 10:51:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8846b28c-0f30-5a91-abfc-5f56a74ed8f6 with identifier: WB03660
2026-03-30 10:51:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8846b28c-0f30-5a91-abfc-5f56a74ed8f6 with scrape type 2
2026-03-30 10:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8846b28c-0f30-5a91-abfc-5f56a74ed8f6 with scrape type 2
2026-03-30 10:51:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8846b28c-0f30-5a91-abfc-5f56a74ed8f6, identifier: WB03660
2026-03-30 10:51:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8846b28c-0f30-5a91-abfc-5f56a74ed8f6 with identifier: WB03660
2026-03-30 10:51:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8846b28c-0f30-5a91-abfc-5f56a74ed8f6 with identifier: WB03660
2026-03-30 10:51:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8846b28c-0f30-5a91-abfc-5f56a74ed8f6 with identifier: WB03660 to the API
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:43:54Z',
 'fuel_type': 'diesel',
 'id': '8846b28c-0f30-5a91-abfc-5f56a74ed8f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB03660',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 331022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-31',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi DPF Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB03660%27 HTTP/1.1" 200 None
2026-03-30 10:51:08 [auto1.de] INFO: Saving data for WB03660: {'auction_closing_time': 1774971834.0, 'created_time': 1773305525.906848, 'last_price_update_time': 1774867868.620038}
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB03660') HTTP/1.1" 204 0
2026-03-30 10:51:08 [auto1.de] INFO: Found listing with ID: SA60451
2026-03-30 10:51:08 [auto1.de] INFO: Found listing with ID: XA52420
2026-03-30 10:51:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.666(s), this was the 1st time calling it.
2026-03-30 10:51:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.051414254549404 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:51:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:51:21 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.620(s), this was the 2nd time calling it.
2026-03-30 10:51:21 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 8.186681831422385 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JL46781> (referer: https://www.auto1.com/v1/car-details-view/JL46781/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 556132cb-054e-5d69-a07b-21ca91c50f31 with identifier: JL46781
2026-03-30 10:51:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 556132cb-054e-5d69-a07b-21ca91c50f31 with scrape type 1
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 556132cb-054e-5d69-a07b-21ca91c50f31
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3f%252Ffc3fb4fa55cd72fadc565e05f289548d%252Fpa%252FJL46781_ee3b53c33df4c15f3c8437842dfb6cf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_ee3b53c33df4c15f3c8437842dfb6cf2.jpg already downloaded
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3f%252Ffc3fb4fa55cd72fadc565e05f289548d%252Fpa%252FJL46781_52d731448d96ae8bafac3cb58844881f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_52d731448d96ae8bafac3cb58844881f.jpg already downloaded
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3f%252Ffc3fb4fa55cd72fadc565e05f289548d%252Fpa%252FJL46781_cc777335acd67303e4cc8a9ec71a412c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_cc777335acd67303e4cc8a9ec71a412c.jpg already downloaded
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3f%252Ffc3fb4fa55cd72fadc565e05f289548d%252Fpa%252FJL46781_a65ba3e6f68397b56aac050054ffc1a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_a65ba3e6f68397b56aac050054ffc1a2.jpg already downloaded
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3f%252Ffc3fb4fa55cd72fadc565e05f289548d%252Fpa%252FJL46781_e569999885faec7e09becedd9d7310d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_e569999885faec7e09becedd9d7310d5.jpg already downloaded
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3f%252Ffc3fb4fa55cd72fadc565e05f289548d%252Fpa%252FJL46781_1656180a3de5bd517c44c3ad9b1a08f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_1656180a3de5bd517c44c3ad9b1a08f3.jpg already downloaded
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3f%252Ffc3fb4fa55cd72fadc565e05f289548d%252Fpa%252FJL46781_d7fd98e970ef86171e747e9e565919e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_d7fd98e970ef86171e747e9e565919e4.jpg already downloaded
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3f%252Ffc3fb4fa55cd72fadc565e05f289548d%252Fpa%252FJL46781_96465bf7c248855a2943a209bdc4f3fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_96465bf7c248855a2943a209bdc4f3fb.jpg already downloaded
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3f%252Ffc3fb4fa55cd72fadc565e05f289548d%252Fpa%252FJL46781_3546aef323ec1bbf84afcf5060252134.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_3546aef323ec1bbf84afcf5060252134.jpg already downloaded
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3f%252Ffc3fb4fa55cd72fadc565e05f289548d%252Fpa%252FJL46781_6be33c418eb3e5577da3869faeb3bd2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_6be33c418eb3e5577da3869faeb3bd2b.jpg already downloaded
2026-03-30 10:51:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 556132cb-054e-5d69-a07b-21ca91c50f31, identifier: JL46781
2026-03-30 10:51:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 556132cb-054e-5d69-a07b-21ca91c50f31 with identifier: JL46781
2026-03-30 10:51:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 556132cb-054e-5d69-a07b-21ca91c50f31 with identifier: JL46781
2026-03-30 10:51:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 556132cb-054e-5d69-a07b-21ca91c50f31 with identifier: JL46781 to the API
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JL46781>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:09:45Z',
 'fuel_type': 'petrol',
 'id': '556132cb-054e-5d69-a07b-21ca91c50f31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL46781',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 54660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_ee3b53c33df4c15f3c8437842dfb6cf2.jpg',
                'https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_52d731448d96ae8bafac3cb58844881f.jpg',
                'https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_cc777335acd67303e4cc8a9ec71a412c.jpg',
                'https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_a65ba3e6f68397b56aac050054ffc1a2.jpg',
                'https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_e569999885faec7e09becedd9d7310d5.jpg',
                'https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_1656180a3de5bd517c44c3ad9b1a08f3.jpg',
                'https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_d7fd98e970ef86171e747e9e565919e4.jpg',
                'https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_96465bf7c248855a2943a209bdc4f3fb.jpg',
                'https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_3546aef323ec1bbf84afcf5060252134.jpg',
                'https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_6be33c418eb3e5577da3869faeb3bd2b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_556132cb-054e-5d69-a07b-21ca91c50f31/556132cb-054e-5d69-a07b-21ca91c50f31_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_ee3b53c33df4c15f3c8437842dfb6cf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_556132cb-054e-5d69-a07b-21ca91c50f31/556132cb-054e-5d69-a07b-21ca91c50f31_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_52d731448d96ae8bafac3cb58844881f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_556132cb-054e-5d69-a07b-21ca91c50f31/556132cb-054e-5d69-a07b-21ca91c50f31_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_cc777335acd67303e4cc8a9ec71a412c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_556132cb-054e-5d69-a07b-21ca91c50f31/556132cb-054e-5d69-a07b-21ca91c50f31_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_a65ba3e6f68397b56aac050054ffc1a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_556132cb-054e-5d69-a07b-21ca91c50f31/556132cb-054e-5d69-a07b-21ca91c50f31_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_e569999885faec7e09becedd9d7310d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_556132cb-054e-5d69-a07b-21ca91c50f31/556132cb-054e-5d69-a07b-21ca91c50f31_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2466474,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_1656180a3de5bd517c44c3ad9b1a08f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_556132cb-054e-5d69-a07b-21ca91c50f31/556132cb-054e-5d69-a07b-21ca91c50f31_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_d7fd98e970ef86171e747e9e565919e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_556132cb-054e-5d69-a07b-21ca91c50f31/556132cb-054e-5d69-a07b-21ca91c50f31_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_96465bf7c248855a2943a209bdc4f3fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_556132cb-054e-5d69-a07b-21ca91c50f31/556132cb-054e-5d69-a07b-21ca91c50f31_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2638458,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_3546aef323ec1bbf84afcf5060252134.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_556132cb-054e-5d69-a07b-21ca91c50f31/556132cb-054e-5d69-a07b-21ca91c50f31_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/3f/fc3fb4fa55cd72fadc565e05f289548d/pa/JL46781_6be33c418eb3e5577da3869faeb3bd2b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Titanium X',
 'transmission': 'manual',
 'trim': 'Titanium X',
 'year': 2020}
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL46781%27 HTTP/1.1" 200 None
2026-03-30 10:51:26 [auto1.de] INFO: Saving data for JL46781: {'created_time': 1774867886.356114, 'last_price_update_time': 1774867886.356125, 'auction_closing_time': 1774969785.0}
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL46781') HTTP/1.1" 204 0
2026-03-30 10:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HU95609> (referer: https://www.auto1.com/v1/car-details-view/HU95609/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4298cb2b-3bdb-51d2-8428-f19374813162 with identifier: HU95609
2026-03-30 10:51:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4298cb2b-3bdb-51d2-8428-f19374813162 with scrape type 1
2026-03-30 10:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4298cb2b-3bdb-51d2-8428-f19374813162
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbf%252Fbebfac1271d4ba5e5e69bf5356e06e6e%252Fpa%252FHU95609_285d38d794f03ac1b0bcdc852a98bdbe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_285d38d794f03ac1b0bcdc852a98bdbe.jpg already downloaded
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbf%252Fbebfac1271d4ba5e5e69bf5356e06e6e%252Fpa%252FHU95609_ca13b8429c2049c5c61dba3ed73130dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_ca13b8429c2049c5c61dba3ed73130dc.jpg already downloaded
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbf%252Fbebfac1271d4ba5e5e69bf5356e06e6e%252Fpa%252FHU95609_febb5f8c644d022e7f84502e3dc136fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_febb5f8c644d022e7f84502e3dc136fa.jpg already downloaded
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbf%252Fbebfac1271d4ba5e5e69bf5356e06e6e%252Fpa%252FHU95609_dbd2921dc8f508291fdac5d8af1f5d59.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_dbd2921dc8f508291fdac5d8af1f5d59.jpg already downloaded
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbf%252Fbebfac1271d4ba5e5e69bf5356e06e6e%252Fpa%252FHU95609_d9078c0cad992924d6a3074c3049d897.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_d9078c0cad992924d6a3074c3049d897.jpg already downloaded
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbf%252Fbebfac1271d4ba5e5e69bf5356e06e6e%252Fpa%252FHU95609_0f3affd7e32a33d0ccbd7f989c3703e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_0f3affd7e32a33d0ccbd7f989c3703e6.jpg already downloaded
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbf%252Fbebfac1271d4ba5e5e69bf5356e06e6e%252Fpa%252FHU95609_409428aad64b3afd616216e7cec19e73.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_409428aad64b3afd616216e7cec19e73.jpg already downloaded
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbf%252Fbebfac1271d4ba5e5e69bf5356e06e6e%252Fpa%252FHU95609_6bb6be06b1cf96eb607da6129e1228e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_6bb6be06b1cf96eb607da6129e1228e4.jpg already downloaded
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbf%252Fbebfac1271d4ba5e5e69bf5356e06e6e%252Fpa%252FHU95609_09b759df2292307ddca527215c939b41.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_09b759df2292307ddca527215c939b41.jpg already downloaded
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbf%252Fbebfac1271d4ba5e5e69bf5356e06e6e%252Fpa%252FHU95609_3332eed71f84e93b5ada34d6e51b6547.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_3332eed71f84e93b5ada34d6e51b6547.jpg already downloaded
2026-03-30 10:51:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4298cb2b-3bdb-51d2-8428-f19374813162, identifier: HU95609
2026-03-30 10:51:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4298cb2b-3bdb-51d2-8428-f19374813162 with identifier: HU95609
2026-03-30 10:51:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4298cb2b-3bdb-51d2-8428-f19374813162 with identifier: HU95609
2026-03-30 10:51:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4298cb2b-3bdb-51d2-8428-f19374813162 with identifier: HU95609 to the API
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HU95609>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:12:01Z',
 'fuel_type': 'diesel',
 'id': '4298cb2b-3bdb-51d2-8428-f19374813162',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU95609',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 156379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_285d38d794f03ac1b0bcdc852a98bdbe.jpg',
                'https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_ca13b8429c2049c5c61dba3ed73130dc.jpg',
                'https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_febb5f8c644d022e7f84502e3dc136fa.jpg',
                'https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_dbd2921dc8f508291fdac5d8af1f5d59.jpg',
                'https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_d9078c0cad992924d6a3074c3049d897.jpg',
                'https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_0f3affd7e32a33d0ccbd7f989c3703e6.jpg',
                'https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_409428aad64b3afd616216e7cec19e73.jpg',
                'https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_6bb6be06b1cf96eb607da6129e1228e4.jpg',
                'https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_09b759df2292307ddca527215c939b41.jpg',
                'https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_3332eed71f84e93b5ada34d6e51b6547.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4298cb2b-3bdb-51d2-8428-f19374813162/4298cb2b-3bdb-51d2-8428-f19374813162_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_285d38d794f03ac1b0bcdc852a98bdbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4298cb2b-3bdb-51d2-8428-f19374813162/4298cb2b-3bdb-51d2-8428-f19374813162_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2543305,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_ca13b8429c2049c5c61dba3ed73130dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4298cb2b-3bdb-51d2-8428-f19374813162/4298cb2b-3bdb-51d2-8428-f19374813162_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2430458,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_febb5f8c644d022e7f84502e3dc136fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4298cb2b-3bdb-51d2-8428-f19374813162/4298cb2b-3bdb-51d2-8428-f19374813162_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2318290,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_dbd2921dc8f508291fdac5d8af1f5d59.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4298cb2b-3bdb-51d2-8428-f19374813162/4298cb2b-3bdb-51d2-8428-f19374813162_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2385337,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_d9078c0cad992924d6a3074c3049d897.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4298cb2b-3bdb-51d2-8428-f19374813162/4298cb2b-3bdb-51d2-8428-f19374813162_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2448458,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_0f3affd7e32a33d0ccbd7f989c3703e6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4298cb2b-3bdb-51d2-8428-f19374813162/4298cb2b-3bdb-51d2-8428-f19374813162_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2304641,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_409428aad64b3afd616216e7cec19e73.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4298cb2b-3bdb-51d2-8428-f19374813162/4298cb2b-3bdb-51d2-8428-f19374813162_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2459861,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_6bb6be06b1cf96eb607da6129e1228e4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4298cb2b-3bdb-51d2-8428-f19374813162/4298cb2b-3bdb-51d2-8428-f19374813162_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2419743,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_09b759df2292307ddca527215c939b41.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4298cb2b-3bdb-51d2-8428-f19374813162/4298cb2b-3bdb-51d2-8428-f19374813162_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bf/bebfac1271d4ba5e5e69bf5356e06e6e/pa/HU95609_3332eed71f84e93b5ada34d6e51b6547.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2013}
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU95609%27 HTTP/1.1" 200 None
2026-03-30 10:51:27 [auto1.de] INFO: Saving data for HU95609: {'created_time': 1774867887.107031, 'last_price_update_time': 1774867887.107044, 'auction_closing_time': 1774969921.0}
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU95609') HTTP/1.1" 204 0
2026-03-30 10:51:27 [auto1.de] INFO: Channel: 24h | Page: 34 | totalHits: 9506 | hits on page: 40
2026-03-30 10:51:27 [auto1.de] INFO: Found listing with ID: SA60451
2026-03-30 10:51:27 [auto1.de] INFO: Found listing with ID: XA52420
2026-03-30 10:51:27 [auto1.de] INFO: Found listing with ID: GC35405
2026-03-30 10:51:27 [auto1.de] INFO: Found listing with ID: HH88396
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH88396%27 HTTP/1.1" 200 None
2026-03-30 10:51:27 [auto1.de] INFO: Scrape type for HH88396: 2
2026-03-30 10:51:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 062aac1a-b9ff-55ce-a3a8-d5804c5efda3 with identifier: HH88396
2026-03-30 10:51:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 062aac1a-b9ff-55ce-a3a8-d5804c5efda3 with scrape type 2
2026-03-30 10:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 062aac1a-b9ff-55ce-a3a8-d5804c5efda3 with scrape type 2
2026-03-30 10:51:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 062aac1a-b9ff-55ce-a3a8-d5804c5efda3, identifier: HH88396
2026-03-30 10:51:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 062aac1a-b9ff-55ce-a3a8-d5804c5efda3 with identifier: HH88396
2026-03-30 10:51:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 062aac1a-b9ff-55ce-a3a8-d5804c5efda3 with identifier: HH88396
2026-03-30 10:51:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 062aac1a-b9ff-55ce-a3a8-d5804c5efda3 with identifier: HH88396 to the API
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:41:01Z',
 'fuel_type': 'diesel',
 'id': '062aac1a-b9ff-55ce-a3a8-d5804c5efda3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH88396',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 149655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-15',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Feel M',
 'transmission': 'manual',
 'trim': 'Feel M',
 'year': 2022}
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH88396%27 HTTP/1.1" 200 None
2026-03-30 10:51:27 [auto1.de] INFO: Saving data for HH88396: {'auction_closing_time': 1774971661.0, 'created_time': 1774379115.21231, 'last_price_update_time': 1774867887.781982}
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH88396') HTTP/1.1" 204 0
2026-03-30 10:51:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:27 [auto1.de] INFO: Found listing with ID: MW52698
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW52698%27 HTTP/1.1" 200 None
2026-03-30 10:51:27 [auto1.de] INFO: Scrape type for MW52698: 2
2026-03-30 10:51:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b732fc33-11cd-5ea5-aefa-990d7f833488 with identifier: MW52698
2026-03-30 10:51:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b732fc33-11cd-5ea5-aefa-990d7f833488 with scrape type 2
2026-03-30 10:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b732fc33-11cd-5ea5-aefa-990d7f833488 with scrape type 2
2026-03-30 10:51:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b732fc33-11cd-5ea5-aefa-990d7f833488, identifier: MW52698
2026-03-30 10:51:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b732fc33-11cd-5ea5-aefa-990d7f833488 with identifier: MW52698
2026-03-30 10:51:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b732fc33-11cd-5ea5-aefa-990d7f833488 with identifier: MW52698
2026-03-30 10:51:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b732fc33-11cd-5ea5-aefa-990d7f833488 with identifier: MW52698 to the API
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:07:36Z',
 'fuel_type': 'petrol',
 'id': 'b732fc33-11cd-5ea5-aefa-990d7f833488',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW52698',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 165763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-28',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.0 TSI Cool Edition',
 'transmission': 'automatic',
 'trim': 'Cool Edition',
 'year': 2017}
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW52698%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [auto1.de] INFO: Saving data for MW52698: {'auction_closing_time': 1774969656.0, 'created_time': 1774463574.520038, 'last_price_update_time': 1774867888.265633}
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW52698') HTTP/1.1" 204 0
2026-03-30 10:51:28 [auto1.de] INFO: Found listing with ID: JL06100
2026-03-30 10:51:28 [auto1.de] INFO: Found listing with ID: UP87347
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP87347%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [auto1.de] INFO: Scrape type for UP87347: 1
2026-03-30 10:51:28 [auto1.de] INFO: Found listing with ID: GB40015
2026-03-30 10:51:28 [auto1.de] INFO: Found listing with ID: WA53567
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA53567%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [auto1.de] INFO: Scrape type for WA53567: 2
2026-03-30 10:51:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d5cba73-a6f2-5eba-85eb-0d035d1328ed with identifier: WA53567
2026-03-30 10:51:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d5cba73-a6f2-5eba-85eb-0d035d1328ed with scrape type 2
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d5cba73-a6f2-5eba-85eb-0d035d1328ed with scrape type 2
2026-03-30 10:51:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d5cba73-a6f2-5eba-85eb-0d035d1328ed, identifier: WA53567
2026-03-30 10:51:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d5cba73-a6f2-5eba-85eb-0d035d1328ed with identifier: WA53567
2026-03-30 10:51:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d5cba73-a6f2-5eba-85eb-0d035d1328ed with identifier: WA53567
2026-03-30 10:51:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d5cba73-a6f2-5eba-85eb-0d035d1328ed with identifier: WA53567 to the API
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:31:16Z',
 'fuel_type': 'diesel',
 'id': '5d5cba73-a6f2-5eba-85eb-0d035d1328ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA53567',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 162500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-11',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2015}
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA53567%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [auto1.de] INFO: Saving data for WA53567: {'auction_closing_time': 1774971076.0, 'created_time': 1773343031.754424, 'last_price_update_time': 1774867888.731481}
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA53567') HTTP/1.1" 204 0
2026-03-30 10:51:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:28 [auto1.de] INFO: Found listing with ID: LN31726
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN31726%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [auto1.de] INFO: Scrape type for LN31726: 2
2026-03-30 10:51:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2ae9264-66c2-5cf8-b276-b501d608d997 with identifier: LN31726
2026-03-30 10:51:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2ae9264-66c2-5cf8-b276-b501d608d997 with scrape type 2
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2ae9264-66c2-5cf8-b276-b501d608d997 with scrape type 2
2026-03-30 10:51:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2ae9264-66c2-5cf8-b276-b501d608d997, identifier: LN31726
2026-03-30 10:51:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2ae9264-66c2-5cf8-b276-b501d608d997 with identifier: LN31726
2026-03-30 10:51:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2ae9264-66c2-5cf8-b276-b501d608d997 with identifier: LN31726
2026-03-30 10:51:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2ae9264-66c2-5cf8-b276-b501d608d997 with identifier: LN31726 to the API
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:08:41Z',
 'fuel_type': 'petrol',
 'id': 'a2ae9264-66c2-5cf8-b276-b501d608d997',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN31726',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 128649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-06',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN31726%27 HTTP/1.1" 200 None
2026-03-30 10:51:29 [auto1.de] INFO: Saving data for LN31726: {'auction_closing_time': 1774969721.0, 'created_time': 1774463667.848138, 'last_price_update_time': 1774867889.656822}
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN31726') HTTP/1.1" 204 0
2026-03-30 10:51:29 [auto1.de] INFO: Found listing with ID: ZH98765
2026-03-30 10:51:29 [auto1.de] INFO: Found listing with ID: TM51786
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM51786%27 HTTP/1.1" 200 None
2026-03-30 10:51:29 [auto1.de] INFO: Scrape type for TM51786: 2
2026-03-30 10:51:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d35b8c66-6f7c-5aee-b862-149dd6f6526e with identifier: TM51786
2026-03-30 10:51:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d35b8c66-6f7c-5aee-b862-149dd6f6526e with scrape type 2
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d35b8c66-6f7c-5aee-b862-149dd6f6526e with scrape type 2
2026-03-30 10:51:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d35b8c66-6f7c-5aee-b862-149dd6f6526e, identifier: TM51786
2026-03-30 10:51:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d35b8c66-6f7c-5aee-b862-149dd6f6526e with identifier: TM51786
2026-03-30 10:51:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d35b8c66-6f7c-5aee-b862-149dd6f6526e with identifier: TM51786
2026-03-30 10:51:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d35b8c66-6f7c-5aee-b862-149dd6f6526e with identifier: TM51786 to the API
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:28:41Z',
 'fuel_type': 'gas',
 'id': 'd35b8c66-6f7c-5aee-b862-149dd6f6526e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM51786',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 56961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-21',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Stepway Comfort',
 'transmission': 'manual',
 'trim': 'Stepway Comfort',
 'year': 2021}
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM51786%27 HTTP/1.1" 200 None
2026-03-30 10:51:30 [auto1.de] INFO: Saving data for TM51786: {'auction_closing_time': 1774970921.0, 'created_time': 1774463556.668126, 'last_price_update_time': 1774867890.126877}
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM51786') HTTP/1.1" 204 0
2026-03-30 10:51:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 10:51:30 [auto1.de] INFO: Found listing with ID: SX57791
2026-03-30 10:51:30 [auto1.de] INFO: Found listing with ID: GH40750
2026-03-30 10:51:30 [auto1.de] INFO: Found listing with ID: RM29810
2026-03-30 10:51:30 [auto1.de] INFO: Found listing with ID: HN93513
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN93513%27 HTTP/1.1" 200 None
2026-03-30 10:51:30 [auto1.de] INFO: Scrape type for HN93513: 2
2026-03-30 10:51:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 898dcff0-51b1-5e2f-b8a9-ea48ff7d8e1a with identifier: HN93513
2026-03-30 10:51:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 898dcff0-51b1-5e2f-b8a9-ea48ff7d8e1a with scrape type 2
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 898dcff0-51b1-5e2f-b8a9-ea48ff7d8e1a with scrape type 2
2026-03-30 10:51:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 898dcff0-51b1-5e2f-b8a9-ea48ff7d8e1a, identifier: HN93513
2026-03-30 10:51:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 898dcff0-51b1-5e2f-b8a9-ea48ff7d8e1a with identifier: HN93513
2026-03-30 10:51:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 898dcff0-51b1-5e2f-b8a9-ea48ff7d8e1a with identifier: HN93513
2026-03-30 10:51:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 898dcff0-51b1-5e2f-b8a9-ea48ff7d8e1a with identifier: HN93513 to the API
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-31T15:07:49Z',
 'fuel_type': 'diesel',
 'id': '898dcff0-51b1-5e2f-b8a9-ea48ff7d8e1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN93513',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 131084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-20',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic Avantgarde',
 'year': 2019}
2026-03-30 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN93513%27 HTTP/1.1" 200 None
2026-03-30 10:51:31 [auto1.de] INFO: Saving data for HN93513: {'auction_closing_time': 1774969669.0, 'created_time': 1774337457.701438, 'last_price_update_time': 1774867891.522546}
2026-03-30 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN93513') HTTP/1.1" 204 0
2026-03-30 10:51:31 [auto1.de] INFO: Found listing with ID: UK33318
2026-03-30 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK33318%27 HTTP/1.1" 200 None
2026-03-30 10:51:31 [auto1.de] INFO: Scrape type for UK33318: 2
2026-03-30 10:51:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 450a2eb7-f238-50c6-8197-f08bfb872717 with identifier: UK33318
2026-03-30 10:51:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 450a2eb7-f238-50c6-8197-f08bfb872717 with scrape type 2
2026-03-30 10:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 450a2eb7-f238-50c6-8197-f08bfb872717 with scrape type 2
2026-03-30 10:51:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 450a2eb7-f238-50c6-8197-f08bfb872717, identifier: UK33318
2026-03-30 10:51:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 450a2eb7-f238-50c6-8197-f08bfb872717 with identifier: UK33318
2026-03-30 10:51:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 450a2eb7-f238-50c6-8197-f08bfb872717 with identifier: UK33318
2026-03-30 10:51:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 450a2eb7-f238-50c6-8197-f08bfb872717 with identifier: UK33318 to the API
2026-03-30 10:51:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:01:40Z',
 'fuel_type': 'diesel',
 'id': '450a2eb7-f238-50c6-8197-f08bfb872717',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK33318',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 282529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-22',
 'seller_name': None,
 'title': 'Seat Leon 1.9 TDI Torro',
 'transmission': 'manual',
 'trim': 'Torro',
 'year': 2006}
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK33318%27 HTTP/1.1" 200 None
2026-03-30 10:51:32 [auto1.de] INFO: Saving data for UK33318: {'auction_closing_time': 1774969300.0, 'created_time': 1774467753.088301, 'last_price_update_time': 1774867892.194767}
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK33318') HTTP/1.1" 204 0
2026-03-30 10:51:32 [auto1.de] INFO: Found listing with ID: LM70179
2026-03-30 10:51:32 [auto1.de] INFO: Found listing with ID: HH81200
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH81200%27 HTTP/1.1" 200 None
2026-03-30 10:51:32 [auto1.de] INFO: Scrape type for HH81200: 2
2026-03-30 10:51:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a482c75c-0f85-5e77-9c61-7f985efd0d37 with identifier: HH81200
2026-03-30 10:51:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a482c75c-0f85-5e77-9c61-7f985efd0d37 with scrape type 2
2026-03-30 10:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a482c75c-0f85-5e77-9c61-7f985efd0d37 with scrape type 2
2026-03-30 10:51:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a482c75c-0f85-5e77-9c61-7f985efd0d37, identifier: HH81200
2026-03-30 10:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a482c75c-0f85-5e77-9c61-7f985efd0d37 with identifier: HH81200
2026-03-30 10:51:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a482c75c-0f85-5e77-9c61-7f985efd0d37 with identifier: HH81200
2026-03-30 10:51:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a482c75c-0f85-5e77-9c61-7f985efd0d37 with identifier: HH81200 to the API
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:07:07Z',
 'fuel_type': 'petrol',
 'id': 'a482c75c-0f85-5e77-9c61-7f985efd0d37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH81200',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 195336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-13',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2007}
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH81200%27 HTTP/1.1" 200 None
2026-03-30 10:51:32 [auto1.de] INFO: Saving data for HH81200: {'auction_closing_time': 1774969627.0, 'created_time': 1774377841.565486, 'last_price_update_time': 1774867892.736003}
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH81200') HTTP/1.1" 204 0
2026-03-30 10:51:32 [auto1.de] INFO: Found listing with ID: MX24097
2026-03-30 10:51:32 [auto1.de] INFO: Found listing with ID: FG94597
2026-03-30 10:51:32 [auto1.de] INFO: Found listing with ID: PY30467
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY30467%27 HTTP/1.1" 200 None
2026-03-30 10:51:32 [auto1.de] INFO: Scrape type for PY30467: 2
2026-03-30 10:51:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5477278-a1a3-5978-a3f4-706a0499605a with identifier: PY30467
2026-03-30 10:51:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5477278-a1a3-5978-a3f4-706a0499605a with scrape type 2
2026-03-30 10:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5477278-a1a3-5978-a3f4-706a0499605a with scrape type 2
2026-03-30 10:51:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5477278-a1a3-5978-a3f4-706a0499605a, identifier: PY30467
2026-03-30 10:51:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5477278-a1a3-5978-a3f4-706a0499605a with identifier: PY30467
2026-03-30 10:51:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5477278-a1a3-5978-a3f4-706a0499605a with identifier: PY30467
2026-03-30 10:51:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5477278-a1a3-5978-a3f4-706a0499605a with identifier: PY30467 to the API
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:13:21Z',
 'fuel_type': 'petrol',
 'id': 'b5477278-a1a3-5978-a3f4-706a0499605a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY30467',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 45966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-23',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.2 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2009}
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY30467%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [auto1.de] INFO: Saving data for PY30467: {'auction_closing_time': 1774970001.0, 'created_time': 1774467468.453886, 'last_price_update_time': 1774867893.249495}
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY30467') HTTP/1.1" 204 0
2026-03-30 10:51:33 [auto1.de] INFO: Found listing with ID: DR91116
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR91116%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [auto1.de] INFO: Scrape type for DR91116: 2
2026-03-30 10:51:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18231732-eabe-541e-b23c-769f0d9d0d8b with identifier: DR91116
2026-03-30 10:51:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18231732-eabe-541e-b23c-769f0d9d0d8b with scrape type 2
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18231732-eabe-541e-b23c-769f0d9d0d8b with scrape type 2
2026-03-30 10:51:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18231732-eabe-541e-b23c-769f0d9d0d8b, identifier: DR91116
2026-03-30 10:51:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18231732-eabe-541e-b23c-769f0d9d0d8b with identifier: DR91116
2026-03-30 10:51:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18231732-eabe-541e-b23c-769f0d9d0d8b with identifier: DR91116
2026-03-30 10:51:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18231732-eabe-541e-b23c-769f0d9d0d8b with identifier: DR91116 to the API
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:40:34Z',
 'fuel_type': 'diesel',
 'id': '18231732-eabe-541e-b23c-769f0d9d0d8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR91116',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 165527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-20',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2018}
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR91116%27 HTTP/1.1" 200 None
2026-03-30 10:51:34 [auto1.de] INFO: Saving data for DR91116: {'auction_closing_time': 1774971634.0, 'created_time': 1773945115.95255, 'last_price_update_time': 1774867894.246909}
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR91116') HTTP/1.1" 204 0
2026-03-30 10:51:34 [auto1.de] INFO: Channel: 24h | Page: 35 | totalHits: 9506 | hits on page: 40
2026-03-30 10:51:34 [auto1.de] INFO: Found listing with ID: FK92289
2026-03-30 10:51:34 [auto1.de] INFO: Found listing with ID: FD73392
2026-03-30 10:51:34 [auto1.de] INFO: Found listing with ID: EN35064
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN35064%27 HTTP/1.1" 200 None
2026-03-30 10:51:34 [auto1.de] INFO: Scrape type for EN35064: 2
2026-03-30 10:51:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 661535d0-0074-5a84-9642-e7394ec5247a with identifier: EN35064
2026-03-30 10:51:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 661535d0-0074-5a84-9642-e7394ec5247a with scrape type 2
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 661535d0-0074-5a84-9642-e7394ec5247a with scrape type 2
2026-03-30 10:51:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 661535d0-0074-5a84-9642-e7394ec5247a, identifier: EN35064
2026-03-30 10:51:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 661535d0-0074-5a84-9642-e7394ec5247a with identifier: EN35064
2026-03-30 10:51:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 661535d0-0074-5a84-9642-e7394ec5247a with identifier: EN35064
2026-03-30 10:51:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 661535d0-0074-5a84-9642-e7394ec5247a with identifier: EN35064 to the API
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:03:26Z',
 'fuel_type': 'diesel',
 'id': '661535d0-0074-5a84-9642-e7394ec5247a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN35064',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 104681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-07',
 'seller_name': None,
 'title': 'Renault Kadjar 1.6 dCi Energy XMOD',
 'transmission': 'manual',
 'trim': 'XMOD',
 'year': 2015}
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN35064%27 HTTP/1.1" 200 None
2026-03-30 10:51:34 [auto1.de] INFO: Saving data for EN35064: {'auction_closing_time': 1774969406.0, 'created_time': 1773399922.150715, 'last_price_update_time': 1774867894.76558}
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN35064') HTTP/1.1" 204 0
2026-03-30 10:51:34 [auto1.de] INFO: Found listing with ID: DL96803
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL96803%27 HTTP/1.1" 200 None
2026-03-30 10:51:34 [auto1.de] INFO: Scrape type for DL96803: 2
2026-03-30 10:51:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4ac8598-936b-512f-be80-406027e14b4d with identifier: DL96803
2026-03-30 10:51:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4ac8598-936b-512f-be80-406027e14b4d with scrape type 2
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4ac8598-936b-512f-be80-406027e14b4d with scrape type 2
2026-03-30 10:51:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4ac8598-936b-512f-be80-406027e14b4d, identifier: DL96803
2026-03-30 10:51:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:34 [auto1.de] INFO: Found listing with ID: HJ19382
2026-03-30 10:51:34 [auto1.de] INFO: Found listing with ID: NF12258
2026-03-30 10:51:34 [auto1.de] INFO: Found listing with ID: TE51742
2026-03-30 10:51:34 [auto1.de] INFO: Found listing with ID: YH42279
2026-03-30 10:51:34 [auto1.de] INFO: Found listing with ID: SG32034
2026-03-30 10:51:34 [auto1.de] INFO: Found listing with ID: TD37503
2026-03-30 10:51:34 [auto1.de] INFO: Found listing with ID: WL44936
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL44936%27 HTTP/1.1" 200 None
2026-03-30 10:51:34 [auto1.de] INFO: Scrape type for WL44936: 2
2026-03-30 10:51:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b90691ee-c0d1-5348-a318-c2740d44aa57 with identifier: WL44936
2026-03-30 10:51:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b90691ee-c0d1-5348-a318-c2740d44aa57 with scrape type 2
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b90691ee-c0d1-5348-a318-c2740d44aa57 with scrape type 2
2026-03-30 10:51:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b90691ee-c0d1-5348-a318-c2740d44aa57, identifier: WL44936
2026-03-30 10:51:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4ac8598-936b-512f-be80-406027e14b4d with identifier: DL96803
2026-03-30 10:51:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4ac8598-936b-512f-be80-406027e14b4d with identifier: DL96803
2026-03-30 10:51:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4ac8598-936b-512f-be80-406027e14b4d with identifier: DL96803 to the API
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:41:37Z',
 'fuel_type': 'diesel',
 'id': 'f4ac8598-936b-512f-be80-406027e14b4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL96803',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 136562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-29',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL96803%27 HTTP/1.1" 200 None
2026-03-30 10:51:35 [auto1.de] INFO: Saving data for DL96803: {'auction_closing_time': 1774971697.0, 'created_time': 1773224205.656577, 'last_price_update_time': 1774867895.345233}
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL96803') HTTP/1.1" 204 0
2026-03-30 10:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UP87347/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TP91786> (referer: https://www.auto1.com/v1/car-details-view/TP91786/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b90691ee-c0d1-5348-a318-c2740d44aa57 with identifier: WL44936
2026-03-30 10:51:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b90691ee-c0d1-5348-a318-c2740d44aa57 with identifier: WL44936
2026-03-30 10:51:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b90691ee-c0d1-5348-a318-c2740d44aa57 with identifier: WL44936 to the API
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:45:48Z',
 'fuel_type': 'petrol',
 'id': 'b90691ee-c0d1-5348-a318-c2740d44aa57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL44936',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 57863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-04',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2013}
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL44936%27 HTTP/1.1" 200 None
2026-03-30 10:51:35 [auto1.de] INFO: Saving data for WL44936: {'auction_closing_time': 1774971948.0, 'created_time': 1773946168.629204, 'last_price_update_time': 1774867895.788986}
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL44936') HTTP/1.1" 204 0
2026-03-30 10:51:35 [auto1.de] INFO: Found listing with ID: WP89589
2026-03-30 10:51:35 [auto1.de] INFO: Found listing with ID: YM15308
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM15308%27 HTTP/1.1" 200 None
2026-03-30 10:51:35 [auto1.de] INFO: Scrape type for YM15308: 2
2026-03-30 10:51:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85c08347-9143-56e7-b785-8f7509d94b6e with identifier: YM15308
2026-03-30 10:51:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85c08347-9143-56e7-b785-8f7509d94b6e with scrape type 2
2026-03-30 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85c08347-9143-56e7-b785-8f7509d94b6e with scrape type 2
2026-03-30 10:51:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85c08347-9143-56e7-b785-8f7509d94b6e, identifier: YM15308
2026-03-30 10:51:36 [auto1.de] INFO: Found listing with ID: RT58189
2026-03-30 10:51:36 [auto1.de] INFO: Found listing with ID: KB71899
2026-03-30 10:51:36 [auto1.de] INFO: Found listing with ID: NC35073
2026-03-30 10:51:36 [auto1.de] INFO: Found listing with ID: NP13175
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP13175%27 HTTP/1.1" 200 None
2026-03-30 10:51:36 [auto1.de] INFO: Scrape type for NP13175: 2
2026-03-30 10:51:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40694a2f-fb6b-5d06-a306-6fd830db4f75 with identifier: NP13175
2026-03-30 10:51:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40694a2f-fb6b-5d06-a306-6fd830db4f75 with scrape type 2
2026-03-30 10:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40694a2f-fb6b-5d06-a306-6fd830db4f75 with scrape type 2
2026-03-30 10:51:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40694a2f-fb6b-5d06-a306-6fd830db4f75, identifier: NP13175
2026-03-30 10:51:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85c08347-9143-56e7-b785-8f7509d94b6e with identifier: YM15308
2026-03-30 10:51:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85c08347-9143-56e7-b785-8f7509d94b6e with identifier: YM15308
2026-03-30 10:51:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85c08347-9143-56e7-b785-8f7509d94b6e with identifier: YM15308 to the API
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:53:25Z',
 'fuel_type': 'petrol',
 'id': '85c08347-9143-56e7-b785-8f7509d94b6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM15308',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 55833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-02',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Trend 2WD',
 'transmission': 'manual',
 'trim': 'Trend 2WD',
 'year': 2019}
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM15308%27 HTTP/1.1" 200 None
2026-03-30 10:51:36 [auto1.de] INFO: Saving data for YM15308: {'auction_closing_time': 1774972405.0, 'created_time': 1774377099.237467, 'last_price_update_time': 1774867896.483548}
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM15308') HTTP/1.1" 204 0
2026-03-30 10:51:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40694a2f-fb6b-5d06-a306-6fd830db4f75 with identifier: NP13175
2026-03-30 10:51:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40694a2f-fb6b-5d06-a306-6fd830db4f75 with identifier: NP13175
2026-03-30 10:51:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40694a2f-fb6b-5d06-a306-6fd830db4f75 with identifier: NP13175 to the API
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:35:16Z',
 'fuel_type': 'diesel',
 'id': '40694a2f-fb6b-5d06-a306-6fd830db4f75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP13175',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 273919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-01',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP13175%27 HTTP/1.1" 200 None
2026-03-30 10:51:37 [auto1.de] INFO: Saving data for NP13175: {'auction_closing_time': 1774971316.0, 'created_time': 1774464118.307315, 'last_price_update_time': 1774867897.385706}
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP13175') HTTP/1.1" 204 0
2026-03-30 10:51:37 [auto1.de] INFO: Found listing with ID: WX33301
2026-03-30 10:51:37 [auto1.de] INFO: Found listing with ID: GF55006
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF55006%27 HTTP/1.1" 200 None
2026-03-30 10:51:37 [auto1.de] INFO: Scrape type for GF55006: 2
2026-03-30 10:51:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e4d7ba4-1ced-5e89-9d76-3153e76b5fd0 with identifier: GF55006
2026-03-30 10:51:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e4d7ba4-1ced-5e89-9d76-3153e76b5fd0 with scrape type 2
2026-03-30 10:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e4d7ba4-1ced-5e89-9d76-3153e76b5fd0 with scrape type 2
2026-03-30 10:51:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e4d7ba4-1ced-5e89-9d76-3153e76b5fd0, identifier: GF55006
2026-03-30 10:51:37 [auto1.de] INFO: Found listing with ID: XM28055
2026-03-30 10:51:37 [auto1.de] INFO: Found listing with ID: UF29141
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF29141%27 HTTP/1.1" 200 None
2026-03-30 10:51:37 [auto1.de] INFO: Scrape type for UF29141: 2
2026-03-30 10:51:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81fdcfbe-ea6a-5138-aecd-595248b5b742 with identifier: UF29141
2026-03-30 10:51:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81fdcfbe-ea6a-5138-aecd-595248b5b742 with scrape type 2
2026-03-30 10:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81fdcfbe-ea6a-5138-aecd-595248b5b742 with scrape type 2
2026-03-30 10:51:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81fdcfbe-ea6a-5138-aecd-595248b5b742, identifier: UF29141
2026-03-30 10:51:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e4d7ba4-1ced-5e89-9d76-3153e76b5fd0 with identifier: GF55006
2026-03-30 10:51:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e4d7ba4-1ced-5e89-9d76-3153e76b5fd0 with identifier: GF55006
2026-03-30 10:51:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e4d7ba4-1ced-5e89-9d76-3153e76b5fd0 with identifier: GF55006 to the API
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:58:15Z',
 'fuel_type': 'petrol',
 'id': '6e4d7ba4-1ced-5e89-9d76-3153e76b5fd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF55006',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 228912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-16',
 'seller_name': None,
 'title': "Kia cee'd 1.4 Edition 7",
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2012}
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF55006%27 HTTP/1.1" 200 None
2026-03-30 10:51:37 [auto1.de] INFO: Saving data for GF55006: {'auction_closing_time': 1774972695.0, 'created_time': 1774350504.045911, 'last_price_update_time': 1774867897.96905}
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF55006') HTTP/1.1" 204 0
2026-03-30 10:51:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81fdcfbe-ea6a-5138-aecd-595248b5b742 with identifier: UF29141
2026-03-30 10:51:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81fdcfbe-ea6a-5138-aecd-595248b5b742 with identifier: UF29141
2026-03-30 10:51:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81fdcfbe-ea6a-5138-aecd-595248b5b742 with identifier: UF29141 to the API
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-31T15:00:13Z',
 'fuel_type': 'petrol',
 'id': '81fdcfbe-ea6a-5138-aecd-595248b5b742',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF29141',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 49967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-26',
 'seller_name': None,
 'title': 'BMW Z4 M40i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF29141%27 HTTP/1.1" 200 None
2026-03-30 10:51:38 [auto1.de] INFO: Saving data for UF29141: {'auction_closing_time': 1774969213.0, 'created_time': 1773945603.625213, 'last_price_update_time': 1774867898.306696}
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF29141') HTTP/1.1" 204 0
2026-03-30 10:51:38 [auto1.de] INFO: Found listing with ID: ET75266
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET75266%27 HTTP/1.1" 200 None
2026-03-30 10:51:38 [auto1.de] INFO: Scrape type for ET75266: 2
2026-03-30 10:51:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11dfe060-fda0-5e55-9834-dd1d89c9102d with identifier: ET75266
2026-03-30 10:51:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11dfe060-fda0-5e55-9834-dd1d89c9102d with scrape type 2
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11dfe060-fda0-5e55-9834-dd1d89c9102d with scrape type 2
2026-03-30 10:51:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11dfe060-fda0-5e55-9834-dd1d89c9102d, identifier: ET75266
2026-03-30 10:51:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f67a381-1952-549d-9b7a-a947c872a1b1 with identifier: TP91786
2026-03-30 10:51:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f67a381-1952-549d-9b7a-a947c872a1b1 with scrape type 1
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8f67a381-1952-549d-9b7a-a947c872a1b1
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fcb%252Ff5cb7a5bf9b5e60b0af05b37c64b2657%252Fpa%252FTP91786_be1351568e164eeded02ea47607e91c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/cb/f5cb7a5bf9b5e60b0af05b37c64b2657/pa/TP91786_be1351568e164eeded02ea47607e91c2.jpg already downloaded
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fcb%252Ff5cb7a5bf9b5e60b0af05b37c64b2657%252Fpa%252FTP91786_03494bed3ebdc2efa710ec62468841af.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/cb/f5cb7a5bf9b5e60b0af05b37c64b2657/pa/TP91786_03494bed3ebdc2efa710ec62468841af.jpg already downloaded
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fcb%252Ff5cb7a5bf9b5e60b0af05b37c64b2657%252Fpa%252FTP91786_3e8c02a2d3b3aa88af442cc45f5d6e19.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/cb/f5cb7a5bf9b5e60b0af05b37c64b2657/pa/TP91786_3e8c02a2d3b3aa88af442cc45f5d6e19.jpg already downloaded
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fcb%252Ff5cb7a5bf9b5e60b0af05b37c64b2657%252Fpa%252FTP91786_70ce1f0499678efb9a447c4be452238c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/cb/f5cb7a5bf9b5e60b0af05b37c64b2657/pa/TP91786_70ce1f0499678efb9a447c4be452238c.jpg already downloaded
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fcb%252Ff5cb7a5bf9b5e60b0af05b37c64b2657%252Fpa%252FTP91786_61d7d69f116256d8fffbbc3a0c7e5004.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/cb/f5cb7a5bf9b5e60b0af05b37c64b2657/pa/TP91786_61d7d69f116256d8fffbbc3a0c7e5004.jpg already downloaded
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fcb%252Ff5cb7a5bf9b5e60b0af05b37c64b2657%252Fpa%252FTP91786_b8185643c66c76cd77b43ddf3330a997.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/cb/f5cb7a5bf9b5e60b0af05b37c64b2657/pa/TP91786_b8185643c66c76cd77b43ddf3330a997.jpg already downloaded
2026-03-30 10:51:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f67a381-1952-549d-9b7a-a947c872a1b1, identifier: TP91786
2026-03-30 10:51:38 [auto1.de] INFO: Found listing with ID: TB76582
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB76582%27 HTTP/1.1" 200 None
2026-03-30 10:51:38 [auto1.de] INFO: Scrape type for TB76582: 2
2026-03-30 10:51:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c723ca7-07dc-5721-a5ac-6b11d6993863 with identifier: TB76582
2026-03-30 10:51:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c723ca7-07dc-5721-a5ac-6b11d6993863 with scrape type 2
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c723ca7-07dc-5721-a5ac-6b11d6993863 with scrape type 2
2026-03-30 10:51:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c723ca7-07dc-5721-a5ac-6b11d6993863, identifier: TB76582
2026-03-30 10:51:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11dfe060-fda0-5e55-9834-dd1d89c9102d with identifier: ET75266
2026-03-30 10:51:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11dfe060-fda0-5e55-9834-dd1d89c9102d with identifier: ET75266
2026-03-30 10:51:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11dfe060-fda0-5e55-9834-dd1d89c9102d with identifier: ET75266 to the API
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:56:09Z',
 'fuel_type': 'petrol',
 'id': '11dfe060-fda0-5e55-9834-dd1d89c9102d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET75266',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 81874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-27',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2011}
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET75266%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [auto1.de] INFO: Saving data for ET75266: {'auction_closing_time': 1774972569.0, 'created_time': 1773302294.23747, 'last_price_update_time': 1774867899.189929}
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET75266') HTTP/1.1" 204 0
2026-03-30 10:51:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f67a381-1952-549d-9b7a-a947c872a1b1 with identifier: TP91786
2026-03-30 10:51:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f67a381-1952-549d-9b7a-a947c872a1b1 with identifier: TP91786
2026-03-30 10:51:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f67a381-1952-549d-9b7a-a947c872a1b1 with identifier: TP91786 to the API
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TP91786>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:14:12Z',
 'fuel_type': 'petrol',
 'id': '8f67a381-1952-549d-9b7a-a947c872a1b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP91786',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 207837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgf5/cb/f5cb7a5bf9b5e60b0af05b37c64b2657/pa/TP91786_be1351568e164eeded02ea47607e91c2.jpg',
                'https://img-pa.auto1.com/imgf5/cb/f5cb7a5bf9b5e60b0af05b37c64b2657/pa/TP91786_03494bed3ebdc2efa710ec62468841af.jpg',
                'https://img-pa.auto1.com/imgf5/cb/f5cb7a5bf9b5e60b0af05b37c64b2657/pa/TP91786_3e8c02a2d3b3aa88af442cc45f5d6e19.jpg',
                'https://img-pa.auto1.com/imgf5/cb/f5cb7a5bf9b5e60b0af05b37c64b2657/pa/TP91786_70ce1f0499678efb9a447c4be452238c.jpg',
                'https://img-pa.auto1.com/imgf5/cb/f5cb7a5bf9b5e60b0af05b37c64b2657/pa/TP91786_61d7d69f116256d8fffbbc3a0c7e5004.jpg',
                'https://img-pa.auto1.com/imgf5/cb/f5cb7a5bf9b5e60b0af05b37c64b2657/pa/TP91786_b8185643c66c76cd77b43ddf3330a997.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f67a381-1952-549d-9b7a-a947c872a1b1/8f67a381-1952-549d-9b7a-a947c872a1b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/cb/f5cb7a5bf9b5e60b0af05b37c64b2657/pa/TP91786_be1351568e164eeded02ea47607e91c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f67a381-1952-549d-9b7a-a947c872a1b1/8f67a381-1952-549d-9b7a-a947c872a1b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/cb/f5cb7a5bf9b5e60b0af05b37c64b2657/pa/TP91786_03494bed3ebdc2efa710ec62468841af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f67a381-1952-549d-9b7a-a947c872a1b1/8f67a381-1952-549d-9b7a-a947c872a1b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/cb/f5cb7a5bf9b5e60b0af05b37c64b2657/pa/TP91786_3e8c02a2d3b3aa88af442cc45f5d6e19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f67a381-1952-549d-9b7a-a947c872a1b1/8f67a381-1952-549d-9b7a-a947c872a1b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/cb/f5cb7a5bf9b5e60b0af05b37c64b2657/pa/TP91786_70ce1f0499678efb9a447c4be452238c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f67a381-1952-549d-9b7a-a947c872a1b1/8f67a381-1952-549d-9b7a-a947c872a1b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/cb/f5cb7a5bf9b5e60b0af05b37c64b2657/pa/TP91786_61d7d69f116256d8fffbbc3a0c7e5004.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f67a381-1952-549d-9b7a-a947c872a1b1/8f67a381-1952-549d-9b7a-a947c872a1b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/cb/f5cb7a5bf9b5e60b0af05b37c64b2657/pa/TP91786_b8185643c66c76cd77b43ddf3330a997.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-01',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Take up!',
 'transmission': 'manual',
 'trim': 'Take',
 'year': 2014}
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP91786%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [auto1.de] INFO: Saving data for TP91786: {'created_time': 1774867899.621187, 'last_price_update_time': 1774867899.621197, 'auction_closing_time': 1774970052.0}
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP91786') HTTP/1.1" 204 0
2026-03-30 10:51:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c723ca7-07dc-5721-a5ac-6b11d6993863 with identifier: TB76582
2026-03-30 10:51:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c723ca7-07dc-5721-a5ac-6b11d6993863 with identifier: TB76582
2026-03-30 10:51:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c723ca7-07dc-5721-a5ac-6b11d6993863 with identifier: TB76582 to the API
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:35:03Z',
 'fuel_type': 'diesel',
 'id': '9c723ca7-07dc-5721-a5ac-6b11d6993863',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB76582',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 140937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-02',
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 TDI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2019}
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB76582%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [auto1.de] INFO: Saving data for TB76582: {'auction_closing_time': 1774971303.0, 'created_time': 1774467869.662911, 'last_price_update_time': 1774867899.957673}
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB76582') HTTP/1.1" 204 0
2026-03-30 10:51:39 [auto1.de] INFO: Found listing with ID: SV38598
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV38598%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [auto1.de] INFO: Scrape type for SV38598: 2
2026-03-30 10:51:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f0124fa-26e5-5739-adbc-b2f46aacfd11 with identifier: SV38598
2026-03-30 10:51:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f0124fa-26e5-5739-adbc-b2f46aacfd11 with scrape type 2
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f0124fa-26e5-5739-adbc-b2f46aacfd11 with scrape type 2
2026-03-30 10:51:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f0124fa-26e5-5739-adbc-b2f46aacfd11, identifier: SV38598
2026-03-30 10:51:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f0124fa-26e5-5739-adbc-b2f46aacfd11 with identifier: SV38598
2026-03-30 10:51:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f0124fa-26e5-5739-adbc-b2f46aacfd11 with identifier: SV38598
2026-03-30 10:51:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f0124fa-26e5-5739-adbc-b2f46aacfd11 with identifier: SV38598 to the API
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:42:54Z',
 'fuel_type': 'petrol',
 'id': '9f0124fa-26e5-5739-adbc-b2f46aacfd11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV38598',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 78086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI R BlueMotion 4Motion',
 'transmission': 'automatic',
 'trim': 'R BlueMotion 4Motion',
 'year': 2019}
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV38598%27 HTTP/1.1" 200 None
2026-03-30 10:51:40 [auto1.de] INFO: Saving data for SV38598: {'auction_closing_time': 1774971774.0, 'created_time': 1774463652.604497, 'last_price_update_time': 1774867900.442456}
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV38598') HTTP/1.1" 204 0
2026-03-30 10:51:40 [auto1.de] INFO: Found listing with ID: PJ28903
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ28903%27 HTTP/1.1" 200 None
2026-03-30 10:51:40 [auto1.de] INFO: Scrape type for PJ28903: 2
2026-03-30 10:51:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dca02e9f-bdc4-5867-af3d-ecc071a5451d with identifier: PJ28903
2026-03-30 10:51:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dca02e9f-bdc4-5867-af3d-ecc071a5451d with scrape type 2
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dca02e9f-bdc4-5867-af3d-ecc071a5451d with scrape type 2
2026-03-30 10:51:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dca02e9f-bdc4-5867-af3d-ecc071a5451d, identifier: PJ28903
2026-03-30 10:51:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dca02e9f-bdc4-5867-af3d-ecc071a5451d with identifier: PJ28903
2026-03-30 10:51:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dca02e9f-bdc4-5867-af3d-ecc071a5451d with identifier: PJ28903
2026-03-30 10:51:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dca02e9f-bdc4-5867-af3d-ecc071a5451d with identifier: PJ28903 to the API
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:56:19Z',
 'fuel_type': 'petrol',
 'id': 'dca02e9f-bdc4-5867-af3d-ecc071a5451d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ28903',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 98004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-05',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.8 TSI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2018}
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ28903%27 HTTP/1.1" 200 None
2026-03-30 10:51:40 [auto1.de] INFO: Saving data for PJ28903: {'auction_closing_time': 1774972579.0, 'created_time': 1774463714.266663, 'last_price_update_time': 1774867900.918901}
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ28903') HTTP/1.1" 204 0
2026-03-30 10:51:40 [auto1.de] INFO: Found listing with ID: ZY59187
2026-03-30 10:51:40 [auto1.de] INFO: Found listing with ID: JT25631
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT25631%27 HTTP/1.1" 200 None
2026-03-30 10:51:40 [auto1.de] INFO: Scrape type for JT25631: 2
2026-03-30 10:51:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d87c455e-f8c3-5d25-b45b-dca4ba578224 with identifier: JT25631
2026-03-30 10:51:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d87c455e-f8c3-5d25-b45b-dca4ba578224 with scrape type 2
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d87c455e-f8c3-5d25-b45b-dca4ba578224 with scrape type 2
2026-03-30 10:51:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d87c455e-f8c3-5d25-b45b-dca4ba578224, identifier: JT25631
2026-03-30 10:51:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d87c455e-f8c3-5d25-b45b-dca4ba578224 with identifier: JT25631
2026-03-30 10:51:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d87c455e-f8c3-5d25-b45b-dca4ba578224 with identifier: JT25631
2026-03-30 10:51:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d87c455e-f8c3-5d25-b45b-dca4ba578224 with identifier: JT25631 to the API
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:26:13Z',
 'fuel_type': 'hybrid',
 'id': 'd87c455e-f8c3-5d25-b45b-dca4ba578224',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT25631',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 76003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-30',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium X',
 'transmission': 'automatic',
 'trim': 'Titanium X',
 'year': 2020}
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT25631%27 HTTP/1.1" 200 None
2026-03-30 10:51:41 [auto1.de] INFO: Saving data for JT25631: {'auction_closing_time': 1774970773.0, 'created_time': 1774463715.414486, 'last_price_update_time': 1774867901.357868}
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT25631') HTTP/1.1" 204 0
2026-03-30 10:51:41 [auto1.de] INFO: Found listing with ID: HH04688
2026-03-30 10:51:41 [auto1.de] INFO: Found listing with ID: DE69503
2026-03-30 10:51:41 [auto1.de] INFO: Found listing with ID: SP29379
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP29379%27 HTTP/1.1" 200 None
2026-03-30 10:51:41 [auto1.de] INFO: Scrape type for SP29379: 1
2026-03-30 10:51:41 [auto1.de] INFO: Found listing with ID: RA40311
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA40311%27 HTTP/1.1" 200 None
2026-03-30 10:51:41 [auto1.de] INFO: Scrape type for RA40311: 2
2026-03-30 10:51:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3316026a-b078-5f6f-b659-337cf313aa2d with identifier: RA40311
2026-03-30 10:51:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3316026a-b078-5f6f-b659-337cf313aa2d with scrape type 2
2026-03-30 10:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3316026a-b078-5f6f-b659-337cf313aa2d with scrape type 2
2026-03-30 10:51:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3316026a-b078-5f6f-b659-337cf313aa2d, identifier: RA40311
2026-03-30 10:51:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3316026a-b078-5f6f-b659-337cf313aa2d with identifier: RA40311
2026-03-30 10:51:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3316026a-b078-5f6f-b659-337cf313aa2d with identifier: RA40311
2026-03-30 10:51:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3316026a-b078-5f6f-b659-337cf313aa2d with identifier: RA40311 to the API
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:29:39Z',
 'fuel_type': 'petrol',
 'id': '3316026a-b078-5f6f-b659-337cf313aa2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA40311',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 123410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-15',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Enjoy',
 'transmission': 'manual',
 'trim': 'Enjoy',
 'year': 2009}
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA40311%27 HTTP/1.1" 200 None
2026-03-30 10:51:41 [auto1.de] INFO: Saving data for RA40311: {'auction_closing_time': 1774970979.0, 'created_time': 1773946423.740148, 'last_price_update_time': 1774867901.900013}
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA40311') HTTP/1.1" 204 0
2026-03-30 10:51:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:41 [auto1.de] INFO: Found listing with ID: YA21535
2026-03-30 10:51:41 [auto1.de] INFO: Found listing with ID: RT09280
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT09280%27 HTTP/1.1" 200 None
2026-03-30 10:51:41 [auto1.de] INFO: Scrape type for RT09280: 2
2026-03-30 10:51:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3312ebf6-9592-5e2c-813f-b7b01c4d518f with identifier: RT09280
2026-03-30 10:51:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3312ebf6-9592-5e2c-813f-b7b01c4d518f with scrape type 2
2026-03-30 10:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3312ebf6-9592-5e2c-813f-b7b01c4d518f with scrape type 2
2026-03-30 10:51:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3312ebf6-9592-5e2c-813f-b7b01c4d518f, identifier: RT09280
2026-03-30 10:51:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3312ebf6-9592-5e2c-813f-b7b01c4d518f with identifier: RT09280
2026-03-30 10:51:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3312ebf6-9592-5e2c-813f-b7b01c4d518f with identifier: RT09280
2026-03-30 10:51:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3312ebf6-9592-5e2c-813f-b7b01c4d518f with identifier: RT09280 to the API
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:20:42Z',
 'fuel_type': 'diesel',
 'id': '3312ebf6-9592-5e2c-813f-b7b01c4d518f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT09280',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 70876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-28',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 111 CDI Lang',
 'transmission': 'manual',
 'trim': 'Lang',
 'year': 2015}
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT09280%27 HTTP/1.1" 200 None
2026-03-30 10:51:42 [auto1.de] INFO: Saving data for RT09280: {'auction_closing_time': 1774970442.0, 'created_time': 1772725896.484714, 'last_price_update_time': 1774867902.351893}
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT09280') HTTP/1.1" 204 0
2026-03-30 10:51:42 [auto1.de] INFO: Found listing with ID: EV41055
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV41055%27 HTTP/1.1" 200 None
2026-03-30 10:51:42 [auto1.de] INFO: Scrape type for EV41055: 2
2026-03-30 10:51:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c08c793a-ac4c-529d-9870-66d79c11e444 with identifier: EV41055
2026-03-30 10:51:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c08c793a-ac4c-529d-9870-66d79c11e444 with scrape type 2
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c08c793a-ac4c-529d-9870-66d79c11e444 with scrape type 2
2026-03-30 10:51:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c08c793a-ac4c-529d-9870-66d79c11e444, identifier: EV41055
2026-03-30 10:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c08c793a-ac4c-529d-9870-66d79c11e444 with identifier: EV41055
2026-03-30 10:51:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c08c793a-ac4c-529d-9870-66d79c11e444 with identifier: EV41055
2026-03-30 10:51:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c08c793a-ac4c-529d-9870-66d79c11e444 with identifier: EV41055 to the API
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-31T15:22:29Z',
 'fuel_type': 'petrol',
 'id': 'c08c793a-ac4c-529d-9870-66d79c11e444',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV41055',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 295795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-14',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 400 T 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic Avantgarde',
 'year': 2017}
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV41055%27 HTTP/1.1" 200 None
2026-03-30 10:51:42 [auto1.de] INFO: Saving data for EV41055: {'auction_closing_time': 1774970549.0, 'created_time': 1773660468.695241, 'last_price_update_time': 1774867902.821941}
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV41055') HTTP/1.1" 204 0
2026-03-30 10:51:42 [auto1.de] INFO: Found listing with ID: CE24177
2026-03-30 10:51:42 [auto1.de] INFO: Found listing with ID: NX49590
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX49590%27 HTTP/1.1" 200 None
2026-03-30 10:51:42 [auto1.de] INFO: Scrape type for NX49590: 2
2026-03-30 10:51:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6d64407-e5c9-5ebf-894c-9f41d0a9300a with identifier: NX49590
2026-03-30 10:51:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6d64407-e5c9-5ebf-894c-9f41d0a9300a with scrape type 2
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6d64407-e5c9-5ebf-894c-9f41d0a9300a with scrape type 2
2026-03-30 10:51:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6d64407-e5c9-5ebf-894c-9f41d0a9300a, identifier: NX49590
2026-03-30 10:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UP87347> (referer: https://www.auto1.com/v1/car-details-view/UP87347/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6d64407-e5c9-5ebf-894c-9f41d0a9300a with identifier: NX49590
2026-03-30 10:51:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6d64407-e5c9-5ebf-894c-9f41d0a9300a with identifier: NX49590
2026-03-30 10:51:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6d64407-e5c9-5ebf-894c-9f41d0a9300a with identifier: NX49590 to the API
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:18:09Z',
 'fuel_type': 'diesel',
 'id': 'f6d64407-e5c9-5ebf-894c-9f41d0a9300a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX49590',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 91426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-18',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX49590%27 HTTP/1.1" 200 None
2026-03-30 10:51:43 [auto1.de] INFO: Saving data for NX49590: {'auction_closing_time': 1774970289.0, 'created_time': 1774467738.081448, 'last_price_update_time': 1774867903.40595}
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX49590') HTTP/1.1" 204 0
2026-03-30 10:51:43 [auto1.de] INFO: Found listing with ID: UC16251
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC16251%27 HTTP/1.1" 200 None
2026-03-30 10:51:43 [auto1.de] INFO: Scrape type for UC16251: 2
2026-03-30 10:51:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96b33abb-5726-536c-99e7-265a943c1de3 with identifier: UC16251
2026-03-30 10:51:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96b33abb-5726-536c-99e7-265a943c1de3 with scrape type 2
2026-03-30 10:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96b33abb-5726-536c-99e7-265a943c1de3 with scrape type 2
2026-03-30 10:51:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96b33abb-5726-536c-99e7-265a943c1de3, identifier: UC16251
2026-03-30 10:51:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96b33abb-5726-536c-99e7-265a943c1de3 with identifier: UC16251
2026-03-30 10:51:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96b33abb-5726-536c-99e7-265a943c1de3 with identifier: UC16251
2026-03-30 10:51:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96b33abb-5726-536c-99e7-265a943c1de3 with identifier: UC16251 to the API
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:30:22Z',
 'fuel_type': 'petrol',
 'id': '96b33abb-5726-536c-99e7-265a943c1de3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC16251',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 130515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-04',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Vision 2WD',
 'transmission': 'manual',
 'trim': 'Vision 2WD',
 'year': 2015}
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC16251%27 HTTP/1.1" 200 None
2026-03-30 10:51:44 [auto1.de] INFO: Saving data for UC16251: {'auction_closing_time': 1774971022.0, 'created_time': 1773303936.99549, 'last_price_update_time': 1774867904.154587}
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC16251') HTTP/1.1" 204 0
2026-03-30 10:51:44 [auto1.de] INFO: Channel: 24h | Page: 36 | totalHits: 9508 | hits on page: 40
2026-03-30 10:51:44 [auto1.de] INFO: Found listing with ID: GT12052
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT12052%27 HTTP/1.1" 200 None
2026-03-30 10:51:44 [auto1.de] INFO: Scrape type for GT12052: 2
2026-03-30 10:51:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f62beef-c146-5def-a602-b6c83a92eb0a with identifier: GT12052
2026-03-30 10:51:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f62beef-c146-5def-a602-b6c83a92eb0a with scrape type 2
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f62beef-c146-5def-a602-b6c83a92eb0a with scrape type 2
2026-03-30 10:51:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f62beef-c146-5def-a602-b6c83a92eb0a, identifier: GT12052
2026-03-30 10:51:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f62beef-c146-5def-a602-b6c83a92eb0a with identifier: GT12052
2026-03-30 10:51:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f62beef-c146-5def-a602-b6c83a92eb0a with identifier: GT12052
2026-03-30 10:51:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f62beef-c146-5def-a602-b6c83a92eb0a with identifier: GT12052 to the API
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:58:28Z',
 'fuel_type': 'petrol',
 'id': '1f62beef-c146-5def-a602-b6c83a92eb0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT12052',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 164297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-25',
 'seller_name': None,
 'title': 'Audi A6 1.8 TFSI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT12052%27 HTTP/1.1" 200 None
2026-03-30 10:51:44 [auto1.de] INFO: Saving data for GT12052: {'auction_closing_time': 1774972708.0, 'created_time': 1774467027.677023, 'last_price_update_time': 1774867904.630339}
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT12052') HTTP/1.1" 204 0
2026-03-30 10:51:44 [auto1.de] INFO: Found listing with ID: JA92497
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA92497%27 HTTP/1.1" 200 None
2026-03-30 10:51:44 [auto1.de] INFO: Scrape type for JA92497: 2
2026-03-30 10:51:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a80be4d6-56a9-579d-a4fb-57e17011efb3 with identifier: JA92497
2026-03-30 10:51:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a80be4d6-56a9-579d-a4fb-57e17011efb3 with scrape type 2
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a80be4d6-56a9-579d-a4fb-57e17011efb3 with scrape type 2
2026-03-30 10:51:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a80be4d6-56a9-579d-a4fb-57e17011efb3, identifier: JA92497
2026-03-30 10:51:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f120c1b-89ec-51f3-b5b8-b024d6f3387e with identifier: UP87347
2026-03-30 10:51:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f120c1b-89ec-51f3-b5b8-b024d6f3387e with scrape type 1
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f120c1b-89ec-51f3-b5b8-b024d6f3387e
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_fa25157cad9adf0df7e5f2a8433358d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_fa25157cad9adf0df7e5f2a8433358d9.jpg not downloaded yet
2026-03-30 10:51:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:44 [auto1.de] INFO: Found listing with ID: GF83151
2026-03-30 10:51:44 [auto1.de] INFO: Found listing with ID: RL62864
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL62864%27 HTTP/1.1" 200 None
2026-03-30 10:51:44 [auto1.de] INFO: Scrape type for RL62864: 1
2026-03-30 10:51:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a80be4d6-56a9-579d-a4fb-57e17011efb3 with identifier: JA92497
2026-03-30 10:51:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a80be4d6-56a9-579d-a4fb-57e17011efb3 with identifier: JA92497
2026-03-30 10:51:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a80be4d6-56a9-579d-a4fb-57e17011efb3 with identifier: JA92497 to the API
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:24:39Z',
 'fuel_type': 'petrol',
 'id': 'a80be4d6-56a9-579d-a4fb-57e17011efb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA92497',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 157948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-13',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA92497%27 HTTP/1.1" 200 None
2026-03-30 10:51:45 [auto1.de] INFO: Saving data for JA92497: {'auction_closing_time': 1774970679.0, 'created_time': 1773466906.929437, 'last_price_update_time': 1774867905.261073}
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA92497') HTTP/1.1" 204 0
2026-03-30 10:51:45 [auto1.de] INFO: Found listing with ID: UU37605
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU37605%27 HTTP/1.1" 200 None
2026-03-30 10:51:45 [auto1.de] INFO: Scrape type for UU37605: 2
2026-03-30 10:51:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa954d4a-ecab-5e9f-b9fd-482e99893e5c with identifier: UU37605
2026-03-30 10:51:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa954d4a-ecab-5e9f-b9fd-482e99893e5c with scrape type 2
2026-03-30 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa954d4a-ecab-5e9f-b9fd-482e99893e5c with scrape type 2
2026-03-30 10:51:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa954d4a-ecab-5e9f-b9fd-482e99893e5c, identifier: UU37605
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_054c7e084df79a54deb9a19eab4bd6d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_054c7e084df79a54deb9a19eab4bd6d5.jpg not downloaded yet
2026-03-30 10:51:45 [auto1.de] INFO: Found listing with ID: DF24349
2026-03-30 10:51:45 [auto1.de] INFO: Found listing with ID: LZ29816
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ29816%27 HTTP/1.1" 200 None
2026-03-30 10:51:45 [auto1.de] INFO: Scrape type for LZ29816: 2
2026-03-30 10:51:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b094d01-b9f0-5e55-87dc-35e30dd8efa8 with identifier: LZ29816
2026-03-30 10:51:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b094d01-b9f0-5e55-87dc-35e30dd8efa8 with scrape type 2
2026-03-30 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b094d01-b9f0-5e55-87dc-35e30dd8efa8 with scrape type 2
2026-03-30 10:51:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b094d01-b9f0-5e55-87dc-35e30dd8efa8, identifier: LZ29816
2026-03-30 10:51:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa954d4a-ecab-5e9f-b9fd-482e99893e5c with identifier: UU37605
2026-03-30 10:51:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa954d4a-ecab-5e9f-b9fd-482e99893e5c with identifier: UU37605
2026-03-30 10:51:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa954d4a-ecab-5e9f-b9fd-482e99893e5c with identifier: UU37605 to the API
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:05:26Z',
 'fuel_type': 'diesel',
 'id': 'fa954d4a-ecab-5e9f-b9fd-482e99893e5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU37605',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 164383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-17',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition 4x4',
 'transmission': 'automatic',
 'trim': 'Ambition 4x4',
 'year': 2022}
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU37605%27 HTTP/1.1" 200 None
2026-03-30 10:51:45 [auto1.de] INFO: Saving data for UU37605: {'auction_closing_time': 1774969526.0, 'created_time': 1773426721.465017, 'last_price_update_time': 1774867905.844957}
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UU37605') HTTP/1.1" 204 0
2026-03-30 10:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SP29379/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b094d01-b9f0-5e55-87dc-35e30dd8efa8 with identifier: LZ29816
2026-03-30 10:51:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b094d01-b9f0-5e55-87dc-35e30dd8efa8 with identifier: LZ29816
2026-03-30 10:51:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b094d01-b9f0-5e55-87dc-35e30dd8efa8 with identifier: LZ29816 to the API
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-31T15:56:27Z',
 'fuel_type': 'diesel',
 'id': '3b094d01-b9f0-5e55-87dc-35e30dd8efa8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ29816',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 79388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-21',
 'seller_name': None,
 'title': 'Audi A6 Allroad 50 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ29816%27 HTTP/1.1" 200 None
2026-03-30 10:51:46 [auto1.de] INFO: Saving data for LZ29816: {'auction_closing_time': 1774972587.0, 'created_time': 1774464486.235881, 'last_price_update_time': 1774867906.261358}
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ29816') HTTP/1.1" 204 0
2026-03-30 10:51:46 [auto1.de] INFO: Found listing with ID: HE75386
2026-03-30 10:51:46 [auto1.de] INFO: Found listing with ID: WE43939
2026-03-30 10:51:46 [auto1.de] INFO: Found listing with ID: XD99934
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD99934%27 HTTP/1.1" 200 None
2026-03-30 10:51:46 [auto1.de] INFO: Scrape type for XD99934: 2
2026-03-30 10:51:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b2dca11-9a2e-55b5-b4be-ca980f402dfc with identifier: XD99934
2026-03-30 10:51:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b2dca11-9a2e-55b5-b4be-ca980f402dfc with scrape type 2
2026-03-30 10:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b2dca11-9a2e-55b5-b4be-ca980f402dfc with scrape type 2
2026-03-30 10:51:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b2dca11-9a2e-55b5-b4be-ca980f402dfc, identifier: XD99934
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_8de9b848c2fd2e710cc577ae1ffcb45c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_8de9b848c2fd2e710cc577ae1ffcb45c.jpg not downloaded yet
2026-03-30 10:51:46 [auto1.de] INFO: Found listing with ID: RM06492
2026-03-30 10:51:46 [auto1.de] INFO: Found listing with ID: UV24482
2026-03-30 10:51:46 [auto1.de] INFO: Found listing with ID: DL13353
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL13353%27 HTTP/1.1" 200 None
2026-03-30 10:51:46 [auto1.de] INFO: Scrape type for DL13353: 2
2026-03-30 10:51:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01693d3f-3a29-52d0-a1f1-7aa391bce9cd with identifier: DL13353
2026-03-30 10:51:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01693d3f-3a29-52d0-a1f1-7aa391bce9cd with scrape type 2
2026-03-30 10:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01693d3f-3a29-52d0-a1f1-7aa391bce9cd with scrape type 2
2026-03-30 10:51:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01693d3f-3a29-52d0-a1f1-7aa391bce9cd, identifier: DL13353
2026-03-30 10:51:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b2dca11-9a2e-55b5-b4be-ca980f402dfc with identifier: XD99934
2026-03-30 10:51:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b2dca11-9a2e-55b5-b4be-ca980f402dfc with identifier: XD99934
2026-03-30 10:51:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b2dca11-9a2e-55b5-b4be-ca980f402dfc with identifier: XD99934 to the API
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:12:30Z',
 'fuel_type': 'petrol',
 'id': '9b2dca11-9a2e-55b5-b4be-ca980f402dfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD99934',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 112175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-08',
 'seller_name': None,
 'title': 'Ford Mondeo 1.0 EcoBoost Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2016}
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD99934%27 HTTP/1.1" 200 None
2026-03-30 10:51:46 [auto1.de] INFO: Saving data for XD99934: {'auction_closing_time': 1774969950.0, 'created_time': 1774464738.643874, 'last_price_update_time': 1774867906.928968}
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD99934') HTTP/1.1" 204 0
2026-03-30 10:51:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01693d3f-3a29-52d0-a1f1-7aa391bce9cd with identifier: DL13353
2026-03-30 10:51:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01693d3f-3a29-52d0-a1f1-7aa391bce9cd with identifier: DL13353
2026-03-30 10:51:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01693d3f-3a29-52d0-a1f1-7aa391bce9cd with identifier: DL13353 to the API
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:16:13Z',
 'fuel_type': 'diesel',
 'id': '01693d3f-3a29-52d0-a1f1-7aa391bce9cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL13353',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 243341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-27',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL13353%27 HTTP/1.1" 200 None
2026-03-30 10:51:47 [auto1.de] INFO: Saving data for DL13353: {'auction_closing_time': 1774970173.0, 'created_time': 1773725437.183091, 'last_price_update_time': 1774867907.41432}
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL13353') HTTP/1.1" 204 0
2026-03-30 10:51:47 [auto1.de] INFO: Found listing with ID: EF86666
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF86666%27 HTTP/1.1" 200 None
2026-03-30 10:51:47 [auto1.de] INFO: Scrape type for EF86666: 2
2026-03-30 10:51:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a00bf093-0cea-5fa8-9750-54f295388ac2 with identifier: EF86666
2026-03-30 10:51:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a00bf093-0cea-5fa8-9750-54f295388ac2 with scrape type 2
2026-03-30 10:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a00bf093-0cea-5fa8-9750-54f295388ac2 with scrape type 2
2026-03-30 10:51:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a00bf093-0cea-5fa8-9750-54f295388ac2, identifier: EF86666
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_334509ec17d80a9baeeefb1bc63ebf20.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_334509ec17d80a9baeeefb1bc63ebf20.jpg not downloaded yet
2026-03-30 10:51:47 [auto1.de] INFO: Found listing with ID: VJ42576
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ42576%27 HTTP/1.1" 200 None
2026-03-30 10:51:47 [auto1.de] INFO: Scrape type for VJ42576: 2
2026-03-30 10:51:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f30a1471-8cbe-5d17-afbf-e34ac3b8348d with identifier: VJ42576
2026-03-30 10:51:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f30a1471-8cbe-5d17-afbf-e34ac3b8348d with scrape type 2
2026-03-30 10:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f30a1471-8cbe-5d17-afbf-e34ac3b8348d with scrape type 2
2026-03-30 10:51:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f30a1471-8cbe-5d17-afbf-e34ac3b8348d, identifier: VJ42576
2026-03-30 10:51:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a00bf093-0cea-5fa8-9750-54f295388ac2 with identifier: EF86666
2026-03-30 10:51:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a00bf093-0cea-5fa8-9750-54f295388ac2 with identifier: EF86666
2026-03-30 10:51:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a00bf093-0cea-5fa8-9750-54f295388ac2 with identifier: EF86666 to the API
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:13:42Z',
 'fuel_type': 'diesel',
 'id': 'a00bf093-0cea-5fa8-9750-54f295388ac2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF86666',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 318563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-17',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro Design',
 'transmission': 'automatic',
 'trim': 'quattro Design',
 'year': 2016}
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF86666%27 HTTP/1.1" 200 None
2026-03-30 10:51:48 [auto1.de] INFO: Saving data for EF86666: {'auction_closing_time': 1774970022.0, 'created_time': 1774378073.565594, 'last_price_update_time': 1774867908.056987}
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF86666') HTTP/1.1" 204 0
2026-03-30 10:51:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f30a1471-8cbe-5d17-afbf-e34ac3b8348d with identifier: VJ42576
2026-03-30 10:51:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f30a1471-8cbe-5d17-afbf-e34ac3b8348d with identifier: VJ42576
2026-03-30 10:51:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f30a1471-8cbe-5d17-afbf-e34ac3b8348d with identifier: VJ42576 to the API
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:21:44Z',
 'fuel_type': 'petrol',
 'id': 'f30a1471-8cbe-5d17-afbf-e34ac3b8348d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ42576',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 121791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-28',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2016}
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ42576%27 HTTP/1.1" 200 None
2026-03-30 10:51:48 [auto1.de] INFO: Saving data for VJ42576: {'auction_closing_time': 1774970504.0, 'created_time': 1774435387.830603, 'last_price_update_time': 1774867908.465552}
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ42576') HTTP/1.1" 204 0
2026-03-30 10:51:48 [auto1.de] INFO: Found listing with ID: FC08101
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC08101%27 HTTP/1.1" 200 None
2026-03-30 10:51:48 [auto1.de] INFO: Scrape type for FC08101: 2
2026-03-30 10:51:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e1b5575-0fc8-5b7e-b826-396fbda2a6c0 with identifier: FC08101
2026-03-30 10:51:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e1b5575-0fc8-5b7e-b826-396fbda2a6c0 with scrape type 2
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e1b5575-0fc8-5b7e-b826-396fbda2a6c0 with scrape type 2
2026-03-30 10:51:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e1b5575-0fc8-5b7e-b826-396fbda2a6c0, identifier: FC08101
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_aef45aebd88e241f315784ed549184b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_aef45aebd88e241f315784ed549184b5.jpg not downloaded yet
2026-03-30 10:51:48 [auto1.de] INFO: Found listing with ID: PH19669
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH19669%27 HTTP/1.1" 200 None
2026-03-30 10:51:48 [auto1.de] INFO: Scrape type for PH19669: 2
2026-03-30 10:51:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef0a063a-a3bf-5256-8f49-08bce6a73d4a with identifier: PH19669
2026-03-30 10:51:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef0a063a-a3bf-5256-8f49-08bce6a73d4a with scrape type 2
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef0a063a-a3bf-5256-8f49-08bce6a73d4a with scrape type 2
2026-03-30 10:51:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef0a063a-a3bf-5256-8f49-08bce6a73d4a, identifier: PH19669
2026-03-30 10:51:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e1b5575-0fc8-5b7e-b826-396fbda2a6c0 with identifier: FC08101
2026-03-30 10:51:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e1b5575-0fc8-5b7e-b826-396fbda2a6c0 with identifier: FC08101
2026-03-30 10:51:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e1b5575-0fc8-5b7e-b826-396fbda2a6c0 with identifier: FC08101 to the API
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:11:05Z',
 'fuel_type': 'petrol',
 'id': '7e1b5575-0fc8-5b7e-b826-396fbda2a6c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC08101',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 141707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-05',
 'seller_name': None,
 'title': 'Porsche Macan Basis',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC08101%27 HTTP/1.1" 200 None
2026-03-30 10:51:49 [auto1.de] INFO: Saving data for FC08101: {'auction_closing_time': 1774969865.0, 'created_time': 1773306462.401286, 'last_price_update_time': 1774867909.178933}
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC08101') HTTP/1.1" 204 0
2026-03-30 10:51:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef0a063a-a3bf-5256-8f49-08bce6a73d4a with identifier: PH19669
2026-03-30 10:51:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef0a063a-a3bf-5256-8f49-08bce6a73d4a with identifier: PH19669
2026-03-30 10:51:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef0a063a-a3bf-5256-8f49-08bce6a73d4a with identifier: PH19669 to the API
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:03:12Z',
 'fuel_type': 'petrol',
 'id': 'ef0a063a-a3bf-5256-8f49-08bce6a73d4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH19669',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 63704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-25',
 'seller_name': None,
 'title': 'Suzuki Swift 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2014}
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH19669%27 HTTP/1.1" 200 None
2026-03-30 10:51:49 [auto1.de] INFO: Saving data for PH19669: {'auction_closing_time': 1774969392.0, 'created_time': 1773774707.980445, 'last_price_update_time': 1774867909.532572}
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH19669') HTTP/1.1" 204 0
2026-03-30 10:51:49 [auto1.de] INFO: Found listing with ID: BL44244
2026-03-30 10:51:49 [auto1.de] INFO: Found listing with ID: UU71497
2026-03-30 10:51:49 [auto1.de] INFO: Found listing with ID: SH34728
2026-03-30 10:51:49 [auto1.de] INFO: Found listing with ID: JU51054
2026-03-30 10:51:49 [auto1.de] INFO: Found listing with ID: GR60102
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR60102%27 HTTP/1.1" 200 None
2026-03-30 10:51:49 [auto1.de] INFO: Scrape type for GR60102: 2
2026-03-30 10:51:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 903c1fba-081d-5369-8f6f-c25f5b7c12b1 with identifier: GR60102
2026-03-30 10:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 903c1fba-081d-5369-8f6f-c25f5b7c12b1 with scrape type 2
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 903c1fba-081d-5369-8f6f-c25f5b7c12b1 with scrape type 2
2026-03-30 10:51:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 903c1fba-081d-5369-8f6f-c25f5b7c12b1, identifier: GR60102
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_3399441e2bac138de34c49011f067bba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_3399441e2bac138de34c49011f067bba.jpg not downloaded yet
2026-03-30 10:51:49 [auto1.de] INFO: Found listing with ID: FV21228
2026-03-30 10:51:49 [auto1.de] INFO: Found listing with ID: FT70246
2026-03-30 10:51:49 [auto1.de] INFO: Found listing with ID: YZ14429
2026-03-30 10:51:49 [auto1.de] INFO: Found listing with ID: BZ51273
2026-03-30 10:51:49 [auto1.de] INFO: Found listing with ID: SR93888
2026-03-30 10:51:49 [auto1.de] INFO: Found listing with ID: WW56601
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW56601%27 HTTP/1.1" 200 None
2026-03-30 10:51:49 [auto1.de] INFO: Scrape type for WW56601: 2
2026-03-30 10:51:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c105db9-9dfa-5971-9040-6165fa03dbaa with identifier: WW56601
2026-03-30 10:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c105db9-9dfa-5971-9040-6165fa03dbaa with scrape type 2
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c105db9-9dfa-5971-9040-6165fa03dbaa with scrape type 2
2026-03-30 10:51:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c105db9-9dfa-5971-9040-6165fa03dbaa, identifier: WW56601
2026-03-30 10:51:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 903c1fba-081d-5369-8f6f-c25f5b7c12b1 with identifier: GR60102
2026-03-30 10:51:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 903c1fba-081d-5369-8f6f-c25f5b7c12b1 with identifier: GR60102
2026-03-30 10:51:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 903c1fba-081d-5369-8f6f-c25f5b7c12b1 with identifier: GR60102 to the API
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-31T15:41:14Z',
 'fuel_type': 'petrol',
 'id': '903c1fba-081d-5369-8f6f-c25f5b7c12b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR60102',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 26833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-27',
 'seller_name': None,
 'title': 'BMW 2er M235i Gran Coupe xDrive Color Vision',
 'transmission': 'automatic',
 'trim': 'xDrive Color Vision',
 'year': 2024}
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR60102%27 HTTP/1.1" 200 None
2026-03-30 10:51:50 [auto1.de] INFO: Saving data for GR60102: {'auction_closing_time': 1774971674.0, 'created_time': 1773342693.856961, 'last_price_update_time': 1774867910.180486}
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR60102') HTTP/1.1" 204 0
2026-03-30 10:51:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c105db9-9dfa-5971-9040-6165fa03dbaa with identifier: WW56601
2026-03-30 10:51:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c105db9-9dfa-5971-9040-6165fa03dbaa with identifier: WW56601
2026-03-30 10:51:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c105db9-9dfa-5971-9040-6165fa03dbaa with identifier: WW56601 to the API
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:32:54Z',
 'fuel_type': 'diesel',
 'id': '1c105db9-9dfa-5971-9040-6165fa03dbaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW56601',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 248559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-27',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueTEC Avantgarde',
 'year': 2014}
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW56601%27 HTTP/1.1" 200 None
2026-03-30 10:51:50 [auto1.de] INFO: Saving data for WW56601: {'auction_closing_time': 1774971174.0, 'created_time': 1774463752.715097, 'last_price_update_time': 1774867910.605204}
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW56601') HTTP/1.1" 204 0
2026-03-30 10:51:50 [auto1.de] INFO: Found listing with ID: CA99872
2026-03-30 10:51:50 [auto1.de] INFO: Found listing with ID: BY01569
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY01569%27 HTTP/1.1" 200 None
2026-03-30 10:51:50 [auto1.de] INFO: Scrape type for BY01569: 2
2026-03-30 10:51:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18ecec6b-3016-586a-a1fa-fb4be702c221 with identifier: BY01569
2026-03-30 10:51:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18ecec6b-3016-586a-a1fa-fb4be702c221 with scrape type 2
2026-03-30 10:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18ecec6b-3016-586a-a1fa-fb4be702c221 with scrape type 2
2026-03-30 10:51:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18ecec6b-3016-586a-a1fa-fb4be702c221, identifier: BY01569
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_e1da61d54757c8d2399983708686f501.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_e1da61d54757c8d2399983708686f501.jpg not downloaded yet
2026-03-30 10:51:50 [auto1.de] INFO: Found listing with ID: XT31458
2026-03-30 10:51:50 [auto1.de] INFO: Found listing with ID: FU70567
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU70567%27 HTTP/1.1" 200 None
2026-03-30 10:51:50 [auto1.de] INFO: Scrape type for FU70567: 2
2026-03-30 10:51:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19689b02-d978-562c-ae3f-434682fbfcb6 with identifier: FU70567
2026-03-30 10:51:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19689b02-d978-562c-ae3f-434682fbfcb6 with scrape type 2
2026-03-30 10:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19689b02-d978-562c-ae3f-434682fbfcb6 with scrape type 2
2026-03-30 10:51:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19689b02-d978-562c-ae3f-434682fbfcb6, identifier: FU70567
2026-03-30 10:51:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18ecec6b-3016-586a-a1fa-fb4be702c221 with identifier: BY01569
2026-03-30 10:51:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18ecec6b-3016-586a-a1fa-fb4be702c221 with identifier: BY01569
2026-03-30 10:51:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18ecec6b-3016-586a-a1fa-fb4be702c221 with identifier: BY01569 to the API
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:14:10Z',
 'fuel_type': 'petrol',
 'id': '18ecec6b-3016-586a-a1fa-fb4be702c221',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY01569',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 76727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-05-21',
 'seller_name': None,
 'title': 'Opel Astra 1.8 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2000}
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY01569%27 HTTP/1.1" 200 None
2026-03-30 10:51:51 [auto1.de] INFO: Saving data for BY01569: {'auction_closing_time': 1774970050.0, 'created_time': 1774435065.662434, 'last_price_update_time': 1774867911.214161}
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY01569') HTTP/1.1" 204 0
2026-03-30 10:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19689b02-d978-562c-ae3f-434682fbfcb6 with identifier: FU70567
2026-03-30 10:51:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19689b02-d978-562c-ae3f-434682fbfcb6 with identifier: FU70567
2026-03-30 10:51:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19689b02-d978-562c-ae3f-434682fbfcb6 with identifier: FU70567 to the API
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:15:28Z',
 'fuel_type': 'petrol',
 'id': '19689b02-d978-562c-ae3f-434682fbfcb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU70567',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 113967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-17',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU70567%27 HTTP/1.1" 200 None
2026-03-30 10:51:51 [auto1.de] INFO: Saving data for FU70567: {'auction_closing_time': 1774970128.0, 'created_time': 1773133142.308483, 'last_price_update_time': 1774867911.555037}
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU70567') HTTP/1.1" 204 0
2026-03-30 10:51:51 [auto1.de] INFO: Found listing with ID: XA03133
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA03133%27 HTTP/1.1" 200 None
2026-03-30 10:51:51 [auto1.de] INFO: Scrape type for XA03133: 2
2026-03-30 10:51:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 426fa4b6-e96f-5016-8075-db0a725ca2af with identifier: XA03133
2026-03-30 10:51:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 426fa4b6-e96f-5016-8075-db0a725ca2af with scrape type 2
2026-03-30 10:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 426fa4b6-e96f-5016-8075-db0a725ca2af with scrape type 2
2026-03-30 10:51:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 426fa4b6-e96f-5016-8075-db0a725ca2af, identifier: XA03133
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_ee7c91945f65c2299acf00b5b55b25b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_ee7c91945f65c2299acf00b5b55b25b0.jpg not downloaded yet
2026-03-30 10:51:51 [auto1.de] INFO: Found listing with ID: JA92497
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA92497%27 HTTP/1.1" 200 None
2026-03-30 10:51:51 [auto1.de] INFO: Scrape type for JA92497: 0
2026-03-30 10:51:51 [auto1.de] INFO: Found listing with ID: UU37605
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU37605%27 HTTP/1.1" 200 None
2026-03-30 10:51:51 [auto1.de] INFO: Scrape type for UU37605: 0
2026-03-30 10:51:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 426fa4b6-e96f-5016-8075-db0a725ca2af with identifier: XA03133
2026-03-30 10:51:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 426fa4b6-e96f-5016-8075-db0a725ca2af with identifier: XA03133
2026-03-30 10:51:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 426fa4b6-e96f-5016-8075-db0a725ca2af with identifier: XA03133 to the API
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:39:48Z',
 'fuel_type': 'diesel',
 'id': '426fa4b6-e96f-5016-8075-db0a725ca2af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA03133',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 112055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-24',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2019}
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA03133%27 HTTP/1.1" 200 None
2026-03-30 10:51:52 [auto1.de] INFO: Saving data for XA03133: {'auction_closing_time': 1774971588.0, 'created_time': 1773686324.855139, 'last_price_update_time': 1774867912.354594}
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA03133') HTTP/1.1" 204 0
2026-03-30 10:51:52 [auto1.de] INFO: Found listing with ID: VH89882
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH89882%27 HTTP/1.1" 200 None
2026-03-30 10:51:52 [auto1.de] INFO: Scrape type for VH89882: 2
2026-03-30 10:51:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0c7cbfa-09f1-5cee-a1e9-66a7d4359d7c with identifier: VH89882
2026-03-30 10:51:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0c7cbfa-09f1-5cee-a1e9-66a7d4359d7c with scrape type 2
2026-03-30 10:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0c7cbfa-09f1-5cee-a1e9-66a7d4359d7c with scrape type 2
2026-03-30 10:51:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0c7cbfa-09f1-5cee-a1e9-66a7d4359d7c, identifier: VH89882
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_5b0d2ace4c8ad9a749c1ce5ce5f3931e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_5b0d2ace4c8ad9a749c1ce5ce5f3931e.jpg not downloaded yet
2026-03-30 10:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL62864/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0c7cbfa-09f1-5cee-a1e9-66a7d4359d7c with identifier: VH89882
2026-03-30 10:51:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0c7cbfa-09f1-5cee-a1e9-66a7d4359d7c with identifier: VH89882
2026-03-30 10:51:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0c7cbfa-09f1-5cee-a1e9-66a7d4359d7c with identifier: VH89882 to the API
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:47:17Z',
 'fuel_type': 'hybrid',
 'id': 'c0c7cbfa-09f1-5cee-a1e9-66a7d4359d7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH89882',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 43944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-03',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.4 PHEV Intro Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Intro Edition 4WD',
 'year': 2019}
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH89882%27 HTTP/1.1" 200 None
2026-03-30 10:51:53 [auto1.de] INFO: Saving data for VH89882: {'auction_closing_time': 1774972037.0, 'created_time': 1774349574.235594, 'last_price_update_time': 1774867913.002028}
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH89882') HTTP/1.1" 204 0
2026-03-30 10:51:53 [auto1.de] INFO: Channel: 24h | Page: 37 | totalHits: 9508 | hits on page: 40
2026-03-30 10:51:53 [auto1.de] INFO: Found listing with ID: BH49655
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH49655%27 HTTP/1.1" 200 None
2026-03-30 10:51:53 [auto1.de] INFO: Scrape type for BH49655: 2
2026-03-30 10:51:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58b4d9da-be50-5cf4-9132-28bd31315764 with identifier: BH49655
2026-03-30 10:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b4d9da-be50-5cf4-9132-28bd31315764 with scrape type 2
2026-03-30 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58b4d9da-be50-5cf4-9132-28bd31315764 with scrape type 2
2026-03-30 10:51:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58b4d9da-be50-5cf4-9132-28bd31315764, identifier: BH49655
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_82ff64e8d711d5878e8930f486151ead.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_82ff64e8d711d5878e8930f486151ead.jpg not downloaded yet
2026-03-30 10:51:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58b4d9da-be50-5cf4-9132-28bd31315764 with identifier: BH49655
2026-03-30 10:51:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58b4d9da-be50-5cf4-9132-28bd31315764 with identifier: BH49655
2026-03-30 10:51:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58b4d9da-be50-5cf4-9132-28bd31315764 with identifier: BH49655 to the API
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:13:47Z',
 'fuel_type': 'petrol',
 'id': '58b4d9da-be50-5cf4-9132-28bd31315764',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH49655',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 85941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2015}
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH49655%27 HTTP/1.1" 200 None
2026-03-30 10:51:53 [auto1.de] INFO: Saving data for BH49655: {'auction_closing_time': 1774970027.0, 'created_time': 1773772231.381279, 'last_price_update_time': 1774867913.508884}
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH49655') HTTP/1.1" 204 0
2026-03-30 10:51:53 [auto1.de] INFO: Found listing with ID: CF23775
2026-03-30 10:51:53 [auto1.de] INFO: Found listing with ID: NR85731
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR85731%27 HTTP/1.1" 200 None
2026-03-30 10:51:53 [auto1.de] INFO: Scrape type for NR85731: 2
2026-03-30 10:51:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e67f052-d7bf-5f6b-b509-8128805f5e83 with identifier: NR85731
2026-03-30 10:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e67f052-d7bf-5f6b-b509-8128805f5e83 with scrape type 2
2026-03-30 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e67f052-d7bf-5f6b-b509-8128805f5e83 with scrape type 2
2026-03-30 10:51:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e67f052-d7bf-5f6b-b509-8128805f5e83, identifier: NR85731
2026-03-30 10:51:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:53 [auto1.de] INFO: Found listing with ID: NB15408
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB15408%27 HTTP/1.1" 200 None
2026-03-30 10:51:53 [auto1.de] INFO: Scrape type for NB15408: 2
2026-03-30 10:51:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7958ed9e-da97-5836-b983-22643892112a with identifier: NB15408
2026-03-30 10:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7958ed9e-da97-5836-b983-22643892112a with scrape type 2
2026-03-30 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7958ed9e-da97-5836-b983-22643892112a with scrape type 2
2026-03-30 10:51:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7958ed9e-da97-5836-b983-22643892112a, identifier: NB15408
2026-03-30 10:51:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e67f052-d7bf-5f6b-b509-8128805f5e83 with identifier: NR85731
2026-03-30 10:51:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e67f052-d7bf-5f6b-b509-8128805f5e83 with identifier: NR85731
2026-03-30 10:51:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e67f052-d7bf-5f6b-b509-8128805f5e83 with identifier: NR85731 to the API
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:01:48Z',
 'fuel_type': 'petrol',
 'id': '5e67f052-d7bf-5f6b-b509-8128805f5e83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR85731',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 239373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-25',
 'seller_name': None,
 'title': 'Honda Jazz 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR85731%27 HTTP/1.1" 200 None
2026-03-30 10:51:54 [auto1.de] INFO: Saving data for NR85731: {'auction_closing_time': 1774969308.0, 'created_time': 1773304842.747388, 'last_price_update_time': 1774867914.08828}
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR85731') HTTP/1.1" 204 0
2026-03-30 10:51:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7958ed9e-da97-5836-b983-22643892112a with identifier: NB15408
2026-03-30 10:51:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7958ed9e-da97-5836-b983-22643892112a with identifier: NB15408
2026-03-30 10:51:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7958ed9e-da97-5836-b983-22643892112a with identifier: NB15408 to the API
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:53:44Z',
 'fuel_type': 'petrol',
 'id': '7958ed9e-da97-5836-b983-22643892112a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB15408',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 90892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-06',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2017}
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB15408%27 HTTP/1.1" 200 None
2026-03-30 10:51:54 [auto1.de] INFO: Saving data for NB15408: {'auction_closing_time': 1774972424.0, 'created_time': 1774434902.741176, 'last_price_update_time': 1774867914.665893}
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB15408') HTTP/1.1" 204 0
2026-03-30 10:51:54 [auto1.de] INFO: Found listing with ID: WT43265
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT43265%27 HTTP/1.1" 200 None
2026-03-30 10:51:54 [auto1.de] INFO: Scrape type for WT43265: 2
2026-03-30 10:51:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8f3dbc6-fec7-53b7-8d6b-901e34ff2a76 with identifier: WT43265
2026-03-30 10:51:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8f3dbc6-fec7-53b7-8d6b-901e34ff2a76 with scrape type 2
2026-03-30 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8f3dbc6-fec7-53b7-8d6b-901e34ff2a76 with scrape type 2
2026-03-30 10:51:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8f3dbc6-fec7-53b7-8d6b-901e34ff2a76, identifier: WT43265
2026-03-30 10:51:54 [auto1.de] INFO: Found listing with ID: YY19012
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY19012%27 HTTP/1.1" 200 None
2026-03-30 10:51:54 [auto1.de] INFO: Scrape type for YY19012: 2
2026-03-30 10:51:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f53c598a-33e5-5147-9bd8-d2e31d5c66d5 with identifier: YY19012
2026-03-30 10:51:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f53c598a-33e5-5147-9bd8-d2e31d5c66d5 with scrape type 2
2026-03-30 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f53c598a-33e5-5147-9bd8-d2e31d5c66d5 with scrape type 2
2026-03-30 10:51:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f53c598a-33e5-5147-9bd8-d2e31d5c66d5, identifier: YY19012
2026-03-30 10:51:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8f3dbc6-fec7-53b7-8d6b-901e34ff2a76 with identifier: WT43265
2026-03-30 10:51:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8f3dbc6-fec7-53b7-8d6b-901e34ff2a76 with identifier: WT43265
2026-03-30 10:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8f3dbc6-fec7-53b7-8d6b-901e34ff2a76 with identifier: WT43265 to the API
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:20:00Z',
 'fuel_type': 'petrol',
 'id': 'f8f3dbc6-fec7-53b7-8d6b-901e34ff2a76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT43265',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Accord',
 'odometer': 198424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-27',
 'seller_name': None,
 'title': 'Honda Accord 2.4 VTEC Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2009}
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT43265%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [auto1.de] INFO: Saving data for WT43265: {'auction_closing_time': 1774970400.0, 'created_time': 1774377729.971869, 'last_price_update_time': 1774867915.289916}
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT43265') HTTP/1.1" 204 0
2026-03-30 10:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f53c598a-33e5-5147-9bd8-d2e31d5c66d5 with identifier: YY19012
2026-03-30 10:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f53c598a-33e5-5147-9bd8-d2e31d5c66d5 with identifier: YY19012
2026-03-30 10:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f53c598a-33e5-5147-9bd8-d2e31d5c66d5 with identifier: YY19012 to the API
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-31T15:51:28Z',
 'fuel_type': 'petrol',
 'id': 'f53c598a-33e5-5147-9bd8-d2e31d5c66d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY19012',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 90213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-28',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 Mild-Hybrid T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2019}
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY19012%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [auto1.de] INFO: Saving data for YY19012: {'auction_closing_time': 1774972288.0, 'created_time': 1773342732.168553, 'last_price_update_time': 1774867915.748423}
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY19012') HTTP/1.1" 204 0
2026-03-30 10:51:55 [auto1.de] INFO: Found listing with ID: XC24065
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC24065%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [auto1.de] INFO: Scrape type for XC24065: 2
2026-03-30 10:51:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d16f7d7-357d-5b2e-9187-321a70842f1b with identifier: XC24065
2026-03-30 10:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d16f7d7-357d-5b2e-9187-321a70842f1b with scrape type 2
2026-03-30 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d16f7d7-357d-5b2e-9187-321a70842f1b with scrape type 2
2026-03-30 10:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d16f7d7-357d-5b2e-9187-321a70842f1b, identifier: XC24065
2026-03-30 10:51:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:55 [auto1.de] INFO: Found listing with ID: SY34780
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY34780%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [auto1.de] INFO: Scrape type for SY34780: 1
2026-03-30 10:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d16f7d7-357d-5b2e-9187-321a70842f1b with identifier: XC24065
2026-03-30 10:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d16f7d7-357d-5b2e-9187-321a70842f1b with identifier: XC24065
2026-03-30 10:51:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d16f7d7-357d-5b2e-9187-321a70842f1b with identifier: XC24065 to the API
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:38:12Z',
 'fuel_type': 'petrol',
 'id': '4d16f7d7-357d-5b2e-9187-321a70842f1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC24065',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 224509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-05',
 'seller_name': None,
 'title': 'Mazda 5 1.8 Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2009}
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC24065%27 HTTP/1.1" 200 None
2026-03-30 10:51:56 [auto1.de] INFO: Saving data for XC24065: {'auction_closing_time': 1774971492.0, 'created_time': 1774377964.567367, 'last_price_update_time': 1774867916.275887}
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC24065') HTTP/1.1" 204 0
2026-03-30 10:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_3399441e2bac138de34c49011f067bba.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:56 [auto1.de] INFO: Found listing with ID: FF89334
2026-03-30 10:51:56 [auto1.de] INFO: Found listing with ID: WR85565
2026-03-30 10:51:56 [auto1.de] INFO: Found listing with ID: KN16725
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN16725%27 HTTP/1.1" 200 None
2026-03-30 10:51:56 [auto1.de] INFO: Scrape type for KN16725: 2
2026-03-30 10:51:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8d66b24-f931-58ca-860e-75259e6f27cf with identifier: KN16725
2026-03-30 10:51:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8d66b24-f931-58ca-860e-75259e6f27cf with scrape type 2
2026-03-30 10:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8d66b24-f931-58ca-860e-75259e6f27cf with scrape type 2
2026-03-30 10:51:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8d66b24-f931-58ca-860e-75259e6f27cf, identifier: KN16725
2026-03-30 10:51:56 [auto1.de] INFO: Found listing with ID: CS95663
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS95663%27 HTTP/1.1" 200 None
2026-03-30 10:51:56 [auto1.de] INFO: Scrape type for CS95663: 2
2026-03-30 10:51:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b63f0eb-749e-5425-8ac4-475fe98e2398 with identifier: CS95663
2026-03-30 10:51:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b63f0eb-749e-5425-8ac4-475fe98e2398 with scrape type 2
2026-03-30 10:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b63f0eb-749e-5425-8ac4-475fe98e2398 with scrape type 2
2026-03-30 10:51:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b63f0eb-749e-5425-8ac4-475fe98e2398, identifier: CS95663
2026-03-30 10:51:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8d66b24-f931-58ca-860e-75259e6f27cf with identifier: KN16725
2026-03-30 10:51:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8d66b24-f931-58ca-860e-75259e6f27cf with identifier: KN16725
2026-03-30 10:51:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8d66b24-f931-58ca-860e-75259e6f27cf with identifier: KN16725 to the API
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-31T15:49:26Z',
 'fuel_type': 'petrol',
 'id': 'a8d66b24-f931-58ca-860e-75259e6f27cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN16725',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 109326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-30',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.2 TCe Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2018}
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN16725%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [auto1.de] INFO: Saving data for KN16725: {'auction_closing_time': 1774972166.0, 'created_time': 1773227383.659892, 'last_price_update_time': 1774867917.02828}
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN16725') HTTP/1.1" 204 0
2026-03-30 10:51:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b63f0eb-749e-5425-8ac4-475fe98e2398 with identifier: CS95663
2026-03-30 10:51:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b63f0eb-749e-5425-8ac4-475fe98e2398 with identifier: CS95663
2026-03-30 10:51:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b63f0eb-749e-5425-8ac4-475fe98e2398 with identifier: CS95663 to the API
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-31T15:11:33Z',
 'fuel_type': 'petrol',
 'id': '0b63f0eb-749e-5425-8ac4-475fe98e2398',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS95663',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 90341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-27',
 'seller_name': None,
 'title': 'Hyundai i40 2.0 GDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS95663%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [auto1.de] INFO: Saving data for CS95663: {'auction_closing_time': 1774969893.0, 'created_time': 1774463671.449238, 'last_price_update_time': 1774867917.479698}
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS95663') HTTP/1.1" 204 0
2026-03-30 10:51:57 [auto1.de] INFO: Found listing with ID: LZ64363
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ64363%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [auto1.de] INFO: Scrape type for LZ64363: 2
2026-03-30 10:51:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfb8d71c-cc21-59e0-9541-4fe3d7740622 with identifier: LZ64363
2026-03-30 10:51:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfb8d71c-cc21-59e0-9541-4fe3d7740622 with scrape type 2
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfb8d71c-cc21-59e0-9541-4fe3d7740622 with scrape type 2
2026-03-30 10:51:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfb8d71c-cc21-59e0-9541-4fe3d7740622, identifier: LZ64363
2026-03-30 10:51:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SP29379> (referer: https://www.auto1.com/v1/car-details-view/SP29379/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:57 [auto1.de] INFO: Found listing with ID: JW06785
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW06785%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [auto1.de] INFO: Scrape type for JW06785: 2
2026-03-30 10:51:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac5aa01c-d438-5f69-89db-b0360022b764 with identifier: JW06785
2026-03-30 10:51:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac5aa01c-d438-5f69-89db-b0360022b764 with scrape type 2
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac5aa01c-d438-5f69-89db-b0360022b764 with scrape type 2
2026-03-30 10:51:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac5aa01c-d438-5f69-89db-b0360022b764, identifier: JW06785
2026-03-30 10:51:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfb8d71c-cc21-59e0-9541-4fe3d7740622 with identifier: LZ64363
2026-03-30 10:51:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfb8d71c-cc21-59e0-9541-4fe3d7740622 with identifier: LZ64363
2026-03-30 10:51:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfb8d71c-cc21-59e0-9541-4fe3d7740622 with identifier: LZ64363 to the API
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:31:07Z',
 'fuel_type': 'diesel',
 'id': 'cfb8d71c-cc21-59e0-9541-4fe3d7740622',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ64363',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 153918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-08',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI ultra',
 'transmission': 'manual',
 'trim': 'ultra',
 'year': 2016}
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ64363%27 HTTP/1.1" 200 None
2026-03-30 10:51:58 [auto1.de] INFO: Saving data for LZ64363: {'auction_closing_time': 1774971067.0, 'created_time': 1773226343.227228, 'last_price_update_time': 1774867918.067494}
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ64363') HTTP/1.1" 204 0
2026-03-30 10:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_5b0d2ace4c8ad9a749c1ce5ce5f3931e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac5aa01c-d438-5f69-89db-b0360022b764 with identifier: JW06785
2026-03-30 10:51:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac5aa01c-d438-5f69-89db-b0360022b764 with identifier: JW06785
2026-03-30 10:51:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac5aa01c-d438-5f69-89db-b0360022b764 with identifier: JW06785 to the API
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-31T15:40:23Z',
 'fuel_type': 'diesel',
 'id': 'ac5aa01c-d438-5f69-89db-b0360022b764',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW06785',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 214019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-15',
 'seller_name': None,
 'title': 'Jaguar E-Pace D240 R-Dynamic HSE AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic HSE AWD',
 'year': 2019}
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW06785%27 HTTP/1.1" 200 None
2026-03-30 10:51:58 [auto1.de] INFO: Saving data for JW06785: {'auction_closing_time': 1774971623.0, 'created_time': 1774423842.922107, 'last_price_update_time': 1774867918.458707}
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW06785') HTTP/1.1" 204 0
2026-03-30 10:51:58 [auto1.de] INFO: Found listing with ID: GC53073
2026-03-30 10:51:58 [auto1.de] INFO: Found listing with ID: AF34629
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF34629%27 HTTP/1.1" 200 None
2026-03-30 10:51:58 [auto1.de] INFO: Scrape type for AF34629: 2
2026-03-30 10:51:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 389b4e65-1edb-5e16-87bf-f83014ebf8a5 with identifier: AF34629
2026-03-30 10:51:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 389b4e65-1edb-5e16-87bf-f83014ebf8a5 with scrape type 2
2026-03-30 10:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 389b4e65-1edb-5e16-87bf-f83014ebf8a5 with scrape type 2
2026-03-30 10:51:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 389b4e65-1edb-5e16-87bf-f83014ebf8a5, identifier: AF34629
2026-03-30 10:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4149ad0>
2026-03-30 10:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_3399441e2bac138de34c49011f067bba.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_3399441e2bac138de34c49011f067bba.jpg saved to cache
2026-03-30 10:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f120c1b-89ec-51f3-b5b8-b024d6f3387e
2026-03-30 10:51:58 [auto1.de] INFO: Found listing with ID: JU02608
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU02608%27 HTTP/1.1" 200 None
2026-03-30 10:51:58 [auto1.de] INFO: Scrape type for JU02608: 2
2026-03-30 10:51:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36ebf5dc-9e33-53c7-bb8c-c2c9138826b2 with identifier: JU02608
2026-03-30 10:51:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36ebf5dc-9e33-53c7-bb8c-c2c9138826b2 with scrape type 2
2026-03-30 10:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36ebf5dc-9e33-53c7-bb8c-c2c9138826b2 with scrape type 2
2026-03-30 10:51:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36ebf5dc-9e33-53c7-bb8c-c2c9138826b2, identifier: JU02608
2026-03-30 10:51:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 389b4e65-1edb-5e16-87bf-f83014ebf8a5 with identifier: AF34629
2026-03-30 10:51:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 389b4e65-1edb-5e16-87bf-f83014ebf8a5 with identifier: AF34629
2026-03-30 10:51:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 389b4e65-1edb-5e16-87bf-f83014ebf8a5 with identifier: AF34629 to the API
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:02:53Z',
 'fuel_type': 'petrol',
 'id': '389b4e65-1edb-5e16-87bf-f83014ebf8a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF34629',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 132891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-04-09',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Njoy',
 'transmission': 'manual',
 'trim': 'Njoy',
 'year': 2003}
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF34629%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [auto1.de] INFO: Saving data for AF34629: {'auction_closing_time': 1774969373.0, 'created_time': 1774379107.4065, 'last_price_update_time': 1774867919.058921}
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF34629') HTTP/1.1" 204 0
2026-03-30 10:51:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36ebf5dc-9e33-53c7-bb8c-c2c9138826b2 with identifier: JU02608
2026-03-30 10:51:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36ebf5dc-9e33-53c7-bb8c-c2c9138826b2 with identifier: JU02608
2026-03-30 10:51:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36ebf5dc-9e33-53c7-bb8c-c2c9138826b2 with identifier: JU02608 to the API
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:55:27Z',
 'fuel_type': 'diesel',
 'id': '36ebf5dc-9e33-53c7-bb8c-c2c9138826b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU02608',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 205626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-25',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 2.0 TDI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU02608%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [auto1.de] INFO: Saving data for JU02608: {'auction_closing_time': 1774972527.0, 'created_time': 1773428936.968529, 'last_price_update_time': 1774867919.586058}
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU02608') HTTP/1.1" 204 0
2026-03-30 10:51:59 [auto1.de] INFO: Found listing with ID: KZ96576
2026-03-30 10:51:59 [auto1.de] INFO: Found listing with ID: MP85459
2026-03-30 10:51:59 [auto1.de] INFO: Found listing with ID: FT42679
2026-03-30 10:51:59 [auto1.de] INFO: Found listing with ID: GP04405
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP04405%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [auto1.de] INFO: Scrape type for GP04405: 2
2026-03-30 10:51:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e444ff81-6908-58c1-83e2-dc2be469d110 with identifier: GP04405
2026-03-30 10:51:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e444ff81-6908-58c1-83e2-dc2be469d110 with scrape type 2
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e444ff81-6908-58c1-83e2-dc2be469d110 with scrape type 2
2026-03-30 10:51:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e444ff81-6908-58c1-83e2-dc2be469d110, identifier: GP04405
2026-03-30 10:51:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7aef1684-8f11-51f3-b018-9f199981ee63 with identifier: SP29379
2026-03-30 10:51:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aef1684-8f11-51f3-b018-9f199981ee63 with scrape type 1
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7aef1684-8f11-51f3-b018-9f199981ee63
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_9a8aba7e8cc5cbee4325910ce0a32645.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_9a8aba7e8cc5cbee4325910ce0a32645.jpg not downloaded yet
2026-03-30 10:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_82ff64e8d711d5878e8930f486151ead.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:59 [auto1.de] INFO: Found listing with ID: AV28159
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV28159%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [auto1.de] INFO: Scrape type for AV28159: 2
2026-03-30 10:51:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 004e921a-7f4b-52f9-8439-f3181f3e57e0 with identifier: AV28159
2026-03-30 10:51:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 004e921a-7f4b-52f9-8439-f3181f3e57e0 with scrape type 2
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 004e921a-7f4b-52f9-8439-f3181f3e57e0 with scrape type 2
2026-03-30 10:51:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 004e921a-7f4b-52f9-8439-f3181f3e57e0, identifier: AV28159
2026-03-30 10:51:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e444ff81-6908-58c1-83e2-dc2be469d110 with identifier: GP04405
2026-03-30 10:51:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e444ff81-6908-58c1-83e2-dc2be469d110 with identifier: GP04405
2026-03-30 10:51:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e444ff81-6908-58c1-83e2-dc2be469d110 with identifier: GP04405 to the API
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:20:08Z',
 'fuel_type': 'petrol',
 'id': 'e444ff81-6908-58c1-83e2-dc2be469d110',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP04405',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 129457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-06-27',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Fresh',
 'transmission': 'manual',
 'trim': 'Fresh',
 'year': 2004}
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP04405%27 HTTP/1.1" 200 None
2026-03-30 10:52:00 [auto1.de] INFO: Saving data for GP04405: {'auction_closing_time': 1774970408.0, 'created_time': 1774467938.931791, 'last_price_update_time': 1774867920.273546}
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP04405') HTTP/1.1" 204 0
2026-03-30 10:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 004e921a-7f4b-52f9-8439-f3181f3e57e0 with identifier: AV28159
2026-03-30 10:52:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 004e921a-7f4b-52f9-8439-f3181f3e57e0 with identifier: AV28159
2026-03-30 10:52:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 004e921a-7f4b-52f9-8439-f3181f3e57e0 with identifier: AV28159 to the API
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 199,
 'expiration_date': '2026-03-31T15:07:25Z',
 'fuel_type': 'diesel',
 'id': '004e921a-7f4b-52f9-8439-f3181f3e57e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV28159',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 171199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Generation Six 4Motion',
 'transmission': 'automatic',
 'trim': 'Generation Six 4Motion',
 'year': 2018}
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV28159%27 HTTP/1.1" 200 None
2026-03-30 10:52:00 [auto1.de] INFO: Saving data for AV28159: {'auction_closing_time': 1774969645.0, 'created_time': 1773773697.884329, 'last_price_update_time': 1774867920.602849}
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV28159') HTTP/1.1" 204 0
2026-03-30 10:52:00 [auto1.de] INFO: Found listing with ID: AJ12624
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ12624%27 HTTP/1.1" 200 None
2026-03-30 10:52:00 [auto1.de] INFO: Scrape type for AJ12624: 2
2026-03-30 10:52:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42f0b6a7-f4b8-5f63-a0a1-fd741030db97 with identifier: AJ12624
2026-03-30 10:52:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42f0b6a7-f4b8-5f63-a0a1-fd741030db97 with scrape type 2
2026-03-30 10:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42f0b6a7-f4b8-5f63-a0a1-fd741030db97 with scrape type 2
2026-03-30 10:52:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42f0b6a7-f4b8-5f63-a0a1-fd741030db97, identifier: AJ12624
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_ca49e6d9c0d7ad13bcd7a50e3a207f09.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_ca49e6d9c0d7ad13bcd7a50e3a207f09.jpg not downloaded yet
2026-03-30 10:52:00 [auto1.de] INFO: Found listing with ID: VN58412
2026-03-30 10:52:00 [auto1.de] INFO: Found listing with ID: YC45625
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC45625%27 HTTP/1.1" 200 None
2026-03-30 10:52:00 [auto1.de] INFO: Scrape type for YC45625: 2
2026-03-30 10:52:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d750b3a2-fd9a-5fa9-aa87-822ecf59720e with identifier: YC45625
2026-03-30 10:52:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d750b3a2-fd9a-5fa9-aa87-822ecf59720e with scrape type 2
2026-03-30 10:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d750b3a2-fd9a-5fa9-aa87-822ecf59720e with scrape type 2
2026-03-30 10:52:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d750b3a2-fd9a-5fa9-aa87-822ecf59720e, identifier: YC45625
2026-03-30 10:52:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42f0b6a7-f4b8-5f63-a0a1-fd741030db97 with identifier: AJ12624
2026-03-30 10:52:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42f0b6a7-f4b8-5f63-a0a1-fd741030db97 with identifier: AJ12624
2026-03-30 10:52:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42f0b6a7-f4b8-5f63-a0a1-fd741030db97 with identifier: AJ12624 to the API
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:28:46Z',
 'fuel_type': 'diesel',
 'id': '42f0b6a7-f4b8-5f63-a0a1-fd741030db97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ12624',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 229174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-31',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ12624%27 HTTP/1.1" 200 None
2026-03-30 10:52:01 [auto1.de] INFO: Saving data for AJ12624: {'auction_closing_time': 1774970926.0, 'created_time': 1773725427.353394, 'last_price_update_time': 1774867921.196903}
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ12624') HTTP/1.1" 204 0
2026-03-30 10:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee32210>
2026-03-30 10:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_5b0d2ace4c8ad9a749c1ce5ce5f3931e.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_5b0d2ace4c8ad9a749c1ce5ce5f3931e.jpg saved to cache
2026-03-30 10:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f120c1b-89ec-51f3-b5b8-b024d6f3387e
2026-03-30 10:52:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d750b3a2-fd9a-5fa9-aa87-822ecf59720e with identifier: YC45625
2026-03-30 10:52:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d750b3a2-fd9a-5fa9-aa87-822ecf59720e with identifier: YC45625
2026-03-30 10:52:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d750b3a2-fd9a-5fa9-aa87-822ecf59720e with identifier: YC45625 to the API
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:36:54Z',
 'fuel_type': 'diesel',
 'id': 'd750b3a2-fd9a-5fa9-aa87-822ecf59720e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC45625',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 143637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-27',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI SportLine',
 'transmission': 'automatic',
 'trim': 'SportLine',
 'year': 2017}
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC45625%27 HTTP/1.1" 200 None
2026-03-30 10:52:01 [auto1.de] INFO: Saving data for YC45625: {'auction_closing_time': 1774971414.0, 'created_time': 1773467619.649978, 'last_price_update_time': 1774867921.725606}
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC45625') HTTP/1.1" 204 0
2026-03-30 10:52:01 [auto1.de] INFO: Found listing with ID: ER70065
2026-03-30 10:52:01 [auto1.de] INFO: Found listing with ID: NF60730
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF60730%27 HTTP/1.1" 200 None
2026-03-30 10:52:01 [auto1.de] INFO: Scrape type for NF60730: 2
2026-03-30 10:52:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65421324-caa3-5e72-becc-aba2f6041547 with identifier: NF60730
2026-03-30 10:52:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65421324-caa3-5e72-becc-aba2f6041547 with scrape type 2
2026-03-30 10:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65421324-caa3-5e72-becc-aba2f6041547 with scrape type 2
2026-03-30 10:52:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65421324-caa3-5e72-becc-aba2f6041547, identifier: NF60730
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_cd19884c29608978dac17fdf2398967a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_cd19884c29608978dac17fdf2398967a.jpg not downloaded yet
2026-03-30 10:52:01 [auto1.de] INFO: Found listing with ID: NP12620
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP12620%27 HTTP/1.1" 200 None
2026-03-30 10:52:01 [auto1.de] INFO: Scrape type for NP12620: 2
2026-03-30 10:52:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc8ade22-1cb5-5bbb-96a2-921880910c32 with identifier: NP12620
2026-03-30 10:52:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc8ade22-1cb5-5bbb-96a2-921880910c32 with scrape type 2
2026-03-30 10:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc8ade22-1cb5-5bbb-96a2-921880910c32 with scrape type 2
2026-03-30 10:52:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc8ade22-1cb5-5bbb-96a2-921880910c32, identifier: NP12620
2026-03-30 10:52:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65421324-caa3-5e72-becc-aba2f6041547 with identifier: NF60730
2026-03-30 10:52:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65421324-caa3-5e72-becc-aba2f6041547 with identifier: NF60730
2026-03-30 10:52:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65421324-caa3-5e72-becc-aba2f6041547 with identifier: NF60730 to the API
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-31T15:41:23Z',
 'fuel_type': 'petrol',
 'id': '65421324-caa3-5e72-becc-aba2f6041547',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF60730',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 120293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-22',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2017}
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF60730%27 HTTP/1.1" 200 None
2026-03-30 10:52:02 [auto1.de] INFO: Saving data for NF60730: {'auction_closing_time': 1774971683.0, 'created_time': 1774350205.340037, 'last_price_update_time': 1774867922.50334}
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF60730') HTTP/1.1" 204 0
2026-03-30 10:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL62864> (referer: https://www.auto1.com/v1/car-details-view/RL62864/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc8ade22-1cb5-5bbb-96a2-921880910c32 with identifier: NP12620
2026-03-30 10:52:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc8ade22-1cb5-5bbb-96a2-921880910c32 with identifier: NP12620
2026-03-30 10:52:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc8ade22-1cb5-5bbb-96a2-921880910c32 with identifier: NP12620 to the API
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:56:23Z',
 'fuel_type': 'petrol',
 'id': 'cc8ade22-1cb5-5bbb-96a2-921880910c32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP12620',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 75277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-10',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 220 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2018}
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP12620%27 HTTP/1.1" 200 None
2026-03-30 10:52:03 [auto1.de] INFO: Saving data for NP12620: {'auction_closing_time': 1774972583.0, 'created_time': 1773305614.420034, 'last_price_update_time': 1774867923.471236}
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP12620') HTTP/1.1" 204 0
2026-03-30 10:52:03 [auto1.de] INFO: Found listing with ID: DU13995
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13995%27 HTTP/1.1" 200 None
2026-03-30 10:52:03 [auto1.de] INFO: Scrape type for DU13995: 2
2026-03-30 10:52:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebc9efb4-df04-5936-bf0a-88c7eae0b775 with identifier: DU13995
2026-03-30 10:52:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebc9efb4-df04-5936-bf0a-88c7eae0b775 with scrape type 2
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebc9efb4-df04-5936-bf0a-88c7eae0b775 with scrape type 2
2026-03-30 10:52:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebc9efb4-df04-5936-bf0a-88c7eae0b775, identifier: DU13995
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_1585ad229a9bf2edc1416a1bd743b880.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_1585ad229a9bf2edc1416a1bd743b880.jpg not downloaded yet
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeedda50>
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_82ff64e8d711d5878e8930f486151ead.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_82ff64e8d711d5878e8930f486151ead.jpg saved to cache
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f120c1b-89ec-51f3-b5b8-b024d6f3387e
2026-03-30 10:52:03 [auto1.de] INFO: Channel: 24h | Page: 38 | totalHits: 9509 | hits on page: 40
2026-03-30 10:52:03 [auto1.de] INFO: Found listing with ID: LJ65322
2026-03-30 10:52:03 [auto1.de] INFO: Found listing with ID: ZM65799
2026-03-30 10:52:03 [auto1.de] INFO: Found listing with ID: HG99428
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG99428%27 HTTP/1.1" 200 None
2026-03-30 10:52:03 [auto1.de] INFO: Scrape type for HG99428: 2
2026-03-30 10:52:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88fed260-b124-5d94-a3ac-50612e430ce6 with identifier: HG99428
2026-03-30 10:52:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88fed260-b124-5d94-a3ac-50612e430ce6 with scrape type 2
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88fed260-b124-5d94-a3ac-50612e430ce6 with scrape type 2
2026-03-30 10:52:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88fed260-b124-5d94-a3ac-50612e430ce6, identifier: HG99428
2026-03-30 10:52:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebc9efb4-df04-5936-bf0a-88c7eae0b775 with identifier: DU13995
2026-03-30 10:52:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebc9efb4-df04-5936-bf0a-88c7eae0b775 with identifier: DU13995
2026-03-30 10:52:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebc9efb4-df04-5936-bf0a-88c7eae0b775 with identifier: DU13995 to the API
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:01:27Z',
 'fuel_type': 'diesel',
 'id': 'ebc9efb4-df04-5936-bf0a-88c7eae0b775',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU13995',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 71502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-01',
 'seller_name': None,
 'title': 'Jaguar F-Pace 20d Pure AWD',
 'transmission': 'automatic',
 'trim': 'Pure AWD',
 'year': 2016}
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13995%27 HTTP/1.1" 200 None
2026-03-30 10:52:04 [auto1.de] INFO: Saving data for DU13995: {'auction_closing_time': 1774969287.0, 'created_time': 1774467173.468872, 'last_price_update_time': 1774867924.161561}
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU13995') HTTP/1.1" 204 0
2026-03-30 10:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_9a8aba7e8cc5cbee4325910ce0a32645.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:04 [scrapy.extensions.logstats] INFO: Crawled 729 pages (at 15 pages/min), scraped 660 items (at 74 items/min)
2026-03-30 10:52:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:52:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88fed260-b124-5d94-a3ac-50612e430ce6 with identifier: HG99428
2026-03-30 10:52:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88fed260-b124-5d94-a3ac-50612e430ce6 with identifier: HG99428
2026-03-30 10:52:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88fed260-b124-5d94-a3ac-50612e430ce6 with identifier: HG99428 to the API
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-31T15:38:11Z',
 'fuel_type': 'hybrid',
 'id': '88fed260-b124-5d94-a3ac-50612e430ce6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG99428',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 39544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-05',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300e T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2022}
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG99428%27 HTTP/1.1" 200 None
2026-03-30 10:52:04 [auto1.de] INFO: Saving data for HG99428: {'auction_closing_time': 1774971491.0, 'created_time': 1774380395.084107, 'last_price_update_time': 1774867924.514318}
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG99428') HTTP/1.1" 204 0
2026-03-30 10:52:04 [auto1.de] INFO: Found listing with ID: DK56258
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK56258%27 HTTP/1.1" 200 None
2026-03-30 10:52:04 [auto1.de] INFO: Scrape type for DK56258: 2
2026-03-30 10:52:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b2cdfdd-b5dc-5a73-9cf6-2f899cc5573d with identifier: DK56258
2026-03-30 10:52:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b2cdfdd-b5dc-5a73-9cf6-2f899cc5573d with scrape type 2
2026-03-30 10:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b2cdfdd-b5dc-5a73-9cf6-2f899cc5573d with scrape type 2
2026-03-30 10:52:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b2cdfdd-b5dc-5a73-9cf6-2f899cc5573d, identifier: DK56258
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_0ef1e9bf670956de0a15241baec66058.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_0ef1e9bf670956de0a15241baec66058.jpg not downloaded yet
2026-03-30 10:52:04 [auto1.de] INFO: Found listing with ID: WL81842
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL81842%27 HTTP/1.1" 200 None
2026-03-30 10:52:04 [auto1.de] INFO: Scrape type for WL81842: 2
2026-03-30 10:52:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f275db1-e855-5126-85e0-3c1413045814 with identifier: WL81842
2026-03-30 10:52:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f275db1-e855-5126-85e0-3c1413045814 with scrape type 2
2026-03-30 10:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f275db1-e855-5126-85e0-3c1413045814 with scrape type 2
2026-03-30 10:52:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f275db1-e855-5126-85e0-3c1413045814, identifier: WL81842
2026-03-30 10:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY34780/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:04 [auto1.de] INFO: Found listing with ID: EH94118
2026-03-30 10:52:04 [auto1.de] INFO: Found listing with ID: EN59108
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN59108%27 HTTP/1.1" 200 None
2026-03-30 10:52:04 [auto1.de] INFO: Scrape type for EN59108: 2
2026-03-30 10:52:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7cd3525-833d-526a-937f-04639ee45124 with identifier: EN59108
2026-03-30 10:52:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7cd3525-833d-526a-937f-04639ee45124 with scrape type 2
2026-03-30 10:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7cd3525-833d-526a-937f-04639ee45124 with scrape type 2
2026-03-30 10:52:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7cd3525-833d-526a-937f-04639ee45124, identifier: EN59108
2026-03-30 10:52:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b2cdfdd-b5dc-5a73-9cf6-2f899cc5573d with identifier: DK56258
2026-03-30 10:52:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b2cdfdd-b5dc-5a73-9cf6-2f899cc5573d with identifier: DK56258
2026-03-30 10:52:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b2cdfdd-b5dc-5a73-9cf6-2f899cc5573d with identifier: DK56258 to the API
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:29:09Z',
 'fuel_type': 'diesel',
 'id': '1b2cdfdd-b5dc-5a73-9cf6-2f899cc5573d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK56258',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 179163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-16',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK56258%27 HTTP/1.1" 200 None
2026-03-30 10:52:05 [auto1.de] INFO: Saving data for DK56258: {'auction_closing_time': 1774970949.0, 'created_time': 1772729005.32869, 'last_price_update_time': 1774867925.298465}
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK56258') HTTP/1.1" 204 0
2026-03-30 10:52:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f275db1-e855-5126-85e0-3c1413045814 with identifier: WL81842
2026-03-30 10:52:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f275db1-e855-5126-85e0-3c1413045814 with identifier: WL81842
2026-03-30 10:52:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f275db1-e855-5126-85e0-3c1413045814 with identifier: WL81842 to the API
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-31T15:57:56Z',
 'fuel_type': 'petrol',
 'id': '5f275db1-e855-5126-85e0-3c1413045814',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL81842',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Camaro',
 'odometer': 59626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-02-28',
 'seller_name': None,
 'title': 'Chevrolet Camaro 3.8 V6 Coupe',
 'transmission': 'automatic',
 'trim': 'Coupe',
 'year': 1999}
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL81842%27 HTTP/1.1" 200 None
2026-03-30 10:52:05 [auto1.de] INFO: Saving data for WL81842: {'auction_closing_time': 1774972676.0, 'created_time': 1774379903.048104, 'last_price_update_time': 1774867925.635001}
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL81842') HTTP/1.1" 204 0
2026-03-30 10:52:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7cd3525-833d-526a-937f-04639ee45124 with identifier: EN59108
2026-03-30 10:52:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7cd3525-833d-526a-937f-04639ee45124 with identifier: EN59108
2026-03-30 10:52:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7cd3525-833d-526a-937f-04639ee45124 with identifier: EN59108 to the API
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:59:20Z',
 'fuel_type': 'diesel',
 'id': 'b7cd3525-833d-526a-937f-04639ee45124',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN59108',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 226532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-27',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC',
 'transmission': 'manual',
 'trim': 'T BlueTEC',
 'year': 2017}
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN59108%27 HTTP/1.1" 200 None
2026-03-30 10:52:05 [auto1.de] INFO: Saving data for EN59108: {'auction_closing_time': 1774972760.0, 'created_time': 1774463725.785941, 'last_price_update_time': 1774867925.987976}
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN59108') HTTP/1.1" 204 0
2026-03-30 10:52:06 [auto1.de] INFO: Found listing with ID: WL25764
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL25764%27 HTTP/1.1" 200 None
2026-03-30 10:52:06 [auto1.de] INFO: Scrape type for WL25764: 2
2026-03-30 10:52:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf60d666-18d4-5b72-a8a8-33e9474891a0 with identifier: WL25764
2026-03-30 10:52:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf60d666-18d4-5b72-a8a8-33e9474891a0 with scrape type 2
2026-03-30 10:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf60d666-18d4-5b72-a8a8-33e9474891a0 with scrape type 2
2026-03-30 10:52:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf60d666-18d4-5b72-a8a8-33e9474891a0, identifier: WL25764
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_e67edbcfcf19e2cb6022ab8e0fb460f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_e67edbcfcf19e2cb6022ab8e0fb460f0.jpg not downloaded yet
2026-03-30 10:52:06 [auto1.de] INFO: Found listing with ID: VH44850
2026-03-30 10:52:06 [auto1.de] INFO: Found listing with ID: PP17491
2026-03-30 10:52:06 [auto1.de] INFO: Found listing with ID: BF84298
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF84298%27 HTTP/1.1" 200 None
2026-03-30 10:52:06 [auto1.de] INFO: Scrape type for BF84298: 2
2026-03-30 10:52:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fb8ebcf-49f8-5595-a54c-bf6b8ad4a780 with identifier: BF84298
2026-03-30 10:52:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fb8ebcf-49f8-5595-a54c-bf6b8ad4a780 with scrape type 2
2026-03-30 10:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fb8ebcf-49f8-5595-a54c-bf6b8ad4a780 with scrape type 2
2026-03-30 10:52:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9fb8ebcf-49f8-5595-a54c-bf6b8ad4a780, identifier: BF84298
2026-03-30 10:52:06 [auto1.de] INFO: Found listing with ID: AM83584
2026-03-30 10:52:06 [auto1.de] INFO: Found listing with ID: RC15708
2026-03-30 10:52:06 [auto1.de] INFO: Found listing with ID: KA01913
2026-03-30 10:52:06 [auto1.de] INFO: Found listing with ID: DL00356
2026-03-30 10:52:06 [auto1.de] INFO: Found listing with ID: HR08840
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR08840%27 HTTP/1.1" 200 None
2026-03-30 10:52:06 [auto1.de] INFO: Scrape type for HR08840: 2
2026-03-30 10:52:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f810daf1-d2ae-5bde-86ca-1669c267609a with identifier: HR08840
2026-03-30 10:52:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f810daf1-d2ae-5bde-86ca-1669c267609a with scrape type 2
2026-03-30 10:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f810daf1-d2ae-5bde-86ca-1669c267609a with scrape type 2
2026-03-30 10:52:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f810daf1-d2ae-5bde-86ca-1669c267609a, identifier: HR08840
2026-03-30 10:52:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf60d666-18d4-5b72-a8a8-33e9474891a0 with identifier: WL25764
2026-03-30 10:52:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf60d666-18d4-5b72-a8a8-33e9474891a0 with identifier: WL25764
2026-03-30 10:52:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf60d666-18d4-5b72-a8a8-33e9474891a0 with identifier: WL25764 to the API
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:39:39Z',
 'fuel_type': 'petrol',
 'id': 'bf60d666-18d4-5b72-a8a8-33e9474891a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL25764',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 94647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2013}
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL25764%27 HTTP/1.1" 200 None
2026-03-30 10:52:06 [auto1.de] INFO: Saving data for WL25764: {'auction_closing_time': 1774971579.0, 'created_time': 1773916914.169103, 'last_price_update_time': 1774867926.76841}
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL25764') HTTP/1.1" 204 0
2026-03-30 10:52:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9fb8ebcf-49f8-5595-a54c-bf6b8ad4a780 with identifier: BF84298
2026-03-30 10:52:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9fb8ebcf-49f8-5595-a54c-bf6b8ad4a780 with identifier: BF84298
2026-03-30 10:52:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9fb8ebcf-49f8-5595-a54c-bf6b8ad4a780 with identifier: BF84298 to the API
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-31T15:13:37Z',
 'fuel_type': 'hybrid',
 'id': '9fb8ebcf-49f8-5595-a54c-bf6b8ad4a780',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF84298',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 169032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-15',
 'seller_name': None,
 'title': 'Audi A6 55 TFSIe quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2021}
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF84298%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [auto1.de] INFO: Saving data for BF84298: {'auction_closing_time': 1774970017.0, 'created_time': 1774463643.677114, 'last_price_update_time': 1774867927.170359}
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF84298') HTTP/1.1" 204 0
2026-03-30 10:52:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c13c811-bcd6-5b20-adad-23614e70558b with identifier: RL62864
2026-03-30 10:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c13c811-bcd6-5b20-adad-23614e70558b with scrape type 1
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c13c811-bcd6-5b20-adad-23614e70558b
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_3b074b3127b9b70e69626707ea121e41.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_3b074b3127b9b70e69626707ea121e41.jpg not downloaded yet
2026-03-30 10:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7d190>
2026-03-30 10:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_9a8aba7e8cc5cbee4325910ce0a32645.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_9a8aba7e8cc5cbee4325910ce0a32645.jpg saved to cache
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7aef1684-8f11-51f3-b018-9f199981ee63
2026-03-30 10:52:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_ca49e6d9c0d7ad13bcd7a50e3a207f09.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f810daf1-d2ae-5bde-86ca-1669c267609a with identifier: HR08840
2026-03-30 10:52:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f810daf1-d2ae-5bde-86ca-1669c267609a with identifier: HR08840
2026-03-30 10:52:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f810daf1-d2ae-5bde-86ca-1669c267609a with identifier: HR08840 to the API
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-31T15:37:36Z',
 'fuel_type': 'petrol',
 'id': 'f810daf1-d2ae-5bde-86ca-1669c267609a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR08840',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Almera',
 'odometer': 211691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-07-30',
 'seller_name': None,
 'title': 'Nissan Almera 1.5 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2003}
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR08840%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [auto1.de] INFO: Saving data for HR08840: {'auction_closing_time': 1774971456.0, 'created_time': 1774348960.158297, 'last_price_update_time': 1774867927.618966}
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR08840') HTTP/1.1" 204 0
2026-03-30 10:52:07 [auto1.de] INFO: Found listing with ID: KH60913
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH60913%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [auto1.de] INFO: Scrape type for KH60913: 2
2026-03-30 10:52:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7eb226bb-58a0-5cb3-adfa-d2f0e082888a with identifier: KH60913
2026-03-30 10:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7eb226bb-58a0-5cb3-adfa-d2f0e082888a with scrape type 2
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7eb226bb-58a0-5cb3-adfa-d2f0e082888a with scrape type 2
2026-03-30 10:52:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7eb226bb-58a0-5cb3-adfa-d2f0e082888a, identifier: KH60913
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_e02503714f48d0836efafe675a2da611.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_e02503714f48d0836efafe675a2da611.jpg not downloaded yet
2026-03-30 10:52:07 [auto1.de] INFO: Found listing with ID: DG38505
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG38505%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [auto1.de] INFO: Scrape type for DG38505: 2
2026-03-30 10:52:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfac22a2-3e10-56e9-ae31-1a97ffe4ab81 with identifier: DG38505
2026-03-30 10:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfac22a2-3e10-56e9-ae31-1a97ffe4ab81 with scrape type 2
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfac22a2-3e10-56e9-ae31-1a97ffe4ab81 with scrape type 2
2026-03-30 10:52:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dfac22a2-3e10-56e9-ae31-1a97ffe4ab81, identifier: DG38505
2026-03-30 10:52:07 [auto1.de] INFO: Found listing with ID: VP81164
2026-03-30 10:52:07 [auto1.de] INFO: Found listing with ID: NK36025
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK36025%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [auto1.de] INFO: Scrape type for NK36025: 2
2026-03-30 10:52:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c28fa852-fd41-5864-96a3-59446aaf0548 with identifier: NK36025
2026-03-30 10:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c28fa852-fd41-5864-96a3-59446aaf0548 with scrape type 2
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c28fa852-fd41-5864-96a3-59446aaf0548 with scrape type 2
2026-03-30 10:52:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c28fa852-fd41-5864-96a3-59446aaf0548, identifier: NK36025
2026-03-30 10:52:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7eb226bb-58a0-5cb3-adfa-d2f0e082888a with identifier: KH60913
2026-03-30 10:52:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7eb226bb-58a0-5cb3-adfa-d2f0e082888a with identifier: KH60913
2026-03-30 10:52:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7eb226bb-58a0-5cb3-adfa-d2f0e082888a with identifier: KH60913 to the API
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 457,
 'expiration_date': '2026-03-31T15:57:54Z',
 'fuel_type': 'hybrid',
 'id': '7eb226bb-58a0-5cb3-adfa-d2f0e082888a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH60913',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Explorer',
 'odometer': 147695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-16',
 'seller_name': None,
 'title': 'Ford Explorer 3.0 Plug-in Hybrid 4x4 ST-Line',
 'transmission': 'automatic',
 'trim': '4x4 ST-Line',
 'year': 2020}
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH60913%27 HTTP/1.1" 200 None
2026-03-30 10:52:08 [auto1.de] INFO: Saving data for KH60913: {'auction_closing_time': 1774972674.0, 'created_time': 1773303748.62114, 'last_price_update_time': 1774867928.349893}
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH60913') HTTP/1.1" 204 0
2026-03-30 10:52:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dfac22a2-3e10-56e9-ae31-1a97ffe4ab81 with identifier: DG38505
2026-03-30 10:52:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dfac22a2-3e10-56e9-ae31-1a97ffe4ab81 with identifier: DG38505
2026-03-30 10:52:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dfac22a2-3e10-56e9-ae31-1a97ffe4ab81 with identifier: DG38505 to the API
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:46:38Z',
 'fuel_type': 'petrol',
 'id': 'dfac22a2-3e10-56e9-ae31-1a97ffe4ab81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG38505',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 111036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2010}
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG38505%27 HTTP/1.1" 200 None
2026-03-30 10:52:08 [auto1.de] INFO: Saving data for DG38505: {'auction_closing_time': 1774971998.0, 'created_time': 1773945618.388758, 'last_price_update_time': 1774867928.752462}
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG38505') HTTP/1.1" 204 0
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_a7066ea8a89ce44fbd9b38b1b8c8aaf7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_a7066ea8a89ce44fbd9b38b1b8c8aaf7.jpg not downloaded yet
2026-03-30 10:52:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c28fa852-fd41-5864-96a3-59446aaf0548 with identifier: NK36025
2026-03-30 10:52:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c28fa852-fd41-5864-96a3-59446aaf0548 with identifier: NK36025
2026-03-30 10:52:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c28fa852-fd41-5864-96a3-59446aaf0548 with identifier: NK36025 to the API
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:09:54Z',
 'fuel_type': 'diesel',
 'id': 'c28fa852-fd41-5864-96a3-59446aaf0548',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK36025',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 205824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-01',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2017}
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK36025%27 HTTP/1.1" 200 None
2026-03-30 10:52:09 [auto1.de] INFO: Saving data for NK36025: {'auction_closing_time': 1774969794.0, 'created_time': 1773688084.068133, 'last_price_update_time': 1774867929.126108}
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK36025') HTTP/1.1" 204 0
2026-03-30 10:52:09 [auto1.de] INFO: Found listing with ID: WY46685
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY46685%27 HTTP/1.1" 200 None
2026-03-30 10:52:09 [auto1.de] INFO: Scrape type for WY46685: 2
2026-03-30 10:52:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9071e2c9-0dc0-56ec-a070-efe5918c820f with identifier: WY46685
2026-03-30 10:52:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9071e2c9-0dc0-56ec-a070-efe5918c820f with scrape type 2
2026-03-30 10:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9071e2c9-0dc0-56ec-a070-efe5918c820f with scrape type 2
2026-03-30 10:52:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9071e2c9-0dc0-56ec-a070-efe5918c820f, identifier: WY46685
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_291ab4f88c5101e0d7a136b56a76ca29.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_291ab4f88c5101e0d7a136b56a76ca29.jpg not downloaded yet
2026-03-30 10:52:09 [auto1.de] INFO: Found listing with ID: HD75435
2026-03-30 10:52:09 [auto1.de] INFO: Found listing with ID: RW72092
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW72092%27 HTTP/1.1" 200 None
2026-03-30 10:52:09 [auto1.de] INFO: Scrape type for RW72092: 2
2026-03-30 10:52:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cde8c28-6164-55ea-98ff-d8c6bc59955d with identifier: RW72092
2026-03-30 10:52:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cde8c28-6164-55ea-98ff-d8c6bc59955d with scrape type 2
2026-03-30 10:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cde8c28-6164-55ea-98ff-d8c6bc59955d with scrape type 2
2026-03-30 10:52:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4cde8c28-6164-55ea-98ff-d8c6bc59955d, identifier: RW72092
2026-03-30 10:52:09 [auto1.de] INFO: Found listing with ID: HS33411
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS33411%27 HTTP/1.1" 200 None
2026-03-30 10:52:09 [auto1.de] INFO: Scrape type for HS33411: 2
2026-03-30 10:52:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2d9ed0e-c0fa-50dd-9a8d-afa0df4b1d87 with identifier: HS33411
2026-03-30 10:52:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2d9ed0e-c0fa-50dd-9a8d-afa0df4b1d87 with scrape type 2
2026-03-30 10:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2d9ed0e-c0fa-50dd-9a8d-afa0df4b1d87 with scrape type 2
2026-03-30 10:52:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2d9ed0e-c0fa-50dd-9a8d-afa0df4b1d87, identifier: HS33411
2026-03-30 10:52:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9071e2c9-0dc0-56ec-a070-efe5918c820f with identifier: WY46685
2026-03-30 10:52:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9071e2c9-0dc0-56ec-a070-efe5918c820f with identifier: WY46685
2026-03-30 10:52:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9071e2c9-0dc0-56ec-a070-efe5918c820f with identifier: WY46685 to the API
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:12:17Z',
 'fuel_type': 'petrol',
 'id': '9071e2c9-0dc0-56ec-a070-efe5918c820f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY46685',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 104958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-16',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY46685%27 HTTP/1.1" 200 None
2026-03-30 10:52:10 [auto1.de] INFO: Saving data for WY46685: {'auction_closing_time': 1774969937.0, 'created_time': 1773302292.753114, 'last_price_update_time': 1774867930.091438}
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY46685') HTTP/1.1" 204 0
2026-03-30 10:52:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4cde8c28-6164-55ea-98ff-d8c6bc59955d with identifier: RW72092
2026-03-30 10:52:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4cde8c28-6164-55ea-98ff-d8c6bc59955d with identifier: RW72092
2026-03-30 10:52:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4cde8c28-6164-55ea-98ff-d8c6bc59955d with identifier: RW72092 to the API
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:55:31Z',
 'fuel_type': 'petrol',
 'id': '4cde8c28-6164-55ea-98ff-d8c6bc59955d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW72092',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 139861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-11',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW72092%27 HTTP/1.1" 200 None
2026-03-30 10:52:10 [auto1.de] INFO: Saving data for RW72092: {'auction_closing_time': 1774972531.0, 'created_time': 1774349172.248833, 'last_price_update_time': 1774867930.430889}
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW72092') HTTP/1.1" 204 0
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_f3f72832c91076505033e4d8d6dc1331.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_f3f72832c91076505033e4d8d6dc1331.jpg not downloaded yet
2026-03-30 10:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_fa25157cad9adf0df7e5f2a8433358d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2d9ed0e-c0fa-50dd-9a8d-afa0df4b1d87 with identifier: HS33411
2026-03-30 10:52:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2d9ed0e-c0fa-50dd-9a8d-afa0df4b1d87 with identifier: HS33411
2026-03-30 10:52:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2d9ed0e-c0fa-50dd-9a8d-afa0df4b1d87 with identifier: HS33411 to the API
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:07:53Z',
 'fuel_type': 'diesel',
 'id': 'b2d9ed0e-c0fa-50dd-9a8d-afa0df4b1d87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS33411',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 166956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-01',
 'seller_name': None,
 'title': 'Audi A4 40 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS33411%27 HTTP/1.1" 200 None
2026-03-30 10:52:10 [auto1.de] INFO: Saving data for HS33411: {'auction_closing_time': 1774969673.0, 'created_time': 1774348417.014904, 'last_price_update_time': 1774867930.779815}
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS33411') HTTP/1.1" 204 0
2026-03-30 10:52:10 [auto1.de] INFO: Found listing with ID: MX60968
2026-03-30 10:52:10 [auto1.de] INFO: Found listing with ID: FW32642
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW32642%27 HTTP/1.1" 200 None
2026-03-30 10:52:10 [auto1.de] INFO: Scrape type for FW32642: 2
2026-03-30 10:52:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57130cd1-c728-5f54-8047-1e79e9efa2b2 with identifier: FW32642
2026-03-30 10:52:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57130cd1-c728-5f54-8047-1e79e9efa2b2 with scrape type 2
2026-03-30 10:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57130cd1-c728-5f54-8047-1e79e9efa2b2 with scrape type 2
2026-03-30 10:52:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57130cd1-c728-5f54-8047-1e79e9efa2b2, identifier: FW32642
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_421fc4a47b9cf6591abae6e803a8c3d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_421fc4a47b9cf6591abae6e803a8c3d9.jpg not downloaded yet
2026-03-30 10:52:10 [auto1.de] INFO: Found listing with ID: LC41774
2026-03-30 10:52:10 [auto1.de] INFO: Found listing with ID: VP91780
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP91780%27 HTTP/1.1" 200 None
2026-03-30 10:52:10 [auto1.de] INFO: Scrape type for VP91780: 2
2026-03-30 10:52:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88b3d700-b9a0-5d9c-b7bf-52012411cc6e with identifier: VP91780
2026-03-30 10:52:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88b3d700-b9a0-5d9c-b7bf-52012411cc6e with scrape type 2
2026-03-30 10:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88b3d700-b9a0-5d9c-b7bf-52012411cc6e with scrape type 2
2026-03-30 10:52:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88b3d700-b9a0-5d9c-b7bf-52012411cc6e, identifier: VP91780
2026-03-30 10:52:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefa6950>
2026-03-30 10:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_ca49e6d9c0d7ad13bcd7a50e3a207f09.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_ca49e6d9c0d7ad13bcd7a50e3a207f09.jpg saved to cache
2026-03-30 10:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7aef1684-8f11-51f3-b018-9f199981ee63
2026-03-30 10:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_cd19884c29608978dac17fdf2398967a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57130cd1-c728-5f54-8047-1e79e9efa2b2 with identifier: FW32642
2026-03-30 10:52:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57130cd1-c728-5f54-8047-1e79e9efa2b2 with identifier: FW32642
2026-03-30 10:52:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57130cd1-c728-5f54-8047-1e79e9efa2b2 with identifier: FW32642 to the API
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:36:20Z',
 'fuel_type': 'petrol',
 'id': '57130cd1-c728-5f54-8047-1e79e9efa2b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW32642',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 105530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-28',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW32642%27 HTTP/1.1" 200 None
2026-03-30 10:52:11 [auto1.de] INFO: Saving data for FW32642: {'auction_closing_time': 1774971380.0, 'created_time': 1773514153.108757, 'last_price_update_time': 1774867931.522838}
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW32642') HTTP/1.1" 204 0
2026-03-30 10:52:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88b3d700-b9a0-5d9c-b7bf-52012411cc6e with identifier: VP91780
2026-03-30 10:52:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88b3d700-b9a0-5d9c-b7bf-52012411cc6e with identifier: VP91780
2026-03-30 10:52:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88b3d700-b9a0-5d9c-b7bf-52012411cc6e with identifier: VP91780 to the API
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:56:55Z',
 'fuel_type': 'diesel',
 'id': '88b3d700-b9a0-5d9c-b7bf-52012411cc6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP91780',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Signum',
 'odometer': 164069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-27',
 'seller_name': None,
 'title': 'Opel Signum 3.0 V6 CDTI Cosmo Plus',
 'transmission': 'automatic',
 'trim': 'Cosmo Plus',
 'year': 2008}
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP91780%27 HTTP/1.1" 200 None
2026-03-30 10:52:11 [auto1.de] INFO: Saving data for VP91780: {'auction_closing_time': 1774972615.0, 'created_time': 1773468015.347534, 'last_price_update_time': 1774867931.994419}
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VP91780') HTTP/1.1" 204 0
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_a2cd25a8a11b05eb91f8e0ada57055d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_a2cd25a8a11b05eb91f8e0ada57055d4.jpg not downloaded yet
2026-03-30 10:52:12 [auto1.de] INFO: Found listing with ID: GG45079
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG45079%27 HTTP/1.1" 200 None
2026-03-30 10:52:12 [auto1.de] INFO: Scrape type for GG45079: 2
2026-03-30 10:52:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fbf8b6a-a9dc-5245-97af-d6abc2e47486 with identifier: GG45079
2026-03-30 10:52:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fbf8b6a-a9dc-5245-97af-d6abc2e47486 with scrape type 2
2026-03-30 10:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fbf8b6a-a9dc-5245-97af-d6abc2e47486 with scrape type 2
2026-03-30 10:52:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fbf8b6a-a9dc-5245-97af-d6abc2e47486, identifier: GG45079
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_42ca2f9ed3c22a1b4ffa6c6788424555.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_42ca2f9ed3c22a1b4ffa6c6788424555.jpg not downloaded yet
2026-03-30 10:52:12 [auto1.de] INFO: Found listing with ID: XK59952
2026-03-30 10:52:12 [auto1.de] INFO: Found listing with ID: RT32909
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT32909%27 HTTP/1.1" 200 None
2026-03-30 10:52:12 [auto1.de] INFO: Scrape type for RT32909: 2
2026-03-30 10:52:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa12a9f8-0c95-5029-b9b2-b61431b440fa with identifier: RT32909
2026-03-30 10:52:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa12a9f8-0c95-5029-b9b2-b61431b440fa with scrape type 2
2026-03-30 10:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa12a9f8-0c95-5029-b9b2-b61431b440fa with scrape type 2
2026-03-30 10:52:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa12a9f8-0c95-5029-b9b2-b61431b440fa, identifier: RT32909
2026-03-30 10:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_1585ad229a9bf2edc1416a1bd743b880.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fbf8b6a-a9dc-5245-97af-d6abc2e47486 with identifier: GG45079
2026-03-30 10:52:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fbf8b6a-a9dc-5245-97af-d6abc2e47486 with identifier: GG45079
2026-03-30 10:52:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fbf8b6a-a9dc-5245-97af-d6abc2e47486 with identifier: GG45079 to the API
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:27:53Z',
 'fuel_type': 'petrol',
 'id': '5fbf8b6a-a9dc-5245-97af-d6abc2e47486',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG45079',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 112632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-23',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2016}
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG45079%27 HTTP/1.1" 200 None
2026-03-30 10:52:12 [auto1.de] INFO: Saving data for GG45079: {'auction_closing_time': 1774970873.0, 'created_time': 1773685971.863458, 'last_price_update_time': 1774867932.606143}
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG45079') HTTP/1.1" 204 0
2026-03-30 10:52:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa12a9f8-0c95-5029-b9b2-b61431b440fa with identifier: RT32909
2026-03-30 10:52:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa12a9f8-0c95-5029-b9b2-b61431b440fa with identifier: RT32909
2026-03-30 10:52:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa12a9f8-0c95-5029-b9b2-b61431b440fa with identifier: RT32909 to the API
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:45:41Z',
 'fuel_type': 'diesel',
 'id': 'aa12a9f8-0c95-5029-b9b2-b61431b440fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT32909',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 145819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-29',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.9 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2011}
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT32909%27 HTTP/1.1" 200 None
2026-03-30 10:52:12 [auto1.de] INFO: Saving data for RT32909: {'auction_closing_time': 1774971941.0, 'created_time': 1773917597.894021, 'last_price_update_time': 1774867932.96454}
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT32909') HTTP/1.1" 204 0
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_ec6d50bd488654420e7e74ba76b8e497.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_ec6d50bd488654420e7e74ba76b8e497.jpg not downloaded yet
2026-03-30 10:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_054c7e084df79a54deb9a19eab4bd6d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_8de9b848c2fd2e710cc577ae1ffcb45c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:13 [auto1.de] INFO: Found listing with ID: AE27507
2026-03-30 10:52:13 [auto1.de] INFO: Found listing with ID: UM36066
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM36066%27 HTTP/1.1" 200 None
2026-03-30 10:52:13 [auto1.de] INFO: Scrape type for UM36066: 2
2026-03-30 10:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec05e601-c325-5388-8db0-b6100cb8774f with identifier: UM36066
2026-03-30 10:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec05e601-c325-5388-8db0-b6100cb8774f with scrape type 2
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec05e601-c325-5388-8db0-b6100cb8774f with scrape type 2
2026-03-30 10:52:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec05e601-c325-5388-8db0-b6100cb8774f, identifier: UM36066
2026-03-30 10:52:13 [auto1.de] INFO: Found listing with ID: FX85164
2026-03-30 10:52:13 [auto1.de] INFO: Found listing with ID: XU91066
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU91066%27 HTTP/1.1" 200 None
2026-03-30 10:52:13 [auto1.de] INFO: Scrape type for XU91066: 1
2026-03-30 10:52:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef53010>
2026-03-30 10:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_fa25157cad9adf0df7e5f2a8433358d9.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_fa25157cad9adf0df7e5f2a8433358d9.jpg saved to cache
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f120c1b-89ec-51f3-b5b8-b024d6f3387e
2026-03-30 10:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee43c90>
2026-03-30 10:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_cd19884c29608978dac17fdf2398967a.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_cd19884c29608978dac17fdf2398967a.jpg saved to cache
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7aef1684-8f11-51f3-b018-9f199981ee63
2026-03-30 10:52:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec05e601-c325-5388-8db0-b6100cb8774f with identifier: UM36066
2026-03-30 10:52:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec05e601-c325-5388-8db0-b6100cb8774f with identifier: UM36066
2026-03-30 10:52:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec05e601-c325-5388-8db0-b6100cb8774f with identifier: UM36066 to the API
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:55:24Z',
 'fuel_type': 'diesel',
 'id': 'ec05e601-c325-5388-8db0-b6100cb8774f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM36066',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 116588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-22',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d AVANTGARDE EDITION 19 lang',
 'transmission': 'automatic',
 'trim': 'AVANTGARDE EDITION 19 lang',
 'year': 2019}
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM36066%27 HTTP/1.1" 200 None
2026-03-30 10:52:13 [auto1.de] INFO: Saving data for UM36066: {'auction_closing_time': 1774972524.0, 'created_time': 1773773950.279576, 'last_price_update_time': 1774867933.627565}
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM36066') HTTP/1.1" 204 0
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_574c68a26693168d92a979f84d767bc6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_574c68a26693168d92a979f84d767bc6.jpg not downloaded yet
2026-03-30 10:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_0ef1e9bf670956de0a15241baec66058.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:13 [auto1.de] INFO: Found listing with ID: JN27816
2026-03-30 10:52:13 [auto1.de] INFO: Found listing with ID: BL66823
2026-03-30 10:52:13 [auto1.de] INFO: Found listing with ID: UG30169
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG30169%27 HTTP/1.1" 200 None
2026-03-30 10:52:13 [auto1.de] INFO: Scrape type for UG30169: 2
2026-03-30 10:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16c4893f-d3b1-588d-8457-912dc9a327f2 with identifier: UG30169
2026-03-30 10:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16c4893f-d3b1-588d-8457-912dc9a327f2 with scrape type 2
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16c4893f-d3b1-588d-8457-912dc9a327f2 with scrape type 2
2026-03-30 10:52:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16c4893f-d3b1-588d-8457-912dc9a327f2, identifier: UG30169
2026-03-30 10:52:13 [auto1.de] INFO: Found listing with ID: HX17640
2026-03-30 10:52:13 [auto1.de] INFO: Found listing with ID: FB64910
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB64910%27 HTTP/1.1" 200 None
2026-03-30 10:52:13 [auto1.de] INFO: Scrape type for FB64910: 2
2026-03-30 10:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53a5f31a-4256-5e19-9ebc-fc6725bbe27f with identifier: FB64910
2026-03-30 10:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53a5f31a-4256-5e19-9ebc-fc6725bbe27f with scrape type 2
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53a5f31a-4256-5e19-9ebc-fc6725bbe27f with scrape type 2
2026-03-30 10:52:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53a5f31a-4256-5e19-9ebc-fc6725bbe27f, identifier: FB64910
2026-03-30 10:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5bdcbd0>
2026-03-30 10:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_1585ad229a9bf2edc1416a1bd743b880.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_1585ad229a9bf2edc1416a1bd743b880.jpg saved to cache
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7aef1684-8f11-51f3-b018-9f199981ee63
2026-03-30 10:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_334509ec17d80a9baeeefb1bc63ebf20.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_aef45aebd88e241f315784ed549184b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_e02503714f48d0836efafe675a2da611.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16c4893f-d3b1-588d-8457-912dc9a327f2 with identifier: UG30169
2026-03-30 10:52:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16c4893f-d3b1-588d-8457-912dc9a327f2 with identifier: UG30169
2026-03-30 10:52:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16c4893f-d3b1-588d-8457-912dc9a327f2 with identifier: UG30169 to the API
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:20:32Z',
 'fuel_type': 'diesel',
 'id': '16c4893f-d3b1-588d-8457-912dc9a327f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG30169',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 121935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.7 dCi Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2020}
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG30169%27 HTTP/1.1" 200 None
2026-03-30 10:52:14 [auto1.de] INFO: Saving data for UG30169: {'auction_closing_time': 1774970432.0, 'created_time': 1773773714.960667, 'last_price_update_time': 1774867934.319485}
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG30169') HTTP/1.1" 204 0
2026-03-30 10:52:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53a5f31a-4256-5e19-9ebc-fc6725bbe27f with identifier: FB64910
2026-03-30 10:52:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53a5f31a-4256-5e19-9ebc-fc6725bbe27f with identifier: FB64910
2026-03-30 10:52:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53a5f31a-4256-5e19-9ebc-fc6725bbe27f with identifier: FB64910 to the API
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:03:02Z',
 'fuel_type': 'petrol',
 'id': '53a5f31a-4256-5e19-9ebc-fc6725bbe27f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB64910',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 146829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-04',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB64910%27 HTTP/1.1" 200 None
2026-03-30 10:52:14 [auto1.de] INFO: Saving data for FB64910: {'auction_closing_time': 1774969382.0, 'created_time': 1773341293.302496, 'last_price_update_time': 1774867934.748298}
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB64910') HTTP/1.1" 204 0
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_1611279ea68f3fd443bf9d7d116919d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_1611279ea68f3fd443bf9d7d116919d5.jpg not downloaded yet
2026-03-30 10:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_e67edbcfcf19e2cb6022ab8e0fb460f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:14 [auto1.de] INFO: Found listing with ID: JD22287
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD22287%27 HTTP/1.1" 200 None
2026-03-30 10:52:14 [auto1.de] INFO: Scrape type for JD22287: 2
2026-03-30 10:52:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3c209b7-56a6-5cef-a676-0f833850467e with identifier: JD22287
2026-03-30 10:52:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c209b7-56a6-5cef-a676-0f833850467e with scrape type 2
2026-03-30 10:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3c209b7-56a6-5cef-a676-0f833850467e with scrape type 2
2026-03-30 10:52:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3c209b7-56a6-5cef-a676-0f833850467e, identifier: JD22287
2026-03-30 10:52:14 [auto1.de] INFO: Found listing with ID: WR44415
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR44415%27 HTTP/1.1" 200 None
2026-03-30 10:52:14 [auto1.de] INFO: Scrape type for WR44415: 2
2026-03-30 10:52:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96df16e3-9b55-5bfd-9eac-43a521a326dc with identifier: WR44415
2026-03-30 10:52:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96df16e3-9b55-5bfd-9eac-43a521a326dc with scrape type 2
2026-03-30 10:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96df16e3-9b55-5bfd-9eac-43a521a326dc with scrape type 2
2026-03-30 10:52:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96df16e3-9b55-5bfd-9eac-43a521a326dc, identifier: WR44415
2026-03-30 10:52:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3c209b7-56a6-5cef-a676-0f833850467e with identifier: JD22287
2026-03-30 10:52:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3c209b7-56a6-5cef-a676-0f833850467e with identifier: JD22287
2026-03-30 10:52:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3c209b7-56a6-5cef-a676-0f833850467e with identifier: JD22287 to the API
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-31T15:31:34Z',
 'fuel_type': 'petrol',
 'id': 'b3c209b7-56a6-5cef-a676-0f833850467e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD22287',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': 'Sebring',
 'odometer': 164313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-05-13',
 'seller_name': None,
 'title': 'Chrysler Sebring 2.7 LX',
 'transmission': 'automatic',
 'trim': 'LX',
 'year': 2001}
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD22287%27 HTTP/1.1" 200 None
2026-03-30 10:52:15 [auto1.de] INFO: Saving data for JD22287: {'auction_closing_time': 1774971094.0, 'created_time': 1774292673.0775, 'last_price_update_time': 1774867935.396984}
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD22287') HTTP/1.1" 204 0
2026-03-30 10:52:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96df16e3-9b55-5bfd-9eac-43a521a326dc with identifier: WR44415
2026-03-30 10:52:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96df16e3-9b55-5bfd-9eac-43a521a326dc with identifier: WR44415
2026-03-30 10:52:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96df16e3-9b55-5bfd-9eac-43a521a326dc with identifier: WR44415 to the API
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 385,
 'expiration_date': '2026-03-31T15:00:17Z',
 'fuel_type': 'diesel',
 'id': '96df16e3-9b55-5bfd-9eac-43a521a326dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR44415',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 169695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-22',
 'seller_name': None,
 'title': 'Porsche Cayenne S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR44415%27 HTTP/1.1" 200 None
2026-03-30 10:52:15 [auto1.de] INFO: Saving data for WR44415: {'auction_closing_time': 1774969217.0, 'created_time': 1773945610.95398, 'last_price_update_time': 1774867935.717902}
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR44415') HTTP/1.1" 204 0
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_6119771b269860a73fccf0c894e318f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_6119771b269860a73fccf0c894e318f6.jpg not downloaded yet
2026-03-30 10:52:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee735d0>
2026-03-30 10:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_054c7e084df79a54deb9a19eab4bd6d5.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_054c7e084df79a54deb9a19eab4bd6d5.jpg saved to cache
2026-03-30 10:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f120c1b-89ec-51f3-b5b8-b024d6f3387e
2026-03-30 10:52:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee44d850>
2026-03-30 10:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_8de9b848c2fd2e710cc577ae1ffcb45c.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_8de9b848c2fd2e710cc577ae1ffcb45c.jpg saved to cache
2026-03-30 10:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f120c1b-89ec-51f3-b5b8-b024d6f3387e
2026-03-30 10:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1402c9ef90>
2026-03-30 10:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_0ef1e9bf670956de0a15241baec66058.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_0ef1e9bf670956de0a15241baec66058.jpg saved to cache
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7aef1684-8f11-51f3-b018-9f199981ee63
2026-03-30 10:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_a2cd25a8a11b05eb91f8e0ada57055d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_291ab4f88c5101e0d7a136b56a76ca29.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:16 [auto1.de] INFO: Found listing with ID: YZ92189
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ92189%27 HTTP/1.1" 200 None
2026-03-30 10:52:16 [auto1.de] INFO: Scrape type for YZ92189: 2
2026-03-30 10:52:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d50761d-f40a-5671-953d-ee27d00d7e99 with identifier: YZ92189
2026-03-30 10:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d50761d-f40a-5671-953d-ee27d00d7e99 with scrape type 2
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d50761d-f40a-5671-953d-ee27d00d7e99 with scrape type 2
2026-03-30 10:52:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d50761d-f40a-5671-953d-ee27d00d7e99, identifier: YZ92189
2026-03-30 10:52:16 [auto1.de] INFO: Found listing with ID: MT15247
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT15247%27 HTTP/1.1" 200 None
2026-03-30 10:52:16 [auto1.de] INFO: Scrape type for MT15247: 2
2026-03-30 10:52:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a4e2c75-a50a-51fa-965d-8474ea910f4c with identifier: MT15247
2026-03-30 10:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a4e2c75-a50a-51fa-965d-8474ea910f4c with scrape type 2
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a4e2c75-a50a-51fa-965d-8474ea910f4c with scrape type 2
2026-03-30 10:52:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a4e2c75-a50a-51fa-965d-8474ea910f4c, identifier: MT15247
2026-03-30 10:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_a7066ea8a89ce44fbd9b38b1b8c8aaf7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_421fc4a47b9cf6591abae6e803a8c3d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d50761d-f40a-5671-953d-ee27d00d7e99 with identifier: YZ92189
2026-03-30 10:52:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d50761d-f40a-5671-953d-ee27d00d7e99 with identifier: YZ92189
2026-03-30 10:52:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d50761d-f40a-5671-953d-ee27d00d7e99 with identifier: YZ92189 to the API
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-31T15:16:42Z',
 'fuel_type': 'petrol',
 'id': '3d50761d-f40a-5671-953d-ee27d00d7e99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ92189',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 86807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-09',
 'seller_name': None,
 'title': 'Porsche Cayenne 3.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ92189%27 HTTP/1.1" 200 None
2026-03-30 10:52:16 [auto1.de] INFO: Saving data for YZ92189: {'auction_closing_time': 1774970202.0, 'created_time': 1773945941.00465, 'last_price_update_time': 1774867936.720766}
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ92189') HTTP/1.1" 204 0
2026-03-30 10:52:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a4e2c75-a50a-51fa-965d-8474ea910f4c with identifier: MT15247
2026-03-30 10:52:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a4e2c75-a50a-51fa-965d-8474ea910f4c with identifier: MT15247
2026-03-30 10:52:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a4e2c75-a50a-51fa-965d-8474ea910f4c with identifier: MT15247 to the API
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:22:53Z',
 'fuel_type': 'petrol',
 'id': '2a4e2c75-a50a-51fa-965d-8474ea910f4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT15247',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 64514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-25',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Live',
 'transmission': 'manual',
 'trim': 'Live',
 'year': 2016}
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT15247%27 HTTP/1.1" 200 None
2026-03-30 10:52:17 [auto1.de] INFO: Saving data for MT15247: {'auction_closing_time': 1774970573.0, 'created_time': 1773916338.227639, 'last_price_update_time': 1774867937.075265}
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT15247') HTTP/1.1" 204 0
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_1a81da17a05f581772c306674b71ec4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_1a81da17a05f581772c306674b71ec4e.jpg not downloaded yet
2026-03-30 10:52:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd5390>
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_334509ec17d80a9baeeefb1bc63ebf20.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_334509ec17d80a9baeeefb1bc63ebf20.jpg saved to cache
2026-03-30 10:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f120c1b-89ec-51f3-b5b8-b024d6f3387e
2026-03-30 10:52:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee636d0>
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_aef45aebd88e241f315784ed549184b5.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_aef45aebd88e241f315784ed549184b5.jpg saved to cache
2026-03-30 10:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f120c1b-89ec-51f3-b5b8-b024d6f3387e
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef58410>
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_e02503714f48d0836efafe675a2da611.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_e02503714f48d0836efafe675a2da611.jpg saved to cache
2026-03-30 10:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7aef1684-8f11-51f3-b018-9f199981ee63
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42909d0>
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_e67edbcfcf19e2cb6022ab8e0fb460f0.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_e67edbcfcf19e2cb6022ab8e0fb460f0.jpg saved to cache
2026-03-30 10:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7aef1684-8f11-51f3-b018-9f199981ee63
2026-03-30 10:52:17 [auto1.de] INFO: Found listing with ID: RA53800
2026-03-30 10:52:17 [auto1.de] INFO: Found listing with ID: AB21758
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB21758%27 HTTP/1.1" 200 None
2026-03-30 10:52:17 [auto1.de] INFO: Scrape type for AB21758: 2
2026-03-30 10:52:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fe8dfab-3cbe-54b9-ba04-d139c52f33b4 with identifier: AB21758
2026-03-30 10:52:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fe8dfab-3cbe-54b9-ba04-d139c52f33b4 with scrape type 2
2026-03-30 10:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fe8dfab-3cbe-54b9-ba04-d139c52f33b4 with scrape type 2
2026-03-30 10:52:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fe8dfab-3cbe-54b9-ba04-d139c52f33b4, identifier: AB21758
2026-03-30 10:52:17 [auto1.de] INFO: Found listing with ID: BL94167
2026-03-30 10:52:17 [auto1.de] INFO: Found listing with ID: ES83380
2026-03-30 10:52:17 [auto1.de] INFO: Found listing with ID: NZ33680
2026-03-30 10:52:17 [auto1.de] INFO: Found listing with ID: AP12446
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP12446%27 HTTP/1.1" 200 None
2026-03-30 10:52:17 [auto1.de] INFO: Scrape type for AP12446: 2
2026-03-30 10:52:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9c8a3db-f565-5982-bb18-3534bf8c16a5 with identifier: AP12446
2026-03-30 10:52:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9c8a3db-f565-5982-bb18-3534bf8c16a5 with scrape type 2
2026-03-30 10:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9c8a3db-f565-5982-bb18-3534bf8c16a5 with scrape type 2
2026-03-30 10:52:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9c8a3db-f565-5982-bb18-3534bf8c16a5, identifier: AP12446
2026-03-30 10:52:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fe8dfab-3cbe-54b9-ba04-d139c52f33b4 with identifier: AB21758
2026-03-30 10:52:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fe8dfab-3cbe-54b9-ba04-d139c52f33b4 with identifier: AB21758
2026-03-30 10:52:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fe8dfab-3cbe-54b9-ba04-d139c52f33b4 with identifier: AB21758 to the API
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:42:31Z',
 'fuel_type': 'petrol',
 'id': '5fe8dfab-3cbe-54b9-ba04-d139c52f33b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB21758',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 143687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-06',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 Tour Edition',
 'transmission': 'manual',
 'trim': 'Tour Edition',
 'year': 2007}
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB21758%27 HTTP/1.1" 200 None
2026-03-30 10:52:17 [auto1.de] INFO: Saving data for AB21758: {'auction_closing_time': 1774971751.0, 'created_time': 1773662292.024226, 'last_price_update_time': 1774867937.994003}
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB21758') HTTP/1.1" 204 0
2026-03-30 10:52:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9c8a3db-f565-5982-bb18-3534bf8c16a5 with identifier: AP12446
2026-03-30 10:52:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9c8a3db-f565-5982-bb18-3534bf8c16a5 with identifier: AP12446
2026-03-30 10:52:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9c8a3db-f565-5982-bb18-3534bf8c16a5 with identifier: AP12446 to the API
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:00:35Z',
 'fuel_type': 'petrol',
 'id': 'b9c8a3db-f565-5982-bb18-3534bf8c16a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP12446',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 73075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-15',
 'seller_name': None,
 'title': 'Audi A3 1.4 TFSI ACT Attraction ultra',
 'transmission': 'manual',
 'trim': 'Attraction ultra',
 'year': 2015}
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP12446%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [auto1.de] INFO: Saving data for AP12446: {'auction_closing_time': 1774969235.0, 'created_time': 1774463581.255763, 'last_price_update_time': 1774867938.376761}
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP12446') HTTP/1.1" 204 0
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_04301a9433d893769eece46e44670a96.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_04301a9433d893769eece46e44670a96.jpg not downloaded yet
2026-03-30 10:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_e1da61d54757c8d2399983708686f501.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:18 [auto1.de] INFO: Found listing with ID: BS08057
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS08057%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [auto1.de] INFO: Scrape type for BS08057: 2
2026-03-30 10:52:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2403ac96-d0d2-5290-b16e-16fb88da9069 with identifier: BS08057
2026-03-30 10:52:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2403ac96-d0d2-5290-b16e-16fb88da9069 with scrape type 2
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2403ac96-d0d2-5290-b16e-16fb88da9069 with scrape type 2
2026-03-30 10:52:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2403ac96-d0d2-5290-b16e-16fb88da9069, identifier: BS08057
2026-03-30 10:52:18 [auto1.de] INFO: Found listing with ID: DF48310
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF48310%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [auto1.de] INFO: Scrape type for DF48310: 2
2026-03-30 10:52:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eafbd813-8adb-56a6-8715-2e4ad988ce4a with identifier: DF48310
2026-03-30 10:52:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eafbd813-8adb-56a6-8715-2e4ad988ce4a with scrape type 2
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eafbd813-8adb-56a6-8715-2e4ad988ce4a with scrape type 2
2026-03-30 10:52:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eafbd813-8adb-56a6-8715-2e4ad988ce4a, identifier: DF48310
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee41a390>
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_a2cd25a8a11b05eb91f8e0ada57055d4.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_a2cd25a8a11b05eb91f8e0ada57055d4.jpg saved to cache
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c13c811-bcd6-5b20-adad-23614e70558b
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee484390>
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_291ab4f88c5101e0d7a136b56a76ca29.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_291ab4f88c5101e0d7a136b56a76ca29.jpg saved to cache
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7aef1684-8f11-51f3-b018-9f199981ee63
2026-03-30 10:52:18 [auto1.de] INFO: Channel: 24h | Page: 39 | totalHits: 9511 | hits on page: 40
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee9f010>
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_a7066ea8a89ce44fbd9b38b1b8c8aaf7.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_a7066ea8a89ce44fbd9b38b1b8c8aaf7.jpg saved to cache
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c13c811-bcd6-5b20-adad-23614e70558b
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee479950>
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_421fc4a47b9cf6591abae6e803a8c3d9.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_421fc4a47b9cf6591abae6e803a8c3d9.jpg saved to cache
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7aef1684-8f11-51f3-b018-9f199981ee63
2026-03-30 10:52:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2403ac96-d0d2-5290-b16e-16fb88da9069 with identifier: BS08057
2026-03-30 10:52:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2403ac96-d0d2-5290-b16e-16fb88da9069 with identifier: BS08057
2026-03-30 10:52:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2403ac96-d0d2-5290-b16e-16fb88da9069 with identifier: BS08057 to the API
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-31T15:03:04Z',
 'fuel_type': 'petrol',
 'id': '2403ac96-d0d2-5290-b16e-16fb88da9069',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS08057',
 'listing': 'auction',
 'make': 'Cadillac',
 'model': 'CTS',
 'odometer': 120446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-12',
 'seller_name': None,
 'title': 'Cadillac CTS 2.0 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2016}
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS08057%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [auto1.de] INFO: Saving data for BS08057: {'auction_closing_time': 1774969384.0, 'created_time': 1774377968.555712, 'last_price_update_time': 1774867939.183312}
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS08057') HTTP/1.1" 204 0
2026-03-30 10:52:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eafbd813-8adb-56a6-8715-2e4ad988ce4a with identifier: DF48310
2026-03-30 10:52:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eafbd813-8adb-56a6-8715-2e4ad988ce4a with identifier: DF48310
2026-03-30 10:52:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eafbd813-8adb-56a6-8715-2e4ad988ce4a with identifier: DF48310 to the API
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 260,
 'expiration_date': '2026-03-31T15:01:27Z',
 'fuel_type': 'petrol',
 'id': 'eafbd813-8adb-56a6-8715-2e4ad988ce4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF48310',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 96788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-19',
 'seller_name': None,
 'title': 'Opel Insignia 2.8 V6 Turbo Sport 4x4',
 'transmission': 'manual',
 'trim': 'Sport 4x4',
 'year': 2011}
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF48310%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [auto1.de] INFO: Saving data for DF48310: {'auction_closing_time': 1774969287.0, 'created_time': 1774465748.560091, 'last_price_update_time': 1774867939.637717}
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF48310') HTTP/1.1" 204 0
2026-03-30 10:52:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:19 [auto1.de] INFO: Found listing with ID: HF61436
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF61436%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [auto1.de] INFO: Scrape type for HF61436: 2
2026-03-30 10:52:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13dd5cd3-28d1-5688-affc-b16d9d30cd30 with identifier: HF61436
2026-03-30 10:52:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13dd5cd3-28d1-5688-affc-b16d9d30cd30 with scrape type 2
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13dd5cd3-28d1-5688-affc-b16d9d30cd30 with scrape type 2
2026-03-30 10:52:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13dd5cd3-28d1-5688-affc-b16d9d30cd30, identifier: HF61436
2026-03-30 10:52:19 [auto1.de] INFO: Found listing with ID: VP95925
2026-03-30 10:52:19 [auto1.de] INFO: Found listing with ID: JR94106
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR94106%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [auto1.de] INFO: Scrape type for JR94106: 2
2026-03-30 10:52:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e6985c1-4739-5cb5-aa25-57d39183968b with identifier: JR94106
2026-03-30 10:52:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e6985c1-4739-5cb5-aa25-57d39183968b with scrape type 2
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e6985c1-4739-5cb5-aa25-57d39183968b with scrape type 2
2026-03-30 10:52:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e6985c1-4739-5cb5-aa25-57d39183968b, identifier: JR94106
2026-03-30 10:52:19 [auto1.de] INFO: Found listing with ID: RX33159
2026-03-30 10:52:19 [auto1.de] INFO: Found listing with ID: UA01329
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA01329%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [auto1.de] INFO: Scrape type for UA01329: 2
2026-03-30 10:52:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81c5f2a9-e0f1-5935-b895-76c985205cdf with identifier: UA01329
2026-03-30 10:52:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81c5f2a9-e0f1-5935-b895-76c985205cdf with scrape type 2
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81c5f2a9-e0f1-5935-b895-76c985205cdf with scrape type 2
2026-03-30 10:52:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81c5f2a9-e0f1-5935-b895-76c985205cdf, identifier: UA01329
2026-03-30 10:52:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_ee7c91945f65c2299acf00b5b55b25b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13dd5cd3-28d1-5688-affc-b16d9d30cd30 with identifier: HF61436
2026-03-30 10:52:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13dd5cd3-28d1-5688-affc-b16d9d30cd30 with identifier: HF61436
2026-03-30 10:52:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13dd5cd3-28d1-5688-affc-b16d9d30cd30 with identifier: HF61436 to the API
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-31T15:01:35Z',
 'fuel_type': 'petrol',
 'id': '13dd5cd3-28d1-5688-affc-b16d9d30cd30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF61436',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 199112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-17',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 500 BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2012}
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF61436%27 HTTP/1.1" 200 None
2026-03-30 10:52:20 [auto1.de] INFO: Saving data for HF61436: {'auction_closing_time': 1774969295.0, 'created_time': 1773946323.771788, 'last_price_update_time': 1774867940.357259}
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF61436') HTTP/1.1" 204 0
2026-03-30 10:52:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e6985c1-4739-5cb5-aa25-57d39183968b with identifier: JR94106
2026-03-30 10:52:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e6985c1-4739-5cb5-aa25-57d39183968b with identifier: JR94106
2026-03-30 10:52:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e6985c1-4739-5cb5-aa25-57d39183968b with identifier: JR94106 to the API
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:08:18Z',
 'fuel_type': 'petrol',
 'id': '8e6985c1-4739-5cb5-aa25-57d39183968b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR94106',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 56228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-27',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 250 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2015}
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR94106%27 HTTP/1.1" 200 None
2026-03-30 10:52:21 [auto1.de] INFO: Saving data for JR94106: {'auction_closing_time': 1774969698.0, 'created_time': 1773686322.579631, 'last_price_update_time': 1774867941.100831}
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR94106') HTTP/1.1" 204 0
2026-03-30 10:52:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81c5f2a9-e0f1-5935-b895-76c985205cdf with identifier: UA01329
2026-03-30 10:52:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81c5f2a9-e0f1-5935-b895-76c985205cdf with identifier: UA01329
2026-03-30 10:52:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81c5f2a9-e0f1-5935-b895-76c985205cdf with identifier: UA01329 to the API
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-31T15:27:58Z',
 'fuel_type': 'petrol',
 'id': '81c5f2a9-e0f1-5935-b895-76c985205cdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA01329',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 132490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-10-23',
 'seller_name': None,
 'title': 'Honda Jazz 1.4 DSi LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2003}
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA01329%27 HTTP/1.1" 200 None
2026-03-30 10:52:21 [auto1.de] INFO: Saving data for UA01329: {'auction_closing_time': 1774970878.0, 'created_time': 1774262217.038377, 'last_price_update_time': 1774867941.465671}
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA01329') HTTP/1.1" 204 0
2026-03-30 10:52:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f432c0d0>
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_e1da61d54757c8d2399983708686f501.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_e1da61d54757c8d2399983708686f501.jpg saved to cache
2026-03-30 10:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f120c1b-89ec-51f3-b5b8-b024d6f3387e
2026-03-30 10:52:21 [auto1.de] INFO: Found listing with ID: JE92990
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE92990%27 HTTP/1.1" 200 None
2026-03-30 10:52:21 [auto1.de] INFO: Scrape type for JE92990: 2
2026-03-30 10:52:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a56cab7-fca7-5cb0-85eb-24464d6b2035 with identifier: JE92990
2026-03-30 10:52:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a56cab7-fca7-5cb0-85eb-24464d6b2035 with scrape type 2
2026-03-30 10:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a56cab7-fca7-5cb0-85eb-24464d6b2035 with scrape type 2
2026-03-30 10:52:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a56cab7-fca7-5cb0-85eb-24464d6b2035, identifier: JE92990
2026-03-30 10:52:21 [auto1.de] INFO: Found listing with ID: XN03179
2026-03-30 10:52:21 [auto1.de] INFO: Found listing with ID: NA04350
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA04350%27 HTTP/1.1" 200 None
2026-03-30 10:52:21 [auto1.de] INFO: Scrape type for NA04350: 2
2026-03-30 10:52:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bff2dbda-9440-5ae7-9e74-d38fd6cd77e9 with identifier: NA04350
2026-03-30 10:52:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bff2dbda-9440-5ae7-9e74-d38fd6cd77e9 with scrape type 2
2026-03-30 10:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bff2dbda-9440-5ae7-9e74-d38fd6cd77e9 with scrape type 2
2026-03-30 10:52:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bff2dbda-9440-5ae7-9e74-d38fd6cd77e9, identifier: NA04350
2026-03-30 10:52:21 [auto1.de] INFO: Found listing with ID: SX00955
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX00955%27 HTTP/1.1" 200 None
2026-03-30 10:52:21 [auto1.de] INFO: Scrape type for SX00955: 2
2026-03-30 10:52:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1bb8398-ab0c-5881-83ec-15793c0eba93 with identifier: SX00955
2026-03-30 10:52:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1bb8398-ab0c-5881-83ec-15793c0eba93 with scrape type 2
2026-03-30 10:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1bb8398-ab0c-5881-83ec-15793c0eba93 with scrape type 2
2026-03-30 10:52:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1bb8398-ab0c-5881-83ec-15793c0eba93, identifier: SX00955
2026-03-30 10:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY34780> (referer: https://www.auto1.com/v1/car-details-view/SY34780/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_ec6d50bd488654420e7e74ba76b8e497.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_04301a9433d893769eece46e44670a96.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a56cab7-fca7-5cb0-85eb-24464d6b2035 with identifier: JE92990
2026-03-30 10:52:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a56cab7-fca7-5cb0-85eb-24464d6b2035 with identifier: JE92990
2026-03-30 10:52:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a56cab7-fca7-5cb0-85eb-24464d6b2035 with identifier: JE92990 to the API
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:22:26Z',
 'fuel_type': 'petrol',
 'id': '7a56cab7-fca7-5cb0-85eb-24464d6b2035',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE92990',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 175271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-14',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE92990%27 HTTP/1.1" 200 None
2026-03-30 10:52:22 [auto1.de] INFO: Saving data for JE92990: {'auction_closing_time': 1774970546.0, 'created_time': 1774467903.007506, 'last_price_update_time': 1774867942.242567}
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE92990') HTTP/1.1" 204 0
2026-03-30 10:52:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bff2dbda-9440-5ae7-9e74-d38fd6cd77e9 with identifier: NA04350
2026-03-30 10:52:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bff2dbda-9440-5ae7-9e74-d38fd6cd77e9 with identifier: NA04350
2026-03-30 10:52:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bff2dbda-9440-5ae7-9e74-d38fd6cd77e9 with identifier: NA04350 to the API
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:16:12Z',
 'fuel_type': 'petrol',
 'id': 'bff2dbda-9440-5ae7-9e74-d38fd6cd77e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA04350',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 143437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-19',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 CrossPolo',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2008}
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA04350%27 HTTP/1.1" 200 None
2026-03-30 10:52:22 [auto1.de] INFO: Saving data for NA04350: {'auction_closing_time': 1774970172.0, 'created_time': 1774464467.129083, 'last_price_update_time': 1774867942.577916}
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA04350') HTTP/1.1" 204 0
2026-03-30 10:52:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1bb8398-ab0c-5881-83ec-15793c0eba93 with identifier: SX00955
2026-03-30 10:52:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1bb8398-ab0c-5881-83ec-15793c0eba93 with identifier: SX00955
2026-03-30 10:52:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1bb8398-ab0c-5881-83ec-15793c0eba93 with identifier: SX00955 to the API
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:18:51Z',
 'fuel_type': 'diesel',
 'id': 'c1bb8398-ab0c-5881-83ec-15793c0eba93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX00955',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 212478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-12',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX00955%27 HTTP/1.1" 200 None
2026-03-30 10:52:22 [auto1.de] INFO: Saving data for SX00955: {'auction_closing_time': 1774970331.0, 'created_time': 1774377625.747186, 'last_price_update_time': 1774867942.94989}
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX00955') HTTP/1.1" 204 0
2026-03-30 10:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_1a81da17a05f581772c306674b71ec4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_1611279ea68f3fd443bf9d7d116919d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_574c68a26693168d92a979f84d767bc6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_6119771b269860a73fccf0c894e318f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:22 [auto1.de] INFO: Found listing with ID: ZM02354
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM02354%27 HTTP/1.1" 200 None
2026-03-30 10:52:22 [auto1.de] INFO: Scrape type for ZM02354: 2
2026-03-30 10:52:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c5c0ada-9c02-5419-b55b-3c2ee76c12b3 with identifier: ZM02354
2026-03-30 10:52:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c5c0ada-9c02-5419-b55b-3c2ee76c12b3 with scrape type 2
2026-03-30 10:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c5c0ada-9c02-5419-b55b-3c2ee76c12b3 with scrape type 2
2026-03-30 10:52:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c5c0ada-9c02-5419-b55b-3c2ee76c12b3, identifier: ZM02354
2026-03-30 10:52:23 [auto1.de] INFO: Found listing with ID: CS10063
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS10063%27 HTTP/1.1" 200 None
2026-03-30 10:52:23 [auto1.de] INFO: Scrape type for CS10063: 2
2026-03-30 10:52:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa0b7f8c-2bcf-5972-9603-7f65581a0cb4 with identifier: CS10063
2026-03-30 10:52:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa0b7f8c-2bcf-5972-9603-7f65581a0cb4 with scrape type 2
2026-03-30 10:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa0b7f8c-2bcf-5972-9603-7f65581a0cb4 with scrape type 2
2026-03-30 10:52:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa0b7f8c-2bcf-5972-9603-7f65581a0cb4, identifier: CS10063
2026-03-30 10:52:23 [auto1.de] INFO: Found listing with ID: NS76929
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS76929%27 HTTP/1.1" 200 None
2026-03-30 10:52:23 [auto1.de] INFO: Scrape type for NS76929: 2
2026-03-30 10:52:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ec39602-7d16-5fdf-b8b4-0bf483dec6d5 with identifier: NS76929
2026-03-30 10:52:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ec39602-7d16-5fdf-b8b4-0bf483dec6d5 with scrape type 2
2026-03-30 10:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ec39602-7d16-5fdf-b8b4-0bf483dec6d5 with scrape type 2
2026-03-30 10:52:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ec39602-7d16-5fdf-b8b4-0bf483dec6d5, identifier: NS76929
2026-03-30 10:52:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef360d0>
2026-03-30 10:52:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc383b374a945897bc2895b6fd8f08a%252Fpa%252FUP87347_ee7c91945f65c2299acf00b5b55b25b0.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_ee7c91945f65c2299acf00b5b55b25b0.jpg saved to cache
2026-03-30 10:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f120c1b-89ec-51f3-b5b8-b024d6f3387e
2026-03-30 10:52:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f120c1b-89ec-51f3-b5b8-b024d6f3387e, skipping ID generation
2026-03-30 10:52:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f120c1b-89ec-51f3-b5b8-b024d6f3387e with scrape type 1
2026-03-30 10:52:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f120c1b-89ec-51f3-b5b8-b024d6f3387e sending to next pipeline
2026-03-30 10:52:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f120c1b-89ec-51f3-b5b8-b024d6f3387e, identifier: UP87347
2026-03-30 10:52:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c5c0ada-9c02-5419-b55b-3c2ee76c12b3 with identifier: ZM02354
2026-03-30 10:52:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c5c0ada-9c02-5419-b55b-3c2ee76c12b3 with identifier: ZM02354
2026-03-30 10:52:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c5c0ada-9c02-5419-b55b-3c2ee76c12b3 with identifier: ZM02354 to the API
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:34:50Z',
 'fuel_type': 'petrol',
 'id': '6c5c0ada-9c02-5419-b55b-3c2ee76c12b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM02354',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 74442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-19',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid Select 2WD',
 'transmission': 'automatic',
 'trim': 'Select 2WD',
 'year': 2022}
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM02354%27 HTTP/1.1" 200 None
2026-03-30 10:52:23 [auto1.de] INFO: Saving data for ZM02354: {'auction_closing_time': 1774971290.0, 'created_time': 1774464418.323667, 'last_price_update_time': 1774867943.903079}
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM02354') HTTP/1.1" 204 0
2026-03-30 10:52:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa0b7f8c-2bcf-5972-9603-7f65581a0cb4 with identifier: CS10063
2026-03-30 10:52:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa0b7f8c-2bcf-5972-9603-7f65581a0cb4 with identifier: CS10063
2026-03-30 10:52:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa0b7f8c-2bcf-5972-9603-7f65581a0cb4 with identifier: CS10063 to the API
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-31T15:28:23Z',
 'fuel_type': 'petrol',
 'id': 'aa0b7f8c-2bcf-5972-9603-7f65581a0cb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS10063',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Leon',
 'odometer': 42272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-03',
 'seller_name': None,
 'title': 'Cupra Leon 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2022}
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS10063%27 HTTP/1.1" 200 None
2026-03-30 10:52:24 [auto1.de] INFO: Saving data for CS10063: {'auction_closing_time': 1774970903.0, 'created_time': 1773134974.195641, 'last_price_update_time': 1774867944.372678}
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS10063') HTTP/1.1" 204 0
2026-03-30 10:52:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ec39602-7d16-5fdf-b8b4-0bf483dec6d5 with identifier: NS76929
2026-03-30 10:52:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ec39602-7d16-5fdf-b8b4-0bf483dec6d5 with identifier: NS76929
2026-03-30 10:52:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ec39602-7d16-5fdf-b8b4-0bf483dec6d5 with identifier: NS76929 to the API
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:47:48Z',
 'fuel_type': 'petrol',
 'id': '1ec39602-7d16-5fdf-b8b4-0bf483dec6d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS76929',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 162671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-31',
 'seller_name': None,
 'title': 'Audi A3 1.6 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2008}
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS76929%27 HTTP/1.1" 200 None
2026-03-30 10:52:24 [auto1.de] INFO: Saving data for NS76929: {'auction_closing_time': 1774972068.0, 'created_time': 1773223799.828219, 'last_price_update_time': 1774867944.869057}
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS76929') HTTP/1.1" 204 0
2026-03-30 10:52:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f120c1b-89ec-51f3-b5b8-b024d6f3387e with identifier: UP87347
2026-03-30 10:52:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f120c1b-89ec-51f3-b5b8-b024d6f3387e with identifier: UP87347
2026-03-30 10:52:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f120c1b-89ec-51f3-b5b8-b024d6f3387e with identifier: UP87347 to the API
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_ee7c91945f65c2299acf00b5b55b25b0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:15:40Z',
 'fuel_type': 'diesel',
 'id': '9f120c1b-89ec-51f3-b5b8-b024d6f3387e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP87347',
 'listing': 'auction',
 'location': 'DE, Potsdam',
 'make': 'BMW',
 'model': '3er',
 'odometer': 31531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2175466,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_fa25157cad9adf0df7e5f2a8433358d9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2287689,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_054c7e084df79a54deb9a19eab4bd6d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2208681,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_8de9b848c2fd2e710cc577ae1ffcb45c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2167587,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_334509ec17d80a9baeeefb1bc63ebf20.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2121569,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_aef45aebd88e241f315784ed549184b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_3399441e2bac138de34c49011f067bba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2228550,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_e1da61d54757c8d2399983708686f501.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2361619,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_ee7c91945f65c2299acf00b5b55b25b0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_5b0d2ace4c8ad9a749c1ce5ce5f3931e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f120c1b-89ec-51f3-b5b8-b024d6f3387e/9f120c1b-89ec-51f3-b5b8-b024d6f3387e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc383b374a945897bc2895b6fd8f08a/pa/UP87347_82ff64e8d711d5878e8930f486151ead.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2024}
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP87347%27 HTTP/1.1" 200 None
2026-03-30 10:52:25 [auto1.de] INFO: Saving data for UP87347: {'created_time': 1774867945.244565, 'last_price_update_time': 1774867945.244577, 'auction_closing_time': 1774970140.0}
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP87347') HTTP/1.1" 204 0
2026-03-30 10:52:25 [auto1.de] INFO: Found listing with ID: PK29892
2026-03-30 10:52:25 [auto1.de] INFO: Found listing with ID: WL81842
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL81842%27 HTTP/1.1" 200 None
2026-03-30 10:52:25 [auto1.de] INFO: Scrape type for WL81842: 0
2026-03-30 10:52:25 [auto1.de] INFO: Found listing with ID: JL42140
2026-03-30 10:52:25 [auto1.de] INFO: Found listing with ID: CU82641
2026-03-30 10:52:25 [auto1.de] INFO: Found listing with ID: ZW11631
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW11631%27 HTTP/1.1" 200 None
2026-03-30 10:52:25 [auto1.de] INFO: Scrape type for ZW11631: 2
2026-03-30 10:52:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46172e87-4352-56db-a75b-904282fc13c1 with identifier: ZW11631
2026-03-30 10:52:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46172e87-4352-56db-a75b-904282fc13c1 with scrape type 2
2026-03-30 10:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46172e87-4352-56db-a75b-904282fc13c1 with scrape type 2
2026-03-30 10:52:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46172e87-4352-56db-a75b-904282fc13c1, identifier: ZW11631
2026-03-30 10:52:25 [auto1.de] INFO: Found listing with ID: FZ56361
2026-03-30 10:52:25 [auto1.de] INFO: Found listing with ID: ET02524
2026-03-30 10:52:25 [auto1.de] INFO: Found listing with ID: MU10500
2026-03-30 10:52:25 [auto1.de] INFO: Found listing with ID: XZ07034
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ07034%27 HTTP/1.1" 200 None
2026-03-30 10:52:25 [auto1.de] INFO: Scrape type for XZ07034: 2
2026-03-30 10:52:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbe127d9-530a-5e14-886e-a3be0363a04c with identifier: XZ07034
2026-03-30 10:52:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbe127d9-530a-5e14-886e-a3be0363a04c with scrape type 2
2026-03-30 10:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbe127d9-530a-5e14-886e-a3be0363a04c with scrape type 2
2026-03-30 10:52:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbe127d9-530a-5e14-886e-a3be0363a04c, identifier: XZ07034
2026-03-30 10:52:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46172e87-4352-56db-a75b-904282fc13c1 with identifier: ZW11631
2026-03-30 10:52:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46172e87-4352-56db-a75b-904282fc13c1 with identifier: ZW11631
2026-03-30 10:52:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46172e87-4352-56db-a75b-904282fc13c1 with identifier: ZW11631 to the API
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:47:06Z',
 'fuel_type': 'diesel',
 'id': '46172e87-4352-56db-a75b-904282fc13c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW11631',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 304105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-11',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2008}
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW11631%27 HTTP/1.1" 200 None
2026-03-30 10:52:25 [auto1.de] INFO: Saving data for ZW11631: {'auction_closing_time': 1774972026.0, 'created_time': 1774379603.00654, 'last_price_update_time': 1774867945.824527}
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW11631') HTTP/1.1" 204 0
2026-03-30 10:52:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbe127d9-530a-5e14-886e-a3be0363a04c with identifier: XZ07034
2026-03-30 10:52:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbe127d9-530a-5e14-886e-a3be0363a04c with identifier: XZ07034
2026-03-30 10:52:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbe127d9-530a-5e14-886e-a3be0363a04c with identifier: XZ07034 to the API
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:18:13Z',
 'fuel_type': 'diesel',
 'id': 'fbe127d9-530a-5e14-886e-a3be0363a04c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ07034',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 174560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-14',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Conceptline',
 'transmission': 'manual',
 'trim': 'Conceptline',
 'year': 2005}
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ07034%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [auto1.de] INFO: Saving data for XZ07034: {'auction_closing_time': 1774970293.0, 'created_time': 1773945861.651492, 'last_price_update_time': 1774867946.182566}
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ07034') HTTP/1.1" 204 0
2026-03-30 10:52:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf849b51-5476-510a-9c44-d5cfc3761ae0 with identifier: SY34780
2026-03-30 10:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf849b51-5476-510a-9c44-d5cfc3761ae0 with scrape type 1
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf849b51-5476-510a-9c44-d5cfc3761ae0
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_0af9a6659146820364de4c2a25134de6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_0af9a6659146820364de4c2a25134de6.jpg not downloaded yet
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f432ef50>
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_ec6d50bd488654420e7e74ba76b8e497.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_ec6d50bd488654420e7e74ba76b8e497.jpg saved to cache
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c13c811-bcd6-5b20-adad-23614e70558b
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee489cd0>
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_04301a9433d893769eece46e44670a96.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_04301a9433d893769eece46e44670a96.jpg saved to cache
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c13c811-bcd6-5b20-adad-23614e70558b
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee49fb10>
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_1a81da17a05f581772c306674b71ec4e.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_1a81da17a05f581772c306674b71ec4e.jpg saved to cache
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c13c811-bcd6-5b20-adad-23614e70558b
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4c7850>
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_1611279ea68f3fd443bf9d7d116919d5.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_1611279ea68f3fd443bf9d7d116919d5.jpg saved to cache
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c13c811-bcd6-5b20-adad-23614e70558b
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4a34d0>
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_574c68a26693168d92a979f84d767bc6.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_574c68a26693168d92a979f84d767bc6.jpg saved to cache
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c13c811-bcd6-5b20-adad-23614e70558b
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4a7410>
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_6119771b269860a73fccf0c894e318f6.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_6119771b269860a73fccf0c894e318f6.jpg saved to cache
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c13c811-bcd6-5b20-adad-23614e70558b
2026-03-30 10:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_f3f72832c91076505033e4d8d6dc1331.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:26 [auto1.de] INFO: Found listing with ID: VK17893
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK17893%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [auto1.de] INFO: Scrape type for VK17893: 2
2026-03-30 10:52:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e893ecc-ba9c-518e-a0b7-6420f90b2a87 with identifier: VK17893
2026-03-30 10:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e893ecc-ba9c-518e-a0b7-6420f90b2a87 with scrape type 2
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e893ecc-ba9c-518e-a0b7-6420f90b2a87 with scrape type 2
2026-03-30 10:52:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e893ecc-ba9c-518e-a0b7-6420f90b2a87, identifier: VK17893
2026-03-30 10:52:26 [auto1.de] INFO: Found listing with ID: YE23414
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE23414%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [auto1.de] INFO: Scrape type for YE23414: 2
2026-03-30 10:52:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2473328-a456-50ba-9853-2406ab50b85c with identifier: YE23414
2026-03-30 10:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2473328-a456-50ba-9853-2406ab50b85c with scrape type 2
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2473328-a456-50ba-9853-2406ab50b85c with scrape type 2
2026-03-30 10:52:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2473328-a456-50ba-9853-2406ab50b85c, identifier: YE23414
2026-03-30 10:52:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e893ecc-ba9c-518e-a0b7-6420f90b2a87 with identifier: VK17893
2026-03-30 10:52:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e893ecc-ba9c-518e-a0b7-6420f90b2a87 with identifier: VK17893
2026-03-30 10:52:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e893ecc-ba9c-518e-a0b7-6420f90b2a87 with identifier: VK17893 to the API
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:44:26Z',
 'fuel_type': 'petrol',
 'id': '1e893ecc-ba9c-518e-a0b7-6420f90b2a87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK17893',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 274546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-19',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2011}
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK17893%27 HTTP/1.1" 200 None
2026-03-30 10:52:27 [auto1.de] INFO: Saving data for VK17893: {'auction_closing_time': 1774971866.0, 'created_time': 1774348966.454787, 'last_price_update_time': 1774867947.081978}
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK17893') HTTP/1.1" 204 0
2026-03-30 10:52:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2473328-a456-50ba-9853-2406ab50b85c with identifier: YE23414
2026-03-30 10:52:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2473328-a456-50ba-9853-2406ab50b85c with identifier: YE23414
2026-03-30 10:52:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2473328-a456-50ba-9853-2406ab50b85c with identifier: YE23414 to the API
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-31T15:35:22Z',
 'fuel_type': 'diesel',
 'id': 'f2473328-a456-50ba-9853-2406ab50b85c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE23414',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 121653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-24',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2020}
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE23414%27 HTTP/1.1" 200 None
2026-03-30 10:52:27 [auto1.de] INFO: Saving data for YE23414: {'auction_closing_time': 1774971322.0, 'created_time': 1773302972.043817, 'last_price_update_time': 1774867947.580497}
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE23414') HTTP/1.1" 204 0
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_3c18051c3903eac6c8fcd41c89a7a5c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_3c18051c3903eac6c8fcd41c89a7a5c9.jpg not downloaded yet
2026-03-30 10:52:27 [auto1.de] INFO: Found listing with ID: JY81419
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY81419%27 HTTP/1.1" 200 None
2026-03-30 10:52:27 [auto1.de] INFO: Scrape type for JY81419: 2
2026-03-30 10:52:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73008f18-d7ba-529d-bdd4-b69f4692ab43 with identifier: JY81419
2026-03-30 10:52:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73008f18-d7ba-529d-bdd4-b69f4692ab43 with scrape type 2
2026-03-30 10:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73008f18-d7ba-529d-bdd4-b69f4692ab43 with scrape type 2
2026-03-30 10:52:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73008f18-d7ba-529d-bdd4-b69f4692ab43, identifier: JY81419
2026-03-30 10:52:27 [auto1.de] INFO: Found listing with ID: PD05251
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD05251%27 HTTP/1.1" 200 None
2026-03-30 10:52:27 [auto1.de] INFO: Scrape type for PD05251: 2
2026-03-30 10:52:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64a772f9-746c-51b8-8e73-d9f537c3df0b with identifier: PD05251
2026-03-30 10:52:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64a772f9-746c-51b8-8e73-d9f537c3df0b with scrape type 2
2026-03-30 10:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64a772f9-746c-51b8-8e73-d9f537c3df0b with scrape type 2
2026-03-30 10:52:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64a772f9-746c-51b8-8e73-d9f537c3df0b, identifier: PD05251
2026-03-30 10:52:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73008f18-d7ba-529d-bdd4-b69f4692ab43 with identifier: JY81419
2026-03-30 10:52:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73008f18-d7ba-529d-bdd4-b69f4692ab43 with identifier: JY81419
2026-03-30 10:52:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73008f18-d7ba-529d-bdd4-b69f4692ab43 with identifier: JY81419 to the API
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-31T15:56:15Z',
 'fuel_type': 'hybrid',
 'id': '73008f18-d7ba-529d-bdd4-b69f4692ab43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY81419',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 143707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-23',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 400 Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY81419%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [auto1.de] INFO: Saving data for JY81419: {'auction_closing_time': 1774972575.0, 'created_time': 1774467012.214994, 'last_price_update_time': 1774867948.214104}
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY81419') HTTP/1.1" 204 0
2026-03-30 10:52:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64a772f9-746c-51b8-8e73-d9f537c3df0b with identifier: PD05251
2026-03-30 10:52:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64a772f9-746c-51b8-8e73-d9f537c3df0b with identifier: PD05251
2026-03-30 10:52:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64a772f9-746c-51b8-8e73-d9f537c3df0b with identifier: PD05251 to the API
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:26:21Z',
 'fuel_type': 'petrol',
 'id': '64a772f9-746c-51b8-8e73-d9f537c3df0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD05251',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 75093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-18',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD05251%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [auto1.de] INFO: Saving data for PD05251: {'auction_closing_time': 1774970781.0, 'created_time': 1774463643.349132, 'last_price_update_time': 1774867948.557051}
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD05251') HTTP/1.1" 204 0
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_14176733f48f5929ff9fc9677a8e2eaa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_14176733f48f5929ff9fc9677a8e2eaa.jpg not downloaded yet
2026-03-30 10:52:28 [auto1.de] INFO: Found listing with ID: HD49679
2026-03-30 10:52:28 [auto1.de] INFO: Found listing with ID: AP39511
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP39511%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [auto1.de] INFO: Scrape type for AP39511: 2
2026-03-30 10:52:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9de2dda8-9c86-55bc-aa4e-2242c18db70f with identifier: AP39511
2026-03-30 10:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9de2dda8-9c86-55bc-aa4e-2242c18db70f with scrape type 2
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9de2dda8-9c86-55bc-aa4e-2242c18db70f with scrape type 2
2026-03-30 10:52:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9de2dda8-9c86-55bc-aa4e-2242c18db70f, identifier: AP39511
2026-03-30 10:52:28 [auto1.de] INFO: Found listing with ID: KG05257
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG05257%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [auto1.de] INFO: Scrape type for KG05257: 2
2026-03-30 10:52:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05c16c86-1bfc-5f1d-9692-427c574db702 with identifier: KG05257
2026-03-30 10:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05c16c86-1bfc-5f1d-9692-427c574db702 with scrape type 2
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05c16c86-1bfc-5f1d-9692-427c574db702 with scrape type 2
2026-03-30 10:52:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05c16c86-1bfc-5f1d-9692-427c574db702, identifier: KG05257
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4184210>
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_f3f72832c91076505033e4d8d6dc1331.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_f3f72832c91076505033e4d8d6dc1331.jpg saved to cache
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c13c811-bcd6-5b20-adad-23614e70558b
2026-03-30 10:52:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9de2dda8-9c86-55bc-aa4e-2242c18db70f with identifier: AP39511
2026-03-30 10:52:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9de2dda8-9c86-55bc-aa4e-2242c18db70f with identifier: AP39511
2026-03-30 10:52:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9de2dda8-9c86-55bc-aa4e-2242c18db70f with identifier: AP39511 to the API
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:27:11Z',
 'fuel_type': 'petrol',
 'id': '9de2dda8-9c86-55bc-aa4e-2242c18db70f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP39511',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 127472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-02',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 T4 Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2020}
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP39511%27 HTTP/1.1" 200 None
2026-03-30 10:52:29 [auto1.de] INFO: Saving data for AP39511: {'auction_closing_time': 1774970831.0, 'created_time': 1773401001.02019, 'last_price_update_time': 1774867949.169152}
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP39511') HTTP/1.1" 204 0
2026-03-30 10:52:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05c16c86-1bfc-5f1d-9692-427c574db702 with identifier: KG05257
2026-03-30 10:52:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05c16c86-1bfc-5f1d-9692-427c574db702 with identifier: KG05257
2026-03-30 10:52:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05c16c86-1bfc-5f1d-9692-427c574db702 with identifier: KG05257 to the API
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:21:08Z',
 'fuel_type': 'petrol',
 'id': '05c16c86-1bfc-5f1d-9692-427c574db702',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG05257',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 191709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-28',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.4 Turbo Super',
 'transmission': 'manual',
 'trim': 'Super',
 'year': 2011}
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG05257%27 HTTP/1.1" 200 None
2026-03-30 10:52:29 [auto1.de] INFO: Saving data for KG05257: {'auction_closing_time': 1774970468.0, 'created_time': 1774380165.555553, 'last_price_update_time': 1774867949.494398}
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG05257') HTTP/1.1" 204 0
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_2a7f3cbc5d6bf00adb667bee00738daa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_2a7f3cbc5d6bf00adb667bee00738daa.jpg not downloaded yet
2026-03-30 10:52:29 [auto1.de] INFO: Found listing with ID: HX44251
2026-03-30 10:52:29 [auto1.de] INFO: Found listing with ID: LK57603
2026-03-30 10:52:29 [auto1.de] INFO: Found listing with ID: VA46995
2026-03-30 10:52:29 [auto1.de] INFO: Found listing with ID: TH61541
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH61541%27 HTTP/1.1" 200 None
2026-03-30 10:52:29 [auto1.de] INFO: Scrape type for TH61541: 2
2026-03-30 10:52:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccb4c404-8343-552d-aad8-aafe20377df2 with identifier: TH61541
2026-03-30 10:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccb4c404-8343-552d-aad8-aafe20377df2 with scrape type 2
2026-03-30 10:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccb4c404-8343-552d-aad8-aafe20377df2 with scrape type 2
2026-03-30 10:52:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccb4c404-8343-552d-aad8-aafe20377df2, identifier: TH61541
2026-03-30 10:52:29 [auto1.de] INFO: Found listing with ID: WU35652
2026-03-30 10:52:29 [auto1.de] INFO: Found listing with ID: PT76912
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT76912%27 HTTP/1.1" 200 None
2026-03-30 10:52:29 [auto1.de] INFO: Scrape type for PT76912: 2
2026-03-30 10:52:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ab8cf58-2996-5020-bf86-26dacb129914 with identifier: PT76912
2026-03-30 10:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab8cf58-2996-5020-bf86-26dacb129914 with scrape type 2
2026-03-30 10:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ab8cf58-2996-5020-bf86-26dacb129914 with scrape type 2
2026-03-30 10:52:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ab8cf58-2996-5020-bf86-26dacb129914, identifier: PT76912
2026-03-30 10:52:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccb4c404-8343-552d-aad8-aafe20377df2 with identifier: TH61541
2026-03-30 10:52:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccb4c404-8343-552d-aad8-aafe20377df2 with identifier: TH61541
2026-03-30 10:52:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccb4c404-8343-552d-aad8-aafe20377df2 with identifier: TH61541 to the API
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:50:18Z',
 'fuel_type': 'petrol',
 'id': 'ccb4c404-8343-552d-aad8-aafe20377df2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH61541',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 147248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-29',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH61541%27 HTTP/1.1" 200 None
2026-03-30 10:52:30 [auto1.de] INFO: Saving data for TH61541: {'auction_closing_time': 1774972218.0, 'created_time': 1773138248.717236, 'last_price_update_time': 1774867950.093798}
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH61541') HTTP/1.1" 204 0
2026-03-30 10:52:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ab8cf58-2996-5020-bf86-26dacb129914 with identifier: PT76912
2026-03-30 10:52:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ab8cf58-2996-5020-bf86-26dacb129914 with identifier: PT76912
2026-03-30 10:52:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ab8cf58-2996-5020-bf86-26dacb129914 with identifier: PT76912 to the API
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:22:47Z',
 'fuel_type': 'petrol',
 'id': '4ab8cf58-2996-5020-bf86-26dacb129914',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT76912',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 99278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-15',
 'seller_name': None,
 'title': 'BMW 3er 328i xDrive',
 'transmission': 'manual',
 'trim': 'xDrive',
 'year': 2015}
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT76912%27 HTTP/1.1" 200 None
2026-03-30 10:52:30 [auto1.de] INFO: Saving data for PT76912: {'auction_closing_time': 1774970567.0, 'created_time': 1773945983.971481, 'last_price_update_time': 1774867950.520075}
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT76912') HTTP/1.1" 204 0
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_1716d1679d9653672b342ff4b7b5c6be.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_1716d1679d9653672b342ff4b7b5c6be.jpg not downloaded yet
2026-03-30 10:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU91066/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:30 [auto1.de] INFO: Found listing with ID: RX33159
2026-03-30 10:52:30 [auto1.de] INFO: Found listing with ID: UA01329
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA01329%27 HTTP/1.1" 200 None
2026-03-30 10:52:30 [auto1.de] INFO: Scrape type for UA01329: 0
2026-03-30 10:52:30 [auto1.de] INFO: Found listing with ID: XH73530
2026-03-30 10:52:30 [auto1.de] INFO: Found listing with ID: HZ35623
2026-03-30 10:52:30 [auto1.de] INFO: Found listing with ID: RG19344
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG19344%27 HTTP/1.1" 200 None
2026-03-30 10:52:30 [auto1.de] INFO: Scrape type for RG19344: 2
2026-03-30 10:52:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee2b5476-2ece-5f8d-948f-50af2f362d77 with identifier: RG19344
2026-03-30 10:52:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee2b5476-2ece-5f8d-948f-50af2f362d77 with scrape type 2
2026-03-30 10:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee2b5476-2ece-5f8d-948f-50af2f362d77 with scrape type 2
2026-03-30 10:52:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee2b5476-2ece-5f8d-948f-50af2f362d77, identifier: RG19344
2026-03-30 10:52:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee2b5476-2ece-5f8d-948f-50af2f362d77 with identifier: RG19344
2026-03-30 10:52:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee2b5476-2ece-5f8d-948f-50af2f362d77 with identifier: RG19344
2026-03-30 10:52:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee2b5476-2ece-5f8d-948f-50af2f362d77 with identifier: RG19344 to the API
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:37:31Z',
 'fuel_type': 'petrol',
 'id': 'ee2b5476-2ece-5f8d-948f-50af2f362d77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG19344',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 22571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-09',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2020}
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG19344%27 HTTP/1.1" 200 None
2026-03-30 10:52:31 [auto1.de] INFO: Saving data for RG19344: {'auction_closing_time': 1774971451.0, 'created_time': 1773341019.26721, 'last_price_update_time': 1774867951.422981}
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG19344') HTTP/1.1" 204 0
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_b68fb3f484ebdac7a47ab4a9001484ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_b68fb3f484ebdac7a47ab4a9001484ce.jpg not downloaded yet
2026-03-30 10:52:31 [auto1.de] INFO: Found listing with ID: RU06451
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU06451%27 HTTP/1.1" 200 None
2026-03-30 10:52:31 [auto1.de] INFO: Scrape type for RU06451: 2
2026-03-30 10:52:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab16d304-26ec-5e66-aa40-7414863e945c with identifier: RU06451
2026-03-30 10:52:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab16d304-26ec-5e66-aa40-7414863e945c with scrape type 2
2026-03-30 10:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab16d304-26ec-5e66-aa40-7414863e945c with scrape type 2
2026-03-30 10:52:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab16d304-26ec-5e66-aa40-7414863e945c, identifier: RU06451
2026-03-30 10:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_0af9a6659146820364de4c2a25134de6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab16d304-26ec-5e66-aa40-7414863e945c with identifier: RU06451
2026-03-30 10:52:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab16d304-26ec-5e66-aa40-7414863e945c with identifier: RU06451
2026-03-30 10:52:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab16d304-26ec-5e66-aa40-7414863e945c with identifier: RU06451 to the API
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:54:28Z',
 'fuel_type': 'diesel',
 'id': 'ab16d304-26ec-5e66-aa40-7414863e945c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU06451',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 194278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-13',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'automatic',
 'trim': 'Kinetic',
 'year': 2016}
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU06451%27 HTTP/1.1" 200 None
2026-03-30 10:52:31 [auto1.de] INFO: Saving data for RU06451: {'auction_closing_time': 1774972468.0, 'created_time': 1773662074.660319, 'last_price_update_time': 1774867951.982748}
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU06451') HTTP/1.1" 204 0
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_b7c6d98cbe85c4340643bffae9ac0615.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_b7c6d98cbe85c4340643bffae9ac0615.jpg not downloaded yet
2026-03-30 10:52:32 [auto1.de] INFO: Found listing with ID: AJ11776
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ11776%27 HTTP/1.1" 200 None
2026-03-30 10:52:32 [auto1.de] INFO: Scrape type for AJ11776: 2
2026-03-30 10:52:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61113246-5e9c-5c68-8949-1b73dfab0232 with identifier: AJ11776
2026-03-30 10:52:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61113246-5e9c-5c68-8949-1b73dfab0232 with scrape type 2
2026-03-30 10:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61113246-5e9c-5c68-8949-1b73dfab0232 with scrape type 2
2026-03-30 10:52:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61113246-5e9c-5c68-8949-1b73dfab0232, identifier: AJ11776
2026-03-30 10:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_3c18051c3903eac6c8fcd41c89a7a5c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61113246-5e9c-5c68-8949-1b73dfab0232 with identifier: AJ11776
2026-03-30 10:52:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61113246-5e9c-5c68-8949-1b73dfab0232 with identifier: AJ11776
2026-03-30 10:52:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61113246-5e9c-5c68-8949-1b73dfab0232 with identifier: AJ11776 to the API
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:44:35Z',
 'fuel_type': 'petrol',
 'id': '61113246-5e9c-5c68-8949-1b73dfab0232',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ11776',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 113506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-18',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2007}
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ11776%27 HTTP/1.1" 200 None
2026-03-30 10:52:32 [auto1.de] INFO: Saving data for AJ11776: {'auction_closing_time': 1774971875.0, 'created_time': 1773688189.073789, 'last_price_update_time': 1774867952.48089}
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ11776') HTTP/1.1" 204 0
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_bca51d1f487db8cdd063e1b63c947d3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_bca51d1f487db8cdd063e1b63c947d3a.jpg not downloaded yet
2026-03-30 10:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_14176733f48f5929ff9fc9677a8e2eaa.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:32 [auto1.de] INFO: Found listing with ID: VX77411
2026-03-30 10:52:32 [auto1.de] INFO: Found listing with ID: KP51039
2026-03-30 10:52:32 [auto1.de] INFO: Found listing with ID: NB84936
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB84936%27 HTTP/1.1" 200 None
2026-03-30 10:52:32 [auto1.de] INFO: Scrape type for NB84936: 2
2026-03-30 10:52:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1c6f029-057b-5d1c-a218-93079a15f44a with identifier: NB84936
2026-03-30 10:52:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1c6f029-057b-5d1c-a218-93079a15f44a with scrape type 2
2026-03-30 10:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1c6f029-057b-5d1c-a218-93079a15f44a with scrape type 2
2026-03-30 10:52:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1c6f029-057b-5d1c-a218-93079a15f44a, identifier: NB84936
2026-03-30 10:52:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:32 [auto1.de] INFO: Channel: 24h | Page: 40 | totalHits: 9511 | hits on page: 40
2026-03-30 10:52:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee71ad0>
2026-03-30 10:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_0af9a6659146820364de4c2a25134de6.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_0af9a6659146820364de4c2a25134de6.jpg saved to cache
2026-03-30 10:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf849b51-5476-510a-9c44-d5cfc3761ae0
2026-03-30 10:52:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1c6f029-057b-5d1c-a218-93079a15f44a with identifier: NB84936
2026-03-30 10:52:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1c6f029-057b-5d1c-a218-93079a15f44a with identifier: NB84936
2026-03-30 10:52:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1c6f029-057b-5d1c-a218-93079a15f44a with identifier: NB84936 to the API
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:59:53Z',
 'fuel_type': 'diesel',
 'id': 'd1c6f029-057b-5d1c-a218-93079a15f44a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB84936',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 82035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-19',
 'seller_name': None,
 'title': 'BMW 1er 120d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB84936%27 HTTP/1.1" 200 None
2026-03-30 10:52:33 [auto1.de] INFO: Saving data for NB84936: {'auction_closing_time': 1774972793.0, 'created_time': 1774290716.285123, 'last_price_update_time': 1774867953.05818}
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB84936') HTTP/1.1" 204 0
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_5bedde0409c34e815860e231910f4e39.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_5bedde0409c34e815860e231910f4e39.jpg not downloaded yet
2026-03-30 10:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_2a7f3cbc5d6bf00adb667bee00738daa.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_1716d1679d9653672b342ff4b7b5c6be.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:33 [auto1.de] INFO: Found listing with ID: YD41840
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD41840%27 HTTP/1.1" 200 None
2026-03-30 10:52:33 [auto1.de] INFO: Scrape type for YD41840: 2
2026-03-30 10:52:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fe0a936-f20d-54b1-a2e8-b093b0e6301e with identifier: YD41840
2026-03-30 10:52:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fe0a936-f20d-54b1-a2e8-b093b0e6301e with scrape type 2
2026-03-30 10:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fe0a936-f20d-54b1-a2e8-b093b0e6301e with scrape type 2
2026-03-30 10:52:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2fe0a936-f20d-54b1-a2e8-b093b0e6301e, identifier: YD41840
2026-03-30 10:52:33 [auto1.de] INFO: Found listing with ID: CY08035
2026-03-30 10:52:33 [auto1.de] INFO: Found listing with ID: TW05114
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW05114%27 HTTP/1.1" 200 None
2026-03-30 10:52:33 [auto1.de] INFO: Scrape type for TW05114: 2
2026-03-30 10:52:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b3d1140-a018-5e9a-aec3-ab59909a0438 with identifier: TW05114
2026-03-30 10:52:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b3d1140-a018-5e9a-aec3-ab59909a0438 with scrape type 2
2026-03-30 10:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b3d1140-a018-5e9a-aec3-ab59909a0438 with scrape type 2
2026-03-30 10:52:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b3d1140-a018-5e9a-aec3-ab59909a0438, identifier: TW05114
2026-03-30 10:52:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f48090d0>
2026-03-30 10:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_3c18051c3903eac6c8fcd41c89a7a5c9.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_3c18051c3903eac6c8fcd41c89a7a5c9.jpg saved to cache
2026-03-30 10:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf849b51-5476-510a-9c44-d5cfc3761ae0
2026-03-30 10:52:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2fe0a936-f20d-54b1-a2e8-b093b0e6301e with identifier: YD41840
2026-03-30 10:52:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2fe0a936-f20d-54b1-a2e8-b093b0e6301e with identifier: YD41840
2026-03-30 10:52:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2fe0a936-f20d-54b1-a2e8-b093b0e6301e with identifier: YD41840 to the API
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:41:13Z',
 'fuel_type': 'petrol',
 'id': '2fe0a936-f20d-54b1-a2e8-b093b0e6301e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD41840',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 16148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 200 Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2024}
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD41840%27 HTTP/1.1" 200 None
2026-03-30 10:52:33 [auto1.de] INFO: Saving data for YD41840: {'auction_closing_time': 1774971673.0, 'created_time': 1773138127.640182, 'last_price_update_time': 1774867953.786756}
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD41840') HTTP/1.1" 204 0
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_87646ace84be7bda77bacc1be76110d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_87646ace84be7bda77bacc1be76110d7.jpg not downloaded yet
2026-03-30 10:52:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b3d1140-a018-5e9a-aec3-ab59909a0438 with identifier: TW05114
2026-03-30 10:52:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b3d1140-a018-5e9a-aec3-ab59909a0438 with identifier: TW05114
2026-03-30 10:52:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b3d1140-a018-5e9a-aec3-ab59909a0438 with identifier: TW05114 to the API
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:50:38Z',
 'fuel_type': 'petrol',
 'id': '0b3d1140-a018-5e9a-aec3-ab59909a0438',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW05114',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 103451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-10',
 'seller_name': None,
 'title': 'Nissan Juke 1.2 N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2016}
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW05114%27 HTTP/1.1" 200 None
2026-03-30 10:52:34 [auto1.de] INFO: Saving data for TW05114: {'auction_closing_time': 1774972238.0, 'created_time': 1773688654.826526, 'last_price_update_time': 1774867954.36248}
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW05114') HTTP/1.1" 204 0
2026-03-30 10:52:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee97f10>
2026-03-30 10:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_14176733f48f5929ff9fc9677a8e2eaa.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_14176733f48f5929ff9fc9677a8e2eaa.jpg saved to cache
2026-03-30 10:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf849b51-5476-510a-9c44-d5cfc3761ae0
2026-03-30 10:52:34 [auto1.de] INFO: Found listing with ID: HV49065
2026-03-30 10:52:34 [auto1.de] INFO: Found listing with ID: LT89325
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT89325%27 HTTP/1.1" 200 None
2026-03-30 10:52:34 [auto1.de] INFO: Scrape type for LT89325: 2
2026-03-30 10:52:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8a8b413-0a29-50fd-89d3-a8cc38f126ea with identifier: LT89325
2026-03-30 10:52:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8a8b413-0a29-50fd-89d3-a8cc38f126ea with scrape type 2
2026-03-30 10:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8a8b413-0a29-50fd-89d3-a8cc38f126ea with scrape type 2
2026-03-30 10:52:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8a8b413-0a29-50fd-89d3-a8cc38f126ea, identifier: LT89325
2026-03-30 10:52:34 [auto1.de] INFO: Found listing with ID: ZE91614
2026-03-30 10:52:34 [auto1.de] INFO: Found listing with ID: XH30445
2026-03-30 10:52:34 [auto1.de] INFO: Found listing with ID: RB04302
2026-03-30 10:52:34 [auto1.de] INFO: Found listing with ID: HZ29181
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ29181%27 HTTP/1.1" 200 None
2026-03-30 10:52:34 [auto1.de] INFO: Scrape type for HZ29181: 2
2026-03-30 10:52:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89a81db8-8255-5a2c-ad38-f70d795bbb13 with identifier: HZ29181
2026-03-30 10:52:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89a81db8-8255-5a2c-ad38-f70d795bbb13 with scrape type 2
2026-03-30 10:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89a81db8-8255-5a2c-ad38-f70d795bbb13 with scrape type 2
2026-03-30 10:52:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89a81db8-8255-5a2c-ad38-f70d795bbb13, identifier: HZ29181
2026-03-30 10:52:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8a8b413-0a29-50fd-89d3-a8cc38f126ea with identifier: LT89325
2026-03-30 10:52:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8a8b413-0a29-50fd-89d3-a8cc38f126ea with identifier: LT89325
2026-03-30 10:52:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8a8b413-0a29-50fd-89d3-a8cc38f126ea with identifier: LT89325 to the API
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:50:36Z',
 'fuel_type': 'petrol',
 'id': 'd8a8b413-0a29-50fd-89d3-a8cc38f126ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT89325',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 114804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-14',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 112',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT89325%27 HTTP/1.1" 200 None
2026-03-30 10:52:35 [auto1.de] INFO: Saving data for LT89325: {'auction_closing_time': 1774972236.0, 'created_time': 1774377088.673573, 'last_price_update_time': 1774867955.101136}
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT89325') HTTP/1.1" 204 0
2026-03-30 10:52:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89a81db8-8255-5a2c-ad38-f70d795bbb13 with identifier: HZ29181
2026-03-30 10:52:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89a81db8-8255-5a2c-ad38-f70d795bbb13 with identifier: HZ29181
2026-03-30 10:52:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89a81db8-8255-5a2c-ad38-f70d795bbb13 with identifier: HZ29181 to the API
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:41:48Z',
 'fuel_type': 'diesel',
 'id': '89a81db8-8255-5a2c-ad38-f70d795bbb13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ29181',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 150816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2016}
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ29181%27 HTTP/1.1" 200 None
2026-03-30 10:52:35 [auto1.de] INFO: Saving data for HZ29181: {'auction_closing_time': 1774971708.0, 'created_time': 1773399293.560248, 'last_price_update_time': 1774867955.499432}
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ29181') HTTP/1.1" 204 0
2026-03-30 10:52:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef61510>
2026-03-30 10:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_2a7f3cbc5d6bf00adb667bee00738daa.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_2a7f3cbc5d6bf00adb667bee00738daa.jpg saved to cache
2026-03-30 10:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf849b51-5476-510a-9c44-d5cfc3761ae0
2026-03-30 10:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea0f90>
2026-03-30 10:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_1716d1679d9653672b342ff4b7b5c6be.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_1716d1679d9653672b342ff4b7b5c6be.jpg saved to cache
2026-03-30 10:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf849b51-5476-510a-9c44-d5cfc3761ae0
2026-03-30 10:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_b68fb3f484ebdac7a47ab4a9001484ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:35 [auto1.de] INFO: Found listing with ID: RG79664
2026-03-30 10:52:35 [auto1.de] INFO: Found listing with ID: GC11554
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC11554%27 HTTP/1.1" 200 None
2026-03-30 10:52:35 [auto1.de] INFO: Scrape type for GC11554: 2
2026-03-30 10:52:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca2b059f-36bd-5526-bfb1-83819d204e72 with identifier: GC11554
2026-03-30 10:52:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca2b059f-36bd-5526-bfb1-83819d204e72 with scrape type 2
2026-03-30 10:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca2b059f-36bd-5526-bfb1-83819d204e72 with scrape type 2
2026-03-30 10:52:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca2b059f-36bd-5526-bfb1-83819d204e72, identifier: GC11554
2026-03-30 10:52:35 [auto1.de] INFO: Found listing with ID: FK23500
2026-03-30 10:52:35 [auto1.de] INFO: Found listing with ID: TH64703
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH64703%27 HTTP/1.1" 200 None
2026-03-30 10:52:35 [auto1.de] INFO: Scrape type for TH64703: 2
2026-03-30 10:52:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0565032c-8a0b-5799-8251-dc5bdde8c2da with identifier: TH64703
2026-03-30 10:52:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0565032c-8a0b-5799-8251-dc5bdde8c2da with scrape type 2
2026-03-30 10:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0565032c-8a0b-5799-8251-dc5bdde8c2da with scrape type 2
2026-03-30 10:52:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0565032c-8a0b-5799-8251-dc5bdde8c2da, identifier: TH64703
2026-03-30 10:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_3b074b3127b9b70e69626707ea121e41.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca2b059f-36bd-5526-bfb1-83819d204e72 with identifier: GC11554
2026-03-30 10:52:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca2b059f-36bd-5526-bfb1-83819d204e72 with identifier: GC11554
2026-03-30 10:52:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca2b059f-36bd-5526-bfb1-83819d204e72 with identifier: GC11554 to the API
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:26:16Z',
 'fuel_type': 'petrol',
 'id': 'ca2b059f-36bd-5526-bfb1-83819d204e72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC11554',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 102506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI R 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'R 4Motion BlueMotion Tech',
 'year': 2014}
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC11554%27 HTTP/1.1" 200 None
2026-03-30 10:52:36 [auto1.de] INFO: Saving data for GC11554: {'auction_closing_time': 1774970776.0, 'created_time': 1774435947.798014, 'last_price_update_time': 1774867956.245164}
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC11554') HTTP/1.1" 204 0
2026-03-30 10:52:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0565032c-8a0b-5799-8251-dc5bdde8c2da with identifier: TH64703
2026-03-30 10:52:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0565032c-8a0b-5799-8251-dc5bdde8c2da with identifier: TH64703
2026-03-30 10:52:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0565032c-8a0b-5799-8251-dc5bdde8c2da with identifier: TH64703 to the API
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:17:25Z',
 'fuel_type': 'diesel',
 'id': '0565032c-8a0b-5799-8251-dc5bdde8c2da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH64703',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 181261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-01',
 'seller_name': None,
 'title': 'Ford Ranger 2.5 TD Doka 4x4',
 'transmission': 'manual',
 'trim': 'Doka 4x4',
 'year': 2006}
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH64703%27 HTTP/1.1" 200 None
2026-03-30 10:52:36 [auto1.de] INFO: Saving data for TH64703: {'auction_closing_time': 1774970245.0, 'created_time': 1773725419.063961, 'last_price_update_time': 1774867956.584966}
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH64703') HTTP/1.1" 204 0
2026-03-30 10:52:36 [auto1.de] INFO: Found listing with ID: ES17453
2026-03-30 10:52:36 [auto1.de] INFO: Found listing with ID: BG27502
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG27502%27 HTTP/1.1" 200 None
2026-03-30 10:52:36 [auto1.de] INFO: Scrape type for BG27502: 2
2026-03-30 10:52:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9680988a-4e3c-56ee-a2c1-a4617ede8a44 with identifier: BG27502
2026-03-30 10:52:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9680988a-4e3c-56ee-a2c1-a4617ede8a44 with scrape type 2
2026-03-30 10:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9680988a-4e3c-56ee-a2c1-a4617ede8a44 with scrape type 2
2026-03-30 10:52:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9680988a-4e3c-56ee-a2c1-a4617ede8a44, identifier: BG27502
2026-03-30 10:52:36 [auto1.de] INFO: Found listing with ID: DE15792
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE15792%27 HTTP/1.1" 200 None
2026-03-30 10:52:36 [auto1.de] INFO: Scrape type for DE15792: 2
2026-03-30 10:52:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33f0c423-a340-55e1-b558-a562dc54ab50 with identifier: DE15792
2026-03-30 10:52:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33f0c423-a340-55e1-b558-a562dc54ab50 with scrape type 2
2026-03-30 10:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33f0c423-a340-55e1-b558-a562dc54ab50 with scrape type 2
2026-03-30 10:52:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33f0c423-a340-55e1-b558-a562dc54ab50, identifier: DE15792
2026-03-30 10:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_b7c6d98cbe85c4340643bffae9ac0615.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9680988a-4e3c-56ee-a2c1-a4617ede8a44 with identifier: BG27502
2026-03-30 10:52:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9680988a-4e3c-56ee-a2c1-a4617ede8a44 with identifier: BG27502
2026-03-30 10:52:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9680988a-4e3c-56ee-a2c1-a4617ede8a44 with identifier: BG27502 to the API
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:08:01Z',
 'fuel_type': 'petrol',
 'id': '9680988a-4e3c-56ee-a2c1-a4617ede8a44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG27502',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 145477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-03',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG27502%27 HTTP/1.1" 200 None
2026-03-30 10:52:37 [auto1.de] INFO: Saving data for BG27502: {'auction_closing_time': 1774969681.0, 'created_time': 1773858811.369283, 'last_price_update_time': 1774867957.356247}
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG27502') HTTP/1.1" 204 0
2026-03-30 10:52:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33f0c423-a340-55e1-b558-a562dc54ab50 with identifier: DE15792
2026-03-30 10:52:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33f0c423-a340-55e1-b558-a562dc54ab50 with identifier: DE15792
2026-03-30 10:52:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33f0c423-a340-55e1-b558-a562dc54ab50 with identifier: DE15792 to the API
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:52:48Z',
 'fuel_type': 'diesel',
 'id': '33f0c423-a340-55e1-b558-a562dc54ab50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE15792',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Grand Sport',
 'odometer': 69841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-02',
 'seller_name': None,
 'title': 'Opel Insignia Grand Sport 2.0 CDTI GSi 4x4',
 'transmission': 'automatic',
 'trim': 'GSi 4x4',
 'year': 2017}
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE15792%27 HTTP/1.1" 200 None
2026-03-30 10:52:37 [auto1.de] INFO: Saving data for DE15792: {'auction_closing_time': 1774972368.0, 'created_time': 1774636904.02845, 'last_price_update_time': 1774867957.806604}
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE15792') HTTP/1.1" 204 0
2026-03-30 10:52:37 [auto1.de] INFO: Found listing with ID: RU55030
2026-03-30 10:52:37 [auto1.de] INFO: Found listing with ID: NZ32797
2026-03-30 10:52:37 [auto1.de] INFO: Found listing with ID: HB39069
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB39069%27 HTTP/1.1" 200 None
2026-03-30 10:52:37 [auto1.de] INFO: Scrape type for HB39069: 2
2026-03-30 10:52:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ad51cf2-f30f-5d00-8f9e-f2872d185d7c with identifier: HB39069
2026-03-30 10:52:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ad51cf2-f30f-5d00-8f9e-f2872d185d7c with scrape type 2
2026-03-30 10:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ad51cf2-f30f-5d00-8f9e-f2872d185d7c with scrape type 2
2026-03-30 10:52:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ad51cf2-f30f-5d00-8f9e-f2872d185d7c, identifier: HB39069
2026-03-30 10:52:37 [auto1.de] INFO: Found listing with ID: TN06340
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN06340%27 HTTP/1.1" 200 None
2026-03-30 10:52:37 [auto1.de] INFO: Scrape type for TN06340: 2
2026-03-30 10:52:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 841fb0f5-dfe3-589a-8e5a-1371c0dc03e4 with identifier: TN06340
2026-03-30 10:52:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 841fb0f5-dfe3-589a-8e5a-1371c0dc03e4 with scrape type 2
2026-03-30 10:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 841fb0f5-dfe3-589a-8e5a-1371c0dc03e4 with scrape type 2
2026-03-30 10:52:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 841fb0f5-dfe3-589a-8e5a-1371c0dc03e4, identifier: TN06340
2026-03-30 10:52:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee482550>
2026-03-30 10:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_b68fb3f484ebdac7a47ab4a9001484ce.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_b68fb3f484ebdac7a47ab4a9001484ce.jpg saved to cache
2026-03-30 10:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf849b51-5476-510a-9c44-d5cfc3761ae0
2026-03-30 10:52:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f416c1d0>
2026-03-30 10:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fc2%252F99c2cfa2aef037f1d9ef1a25c5666f89%252Fpa%252FRL62864_3b074b3127b9b70e69626707ea121e41.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_3b074b3127b9b70e69626707ea121e41.jpg saved to cache
2026-03-30 10:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c13c811-bcd6-5b20-adad-23614e70558b
2026-03-30 10:52:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c13c811-bcd6-5b20-adad-23614e70558b, skipping ID generation
2026-03-30 10:52:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c13c811-bcd6-5b20-adad-23614e70558b with scrape type 1
2026-03-30 10:52:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c13c811-bcd6-5b20-adad-23614e70558b sending to next pipeline
2026-03-30 10:52:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c13c811-bcd6-5b20-adad-23614e70558b, identifier: RL62864
2026-03-30 10:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_bca51d1f487db8cdd063e1b63c947d3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ad51cf2-f30f-5d00-8f9e-f2872d185d7c with identifier: HB39069
2026-03-30 10:52:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ad51cf2-f30f-5d00-8f9e-f2872d185d7c with identifier: HB39069
2026-03-30 10:52:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ad51cf2-f30f-5d00-8f9e-f2872d185d7c with identifier: HB39069 to the API
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:46:36Z',
 'fuel_type': 'diesel',
 'id': '9ad51cf2-f30f-5d00-8f9e-f2872d185d7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB39069',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 145182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-07',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 CDTI DPF Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB39069%27 HTTP/1.1" 200 None
2026-03-30 10:52:38 [auto1.de] INFO: Saving data for HB39069: {'auction_closing_time': 1774971996.0, 'created_time': 1773428857.199602, 'last_price_update_time': 1774867958.770181}
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB39069') HTTP/1.1" 204 0
2026-03-30 10:52:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 841fb0f5-dfe3-589a-8e5a-1371c0dc03e4 with identifier: TN06340
2026-03-30 10:52:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 841fb0f5-dfe3-589a-8e5a-1371c0dc03e4 with identifier: TN06340
2026-03-30 10:52:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 841fb0f5-dfe3-589a-8e5a-1371c0dc03e4 with identifier: TN06340 to the API
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-31T15:53:31Z',
 'fuel_type': 'hybrid',
 'id': '841fb0f5-dfe3-589a-8e5a-1371c0dc03e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN06340',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 12705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-10-22',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid 4x4',
 'transmission': 'automatic',
 'trim': '4x4',
 'year': 2025}
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN06340%27 HTTP/1.1" 200 None
2026-03-30 10:52:39 [auto1.de] INFO: Saving data for TN06340: {'auction_closing_time': 1774972411.0, 'created_time': 1773133139.383074, 'last_price_update_time': 1774867959.211461}
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN06340') HTTP/1.1" 204 0
2026-03-30 10:52:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c13c811-bcd6-5b20-adad-23614e70558b with identifier: RL62864
2026-03-30 10:52:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c13c811-bcd6-5b20-adad-23614e70558b with identifier: RL62864
2026-03-30 10:52:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c13c811-bcd6-5b20-adad-23614e70558b with identifier: RL62864 to the API
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_3b074b3127b9b70e69626707ea121e41.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 275,
 'expiration_date': '2026-03-31T15:15:40Z',
 'fuel_type': 'diesel',
 'id': '5c13c811-bcd6-5b20-adad-23614e70558b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL62864',
 'listing': 'auction',
 'location': 'DE, Neumünster',
 'make': 'Jaguar',
 'model': 'XJ',
 'odometer': 228403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2570306,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_3b074b3127b9b70e69626707ea121e41.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_a7066ea8a89ce44fbd9b38b1b8c8aaf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_f3f72832c91076505033e4d8d6dc1331.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_a2cd25a8a11b05eb91f8e0ada57055d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_ec6d50bd488654420e7e74ba76b8e497.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_574c68a26693168d92a979f84d767bc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_1611279ea68f3fd443bf9d7d116919d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_6119771b269860a73fccf0c894e318f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_1a81da17a05f581772c306674b71ec4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c13c811-bcd6-5b20-adad-23614e70558b/5c13c811-bcd6-5b20-adad-23614e70558b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/c2/99c2cfa2aef037f1d9ef1a25c5666f89/pa/RL62864_04301a9433d893769eece46e44670a96.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar XJ 3.0 D V6 Portfolio Lang',
 'transmission': 'automatic',
 'trim': 'Portfolio Lang',
 'year': 2010}
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL62864%27 HTTP/1.1" 200 None
2026-03-30 10:52:39 [auto1.de] INFO: Saving data for RL62864: {'created_time': 1774867959.580169, 'last_price_update_time': 1774867959.580182, 'auction_closing_time': 1774970140.0}
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL62864') HTTP/1.1" 204 0
2026-03-30 10:52:39 [auto1.de] INFO: Found listing with ID: GM14403
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM14403%27 HTTP/1.1" 200 None
2026-03-30 10:52:39 [auto1.de] INFO: Scrape type for GM14403: 2
2026-03-30 10:52:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25ee8c34-0049-5f2b-bc9b-73979f1f077e with identifier: GM14403
2026-03-30 10:52:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25ee8c34-0049-5f2b-bc9b-73979f1f077e with scrape type 2
2026-03-30 10:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25ee8c34-0049-5f2b-bc9b-73979f1f077e with scrape type 2
2026-03-30 10:52:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25ee8c34-0049-5f2b-bc9b-73979f1f077e, identifier: GM14403
2026-03-30 10:52:39 [auto1.de] INFO: Found listing with ID: DK78572
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK78572%27 HTTP/1.1" 200 None
2026-03-30 10:52:39 [auto1.de] INFO: Scrape type for DK78572: 2
2026-03-30 10:52:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e26e0e61-b9ac-5b01-b6e0-c1666595f6da with identifier: DK78572
2026-03-30 10:52:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e26e0e61-b9ac-5b01-b6e0-c1666595f6da with scrape type 2
2026-03-30 10:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e26e0e61-b9ac-5b01-b6e0-c1666595f6da with scrape type 2
2026-03-30 10:52:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e26e0e61-b9ac-5b01-b6e0-c1666595f6da, identifier: DK78572
2026-03-30 10:52:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f427aa10>
2026-03-30 10:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_b7c6d98cbe85c4340643bffae9ac0615.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_b7c6d98cbe85c4340643bffae9ac0615.jpg saved to cache
2026-03-30 10:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf849b51-5476-510a-9c44-d5cfc3761ae0
2026-03-30 10:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_5bedde0409c34e815860e231910f4e39.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25ee8c34-0049-5f2b-bc9b-73979f1f077e with identifier: GM14403
2026-03-30 10:52:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25ee8c34-0049-5f2b-bc9b-73979f1f077e with identifier: GM14403
2026-03-30 10:52:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25ee8c34-0049-5f2b-bc9b-73979f1f077e with identifier: GM14403 to the API
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:01:37Z',
 'fuel_type': 'petrol',
 'id': '25ee8c34-0049-5f2b-bc9b-73979f1f077e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM14403',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 154577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-09',
 'seller_name': None,
 'title': 'Renault Megane 1.2 Paris',
 'transmission': 'manual',
 'trim': 'Paris',
 'year': 2013}
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM14403%27 HTTP/1.1" 200 None
2026-03-30 10:52:40 [auto1.de] INFO: Saving data for GM14403: {'auction_closing_time': 1774969297.0, 'created_time': 1774377219.391184, 'last_price_update_time': 1774867960.258156}
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM14403') HTTP/1.1" 204 0
2026-03-30 10:52:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e26e0e61-b9ac-5b01-b6e0-c1666595f6da with identifier: DK78572
2026-03-30 10:52:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e26e0e61-b9ac-5b01-b6e0-c1666595f6da with identifier: DK78572
2026-03-30 10:52:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e26e0e61-b9ac-5b01-b6e0-c1666595f6da with identifier: DK78572 to the API
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:07:07Z',
 'fuel_type': 'petrol',
 'id': 'e26e0e61-b9ac-5b01-b6e0-c1666595f6da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK78572',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 20176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-02',
 'seller_name': None,
 'title': 'Hyundai ix35 1.6 Classic 2WD',
 'transmission': 'manual',
 'trim': 'Classic 2WD',
 'year': 2023}
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK78572%27 HTTP/1.1" 200 None
2026-03-30 10:52:40 [auto1.de] INFO: Saving data for DK78572: {'auction_closing_time': 1774969627.0, 'created_time': 1773427539.969986, 'last_price_update_time': 1774867960.581827}
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK78572') HTTP/1.1" 204 0
2026-03-30 10:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_87646ace84be7bda77bacc1be76110d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:40 [auto1.de] INFO: Found listing with ID: CJ93593
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ93593%27 HTTP/1.1" 200 None
2026-03-30 10:52:40 [auto1.de] INFO: Scrape type for CJ93593: 2
2026-03-30 10:52:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84bc66c3-877a-50dc-907f-3163de04a618 with identifier: CJ93593
2026-03-30 10:52:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84bc66c3-877a-50dc-907f-3163de04a618 with scrape type 2
2026-03-30 10:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84bc66c3-877a-50dc-907f-3163de04a618 with scrape type 2
2026-03-30 10:52:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84bc66c3-877a-50dc-907f-3163de04a618, identifier: CJ93593
2026-03-30 10:52:40 [auto1.de] INFO: Found listing with ID: EG23428
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG23428%27 HTTP/1.1" 200 None
2026-03-30 10:52:40 [auto1.de] INFO: Scrape type for EG23428: 2
2026-03-30 10:52:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2382b11c-1c9a-5e5d-8b83-7829aa9ff382 with identifier: EG23428
2026-03-30 10:52:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2382b11c-1c9a-5e5d-8b83-7829aa9ff382 with scrape type 2
2026-03-30 10:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2382b11c-1c9a-5e5d-8b83-7829aa9ff382 with scrape type 2
2026-03-30 10:52:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2382b11c-1c9a-5e5d-8b83-7829aa9ff382, identifier: EG23428
2026-03-30 10:52:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84bc66c3-877a-50dc-907f-3163de04a618 with identifier: CJ93593
2026-03-30 10:52:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84bc66c3-877a-50dc-907f-3163de04a618 with identifier: CJ93593
2026-03-30 10:52:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84bc66c3-877a-50dc-907f-3163de04a618 with identifier: CJ93593 to the API
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:52:48Z',
 'fuel_type': 'diesel',
 'id': '84bc66c3-877a-50dc-907f-3163de04a618',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ93593',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 256333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-06',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ93593%27 HTTP/1.1" 200 None
2026-03-30 10:52:41 [auto1.de] INFO: Saving data for CJ93593: {'auction_closing_time': 1774972368.0, 'created_time': 1773305411.456223, 'last_price_update_time': 1774867961.209686}
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ93593') HTTP/1.1" 204 0
2026-03-30 10:52:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2382b11c-1c9a-5e5d-8b83-7829aa9ff382 with identifier: EG23428
2026-03-30 10:52:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2382b11c-1c9a-5e5d-8b83-7829aa9ff382 with identifier: EG23428
2026-03-30 10:52:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2382b11c-1c9a-5e5d-8b83-7829aa9ff382 with identifier: EG23428 to the API
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:09:08Z',
 'fuel_type': 'diesel',
 'id': '2382b11c-1c9a-5e5d-8b83-7829aa9ff382',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG23428',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 238817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-09',
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI quattro Ambiente',
 'transmission': 'automatic',
 'trim': 'quattro Ambiente',
 'year': 2012}
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG23428%27 HTTP/1.1" 200 None
2026-03-30 10:52:41 [auto1.de] INFO: Saving data for EG23428: {'auction_closing_time': 1774969748.0, 'created_time': 1773306689.114075, 'last_price_update_time': 1774867961.576482}
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG23428') HTTP/1.1" 204 0
2026-03-30 10:52:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeebf450>
2026-03-30 10:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_bca51d1f487db8cdd063e1b63c947d3a.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_bca51d1f487db8cdd063e1b63c947d3a.jpg saved to cache
2026-03-30 10:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf849b51-5476-510a-9c44-d5cfc3761ae0
2026-03-30 10:52:41 [auto1.de] INFO: Found listing with ID: ZL92656
2026-03-30 10:52:41 [auto1.de] INFO: Found listing with ID: EZ66449
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ66449%27 HTTP/1.1" 200 None
2026-03-30 10:52:41 [auto1.de] INFO: Scrape type for EZ66449: 2
2026-03-30 10:52:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faa88d73-7bc5-5d60-8a61-e79ecef0cc33 with identifier: EZ66449
2026-03-30 10:52:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faa88d73-7bc5-5d60-8a61-e79ecef0cc33 with scrape type 2
2026-03-30 10:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faa88d73-7bc5-5d60-8a61-e79ecef0cc33 with scrape type 2
2026-03-30 10:52:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: faa88d73-7bc5-5d60-8a61-e79ecef0cc33, identifier: EZ66449
2026-03-30 10:52:41 [auto1.de] INFO: Found listing with ID: FM04287
2026-03-30 10:52:41 [auto1.de] INFO: Found listing with ID: KV82053
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV82053%27 HTTP/1.1" 200 None
2026-03-30 10:52:41 [auto1.de] INFO: Scrape type for KV82053: 2
2026-03-30 10:52:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 289a159c-811a-5606-932d-482c63966009 with identifier: KV82053
2026-03-30 10:52:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 289a159c-811a-5606-932d-482c63966009 with scrape type 2
2026-03-30 10:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 289a159c-811a-5606-932d-482c63966009 with scrape type 2
2026-03-30 10:52:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 289a159c-811a-5606-932d-482c63966009, identifier: KV82053
2026-03-30 10:52:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: faa88d73-7bc5-5d60-8a61-e79ecef0cc33 with identifier: EZ66449
2026-03-30 10:52:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: faa88d73-7bc5-5d60-8a61-e79ecef0cc33 with identifier: EZ66449
2026-03-30 10:52:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: faa88d73-7bc5-5d60-8a61-e79ecef0cc33 with identifier: EZ66449 to the API
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:03:29Z',
 'fuel_type': 'diesel',
 'id': 'faa88d73-7bc5-5d60-8a61-e79ecef0cc33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ66449',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 182350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-26',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC Exclusive',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Exclusive',
 'year': 2015}
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ66449%27 HTTP/1.1" 200 None
2026-03-30 10:52:42 [auto1.de] INFO: Saving data for EZ66449: {'auction_closing_time': 1774969409.0, 'created_time': 1774379939.466551, 'last_price_update_time': 1774867962.283375}
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ66449') HTTP/1.1" 204 0
2026-03-30 10:52:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 289a159c-811a-5606-932d-482c63966009 with identifier: KV82053
2026-03-30 10:52:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 289a159c-811a-5606-932d-482c63966009 with identifier: KV82053
2026-03-30 10:52:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 289a159c-811a-5606-932d-482c63966009 with identifier: KV82053 to the API
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:28:12Z',
 'fuel_type': 'diesel',
 'id': '289a159c-811a-5606-932d-482c63966009',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV82053',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 257761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-15',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI 150 Jahre Opel',
 'transmission': 'manual',
 'trim': '150 Jahre',
 'year': 2012}
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV82053%27 HTTP/1.1" 200 None
2026-03-30 10:52:42 [auto1.de] INFO: Saving data for KV82053: {'auction_closing_time': 1774970892.0, 'created_time': 1774380253.872124, 'last_price_update_time': 1774867962.711153}
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV82053') HTTP/1.1" 204 0
2026-03-30 10:52:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f60c0290>
2026-03-30 10:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_5bedde0409c34e815860e231910f4e39.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_5bedde0409c34e815860e231910f4e39.jpg saved to cache
2026-03-30 10:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf849b51-5476-510a-9c44-d5cfc3761ae0
2026-03-30 10:52:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f593c410>
2026-03-30 10:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F55%252F9755df746b6b3f9b10482441cc777e1f%252Fpa%252FSY34780_87646ace84be7bda77bacc1be76110d7.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_87646ace84be7bda77bacc1be76110d7.jpg saved to cache
2026-03-30 10:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf849b51-5476-510a-9c44-d5cfc3761ae0
2026-03-30 10:52:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf849b51-5476-510a-9c44-d5cfc3761ae0, skipping ID generation
2026-03-30 10:52:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf849b51-5476-510a-9c44-d5cfc3761ae0 with scrape type 1
2026-03-30 10:52:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf849b51-5476-510a-9c44-d5cfc3761ae0 sending to next pipeline
2026-03-30 10:52:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf849b51-5476-510a-9c44-d5cfc3761ae0, identifier: SY34780
2026-03-30 10:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_42ca2f9ed3c22a1b4ffa6c6788424555.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:42 [auto1.de] INFO: Found listing with ID: AK28209
2026-03-30 10:52:42 [auto1.de] INFO: Found listing with ID: HX41929
2026-03-30 10:52:42 [auto1.de] INFO: Found listing with ID: JS41418
2026-03-30 10:52:42 [auto1.de] INFO: Found listing with ID: DZ26668
2026-03-30 10:52:42 [auto1.de] INFO: Found listing with ID: MH07331
2026-03-30 10:52:42 [auto1.de] INFO: Found listing with ID: WW97819
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW97819%27 HTTP/1.1" 200 None
2026-03-30 10:52:43 [auto1.de] INFO: Scrape type for WW97819: 2
2026-03-30 10:52:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45413a58-7743-5467-a5c1-9544a3b17fa3 with identifier: WW97819
2026-03-30 10:52:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45413a58-7743-5467-a5c1-9544a3b17fa3 with scrape type 2
2026-03-30 10:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45413a58-7743-5467-a5c1-9544a3b17fa3 with scrape type 2
2026-03-30 10:52:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45413a58-7743-5467-a5c1-9544a3b17fa3, identifier: WW97819
2026-03-30 10:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU91066> (referer: https://www.auto1.com/v1/car-details-view/XU91066/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf849b51-5476-510a-9c44-d5cfc3761ae0 with identifier: SY34780
2026-03-30 10:52:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf849b51-5476-510a-9c44-d5cfc3761ae0 with identifier: SY34780
2026-03-30 10:52:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf849b51-5476-510a-9c44-d5cfc3761ae0 with identifier: SY34780 to the API
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_87646ace84be7bda77bacc1be76110d7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 82,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:27:55Z',
 'fuel_type': 'hybrid',
 'id': 'cf849b51-5476-510a-9c44-d5cfc3761ae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY34780',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 38214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 417125,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_0af9a6659146820364de4c2a25134de6.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 391940,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_3c18051c3903eac6c8fcd41c89a7a5c9.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383543,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_14176733f48f5929ff9fc9677a8e2eaa.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330804,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_2a7f3cbc5d6bf00adb667bee00738daa.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_1716d1679d9653672b342ff4b7b5c6be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390960,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_b68fb3f484ebdac7a47ab4a9001484ce.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344767,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_b7c6d98cbe85c4340643bffae9ac0615.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 415128,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_bca51d1f487db8cdd063e1b63c947d3a.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402708,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_5bedde0409c34e815860e231910f4e39.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf849b51-5476-510a-9c44-d5cfc3761ae0/cf849b51-5476-510a-9c44-d5cfc3761ae0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381810,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img97/55/9755df746b6b3f9b10482441cc777e1f/pa/SY34780_87646ace84be7bda77bacc1be76110d7.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Auris 1.8 Hybrid Edition-S',
 'transmission': 'automatic',
 'trim': 'Edition-S',
 'year': 2016}
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY34780%27 HTTP/1.1" 200 None
2026-03-30 10:52:43 [auto1.de] INFO: Saving data for SY34780: {'created_time': 1774867963.507683, 'last_price_update_time': 1774867963.507692, 'auction_closing_time': 1774970875.0}
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY34780') HTTP/1.1" 204 0
2026-03-30 10:52:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45413a58-7743-5467-a5c1-9544a3b17fa3 with identifier: WW97819
2026-03-30 10:52:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45413a58-7743-5467-a5c1-9544a3b17fa3 with identifier: WW97819
2026-03-30 10:52:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45413a58-7743-5467-a5c1-9544a3b17fa3 with identifier: WW97819 to the API
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:00:08Z',
 'fuel_type': 'diesel',
 'id': '45413a58-7743-5467-a5c1-9544a3b17fa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW97819',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 188805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-21',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2017}
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW97819%27 HTTP/1.1" 200 None
2026-03-30 10:52:43 [auto1.de] INFO: Saving data for WW97819: {'auction_closing_time': 1774969208.0, 'created_time': 1774467731.255433, 'last_price_update_time': 1774867963.887315}
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW97819') HTTP/1.1" 204 0
2026-03-30 10:52:43 [auto1.de] INFO: Found listing with ID: AW11286
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW11286%27 HTTP/1.1" 200 None
2026-03-30 10:52:43 [auto1.de] INFO: Scrape type for AW11286: 2
2026-03-30 10:52:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87ffafcd-fdae-5197-b8a1-c7baed916c29 with identifier: AW11286
2026-03-30 10:52:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87ffafcd-fdae-5197-b8a1-c7baed916c29 with scrape type 2
2026-03-30 10:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87ffafcd-fdae-5197-b8a1-c7baed916c29 with scrape type 2
2026-03-30 10:52:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87ffafcd-fdae-5197-b8a1-c7baed916c29, identifier: AW11286
2026-03-30 10:52:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87ffafcd-fdae-5197-b8a1-c7baed916c29 with identifier: AW11286
2026-03-30 10:52:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87ffafcd-fdae-5197-b8a1-c7baed916c29 with identifier: AW11286
2026-03-30 10:52:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87ffafcd-fdae-5197-b8a1-c7baed916c29 with identifier: AW11286 to the API
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:29:31Z',
 'fuel_type': 'petrol',
 'id': '87ffafcd-fdae-5197-b8a1-c7baed916c29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW11286',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 154650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-26',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Sportline',
 'transmission': 'manual',
 'trim': 'Sportline',
 'year': 2009}
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW11286%27 HTTP/1.1" 200 None
2026-03-30 10:52:44 [auto1.de] INFO: Saving data for AW11286: {'auction_closing_time': 1774970971.0, 'created_time': 1774416657.302754, 'last_price_update_time': 1774867964.329223}
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW11286') HTTP/1.1" 204 0
2026-03-30 10:52:44 [auto1.de] INFO: Found listing with ID: GV09238
2026-03-30 10:52:44 [auto1.de] INFO: Found listing with ID: DC75837
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC75837%27 HTTP/1.1" 200 None
2026-03-30 10:52:44 [auto1.de] INFO: Scrape type for DC75837: 2
2026-03-30 10:52:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94217a75-801c-56f7-9779-3c70cc5d8712 with identifier: DC75837
2026-03-30 10:52:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94217a75-801c-56f7-9779-3c70cc5d8712 with scrape type 2
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94217a75-801c-56f7-9779-3c70cc5d8712 with scrape type 2
2026-03-30 10:52:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94217a75-801c-56f7-9779-3c70cc5d8712, identifier: DC75837
2026-03-30 10:52:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4378550>
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F49%252F7e491570de15f496193030382d4777ef%252Fpa%252FSP29379_42ca2f9ed3c22a1b4ffa6c6788424555.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_42ca2f9ed3c22a1b4ffa6c6788424555.jpg saved to cache
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7aef1684-8f11-51f3-b018-9f199981ee63
2026-03-30 10:52:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7aef1684-8f11-51f3-b018-9f199981ee63, skipping ID generation
2026-03-30 10:52:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aef1684-8f11-51f3-b018-9f199981ee63 with scrape type 1
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7aef1684-8f11-51f3-b018-9f199981ee63 sending to next pipeline
2026-03-30 10:52:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7aef1684-8f11-51f3-b018-9f199981ee63, identifier: SP29379
2026-03-30 10:52:44 [auto1.de] INFO: Channel: 24h | Page: 41 | totalHits: 9512 | hits on page: 40
2026-03-30 10:52:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db with identifier: XU91066
2026-03-30 10:52:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db with scrape type 1
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_a55f61487bd87cd7897eeb831b2651db.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_a55f61487bd87cd7897eeb831b2651db.jpg not downloaded yet
2026-03-30 10:52:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94217a75-801c-56f7-9779-3c70cc5d8712 with identifier: DC75837
2026-03-30 10:52:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94217a75-801c-56f7-9779-3c70cc5d8712 with identifier: DC75837
2026-03-30 10:52:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94217a75-801c-56f7-9779-3c70cc5d8712 with identifier: DC75837 to the API
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:40:39Z',
 'fuel_type': 'petrol',
 'id': '94217a75-801c-56f7-9779-3c70cc5d8712',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC75837',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 88203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-14',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 City',
 'transmission': 'manual',
 'trim': 'City',
 'year': 2009}
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC75837%27 HTTP/1.1" 200 None
2026-03-30 10:52:45 [auto1.de] INFO: Saving data for DC75837: {'auction_closing_time': 1774971639.0, 'created_time': 1774467688.966554, 'last_price_update_time': 1774867965.167931}
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC75837') HTTP/1.1" 204 0
2026-03-30 10:52:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7aef1684-8f11-51f3-b018-9f199981ee63 with identifier: SP29379
2026-03-30 10:52:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7aef1684-8f11-51f3-b018-9f199981ee63 with identifier: SP29379
2026-03-30 10:52:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7aef1684-8f11-51f3-b018-9f199981ee63 with identifier: SP29379 to the API
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_42ca2f9ed3c22a1b4ffa6c6788424555.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 132,
 'expiration_date': '2026-03-31T15:13:03Z',
 'fuel_type': 'petrol',
 'id': '7aef1684-8f11-51f3-b018-9f199981ee63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP29379',
 'listing': 'auction',
 'location': 'DE, Lübeck',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 136103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_9a8aba7e8cc5cbee4325910ce0a32645.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_ca49e6d9c0d7ad13bcd7a50e3a207f09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_cd19884c29608978dac17fdf2398967a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_1585ad229a9bf2edc1416a1bd743b880.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_0ef1e9bf670956de0a15241baec66058.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_e67edbcfcf19e2cb6022ab8e0fb460f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_e02503714f48d0836efafe675a2da611.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_291ab4f88c5101e0d7a136b56a76ca29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_421fc4a47b9cf6591abae6e803a8c3d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aef1684-8f11-51f3-b018-9f199981ee63/7aef1684-8f11-51f3-b018-9f199981ee63_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2364401,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/49/7e491570de15f496193030382d4777ef/pa/SP29379_42ca2f9ed3c22a1b4ffa6c6788424555.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Dream Team 2WD',
 'transmission': 'manual',
 'trim': 'Dream Team 2WD',
 'year': 2018}
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP29379%27 HTTP/1.1" 200 None
2026-03-30 10:52:45 [auto1.de] INFO: Saving data for SP29379: {'created_time': 1774867965.574141, 'last_price_update_time': 1774867965.574153, 'auction_closing_time': 1774969983.0}
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP29379') HTTP/1.1" 204 0
2026-03-30 10:52:45 [auto1.de] INFO: Found listing with ID: CW68462
2026-03-30 10:52:45 [auto1.de] INFO: Found listing with ID: UY74069
2026-03-30 10:52:45 [auto1.de] INFO: Found listing with ID: DH94169
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH94169%27 HTTP/1.1" 200 None
2026-03-30 10:52:45 [auto1.de] INFO: Scrape type for DH94169: 2
2026-03-30 10:52:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90ff884f-6475-5e4d-be9e-c9483bc48eaf with identifier: DH94169
2026-03-30 10:52:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90ff884f-6475-5e4d-be9e-c9483bc48eaf with scrape type 2
2026-03-30 10:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90ff884f-6475-5e4d-be9e-c9483bc48eaf with scrape type 2
2026-03-30 10:52:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90ff884f-6475-5e4d-be9e-c9483bc48eaf, identifier: DH94169
2026-03-30 10:52:45 [auto1.de] INFO: Found listing with ID: NB36369
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB36369%27 HTTP/1.1" 200 None
2026-03-30 10:52:45 [auto1.de] INFO: Scrape type for NB36369: 2
2026-03-30 10:52:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 339a0b5c-f5ba-52f0-8974-a51fc4b5544f with identifier: NB36369
2026-03-30 10:52:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 339a0b5c-f5ba-52f0-8974-a51fc4b5544f with scrape type 2
2026-03-30 10:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 339a0b5c-f5ba-52f0-8974-a51fc4b5544f with scrape type 2
2026-03-30 10:52:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 339a0b5c-f5ba-52f0-8974-a51fc4b5544f, identifier: NB36369
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_d2fe809f7891462adc0b38ac60809ec4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_d2fe809f7891462adc0b38ac60809ec4.jpg not downloaded yet
2026-03-30 10:52:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90ff884f-6475-5e4d-be9e-c9483bc48eaf with identifier: DH94169
2026-03-30 10:52:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90ff884f-6475-5e4d-be9e-c9483bc48eaf with identifier: DH94169
2026-03-30 10:52:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90ff884f-6475-5e4d-be9e-c9483bc48eaf with identifier: DH94169 to the API
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 52,
 'expiration_date': '2026-03-31T15:44:06Z',
 'fuel_type': 'petrol',
 'id': '90ff884f-6475-5e4d-be9e-c9483bc48eaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH94169',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Matiz',
 'odometer': 90069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-10',
 'seller_name': None,
 'title': 'Chevrolet Matiz 0.8 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2009}
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH94169%27 HTTP/1.1" 200 None
2026-03-30 10:52:46 [auto1.de] INFO: Saving data for DH94169: {'auction_closing_time': 1774971846.0, 'created_time': 1774467409.083668, 'last_price_update_time': 1774867966.335757}
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DH94169') HTTP/1.1" 204 0
2026-03-30 10:52:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 339a0b5c-f5ba-52f0-8974-a51fc4b5544f with identifier: NB36369
2026-03-30 10:52:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 339a0b5c-f5ba-52f0-8974-a51fc4b5544f with identifier: NB36369
2026-03-30 10:52:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 339a0b5c-f5ba-52f0-8974-a51fc4b5544f with identifier: NB36369 to the API
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:51:51Z',
 'fuel_type': 'diesel',
 'id': '339a0b5c-f5ba-52f0-8974-a51fc4b5544f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB36369',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 101774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-17',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2015}
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB36369%27 HTTP/1.1" 200 None
2026-03-30 10:52:46 [auto1.de] INFO: Saving data for NB36369: {'auction_closing_time': 1774972311.0, 'created_time': 1773775404.749041, 'last_price_update_time': 1774867966.870997}
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB36369') HTTP/1.1" 204 0
2026-03-30 10:52:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:46 [auto1.de] INFO: Found listing with ID: KX28982
2026-03-30 10:52:46 [auto1.de] INFO: Found listing with ID: ZC73277
2026-03-30 10:52:46 [auto1.de] INFO: Found listing with ID: HS45664
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS45664%27 HTTP/1.1" 200 None
2026-03-30 10:52:46 [auto1.de] INFO: Scrape type for HS45664: 2
2026-03-30 10:52:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff638725-de6a-5a4c-aa71-694a40809f29 with identifier: HS45664
2026-03-30 10:52:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff638725-de6a-5a4c-aa71-694a40809f29 with scrape type 2
2026-03-30 10:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff638725-de6a-5a4c-aa71-694a40809f29 with scrape type 2
2026-03-30 10:52:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff638725-de6a-5a4c-aa71-694a40809f29, identifier: HS45664
2026-03-30 10:52:47 [auto1.de] INFO: Found listing with ID: EW88282
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW88282%27 HTTP/1.1" 200 None
2026-03-30 10:52:47 [auto1.de] INFO: Scrape type for EW88282: 2
2026-03-30 10:52:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dccdb28-986a-56b5-adcb-c76be90951ab with identifier: EW88282
2026-03-30 10:52:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dccdb28-986a-56b5-adcb-c76be90951ab with scrape type 2
2026-03-30 10:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8dccdb28-986a-56b5-adcb-c76be90951ab with scrape type 2
2026-03-30 10:52:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8dccdb28-986a-56b5-adcb-c76be90951ab, identifier: EW88282
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_560030b216a03d7d35d826f66c7f0fc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_560030b216a03d7d35d826f66c7f0fc9.jpg not downloaded yet
2026-03-30 10:52:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff638725-de6a-5a4c-aa71-694a40809f29 with identifier: HS45664
2026-03-30 10:52:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff638725-de6a-5a4c-aa71-694a40809f29 with identifier: HS45664
2026-03-30 10:52:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff638725-de6a-5a4c-aa71-694a40809f29 with identifier: HS45664 to the API
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:35:50Z',
 'fuel_type': 'petrol',
 'id': 'ff638725-de6a-5a4c-aa71-694a40809f29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS45664',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 143489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-27',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2009}
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS45664%27 HTTP/1.1" 200 None
2026-03-30 10:52:47 [auto1.de] INFO: Saving data for HS45664: {'auction_closing_time': 1774971350.0, 'created_time': 1773662285.698352, 'last_price_update_time': 1774867967.546046}
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS45664') HTTP/1.1" 204 0
2026-03-30 10:52:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8dccdb28-986a-56b5-adcb-c76be90951ab with identifier: EW88282
2026-03-30 10:52:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8dccdb28-986a-56b5-adcb-c76be90951ab with identifier: EW88282
2026-03-30 10:52:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8dccdb28-986a-56b5-adcb-c76be90951ab with identifier: EW88282 to the API
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-31T15:10:33Z',
 'fuel_type': 'diesel',
 'id': '8dccdb28-986a-56b5-adcb-c76be90951ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW88282',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 82154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-14',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Design',
 'transmission': 'automatic',
 'trim': 'quattro Design',
 'year': 2018}
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW88282%27 HTTP/1.1" 200 None
2026-03-30 10:52:47 [auto1.de] INFO: Saving data for EW88282: {'auction_closing_time': 1774969833.0, 'created_time': 1773303077.885287, 'last_price_update_time': 1774867967.907493}
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW88282') HTTP/1.1" 204 0
2026-03-30 10:52:47 [auto1.de] INFO: Found listing with ID: VH45097
2026-03-30 10:52:47 [auto1.de] INFO: Found listing with ID: VN94649
2026-03-30 10:52:47 [auto1.de] INFO: Found listing with ID: CT92868
2026-03-30 10:52:47 [auto1.de] INFO: Found listing with ID: RB55254
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB55254%27 HTTP/1.1" 200 None
2026-03-30 10:52:47 [auto1.de] INFO: Scrape type for RB55254: 2
2026-03-30 10:52:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c09a020c-5b21-548f-983f-9e5158d174d6 with identifier: RB55254
2026-03-30 10:52:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c09a020c-5b21-548f-983f-9e5158d174d6 with scrape type 2
2026-03-30 10:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c09a020c-5b21-548f-983f-9e5158d174d6 with scrape type 2
2026-03-30 10:52:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c09a020c-5b21-548f-983f-9e5158d174d6, identifier: RB55254
2026-03-30 10:52:48 [auto1.de] INFO: Found listing with ID: WR65399
2026-03-30 10:52:48 [auto1.de] INFO: Found listing with ID: UP47374
2026-03-30 10:52:48 [auto1.de] INFO: Found listing with ID: SF02157
2026-03-30 10:52:48 [auto1.de] INFO: Found listing with ID: CE90734
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE90734%27 HTTP/1.1" 200 None
2026-03-30 10:52:48 [auto1.de] INFO: Scrape type for CE90734: 2
2026-03-30 10:52:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bb6e717-7071-5a1b-ad79-8c350b91b4d0 with identifier: CE90734
2026-03-30 10:52:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bb6e717-7071-5a1b-ad79-8c350b91b4d0 with scrape type 2
2026-03-30 10:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bb6e717-7071-5a1b-ad79-8c350b91b4d0 with scrape type 2
2026-03-30 10:52:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1bb6e717-7071-5a1b-ad79-8c350b91b4d0, identifier: CE90734
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_70bef636419eed3fa49d6b6a574159ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_70bef636419eed3fa49d6b6a574159ed.jpg not downloaded yet
2026-03-30 10:52:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c09a020c-5b21-548f-983f-9e5158d174d6 with identifier: RB55254
2026-03-30 10:52:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c09a020c-5b21-548f-983f-9e5158d174d6 with identifier: RB55254
2026-03-30 10:52:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c09a020c-5b21-548f-983f-9e5158d174d6 with identifier: RB55254 to the API
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:09:36Z',
 'fuel_type': 'diesel',
 'id': 'c09a020c-5b21-548f-983f-9e5158d174d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB55254',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 196242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-26',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2015}
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB55254%27 HTTP/1.1" 200 None
2026-03-30 10:52:48 [auto1.de] INFO: Saving data for RB55254: {'auction_closing_time': 1774969776.0, 'created_time': 1774435344.472412, 'last_price_update_time': 1774867968.641159}
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB55254') HTTP/1.1" 204 0
2026-03-30 10:52:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1bb6e717-7071-5a1b-ad79-8c350b91b4d0 with identifier: CE90734
2026-03-30 10:52:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1bb6e717-7071-5a1b-ad79-8c350b91b4d0 with identifier: CE90734
2026-03-30 10:52:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1bb6e717-7071-5a1b-ad79-8c350b91b4d0 with identifier: CE90734 to the API
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:13:15Z',
 'fuel_type': 'diesel',
 'id': '1bb6e717-7071-5a1b-ad79-8c350b91b4d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE90734',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 102570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-11',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L2',
 'transmission': 'manual',
 'trim': '350 L2',
 'year': 2019}
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE90734%27 HTTP/1.1" 200 None
2026-03-30 10:52:49 [auto1.de] INFO: Saving data for CE90734: {'auction_closing_time': 1774969995.0, 'created_time': 1773304314.379508, 'last_price_update_time': 1774867969.143705}
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE90734') HTTP/1.1" 204 0
2026-03-30 10:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_a55f61487bd87cd7897eeb831b2651db.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:49 [auto1.de] INFO: Found listing with ID: CC98432
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC98432%27 HTTP/1.1" 200 None
2026-03-30 10:52:49 [auto1.de] INFO: Scrape type for CC98432: 2
2026-03-30 10:52:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74d91646-5b9b-5eb3-9b1c-b040ff3e9d38 with identifier: CC98432
2026-03-30 10:52:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74d91646-5b9b-5eb3-9b1c-b040ff3e9d38 with scrape type 2
2026-03-30 10:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74d91646-5b9b-5eb3-9b1c-b040ff3e9d38 with scrape type 2
2026-03-30 10:52:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74d91646-5b9b-5eb3-9b1c-b040ff3e9d38, identifier: CC98432
2026-03-30 10:52:49 [auto1.de] INFO: Found listing with ID: LS17715
2026-03-30 10:52:49 [auto1.de] INFO: Found listing with ID: NU16694
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU16694%27 HTTP/1.1" 200 None
2026-03-30 10:52:49 [auto1.de] INFO: Scrape type for NU16694: 2
2026-03-30 10:52:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 584041cb-26eb-51b5-9455-020dedb8d73b with identifier: NU16694
2026-03-30 10:52:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 584041cb-26eb-51b5-9455-020dedb8d73b with scrape type 2
2026-03-30 10:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 584041cb-26eb-51b5-9455-020dedb8d73b with scrape type 2
2026-03-30 10:52:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 584041cb-26eb-51b5-9455-020dedb8d73b, identifier: NU16694
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_4c514e8086343a579ed13e268d369528.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_4c514e8086343a579ed13e268d369528.jpg not downloaded yet
2026-03-30 10:52:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74d91646-5b9b-5eb3-9b1c-b040ff3e9d38 with identifier: CC98432
2026-03-30 10:52:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74d91646-5b9b-5eb3-9b1c-b040ff3e9d38 with identifier: CC98432
2026-03-30 10:52:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74d91646-5b9b-5eb3-9b1c-b040ff3e9d38 with identifier: CC98432 to the API
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-31T15:14:16Z',
 'fuel_type': 'petrol',
 'id': '74d91646-5b9b-5eb3-9b1c-b040ff3e9d38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC98432',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 53805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-27',
 'seller_name': None,
 'title': 'BMW X1 xDrive 25i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC98432%27 HTTP/1.1" 200 None
2026-03-30 10:52:49 [auto1.de] INFO: Saving data for CC98432: {'auction_closing_time': 1774970056.0, 'created_time': 1773657770.284318, 'last_price_update_time': 1774867969.771999}
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC98432') HTTP/1.1" 204 0
2026-03-30 10:52:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 584041cb-26eb-51b5-9455-020dedb8d73b with identifier: NU16694
2026-03-30 10:52:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 584041cb-26eb-51b5-9455-020dedb8d73b with identifier: NU16694
2026-03-30 10:52:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 584041cb-26eb-51b5-9455-020dedb8d73b with identifier: NU16694 to the API
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:05:44Z',
 'fuel_type': 'petrol',
 'id': '584041cb-26eb-51b5-9455-020dedb8d73b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU16694',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 152421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-10-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2001}
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU16694%27 HTTP/1.1" 200 None
2026-03-30 10:52:50 [auto1.de] INFO: Saving data for NU16694: {'auction_closing_time': 1774969544.0, 'created_time': 1773303124.288704, 'last_price_update_time': 1774867970.122466}
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU16694') HTTP/1.1" 204 0
2026-03-30 10:52:50 [auto1.de] INFO: Found listing with ID: DG91683
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG91683%27 HTTP/1.1" 200 None
2026-03-30 10:52:50 [auto1.de] INFO: Scrape type for DG91683: 2
2026-03-30 10:52:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 882f966e-2a6b-5ecd-94b4-b3f565e7e45f with identifier: DG91683
2026-03-30 10:52:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 882f966e-2a6b-5ecd-94b4-b3f565e7e45f with scrape type 2
2026-03-30 10:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 882f966e-2a6b-5ecd-94b4-b3f565e7e45f with scrape type 2
2026-03-30 10:52:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 882f966e-2a6b-5ecd-94b4-b3f565e7e45f, identifier: DG91683
2026-03-30 10:52:50 [auto1.de] INFO: Found listing with ID: VM29679
2026-03-30 10:52:50 [auto1.de] INFO: Found listing with ID: FH51774
2026-03-30 10:52:50 [auto1.de] INFO: Found listing with ID: KX50009
2026-03-30 10:52:50 [auto1.de] INFO: Found listing with ID: SJ22549
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ22549%27 HTTP/1.1" 200 None
2026-03-30 10:52:50 [auto1.de] INFO: Scrape type for SJ22549: 1
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_05592c3ab5ea6e1879dc2c6cff923ac2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_05592c3ab5ea6e1879dc2c6cff923ac2.jpg not downloaded yet
2026-03-30 10:52:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 882f966e-2a6b-5ecd-94b4-b3f565e7e45f with identifier: DG91683
2026-03-30 10:52:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 882f966e-2a6b-5ecd-94b4-b3f565e7e45f with identifier: DG91683
2026-03-30 10:52:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 882f966e-2a6b-5ecd-94b4-b3f565e7e45f with identifier: DG91683 to the API
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:48:29Z',
 'fuel_type': 'diesel',
 'id': '882f966e-2a6b-5ecd-94b4-b3f565e7e45f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG91683',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 201209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-30',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2015}
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG91683%27 HTTP/1.1" 200 None
2026-03-30 10:52:50 [auto1.de] INFO: Saving data for DG91683: {'auction_closing_time': 1774972109.0, 'created_time': 1773860428.160318, 'last_price_update_time': 1774867970.634259}
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG91683') HTTP/1.1" 204 0
2026-03-30 10:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434e950>
2026-03-30 10:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_a55f61487bd87cd7897eeb831b2651db.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_a55f61487bd87cd7897eeb831b2651db.jpg saved to cache
2026-03-30 10:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db
2026-03-30 10:52:50 [auto1.de] INFO: Found listing with ID: MT13851
2026-03-30 10:52:50 [auto1.de] INFO: Found listing with ID: LR92682
2026-03-30 10:52:50 [auto1.de] INFO: Found listing with ID: HE60226
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE60226%27 HTTP/1.1" 200 None
2026-03-30 10:52:50 [auto1.de] INFO: Scrape type for HE60226: 2
2026-03-30 10:52:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 557afb6b-d4c2-55f2-99f7-2edebe517738 with identifier: HE60226
2026-03-30 10:52:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 557afb6b-d4c2-55f2-99f7-2edebe517738 with scrape type 2
2026-03-30 10:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 557afb6b-d4c2-55f2-99f7-2edebe517738 with scrape type 2
2026-03-30 10:52:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 557afb6b-d4c2-55f2-99f7-2edebe517738, identifier: HE60226
2026-03-30 10:52:50 [auto1.de] INFO: Found listing with ID: AZ58179
2026-03-30 10:52:50 [auto1.de] INFO: Found listing with ID: RE35722
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE35722%27 HTTP/1.1" 200 None
2026-03-30 10:52:50 [auto1.de] INFO: Scrape type for RE35722: 2
2026-03-30 10:52:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 676989ec-3ca7-57a0-a6e3-45cd996630e3 with identifier: RE35722
2026-03-30 10:52:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 676989ec-3ca7-57a0-a6e3-45cd996630e3 with scrape type 2
2026-03-30 10:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 676989ec-3ca7-57a0-a6e3-45cd996630e3 with scrape type 2
2026-03-30 10:52:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 676989ec-3ca7-57a0-a6e3-45cd996630e3, identifier: RE35722
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_6ad29e24e3ec70f14f7a5119e41d148b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_6ad29e24e3ec70f14f7a5119e41d148b.jpg not downloaded yet
2026-03-30 10:52:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 557afb6b-d4c2-55f2-99f7-2edebe517738 with identifier: HE60226
2026-03-30 10:52:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 557afb6b-d4c2-55f2-99f7-2edebe517738 with identifier: HE60226
2026-03-30 10:52:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 557afb6b-d4c2-55f2-99f7-2edebe517738 with identifier: HE60226 to the API
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:45:15Z',
 'fuel_type': 'petrol',
 'id': '557afb6b-d4c2-55f2-99f7-2edebe517738',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE60226',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 179585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-09',
 'seller_name': None,
 'title': 'Ford Galaxy 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE60226%27 HTTP/1.1" 200 None
2026-03-30 10:52:51 [auto1.de] INFO: Saving data for HE60226: {'auction_closing_time': 1774971915.0, 'created_time': 1774416656.479321, 'last_price_update_time': 1774867971.583967}
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE60226') HTTP/1.1" 204 0
2026-03-30 10:52:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 676989ec-3ca7-57a0-a6e3-45cd996630e3 with identifier: RE35722
2026-03-30 10:52:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 676989ec-3ca7-57a0-a6e3-45cd996630e3 with identifier: RE35722
2026-03-30 10:52:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 676989ec-3ca7-57a0-a6e3-45cd996630e3 with identifier: RE35722 to the API
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:49:35Z',
 'fuel_type': 'diesel',
 'id': '676989ec-3ca7-57a0-a6e3-45cd996630e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE35722',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 257799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-11-28',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2004}
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE35722%27 HTTP/1.1" 200 None
2026-03-30 10:52:52 [auto1.de] INFO: Saving data for RE35722: {'auction_closing_time': 1774972175.0, 'created_time': 1772541098.869295, 'last_price_update_time': 1774867972.167267}
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE35722') HTTP/1.1" 204 0
2026-03-30 10:52:52 [auto1.de] INFO: Found listing with ID: DW40061
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW40061%27 HTTP/1.1" 200 None
2026-03-30 10:52:52 [auto1.de] INFO: Scrape type for DW40061: 2
2026-03-30 10:52:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0190cfc6-9a6e-5bbb-9270-954c686c4aac with identifier: DW40061
2026-03-30 10:52:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0190cfc6-9a6e-5bbb-9270-954c686c4aac with scrape type 2
2026-03-30 10:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0190cfc6-9a6e-5bbb-9270-954c686c4aac with scrape type 2
2026-03-30 10:52:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0190cfc6-9a6e-5bbb-9270-954c686c4aac, identifier: DW40061
2026-03-30 10:52:52 [auto1.de] INFO: Found listing with ID: FY00951
2026-03-30 10:52:52 [auto1.de] INFO: Found listing with ID: MS56284
2026-03-30 10:52:52 [auto1.de] INFO: Found listing with ID: GZ67786
2026-03-30 10:52:52 [auto1.de] INFO: Found listing with ID: LU25444
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU25444%27 HTTP/1.1" 200 None
2026-03-30 10:52:52 [auto1.de] INFO: Scrape type for LU25444: 1
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_093f42fd475722cafb32ae6173dfa8a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_093f42fd475722cafb32ae6173dfa8a3.jpg not downloaded yet
2026-03-30 10:52:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0190cfc6-9a6e-5bbb-9270-954c686c4aac with identifier: DW40061
2026-03-30 10:52:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0190cfc6-9a6e-5bbb-9270-954c686c4aac with identifier: DW40061
2026-03-30 10:52:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0190cfc6-9a6e-5bbb-9270-954c686c4aac with identifier: DW40061 to the API
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:15:47Z',
 'fuel_type': 'diesel',
 'id': '0190cfc6-9a6e-5bbb-9270-954c686c4aac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW40061',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 126169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-10',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2013}
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW40061%27 HTTP/1.1" 200 None
2026-03-30 10:52:52 [auto1.de] INFO: Saving data for DW40061: {'auction_closing_time': 1774970147.0, 'created_time': 1773662114.843097, 'last_price_update_time': 1774867972.779392}
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW40061') HTTP/1.1" 204 0
2026-03-30 10:52:52 [auto1.de] INFO: Found listing with ID: AZ98687
2026-03-30 10:52:52 [auto1.de] INFO: Found listing with ID: EC94378
2026-03-30 10:52:52 [auto1.de] INFO: Found listing with ID: AV92070
2026-03-30 10:52:52 [auto1.de] INFO: Found listing with ID: XM74841
2026-03-30 10:52:52 [auto1.de] INFO: Found listing with ID: ZZ04091
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ04091%27 HTTP/1.1" 200 None
2026-03-30 10:52:52 [auto1.de] INFO: Scrape type for ZZ04091: 2
2026-03-30 10:52:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ba081fe-4db7-5522-8f31-401bd6c37a14 with identifier: ZZ04091
2026-03-30 10:52:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ba081fe-4db7-5522-8f31-401bd6c37a14 with scrape type 2
2026-03-30 10:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ba081fe-4db7-5522-8f31-401bd6c37a14 with scrape type 2
2026-03-30 10:52:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ba081fe-4db7-5522-8f31-401bd6c37a14, identifier: ZZ04091
2026-03-30 10:52:52 [auto1.de] INFO: Found listing with ID: GS24649
2026-03-30 10:52:52 [auto1.de] INFO: Found listing with ID: TX62945
2026-03-30 10:52:52 [auto1.de] INFO: Found listing with ID: CS66629
2026-03-30 10:52:52 [auto1.de] INFO: Found listing with ID: WG42712
2026-03-30 10:52:52 [auto1.de] INFO: Found listing with ID: TJ01230
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ01230%27 HTTP/1.1" 200 None
2026-03-30 10:52:52 [auto1.de] INFO: Scrape type for TJ01230: 2
2026-03-30 10:52:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a57d026-cd2e-5d76-88f4-e60b5c28e6b3 with identifier: TJ01230
2026-03-30 10:52:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a57d026-cd2e-5d76-88f4-e60b5c28e6b3 with scrape type 2
2026-03-30 10:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a57d026-cd2e-5d76-88f4-e60b5c28e6b3 with scrape type 2
2026-03-30 10:52:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a57d026-cd2e-5d76-88f4-e60b5c28e6b3, identifier: TJ01230
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_29d1d4900a6861420349c5e9efd3fe04.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_29d1d4900a6861420349c5e9efd3fe04.jpg not downloaded yet
2026-03-30 10:52:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ba081fe-4db7-5522-8f31-401bd6c37a14 with identifier: ZZ04091
2026-03-30 10:52:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ba081fe-4db7-5522-8f31-401bd6c37a14 with identifier: ZZ04091
2026-03-30 10:52:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ba081fe-4db7-5522-8f31-401bd6c37a14 with identifier: ZZ04091 to the API
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:18:06Z',
 'fuel_type': 'petrol',
 'id': '1ba081fe-4db7-5522-8f31-401bd6c37a14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ04091',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 123596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-22',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2015}
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ04091%27 HTTP/1.1" 200 None
2026-03-30 10:52:53 [auto1.de] INFO: Saving data for ZZ04091: {'auction_closing_time': 1774970286.0, 'created_time': 1774350420.660253, 'last_price_update_time': 1774867973.380585}
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ04091') HTTP/1.1" 204 0
2026-03-30 10:52:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a57d026-cd2e-5d76-88f4-e60b5c28e6b3 with identifier: TJ01230
2026-03-30 10:52:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a57d026-cd2e-5d76-88f4-e60b5c28e6b3 with identifier: TJ01230
2026-03-30 10:52:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a57d026-cd2e-5d76-88f4-e60b5c28e6b3 with identifier: TJ01230 to the API
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:54:09Z',
 'fuel_type': 'petrol',
 'id': '5a57d026-cd2e-5d76-88f4-e60b5c28e6b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ01230',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 151246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-31',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI ACT Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ01230%27 HTTP/1.1" 200 None
2026-03-30 10:52:53 [auto1.de] INFO: Saving data for TJ01230: {'auction_closing_time': 1774972449.0, 'created_time': 1772541237.997133, 'last_price_update_time': 1774867973.827319}
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ01230') HTTP/1.1" 204 0
2026-03-30 10:52:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:53 [auto1.de] INFO: Found listing with ID: NB36369
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB36369%27 HTTP/1.1" 200 None
2026-03-30 10:52:53 [auto1.de] INFO: Scrape type for NB36369: 0
2026-03-30 10:52:53 [auto1.de] INFO: Found listing with ID: XK45819
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK45819%27 HTTP/1.1" 200 None
2026-03-30 10:52:53 [auto1.de] INFO: Scrape type for XK45819: 2
2026-03-30 10:52:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 591dd401-0db7-5a10-bc79-504dbe3f64cf with identifier: XK45819
2026-03-30 10:52:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 591dd401-0db7-5a10-bc79-504dbe3f64cf with scrape type 2
2026-03-30 10:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 591dd401-0db7-5a10-bc79-504dbe3f64cf with scrape type 2
2026-03-30 10:52:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 591dd401-0db7-5a10-bc79-504dbe3f64cf, identifier: XK45819
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_8314ca5bd7d57a78fa55895b50e04d55.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_8314ca5bd7d57a78fa55895b50e04d55.jpg not downloaded yet
2026-03-30 10:52:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 591dd401-0db7-5a10-bc79-504dbe3f64cf with identifier: XK45819
2026-03-30 10:52:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 591dd401-0db7-5a10-bc79-504dbe3f64cf with identifier: XK45819
2026-03-30 10:52:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 591dd401-0db7-5a10-bc79-504dbe3f64cf with identifier: XK45819 to the API
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-31T15:30:42Z',
 'fuel_type': 'hybrid',
 'id': '591dd401-0db7-5a10-bc79-504dbe3f64cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK45819',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 228055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-02',
 'seller_name': None,
 'title': 'Audi A6 55 TFSIe quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2020}
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK45819%27 HTTP/1.1" 200 None
2026-03-30 10:52:54 [auto1.de] INFO: Saving data for XK45819: {'auction_closing_time': 1774971042.0, 'created_time': 1774379534.38694, 'last_price_update_time': 1774867974.353255}
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK45819') HTTP/1.1" 204 0
2026-03-30 10:52:54 [auto1.de] INFO: Found listing with ID: VC88612
2026-03-30 10:52:54 [auto1.de] INFO: Found listing with ID: DF78416
2026-03-30 10:52:54 [auto1.de] INFO: Found listing with ID: HM31508
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM31508%27 HTTP/1.1" 200 None
2026-03-30 10:52:54 [auto1.de] INFO: Scrape type for HM31508: 2
2026-03-30 10:52:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a23e58e-8b73-5448-ac99-420f8531481b with identifier: HM31508
2026-03-30 10:52:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a23e58e-8b73-5448-ac99-420f8531481b with scrape type 2
2026-03-30 10:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a23e58e-8b73-5448-ac99-420f8531481b with scrape type 2
2026-03-30 10:52:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a23e58e-8b73-5448-ac99-420f8531481b, identifier: HM31508
2026-03-30 10:52:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a23e58e-8b73-5448-ac99-420f8531481b with identifier: HM31508
2026-03-30 10:52:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a23e58e-8b73-5448-ac99-420f8531481b with identifier: HM31508
2026-03-30 10:52:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a23e58e-8b73-5448-ac99-420f8531481b with identifier: HM31508 to the API
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:23:25Z',
 'fuel_type': 'petrol',
 'id': '4a23e58e-8b73-5448-ac99-420f8531481b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM31508',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 67373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-30',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Sound BlueMotion',
 'transmission': 'manual',
 'trim': 'Sound BlueMotion',
 'year': 2017}
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM31508%27 HTTP/1.1" 200 None
2026-03-30 10:52:54 [auto1.de] INFO: Saving data for HM31508: {'auction_closing_time': 1774970605.0, 'created_time': 1773307188.733071, 'last_price_update_time': 1774867974.822448}
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM31508') HTTP/1.1" 204 0
2026-03-30 10:52:54 [auto1.de] INFO: Found listing with ID: XB67892
2026-03-30 10:52:54 [auto1.de] INFO: Found listing with ID: DS57993
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS57993%27 HTTP/1.1" 200 None
2026-03-30 10:52:54 [auto1.de] INFO: Scrape type for DS57993: 2
2026-03-30 10:52:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5cfd6d3-a885-5e4a-abf3-be74ef51e8ec with identifier: DS57993
2026-03-30 10:52:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5cfd6d3-a885-5e4a-abf3-be74ef51e8ec with scrape type 2
2026-03-30 10:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5cfd6d3-a885-5e4a-abf3-be74ef51e8ec with scrape type 2
2026-03-30 10:52:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5cfd6d3-a885-5e4a-abf3-be74ef51e8ec, identifier: DS57993
2026-03-30 10:52:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5cfd6d3-a885-5e4a-abf3-be74ef51e8ec with identifier: DS57993
2026-03-30 10:52:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5cfd6d3-a885-5e4a-abf3-be74ef51e8ec with identifier: DS57993
2026-03-30 10:52:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5cfd6d3-a885-5e4a-abf3-be74ef51e8ec with identifier: DS57993 to the API
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:31:47Z',
 'fuel_type': 'diesel',
 'id': 'a5cfd6d3-a885-5e4a-abf3-be74ef51e8ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS57993',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 202416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-25',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI CMon',
 'transmission': 'manual',
 'trim': 'CMon',
 'year': 2011}
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS57993%27 HTTP/1.1" 200 None
2026-03-30 10:52:55 [auto1.de] INFO: Saving data for DS57993: {'auction_closing_time': 1774971107.0, 'created_time': 1773400243.601466, 'last_price_update_time': 1774867975.314436}
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS57993') HTTP/1.1" 204 0
2026-03-30 10:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_29d1d4900a6861420349c5e9efd3fe04.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:55 [auto1.de] INFO: Found listing with ID: CL91899
2026-03-30 10:52:55 [auto1.de] INFO: Found listing with ID: JB49732
2026-03-30 10:52:55 [auto1.de] INFO: Found listing with ID: XV41644
2026-03-30 10:52:55 [auto1.de] INFO: Found listing with ID: VB04886
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB04886%27 HTTP/1.1" 200 None
2026-03-30 10:52:55 [auto1.de] INFO: Scrape type for VB04886: 2
2026-03-30 10:52:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28f5de2b-a21a-5b42-9404-afc6a4818049 with identifier: VB04886
2026-03-30 10:52:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28f5de2b-a21a-5b42-9404-afc6a4818049 with scrape type 2
2026-03-30 10:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28f5de2b-a21a-5b42-9404-afc6a4818049 with scrape type 2
2026-03-30 10:52:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28f5de2b-a21a-5b42-9404-afc6a4818049, identifier: VB04886
2026-03-30 10:52:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28f5de2b-a21a-5b42-9404-afc6a4818049 with identifier: VB04886
2026-03-30 10:52:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28f5de2b-a21a-5b42-9404-afc6a4818049 with identifier: VB04886
2026-03-30 10:52:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28f5de2b-a21a-5b42-9404-afc6a4818049 with identifier: VB04886 to the API
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:53:54Z',
 'fuel_type': 'petrol',
 'id': '28f5de2b-a21a-5b42-9404-afc6a4818049',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB04886',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 229730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-30',
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB04886%27 HTTP/1.1" 200 None
2026-03-30 10:52:55 [auto1.de] INFO: Saving data for VB04886: {'auction_closing_time': 1774972434.0, 'created_time': 1774434991.473398, 'last_price_update_time': 1774867975.783358}
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB04886') HTTP/1.1" 204 0
2026-03-30 10:52:56 [auto1.de] INFO: Found listing with ID: YB47144
2026-03-30 10:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB47144%27 HTTP/1.1" 200 None
2026-03-30 10:52:56 [auto1.de] INFO: Scrape type for YB47144: 2
2026-03-30 10:52:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb5e17ca-cc69-54db-905e-bd20690ab8a7 with identifier: YB47144
2026-03-30 10:52:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb5e17ca-cc69-54db-905e-bd20690ab8a7 with scrape type 2
2026-03-30 10:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb5e17ca-cc69-54db-905e-bd20690ab8a7 with scrape type 2
2026-03-30 10:52:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb5e17ca-cc69-54db-905e-bd20690ab8a7, identifier: YB47144
2026-03-30 10:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ22549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb5e17ca-cc69-54db-905e-bd20690ab8a7 with identifier: YB47144
2026-03-30 10:52:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb5e17ca-cc69-54db-905e-bd20690ab8a7 with identifier: YB47144
2026-03-30 10:52:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb5e17ca-cc69-54db-905e-bd20690ab8a7 with identifier: YB47144 to the API
2026-03-30 10:52:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:46:27Z',
 'fuel_type': 'diesel',
 'id': 'bb5e17ca-cc69-54db-905e-bd20690ab8a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB47144',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 232682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB47144%27 HTTP/1.1" 200 None
2026-03-30 10:52:57 [auto1.de] INFO: Saving data for YB47144: {'auction_closing_time': 1774971987.0, 'created_time': 1773657831.710359, 'last_price_update_time': 1774867977.176228}
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB47144') HTTP/1.1" 204 0
2026-03-30 10:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_8314ca5bd7d57a78fa55895b50e04d55.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:57 [auto1.de] INFO: Found listing with ID: FD89008
2026-03-30 10:52:57 [auto1.de] INFO: Found listing with ID: LX10413
2026-03-30 10:52:57 [auto1.de] INFO: Found listing with ID: TP09714
2026-03-30 10:52:57 [auto1.de] INFO: Found listing with ID: XM71416
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM71416%27 HTTP/1.1" 200 None
2026-03-30 10:52:57 [auto1.de] INFO: Scrape type for XM71416: 2
2026-03-30 10:52:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 496b03c6-64f1-5094-b66b-ca8a05edbd3d with identifier: XM71416
2026-03-30 10:52:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 496b03c6-64f1-5094-b66b-ca8a05edbd3d with scrape type 2
2026-03-30 10:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 496b03c6-64f1-5094-b66b-ca8a05edbd3d with scrape type 2
2026-03-30 10:52:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 496b03c6-64f1-5094-b66b-ca8a05edbd3d, identifier: XM71416
2026-03-30 10:52:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee441b10>
2026-03-30 10:52:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_29d1d4900a6861420349c5e9efd3fe04.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_29d1d4900a6861420349c5e9efd3fe04.jpg saved to cache
2026-03-30 10:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db
2026-03-30 10:52:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 496b03c6-64f1-5094-b66b-ca8a05edbd3d with identifier: XM71416
2026-03-30 10:52:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 496b03c6-64f1-5094-b66b-ca8a05edbd3d with identifier: XM71416
2026-03-30 10:52:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 496b03c6-64f1-5094-b66b-ca8a05edbd3d with identifier: XM71416 to the API
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:42:13Z',
 'fuel_type': 'petrol',
 'id': '496b03c6-64f1-5094-b66b-ca8a05edbd3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM71416',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 78878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-25',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Extreme',
 'transmission': 'manual',
 'trim': 'Extreme',
 'year': 2009}
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM71416%27 HTTP/1.1" 200 None
2026-03-30 10:52:57 [auto1.de] INFO: Saving data for XM71416: {'auction_closing_time': 1774971733.0, 'created_time': 1774466825.364328, 'last_price_update_time': 1774867977.713709}
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM71416') HTTP/1.1" 204 0
2026-03-30 10:52:57 [auto1.de] INFO: Found listing with ID: NC61383
2026-03-30 10:52:57 [auto1.de] INFO: Found listing with ID: TP41556
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP41556%27 HTTP/1.1" 200 None
2026-03-30 10:52:57 [auto1.de] INFO: Scrape type for TP41556: 2
2026-03-30 10:52:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16ba367d-e3a4-5a48-9c21-860d52625f7f with identifier: TP41556
2026-03-30 10:52:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16ba367d-e3a4-5a48-9c21-860d52625f7f with scrape type 2
2026-03-30 10:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16ba367d-e3a4-5a48-9c21-860d52625f7f with scrape type 2
2026-03-30 10:52:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16ba367d-e3a4-5a48-9c21-860d52625f7f, identifier: TP41556
2026-03-30 10:52:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16ba367d-e3a4-5a48-9c21-860d52625f7f with identifier: TP41556
2026-03-30 10:52:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16ba367d-e3a4-5a48-9c21-860d52625f7f with identifier: TP41556
2026-03-30 10:52:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16ba367d-e3a4-5a48-9c21-860d52625f7f with identifier: TP41556 to the API
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 450,
 'expiration_date': '2026-03-31T15:36:00Z',
 'fuel_type': 'petrol',
 'id': '16ba367d-e3a4-5a48-9c21-860d52625f7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP41556',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 90276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-27',
 'seller_name': None,
 'title': 'BMW 7er 750i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2015}
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP41556%27 HTTP/1.1" 200 None
2026-03-30 10:52:58 [auto1.de] INFO: Saving data for TP41556: {'auction_closing_time': 1774971360.0, 'created_time': 1773657538.118664, 'last_price_update_time': 1774867978.288423}
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP41556') HTTP/1.1" 204 0
2026-03-30 10:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LU25444/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee42e290>
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_8314ca5bd7d57a78fa55895b50e04d55.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_8314ca5bd7d57a78fa55895b50e04d55.jpg saved to cache
2026-03-30 10:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db
2026-03-30 10:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_d2fe809f7891462adc0b38ac60809ec4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_70bef636419eed3fa49d6b6a574159ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_4c514e8086343a579ed13e268d369528.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_6ad29e24e3ec70f14f7a5119e41d148b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58fb050>
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_d2fe809f7891462adc0b38ac60809ec4.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_d2fe809f7891462adc0b38ac60809ec4.jpg saved to cache
2026-03-30 10:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db
2026-03-30 10:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_560030b216a03d7d35d826f66c7f0fc9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4603d0>
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_70bef636419eed3fa49d6b6a574159ed.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_70bef636419eed3fa49d6b6a574159ed.jpg saved to cache
2026-03-30 10:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db
2026-03-30 10:52:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3fc410>
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_4c514e8086343a579ed13e268d369528.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_4c514e8086343a579ed13e268d369528.jpg saved to cache
2026-03-30 10:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db
2026-03-30 10:52:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefe7bd0>
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_6ad29e24e3ec70f14f7a5119e41d148b.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_6ad29e24e3ec70f14f7a5119e41d148b.jpg saved to cache
2026-03-30 10:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db
2026-03-30 10:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_05592c3ab5ea6e1879dc2c6cff923ac2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefc8550>
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_560030b216a03d7d35d826f66c7f0fc9.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_560030b216a03d7d35d826f66c7f0fc9.jpg saved to cache
2026-03-30 10:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db
2026-03-30 10:52:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee419a50>
2026-03-30 10:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_05592c3ab5ea6e1879dc2c6cff923ac2.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_05592c3ab5ea6e1879dc2c6cff923ac2.jpg saved to cache
2026-03-30 10:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db
2026-03-30 10:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_093f42fd475722cafb32ae6173dfa8a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ22549> (referer: https://www.auto1.com/v1/car-details-view/SJ22549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee44d910>
2026-03-30 10:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fb9%252F69b94434fb9ec61fbac50d43674445db%252Fpa%252FXU91066_093f42fd475722cafb32ae6173dfa8a3.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_093f42fd475722cafb32ae6173dfa8a3.jpg saved to cache
2026-03-30 10:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db
2026-03-30 10:52:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db, skipping ID generation
2026-03-30 10:52:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db with scrape type 1
2026-03-30 10:52:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db sending to next pipeline
2026-03-30 10:52:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db, identifier: XU91066
2026-03-30 10:52:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db with identifier: XU91066
2026-03-30 10:52:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db with identifier: XU91066
2026-03-30 10:52:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db with identifier: XU91066 to the API
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_093f42fd475722cafb32ae6173dfa8a3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': 'Rental',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:06:21Z',
 'fuel_type': 'diesel',
 'id': '08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU91066',
 'listing': 'auction',
 'location': 'DE, Schwäbisch Gmünd',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 225381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_a55f61487bd87cd7897eeb831b2651db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3337797,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_d2fe809f7891462adc0b38ac60809ec4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3320942,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_560030b216a03d7d35d826f66c7f0fc9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3210395,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_70bef636419eed3fa49d6b6a574159ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3286645,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_4c514e8086343a579ed13e268d369528.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3331372,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_05592c3ab5ea6e1879dc2c6cff923ac2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3383728,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_6ad29e24e3ec70f14f7a5119e41d148b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3125031,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_093f42fd475722cafb32ae6173dfa8a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_29d1d4900a6861420349c5e9efd3fe04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db/08c00a74-6a7a-5d22-b8b9-1de2b9d3b5db_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/b9/69b94434fb9ec61fbac50d43674445db/pa/XU91066_8314ca5bd7d57a78fa55895b50e04d55.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-15',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Life BlueMotion',
 'transmission': 'manual',
 'trim': 'Life BlueMotion',
 'year': 2013}
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU91066%27 HTTP/1.1" 200 None
2026-03-30 10:53:00 [auto1.de] INFO: Saving data for XU91066: {'created_time': 1774867980.06164, 'last_price_update_time': 1774867980.061656, 'auction_closing_time': 1774969581.0}
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU91066') HTTP/1.1" 204 0
2026-03-30 10:53:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ef0f162-c5cf-5766-90c0-5f0058df523d with identifier: SJ22549
2026-03-30 10:53:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ef0f162-c5cf-5766-90c0-5f0058df523d with scrape type 1
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1ef0f162-c5cf-5766-90c0-5f0058df523d
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9abaf2012e03da232f2965831a56c2a8%252Fpa%252FSJ22549_5afaeb72044687082c7dfad73a35a381.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_5afaeb72044687082c7dfad73a35a381.jpg not downloaded yet
2026-03-30 10:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LU25444> (referer: https://www.auto1.com/v1/car-details-view/LU25444/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9abaf2012e03da232f2965831a56c2a8%252Fpa%252FSJ22549_6e7b0e95f7f40f6cd3f0b4bea9943ddc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_6e7b0e95f7f40f6cd3f0b4bea9943ddc.jpg not downloaded yet
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9abaf2012e03da232f2965831a56c2a8%252Fpa%252FSJ22549_9a71cafacb3d914fa0f8dc14f28a38fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_9a71cafacb3d914fa0f8dc14f28a38fb.jpg not downloaded yet
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9abaf2012e03da232f2965831a56c2a8%252Fpa%252FSJ22549_ddea720c8572788e2d4c36797bb463e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_ddea720c8572788e2d4c36797bb463e1.jpg not downloaded yet
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9abaf2012e03da232f2965831a56c2a8%252Fpa%252FSJ22549_c966b4edcad2a40e998f54705352d5f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_c966b4edcad2a40e998f54705352d5f9.jpg not downloaded yet
2026-03-30 10:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_5afaeb72044687082c7dfad73a35a381.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb57bac2-0f14-5d74-afa1-a5ed5697cfb6 with identifier: LU25444
2026-03-30 10:53:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb57bac2-0f14-5d74-afa1-a5ed5697cfb6 with scrape type 1
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb57bac2-0f14-5d74-afa1-a5ed5697cfb6
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_72c75eadf37e6aa7c01b740e645f03e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_72c75eadf37e6aa7c01b740e645f03e0.jpg not downloaded yet
2026-03-30 10:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_6e7b0e95f7f40f6cd3f0b4bea9943ddc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_fc95208e036957bd48a6048d6ae2d5eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_fc95208e036957bd48a6048d6ae2d5eb.jpg not downloaded yet
2026-03-30 10:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_9a71cafacb3d914fa0f8dc14f28a38fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_ddea720c8572788e2d4c36797bb463e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_93eec98631f1c55c37c8414773781b15.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_93eec98631f1c55c37c8414773781b15.jpg not downloaded yet
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_1f7699addd595990b103db744b2c1500.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_1f7699addd595990b103db744b2c1500.jpg not downloaded yet
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_b58f305b0244b341da343eae59230af3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_b58f305b0244b341da343eae59230af3.jpg not downloaded yet
2026-03-30 10:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_c966b4edcad2a40e998f54705352d5f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_9f90c8e89209f05983fa35d3d3d994fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_9f90c8e89209f05983fa35d3d3d994fb.jpg not downloaded yet
2026-03-30 10:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_72c75eadf37e6aa7c01b740e645f03e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee418b10>
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ef0f162-c5cf-5766-90c0-5f0058df523d/1ef0f162-c5cf-5766-90c0-5f0058df523d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9abaf2012e03da232f2965831a56c2a8%252Fpa%252FSJ22549_5afaeb72044687082c7dfad73a35a381.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_5afaeb72044687082c7dfad73a35a381.jpg saved to cache
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ef0f162-c5cf-5766-90c0-5f0058df523d
2026-03-30 10:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_fc95208e036957bd48a6048d6ae2d5eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_b3a40df954f8b91984b6d5eeb164822e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_b3a40df954f8b91984b6d5eeb164822e.jpg not downloaded yet
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeea24d0>
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ef0f162-c5cf-5766-90c0-5f0058df523d/1ef0f162-c5cf-5766-90c0-5f0058df523d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9abaf2012e03da232f2965831a56c2a8%252Fpa%252FSJ22549_6e7b0e95f7f40f6cd3f0b4bea9943ddc.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_6e7b0e95f7f40f6cd3f0b4bea9943ddc.jpg saved to cache
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ef0f162-c5cf-5766-90c0-5f0058df523d
2026-03-30 10:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_93eec98631f1c55c37c8414773781b15.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_f66a2d9a9ecd2680e5ec45183301d456.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_f66a2d9a9ecd2680e5ec45183301d456.jpg not downloaded yet
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee94f50>
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ef0f162-c5cf-5766-90c0-5f0058df523d/1ef0f162-c5cf-5766-90c0-5f0058df523d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9abaf2012e03da232f2965831a56c2a8%252Fpa%252FSJ22549_9a71cafacb3d914fa0f8dc14f28a38fb.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_9a71cafacb3d914fa0f8dc14f28a38fb.jpg saved to cache
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1ef0f162-c5cf-5766-90c0-5f0058df523d
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e31d0>
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ef0f162-c5cf-5766-90c0-5f0058df523d/1ef0f162-c5cf-5766-90c0-5f0058df523d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9abaf2012e03da232f2965831a56c2a8%252Fpa%252FSJ22549_ddea720c8572788e2d4c36797bb463e1.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_ddea720c8572788e2d4c36797bb463e1.jpg saved to cache
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1ef0f162-c5cf-5766-90c0-5f0058df523d
2026-03-30 10:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_b58f305b0244b341da343eae59230af3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_19e9d1a56e365ee3afcef63d73ec418c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_19e9d1a56e365ee3afcef63d73ec418c.jpg not downloaded yet
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e2810>
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ef0f162-c5cf-5766-90c0-5f0058df523d/1ef0f162-c5cf-5766-90c0-5f0058df523d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9abaf2012e03da232f2965831a56c2a8%252Fpa%252FSJ22549_c966b4edcad2a40e998f54705352d5f9.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_c966b4edcad2a40e998f54705352d5f9.jpg saved to cache
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1ef0f162-c5cf-5766-90c0-5f0058df523d
2026-03-30 10:53:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ef0f162-c5cf-5766-90c0-5f0058df523d, skipping ID generation
2026-03-30 10:53:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ef0f162-c5cf-5766-90c0-5f0058df523d with scrape type 1
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ef0f162-c5cf-5766-90c0-5f0058df523d sending to next pipeline
2026-03-30 10:53:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ef0f162-c5cf-5766-90c0-5f0058df523d, identifier: SJ22549
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f58fbc90>
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_72c75eadf37e6aa7c01b740e645f03e0.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_72c75eadf37e6aa7c01b740e645f03e0.jpg saved to cache
2026-03-30 10:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb57bac2-0f14-5d74-afa1-a5ed5697cfb6
2026-03-30 10:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_9f90c8e89209f05983fa35d3d3d994fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_1f7699addd595990b103db744b2c1500.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ef0f162-c5cf-5766-90c0-5f0058df523d with identifier: SJ22549
2026-03-30 10:53:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ef0f162-c5cf-5766-90c0-5f0058df523d with identifier: SJ22549
2026-03-30 10:53:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ef0f162-c5cf-5766-90c0-5f0058df523d with identifier: SJ22549 to the API
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_c966b4edcad2a40e998f54705352d5f9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:27:49Z',
 'fuel_type': 'petrol',
 'id': '1ef0f162-c5cf-5766-90c0-5f0058df523d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ22549',
 'listing': 'auction',
 'location': 'DE, Eggenfelden',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 102002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef0f162-c5cf-5766-90c0-5f0058df523d/1ef0f162-c5cf-5766-90c0-5f0058df523d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_5afaeb72044687082c7dfad73a35a381.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef0f162-c5cf-5766-90c0-5f0058df523d/1ef0f162-c5cf-5766-90c0-5f0058df523d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_6e7b0e95f7f40f6cd3f0b4bea9943ddc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef0f162-c5cf-5766-90c0-5f0058df523d/1ef0f162-c5cf-5766-90c0-5f0058df523d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_9a71cafacb3d914fa0f8dc14f28a38fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef0f162-c5cf-5766-90c0-5f0058df523d/1ef0f162-c5cf-5766-90c0-5f0058df523d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_ddea720c8572788e2d4c36797bb463e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef0f162-c5cf-5766-90c0-5f0058df523d/1ef0f162-c5cf-5766-90c0-5f0058df523d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/ba/9abaf2012e03da232f2965831a56c2a8/pa/SJ22549_c966b4edcad2a40e998f54705352d5f9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2017}
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ22549%27 HTTP/1.1" 200 None
2026-03-30 10:53:01 [auto1.de] INFO: Saving data for SJ22549: {'created_time': 1774867981.58513, 'last_price_update_time': 1774867981.585144, 'auction_closing_time': 1774970869.0}
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ22549') HTTP/1.1" 204 0
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefca050>
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_fc95208e036957bd48a6048d6ae2d5eb.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_fc95208e036957bd48a6048d6ae2d5eb.jpg saved to cache
2026-03-30 10:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb57bac2-0f14-5d74-afa1-a5ed5697cfb6
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_5e45f99346e804d79b316fcfb7acf275.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_5e45f99346e804d79b316fcfb7acf275.jpg not downloaded yet
2026-03-30 10:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_b3a40df954f8b91984b6d5eeb164822e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4233c90>
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_93eec98631f1c55c37c8414773781b15.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_93eec98631f1c55c37c8414773781b15.jpg saved to cache
2026-03-30 10:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb57bac2-0f14-5d74-afa1-a5ed5697cfb6
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefa7e10>
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_b58f305b0244b341da343eae59230af3.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_b58f305b0244b341da343eae59230af3.jpg saved to cache
2026-03-30 10:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb57bac2-0f14-5d74-afa1-a5ed5697cfb6
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424f190>
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_9f90c8e89209f05983fa35d3d3d994fb.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_9f90c8e89209f05983fa35d3d3d994fb.jpg saved to cache
2026-03-30 10:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb57bac2-0f14-5d74-afa1-a5ed5697cfb6
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee81cd0>
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_1f7699addd595990b103db744b2c1500.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_1f7699addd595990b103db744b2c1500.jpg saved to cache
2026-03-30 10:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb57bac2-0f14-5d74-afa1-a5ed5697cfb6
2026-03-30 10:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_f66a2d9a9ecd2680e5ec45183301d456.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_19e9d1a56e365ee3afcef63d73ec418c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4395dd0>
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_b3a40df954f8b91984b6d5eeb164822e.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_b3a40df954f8b91984b6d5eeb164822e.jpg saved to cache
2026-03-30 10:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb57bac2-0f14-5d74-afa1-a5ed5697cfb6
2026-03-30 10:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_5e45f99346e804d79b316fcfb7acf275.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5dfe850>
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_f66a2d9a9ecd2680e5ec45183301d456.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_f66a2d9a9ecd2680e5ec45183301d456.jpg saved to cache
2026-03-30 10:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb57bac2-0f14-5d74-afa1-a5ed5697cfb6
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4395350>
2026-03-30 10:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_19e9d1a56e365ee3afcef63d73ec418c.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_19e9d1a56e365ee3afcef63d73ec418c.jpg saved to cache
2026-03-30 10:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb57bac2-0f14-5d74-afa1-a5ed5697cfb6
2026-03-30 10:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef05d0>
2026-03-30 10:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb0%252F8ab02981ef9f2932f864926487614baf%252Fpa%252FLU25444_5e45f99346e804d79b316fcfb7acf275.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_5e45f99346e804d79b316fcfb7acf275.jpg saved to cache
2026-03-30 10:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb57bac2-0f14-5d74-afa1-a5ed5697cfb6
2026-03-30 10:53:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb57bac2-0f14-5d74-afa1-a5ed5697cfb6, skipping ID generation
2026-03-30 10:53:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb57bac2-0f14-5d74-afa1-a5ed5697cfb6 with scrape type 1
2026-03-30 10:53:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb57bac2-0f14-5d74-afa1-a5ed5697cfb6 sending to next pipeline
2026-03-30 10:53:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb57bac2-0f14-5d74-afa1-a5ed5697cfb6, identifier: LU25444
2026-03-30 10:53:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb57bac2-0f14-5d74-afa1-a5ed5697cfb6 with identifier: LU25444
2026-03-30 10:53:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb57bac2-0f14-5d74-afa1-a5ed5697cfb6 with identifier: LU25444
2026-03-30 10:53:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb57bac2-0f14-5d74-afa1-a5ed5697cfb6 with identifier: LU25444 to the API
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_5e45f99346e804d79b316fcfb7acf275.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 193,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 235,
 'expiration_date': '2026-03-31T15:09:06Z',
 'fuel_type': 'diesel',
 'id': 'eb57bac2-0f14-5d74-afa1-a5ed5697cfb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU25444',
 'listing': 'auction',
 'location': 'DE, Königsbrunn',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 213012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_72c75eadf37e6aa7c01b740e645f03e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_fc95208e036957bd48a6048d6ae2d5eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_93eec98631f1c55c37c8414773781b15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_1f7699addd595990b103db744b2c1500.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_b58f305b0244b341da343eae59230af3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_9f90c8e89209f05983fa35d3d3d994fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_b3a40df954f8b91984b6d5eeb164822e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_f66a2d9a9ecd2680e5ec45183301d456.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_19e9d1a56e365ee3afcef63d73ec418c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb57bac2-0f14-5d74-afa1-a5ed5697cfb6/eb57bac2-0f14-5d74-afa1-a5ed5697cfb6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b0/8ab02981ef9f2932f864926487614baf/pa/LU25444_5e45f99346e804d79b316fcfb7acf275.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D5 R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2018}
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU25444%27 HTTP/1.1" 200 None
2026-03-30 10:53:02 [auto1.de] INFO: Saving data for LU25444: {'created_time': 1774867982.604293, 'last_price_update_time': 1774867982.604303, 'auction_closing_time': 1774969746.0}
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU25444') HTTP/1.1" 204 0
2026-03-30 10:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:02 [auto1.de] INFO: Channel: 24h | Page: 42 | totalHits: 9516 | hits on page: 40
2026-03-30 10:53:02 [auto1.de] INFO: Found listing with ID: TP09714
2026-03-30 10:53:02 [auto1.de] INFO: Found listing with ID: XM71416
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM71416%27 HTTP/1.1" 200 None
2026-03-30 10:53:02 [auto1.de] INFO: Scrape type for XM71416: 0
2026-03-30 10:53:02 [auto1.de] INFO: Found listing with ID: NC61383
2026-03-30 10:53:02 [auto1.de] INFO: Found listing with ID: TP41556
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP41556%27 HTTP/1.1" 200 None
2026-03-30 10:53:02 [auto1.de] INFO: Scrape type for TP41556: 0
2026-03-30 10:53:02 [auto1.de] INFO: Found listing with ID: SM51987
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM51987%27 HTTP/1.1" 200 None
2026-03-30 10:53:02 [auto1.de] INFO: Scrape type for SM51987: 2
2026-03-30 10:53:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d246e39-75e6-5147-9592-c89192bfa8c8 with identifier: SM51987
2026-03-30 10:53:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d246e39-75e6-5147-9592-c89192bfa8c8 with scrape type 2
2026-03-30 10:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d246e39-75e6-5147-9592-c89192bfa8c8 with scrape type 2
2026-03-30 10:53:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d246e39-75e6-5147-9592-c89192bfa8c8, identifier: SM51987
2026-03-30 10:53:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d246e39-75e6-5147-9592-c89192bfa8c8 with identifier: SM51987
2026-03-30 10:53:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d246e39-75e6-5147-9592-c89192bfa8c8 with identifier: SM51987
2026-03-30 10:53:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d246e39-75e6-5147-9592-c89192bfa8c8 with identifier: SM51987 to the API
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:11:01Z',
 'fuel_type': 'petrol',
 'id': '9d246e39-75e6-5147-9592-c89192bfa8c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM51987',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 136767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-16',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2017}
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM51987%27 HTTP/1.1" 200 None
2026-03-30 10:53:03 [auto1.de] INFO: Saving data for SM51987: {'auction_closing_time': 1774969861.0, 'created_time': 1773306495.632898, 'last_price_update_time': 1774867983.307773}
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM51987') HTTP/1.1" 204 0
2026-03-30 10:53:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:03 [auto1.de] INFO: Found listing with ID: SK50734
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK50734%27 HTTP/1.1" 200 None
2026-03-30 10:53:03 [auto1.de] INFO: Scrape type for SK50734: 2
2026-03-30 10:53:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 942f9569-7fb8-5e7b-9714-a0d3b79e3dfc with identifier: SK50734
2026-03-30 10:53:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 942f9569-7fb8-5e7b-9714-a0d3b79e3dfc with scrape type 2
2026-03-30 10:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 942f9569-7fb8-5e7b-9714-a0d3b79e3dfc with scrape type 2
2026-03-30 10:53:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 942f9569-7fb8-5e7b-9714-a0d3b79e3dfc, identifier: SK50734
2026-03-30 10:53:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 942f9569-7fb8-5e7b-9714-a0d3b79e3dfc with identifier: SK50734
2026-03-30 10:53:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 942f9569-7fb8-5e7b-9714-a0d3b79e3dfc with identifier: SK50734
2026-03-30 10:53:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 942f9569-7fb8-5e7b-9714-a0d3b79e3dfc with identifier: SK50734 to the API
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:48:42Z',
 'fuel_type': 'electro',
 'id': '942f9569-7fb8-5e7b-9714-a0d3b79e3dfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK50734',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 20200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-24',
 'seller_name': None,
 'title': 'Smart fortwo electric drive 60 kW Prime',
 'transmission': 'automatic',
 'trim': 'Prime',
 'year': 2019}
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK50734%27 HTTP/1.1" 200 None
2026-03-30 10:53:03 [auto1.de] INFO: Saving data for SK50734: {'auction_closing_time': 1774972122.0, 'created_time': 1773304980.830149, 'last_price_update_time': 1774867983.909192}
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK50734') HTTP/1.1" 204 0
2026-03-30 10:53:03 [auto1.de] INFO: Found listing with ID: GL43025
2026-03-30 10:53:03 [auto1.de] INFO: Found listing with ID: HE95422
2026-03-30 10:53:03 [auto1.de] INFO: Found listing with ID: SC29196
2026-03-30 10:53:03 [auto1.de] INFO: Found listing with ID: VF94022
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF94022%27 HTTP/1.1" 200 None
2026-03-30 10:53:03 [auto1.de] INFO: Scrape type for VF94022: 2
2026-03-30 10:53:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9141edfd-22bf-525d-9874-5c490381d807 with identifier: VF94022
2026-03-30 10:53:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9141edfd-22bf-525d-9874-5c490381d807 with scrape type 2
2026-03-30 10:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9141edfd-22bf-525d-9874-5c490381d807 with scrape type 2
2026-03-30 10:53:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9141edfd-22bf-525d-9874-5c490381d807, identifier: VF94022
2026-03-30 10:53:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9141edfd-22bf-525d-9874-5c490381d807 with identifier: VF94022
2026-03-30 10:53:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9141edfd-22bf-525d-9874-5c490381d807 with identifier: VF94022
2026-03-30 10:53:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9141edfd-22bf-525d-9874-5c490381d807 with identifier: VF94022 to the API
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-31T15:46:00Z',
 'fuel_type': 'petrol',
 'id': '9141edfd-22bf-525d-9874-5c490381d807',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF94022',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Toledo',
 'odometer': 122807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1994-03-10',
 'seller_name': None,
 'title': 'Seat Toledo 1.8 Alcazar',
 'transmission': 'manual',
 'trim': 'Alcazar',
 'year': 1994}
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF94022%27 HTTP/1.1" 200 None
2026-03-30 10:53:04 [auto1.de] INFO: Saving data for VF94022: {'auction_closing_time': 1774971960.0, 'created_time': 1774350369.142259, 'last_price_update_time': 1774867984.360864}
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF94022') HTTP/1.1" 204 0
2026-03-30 10:53:04 [auto1.de] INFO: Found listing with ID: AC06090
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC06090%27 HTTP/1.1" 200 None
2026-03-30 10:53:04 [auto1.de] INFO: Scrape type for AC06090: 2
2026-03-30 10:53:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fb7f963-63f8-5dab-a950-127398848cf8 with identifier: AC06090
2026-03-30 10:53:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fb7f963-63f8-5dab-a950-127398848cf8 with scrape type 2
2026-03-30 10:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fb7f963-63f8-5dab-a950-127398848cf8 with scrape type 2
2026-03-30 10:53:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fb7f963-63f8-5dab-a950-127398848cf8, identifier: AC06090
2026-03-30 10:53:04 [scrapy.extensions.logstats] INFO: Crawled 740 pages (at 11 pages/min), scraped 761 items (at 101 items/min)
2026-03-30 10:53:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:53:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fb7f963-63f8-5dab-a950-127398848cf8 with identifier: AC06090
2026-03-30 10:53:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fb7f963-63f8-5dab-a950-127398848cf8 with identifier: AC06090
2026-03-30 10:53:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fb7f963-63f8-5dab-a950-127398848cf8 with identifier: AC06090 to the API
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:57:01Z',
 'fuel_type': 'petrol',
 'id': '5fb7f963-63f8-5dab-a950-127398848cf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC06090',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 24107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seller_name': None,
 'title': 'MINI Countryman Cooper Classic Trim',
 'transmission': 'manual',
 'trim': 'Classic Trim',
 'year': 2022}
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC06090%27 HTTP/1.1" 200 None
2026-03-30 10:53:04 [auto1.de] INFO: Saving data for AC06090: {'auction_closing_time': 1774972621.0, 'created_time': 1773513059.223556, 'last_price_update_time': 1774867984.870445}
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC06090') HTTP/1.1" 204 0
2026-03-30 10:53:04 [auto1.de] INFO: Found listing with ID: JE79565
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE79565%27 HTTP/1.1" 200 None
2026-03-30 10:53:04 [auto1.de] INFO: Scrape type for JE79565: 2
2026-03-30 10:53:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d07ae26-399e-54fc-ac05-9a035ffa9a43 with identifier: JE79565
2026-03-30 10:53:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d07ae26-399e-54fc-ac05-9a035ffa9a43 with scrape type 2
2026-03-30 10:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d07ae26-399e-54fc-ac05-9a035ffa9a43 with scrape type 2
2026-03-30 10:53:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d07ae26-399e-54fc-ac05-9a035ffa9a43, identifier: JE79565
2026-03-30 10:53:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d07ae26-399e-54fc-ac05-9a035ffa9a43 with identifier: JE79565
2026-03-30 10:53:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d07ae26-399e-54fc-ac05-9a035ffa9a43 with identifier: JE79565
2026-03-30 10:53:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d07ae26-399e-54fc-ac05-9a035ffa9a43 with identifier: JE79565 to the API
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:57:00Z',
 'fuel_type': 'diesel',
 'id': '2d07ae26-399e-54fc-ac05-9a035ffa9a43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE79565',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 179466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE79565%27 HTTP/1.1" 200 None
2026-03-30 10:53:05 [auto1.de] INFO: Saving data for JE79565: {'auction_closing_time': 1774972620.0, 'created_time': 1773945066.583426, 'last_price_update_time': 1774867985.399793}
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE79565') HTTP/1.1" 204 0
2026-03-30 10:53:05 [auto1.de] INFO: Found listing with ID: TU19465
2026-03-30 10:53:05 [auto1.de] INFO: Found listing with ID: ZA98162
2026-03-30 10:53:05 [auto1.de] INFO: Found listing with ID: EX51640
2026-03-30 10:53:05 [auto1.de] INFO: Found listing with ID: CW40346
2026-03-30 10:53:05 [auto1.de] INFO: Found listing with ID: VA69580
2026-03-30 10:53:05 [auto1.de] INFO: Found listing with ID: KE44581
2026-03-30 10:53:05 [auto1.de] INFO: Found listing with ID: JE17761
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE17761%27 HTTP/1.1" 200 None
2026-03-30 10:53:05 [auto1.de] INFO: Scrape type for JE17761: 2
2026-03-30 10:53:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e17ab906-1fd8-50de-aeeb-43825183c611 with identifier: JE17761
2026-03-30 10:53:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e17ab906-1fd8-50de-aeeb-43825183c611 with scrape type 2
2026-03-30 10:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e17ab906-1fd8-50de-aeeb-43825183c611 with scrape type 2
2026-03-30 10:53:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e17ab906-1fd8-50de-aeeb-43825183c611, identifier: JE17761
2026-03-30 10:53:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e17ab906-1fd8-50de-aeeb-43825183c611 with identifier: JE17761
2026-03-30 10:53:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e17ab906-1fd8-50de-aeeb-43825183c611 with identifier: JE17761
2026-03-30 10:53:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e17ab906-1fd8-50de-aeeb-43825183c611 with identifier: JE17761 to the API
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:45:55Z',
 'fuel_type': 'petrol',
 'id': 'e17ab906-1fd8-50de-aeeb-43825183c611',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE17761',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 230804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-31',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Selection "110 Jahre"',
 'transmission': 'manual',
 'trim': 'Selection "110 Jahre"',
 'year': 2010}
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE17761%27 HTTP/1.1" 200 None
2026-03-30 10:53:05 [auto1.de] INFO: Saving data for JE17761: {'auction_closing_time': 1774971955.0, 'created_time': 1774550566.562387, 'last_price_update_time': 1774867985.878017}
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE17761') HTTP/1.1" 204 0
2026-03-30 10:53:05 [auto1.de] INFO: Found listing with ID: HS50383
2026-03-30 10:53:05 [auto1.de] INFO: Found listing with ID: TZ46793
2026-03-30 10:53:05 [auto1.de] INFO: Found listing with ID: CW67580
2026-03-30 10:53:05 [auto1.de] INFO: Found listing with ID: NV71643
2026-03-30 10:53:05 [auto1.de] INFO: Found listing with ID: BR38332
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR38332%27 HTTP/1.1" 200 None
2026-03-30 10:53:06 [auto1.de] INFO: Scrape type for BR38332: 2
2026-03-30 10:53:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43fdd2b8-273c-571b-bd65-7d1ce899c96f with identifier: BR38332
2026-03-30 10:53:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43fdd2b8-273c-571b-bd65-7d1ce899c96f with scrape type 2
2026-03-30 10:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43fdd2b8-273c-571b-bd65-7d1ce899c96f with scrape type 2
2026-03-30 10:53:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43fdd2b8-273c-571b-bd65-7d1ce899c96f, identifier: BR38332
2026-03-30 10:53:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43fdd2b8-273c-571b-bd65-7d1ce899c96f with identifier: BR38332
2026-03-30 10:53:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43fdd2b8-273c-571b-bd65-7d1ce899c96f with identifier: BR38332
2026-03-30 10:53:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43fdd2b8-273c-571b-bd65-7d1ce899c96f with identifier: BR38332 to the API
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:05:33Z',
 'fuel_type': 'diesel',
 'id': '43fdd2b8-273c-571b-bd65-7d1ce899c96f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR38332',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 114934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-12',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI IQ.DRIVE 4Motion',
 'transmission': 'automatic',
 'trim': 'IQ.DRIVE 4Motion',
 'year': 2019}
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR38332%27 HTTP/1.1" 200 None
2026-03-30 10:53:06 [auto1.de] INFO: Saving data for BR38332: {'auction_closing_time': 1774969533.0, 'created_time': 1774379925.503513, 'last_price_update_time': 1774867986.447422}
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR38332') HTTP/1.1" 204 0
2026-03-30 10:53:06 [auto1.de] INFO: Found listing with ID: FK66572
2026-03-30 10:53:06 [auto1.de] INFO: Found listing with ID: DC85616
2026-03-30 10:53:06 [auto1.de] INFO: Found listing with ID: ZT79683
2026-03-30 10:53:06 [auto1.de] INFO: Found listing with ID: RK31511
2026-03-30 10:53:06 [auto1.de] INFO: Found listing with ID: AV36611
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV36611%27 HTTP/1.1" 200 None
2026-03-30 10:53:06 [auto1.de] INFO: Scrape type for AV36611: 2
2026-03-30 10:53:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d89a985f-2c6d-584b-8f1b-d1ca4adccc10 with identifier: AV36611
2026-03-30 10:53:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d89a985f-2c6d-584b-8f1b-d1ca4adccc10 with scrape type 2
2026-03-30 10:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d89a985f-2c6d-584b-8f1b-d1ca4adccc10 with scrape type 2
2026-03-30 10:53:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d89a985f-2c6d-584b-8f1b-d1ca4adccc10, identifier: AV36611
2026-03-30 10:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d89a985f-2c6d-584b-8f1b-d1ca4adccc10 with identifier: AV36611
2026-03-30 10:53:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d89a985f-2c6d-584b-8f1b-d1ca4adccc10 with identifier: AV36611
2026-03-30 10:53:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d89a985f-2c6d-584b-8f1b-d1ca4adccc10 with identifier: AV36611 to the API
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:44:35Z',
 'fuel_type': 'petrol',
 'id': 'd89a985f-2c6d-584b-8f1b-d1ca4adccc10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV36611',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 40172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seller_name': None,
 'title': 'Renault Megane 1.8 TCe R.S. Trophy',
 'transmission': 'automatic',
 'trim': 'R.S. Trophy',
 'year': 2021}
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV36611%27 HTTP/1.1" 200 None
2026-03-30 10:53:06 [auto1.de] INFO: Saving data for AV36611: {'auction_closing_time': 1774971875.0, 'created_time': 1773945898.757036, 'last_price_update_time': 1774867986.896554}
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV36611') HTTP/1.1" 204 0
2026-03-30 10:53:06 [auto1.de] INFO: Found listing with ID: XT77229
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT77229%27 HTTP/1.1" 200 None
2026-03-30 10:53:06 [auto1.de] INFO: Scrape type for XT77229: 2
2026-03-30 10:53:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf40568c-d22d-51b2-9ccd-1f10a489a0b3 with identifier: XT77229
2026-03-30 10:53:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf40568c-d22d-51b2-9ccd-1f10a489a0b3 with scrape type 2
2026-03-30 10:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf40568c-d22d-51b2-9ccd-1f10a489a0b3 with scrape type 2
2026-03-30 10:53:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf40568c-d22d-51b2-9ccd-1f10a489a0b3, identifier: XT77229
2026-03-30 10:53:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf40568c-d22d-51b2-9ccd-1f10a489a0b3 with identifier: XT77229
2026-03-30 10:53:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf40568c-d22d-51b2-9ccd-1f10a489a0b3 with identifier: XT77229
2026-03-30 10:53:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf40568c-d22d-51b2-9ccd-1f10a489a0b3 with identifier: XT77229 to the API
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-31T15:52:52Z',
 'fuel_type': 'petrol',
 'id': 'cf40568c-d22d-51b2-9ccd-1f10a489a0b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT77229',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 102380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-30',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 Classic blue 2WD',
 'transmission': 'manual',
 'trim': 'Classic blue 2WD',
 'year': 2018}
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT77229%27 HTTP/1.1" 200 None
2026-03-30 10:53:07 [auto1.de] INFO: Saving data for XT77229: {'auction_closing_time': 1774972372.0, 'created_time': 1773772272.251678, 'last_price_update_time': 1774867987.389352}
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT77229') HTTP/1.1" 204 0
2026-03-30 10:53:07 [auto1.de] INFO: Found listing with ID: GJ64200
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ64200%27 HTTP/1.1" 200 None
2026-03-30 10:53:07 [auto1.de] INFO: Scrape type for GJ64200: 2
2026-03-30 10:53:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c977bd8-25ac-5ad8-a9cf-740af1f2cd04 with identifier: GJ64200
2026-03-30 10:53:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c977bd8-25ac-5ad8-a9cf-740af1f2cd04 with scrape type 2
2026-03-30 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c977bd8-25ac-5ad8-a9cf-740af1f2cd04 with scrape type 2
2026-03-30 10:53:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c977bd8-25ac-5ad8-a9cf-740af1f2cd04, identifier: GJ64200
2026-03-30 10:53:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c977bd8-25ac-5ad8-a9cf-740af1f2cd04 with identifier: GJ64200
2026-03-30 10:53:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c977bd8-25ac-5ad8-a9cf-740af1f2cd04 with identifier: GJ64200
2026-03-30 10:53:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c977bd8-25ac-5ad8-a9cf-740af1f2cd04 with identifier: GJ64200 to the API
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:36:00Z',
 'fuel_type': 'petrol',
 'id': '8c977bd8-25ac-5ad8-a9cf-740af1f2cd04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ64200',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 82606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-27',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2016}
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ64200%27 HTTP/1.1" 200 None
2026-03-30 10:53:07 [auto1.de] INFO: Saving data for GJ64200: {'auction_closing_time': 1774971360.0, 'created_time': 1774377197.94597, 'last_price_update_time': 1774867987.991053}
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ64200') HTTP/1.1" 204 0
2026-03-30 10:53:08 [auto1.de] INFO: Channel: 24h | Page: 43 | totalHits: 9516 | hits on page: 40
2026-03-30 10:53:08 [auto1.de] INFO: Found listing with ID: BC32667
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC32667%27 HTTP/1.1" 200 None
2026-03-30 10:53:08 [auto1.de] INFO: Scrape type for BC32667: 2
2026-03-30 10:53:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6077fdeb-2384-5963-80bf-380274ae4b29 with identifier: BC32667
2026-03-30 10:53:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6077fdeb-2384-5963-80bf-380274ae4b29 with scrape type 2
2026-03-30 10:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6077fdeb-2384-5963-80bf-380274ae4b29 with scrape type 2
2026-03-30 10:53:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6077fdeb-2384-5963-80bf-380274ae4b29, identifier: BC32667
2026-03-30 10:53:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6077fdeb-2384-5963-80bf-380274ae4b29 with identifier: BC32667
2026-03-30 10:53:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6077fdeb-2384-5963-80bf-380274ae4b29 with identifier: BC32667
2026-03-30 10:53:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6077fdeb-2384-5963-80bf-380274ae4b29 with identifier: BC32667 to the API
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-31T15:17:29Z',
 'fuel_type': 'petrol',
 'id': '6077fdeb-2384-5963-80bf-380274ae4b29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC32667',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 161229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-02',
 'seller_name': None,
 'title': 'Dacia Logan MCV 1.6 Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2009}
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC32667%27 HTTP/1.1" 200 None
2026-03-30 10:53:08 [auto1.de] INFO: Saving data for BC32667: {'auction_closing_time': 1774970249.0, 'created_time': 1774463505.965464, 'last_price_update_time': 1774867988.452006}
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC32667') HTTP/1.1" 204 0
2026-03-30 10:53:08 [auto1.de] INFO: Found listing with ID: CB64325
2026-03-30 10:53:08 [auto1.de] INFO: Found listing with ID: KM55226
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM55226%27 HTTP/1.1" 200 None
2026-03-30 10:53:08 [auto1.de] INFO: Scrape type for KM55226: 2
2026-03-30 10:53:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612dbc9d-930f-5db8-870e-093dc8c2c5e1 with identifier: KM55226
2026-03-30 10:53:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612dbc9d-930f-5db8-870e-093dc8c2c5e1 with scrape type 2
2026-03-30 10:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612dbc9d-930f-5db8-870e-093dc8c2c5e1 with scrape type 2
2026-03-30 10:53:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 612dbc9d-930f-5db8-870e-093dc8c2c5e1, identifier: KM55226
2026-03-30 10:53:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:08 [auto1.de] INFO: Found listing with ID: NG90783
2026-03-30 10:53:08 [auto1.de] INFO: Found listing with ID: ZY01103
2026-03-30 10:53:08 [auto1.de] INFO: Found listing with ID: PT35689
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT35689%27 HTTP/1.1" 200 None
2026-03-30 10:53:08 [auto1.de] INFO: Scrape type for PT35689: 2
2026-03-30 10:53:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0c0984c-fd85-57c2-aa9e-eafa27fcc764 with identifier: PT35689
2026-03-30 10:53:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0c0984c-fd85-57c2-aa9e-eafa27fcc764 with scrape type 2
2026-03-30 10:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0c0984c-fd85-57c2-aa9e-eafa27fcc764 with scrape type 2
2026-03-30 10:53:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0c0984c-fd85-57c2-aa9e-eafa27fcc764, identifier: PT35689
2026-03-30 10:53:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 612dbc9d-930f-5db8-870e-093dc8c2c5e1 with identifier: KM55226
2026-03-30 10:53:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 612dbc9d-930f-5db8-870e-093dc8c2c5e1 with identifier: KM55226
2026-03-30 10:53:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 612dbc9d-930f-5db8-870e-093dc8c2c5e1 with identifier: KM55226 to the API
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:52:35Z',
 'fuel_type': 'diesel',
 'id': '612dbc9d-930f-5db8-870e-093dc8c2c5e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM55226',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 128617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-18',
 'seller_name': None,
 'title': 'BMW X4 xDrive 20d Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM55226%27 HTTP/1.1" 200 None
2026-03-30 10:53:09 [auto1.de] INFO: Saving data for KM55226: {'auction_closing_time': 1774972355.0, 'created_time': 1773945623.023662, 'last_price_update_time': 1774867989.046569}
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM55226') HTTP/1.1" 204 0
2026-03-30 10:53:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0c0984c-fd85-57c2-aa9e-eafa27fcc764 with identifier: PT35689
2026-03-30 10:53:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0c0984c-fd85-57c2-aa9e-eafa27fcc764 with identifier: PT35689
2026-03-30 10:53:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0c0984c-fd85-57c2-aa9e-eafa27fcc764 with identifier: PT35689 to the API
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:02:22Z',
 'fuel_type': 'diesel',
 'id': 'c0c0984c-fd85-57c2-aa9e-eafa27fcc764',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT35689',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 60299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-19',
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi Bi-Turbo Sport 4x4',
 'transmission': 'automatic',
 'trim': 'Sport 4x4',
 'year': 2017}
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT35689%27 HTTP/1.1" 200 None
2026-03-30 10:53:09 [auto1.de] INFO: Saving data for PT35689: {'auction_closing_time': 1774969342.0, 'created_time': 1774379615.562778, 'last_price_update_time': 1774867989.405136}
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT35689') HTTP/1.1" 204 0
2026-03-30 10:53:09 [auto1.de] INFO: Found listing with ID: PL31001
2026-03-30 10:53:09 [auto1.de] INFO: Found listing with ID: YX79581
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX79581%27 HTTP/1.1" 200 None
2026-03-30 10:53:09 [auto1.de] INFO: Scrape type for YX79581: 2
2026-03-30 10:53:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 344551dc-a6b5-5f26-b219-a2efddfdb2b4 with identifier: YX79581
2026-03-30 10:53:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 344551dc-a6b5-5f26-b219-a2efddfdb2b4 with scrape type 2
2026-03-30 10:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 344551dc-a6b5-5f26-b219-a2efddfdb2b4 with scrape type 2
2026-03-30 10:53:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 344551dc-a6b5-5f26-b219-a2efddfdb2b4, identifier: YX79581
2026-03-30 10:53:09 [auto1.de] INFO: Found listing with ID: TY67265
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY67265%27 HTTP/1.1" 200 None
2026-03-30 10:53:09 [auto1.de] INFO: Scrape type for TY67265: 2
2026-03-30 10:53:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e115fdf5-6cf5-566b-9359-79271001fb7b with identifier: TY67265
2026-03-30 10:53:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e115fdf5-6cf5-566b-9359-79271001fb7b with scrape type 2
2026-03-30 10:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e115fdf5-6cf5-566b-9359-79271001fb7b with scrape type 2
2026-03-30 10:53:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e115fdf5-6cf5-566b-9359-79271001fb7b, identifier: TY67265
2026-03-30 10:53:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 344551dc-a6b5-5f26-b219-a2efddfdb2b4 with identifier: YX79581
2026-03-30 10:53:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 344551dc-a6b5-5f26-b219-a2efddfdb2b4 with identifier: YX79581
2026-03-30 10:53:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 344551dc-a6b5-5f26-b219-a2efddfdb2b4 with identifier: YX79581 to the API
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:25:59Z',
 'fuel_type': 'petrol',
 'id': '344551dc-a6b5-5f26-b219-a2efddfdb2b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX79581',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 45388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-09',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX79581%27 HTTP/1.1" 200 None
2026-03-30 10:53:10 [auto1.de] INFO: Saving data for YX79581: {'auction_closing_time': 1774970759.0, 'created_time': 1773776233.227699, 'last_price_update_time': 1774867990.048776}
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YX79581') HTTP/1.1" 204 0
2026-03-30 10:53:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e115fdf5-6cf5-566b-9359-79271001fb7b with identifier: TY67265
2026-03-30 10:53:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e115fdf5-6cf5-566b-9359-79271001fb7b with identifier: TY67265
2026-03-30 10:53:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e115fdf5-6cf5-566b-9359-79271001fb7b with identifier: TY67265 to the API
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:33:03Z',
 'fuel_type': 'diesel',
 'id': 'e115fdf5-6cf5-566b-9359-79271001fb7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY67265',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 259147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-02',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueEfficiency',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency',
 'year': 2012}
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY67265%27 HTTP/1.1" 200 None
2026-03-30 10:53:10 [auto1.de] INFO: Saving data for TY67265: {'auction_closing_time': 1774971183.0, 'created_time': 1773400929.56518, 'last_price_update_time': 1774867990.39968}
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY67265') HTTP/1.1" 204 0
2026-03-30 10:53:10 [auto1.de] INFO: Found listing with ID: HU81893
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU81893%27 HTTP/1.1" 200 None
2026-03-30 10:53:10 [auto1.de] INFO: Scrape type for HU81893: 2
2026-03-30 10:53:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51933a2b-aa23-5bf2-8663-3bad7f7c12c1 with identifier: HU81893
2026-03-30 10:53:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51933a2b-aa23-5bf2-8663-3bad7f7c12c1 with scrape type 2
2026-03-30 10:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51933a2b-aa23-5bf2-8663-3bad7f7c12c1 with scrape type 2
2026-03-30 10:53:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51933a2b-aa23-5bf2-8663-3bad7f7c12c1, identifier: HU81893
2026-03-30 10:53:10 [auto1.de] INFO: Found listing with ID: TC30897
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC30897%27 HTTP/1.1" 200 None
2026-03-30 10:53:10 [auto1.de] INFO: Scrape type for TC30897: 2
2026-03-30 10:53:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8505c45d-457a-523f-a731-a52fd7e5330e with identifier: TC30897
2026-03-30 10:53:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8505c45d-457a-523f-a731-a52fd7e5330e with scrape type 2
2026-03-30 10:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8505c45d-457a-523f-a731-a52fd7e5330e with scrape type 2
2026-03-30 10:53:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8505c45d-457a-523f-a731-a52fd7e5330e, identifier: TC30897
2026-03-30 10:53:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51933a2b-aa23-5bf2-8663-3bad7f7c12c1 with identifier: HU81893
2026-03-30 10:53:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51933a2b-aa23-5bf2-8663-3bad7f7c12c1 with identifier: HU81893
2026-03-30 10:53:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51933a2b-aa23-5bf2-8663-3bad7f7c12c1 with identifier: HU81893 to the API
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:49:43Z',
 'fuel_type': 'petrol',
 'id': '51933a2b-aa23-5bf2-8663-3bad7f7c12c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU81893',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 88440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-18',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2007}
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU81893%27 HTTP/1.1" 200 None
2026-03-30 10:53:11 [auto1.de] INFO: Saving data for HU81893: {'auction_closing_time': 1774972183.0, 'created_time': 1774292009.745358, 'last_price_update_time': 1774867991.09247}
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU81893') HTTP/1.1" 204 0
2026-03-30 10:53:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8505c45d-457a-523f-a731-a52fd7e5330e with identifier: TC30897
2026-03-30 10:53:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8505c45d-457a-523f-a731-a52fd7e5330e with identifier: TC30897
2026-03-30 10:53:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8505c45d-457a-523f-a731-a52fd7e5330e with identifier: TC30897 to the API
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:34:49Z',
 'fuel_type': 'petrol',
 'id': '8505c45d-457a-523f-a731-a52fd7e5330e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC30897',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 65911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-20',
 'seller_name': None,
 'title': 'Audi A1 1.4 TFSI Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2015}
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC30897%27 HTTP/1.1" 200 None
2026-03-30 10:53:11 [auto1.de] INFO: Saving data for TC30897: {'auction_closing_time': 1774971289.0, 'created_time': 1773131882.845549, 'last_price_update_time': 1774867991.642672}
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TC30897') HTTP/1.1" 204 0
2026-03-30 10:53:11 [auto1.de] INFO: Found listing with ID: AU78717
2026-03-30 10:53:11 [auto1.de] INFO: Found listing with ID: CV04289
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV04289%27 HTTP/1.1" 200 None
2026-03-30 10:53:11 [auto1.de] INFO: Scrape type for CV04289: 2
2026-03-30 10:53:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a164d0d1-9fb4-5491-9a7d-f12c31936625 with identifier: CV04289
2026-03-30 10:53:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a164d0d1-9fb4-5491-9a7d-f12c31936625 with scrape type 2
2026-03-30 10:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a164d0d1-9fb4-5491-9a7d-f12c31936625 with scrape type 2
2026-03-30 10:53:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a164d0d1-9fb4-5491-9a7d-f12c31936625, identifier: CV04289
2026-03-30 10:53:11 [auto1.de] INFO: Found listing with ID: XU08667
2026-03-30 10:53:11 [auto1.de] INFO: Found listing with ID: UL26956
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL26956%27 HTTP/1.1" 200 None
2026-03-30 10:53:11 [auto1.de] INFO: Scrape type for UL26956: 2
2026-03-30 10:53:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1cc9142-72bf-53a7-8d9e-cda18203c43d with identifier: UL26956
2026-03-30 10:53:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1cc9142-72bf-53a7-8d9e-cda18203c43d with scrape type 2
2026-03-30 10:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1cc9142-72bf-53a7-8d9e-cda18203c43d with scrape type 2
2026-03-30 10:53:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1cc9142-72bf-53a7-8d9e-cda18203c43d, identifier: UL26956
2026-03-30 10:53:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a164d0d1-9fb4-5491-9a7d-f12c31936625 with identifier: CV04289
2026-03-30 10:53:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a164d0d1-9fb4-5491-9a7d-f12c31936625 with identifier: CV04289
2026-03-30 10:53:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a164d0d1-9fb4-5491-9a7d-f12c31936625 with identifier: CV04289 to the API
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:12:42Z',
 'fuel_type': 'petrol',
 'id': 'a164d0d1-9fb4-5491-9a7d-f12c31936625',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV04289',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 51181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-25',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic Blue',
 'transmission': 'manual',
 'trim': 'Classic Blue',
 'year': 2015}
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV04289%27 HTTP/1.1" 200 None
2026-03-30 10:53:12 [auto1.de] INFO: Saving data for CV04289: {'auction_closing_time': 1774969962.0, 'created_time': 1773343845.820042, 'last_price_update_time': 1774867992.202801}
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV04289') HTTP/1.1" 204 0
2026-03-30 10:53:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1cc9142-72bf-53a7-8d9e-cda18203c43d with identifier: UL26956
2026-03-30 10:53:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1cc9142-72bf-53a7-8d9e-cda18203c43d with identifier: UL26956
2026-03-30 10:53:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1cc9142-72bf-53a7-8d9e-cda18203c43d with identifier: UL26956 to the API
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-31T15:29:16Z',
 'fuel_type': 'petrol',
 'id': 'b1cc9142-72bf-53a7-8d9e-cda18203c43d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL26956',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 213935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-06',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 450 4Matic AMG',
 'transmission': 'automatic',
 'trim': '4Matic AMG',
 'year': 2016}
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL26956%27 HTTP/1.1" 200 None
2026-03-30 10:53:12 [auto1.de] INFO: Saving data for UL26956: {'auction_closing_time': 1774970956.0, 'created_time': 1773302196.431236, 'last_price_update_time': 1774867992.56837}
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL26956') HTTP/1.1" 204 0
2026-03-30 10:53:12 [auto1.de] INFO: Found listing with ID: UY19971
2026-03-30 10:53:12 [auto1.de] INFO: Found listing with ID: ML79860
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML79860%27 HTTP/1.1" 200 None
2026-03-30 10:53:12 [auto1.de] INFO: Scrape type for ML79860: 2
2026-03-30 10:53:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21fa9ddc-39b0-58d7-bbec-4f19989a4b0d with identifier: ML79860
2026-03-30 10:53:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21fa9ddc-39b0-58d7-bbec-4f19989a4b0d with scrape type 2
2026-03-30 10:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21fa9ddc-39b0-58d7-bbec-4f19989a4b0d with scrape type 2
2026-03-30 10:53:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21fa9ddc-39b0-58d7-bbec-4f19989a4b0d, identifier: ML79860
2026-03-30 10:53:12 [auto1.de] INFO: Found listing with ID: GV55146
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV55146%27 HTTP/1.1" 200 None
2026-03-30 10:53:12 [auto1.de] INFO: Scrape type for GV55146: 2
2026-03-30 10:53:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6ca54ca-a5e1-54d0-8ade-43d303810736 with identifier: GV55146
2026-03-30 10:53:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6ca54ca-a5e1-54d0-8ade-43d303810736 with scrape type 2
2026-03-30 10:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6ca54ca-a5e1-54d0-8ade-43d303810736 with scrape type 2
2026-03-30 10:53:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6ca54ca-a5e1-54d0-8ade-43d303810736, identifier: GV55146
2026-03-30 10:53:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21fa9ddc-39b0-58d7-bbec-4f19989a4b0d with identifier: ML79860
2026-03-30 10:53:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21fa9ddc-39b0-58d7-bbec-4f19989a4b0d with identifier: ML79860
2026-03-30 10:53:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21fa9ddc-39b0-58d7-bbec-4f19989a4b0d with identifier: ML79860 to the API
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:44:55Z',
 'fuel_type': 'petrol',
 'id': '21fa9ddc-39b0-58d7-bbec-4f19989a4b0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML79860',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 220461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1992-12-20',
 'seller_name': None,
 'title': 'BMW 3er 316i',
 'transmission': 'automatic',
 'trim': '',
 'year': 1992}
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML79860%27 HTTP/1.1" 200 None
2026-03-30 10:53:13 [auto1.de] INFO: Saving data for ML79860: {'auction_closing_time': 1774971895.0, 'created_time': 1774379112.599495, 'last_price_update_time': 1774867993.173626}
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML79860') HTTP/1.1" 204 0
2026-03-30 10:53:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6ca54ca-a5e1-54d0-8ade-43d303810736 with identifier: GV55146
2026-03-30 10:53:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6ca54ca-a5e1-54d0-8ade-43d303810736 with identifier: GV55146
2026-03-30 10:53:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6ca54ca-a5e1-54d0-8ade-43d303810736 with identifier: GV55146 to the API
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:26:55Z',
 'fuel_type': 'diesel',
 'id': 'a6ca54ca-a5e1-54d0-8ade-43d303810736',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV55146',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T4 Caravelle',
 'odometer': 360393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-07-05',
 'seller_name': None,
 'title': 'Volkswagen T4 Caravelle 2.5 TDI GL',
 'transmission': 'manual',
 'trim': 'GL',
 'year': 1998}
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV55146%27 HTTP/1.1" 200 None
2026-03-30 10:53:13 [auto1.de] INFO: Saving data for GV55146: {'auction_closing_time': 1774970815.0, 'created_time': 1773945272.400801, 'last_price_update_time': 1774867993.517028}
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV55146') HTTP/1.1" 204 0
2026-03-30 10:53:13 [auto1.de] INFO: Found listing with ID: EW23969
2026-03-30 10:53:13 [auto1.de] INFO: Found listing with ID: PK80050
2026-03-30 10:53:13 [auto1.de] INFO: Found listing with ID: EV61179
2026-03-30 10:53:13 [auto1.de] INFO: Found listing with ID: EY37211
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY37211%27 HTTP/1.1" 200 None
2026-03-30 10:53:13 [auto1.de] INFO: Scrape type for EY37211: 2
2026-03-30 10:53:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca97019b-db2a-5eeb-870d-8261b02b0449 with identifier: EY37211
2026-03-30 10:53:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca97019b-db2a-5eeb-870d-8261b02b0449 with scrape type 2
2026-03-30 10:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca97019b-db2a-5eeb-870d-8261b02b0449 with scrape type 2
2026-03-30 10:53:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca97019b-db2a-5eeb-870d-8261b02b0449, identifier: EY37211
2026-03-30 10:53:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca97019b-db2a-5eeb-870d-8261b02b0449 with identifier: EY37211
2026-03-30 10:53:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca97019b-db2a-5eeb-870d-8261b02b0449 with identifier: EY37211
2026-03-30 10:53:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca97019b-db2a-5eeb-870d-8261b02b0449 with identifier: EY37211 to the API
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-31T15:50:54Z',
 'fuel_type': 'petrol',
 'id': 'ca97019b-db2a-5eeb-870d-8261b02b0449',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY37211',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 133770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-18',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 400 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY37211%27 HTTP/1.1" 200 None
2026-03-30 10:53:13 [auto1.de] INFO: Saving data for EY37211: {'auction_closing_time': 1774972254.0, 'created_time': 1773772264.019501, 'last_price_update_time': 1774867993.954492}
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY37211') HTTP/1.1" 204 0
2026-03-30 10:53:14 [auto1.de] INFO: Found listing with ID: PH55867
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH55867%27 HTTP/1.1" 200 None
2026-03-30 10:53:14 [auto1.de] INFO: Scrape type for PH55867: 2
2026-03-30 10:53:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d4cb4aa-22ba-5685-9be9-b28f884cffcc with identifier: PH55867
2026-03-30 10:53:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d4cb4aa-22ba-5685-9be9-b28f884cffcc with scrape type 2
2026-03-30 10:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d4cb4aa-22ba-5685-9be9-b28f884cffcc with scrape type 2
2026-03-30 10:53:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d4cb4aa-22ba-5685-9be9-b28f884cffcc, identifier: PH55867
2026-03-30 10:53:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d4cb4aa-22ba-5685-9be9-b28f884cffcc with identifier: PH55867
2026-03-30 10:53:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d4cb4aa-22ba-5685-9be9-b28f884cffcc with identifier: PH55867
2026-03-30 10:53:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d4cb4aa-22ba-5685-9be9-b28f884cffcc with identifier: PH55867 to the API
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:12:05Z',
 'fuel_type': 'diesel',
 'id': '9d4cb4aa-22ba-5685-9be9-b28f884cffcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH55867',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 165667,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-17',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH55867%27 HTTP/1.1" 200 None
2026-03-30 10:53:14 [auto1.de] INFO: Saving data for PH55867: {'auction_closing_time': 1774969925.0, 'created_time': 1773341221.64918, 'last_price_update_time': 1774867994.565524}
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH55867') HTTP/1.1" 204 0
2026-03-30 10:53:14 [auto1.de] INFO: Found listing with ID: YH45665
2026-03-30 10:53:14 [auto1.de] INFO: Found listing with ID: SS53525
2026-03-30 10:53:14 [auto1.de] INFO: Found listing with ID: VZ80726
2026-03-30 10:53:14 [auto1.de] INFO: Found listing with ID: EA70503
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA70503%27 HTTP/1.1" 200 None
2026-03-30 10:53:14 [auto1.de] INFO: Scrape type for EA70503: 1
2026-03-30 10:53:14 [auto1.de] INFO: Found listing with ID: LU14578
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU14578%27 HTTP/1.1" 200 None
2026-03-30 10:53:14 [auto1.de] INFO: Scrape type for LU14578: 2
2026-03-30 10:53:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c88cc516-f68f-51a5-bbf3-d07e399d52a3 with identifier: LU14578
2026-03-30 10:53:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c88cc516-f68f-51a5-bbf3-d07e399d52a3 with scrape type 2
2026-03-30 10:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c88cc516-f68f-51a5-bbf3-d07e399d52a3 with scrape type 2
2026-03-30 10:53:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c88cc516-f68f-51a5-bbf3-d07e399d52a3, identifier: LU14578
2026-03-30 10:53:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c88cc516-f68f-51a5-bbf3-d07e399d52a3 with identifier: LU14578
2026-03-30 10:53:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c88cc516-f68f-51a5-bbf3-d07e399d52a3 with identifier: LU14578
2026-03-30 10:53:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c88cc516-f68f-51a5-bbf3-d07e399d52a3 with identifier: LU14578 to the API
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:21:42Z',
 'fuel_type': 'petrol',
 'id': 'c88cc516-f68f-51a5-bbf3-d07e399d52a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU14578',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 101037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-01',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2015}
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU14578%27 HTTP/1.1" 200 None
2026-03-30 10:53:15 [auto1.de] INFO: Saving data for LU14578: {'auction_closing_time': 1774970502.0, 'created_time': 1774378853.338244, 'last_price_update_time': 1774867995.3743}
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU14578') HTTP/1.1" 204 0
2026-03-30 10:53:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:15 [auto1.de] INFO: Found listing with ID: SK78109
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK78109%27 HTTP/1.1" 200 None
2026-03-30 10:53:15 [auto1.de] INFO: Scrape type for SK78109: 2
2026-03-30 10:53:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0105b39f-dba1-5afd-8f27-b511ecdbb812 with identifier: SK78109
2026-03-30 10:53:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0105b39f-dba1-5afd-8f27-b511ecdbb812 with scrape type 2
2026-03-30 10:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0105b39f-dba1-5afd-8f27-b511ecdbb812 with scrape type 2
2026-03-30 10:53:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0105b39f-dba1-5afd-8f27-b511ecdbb812, identifier: SK78109
2026-03-30 10:53:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0105b39f-dba1-5afd-8f27-b511ecdbb812 with identifier: SK78109
2026-03-30 10:53:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0105b39f-dba1-5afd-8f27-b511ecdbb812 with identifier: SK78109
2026-03-30 10:53:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0105b39f-dba1-5afd-8f27-b511ecdbb812 with identifier: SK78109 to the API
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:22:36Z',
 'fuel_type': 'diesel',
 'id': '0105b39f-dba1-5afd-8f27-b511ecdbb812',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK78109',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 251596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-26',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK78109%27 HTTP/1.1" 200 None
2026-03-30 10:53:15 [auto1.de] INFO: Saving data for SK78109: {'auction_closing_time': 1774970556.0, 'created_time': 1773660069.474451, 'last_price_update_time': 1774867995.821346}
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK78109') HTTP/1.1" 204 0
2026-03-30 10:53:15 [auto1.de] INFO: Found listing with ID: RT55405
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT55405%27 HTTP/1.1" 200 None
2026-03-30 10:53:15 [auto1.de] INFO: Scrape type for RT55405: 2
2026-03-30 10:53:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 514b0bdc-bc01-5dee-9acc-93cab63adc60 with identifier: RT55405
2026-03-30 10:53:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 514b0bdc-bc01-5dee-9acc-93cab63adc60 with scrape type 2
2026-03-30 10:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 514b0bdc-bc01-5dee-9acc-93cab63adc60 with scrape type 2
2026-03-30 10:53:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 514b0bdc-bc01-5dee-9acc-93cab63adc60, identifier: RT55405
2026-03-30 10:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 514b0bdc-bc01-5dee-9acc-93cab63adc60 with identifier: RT55405
2026-03-30 10:53:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 514b0bdc-bc01-5dee-9acc-93cab63adc60 with identifier: RT55405
2026-03-30 10:53:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 514b0bdc-bc01-5dee-9acc-93cab63adc60 with identifier: RT55405 to the API
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:54:32Z',
 'fuel_type': 'petrol',
 'id': '514b0bdc-bc01-5dee-9acc-93cab63adc60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT55405',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 181343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-13',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT55405%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [auto1.de] INFO: Saving data for RT55405: {'auction_closing_time': 1774972472.0, 'created_time': 1774380343.20874, 'last_price_update_time': 1774867996.345995}
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT55405') HTTP/1.1" 204 0
2026-03-30 10:53:16 [auto1.de] INFO: Found listing with ID: EJ11673
2026-03-30 10:53:16 [auto1.de] INFO: Found listing with ID: SS47444
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS47444%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [auto1.de] INFO: Scrape type for SS47444: 2
2026-03-30 10:53:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ede61686-0284-57e1-a4a5-a4d5cc15ab63 with identifier: SS47444
2026-03-30 10:53:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ede61686-0284-57e1-a4a5-a4d5cc15ab63 with scrape type 2
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ede61686-0284-57e1-a4a5-a4d5cc15ab63 with scrape type 2
2026-03-30 10:53:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ede61686-0284-57e1-a4a5-a4d5cc15ab63, identifier: SS47444
2026-03-30 10:53:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ede61686-0284-57e1-a4a5-a4d5cc15ab63 with identifier: SS47444
2026-03-30 10:53:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ede61686-0284-57e1-a4a5-a4d5cc15ab63 with identifier: SS47444
2026-03-30 10:53:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ede61686-0284-57e1-a4a5-a4d5cc15ab63 with identifier: SS47444 to the API
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:58:46Z',
 'fuel_type': 'diesel',
 'id': 'ede61686-0284-57e1-a4a5-a4d5cc15ab63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS47444',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 82993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-19',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CDI BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Elegance',
 'year': 2011}
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS47444%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [auto1.de] INFO: Saving data for SS47444: {'auction_closing_time': 1774972726.0, 'created_time': 1774377106.359991, 'last_price_update_time': 1774867996.812417}
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS47444') HTTP/1.1" 204 0
2026-03-30 10:53:16 [auto1.de] INFO: Found listing with ID: TD39885
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD39885%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [auto1.de] INFO: Scrape type for TD39885: 2
2026-03-30 10:53:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b481af6b-d548-5942-bb4e-f4bf61db2f03 with identifier: TD39885
2026-03-30 10:53:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b481af6b-d548-5942-bb4e-f4bf61db2f03 with scrape type 2
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b481af6b-d548-5942-bb4e-f4bf61db2f03 with scrape type 2
2026-03-30 10:53:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b481af6b-d548-5942-bb4e-f4bf61db2f03, identifier: TD39885
2026-03-30 10:53:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b481af6b-d548-5942-bb4e-f4bf61db2f03 with identifier: TD39885
2026-03-30 10:53:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b481af6b-d548-5942-bb4e-f4bf61db2f03 with identifier: TD39885
2026-03-30 10:53:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b481af6b-d548-5942-bb4e-f4bf61db2f03 with identifier: TD39885 to the API
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:50:00Z',
 'fuel_type': 'diesel',
 'id': 'b481af6b-d548-5942-bb4e-f4bf61db2f03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD39885',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 101208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-24',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium AWD',
 'transmission': 'automatic',
 'trim': 'Titanium AWD',
 'year': 2016}
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD39885%27 HTTP/1.1" 200 None
2026-03-30 10:53:17 [auto1.de] INFO: Saving data for TD39885: {'auction_closing_time': 1774972200.0, 'created_time': 1774465132.502961, 'last_price_update_time': 1774867997.277002}
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD39885') HTTP/1.1" 204 0
2026-03-30 10:53:17 [auto1.de] INFO: Channel: 24h | Page: 44 | totalHits: 9519 | hits on page: 40
2026-03-30 10:53:17 [auto1.de] INFO: Found listing with ID: VP92353
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP92353%27 HTTP/1.1" 200 None
2026-03-30 10:53:17 [auto1.de] INFO: Scrape type for VP92353: 2
2026-03-30 10:53:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 164e6c28-a101-52ca-8e77-fb4b62e703f2 with identifier: VP92353
2026-03-30 10:53:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 164e6c28-a101-52ca-8e77-fb4b62e703f2 with scrape type 2
2026-03-30 10:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 164e6c28-a101-52ca-8e77-fb4b62e703f2 with scrape type 2
2026-03-30 10:53:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 164e6c28-a101-52ca-8e77-fb4b62e703f2, identifier: VP92353
2026-03-30 10:53:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 164e6c28-a101-52ca-8e77-fb4b62e703f2 with identifier: VP92353
2026-03-30 10:53:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 164e6c28-a101-52ca-8e77-fb4b62e703f2 with identifier: VP92353
2026-03-30 10:53:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 164e6c28-a101-52ca-8e77-fb4b62e703f2 with identifier: VP92353 to the API
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 387,
 'expiration_date': '2026-03-31T15:44:44Z',
 'fuel_type': 'petrol',
 'id': '164e6c28-a101-52ca-8e77-fb4b62e703f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP92353',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 257168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-23',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 500',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP92353%27 HTTP/1.1" 200 None
2026-03-30 10:53:17 [auto1.de] INFO: Saving data for VP92353: {'auction_closing_time': 1774971884.0, 'created_time': 1773661952.752114, 'last_price_update_time': 1774867997.82584}
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VP92353') HTTP/1.1" 204 0
2026-03-30 10:53:17 [auto1.de] INFO: Found listing with ID: NB55026
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB55026%27 HTTP/1.1" 200 None
2026-03-30 10:53:17 [auto1.de] INFO: Scrape type for NB55026: 1
2026-03-30 10:53:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:17 [auto1.de] INFO: Found listing with ID: TP77311
2026-03-30 10:53:17 [auto1.de] INFO: Found listing with ID: WT89388
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT89388%27 HTTP/1.1" 200 None
2026-03-30 10:53:17 [auto1.de] INFO: Scrape type for WT89388: 1
2026-03-30 10:53:17 [auto1.de] INFO: Found listing with ID: MS18045
2026-03-30 10:53:17 [auto1.de] INFO: Found listing with ID: UW30649
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW30649%27 HTTP/1.1" 200 None
2026-03-30 10:53:17 [auto1.de] INFO: Scrape type for UW30649: 2
2026-03-30 10:53:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24881325-5fb3-589e-8887-bf1592119b7e with identifier: UW30649
2026-03-30 10:53:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24881325-5fb3-589e-8887-bf1592119b7e with scrape type 2
2026-03-30 10:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24881325-5fb3-589e-8887-bf1592119b7e with scrape type 2
2026-03-30 10:53:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24881325-5fb3-589e-8887-bf1592119b7e, identifier: UW30649
2026-03-30 10:53:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:18 [auto1.de] INFO: Found listing with ID: JU02065
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU02065%27 HTTP/1.1" 200 None
2026-03-30 10:53:18 [auto1.de] INFO: Scrape type for JU02065: 2
2026-03-30 10:53:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 477cc983-a0f6-5b45-8cad-fbb430e90a3c with identifier: JU02065
2026-03-30 10:53:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 477cc983-a0f6-5b45-8cad-fbb430e90a3c with scrape type 2
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 477cc983-a0f6-5b45-8cad-fbb430e90a3c with scrape type 2
2026-03-30 10:53:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 477cc983-a0f6-5b45-8cad-fbb430e90a3c, identifier: JU02065
2026-03-30 10:53:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24881325-5fb3-589e-8887-bf1592119b7e with identifier: UW30649
2026-03-30 10:53:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24881325-5fb3-589e-8887-bf1592119b7e with identifier: UW30649
2026-03-30 10:53:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24881325-5fb3-589e-8887-bf1592119b7e with identifier: UW30649 to the API
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:03:22Z',
 'fuel_type': 'diesel',
 'id': '24881325-5fb3-589e-8887-bf1592119b7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW30649',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 298218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-07',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 119 CDI lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2019}
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW30649%27 HTTP/1.1" 200 None
2026-03-30 10:53:18 [auto1.de] INFO: Saving data for UW30649: {'auction_closing_time': 1774969402.0, 'created_time': 1774262278.745317, 'last_price_update_time': 1774867998.52729}
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW30649') HTTP/1.1" 204 0
2026-03-30 10:53:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 477cc983-a0f6-5b45-8cad-fbb430e90a3c with identifier: JU02065
2026-03-30 10:53:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 477cc983-a0f6-5b45-8cad-fbb430e90a3c with identifier: JU02065
2026-03-30 10:53:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 477cc983-a0f6-5b45-8cad-fbb430e90a3c with identifier: JU02065 to the API
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 475,
 'expiration_date': '2026-03-31T15:40:45Z',
 'fuel_type': 'petrol',
 'id': '477cc983-a0f6-5b45-8cad-fbb430e90a3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU02065',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 63907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-27',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 63 AMG T',
 'transmission': 'automatic',
 'trim': 'T',
 'year': 2017}
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU02065%27 HTTP/1.1" 200 None
2026-03-30 10:53:18 [auto1.de] INFO: Saving data for JU02065: {'auction_closing_time': 1774971645.0, 'created_time': 1773772271.569226, 'last_price_update_time': 1774867998.858731}
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU02065') HTTP/1.1" 204 0
2026-03-30 10:53:18 [auto1.de] INFO: Found listing with ID: WX32371
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX32371%27 HTTP/1.1" 200 None
2026-03-30 10:53:18 [auto1.de] INFO: Scrape type for WX32371: 2
2026-03-30 10:53:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a222bb24-f77a-5747-bdd5-3f936b720d4f with identifier: WX32371
2026-03-30 10:53:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a222bb24-f77a-5747-bdd5-3f936b720d4f with scrape type 2
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a222bb24-f77a-5747-bdd5-3f936b720d4f with scrape type 2
2026-03-30 10:53:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a222bb24-f77a-5747-bdd5-3f936b720d4f, identifier: WX32371
2026-03-30 10:53:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:19 [auto1.de] INFO: Found listing with ID: JJ00785
2026-03-30 10:53:19 [auto1.de] INFO: Found listing with ID: JV02966
2026-03-30 10:53:19 [auto1.de] INFO: Found listing with ID: BW90089
2026-03-30 10:53:19 [auto1.de] INFO: Found listing with ID: XE14279
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE14279%27 HTTP/1.1" 200 None
2026-03-30 10:53:19 [auto1.de] INFO: Scrape type for XE14279: 2
2026-03-30 10:53:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47dc6633-4432-5ad0-b6a9-d7f735f10476 with identifier: XE14279
2026-03-30 10:53:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47dc6633-4432-5ad0-b6a9-d7f735f10476 with scrape type 2
2026-03-30 10:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47dc6633-4432-5ad0-b6a9-d7f735f10476 with scrape type 2
2026-03-30 10:53:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47dc6633-4432-5ad0-b6a9-d7f735f10476, identifier: XE14279
2026-03-30 10:53:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a222bb24-f77a-5747-bdd5-3f936b720d4f with identifier: WX32371
2026-03-30 10:53:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a222bb24-f77a-5747-bdd5-3f936b720d4f with identifier: WX32371
2026-03-30 10:53:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a222bb24-f77a-5747-bdd5-3f936b720d4f with identifier: WX32371 to the API
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:30:39Z',
 'fuel_type': 'petrol',
 'id': 'a222bb24-f77a-5747-bdd5-3f936b720d4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX32371',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 221949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-11-10',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Viva X',
 'transmission': 'manual',
 'trim': 'Viva X',
 'year': 2004}
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX32371%27 HTTP/1.1" 200 None
2026-03-30 10:53:19 [auto1.de] INFO: Saving data for WX32371: {'auction_closing_time': 1774971039.0, 'created_time': 1774294207.92868, 'last_price_update_time': 1774867999.486833}
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX32371') HTTP/1.1" 204 0
2026-03-30 10:53:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47dc6633-4432-5ad0-b6a9-d7f735f10476 with identifier: XE14279
2026-03-30 10:53:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47dc6633-4432-5ad0-b6a9-d7f735f10476 with identifier: XE14279
2026-03-30 10:53:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47dc6633-4432-5ad0-b6a9-d7f735f10476 with identifier: XE14279 to the API
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:51:35Z',
 'fuel_type': 'petrol',
 'id': '47dc6633-4432-5ad0-b6a9-d7f735f10476',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE14279',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 127875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-21',
 'seller_name': None,
 'title': 'BMW 1er 118i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2015}
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE14279%27 HTTP/1.1" 200 None
2026-03-30 10:53:20 [auto1.de] INFO: Saving data for XE14279: {'auction_closing_time': 1774972295.0, 'created_time': 1773227390.199828, 'last_price_update_time': 1774868000.037795}
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE14279') HTTP/1.1" 204 0
2026-03-30 10:53:20 [auto1.de] INFO: Found listing with ID: GK14765
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK14765%27 HTTP/1.1" 200 None
2026-03-30 10:53:20 [auto1.de] INFO: Scrape type for GK14765: 2
2026-03-30 10:53:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 219a24ac-0e76-5fda-8797-61a6715c565a with identifier: GK14765
2026-03-30 10:53:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 219a24ac-0e76-5fda-8797-61a6715c565a with scrape type 2
2026-03-30 10:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 219a24ac-0e76-5fda-8797-61a6715c565a with scrape type 2
2026-03-30 10:53:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 219a24ac-0e76-5fda-8797-61a6715c565a, identifier: GK14765
2026-03-30 10:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA70503/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:20 [auto1.de] INFO: Found listing with ID: UY98455
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY98455%27 HTTP/1.1" 200 None
2026-03-30 10:53:20 [auto1.de] INFO: Scrape type for UY98455: 2
2026-03-30 10:53:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b823ad59-75a2-5a7a-a919-e41113d6bb22 with identifier: UY98455
2026-03-30 10:53:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b823ad59-75a2-5a7a-a919-e41113d6bb22 with scrape type 2
2026-03-30 10:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b823ad59-75a2-5a7a-a919-e41113d6bb22 with scrape type 2
2026-03-30 10:53:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b823ad59-75a2-5a7a-a919-e41113d6bb22, identifier: UY98455
2026-03-30 10:53:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 219a24ac-0e76-5fda-8797-61a6715c565a with identifier: GK14765
2026-03-30 10:53:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 219a24ac-0e76-5fda-8797-61a6715c565a with identifier: GK14765
2026-03-30 10:53:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 219a24ac-0e76-5fda-8797-61a6715c565a with identifier: GK14765 to the API
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:58:31Z',
 'fuel_type': 'petrol',
 'id': '219a24ac-0e76-5fda-8797-61a6715c565a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK14765',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 136024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-21',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK14765%27 HTTP/1.1" 200 None
2026-03-30 10:53:20 [auto1.de] INFO: Saving data for GK14765: {'auction_closing_time': 1774972711.0, 'created_time': 1774466910.101839, 'last_price_update_time': 1774868000.6805}
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK14765') HTTP/1.1" 204 0
2026-03-30 10:53:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b823ad59-75a2-5a7a-a919-e41113d6bb22 with identifier: UY98455
2026-03-30 10:53:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b823ad59-75a2-5a7a-a919-e41113d6bb22 with identifier: UY98455
2026-03-30 10:53:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b823ad59-75a2-5a7a-a919-e41113d6bb22 with identifier: UY98455 to the API
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:10:45Z',
 'fuel_type': 'petrol',
 'id': 'b823ad59-75a2-5a7a-a919-e41113d6bb22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY98455',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 57132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-26',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2021}
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY98455%27 HTTP/1.1" 200 None
2026-03-30 10:53:21 [auto1.de] INFO: Saving data for UY98455: {'auction_closing_time': 1774969845.0, 'created_time': 1774377591.598405, 'last_price_update_time': 1774868001.030151}
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY98455') HTTP/1.1" 204 0
2026-03-30 10:53:21 [auto1.de] INFO: Found listing with ID: NV49426
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV49426%27 HTTP/1.1" 200 None
2026-03-30 10:53:21 [auto1.de] INFO: Scrape type for NV49426: 2
2026-03-30 10:53:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a0520be-8b62-5b73-b35b-ac44dd29505b with identifier: NV49426
2026-03-30 10:53:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a0520be-8b62-5b73-b35b-ac44dd29505b with scrape type 2
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a0520be-8b62-5b73-b35b-ac44dd29505b with scrape type 2
2026-03-30 10:53:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a0520be-8b62-5b73-b35b-ac44dd29505b, identifier: NV49426
2026-03-30 10:53:21 [auto1.de] INFO: Found listing with ID: WG34535
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG34535%27 HTTP/1.1" 200 None
2026-03-30 10:53:21 [auto1.de] INFO: Scrape type for WG34535: 2
2026-03-30 10:53:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84a937ba-3106-5ad1-813c-403eb4309678 with identifier: WG34535
2026-03-30 10:53:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84a937ba-3106-5ad1-813c-403eb4309678 with scrape type 2
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84a937ba-3106-5ad1-813c-403eb4309678 with scrape type 2
2026-03-30 10:53:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84a937ba-3106-5ad1-813c-403eb4309678, identifier: WG34535
2026-03-30 10:53:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a0520be-8b62-5b73-b35b-ac44dd29505b with identifier: NV49426
2026-03-30 10:53:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a0520be-8b62-5b73-b35b-ac44dd29505b with identifier: NV49426
2026-03-30 10:53:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a0520be-8b62-5b73-b35b-ac44dd29505b with identifier: NV49426 to the API
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:21:50Z',
 'fuel_type': 'petrol',
 'id': '6a0520be-8b62-5b73-b35b-ac44dd29505b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV49426',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 29423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-27',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2017}
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV49426%27 HTTP/1.1" 200 None
2026-03-30 10:53:21 [auto1.de] INFO: Saving data for NV49426: {'auction_closing_time': 1774970510.0, 'created_time': 1774377104.436329, 'last_price_update_time': 1774868001.666783}
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV49426') HTTP/1.1" 204 0
2026-03-30 10:53:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84a937ba-3106-5ad1-813c-403eb4309678 with identifier: WG34535
2026-03-30 10:53:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84a937ba-3106-5ad1-813c-403eb4309678 with identifier: WG34535
2026-03-30 10:53:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84a937ba-3106-5ad1-813c-403eb4309678 with identifier: WG34535 to the API
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:02:28Z',
 'fuel_type': 'diesel',
 'id': '84a937ba-3106-5ad1-813c-403eb4309678',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG34535',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 250855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-29',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion',
 'year': 2014}
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG34535%27 HTTP/1.1" 200 None
2026-03-30 10:53:22 [auto1.de] INFO: Saving data for WG34535: {'auction_closing_time': 1774969348.0, 'created_time': 1773469073.404115, 'last_price_update_time': 1774868002.009177}
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG34535') HTTP/1.1" 204 0
2026-03-30 10:53:22 [auto1.de] INFO: Found listing with ID: UP67859
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP67859%27 HTTP/1.1" 200 None
2026-03-30 10:53:22 [auto1.de] INFO: Scrape type for UP67859: 2
2026-03-30 10:53:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 745f0fbc-b611-52aa-9af3-2b10813492fd with identifier: UP67859
2026-03-30 10:53:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 745f0fbc-b611-52aa-9af3-2b10813492fd with scrape type 2
2026-03-30 10:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 745f0fbc-b611-52aa-9af3-2b10813492fd with scrape type 2
2026-03-30 10:53:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 745f0fbc-b611-52aa-9af3-2b10813492fd, identifier: UP67859
2026-03-30 10:53:22 [auto1.de] INFO: Found listing with ID: UC07744
2026-03-30 10:53:22 [auto1.de] INFO: Found listing with ID: PB07846
2026-03-30 10:53:22 [auto1.de] INFO: Found listing with ID: RL13206
2026-03-30 10:53:22 [auto1.de] INFO: Found listing with ID: NB55026
2026-03-30 10:53:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 745f0fbc-b611-52aa-9af3-2b10813492fd with identifier: UP67859
2026-03-30 10:53:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 745f0fbc-b611-52aa-9af3-2b10813492fd with identifier: UP67859
2026-03-30 10:53:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 745f0fbc-b611-52aa-9af3-2b10813492fd with identifier: UP67859 to the API
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:53:36Z',
 'fuel_type': 'petrol',
 'id': '745f0fbc-b611-52aa-9af3-2b10813492fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP67859',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 93129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-24',
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2018}
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP67859%27 HTTP/1.1" 200 None
2026-03-30 10:53:22 [auto1.de] INFO: Saving data for UP67859: {'auction_closing_time': 1774972416.0, 'created_time': 1773400298.73062, 'last_price_update_time': 1774868002.497793}
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP67859') HTTP/1.1" 204 0
2026-03-30 10:53:22 [auto1.de] INFO: Found listing with ID: HL85444
2026-03-30 10:53:22 [auto1.de] INFO: Found listing with ID: CW51870
2026-03-30 10:53:22 [auto1.de] INFO: Found listing with ID: LU46905
2026-03-30 10:53:22 [auto1.de] INFO: Found listing with ID: AK84814
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK84814%27 HTTP/1.1" 200 None
2026-03-30 10:53:22 [auto1.de] INFO: Scrape type for AK84814: 2
2026-03-30 10:53:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8561452-d55c-5768-b1fe-ccbf80e3440b with identifier: AK84814
2026-03-30 10:53:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8561452-d55c-5768-b1fe-ccbf80e3440b with scrape type 2
2026-03-30 10:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8561452-d55c-5768-b1fe-ccbf80e3440b with scrape type 2
2026-03-30 10:53:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8561452-d55c-5768-b1fe-ccbf80e3440b, identifier: AK84814
2026-03-30 10:53:22 [auto1.de] INFO: Found listing with ID: MS18045
2026-03-30 10:53:22 [auto1.de] INFO: Found listing with ID: UW30649
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW30649%27 HTTP/1.1" 200 None
2026-03-30 10:53:22 [auto1.de] INFO: Scrape type for UW30649: 0
2026-03-30 10:53:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8561452-d55c-5768-b1fe-ccbf80e3440b with identifier: AK84814
2026-03-30 10:53:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8561452-d55c-5768-b1fe-ccbf80e3440b with identifier: AK84814
2026-03-30 10:53:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8561452-d55c-5768-b1fe-ccbf80e3440b with identifier: AK84814 to the API
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:04:58Z',
 'fuel_type': 'petrol',
 'id': 'f8561452-d55c-5768-b1fe-ccbf80e3440b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK84814',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 75959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-24',
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2019}
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK84814%27 HTTP/1.1" 200 None
2026-03-30 10:53:23 [auto1.de] INFO: Saving data for AK84814: {'auction_closing_time': 1774969498.0, 'created_time': 1773776187.885638, 'last_price_update_time': 1774868003.076411}
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK84814') HTTP/1.1" 204 0
2026-03-30 10:53:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:23 [auto1.de] INFO: Found listing with ID: FR35172
2026-03-30 10:53:23 [auto1.de] INFO: Found listing with ID: VL17014
2026-03-30 10:53:23 [auto1.de] INFO: Found listing with ID: XY02302
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY02302%27 HTTP/1.1" 200 None
2026-03-30 10:53:23 [auto1.de] INFO: Scrape type for XY02302: 2
2026-03-30 10:53:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ad5d21c-e53f-54c2-84a8-573c623b6316 with identifier: XY02302
2026-03-30 10:53:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ad5d21c-e53f-54c2-84a8-573c623b6316 with scrape type 2
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ad5d21c-e53f-54c2-84a8-573c623b6316 with scrape type 2
2026-03-30 10:53:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ad5d21c-e53f-54c2-84a8-573c623b6316, identifier: XY02302
2026-03-30 10:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ad5d21c-e53f-54c2-84a8-573c623b6316 with identifier: XY02302
2026-03-30 10:53:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ad5d21c-e53f-54c2-84a8-573c623b6316 with identifier: XY02302
2026-03-30 10:53:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ad5d21c-e53f-54c2-84a8-573c623b6316 with identifier: XY02302 to the API
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:53:15Z',
 'fuel_type': 'petrol',
 'id': '2ad5d21c-e53f-54c2-84a8-573c623b6316',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY02302',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 101828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-27',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Rip Curl',
 'transmission': 'manual',
 'trim': 'Rip Curl',
 'year': 2011}
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY02302%27 HTTP/1.1" 200 None
2026-03-30 10:53:23 [auto1.de] INFO: Saving data for XY02302: {'auction_closing_time': 1774972395.0, 'created_time': 1773342081.939784, 'last_price_update_time': 1774868003.665887}
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY02302') HTTP/1.1" 204 0
2026-03-30 10:53:23 [auto1.de] INFO: Found listing with ID: ZU63901
2026-03-30 10:53:23 [auto1.de] INFO: Found listing with ID: SF44435
2026-03-30 10:53:23 [auto1.de] INFO: Found listing with ID: KB01548
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB01548%27 HTTP/1.1" 200 None
2026-03-30 10:53:23 [auto1.de] INFO: Scrape type for KB01548: 2
2026-03-30 10:53:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca18b2ec-2f57-5854-8786-4468fb81af24 with identifier: KB01548
2026-03-30 10:53:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca18b2ec-2f57-5854-8786-4468fb81af24 with scrape type 2
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca18b2ec-2f57-5854-8786-4468fb81af24 with scrape type 2
2026-03-30 10:53:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca18b2ec-2f57-5854-8786-4468fb81af24, identifier: KB01548
2026-03-30 10:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NB55026/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca18b2ec-2f57-5854-8786-4468fb81af24 with identifier: KB01548
2026-03-30 10:53:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca18b2ec-2f57-5854-8786-4468fb81af24 with identifier: KB01548
2026-03-30 10:53:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca18b2ec-2f57-5854-8786-4468fb81af24 with identifier: KB01548 to the API
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:31:06Z',
 'fuel_type': 'petrol',
 'id': 'ca18b2ec-2f57-5854-8786-4468fb81af24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB01548',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 41357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-05',
 'seller_name': None,
 'title': 'BMW 5er 530i Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB01548%27 HTTP/1.1" 200 None
2026-03-30 10:53:24 [auto1.de] INFO: Saving data for KB01548: {'auction_closing_time': 1774971066.0, 'created_time': 1773306913.69265, 'last_price_update_time': 1774868004.123538}
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB01548') HTTP/1.1" 204 0
2026-03-30 10:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WT89388/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:24 [auto1.de] INFO: Found listing with ID: DC30306
2026-03-30 10:53:24 [auto1.de] INFO: Found listing with ID: ZR85378
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR85378%27 HTTP/1.1" 200 None
2026-03-30 10:53:24 [auto1.de] INFO: Scrape type for ZR85378: 2
2026-03-30 10:53:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1487bb79-7694-5a1c-8882-ee0c04e5cf36 with identifier: ZR85378
2026-03-30 10:53:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1487bb79-7694-5a1c-8882-ee0c04e5cf36 with scrape type 2
2026-03-30 10:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1487bb79-7694-5a1c-8882-ee0c04e5cf36 with scrape type 2
2026-03-30 10:53:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1487bb79-7694-5a1c-8882-ee0c04e5cf36, identifier: ZR85378
2026-03-30 10:53:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1487bb79-7694-5a1c-8882-ee0c04e5cf36 with identifier: ZR85378
2026-03-30 10:53:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1487bb79-7694-5a1c-8882-ee0c04e5cf36 with identifier: ZR85378
2026-03-30 10:53:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1487bb79-7694-5a1c-8882-ee0c04e5cf36 with identifier: ZR85378 to the API
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:44:03Z',
 'fuel_type': 'petrol',
 'id': '1487bb79-7694-5a1c-8882-ee0c04e5cf36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR85378',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Accord',
 'odometer': 134135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-04',
 'seller_name': None,
 'title': 'Honda Accord 2.0 Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2014}
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR85378%27 HTTP/1.1" 200 None
2026-03-30 10:53:24 [auto1.de] INFO: Saving data for ZR85378: {'auction_closing_time': 1774971843.0, 'created_time': 1773662115.8030019, 'last_price_update_time': 1774868004.697555}
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR85378') HTTP/1.1" 204 0
2026-03-30 10:53:24 [auto1.de] INFO: Channel: 24h | Page: 45 | totalHits: 9519 | hits on page: 40
2026-03-30 10:53:24 [auto1.de] INFO: Found listing with ID: KA83204
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83204%27 HTTP/1.1" 200 None
2026-03-30 10:53:24 [auto1.de] INFO: Scrape type for KA83204: 2
2026-03-30 10:53:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fea7b289-fddf-5845-aecf-3bd5e3e69013 with identifier: KA83204
2026-03-30 10:53:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fea7b289-fddf-5845-aecf-3bd5e3e69013 with scrape type 2
2026-03-30 10:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fea7b289-fddf-5845-aecf-3bd5e3e69013 with scrape type 2
2026-03-30 10:53:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fea7b289-fddf-5845-aecf-3bd5e3e69013, identifier: KA83204
2026-03-30 10:53:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fea7b289-fddf-5845-aecf-3bd5e3e69013 with identifier: KA83204
2026-03-30 10:53:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fea7b289-fddf-5845-aecf-3bd5e3e69013 with identifier: KA83204
2026-03-30 10:53:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fea7b289-fddf-5845-aecf-3bd5e3e69013 with identifier: KA83204 to the API
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:48:27Z',
 'fuel_type': 'diesel',
 'id': 'fea7b289-fddf-5845-aecf-3bd5e3e69013',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA83204',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 53418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-16',
 'seller_name': None,
 'title': 'Citroen Jumper 2.2 HDi 33 L2',
 'transmission': 'manual',
 'trim': '33 L2',
 'year': 2014}
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83204%27 HTTP/1.1" 200 None
2026-03-30 10:53:26 [auto1.de] INFO: Saving data for KA83204: {'auction_closing_time': 1774972107.0, 'created_time': 1773307569.992207, 'last_price_update_time': 1774868006.181071}
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA83204') HTTP/1.1" 204 0
2026-03-30 10:53:26 [auto1.de] INFO: Found listing with ID: SY52709
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY52709%27 HTTP/1.1" 200 None
2026-03-30 10:53:26 [auto1.de] INFO: Scrape type for SY52709: 2
2026-03-30 10:53:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bda4c882-4907-5e14-91b6-55b8011afcdb with identifier: SY52709
2026-03-30 10:53:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bda4c882-4907-5e14-91b6-55b8011afcdb with scrape type 2
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bda4c882-4907-5e14-91b6-55b8011afcdb with scrape type 2
2026-03-30 10:53:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bda4c882-4907-5e14-91b6-55b8011afcdb, identifier: SY52709
2026-03-30 10:53:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:26 [auto1.de] INFO: Found listing with ID: NF06054
2026-03-30 10:53:26 [auto1.de] INFO: Found listing with ID: YK59782
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK59782%27 HTTP/1.1" 200 None
2026-03-30 10:53:26 [auto1.de] INFO: Scrape type for YK59782: 2
2026-03-30 10:53:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69e3067e-3f20-5255-bd19-85cfcc7de2cc with identifier: YK59782
2026-03-30 10:53:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69e3067e-3f20-5255-bd19-85cfcc7de2cc with scrape type 2
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69e3067e-3f20-5255-bd19-85cfcc7de2cc with scrape type 2
2026-03-30 10:53:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69e3067e-3f20-5255-bd19-85cfcc7de2cc, identifier: YK59782
2026-03-30 10:53:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bda4c882-4907-5e14-91b6-55b8011afcdb with identifier: SY52709
2026-03-30 10:53:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bda4c882-4907-5e14-91b6-55b8011afcdb with identifier: SY52709
2026-03-30 10:53:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bda4c882-4907-5e14-91b6-55b8011afcdb with identifier: SY52709 to the API
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:42:23Z',
 'fuel_type': 'diesel',
 'id': 'bda4c882-4907-5e14-91b6-55b8011afcdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY52709',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 102211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-05',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 114 CDI Pro 4x4 lang',
 'transmission': 'automatic',
 'trim': 'Pro 4x4 lang',
 'year': 2020}
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY52709%27 HTTP/1.1" 200 None
2026-03-30 10:53:26 [auto1.de] INFO: Saving data for SY52709: {'auction_closing_time': 1774971743.0, 'created_time': 1774464732.563872, 'last_price_update_time': 1774868006.732469}
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY52709') HTTP/1.1" 204 0
2026-03-30 10:53:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69e3067e-3f20-5255-bd19-85cfcc7de2cc with identifier: YK59782
2026-03-30 10:53:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69e3067e-3f20-5255-bd19-85cfcc7de2cc with identifier: YK59782
2026-03-30 10:53:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69e3067e-3f20-5255-bd19-85cfcc7de2cc with identifier: YK59782 to the API
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-31T15:19:27Z',
 'fuel_type': 'petrol',
 'id': '69e3067e-3f20-5255-bd19-85cfcc7de2cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK59782',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS 3 Sportback',
 'odometer': 153397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-20',
 'seller_name': None,
 'title': 'Audi RS 3 Sportback 2.5 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK59782%27 HTTP/1.1" 200 None
2026-03-30 10:53:27 [auto1.de] INFO: Saving data for YK59782: {'auction_closing_time': 1774970367.0, 'created_time': 1773945607.076172, 'last_price_update_time': 1774868007.180726}
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK59782') HTTP/1.1" 204 0
2026-03-30 10:53:27 [auto1.de] INFO: Found listing with ID: XG30345
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG30345%27 HTTP/1.1" 200 None
2026-03-30 10:53:27 [auto1.de] INFO: Scrape type for XG30345: 2
2026-03-30 10:53:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00f35286-d543-57dc-be90-805b00f92918 with identifier: XG30345
2026-03-30 10:53:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00f35286-d543-57dc-be90-805b00f92918 with scrape type 2
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00f35286-d543-57dc-be90-805b00f92918 with scrape type 2
2026-03-30 10:53:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00f35286-d543-57dc-be90-805b00f92918, identifier: XG30345
2026-03-30 10:53:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:27 [auto1.de] INFO: Found listing with ID: TE22896
2026-03-30 10:53:27 [auto1.de] INFO: Found listing with ID: GG85995
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG85995%27 HTTP/1.1" 200 None
2026-03-30 10:53:27 [auto1.de] INFO: Scrape type for GG85995: 2
2026-03-30 10:53:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab13e2ab-57dd-593d-aff8-5d7db0cb8d9d with identifier: GG85995
2026-03-30 10:53:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab13e2ab-57dd-593d-aff8-5d7db0cb8d9d with scrape type 2
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab13e2ab-57dd-593d-aff8-5d7db0cb8d9d with scrape type 2
2026-03-30 10:53:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab13e2ab-57dd-593d-aff8-5d7db0cb8d9d, identifier: GG85995
2026-03-30 10:53:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00f35286-d543-57dc-be90-805b00f92918 with identifier: XG30345
2026-03-30 10:53:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00f35286-d543-57dc-be90-805b00f92918 with identifier: XG30345
2026-03-30 10:53:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00f35286-d543-57dc-be90-805b00f92918 with identifier: XG30345 to the API
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:28:36Z',
 'fuel_type': 'petrol',
 'id': '00f35286-d543-57dc-be90-805b00f92918',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG30345',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Jimny',
 'odometer': 86873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-22',
 'seller_name': None,
 'title': 'Suzuki Jimny 1.3 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2011}
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG30345%27 HTTP/1.1" 200 None
2026-03-30 10:53:27 [auto1.de] INFO: Saving data for XG30345: {'auction_closing_time': 1774970916.0, 'created_time': 1774468006.822355, 'last_price_update_time': 1774868007.802057}
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG30345') HTTP/1.1" 204 0
2026-03-30 10:53:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab13e2ab-57dd-593d-aff8-5d7db0cb8d9d with identifier: GG85995
2026-03-30 10:53:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab13e2ab-57dd-593d-aff8-5d7db0cb8d9d with identifier: GG85995
2026-03-30 10:53:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab13e2ab-57dd-593d-aff8-5d7db0cb8d9d with identifier: GG85995 to the API
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:59:19Z',
 'fuel_type': 'diesel',
 'id': 'ab13e2ab-57dd-593d-aff8-5d7db0cb8d9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG85995',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 212974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-06',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG85995%27 HTTP/1.1" 200 None
2026-03-30 10:53:28 [auto1.de] INFO: Saving data for GG85995: {'auction_closing_time': 1774972759.0, 'created_time': 1774378493.453364, 'last_price_update_time': 1774868008.166155}
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG85995') HTTP/1.1" 204 0
2026-03-30 10:53:28 [auto1.de] INFO: Found listing with ID: ZB54249
2026-03-30 10:53:28 [auto1.de] INFO: Found listing with ID: FP74638
2026-03-30 10:53:28 [auto1.de] INFO: Found listing with ID: UM42416
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM42416%27 HTTP/1.1" 200 None
2026-03-30 10:53:28 [auto1.de] INFO: Scrape type for UM42416: 2
2026-03-30 10:53:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ac560b5-ee3e-58e9-9784-57935c0203a5 with identifier: UM42416
2026-03-30 10:53:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ac560b5-ee3e-58e9-9784-57935c0203a5 with scrape type 2
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ac560b5-ee3e-58e9-9784-57935c0203a5 with scrape type 2
2026-03-30 10:53:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ac560b5-ee3e-58e9-9784-57935c0203a5, identifier: UM42416
2026-03-30 10:53:28 [auto1.de] INFO: Found listing with ID: ZT91138
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT91138%27 HTTP/1.1" 200 None
2026-03-30 10:53:28 [auto1.de] INFO: Scrape type for ZT91138: 2
2026-03-30 10:53:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11b7415d-b7e0-5910-bbdd-6959f3ed2058 with identifier: ZT91138
2026-03-30 10:53:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11b7415d-b7e0-5910-bbdd-6959f3ed2058 with scrape type 2
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11b7415d-b7e0-5910-bbdd-6959f3ed2058 with scrape type 2
2026-03-30 10:53:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11b7415d-b7e0-5910-bbdd-6959f3ed2058, identifier: ZT91138
2026-03-30 10:53:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ac560b5-ee3e-58e9-9784-57935c0203a5 with identifier: UM42416
2026-03-30 10:53:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ac560b5-ee3e-58e9-9784-57935c0203a5 with identifier: UM42416
2026-03-30 10:53:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ac560b5-ee3e-58e9-9784-57935c0203a5 with identifier: UM42416 to the API
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-31T15:18:34Z',
 'fuel_type': 'petrol',
 'id': '1ac560b5-ee3e-58e9-9784-57935c0203a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM42416',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 44641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-18',
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2021}
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM42416%27 HTTP/1.1" 200 None
2026-03-30 10:53:28 [auto1.de] INFO: Saving data for UM42416: {'auction_closing_time': 1774970314.0, 'created_time': 1773134271.587003, 'last_price_update_time': 1774868008.779503}
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM42416') HTTP/1.1" 204 0
2026-03-30 10:53:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11b7415d-b7e0-5910-bbdd-6959f3ed2058 with identifier: ZT91138
2026-03-30 10:53:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11b7415d-b7e0-5910-bbdd-6959f3ed2058 with identifier: ZT91138
2026-03-30 10:53:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11b7415d-b7e0-5910-bbdd-6959f3ed2058 with identifier: ZT91138 to the API
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:50:05Z',
 'fuel_type': 'petrol',
 'id': '11b7415d-b7e0-5910-bbdd-6959f3ed2058',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT91138',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 90724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-05',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Move up! BlueMotion',
 'transmission': 'automatic',
 'trim': 'Move  BlueMotion',
 'year': 2019}
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT91138%27 HTTP/1.1" 200 None
2026-03-30 10:53:29 [auto1.de] INFO: Saving data for ZT91138: {'auction_closing_time': 1774972205.0, 'created_time': 1774464471.175556, 'last_price_update_time': 1774868009.197202}
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT91138') HTTP/1.1" 204 0
2026-03-30 10:53:29 [auto1.de] INFO: Found listing with ID: CC84922
2026-03-30 10:53:29 [auto1.de] INFO: Found listing with ID: PW66424
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW66424%27 HTTP/1.1" 200 None
2026-03-30 10:53:29 [auto1.de] INFO: Scrape type for PW66424: 2
2026-03-30 10:53:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8746f6af-7db2-536a-9529-21f9e4cff49c with identifier: PW66424
2026-03-30 10:53:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8746f6af-7db2-536a-9529-21f9e4cff49c with scrape type 2
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8746f6af-7db2-536a-9529-21f9e4cff49c with scrape type 2
2026-03-30 10:53:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8746f6af-7db2-536a-9529-21f9e4cff49c, identifier: PW66424
2026-03-30 10:53:29 [auto1.de] INFO: Found listing with ID: UL25580
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL25580%27 HTTP/1.1" 200 None
2026-03-30 10:53:29 [auto1.de] INFO: Scrape type for UL25580: 2
2026-03-30 10:53:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0156c5a4-b7f6-5c28-8aa4-d8e2b431e585 with identifier: UL25580
2026-03-30 10:53:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0156c5a4-b7f6-5c28-8aa4-d8e2b431e585 with scrape type 2
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0156c5a4-b7f6-5c28-8aa4-d8e2b431e585 with scrape type 2
2026-03-30 10:53:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0156c5a4-b7f6-5c28-8aa4-d8e2b431e585, identifier: UL25580
2026-03-30 10:53:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8746f6af-7db2-536a-9529-21f9e4cff49c with identifier: PW66424
2026-03-30 10:53:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8746f6af-7db2-536a-9529-21f9e4cff49c with identifier: PW66424
2026-03-30 10:53:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8746f6af-7db2-536a-9529-21f9e4cff49c with identifier: PW66424 to the API
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:31:09Z',
 'fuel_type': 'petrol',
 'id': '8746f6af-7db2-536a-9529-21f9e4cff49c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW66424',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 167843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-09',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW66424%27 HTTP/1.1" 200 None
2026-03-30 10:53:29 [auto1.de] INFO: Saving data for PW66424: {'auction_closing_time': 1774971069.0, 'created_time': 1773687791.34275, 'last_price_update_time': 1774868009.782271}
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW66424') HTTP/1.1" 204 0
2026-03-30 10:53:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0156c5a4-b7f6-5c28-8aa4-d8e2b431e585 with identifier: UL25580
2026-03-30 10:53:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0156c5a4-b7f6-5c28-8aa4-d8e2b431e585 with identifier: UL25580
2026-03-30 10:53:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0156c5a4-b7f6-5c28-8aa4-d8e2b431e585 with identifier: UL25580 to the API
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:05:11Z',
 'fuel_type': 'petrol',
 'id': '0156c5a4-b7f6-5c28-8aa4-d8e2b431e585',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL25580',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 68313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-15',
 'seller_name': None,
 'title': 'Seat Leon 1.5 eTSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2021}
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL25580%27 HTTP/1.1" 200 None
2026-03-30 10:53:30 [auto1.de] INFO: Saving data for UL25580: {'auction_closing_time': 1774969511.0, 'created_time': 1774379609.100778, 'last_price_update_time': 1774868010.111656}
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL25580') HTTP/1.1" 204 0
2026-03-30 10:53:30 [auto1.de] INFO: Found listing with ID: XH17587
2026-03-30 10:53:30 [auto1.de] INFO: Found listing with ID: JK25438
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK25438%27 HTTP/1.1" 200 None
2026-03-30 10:53:30 [auto1.de] INFO: Scrape type for JK25438: 2
2026-03-30 10:53:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad110816-ffde-5ebd-ab7e-01fdaa21cd16 with identifier: JK25438
2026-03-30 10:53:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad110816-ffde-5ebd-ab7e-01fdaa21cd16 with scrape type 2
2026-03-30 10:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad110816-ffde-5ebd-ab7e-01fdaa21cd16 with scrape type 2
2026-03-30 10:53:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad110816-ffde-5ebd-ab7e-01fdaa21cd16, identifier: JK25438
2026-03-30 10:53:30 [auto1.de] INFO: Found listing with ID: LW97378
2026-03-30 10:53:30 [auto1.de] INFO: Found listing with ID: TS72437
2026-03-30 10:53:30 [auto1.de] INFO: Found listing with ID: XY32455
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY32455%27 HTTP/1.1" 200 None
2026-03-30 10:53:30 [auto1.de] INFO: Scrape type for XY32455: 2
2026-03-30 10:53:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e6313d4-481a-5bcd-89e0-f44f88595ee6 with identifier: XY32455
2026-03-30 10:53:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e6313d4-481a-5bcd-89e0-f44f88595ee6 with scrape type 2
2026-03-30 10:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e6313d4-481a-5bcd-89e0-f44f88595ee6 with scrape type 2
2026-03-30 10:53:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e6313d4-481a-5bcd-89e0-f44f88595ee6, identifier: XY32455
2026-03-30 10:53:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad110816-ffde-5ebd-ab7e-01fdaa21cd16 with identifier: JK25438
2026-03-30 10:53:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad110816-ffde-5ebd-ab7e-01fdaa21cd16 with identifier: JK25438
2026-03-30 10:53:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad110816-ffde-5ebd-ab7e-01fdaa21cd16 with identifier: JK25438 to the API
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:09:19Z',
 'fuel_type': 'petrol',
 'id': 'ad110816-ffde-5ebd-ab7e-01fdaa21cd16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK25438',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 219003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-22',
 'seller_name': None,
 'title': 'Skoda Superb 1.8 TSI Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2014}
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK25438%27 HTTP/1.1" 200 None
2026-03-30 10:53:30 [auto1.de] INFO: Saving data for JK25438: {'auction_closing_time': 1774969759.0, 'created_time': 1773400674.870288, 'last_price_update_time': 1774868010.712314}
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK25438') HTTP/1.1" 204 0
2026-03-30 10:53:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e6313d4-481a-5bcd-89e0-f44f88595ee6 with identifier: XY32455
2026-03-30 10:53:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e6313d4-481a-5bcd-89e0-f44f88595ee6 with identifier: XY32455
2026-03-30 10:53:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e6313d4-481a-5bcd-89e0-f44f88595ee6 with identifier: XY32455 to the API
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:57:11Z',
 'fuel_type': 'diesel',
 'id': '7e6313d4-481a-5bcd-89e0-f44f88595ee6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY32455',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 114449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-26',
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive M Sport Shadow',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport Shadow',
 'year': 2018}
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY32455%27 HTTP/1.1" 200 None
2026-03-30 10:53:31 [auto1.de] INFO: Saving data for XY32455: {'auction_closing_time': 1774972631.0, 'created_time': 1773466749.945026, 'last_price_update_time': 1774868011.588932}
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY32455') HTTP/1.1" 204 0
2026-03-30 10:53:31 [auto1.de] INFO: Found listing with ID: RX10275
2026-03-30 10:53:31 [auto1.de] INFO: Found listing with ID: JW40764
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW40764%27 HTTP/1.1" 200 None
2026-03-30 10:53:31 [auto1.de] INFO: Scrape type for JW40764: 2
2026-03-30 10:53:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab7bf204-b62c-5bbe-9ee8-52c44d90145f with identifier: JW40764
2026-03-30 10:53:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab7bf204-b62c-5bbe-9ee8-52c44d90145f with scrape type 2
2026-03-30 10:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab7bf204-b62c-5bbe-9ee8-52c44d90145f with scrape type 2
2026-03-30 10:53:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab7bf204-b62c-5bbe-9ee8-52c44d90145f, identifier: JW40764
2026-03-30 10:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA70503> (referer: https://www.auto1.com/v1/car-details-view/EA70503/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:31 [auto1.de] INFO: Found listing with ID: HF93344
2026-03-30 10:53:31 [auto1.de] INFO: Found listing with ID: YC07614
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC07614%27 HTTP/1.1" 200 None
2026-03-30 10:53:31 [auto1.de] INFO: Scrape type for YC07614: 2
2026-03-30 10:53:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed2cc261-2848-5609-bbd8-9dea156710b8 with identifier: YC07614
2026-03-30 10:53:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed2cc261-2848-5609-bbd8-9dea156710b8 with scrape type 2
2026-03-30 10:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed2cc261-2848-5609-bbd8-9dea156710b8 with scrape type 2
2026-03-30 10:53:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed2cc261-2848-5609-bbd8-9dea156710b8, identifier: YC07614
2026-03-30 10:53:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab7bf204-b62c-5bbe-9ee8-52c44d90145f with identifier: JW40764
2026-03-30 10:53:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab7bf204-b62c-5bbe-9ee8-52c44d90145f with identifier: JW40764
2026-03-30 10:53:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab7bf204-b62c-5bbe-9ee8-52c44d90145f with identifier: JW40764 to the API
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-31T15:43:24Z',
 'fuel_type': 'petrol',
 'id': 'ab7bf204-b62c-5bbe-9ee8-52c44d90145f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW40764',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 161870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-09',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30i xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW40764%27 HTTP/1.1" 200 None
2026-03-30 10:53:32 [auto1.de] INFO: Saving data for JW40764: {'auction_closing_time': 1774971804.0, 'created_time': 1773305980.149621, 'last_price_update_time': 1774868012.359863}
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW40764') HTTP/1.1" 204 0
2026-03-30 10:53:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed2cc261-2848-5609-bbd8-9dea156710b8 with identifier: YC07614
2026-03-30 10:53:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed2cc261-2848-5609-bbd8-9dea156710b8 with identifier: YC07614
2026-03-30 10:53:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed2cc261-2848-5609-bbd8-9dea156710b8 with identifier: YC07614 to the API
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:13:33Z',
 'fuel_type': 'diesel',
 'id': 'ed2cc261-2848-5609-bbd8-9dea156710b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC07614',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 190089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-19',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI ON Start/Stop',
 'transmission': 'manual',
 'trim': 'ON Start/Stop',
 'year': 2018}
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC07614%27 HTTP/1.1" 200 None
2026-03-30 10:53:32 [auto1.de] INFO: Saving data for YC07614: {'auction_closing_time': 1774970013.0, 'created_time': 1774435048.063339, 'last_price_update_time': 1774868012.897218}
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC07614') HTTP/1.1" 204 0
2026-03-30 10:53:32 [auto1.de] INFO: Found listing with ID: KK63097
2026-03-30 10:53:32 [auto1.de] INFO: Found listing with ID: VW33777
2026-03-30 10:53:32 [auto1.de] INFO: Found listing with ID: ES32816
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES32816%27 HTTP/1.1" 200 None
2026-03-30 10:53:32 [auto1.de] INFO: Scrape type for ES32816: 2
2026-03-30 10:53:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b7a35a8-f19f-5970-8222-bc78b8992fc7 with identifier: ES32816
2026-03-30 10:53:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b7a35a8-f19f-5970-8222-bc78b8992fc7 with scrape type 2
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b7a35a8-f19f-5970-8222-bc78b8992fc7 with scrape type 2
2026-03-30 10:53:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b7a35a8-f19f-5970-8222-bc78b8992fc7, identifier: ES32816
2026-03-30 10:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:33 [auto1.de] INFO: Found listing with ID: YL58691
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL58691%27 HTTP/1.1" 200 None
2026-03-30 10:53:33 [auto1.de] INFO: Scrape type for YL58691: 2
2026-03-30 10:53:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8aaf1e9-5e9d-5378-bcad-b2fd921331c4 with identifier: YL58691
2026-03-30 10:53:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8aaf1e9-5e9d-5378-bcad-b2fd921331c4 with scrape type 2
2026-03-30 10:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8aaf1e9-5e9d-5378-bcad-b2fd921331c4 with scrape type 2
2026-03-30 10:53:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8aaf1e9-5e9d-5378-bcad-b2fd921331c4, identifier: YL58691
2026-03-30 10:53:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b7a35a8-f19f-5970-8222-bc78b8992fc7 with identifier: ES32816
2026-03-30 10:53:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b7a35a8-f19f-5970-8222-bc78b8992fc7 with identifier: ES32816
2026-03-30 10:53:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b7a35a8-f19f-5970-8222-bc78b8992fc7 with identifier: ES32816 to the API
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:39:50Z',
 'fuel_type': 'petrol',
 'id': '8b7a35a8-f19f-5970-8222-bc78b8992fc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES32816',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 137698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-08',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Energy',
 'transmission': 'manual',
 'trim': 'Energy',
 'year': 2014}
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES32816%27 HTTP/1.1" 200 None
2026-03-30 10:53:33 [auto1.de] INFO: Saving data for ES32816: {'auction_closing_time': 1774971590.0, 'created_time': 1773658517.480577, 'last_price_update_time': 1774868013.481675}
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES32816') HTTP/1.1" 204 0
2026-03-30 10:53:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8aaf1e9-5e9d-5378-bcad-b2fd921331c4 with identifier: YL58691
2026-03-30 10:53:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8aaf1e9-5e9d-5378-bcad-b2fd921331c4 with identifier: YL58691
2026-03-30 10:53:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8aaf1e9-5e9d-5378-bcad-b2fd921331c4 with identifier: YL58691 to the API
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:37:16Z',
 'fuel_type': 'diesel',
 'id': 'd8aaf1e9-5e9d-5378-bcad-b2fd921331c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL58691',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 323377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-02',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2017}
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL58691%27 HTTP/1.1" 200 None
2026-03-30 10:53:33 [auto1.de] INFO: Saving data for YL58691: {'auction_closing_time': 1774971436.0, 'created_time': 1773229790.195534, 'last_price_update_time': 1774868013.857082}
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL58691') HTTP/1.1" 204 0
2026-03-30 10:53:33 [auto1.de] INFO: Found listing with ID: XX85563
2026-03-30 10:53:33 [auto1.de] INFO: Found listing with ID: AC43981
2026-03-30 10:53:33 [auto1.de] INFO: Found listing with ID: SF11618
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF11618%27 HTTP/1.1" 200 None
2026-03-30 10:53:33 [auto1.de] INFO: Scrape type for SF11618: 2
2026-03-30 10:53:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 869205a4-6ecb-5b29-b7fb-004acaae2716 with identifier: SF11618
2026-03-30 10:53:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 869205a4-6ecb-5b29-b7fb-004acaae2716 with scrape type 2
2026-03-30 10:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 869205a4-6ecb-5b29-b7fb-004acaae2716 with scrape type 2
2026-03-30 10:53:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 869205a4-6ecb-5b29-b7fb-004acaae2716, identifier: SF11618
2026-03-30 10:53:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e31dafb-5cb9-565c-9935-0b630cfec88c with identifier: EA70503
2026-03-30 10:53:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e31dafb-5cb9-565c-9935-0b630cfec88c with scrape type 1
2026-03-30 10:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6e31dafb-5cb9-565c-9935-0b630cfec88c
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F00%252Fae003cb4daa884ba053a24f6ce30027d%252Fpa%252FEA70503_fbdb3f6cc90090df7864b027e4d744bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_fbdb3f6cc90090df7864b027e4d744bb.jpg not downloaded yet
2026-03-30 10:53:34 [auto1.de] INFO: Found listing with ID: EX48924
2026-03-30 10:53:34 [auto1.de] INFO: Found listing with ID: RP49857
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP49857%27 HTTP/1.1" 200 None
2026-03-30 10:53:34 [auto1.de] INFO: Scrape type for RP49857: 2
2026-03-30 10:53:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1c195fa-6ef9-5fc0-847b-8e1e3a3d836e with identifier: RP49857
2026-03-30 10:53:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1c195fa-6ef9-5fc0-847b-8e1e3a3d836e with scrape type 2
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1c195fa-6ef9-5fc0-847b-8e1e3a3d836e with scrape type 2
2026-03-30 10:53:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1c195fa-6ef9-5fc0-847b-8e1e3a3d836e, identifier: RP49857
2026-03-30 10:53:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 869205a4-6ecb-5b29-b7fb-004acaae2716 with identifier: SF11618
2026-03-30 10:53:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 869205a4-6ecb-5b29-b7fb-004acaae2716 with identifier: SF11618
2026-03-30 10:53:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 869205a4-6ecb-5b29-b7fb-004acaae2716 with identifier: SF11618 to the API
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:58:17Z',
 'fuel_type': 'petrol',
 'id': '869205a4-6ecb-5b29-b7fb-004acaae2716',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF11618',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 150004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-20',
 'seller_name': None,
 'title': 'Peugeot 206 1.6 CC Platinum',
 'transmission': 'manual',
 'trim': 'CC Platinum',
 'year': 2006}
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF11618%27 HTTP/1.1" 200 None
2026-03-30 10:53:34 [auto1.de] INFO: Saving data for SF11618: {'auction_closing_time': 1774972697.0, 'created_time': 1774348792.939864, 'last_price_update_time': 1774868014.491007}
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF11618') HTTP/1.1" 204 0
2026-03-30 10:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NB55026> (referer: https://www.auto1.com/v1/car-details-view/NB55026/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WT89388> (referer: https://www.auto1.com/v1/car-details-view/WT89388/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1c195fa-6ef9-5fc0-847b-8e1e3a3d836e with identifier: RP49857
2026-03-30 10:53:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1c195fa-6ef9-5fc0-847b-8e1e3a3d836e with identifier: RP49857
2026-03-30 10:53:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1c195fa-6ef9-5fc0-847b-8e1e3a3d836e with identifier: RP49857 to the API
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:44:16Z',
 'fuel_type': 'petrol',
 'id': 'a1c195fa-6ef9-5fc0-847b-8e1e3a3d836e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP49857',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 91694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-10',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP49857%27 HTTP/1.1" 200 None
2026-03-30 10:53:34 [auto1.de] INFO: Saving data for RP49857: {'auction_closing_time': 1774971856.0, 'created_time': 1773688523.354455, 'last_price_update_time': 1774868014.939062}
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP49857') HTTP/1.1" 204 0
2026-03-30 10:53:34 [auto1.de] INFO: Found listing with ID: CF27323
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF27323%27 HTTP/1.1" 200 None
2026-03-30 10:53:34 [auto1.de] INFO: Scrape type for CF27323: 2
2026-03-30 10:53:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5841384f-5440-5d79-980f-bda4b75ca9b2 with identifier: CF27323
2026-03-30 10:53:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5841384f-5440-5d79-980f-bda4b75ca9b2 with scrape type 2
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5841384f-5440-5d79-980f-bda4b75ca9b2 with scrape type 2
2026-03-30 10:53:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5841384f-5440-5d79-980f-bda4b75ca9b2, identifier: CF27323
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F00%252Fae003cb4daa884ba053a24f6ce30027d%252Fpa%252FEA70503_e2f1066f4a6b4e97f65d0e1b2900dcb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_e2f1066f4a6b4e97f65d0e1b2900dcb8.jpg not downloaded yet
2026-03-30 10:53:35 [auto1.de] INFO: Channel: 24h | Page: 46 | totalHits: 9519 | hits on page: 40
2026-03-30 10:53:35 [auto1.de] INFO: Found listing with ID: EV18023
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV18023%27 HTTP/1.1" 200 None
2026-03-30 10:53:35 [auto1.de] INFO: Scrape type for EV18023: 2
2026-03-30 10:53:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 801e4bcd-a308-58f2-879e-1eb27b272af4 with identifier: EV18023
2026-03-30 10:53:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 801e4bcd-a308-58f2-879e-1eb27b272af4 with scrape type 2
2026-03-30 10:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 801e4bcd-a308-58f2-879e-1eb27b272af4 with scrape type 2
2026-03-30 10:53:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 801e4bcd-a308-58f2-879e-1eb27b272af4, identifier: EV18023
2026-03-30 10:53:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5841384f-5440-5d79-980f-bda4b75ca9b2 with identifier: CF27323
2026-03-30 10:53:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5841384f-5440-5d79-980f-bda4b75ca9b2 with identifier: CF27323
2026-03-30 10:53:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5841384f-5440-5d79-980f-bda4b75ca9b2 with identifier: CF27323 to the API
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 335,
 'expiration_date': '2026-03-31T15:51:25Z',
 'fuel_type': 'petrol',
 'id': '5841384f-5440-5d79-980f-bda4b75ca9b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF27323',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Phaeton',
 'odometer': 274101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-08-31',
 'seller_name': None,
 'title': 'Volkswagen Phaeton 4.2 V8 4Motion',
 'transmission': 'automatic',
 'trim': '4Motion',
 'year': 2004}
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF27323%27 HTTP/1.1" 200 None
2026-03-30 10:53:35 [auto1.de] INFO: Saving data for CF27323: {'auction_closing_time': 1774972285.0, 'created_time': 1773303406.489965, 'last_price_update_time': 1774868015.546663}
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF27323') HTTP/1.1" 204 0
2026-03-30 10:53:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 801e4bcd-a308-58f2-879e-1eb27b272af4 with identifier: EV18023
2026-03-30 10:53:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 801e4bcd-a308-58f2-879e-1eb27b272af4 with identifier: EV18023
2026-03-30 10:53:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 801e4bcd-a308-58f2-879e-1eb27b272af4 with identifier: EV18023 to the API
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:55:42Z',
 'fuel_type': 'diesel',
 'id': '801e4bcd-a308-58f2-879e-1eb27b272af4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV18023',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 147186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-29',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Connect',
 'transmission': 'manual',
 'trim': 'Connect',
 'year': 2015}
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV18023%27 HTTP/1.1" 200 None
2026-03-30 10:53:35 [auto1.de] INFO: Saving data for EV18023: {'auction_closing_time': 1774972542.0, 'created_time': 1774503051.109448, 'last_price_update_time': 1774868015.892297}
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV18023') HTTP/1.1" 204 0
2026-03-30 10:53:35 [auto1.de] INFO: Found listing with ID: BK72669
2026-03-30 10:53:35 [auto1.de] INFO: Found listing with ID: GB55517
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB55517%27 HTTP/1.1" 200 None
2026-03-30 10:53:35 [auto1.de] INFO: Scrape type for GB55517: 2
2026-03-30 10:53:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 262943e5-7fab-5857-ba3e-15bb7140052b with identifier: GB55517
2026-03-30 10:53:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 262943e5-7fab-5857-ba3e-15bb7140052b with scrape type 2
2026-03-30 10:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 262943e5-7fab-5857-ba3e-15bb7140052b with scrape type 2
2026-03-30 10:53:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 262943e5-7fab-5857-ba3e-15bb7140052b, identifier: GB55517
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F00%252Fae003cb4daa884ba053a24f6ce30027d%252Fpa%252FEA70503_640bcbed338c8febbb2564fa82ef5fc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_640bcbed338c8febbb2564fa82ef5fc7.jpg not downloaded yet
2026-03-30 10:53:36 [auto1.de] INFO: Found listing with ID: US16012
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US16012%27 HTTP/1.1" 200 None
2026-03-30 10:53:36 [auto1.de] INFO: Scrape type for US16012: 2
2026-03-30 10:53:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4ad737b-c014-54a5-a343-46048a322f2a with identifier: US16012
2026-03-30 10:53:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4ad737b-c014-54a5-a343-46048a322f2a with scrape type 2
2026-03-30 10:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4ad737b-c014-54a5-a343-46048a322f2a with scrape type 2
2026-03-30 10:53:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4ad737b-c014-54a5-a343-46048a322f2a, identifier: US16012
2026-03-30 10:53:36 [auto1.de] INFO: Found listing with ID: GR85769
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR85769%27 HTTP/1.1" 200 None
2026-03-30 10:53:36 [auto1.de] INFO: Scrape type for GR85769: 2
2026-03-30 10:53:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e129e214-b9e6-54c1-8512-4e2bb301d0cf with identifier: GR85769
2026-03-30 10:53:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e129e214-b9e6-54c1-8512-4e2bb301d0cf with scrape type 2
2026-03-30 10:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e129e214-b9e6-54c1-8512-4e2bb301d0cf with scrape type 2
2026-03-30 10:53:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e129e214-b9e6-54c1-8512-4e2bb301d0cf, identifier: GR85769
2026-03-30 10:53:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 262943e5-7fab-5857-ba3e-15bb7140052b with identifier: GB55517
2026-03-30 10:53:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 262943e5-7fab-5857-ba3e-15bb7140052b with identifier: GB55517
2026-03-30 10:53:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 262943e5-7fab-5857-ba3e-15bb7140052b with identifier: GB55517 to the API
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:38:43Z',
 'fuel_type': 'petrol',
 'id': '262943e5-7fab-5857-ba3e-15bb7140052b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB55517',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 234661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-30',
 'seller_name': None,
 'title': 'Skoda Octavia 1.8 TSI Sport Edition',
 'transmission': 'manual',
 'trim': 'Sport Edition',
 'year': 2010}
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB55517%27 HTTP/1.1" 200 None
2026-03-30 10:53:36 [auto1.de] INFO: Saving data for GB55517: {'auction_closing_time': 1774971523.0, 'created_time': 1774434904.348796, 'last_price_update_time': 1774868016.701404}
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB55517') HTTP/1.1" 204 0
2026-03-30 10:53:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4ad737b-c014-54a5-a343-46048a322f2a with identifier: US16012
2026-03-30 10:53:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4ad737b-c014-54a5-a343-46048a322f2a with identifier: US16012
2026-03-30 10:53:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4ad737b-c014-54a5-a343-46048a322f2a with identifier: US16012 to the API
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-31T15:30:09Z',
 'fuel_type': 'diesel',
 'id': 'd4ad737b-c014-54a5-a343-46048a322f2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US16012',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 210074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-15',
 'seller_name': None,
 'title': 'Audi A7 Sportback 50 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US16012%27 HTTP/1.1" 200 None
2026-03-30 10:53:37 [auto1.de] INFO: Saving data for US16012: {'auction_closing_time': 1774971009.0, 'created_time': 1774337462.743119, 'last_price_update_time': 1774868017.069796}
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US16012') HTTP/1.1" 204 0
2026-03-30 10:53:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bf19aad-a25c-5fbc-a5aa-b12bbe969592 with identifier: NB55026
2026-03-30 10:53:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bf19aad-a25c-5fbc-a5aa-b12bbe969592 with scrape type 1
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2bf19aad-a25c-5fbc-a5aa-b12bbe969592
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_07544adc4ae092cc76d66a3f589703a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_07544adc4ae092cc76d66a3f589703a7.jpg not downloaded yet
2026-03-30 10:53:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ec2e095-a75f-5a76-bb58-363a121b9805 with identifier: WT89388
2026-03-30 10:53:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ec2e095-a75f-5a76-bb58-363a121b9805 with scrape type 1
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ec2e095-a75f-5a76-bb58-363a121b9805
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_0b8036523ab25a38ba73cd2b270ce093.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_0b8036523ab25a38ba73cd2b270ce093.jpg not downloaded yet
2026-03-30 10:53:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e129e214-b9e6-54c1-8512-4e2bb301d0cf with identifier: GR85769
2026-03-30 10:53:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e129e214-b9e6-54c1-8512-4e2bb301d0cf with identifier: GR85769
2026-03-30 10:53:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e129e214-b9e6-54c1-8512-4e2bb301d0cf with identifier: GR85769 to the API
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:04:57Z',
 'fuel_type': 'diesel',
 'id': 'e129e214-b9e6-54c1-8512-4e2bb301d0cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR85769',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce Verso',
 'odometer': 88280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-23',
 'seller_name': None,
 'title': 'Toyota ProAce Verso 1.5 D-4D L2 Shutle',
 'transmission': 'manual',
 'trim': 'L2 Shutle',
 'year': 2020}
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR85769%27 HTTP/1.1" 200 None
2026-03-30 10:53:37 [auto1.de] INFO: Saving data for GR85769: {'auction_closing_time': 1774969497.0, 'created_time': 1773660176.487863, 'last_price_update_time': 1774868017.536926}
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR85769') HTTP/1.1" 204 0
2026-03-30 10:53:37 [auto1.de] INFO: Found listing with ID: YL83790
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL83790%27 HTTP/1.1" 200 None
2026-03-30 10:53:37 [auto1.de] INFO: Scrape type for YL83790: 2
2026-03-30 10:53:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58e14a55-6346-5ff8-9f47-4c65d0435820 with identifier: YL83790
2026-03-30 10:53:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58e14a55-6346-5ff8-9f47-4c65d0435820 with scrape type 2
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58e14a55-6346-5ff8-9f47-4c65d0435820 with scrape type 2
2026-03-30 10:53:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58e14a55-6346-5ff8-9f47-4c65d0435820, identifier: YL83790
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F00%252Fae003cb4daa884ba053a24f6ce30027d%252Fpa%252FEA70503_84dc5660c36c68236cd56777c9111a9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_84dc5660c36c68236cd56777c9111a9b.jpg not downloaded yet
2026-03-30 10:53:37 [auto1.de] INFO: Found listing with ID: TN52823
2026-03-30 10:53:37 [auto1.de] INFO: Found listing with ID: RE58657
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE58657%27 HTTP/1.1" 200 None
2026-03-30 10:53:37 [auto1.de] INFO: Scrape type for RE58657: 1
2026-03-30 10:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_fbdb3f6cc90090df7864b027e4d744bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:37 [auto1.de] INFO: Found listing with ID: GK45349
2026-03-30 10:53:37 [auto1.de] INFO: Found listing with ID: YW38649
2026-03-30 10:53:37 [auto1.de] INFO: Found listing with ID: NP60172
2026-03-30 10:53:37 [auto1.de] INFO: Found listing with ID: LF70646
2026-03-30 10:53:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58e14a55-6346-5ff8-9f47-4c65d0435820 with identifier: YL83790
2026-03-30 10:53:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58e14a55-6346-5ff8-9f47-4c65d0435820 with identifier: YL83790
2026-03-30 10:53:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58e14a55-6346-5ff8-9f47-4c65d0435820 with identifier: YL83790 to the API
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:34:20Z',
 'fuel_type': 'petrol',
 'id': '58e14a55-6346-5ff8-9f47-4c65d0435820',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL83790',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 95204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-21',
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL83790%27 HTTP/1.1" 200 None
2026-03-30 10:53:38 [auto1.de] INFO: Saving data for YL83790: {'auction_closing_time': 1774971260.0, 'created_time': 1774463654.095403, 'last_price_update_time': 1774868018.072672}
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL83790') HTTP/1.1" 204 0
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_cbb5bf5011718804527c9284a8c40dbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_cbb5bf5011718804527c9284a8c40dbc.jpg not downloaded yet
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_0daeaced3fde4591821c68a5cfb56ee0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_0daeaced3fde4591821c68a5cfb56ee0.jpg not downloaded yet
2026-03-30 10:53:38 [auto1.de] INFO: Found listing with ID: RE14454
2026-03-30 10:53:38 [auto1.de] INFO: Found listing with ID: TZ82859
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ82859%27 HTTP/1.1" 200 None
2026-03-30 10:53:38 [auto1.de] INFO: Scrape type for TZ82859: 1
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F00%252Fae003cb4daa884ba053a24f6ce30027d%252Fpa%252FEA70503_7970dd7f3c2cdee34fe730e75e8c5829.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_7970dd7f3c2cdee34fe730e75e8c5829.jpg not downloaded yet
2026-03-30 10:53:38 [auto1.de] INFO: Found listing with ID: UC67587
2026-03-30 10:53:38 [auto1.de] INFO: Found listing with ID: WS88926
2026-03-30 10:53:38 [auto1.de] INFO: Found listing with ID: GW79397
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW79397%27 HTTP/1.1" 200 None
2026-03-30 10:53:38 [auto1.de] INFO: Scrape type for GW79397: 1
2026-03-30 10:53:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_be89b6e47f0a110b287c220125a66853.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_be89b6e47f0a110b287c220125a66853.jpg not downloaded yet
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_6beaa5eae1aa5b3931fc4ae6c036e528.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_6beaa5eae1aa5b3931fc4ae6c036e528.jpg not downloaded yet
2026-03-30 10:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_e2f1066f4a6b4e97f65d0e1b2900dcb8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:38 [auto1.de] INFO: Found listing with ID: UA38092
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA38092%27 HTTP/1.1" 200 None
2026-03-30 10:53:38 [auto1.de] INFO: Scrape type for UA38092: 2
2026-03-30 10:53:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1a78788-9850-5420-b429-1e5816d738a4 with identifier: UA38092
2026-03-30 10:53:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1a78788-9850-5420-b429-1e5816d738a4 with scrape type 2
2026-03-30 10:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1a78788-9850-5420-b429-1e5816d738a4 with scrape type 2
2026-03-30 10:53:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1a78788-9850-5420-b429-1e5816d738a4, identifier: UA38092
2026-03-30 10:53:38 [auto1.de] INFO: Found listing with ID: YS92150
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS92150%27 HTTP/1.1" 200 None
2026-03-30 10:53:38 [auto1.de] INFO: Scrape type for YS92150: 1
2026-03-30 10:53:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4286c50>
2026-03-30 10:53:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e31dafb-5cb9-565c-9935-0b630cfec88c/6e31dafb-5cb9-565c-9935-0b630cfec88c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F00%252Fae003cb4daa884ba053a24f6ce30027d%252Fpa%252FEA70503_fbdb3f6cc90090df7864b027e4d744bb.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_fbdb3f6cc90090df7864b027e4d744bb.jpg saved to cache
2026-03-30 10:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e31dafb-5cb9-565c-9935-0b630cfec88c
2026-03-30 10:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_640bcbed338c8febbb2564fa82ef5fc7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1a78788-9850-5420-b429-1e5816d738a4 with identifier: UA38092
2026-03-30 10:53:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1a78788-9850-5420-b429-1e5816d738a4 with identifier: UA38092
2026-03-30 10:53:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1a78788-9850-5420-b429-1e5816d738a4 with identifier: UA38092 to the API
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:10:29Z',
 'fuel_type': 'diesel',
 'id': 'e1a78788-9850-5420-b429-1e5816d738a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA38092',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 234179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-18',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA38092%27 HTTP/1.1" 200 None
2026-03-30 10:53:38 [auto1.de] INFO: Saving data for UA38092: {'auction_closing_time': 1774969829.0, 'created_time': 1773686207.192589, 'last_price_update_time': 1774868018.952302}
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA38092') HTTP/1.1" 204 0
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_789d4b303407fa563524edef9183c218.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_789d4b303407fa563524edef9183c218.jpg not downloaded yet
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_2521bf9305e2f307bf44c67f1c7ecf90.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_2521bf9305e2f307bf44c67f1c7ecf90.jpg not downloaded yet
2026-03-30 10:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_0b8036523ab25a38ba73cd2b270ce093.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_07544adc4ae092cc76d66a3f589703a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:39 [auto1.de] INFO: Found listing with ID: ZA73263
2026-03-30 10:53:39 [auto1.de] INFO: Found listing with ID: TR55482
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR55482%27 HTTP/1.1" 200 None
2026-03-30 10:53:39 [auto1.de] INFO: Scrape type for TR55482: 2
2026-03-30 10:53:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f338b26-f50d-5e2f-aeab-e31fbb06a1ea with identifier: TR55482
2026-03-30 10:53:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f338b26-f50d-5e2f-aeab-e31fbb06a1ea with scrape type 2
2026-03-30 10:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f338b26-f50d-5e2f-aeab-e31fbb06a1ea with scrape type 2
2026-03-30 10:53:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f338b26-f50d-5e2f-aeab-e31fbb06a1ea, identifier: TR55482
2026-03-30 10:53:39 [auto1.de] INFO: Found listing with ID: WP32637
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP32637%27 HTTP/1.1" 200 None
2026-03-30 10:53:39 [auto1.de] INFO: Scrape type for WP32637: 2
2026-03-30 10:53:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1f54603-9b80-5076-9d5b-9db4e59db9ef with identifier: WP32637
2026-03-30 10:53:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1f54603-9b80-5076-9d5b-9db4e59db9ef with scrape type 2
2026-03-30 10:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1f54603-9b80-5076-9d5b-9db4e59db9ef with scrape type 2
2026-03-30 10:53:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1f54603-9b80-5076-9d5b-9db4e59db9ef, identifier: WP32637
2026-03-30 10:53:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_84dc5660c36c68236cd56777c9111a9b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f338b26-f50d-5e2f-aeab-e31fbb06a1ea with identifier: TR55482
2026-03-30 10:53:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f338b26-f50d-5e2f-aeab-e31fbb06a1ea with identifier: TR55482
2026-03-30 10:53:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f338b26-f50d-5e2f-aeab-e31fbb06a1ea with identifier: TR55482 to the API
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:41:33Z',
 'fuel_type': 'diesel',
 'id': '7f338b26-f50d-5e2f-aeab-e31fbb06a1ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR55482',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 196781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-10',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Life BlueMotion',
 'transmission': 'manual',
 'trim': 'Life BlueMotion',
 'year': 2013}
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR55482%27 HTTP/1.1" 200 None
2026-03-30 10:53:39 [auto1.de] INFO: Saving data for TR55482: {'auction_closing_time': 1774971693.0, 'created_time': 1773399938.784796, 'last_price_update_time': 1774868019.664419}
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR55482') HTTP/1.1" 204 0
2026-03-30 10:53:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1f54603-9b80-5076-9d5b-9db4e59db9ef with identifier: WP32637
2026-03-30 10:53:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1f54603-9b80-5076-9d5b-9db4e59db9ef with identifier: WP32637
2026-03-30 10:53:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1f54603-9b80-5076-9d5b-9db4e59db9ef with identifier: WP32637 to the API
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:37:29Z',
 'fuel_type': 'diesel',
 'id': 'b1f54603-9b80-5076-9d5b-9db4e59db9ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP32637',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 193973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-07',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 d T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2019}
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP32637%27 HTTP/1.1" 200 None
2026-03-30 10:53:40 [auto1.de] INFO: Saving data for WP32637: {'auction_closing_time': 1774971449.0, 'created_time': 1774465628.440206, 'last_price_update_time': 1774868020.039092}
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP32637') HTTP/1.1" 204 0
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_a81be07382d5f98bfb60c5ba1a2e2ed0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_a81be07382d5f98bfb60c5ba1a2e2ed0.jpg not downloaded yet
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_8210416107770d1e6141bdb63d36c252.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_8210416107770d1e6141bdb63d36c252.jpg not downloaded yet
2026-03-30 10:53:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41f3e90>
2026-03-30 10:53:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e31dafb-5cb9-565c-9935-0b630cfec88c/6e31dafb-5cb9-565c-9935-0b630cfec88c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F00%252Fae003cb4daa884ba053a24f6ce30027d%252Fpa%252FEA70503_e2f1066f4a6b4e97f65d0e1b2900dcb8.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_e2f1066f4a6b4e97f65d0e1b2900dcb8.jpg saved to cache
2026-03-30 10:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e31dafb-5cb9-565c-9935-0b630cfec88c
2026-03-30 10:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_0daeaced3fde4591821c68a5cfb56ee0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_cbb5bf5011718804527c9284a8c40dbc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:40 [auto1.de] INFO: Found listing with ID: WB89242
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB89242%27 HTTP/1.1" 200 None
2026-03-30 10:53:40 [auto1.de] INFO: Scrape type for WB89242: 1
2026-03-30 10:53:40 [auto1.de] INFO: Found listing with ID: WA51646
2026-03-30 10:53:40 [auto1.de] INFO: Found listing with ID: BD30878
2026-03-30 10:53:40 [auto1.de] INFO: Found listing with ID: KU76096
2026-03-30 10:53:40 [auto1.de] INFO: Found listing with ID: DE00247
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE00247%27 HTTP/1.1" 200 None
2026-03-30 10:53:40 [auto1.de] INFO: Scrape type for DE00247: 2
2026-03-30 10:53:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9886483c-380d-5ffc-97d8-27fdbaf1416e with identifier: DE00247
2026-03-30 10:53:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9886483c-380d-5ffc-97d8-27fdbaf1416e with scrape type 2
2026-03-30 10:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9886483c-380d-5ffc-97d8-27fdbaf1416e with scrape type 2
2026-03-30 10:53:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9886483c-380d-5ffc-97d8-27fdbaf1416e, identifier: DE00247
2026-03-30 10:53:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee44d9d0>
2026-03-30 10:53:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e31dafb-5cb9-565c-9935-0b630cfec88c/6e31dafb-5cb9-565c-9935-0b630cfec88c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F00%252Fae003cb4daa884ba053a24f6ce30027d%252Fpa%252FEA70503_640bcbed338c8febbb2564fa82ef5fc7.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_640bcbed338c8febbb2564fa82ef5fc7.jpg saved to cache
2026-03-30 10:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e31dafb-5cb9-565c-9935-0b630cfec88c
2026-03-30 10:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_7970dd7f3c2cdee34fe730e75e8c5829.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9886483c-380d-5ffc-97d8-27fdbaf1416e with identifier: DE00247
2026-03-30 10:53:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9886483c-380d-5ffc-97d8-27fdbaf1416e with identifier: DE00247
2026-03-30 10:53:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9886483c-380d-5ffc-97d8-27fdbaf1416e with identifier: DE00247 to the API
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:38:05Z',
 'fuel_type': 'petrol',
 'id': '9886483c-380d-5ffc-97d8-27fdbaf1416e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE00247',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 185274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-12',
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI Coupe',
 'transmission': 'manual',
 'trim': 'Coupe',
 'year': 2007}
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE00247%27 HTTP/1.1" 200 None
2026-03-30 10:53:40 [auto1.de] INFO: Saving data for DE00247: {'auction_closing_time': 1774971485.0, 'created_time': 1774435416.871305, 'last_price_update_time': 1774868020.632172}
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE00247') HTTP/1.1" 204 0
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_8acca0fa73fe695533344fbd15ddfe03.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_8acca0fa73fe695533344fbd15ddfe03.jpg not downloaded yet
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_10fc3e145b61e7e43d09e1112744cdb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_10fc3e145b61e7e43d09e1112744cdb7.jpg not downloaded yet
2026-03-30 10:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_6beaa5eae1aa5b3931fc4ae6c036e528.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_be89b6e47f0a110b287c220125a66853.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:40 [auto1.de] INFO: Found listing with ID: AP35212
2026-03-30 10:53:40 [auto1.de] INFO: Found listing with ID: VS28124
2026-03-30 10:53:40 [auto1.de] INFO: Found listing with ID: BH27116
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH27116%27 HTTP/1.1" 200 None
2026-03-30 10:53:40 [auto1.de] INFO: Scrape type for BH27116: 2
2026-03-30 10:53:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d36b773a-4c1a-5bb9-b9f3-b6a2fb9a36a2 with identifier: BH27116
2026-03-30 10:53:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d36b773a-4c1a-5bb9-b9f3-b6a2fb9a36a2 with scrape type 2
2026-03-30 10:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d36b773a-4c1a-5bb9-b9f3-b6a2fb9a36a2 with scrape type 2
2026-03-30 10:53:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d36b773a-4c1a-5bb9-b9f3-b6a2fb9a36a2, identifier: BH27116
2026-03-30 10:53:40 [auto1.de] INFO: Found listing with ID: FZ79276
2026-03-30 10:53:40 [auto1.de] INFO: Found listing with ID: ZV01579
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV01579%27 HTTP/1.1" 200 None
2026-03-30 10:53:40 [auto1.de] INFO: Scrape type for ZV01579: 2
2026-03-30 10:53:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3cacf29-a8ed-56ad-af2d-96c943685c75 with identifier: ZV01579
2026-03-30 10:53:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3cacf29-a8ed-56ad-af2d-96c943685c75 with scrape type 2
2026-03-30 10:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3cacf29-a8ed-56ad-af2d-96c943685c75 with scrape type 2
2026-03-30 10:53:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3cacf29-a8ed-56ad-af2d-96c943685c75, identifier: ZV01579
2026-03-30 10:53:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f428a810>
2026-03-30 10:53:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_0b8036523ab25a38ba73cd2b270ce093.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_0b8036523ab25a38ba73cd2b270ce093.jpg saved to cache
2026-03-30 10:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ec2e095-a75f-5a76-bb58-363a121b9805
2026-03-30 10:53:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4230bd0>
2026-03-30 10:53:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_07544adc4ae092cc76d66a3f589703a7.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_07544adc4ae092cc76d66a3f589703a7.jpg saved to cache
2026-03-30 10:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bf19aad-a25c-5fbc-a5aa-b12bbe969592
2026-03-30 10:53:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee97a10>
2026-03-30 10:53:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e31dafb-5cb9-565c-9935-0b630cfec88c/6e31dafb-5cb9-565c-9935-0b630cfec88c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F00%252Fae003cb4daa884ba053a24f6ce30027d%252Fpa%252FEA70503_84dc5660c36c68236cd56777c9111a9b.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_84dc5660c36c68236cd56777c9111a9b.jpg saved to cache
2026-03-30 10:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e31dafb-5cb9-565c-9935-0b630cfec88c
2026-03-30 10:53:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d36b773a-4c1a-5bb9-b9f3-b6a2fb9a36a2 with identifier: BH27116
2026-03-30 10:53:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d36b773a-4c1a-5bb9-b9f3-b6a2fb9a36a2 with identifier: BH27116
2026-03-30 10:53:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d36b773a-4c1a-5bb9-b9f3-b6a2fb9a36a2 with identifier: BH27116 to the API
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:51:53Z',
 'fuel_type': 'petrol',
 'id': 'd36b773a-4c1a-5bb9-b9f3-b6a2fb9a36a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH27116',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 88357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-08',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2021}
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH27116%27 HTTP/1.1" 200 None
2026-03-30 10:53:41 [auto1.de] INFO: Saving data for BH27116: {'auction_closing_time': 1774972313.0, 'created_time': 1773775267.917883, 'last_price_update_time': 1774868021.542382}
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH27116') HTTP/1.1" 204 0
2026-03-30 10:53:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3cacf29-a8ed-56ad-af2d-96c943685c75 with identifier: ZV01579
2026-03-30 10:53:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3cacf29-a8ed-56ad-af2d-96c943685c75 with identifier: ZV01579
2026-03-30 10:53:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3cacf29-a8ed-56ad-af2d-96c943685c75 with identifier: ZV01579 to the API
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:56:55Z',
 'fuel_type': 'petrol',
 'id': 'd3cacf29-a8ed-56ad-af2d-96c943685c75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV01579',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 280503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-10-31',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 Comfortline Family',
 'transmission': 'manual',
 'trim': 'Comfortline Family',
 'year': 2004}
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV01579%27 HTTP/1.1" 200 None
2026-03-30 10:53:41 [auto1.de] INFO: Saving data for ZV01579: {'auction_closing_time': 1774972615.0, 'created_time': 1774293377.008097, 'last_price_update_time': 1774868021.852427}
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV01579') HTTP/1.1" 204 0
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_bfd4d40b4924e3db18db899f9bf43ad4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_bfd4d40b4924e3db18db899f9bf43ad4.jpg not downloaded yet
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_fea306f273852284b5716d20bf582b52.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_fea306f273852284b5716d20bf582b52.jpg not downloaded yet
2026-03-30 10:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_2521bf9305e2f307bf44c67f1c7ecf90.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_789d4b303407fa563524edef9183c218.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:41 [auto1.de] INFO: Found listing with ID: WA93069
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA93069%27 HTTP/1.1" 200 None
2026-03-30 10:53:41 [auto1.de] INFO: Scrape type for WA93069: 2
2026-03-30 10:53:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bf1411c-b391-5cd3-8d06-262c526c817b with identifier: WA93069
2026-03-30 10:53:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bf1411c-b391-5cd3-8d06-262c526c817b with scrape type 2
2026-03-30 10:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bf1411c-b391-5cd3-8d06-262c526c817b with scrape type 2
2026-03-30 10:53:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bf1411c-b391-5cd3-8d06-262c526c817b, identifier: WA93069
2026-03-30 10:53:42 [auto1.de] INFO: Found listing with ID: YJ24873
2026-03-30 10:53:42 [auto1.de] INFO: Found listing with ID: CL28270
2026-03-30 10:53:42 [auto1.de] INFO: Found listing with ID: GT95785
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT95785%27 HTTP/1.1" 200 None
2026-03-30 10:53:42 [auto1.de] INFO: Scrape type for GT95785: 2
2026-03-30 10:53:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b116a17a-b148-5cbc-bba5-f417fbf687db with identifier: GT95785
2026-03-30 10:53:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b116a17a-b148-5cbc-bba5-f417fbf687db with scrape type 2
2026-03-30 10:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b116a17a-b148-5cbc-bba5-f417fbf687db with scrape type 2
2026-03-30 10:53:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b116a17a-b148-5cbc-bba5-f417fbf687db, identifier: GT95785
2026-03-30 10:53:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee76f50>
2026-03-30 10:53:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_0daeaced3fde4591821c68a5cfb56ee0.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_0daeaced3fde4591821c68a5cfb56ee0.jpg saved to cache
2026-03-30 10:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ec2e095-a75f-5a76-bb58-363a121b9805
2026-03-30 10:53:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4172b50>
2026-03-30 10:53:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_cbb5bf5011718804527c9284a8c40dbc.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_cbb5bf5011718804527c9284a8c40dbc.jpg saved to cache
2026-03-30 10:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2bf19aad-a25c-5fbc-a5aa-b12bbe969592
2026-03-30 10:53:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee47a190>
2026-03-30 10:53:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e31dafb-5cb9-565c-9935-0b630cfec88c/6e31dafb-5cb9-565c-9935-0b630cfec88c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F00%252Fae003cb4daa884ba053a24f6ce30027d%252Fpa%252FEA70503_7970dd7f3c2cdee34fe730e75e8c5829.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_7970dd7f3c2cdee34fe730e75e8c5829.jpg saved to cache
2026-03-30 10:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e31dafb-5cb9-565c-9935-0b630cfec88c
2026-03-30 10:53:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e31dafb-5cb9-565c-9935-0b630cfec88c, skipping ID generation
2026-03-30 10:53:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e31dafb-5cb9-565c-9935-0b630cfec88c with scrape type 1
2026-03-30 10:53:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e31dafb-5cb9-565c-9935-0b630cfec88c sending to next pipeline
2026-03-30 10:53:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e31dafb-5cb9-565c-9935-0b630cfec88c, identifier: EA70503
2026-03-30 10:53:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bf1411c-b391-5cd3-8d06-262c526c817b with identifier: WA93069
2026-03-30 10:53:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bf1411c-b391-5cd3-8d06-262c526c817b with identifier: WA93069
2026-03-30 10:53:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bf1411c-b391-5cd3-8d06-262c526c817b with identifier: WA93069 to the API
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:41:11Z',
 'fuel_type': 'petrol',
 'id': '7bf1411c-b391-5cd3-8d06-262c526c817b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA93069',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 53615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-27',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI Cupra 300 4Drive',
 'transmission': 'automatic',
 'trim': 'Cupra 300 4Drive',
 'year': 2019}
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA93069%27 HTTP/1.1" 200 None
2026-03-30 10:53:42 [auto1.de] INFO: Saving data for WA93069: {'auction_closing_time': 1774971671.0, 'created_time': 1774464558.49698, 'last_price_update_time': 1774868022.672524}
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA93069') HTTP/1.1" 204 0
2026-03-30 10:53:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b116a17a-b148-5cbc-bba5-f417fbf687db with identifier: GT95785
2026-03-30 10:53:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b116a17a-b148-5cbc-bba5-f417fbf687db with identifier: GT95785
2026-03-30 10:53:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b116a17a-b148-5cbc-bba5-f417fbf687db with identifier: GT95785 to the API
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:45:08Z',
 'fuel_type': 'petrol',
 'id': 'b116a17a-b148-5cbc-bba5-f417fbf687db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT95785',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 122531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-08',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT95785%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [auto1.de] INFO: Saving data for GT95785: {'auction_closing_time': 1774971908.0, 'created_time': 1773344816.837648, 'last_price_update_time': 1774868023.077914}
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT95785') HTTP/1.1" 204 0
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_e9d4cf073e696c9aa69e45866e20b4eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_e9d4cf073e696c9aa69e45866e20b4eb.jpg not downloaded yet
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_74c01eca8c1279de48780cdf52a756a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_74c01eca8c1279de48780cdf52a756a1.jpg not downloaded yet
2026-03-30 10:53:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e31dafb-5cb9-565c-9935-0b630cfec88c with identifier: EA70503
2026-03-30 10:53:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e31dafb-5cb9-565c-9935-0b630cfec88c with identifier: EA70503
2026-03-30 10:53:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e31dafb-5cb9-565c-9935-0b630cfec88c with identifier: EA70503 to the API
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_7970dd7f3c2cdee34fe730e75e8c5829.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:09:33Z',
 'fuel_type': 'petrol',
 'id': '6e31dafb-5cb9-565c-9935-0b630cfec88c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA70503',
 'listing': 'auction',
 'location': 'Bretzenheim',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 121631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e31dafb-5cb9-565c-9935-0b630cfec88c/6e31dafb-5cb9-565c-9935-0b630cfec88c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_fbdb3f6cc90090df7864b027e4d744bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e31dafb-5cb9-565c-9935-0b630cfec88c/6e31dafb-5cb9-565c-9935-0b630cfec88c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_e2f1066f4a6b4e97f65d0e1b2900dcb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e31dafb-5cb9-565c-9935-0b630cfec88c/6e31dafb-5cb9-565c-9935-0b630cfec88c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_640bcbed338c8febbb2564fa82ef5fc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e31dafb-5cb9-565c-9935-0b630cfec88c/6e31dafb-5cb9-565c-9935-0b630cfec88c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_84dc5660c36c68236cd56777c9111a9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e31dafb-5cb9-565c-9935-0b630cfec88c/6e31dafb-5cb9-565c-9935-0b630cfec88c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/00/ae003cb4daa884ba053a24f6ce30027d/pa/EA70503_7970dd7f3c2cdee34fe730e75e8c5829.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA70503%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [auto1.de] INFO: Saving data for EA70503: {'created_time': 1774868023.508378, 'last_price_update_time': 1774868023.508389, 'auction_closing_time': 1774969773.0}
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA70503') HTTP/1.1" 204 0
2026-03-30 10:53:43 [auto1.de] INFO: Found listing with ID: CN59781
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN59781%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [auto1.de] INFO: Scrape type for CN59781: 2
2026-03-30 10:53:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 801eb981-8bee-53b4-87cf-fccb833324b9 with identifier: CN59781
2026-03-30 10:53:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 801eb981-8bee-53b4-87cf-fccb833324b9 with scrape type 2
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 801eb981-8bee-53b4-87cf-fccb833324b9 with scrape type 2
2026-03-30 10:53:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 801eb981-8bee-53b4-87cf-fccb833324b9, identifier: CN59781
2026-03-30 10:53:43 [auto1.de] INFO: Found listing with ID: EW55752
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW55752%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [auto1.de] INFO: Scrape type for EW55752: 2
2026-03-30 10:53:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00b594f3-0b47-55de-be1a-a6aeb95eb445 with identifier: EW55752
2026-03-30 10:53:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00b594f3-0b47-55de-be1a-a6aeb95eb445 with scrape type 2
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00b594f3-0b47-55de-be1a-a6aeb95eb445 with scrape type 2
2026-03-30 10:53:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00b594f3-0b47-55de-be1a-a6aeb95eb445, identifier: EW55752
2026-03-30 10:53:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4184ad0>
2026-03-30 10:53:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_6beaa5eae1aa5b3931fc4ae6c036e528.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_6beaa5eae1aa5b3931fc4ae6c036e528.jpg saved to cache
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ec2e095-a75f-5a76-bb58-363a121b9805
2026-03-30 10:53:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f433de50>
2026-03-30 10:53:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_be89b6e47f0a110b287c220125a66853.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_be89b6e47f0a110b287c220125a66853.jpg saved to cache
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2bf19aad-a25c-5fbc-a5aa-b12bbe969592
2026-03-30 10:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_8210416107770d1e6141bdb63d36c252.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_a81be07382d5f98bfb60c5ba1a2e2ed0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 801eb981-8bee-53b4-87cf-fccb833324b9 with identifier: CN59781
2026-03-30 10:53:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 801eb981-8bee-53b4-87cf-fccb833324b9 with identifier: CN59781
2026-03-30 10:53:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 801eb981-8bee-53b4-87cf-fccb833324b9 with identifier: CN59781 to the API
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:06:21Z',
 'fuel_type': 'petrol',
 'id': '801eb981-8bee-53b4-87cf-fccb833324b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN59781',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 3021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-05',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.5 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN59781%27 HTTP/1.1" 200 None
2026-03-30 10:53:44 [auto1.de] INFO: Saving data for CN59781: {'auction_closing_time': 1774969581.0, 'created_time': 1774467015.387954, 'last_price_update_time': 1774868024.194981}
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN59781') HTTP/1.1" 204 0
2026-03-30 10:53:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00b594f3-0b47-55de-be1a-a6aeb95eb445 with identifier: EW55752
2026-03-30 10:53:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00b594f3-0b47-55de-be1a-a6aeb95eb445 with identifier: EW55752
2026-03-30 10:53:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00b594f3-0b47-55de-be1a-a6aeb95eb445 with identifier: EW55752 to the API
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-31T15:03:07Z',
 'fuel_type': 'petrol',
 'id': '00b594f3-0b47-55de-be1a-a6aeb95eb445',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW55752',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat Alltrack',
 'odometer': 115415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-29',
 'seller_name': None,
 'title': 'Volkswagen Passat Alltrack 2.0 TSI 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': '4Motion BlueMotion',
 'year': 2019}
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW55752%27 HTTP/1.1" 200 None
2026-03-30 10:53:44 [auto1.de] INFO: Saving data for EW55752: {'auction_closing_time': 1774969387.0, 'created_time': 1773687975.132626, 'last_price_update_time': 1774868024.673255}
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW55752') HTTP/1.1" 204 0
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_e9b4c4f7c4333e73e82bb4da22e7ebf5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_e9b4c4f7c4333e73e82bb4da22e7ebf5.jpg not downloaded yet
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_4d282c3b730eea00ea56aa75dd7f9911.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_4d282c3b730eea00ea56aa75dd7f9911.jpg not downloaded yet
2026-03-30 10:53:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_10fc3e145b61e7e43d09e1112744cdb7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_8acca0fa73fe695533344fbd15ddfe03.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:44 [auto1.de] INFO: Found listing with ID: LU03314
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU03314%27 HTTP/1.1" 200 None
2026-03-30 10:53:44 [auto1.de] INFO: Scrape type for LU03314: 1
2026-03-30 10:53:44 [auto1.de] INFO: Found listing with ID: RG17194
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG17194%27 HTTP/1.1" 200 None
2026-03-30 10:53:44 [auto1.de] INFO: Scrape type for RG17194: 2
2026-03-30 10:53:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5ac0e67-cf51-559f-b78f-cd2bae4adc84 with identifier: RG17194
2026-03-30 10:53:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5ac0e67-cf51-559f-b78f-cd2bae4adc84 with scrape type 2
2026-03-30 10:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5ac0e67-cf51-559f-b78f-cd2bae4adc84 with scrape type 2
2026-03-30 10:53:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5ac0e67-cf51-559f-b78f-cd2bae4adc84, identifier: RG17194
2026-03-30 10:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW79397/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ82859/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE58657/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec9c10>
2026-03-30 10:53:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_2521bf9305e2f307bf44c67f1c7ecf90.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_2521bf9305e2f307bf44c67f1c7ecf90.jpg saved to cache
2026-03-30 10:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ec2e095-a75f-5a76-bb58-363a121b9805
2026-03-30 10:53:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef8fd50>
2026-03-30 10:53:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_789d4b303407fa563524edef9183c218.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_789d4b303407fa563524edef9183c218.jpg saved to cache
2026-03-30 10:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2bf19aad-a25c-5fbc-a5aa-b12bbe969592
2026-03-30 10:53:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5ac0e67-cf51-559f-b78f-cd2bae4adc84 with identifier: RG17194
2026-03-30 10:53:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5ac0e67-cf51-559f-b78f-cd2bae4adc84 with identifier: RG17194
2026-03-30 10:53:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5ac0e67-cf51-559f-b78f-cd2bae4adc84 with identifier: RG17194 to the API
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:05:32Z',
 'fuel_type': 'diesel',
 'id': 'f5ac0e67-cf51-559f-b78f-cd2bae4adc84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG17194',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 261197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-11',
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG17194%27 HTTP/1.1" 200 None
2026-03-30 10:53:45 [auto1.de] INFO: Saving data for RG17194: {'auction_closing_time': 1774969532.0, 'created_time': 1773305218.943391, 'last_price_update_time': 1774868025.514282}
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG17194') HTTP/1.1" 204 0
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_a55444b0b3ff452382429568dfae5dfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_a55444b0b3ff452382429568dfae5dfa.jpg not downloaded yet
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_16bb827b7183e4665c72776e7923c668.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_16bb827b7183e4665c72776e7923c668.jpg not downloaded yet
2026-03-30 10:53:45 [auto1.de] INFO: Found listing with ID: UR23354
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR23354%27 HTTP/1.1" 200 None
2026-03-30 10:53:45 [auto1.de] INFO: Scrape type for UR23354: 2
2026-03-30 10:53:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb51197d-7a18-593c-98a2-1b1302b33506 with identifier: UR23354
2026-03-30 10:53:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb51197d-7a18-593c-98a2-1b1302b33506 with scrape type 2
2026-03-30 10:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb51197d-7a18-593c-98a2-1b1302b33506 with scrape type 2
2026-03-30 10:53:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb51197d-7a18-593c-98a2-1b1302b33506, identifier: UR23354
2026-03-30 10:53:45 [auto1.de] INFO: Found listing with ID: DA73332
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA73332%27 HTTP/1.1" 200 None
2026-03-30 10:53:45 [auto1.de] INFO: Scrape type for DA73332: 1
2026-03-30 10:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS92150/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4176fd0>
2026-03-30 10:53:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_8210416107770d1e6141bdb63d36c252.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_8210416107770d1e6141bdb63d36c252.jpg saved to cache
2026-03-30 10:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ec2e095-a75f-5a76-bb58-363a121b9805
2026-03-30 10:53:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefee910>
2026-03-30 10:53:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_a81be07382d5f98bfb60c5ba1a2e2ed0.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_a81be07382d5f98bfb60c5ba1a2e2ed0.jpg saved to cache
2026-03-30 10:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2bf19aad-a25c-5fbc-a5aa-b12bbe969592
2026-03-30 10:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_bfd4d40b4924e3db18db899f9bf43ad4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_fea306f273852284b5716d20bf582b52.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb51197d-7a18-593c-98a2-1b1302b33506 with identifier: UR23354
2026-03-30 10:53:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb51197d-7a18-593c-98a2-1b1302b33506 with identifier: UR23354
2026-03-30 10:53:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb51197d-7a18-593c-98a2-1b1302b33506 with identifier: UR23354 to the API
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:15:17Z',
 'fuel_type': 'petrol',
 'id': 'fb51197d-7a18-593c-98a2-1b1302b33506',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR23354',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker Express',
 'odometer': 58872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-18',
 'seller_name': None,
 'title': 'Dacia Dokker Express 1.6 SCe Essentiel',
 'transmission': 'manual',
 'trim': 'Essentiel',
 'year': 2017}
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR23354%27 HTTP/1.1" 200 None
2026-03-30 10:53:46 [auto1.de] INFO: Saving data for UR23354: {'auction_closing_time': 1774970117.0, 'created_time': 1774466155.399885, 'last_price_update_time': 1774868026.105537}
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR23354') HTTP/1.1" 204 0
2026-03-30 10:53:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_e9d4cf073e696c9aa69e45866e20b4eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_74c01eca8c1279de48780cdf52a756a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:46 [auto1.de] INFO: Found listing with ID: ZF95436
2026-03-30 10:53:46 [auto1.de] INFO: Found listing with ID: UG13910
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG13910%27 HTTP/1.1" 200 None
2026-03-30 10:53:46 [auto1.de] INFO: Scrape type for UG13910: 2
2026-03-30 10:53:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cf1b222-b405-516e-ac77-aa940a82af80 with identifier: UG13910
2026-03-30 10:53:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cf1b222-b405-516e-ac77-aa940a82af80 with scrape type 2
2026-03-30 10:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cf1b222-b405-516e-ac77-aa940a82af80 with scrape type 2
2026-03-30 10:53:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cf1b222-b405-516e-ac77-aa940a82af80, identifier: UG13910
2026-03-30 10:53:46 [auto1.de] INFO: Found listing with ID: AU19422
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU19422%27 HTTP/1.1" 200 None
2026-03-30 10:53:46 [auto1.de] INFO: Scrape type for AU19422: 2
2026-03-30 10:53:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d74cccd-ea65-5674-86d0-53694e5f4a3f with identifier: AU19422
2026-03-30 10:53:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d74cccd-ea65-5674-86d0-53694e5f4a3f with scrape type 2
2026-03-30 10:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d74cccd-ea65-5674-86d0-53694e5f4a3f with scrape type 2
2026-03-30 10:53:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d74cccd-ea65-5674-86d0-53694e5f4a3f, identifier: AU19422
2026-03-30 10:53:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef39fd0>
2026-03-30 10:53:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_10fc3e145b61e7e43d09e1112744cdb7.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_10fc3e145b61e7e43d09e1112744cdb7.jpg saved to cache
2026-03-30 10:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ec2e095-a75f-5a76-bb58-363a121b9805
2026-03-30 10:53:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee54e90>
2026-03-30 10:53:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_8acca0fa73fe695533344fbd15ddfe03.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_8acca0fa73fe695533344fbd15ddfe03.jpg saved to cache
2026-03-30 10:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2bf19aad-a25c-5fbc-a5aa-b12bbe969592
2026-03-30 10:53:46 [auto1.de] INFO: Channel: 24h | Page: 47 | totalHits: 9520 | hits on page: 40
2026-03-30 10:53:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cf1b222-b405-516e-ac77-aa940a82af80 with identifier: UG13910
2026-03-30 10:53:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cf1b222-b405-516e-ac77-aa940a82af80 with identifier: UG13910
2026-03-30 10:53:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cf1b222-b405-516e-ac77-aa940a82af80 with identifier: UG13910 to the API
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:09:53Z',
 'fuel_type': 'petrol',
 'id': '6cf1b222-b405-516e-ac77-aa940a82af80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG13910',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 222736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-20',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG13910%27 HTTP/1.1" 200 None
2026-03-30 10:53:46 [auto1.de] INFO: Saving data for UG13910: {'auction_closing_time': 1774969793.0, 'created_time': 1774292845.297478, 'last_price_update_time': 1774868026.904109}
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG13910') HTTP/1.1" 204 0
2026-03-30 10:53:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d74cccd-ea65-5674-86d0-53694e5f4a3f with identifier: AU19422
2026-03-30 10:53:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d74cccd-ea65-5674-86d0-53694e5f4a3f with identifier: AU19422
2026-03-30 10:53:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d74cccd-ea65-5674-86d0-53694e5f4a3f with identifier: AU19422 to the API
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:02:30Z',
 'fuel_type': 'petrol',
 'id': '3d74cccd-ea65-5674-86d0-53694e5f4a3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU19422',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 352846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-26',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI quattro S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'quattro S line Sportpaket plus',
 'year': 2010}
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU19422%27 HTTP/1.1" 200 None
2026-03-30 10:53:47 [auto1.de] INFO: Saving data for AU19422: {'auction_closing_time': 1774969350.0, 'created_time': 1774467023.363316, 'last_price_update_time': 1774868027.287695}
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU19422') HTTP/1.1" 204 0
2026-03-30 10:53:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WB89242/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:47 [auto1.de] INFO: Found listing with ID: EU09282
2026-03-30 10:53:47 [auto1.de] INFO: Found listing with ID: DS36264
2026-03-30 10:53:47 [auto1.de] INFO: Found listing with ID: NS90051
2026-03-30 10:53:47 [auto1.de] INFO: Found listing with ID: GX62549
2026-03-30 10:53:47 [auto1.de] INFO: Found listing with ID: EJ51089
2026-03-30 10:53:47 [auto1.de] INFO: Found listing with ID: FK65857
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK65857%27 HTTP/1.1" 200 None
2026-03-30 10:53:47 [auto1.de] INFO: Scrape type for FK65857: 2
2026-03-30 10:53:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb91c4d6-41e5-5335-833c-9150a47ceac6 with identifier: FK65857
2026-03-30 10:53:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb91c4d6-41e5-5335-833c-9150a47ceac6 with scrape type 2
2026-03-30 10:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb91c4d6-41e5-5335-833c-9150a47ceac6 with scrape type 2
2026-03-30 10:53:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb91c4d6-41e5-5335-833c-9150a47ceac6, identifier: FK65857
2026-03-30 10:53:47 [auto1.de] INFO: Found listing with ID: SG57857
2026-03-30 10:53:47 [auto1.de] INFO: Found listing with ID: AF90097
2026-03-30 10:53:47 [auto1.de] INFO: Found listing with ID: EU60788
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU60788%27 HTTP/1.1" 200 None
2026-03-30 10:53:47 [auto1.de] INFO: Scrape type for EU60788: 2
2026-03-30 10:53:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9669b220-8e5c-52c5-88ae-ee1a0081bb4c with identifier: EU60788
2026-03-30 10:53:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9669b220-8e5c-52c5-88ae-ee1a0081bb4c with scrape type 2
2026-03-30 10:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9669b220-8e5c-52c5-88ae-ee1a0081bb4c with scrape type 2
2026-03-30 10:53:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9669b220-8e5c-52c5-88ae-ee1a0081bb4c, identifier: EU60788
2026-03-30 10:53:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefe2b90>
2026-03-30 10:53:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_bfd4d40b4924e3db18db899f9bf43ad4.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_bfd4d40b4924e3db18db899f9bf43ad4.jpg saved to cache
2026-03-30 10:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2bf19aad-a25c-5fbc-a5aa-b12bbe969592
2026-03-30 10:53:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f426a250>
2026-03-30 10:53:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_fea306f273852284b5716d20bf582b52.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_fea306f273852284b5716d20bf582b52.jpg saved to cache
2026-03-30 10:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ec2e095-a75f-5a76-bb58-363a121b9805
2026-03-30 10:53:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_16bb827b7183e4665c72776e7923c668.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_4d282c3b730eea00ea56aa75dd7f9911.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_e9b4c4f7c4333e73e82bb4da22e7ebf5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb91c4d6-41e5-5335-833c-9150a47ceac6 with identifier: FK65857
2026-03-30 10:53:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb91c4d6-41e5-5335-833c-9150a47ceac6 with identifier: FK65857
2026-03-30 10:53:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb91c4d6-41e5-5335-833c-9150a47ceac6 with identifier: FK65857 to the API
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-31T15:28:21Z',
 'fuel_type': 'petrol',
 'id': 'bb91c4d6-41e5-5335-833c-9150a47ceac6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK65857',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 159252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-30',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2013}
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK65857%27 HTTP/1.1" 200 None
2026-03-30 10:53:48 [auto1.de] INFO: Saving data for FK65857: {'auction_closing_time': 1774970901.0, 'created_time': 1774379328.085173, 'last_price_update_time': 1774868028.044879}
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK65857') HTTP/1.1" 204 0
2026-03-30 10:53:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9669b220-8e5c-52c5-88ae-ee1a0081bb4c with identifier: EU60788
2026-03-30 10:53:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9669b220-8e5c-52c5-88ae-ee1a0081bb4c with identifier: EU60788
2026-03-30 10:53:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9669b220-8e5c-52c5-88ae-ee1a0081bb4c with identifier: EU60788 to the API
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:26:44Z',
 'fuel_type': 'diesel',
 'id': '9669b220-8e5c-52c5-88ae-ee1a0081bb4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU60788',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 58838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-17',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2021}
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU60788%27 HTTP/1.1" 200 None
2026-03-30 10:53:48 [auto1.de] INFO: Saving data for EU60788: {'auction_closing_time': 1774970804.0, 'created_time': 1773775386.051037, 'last_price_update_time': 1774868028.486517}
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU60788') HTTP/1.1" 204 0
2026-03-30 10:53:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefc84d0>
2026-03-30 10:53:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_e9d4cf073e696c9aa69e45866e20b4eb.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_e9d4cf073e696c9aa69e45866e20b4eb.jpg saved to cache
2026-03-30 10:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2bf19aad-a25c-5fbc-a5aa-b12bbe969592
2026-03-30 10:53:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4258e10>
2026-03-30 10:53:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_74c01eca8c1279de48780cdf52a756a1.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_74c01eca8c1279de48780cdf52a756a1.jpg saved to cache
2026-03-30 10:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ec2e095-a75f-5a76-bb58-363a121b9805
2026-03-30 10:53:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_a55444b0b3ff452382429568dfae5dfa.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:48 [auto1.de] INFO: Found listing with ID: BH50029
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH50029%27 HTTP/1.1" 200 None
2026-03-30 10:53:48 [auto1.de] INFO: Scrape type for BH50029: 2
2026-03-30 10:53:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89df4df3-e412-5574-ad72-1b77ef3ba183 with identifier: BH50029
2026-03-30 10:53:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89df4df3-e412-5574-ad72-1b77ef3ba183 with scrape type 2
2026-03-30 10:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89df4df3-e412-5574-ad72-1b77ef3ba183 with scrape type 2
2026-03-30 10:53:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89df4df3-e412-5574-ad72-1b77ef3ba183, identifier: BH50029
2026-03-30 10:53:48 [auto1.de] INFO: Found listing with ID: MN64369
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN64369%27 HTTP/1.1" 200 None
2026-03-30 10:53:48 [auto1.de] INFO: Scrape type for MN64369: 2
2026-03-30 10:53:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7230b62f-b1ab-54c8-8e91-e5fccead6a8a with identifier: MN64369
2026-03-30 10:53:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7230b62f-b1ab-54c8-8e91-e5fccead6a8a with scrape type 2
2026-03-30 10:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7230b62f-b1ab-54c8-8e91-e5fccead6a8a with scrape type 2
2026-03-30 10:53:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7230b62f-b1ab-54c8-8e91-e5fccead6a8a, identifier: MN64369
2026-03-30 10:53:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89df4df3-e412-5574-ad72-1b77ef3ba183 with identifier: BH50029
2026-03-30 10:53:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89df4df3-e412-5574-ad72-1b77ef3ba183 with identifier: BH50029
2026-03-30 10:53:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89df4df3-e412-5574-ad72-1b77ef3ba183 with identifier: BH50029 to the API
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:58:26Z',
 'fuel_type': 'diesel',
 'id': '89df4df3-e412-5574-ad72-1b77ef3ba183',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH50029',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 100570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-10',
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH50029%27 HTTP/1.1" 200 None
2026-03-30 10:53:49 [auto1.de] INFO: Saving data for BH50029: {'auction_closing_time': 1774972706.0, 'created_time': 1773224939.067786, 'last_price_update_time': 1774868029.192187}
2026-03-30 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH50029') HTTP/1.1" 204 0
2026-03-30 10:53:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7230b62f-b1ab-54c8-8e91-e5fccead6a8a with identifier: MN64369
2026-03-30 10:53:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7230b62f-b1ab-54c8-8e91-e5fccead6a8a with identifier: MN64369
2026-03-30 10:53:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7230b62f-b1ab-54c8-8e91-e5fccead6a8a with identifier: MN64369 to the API
2026-03-30 10:53:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:42:07Z',
 'fuel_type': 'petrol',
 'id': '7230b62f-b1ab-54c8-8e91-e5fccead6a8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN64369',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 145999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-23',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN64369%27 HTTP/1.1" 200 None
2026-03-30 10:53:50 [auto1.de] INFO: Saving data for MN64369: {'auction_closing_time': 1774971727.0, 'created_time': 1773428257.598781, 'last_price_update_time': 1774868030.226762}
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN64369') HTTP/1.1" 204 0
2026-03-30 10:53:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:50 [auto1.de] INFO: Found listing with ID: LT62829
2026-03-30 10:53:50 [auto1.de] INFO: Found listing with ID: LT67236
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT67236%27 HTTP/1.1" 200 None
2026-03-30 10:53:50 [auto1.de] INFO: Scrape type for LT67236: 2
2026-03-30 10:53:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f48a980-4f21-56a2-82d0-318c1229531f with identifier: LT67236
2026-03-30 10:53:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f48a980-4f21-56a2-82d0-318c1229531f with scrape type 2
2026-03-30 10:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f48a980-4f21-56a2-82d0-318c1229531f with scrape type 2
2026-03-30 10:53:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f48a980-4f21-56a2-82d0-318c1229531f, identifier: LT67236
2026-03-30 10:53:50 [auto1.de] INFO: Found listing with ID: EC42355
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC42355%27 HTTP/1.1" 200 None
2026-03-30 10:53:50 [auto1.de] INFO: Scrape type for EC42355: 2
2026-03-30 10:53:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0abbc67a-1c2a-5107-a549-a7c90fbf1934 with identifier: EC42355
2026-03-30 10:53:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0abbc67a-1c2a-5107-a549-a7c90fbf1934 with scrape type 2
2026-03-30 10:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0abbc67a-1c2a-5107-a549-a7c90fbf1934 with scrape type 2
2026-03-30 10:53:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0abbc67a-1c2a-5107-a549-a7c90fbf1934, identifier: EC42355
2026-03-30 10:53:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f48a980-4f21-56a2-82d0-318c1229531f with identifier: LT67236
2026-03-30 10:53:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f48a980-4f21-56a2-82d0-318c1229531f with identifier: LT67236
2026-03-30 10:53:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f48a980-4f21-56a2-82d0-318c1229531f with identifier: LT67236 to the API
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:36:42Z',
 'fuel_type': 'diesel',
 'id': '6f48a980-4f21-56a2-82d0-318c1229531f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT67236',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 183266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-09',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT67236%27 HTTP/1.1" 200 None
2026-03-30 10:53:50 [auto1.de] INFO: Saving data for LT67236: {'auction_closing_time': 1774971402.0, 'created_time': 1774464580.077529, 'last_price_update_time': 1774868030.892504}
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT67236') HTTP/1.1" 204 0
2026-03-30 10:53:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0abbc67a-1c2a-5107-a549-a7c90fbf1934 with identifier: EC42355
2026-03-30 10:53:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0abbc67a-1c2a-5107-a549-a7c90fbf1934 with identifier: EC42355
2026-03-30 10:53:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0abbc67a-1c2a-5107-a549-a7c90fbf1934 with identifier: EC42355 to the API
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:26:11Z',
 'fuel_type': 'petrol',
 'id': '0abbc67a-1c2a-5107-a549-a7c90fbf1934',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC42355',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 58623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-13',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2019}
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC42355%27 HTTP/1.1" 200 None
2026-03-30 10:53:51 [auto1.de] INFO: Saving data for EC42355: {'auction_closing_time': 1774970771.0, 'created_time': 1774463683.346679, 'last_price_update_time': 1774868031.248083}
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC42355') HTTP/1.1" 204 0
2026-03-30 10:53:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f59586d0>
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_16bb827b7183e4665c72776e7923c668.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_16bb827b7183e4665c72776e7923c668.jpg saved to cache
2026-03-30 10:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ec2e095-a75f-5a76-bb58-363a121b9805
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eed37850>
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387da3da038f51ce806752f8c9fd8cb4%252Fpa%252FWT89388_4d282c3b730eea00ea56aa75dd7f9911.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_4d282c3b730eea00ea56aa75dd7f9911.jpg saved to cache
2026-03-30 10:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ec2e095-a75f-5a76-bb58-363a121b9805
2026-03-30 10:53:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ec2e095-a75f-5a76-bb58-363a121b9805, skipping ID generation
2026-03-30 10:53:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ec2e095-a75f-5a76-bb58-363a121b9805 with scrape type 1
2026-03-30 10:53:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ec2e095-a75f-5a76-bb58-363a121b9805 sending to next pipeline
2026-03-30 10:53:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ec2e095-a75f-5a76-bb58-363a121b9805, identifier: WT89388
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41c5190>
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_e9b4c4f7c4333e73e82bb4da22e7ebf5.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_e9b4c4f7c4333e73e82bb4da22e7ebf5.jpg saved to cache
2026-03-30 10:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2bf19aad-a25c-5fbc-a5aa-b12bbe969592
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb99d0>
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fcd%252Fa1cd48df87f43e0088706d641e457f8b%252Fpa%252FNB55026_a55444b0b3ff452382429568dfae5dfa.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_a55444b0b3ff452382429568dfae5dfa.jpg saved to cache
2026-03-30 10:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2bf19aad-a25c-5fbc-a5aa-b12bbe969592
2026-03-30 10:53:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2bf19aad-a25c-5fbc-a5aa-b12bbe969592, skipping ID generation
2026-03-30 10:53:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bf19aad-a25c-5fbc-a5aa-b12bbe969592 with scrape type 1
2026-03-30 10:53:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bf19aad-a25c-5fbc-a5aa-b12bbe969592 sending to next pipeline
2026-03-30 10:53:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bf19aad-a25c-5fbc-a5aa-b12bbe969592, identifier: NB55026
2026-03-30 10:53:51 [auto1.de] INFO: Found listing with ID: EN14758
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN14758%27 HTTP/1.1" 200 None
2026-03-30 10:53:51 [auto1.de] INFO: Scrape type for EN14758: 2
2026-03-30 10:53:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4142684e-f370-5139-a253-dcb5f6c560ec with identifier: EN14758
2026-03-30 10:53:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4142684e-f370-5139-a253-dcb5f6c560ec with scrape type 2
2026-03-30 10:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4142684e-f370-5139-a253-dcb5f6c560ec with scrape type 2
2026-03-30 10:53:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4142684e-f370-5139-a253-dcb5f6c560ec, identifier: EN14758
2026-03-30 10:53:51 [auto1.de] INFO: Found listing with ID: FP89516
2026-03-30 10:53:51 [auto1.de] INFO: Found listing with ID: PG02615
2026-03-30 10:53:51 [auto1.de] INFO: Found listing with ID: YV18372
2026-03-30 10:53:51 [auto1.de] INFO: Found listing with ID: CC36364
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC36364%27 HTTP/1.1" 200 None
2026-03-30 10:53:51 [auto1.de] INFO: Scrape type for CC36364: 2
2026-03-30 10:53:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1db54cf0-f91a-5c49-b7c2-098a2c4a3ca0 with identifier: CC36364
2026-03-30 10:53:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1db54cf0-f91a-5c49-b7c2-098a2c4a3ca0 with scrape type 2
2026-03-30 10:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1db54cf0-f91a-5c49-b7c2-098a2c4a3ca0 with scrape type 2
2026-03-30 10:53:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1db54cf0-f91a-5c49-b7c2-098a2c4a3ca0, identifier: CC36364
2026-03-30 10:53:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ec2e095-a75f-5a76-bb58-363a121b9805 with identifier: WT89388
2026-03-30 10:53:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ec2e095-a75f-5a76-bb58-363a121b9805 with identifier: WT89388
2026-03-30 10:53:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ec2e095-a75f-5a76-bb58-363a121b9805 with identifier: WT89388 to the API
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_4d282c3b730eea00ea56aa75dd7f9911.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 91,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:18:17Z',
 'fuel_type': 'hybrid',
 'id': '4ec2e095-a75f-5a76-bb58-363a121b9805',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT89388',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 190626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_0b8036523ab25a38ba73cd2b270ce093.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_0daeaced3fde4591821c68a5cfb56ee0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_6beaa5eae1aa5b3931fc4ae6c036e528.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_2521bf9305e2f307bf44c67f1c7ecf90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_8210416107770d1e6141bdb63d36c252.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_10fc3e145b61e7e43d09e1112744cdb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_fea306f273852284b5716d20bf582b52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_74c01eca8c1279de48780cdf52a756a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_4d282c3b730eea00ea56aa75dd7f9911.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec2e095-a75f-5a76-bb58-363a121b9805/4ec2e095-a75f-5a76-bb58-363a121b9805_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387da3da038f51ce806752f8c9fd8cb4/pa/WT89388_16bb827b7183e4665c72776e7923c668.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Auris 1.8 Hybrid START Edition',
 'transmission': 'automatic',
 'trim': 'START Edition',
 'year': 2013}
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT89388%27 HTTP/1.1" 200 None
2026-03-30 10:53:52 [auto1.de] INFO: Saving data for WT89388: {'created_time': 1774868032.225934, 'last_price_update_time': 1774868032.225946, 'auction_closing_time': 1774970297.0}
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT89388') HTTP/1.1" 204 0
2026-03-30 10:53:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bf19aad-a25c-5fbc-a5aa-b12bbe969592 with identifier: NB55026
2026-03-30 10:53:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bf19aad-a25c-5fbc-a5aa-b12bbe969592 with identifier: NB55026
2026-03-30 10:53:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bf19aad-a25c-5fbc-a5aa-b12bbe969592 with identifier: NB55026 to the API
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_a55444b0b3ff452382429568dfae5dfa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 197,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:43:05Z',
 'fuel_type': 'diesel',
 'id': '2bf19aad-a25c-5fbc-a5aa-b12bbe969592',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB55026',
 'listing': 'auction',
 'location': 'DE, Würselen',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 78922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_07544adc4ae092cc76d66a3f589703a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_cbb5bf5011718804527c9284a8c40dbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_be89b6e47f0a110b287c220125a66853.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_789d4b303407fa563524edef9183c218.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_a81be07382d5f98bfb60c5ba1a2e2ed0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_8acca0fa73fe695533344fbd15ddfe03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_bfd4d40b4924e3db18db899f9bf43ad4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_e9d4cf073e696c9aa69e45866e20b4eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_e9b4c4f7c4333e73e82bb4da22e7ebf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf19aad-a25c-5fbc-a5aa-b12bbe969592/2bf19aad-a25c-5fbc-a5aa-b12bbe969592_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cd/a1cd48df87f43e0088706d641e457f8b/pa/NB55026_a55444b0b3ff452382429568dfae5dfa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-15',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten FWD',
 'transmission': 'manual',
 'trim': 'Kasten FWD',
 'year': 2019}
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB55026%27 HTTP/1.1" 200 None
2026-03-30 10:53:52 [auto1.de] INFO: Saving data for NB55026: {'created_time': 1774868032.626764, 'last_price_update_time': 1774868032.626776, 'auction_closing_time': 1774971785.0}
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB55026') HTTP/1.1" 204 0
2026-03-30 10:53:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4142684e-f370-5139-a253-dcb5f6c560ec with identifier: EN14758
2026-03-30 10:53:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4142684e-f370-5139-a253-dcb5f6c560ec with identifier: EN14758
2026-03-30 10:53:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4142684e-f370-5139-a253-dcb5f6c560ec with identifier: EN14758 to the API
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:27:52Z',
 'fuel_type': 'petrol',
 'id': '4142684e-f370-5139-a253-dcb5f6c560ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN14758',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 231920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-28',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2013}
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN14758%27 HTTP/1.1" 200 None
2026-03-30 10:53:52 [auto1.de] INFO: Saving data for EN14758: {'auction_closing_time': 1774970872.0, 'created_time': 1774348281.764459, 'last_price_update_time': 1774868032.99567}
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN14758') HTTP/1.1" 204 0
2026-03-30 10:53:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1db54cf0-f91a-5c49-b7c2-098a2c4a3ca0 with identifier: CC36364
2026-03-30 10:53:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1db54cf0-f91a-5c49-b7c2-098a2c4a3ca0 with identifier: CC36364
2026-03-30 10:53:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1db54cf0-f91a-5c49-b7c2-098a2c4a3ca0 with identifier: CC36364 to the API
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-31T15:39:33Z',
 'fuel_type': 'petrol',
 'id': '1db54cf0-f91a-5c49-b7c2-098a2c4a3ca0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC36364',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 68789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-09',
 'seller_name': None,
 'title': 'Hyundai i30 2.0 TGDI N Performance',
 'transmission': 'manual',
 'trim': 'N Performance',
 'year': 2020}
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC36364%27 HTTP/1.1" 200 None
2026-03-30 10:53:53 [auto1.de] INFO: Saving data for CC36364: {'auction_closing_time': 1774971573.0, 'created_time': 1774380344.315149, 'last_price_update_time': 1774868033.38252}
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC36364') HTTP/1.1" 204 0
2026-03-30 10:53:53 [auto1.de] INFO: Found listing with ID: SZ84834
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ84834%27 HTTP/1.1" 200 None
2026-03-30 10:53:53 [auto1.de] INFO: Scrape type for SZ84834: 2
2026-03-30 10:53:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 104cf66d-ef30-5ccb-b474-4585cfc05575 with identifier: SZ84834
2026-03-30 10:53:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 104cf66d-ef30-5ccb-b474-4585cfc05575 with scrape type 2
2026-03-30 10:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 104cf66d-ef30-5ccb-b474-4585cfc05575 with scrape type 2
2026-03-30 10:53:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 104cf66d-ef30-5ccb-b474-4585cfc05575, identifier: SZ84834
2026-03-30 10:53:53 [auto1.de] INFO: Found listing with ID: CD38469
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD38469%27 HTTP/1.1" 200 None
2026-03-30 10:53:53 [auto1.de] INFO: Scrape type for CD38469: 2
2026-03-30 10:53:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5be47979-bed0-5ad5-bc94-80cafa08733e with identifier: CD38469
2026-03-30 10:53:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5be47979-bed0-5ad5-bc94-80cafa08733e with scrape type 2
2026-03-30 10:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5be47979-bed0-5ad5-bc94-80cafa08733e with scrape type 2
2026-03-30 10:53:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5be47979-bed0-5ad5-bc94-80cafa08733e, identifier: CD38469
2026-03-30 10:53:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA73332/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LU03314/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 104cf66d-ef30-5ccb-b474-4585cfc05575 with identifier: SZ84834
2026-03-30 10:53:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 104cf66d-ef30-5ccb-b474-4585cfc05575 with identifier: SZ84834
2026-03-30 10:53:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 104cf66d-ef30-5ccb-b474-4585cfc05575 with identifier: SZ84834 to the API
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:52:32Z',
 'fuel_type': 'gas',
 'id': '104cf66d-ef30-5ccb-b474-4585cfc05575',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ84834',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 100987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-28',
 'seller_name': None,
 'title': 'Fiat Doblo 1.4 Turbo SX Maxi Kasten',
 'transmission': 'manual',
 'trim': 'SX Maxi Kasten',
 'year': 2018}
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ84834%27 HTTP/1.1" 200 None
2026-03-30 10:53:53 [auto1.de] INFO: Saving data for SZ84834: {'auction_closing_time': 1774972352.0, 'created_time': 1774378097.245569, 'last_price_update_time': 1774868033.980659}
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ84834') HTTP/1.1" 204 0
2026-03-30 10:53:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5be47979-bed0-5ad5-bc94-80cafa08733e with identifier: CD38469
2026-03-30 10:53:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5be47979-bed0-5ad5-bc94-80cafa08733e with identifier: CD38469
2026-03-30 10:53:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5be47979-bed0-5ad5-bc94-80cafa08733e with identifier: CD38469 to the API
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:55:58Z',
 'fuel_type': 'diesel',
 'id': '5be47979-bed0-5ad5-bc94-80cafa08733e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD38469',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 102281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-06',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 250 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD38469%27 HTTP/1.1" 200 None
2026-03-30 10:53:54 [auto1.de] INFO: Saving data for CD38469: {'auction_closing_time': 1774972558.0, 'created_time': 1773946239.811358, 'last_price_update_time': 1774868034.423645}
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD38469') HTTP/1.1" 204 0
2026-03-30 10:53:54 [auto1.de] INFO: Found listing with ID: XL03429
2026-03-30 10:53:54 [auto1.de] INFO: Found listing with ID: JY37927
2026-03-30 10:53:54 [auto1.de] INFO: Found listing with ID: ND88059
2026-03-30 10:53:54 [auto1.de] INFO: Found listing with ID: XV11651
2026-03-30 10:53:54 [auto1.de] INFO: Found listing with ID: MT13357
2026-03-30 10:53:54 [auto1.de] INFO: Found listing with ID: LC55419
2026-03-30 10:53:54 [auto1.de] INFO: Found listing with ID: SW36019
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW36019%27 HTTP/1.1" 200 None
2026-03-30 10:53:54 [auto1.de] INFO: Scrape type for SW36019: 1
2026-03-30 10:53:54 [auto1.de] INFO: Found listing with ID: XX53475
2026-03-30 10:53:54 [auto1.de] INFO: Found listing with ID: BG92891
2026-03-30 10:53:54 [auto1.de] INFO: Found listing with ID: MJ05239
2026-03-30 10:53:54 [auto1.de] INFO: Found listing with ID: EF16593
2026-03-30 10:53:54 [auto1.de] INFO: Found listing with ID: DY66816
2026-03-30 10:53:54 [auto1.de] INFO: Found listing with ID: BE04791
2026-03-30 10:53:54 [auto1.de] INFO: Found listing with ID: PR75210
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR75210%27 HTTP/1.1" 200 None
2026-03-30 10:53:54 [auto1.de] INFO: Scrape type for PR75210: 2
2026-03-30 10:53:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37015876-0124-5bd8-9883-362d0fb3fb4e with identifier: PR75210
2026-03-30 10:53:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37015876-0124-5bd8-9883-362d0fb3fb4e with scrape type 2
2026-03-30 10:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37015876-0124-5bd8-9883-362d0fb3fb4e with scrape type 2
2026-03-30 10:53:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37015876-0124-5bd8-9883-362d0fb3fb4e, identifier: PR75210
2026-03-30 10:53:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37015876-0124-5bd8-9883-362d0fb3fb4e with identifier: PR75210
2026-03-30 10:53:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37015876-0124-5bd8-9883-362d0fb3fb4e with identifier: PR75210
2026-03-30 10:53:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37015876-0124-5bd8-9883-362d0fb3fb4e with identifier: PR75210 to the API
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:01:10Z',
 'fuel_type': 'petrol',
 'id': '37015876-0124-5bd8-9883-362d0fb3fb4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR75210',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 38582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-15',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR75210%27 HTTP/1.1" 200 None
2026-03-30 10:53:54 [auto1.de] INFO: Saving data for PR75210: {'auction_closing_time': 1774969270.0, 'created_time': 1773688554.305643, 'last_price_update_time': 1774868034.974901}
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR75210') HTTP/1.1" 204 0
2026-03-30 10:53:55 [auto1.de] INFO: Found listing with ID: ZV14288
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV14288%27 HTTP/1.1" 200 None
2026-03-30 10:53:55 [auto1.de] INFO: Scrape type for ZV14288: 2
2026-03-30 10:53:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36e6bbcc-3c42-57f1-b866-492bc559a10c with identifier: ZV14288
2026-03-30 10:53:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36e6bbcc-3c42-57f1-b866-492bc559a10c with scrape type 2
2026-03-30 10:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36e6bbcc-3c42-57f1-b866-492bc559a10c with scrape type 2
2026-03-30 10:53:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36e6bbcc-3c42-57f1-b866-492bc559a10c, identifier: ZV14288
2026-03-30 10:53:55 [auto1.de] INFO: Found listing with ID: XM97106
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM97106%27 HTTP/1.1" 200 None
2026-03-30 10:53:55 [auto1.de] INFO: Scrape type for XM97106: 2
2026-03-30 10:53:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1190f55-c638-5aeb-9142-c97df6f35332 with identifier: XM97106
2026-03-30 10:53:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1190f55-c638-5aeb-9142-c97df6f35332 with scrape type 2
2026-03-30 10:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1190f55-c638-5aeb-9142-c97df6f35332 with scrape type 2
2026-03-30 10:53:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1190f55-c638-5aeb-9142-c97df6f35332, identifier: XM97106
2026-03-30 10:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW79397> (referer: https://www.auto1.com/v1/car-details-view/GW79397/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36e6bbcc-3c42-57f1-b866-492bc559a10c with identifier: ZV14288
2026-03-30 10:53:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36e6bbcc-3c42-57f1-b866-492bc559a10c with identifier: ZV14288
2026-03-30 10:53:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36e6bbcc-3c42-57f1-b866-492bc559a10c with identifier: ZV14288 to the API
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:28:44Z',
 'fuel_type': 'diesel',
 'id': '36e6bbcc-3c42-57f1-b866-492bc559a10c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV14288',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse Marco Polo',
 'odometer': 73913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-31',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse Marco Polo V 250 d Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2019}
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV14288%27 HTTP/1.1" 200 None
2026-03-30 10:53:55 [auto1.de] INFO: Saving data for ZV14288: {'auction_closing_time': 1774970924.0, 'created_time': 1774463463.416956, 'last_price_update_time': 1774868035.85722}
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV14288') HTTP/1.1" 204 0
2026-03-30 10:53:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1190f55-c638-5aeb-9142-c97df6f35332 with identifier: XM97106
2026-03-30 10:53:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1190f55-c638-5aeb-9142-c97df6f35332 with identifier: XM97106
2026-03-30 10:53:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1190f55-c638-5aeb-9142-c97df6f35332 with identifier: XM97106 to the API
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-31T15:07:56Z',
 'fuel_type': 'petrol',
 'id': 'b1190f55-c638-5aeb-9142-c97df6f35332',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM97106',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 123815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-02',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 SCe Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2018}
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM97106%27 HTTP/1.1" 200 None
2026-03-30 10:53:56 [auto1.de] INFO: Saving data for XM97106: {'auction_closing_time': 1774969676.0, 'created_time': 1773775967.55577, 'last_price_update_time': 1774868036.174244}
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM97106') HTTP/1.1" 204 0
2026-03-30 10:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ82859> (referer: https://www.auto1.com/v1/car-details-view/TZ82859/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:56 [auto1.de] INFO: Found listing with ID: UZ37057
2026-03-30 10:53:56 [auto1.de] INFO: Found listing with ID: VV73959
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV73959%27 HTTP/1.1" 200 None
2026-03-30 10:53:56 [auto1.de] INFO: Scrape type for VV73959: 2
2026-03-30 10:53:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3191b0d-50ad-5175-a5ba-45be6573cb13 with identifier: VV73959
2026-03-30 10:53:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3191b0d-50ad-5175-a5ba-45be6573cb13 with scrape type 2
2026-03-30 10:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3191b0d-50ad-5175-a5ba-45be6573cb13 with scrape type 2
2026-03-30 10:53:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3191b0d-50ad-5175-a5ba-45be6573cb13, identifier: VV73959
2026-03-30 10:53:56 [auto1.de] INFO: Found listing with ID: ZN42603
2026-03-30 10:53:56 [auto1.de] INFO: Found listing with ID: SU92551
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU92551%27 HTTP/1.1" 200 None
2026-03-30 10:53:56 [auto1.de] INFO: Scrape type for SU92551: 2
2026-03-30 10:53:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f818680-30c5-560f-b520-258e134c3e61 with identifier: SU92551
2026-03-30 10:53:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f818680-30c5-560f-b520-258e134c3e61 with scrape type 2
2026-03-30 10:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f818680-30c5-560f-b520-258e134c3e61 with scrape type 2
2026-03-30 10:53:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f818680-30c5-560f-b520-258e134c3e61, identifier: SU92551
2026-03-30 10:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE58657> (referer: https://www.auto1.com/v1/car-details-view/RE58657/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3191b0d-50ad-5175-a5ba-45be6573cb13 with identifier: VV73959
2026-03-30 10:53:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3191b0d-50ad-5175-a5ba-45be6573cb13 with identifier: VV73959
2026-03-30 10:53:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3191b0d-50ad-5175-a5ba-45be6573cb13 with identifier: VV73959 to the API
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:58:46Z',
 'fuel_type': 'petrol',
 'id': 'f3191b0d-50ad-5175-a5ba-45be6573cb13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV73959',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 42150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-01',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.0 Diamant Edition',
 'transmission': 'manual',
 'trim': 'Diamant Edition',
 'year': 2020}
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV73959%27 HTTP/1.1" 200 None
2026-03-30 10:53:56 [auto1.de] INFO: Saving data for VV73959: {'auction_closing_time': 1774972726.0, 'created_time': 1773662284.212042, 'last_price_update_time': 1774868036.796572}
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV73959') HTTP/1.1" 204 0
2026-03-30 10:53:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f818680-30c5-560f-b520-258e134c3e61 with identifier: SU92551
2026-03-30 10:53:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f818680-30c5-560f-b520-258e134c3e61 with identifier: SU92551
2026-03-30 10:53:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f818680-30c5-560f-b520-258e134c3e61 with identifier: SU92551 to the API
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:58:09Z',
 'fuel_type': 'petrol',
 'id': '9f818680-30c5-560f-b520-258e134c3e61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU92551',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 141845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-13',
 'seller_name': None,
 'title': 'Skoda Octavia 1.2 TSI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU92551%27 HTTP/1.1" 200 None
2026-03-30 10:53:57 [auto1.de] INFO: Saving data for SU92551: {'auction_closing_time': 1774972689.0, 'created_time': 1773302258.605147, 'last_price_update_time': 1774868037.254251}
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU92551') HTTP/1.1" 204 0
2026-03-30 10:53:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:57 [auto1.de] INFO: Found listing with ID: WL38814
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL38814%27 HTTP/1.1" 200 None
2026-03-30 10:53:57 [auto1.de] INFO: Scrape type for WL38814: 2
2026-03-30 10:53:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b4e3484-c0e5-5b3c-90d8-15c89088dd3d with identifier: WL38814
2026-03-30 10:53:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b4e3484-c0e5-5b3c-90d8-15c89088dd3d with scrape type 2
2026-03-30 10:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b4e3484-c0e5-5b3c-90d8-15c89088dd3d with scrape type 2
2026-03-30 10:53:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b4e3484-c0e5-5b3c-90d8-15c89088dd3d, identifier: WL38814
2026-03-30 10:53:57 [auto1.de] INFO: Found listing with ID: FC82550
2026-03-30 10:53:57 [auto1.de] INFO: Found listing with ID: BF15182
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF15182%27 HTTP/1.1" 200 None
2026-03-30 10:53:57 [auto1.de] INFO: Scrape type for BF15182: 2
2026-03-30 10:53:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8216de55-ccfb-56c9-b3d1-34fdb926ddb1 with identifier: BF15182
2026-03-30 10:53:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8216de55-ccfb-56c9-b3d1-34fdb926ddb1 with scrape type 2
2026-03-30 10:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8216de55-ccfb-56c9-b3d1-34fdb926ddb1 with scrape type 2
2026-03-30 10:53:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8216de55-ccfb-56c9-b3d1-34fdb926ddb1, identifier: BF15182
2026-03-30 10:53:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b4e3484-c0e5-5b3c-90d8-15c89088dd3d with identifier: WL38814
2026-03-30 10:53:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b4e3484-c0e5-5b3c-90d8-15c89088dd3d with identifier: WL38814
2026-03-30 10:53:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b4e3484-c0e5-5b3c-90d8-15c89088dd3d with identifier: WL38814 to the API
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-31T15:38:50Z',
 'fuel_type': 'petrol',
 'id': '8b4e3484-c0e5-5b3c-90d8-15c89088dd3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL38814',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 138927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-29',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2016}
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL38814%27 HTTP/1.1" 200 None
2026-03-30 10:53:57 [auto1.de] INFO: Saving data for WL38814: {'auction_closing_time': 1774971530.0, 'created_time': 1774522464.533373, 'last_price_update_time': 1774868037.942092}
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL38814') HTTP/1.1" 204 0
2026-03-30 10:53:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8216de55-ccfb-56c9-b3d1-34fdb926ddb1 with identifier: BF15182
2026-03-30 10:53:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8216de55-ccfb-56c9-b3d1-34fdb926ddb1 with identifier: BF15182
2026-03-30 10:53:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8216de55-ccfb-56c9-b3d1-34fdb926ddb1 with identifier: BF15182 to the API
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:44:05Z',
 'fuel_type': 'petrol',
 'id': '8216de55-ccfb-56c9-b3d1-34fdb926ddb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF15182',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 189769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-27',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 250 Shooting Brake Edition 2020 AMG '
          'Line',
 'transmission': 'automatic',
 'trim': 'Edition 2020 AMG Line',
 'year': 2020}
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF15182%27 HTTP/1.1" 200 None
2026-03-30 10:53:58 [auto1.de] INFO: Saving data for BF15182: {'auction_closing_time': 1774971845.0, 'created_time': 1773514087.363856, 'last_price_update_time': 1774868038.326588}
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF15182') HTTP/1.1" 204 0
2026-03-30 10:53:58 [auto1.de] INFO: Channel: 24h | Page: 48 | totalHits: 9521 | hits on page: 40
2026-03-30 10:53:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e1809b1-19ca-5719-bde1-98be240fe3bf with identifier: GW79397
2026-03-30 10:53:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e1809b1-19ca-5719-bde1-98be240fe3bf with scrape type 1
2026-03-30 10:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e1809b1-19ca-5719-bde1-98be240fe3bf
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_abcc54ae8983ff09abf3c9b6b2b28e9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_abcc54ae8983ff09abf3c9b6b2b28e9c.jpg not downloaded yet
2026-03-30 10:53:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75d65597-7ba3-5d61-bb65-def4a80eb571 with identifier: TZ82859
2026-03-30 10:53:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75d65597-7ba3-5d61-bb65-def4a80eb571 with scrape type 1
2026-03-30 10:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 75d65597-7ba3-5d61-bb65-def4a80eb571
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Ff4%252Feef4d1a02dea9f88a40077c88b13d61d%252Fpa%252FTZ82859_54a31ef0aa832a0c1354ba41f277acbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_54a31ef0aa832a0c1354ba41f277acbf.jpg already downloaded
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Ff4%252Feef4d1a02dea9f88a40077c88b13d61d%252Fpa%252FTZ82859_1e35e5e7669843452c3bc30f0ad0b56b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_1e35e5e7669843452c3bc30f0ad0b56b.jpg already downloaded
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Ff4%252Feef4d1a02dea9f88a40077c88b13d61d%252Fpa%252FTZ82859_17aa4e2568711368d78d0ae957d76d72.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_17aa4e2568711368d78d0ae957d76d72.jpg already downloaded
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Ff4%252Feef4d1a02dea9f88a40077c88b13d61d%252Fpa%252FTZ82859_fcf248344abd1491094a5596d8ca6c17.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_fcf248344abd1491094a5596d8ca6c17.jpg already downloaded
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Ff4%252Feef4d1a02dea9f88a40077c88b13d61d%252Fpa%252FTZ82859_4637d9f9496d0089092559c2566ac391.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_4637d9f9496d0089092559c2566ac391.jpg already downloaded
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Ff4%252Feef4d1a02dea9f88a40077c88b13d61d%252Fpa%252FTZ82859_adc331fbb7da82b64dfe04e140a62167.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_adc331fbb7da82b64dfe04e140a62167.jpg already downloaded
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Ff4%252Feef4d1a02dea9f88a40077c88b13d61d%252Fpa%252FTZ82859_e803eed82fa7e55f6282f6f8034a18de.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_e803eed82fa7e55f6282f6f8034a18de.jpg already downloaded
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Ff4%252Feef4d1a02dea9f88a40077c88b13d61d%252Fpa%252FTZ82859_2e915f73c65c89e0e741ca98b063fdf1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_2e915f73c65c89e0e741ca98b063fdf1.jpg already downloaded
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Ff4%252Feef4d1a02dea9f88a40077c88b13d61d%252Fpa%252FTZ82859_914a03fd3558a86ff275a63d1f222869.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_914a03fd3558a86ff275a63d1f222869.jpg already downloaded
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Ff4%252Feef4d1a02dea9f88a40077c88b13d61d%252Fpa%252FTZ82859_3de742e9a8aa3245bdb8cc331a90b523.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_3de742e9a8aa3245bdb8cc331a90b523.jpg already downloaded
2026-03-30 10:53:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75d65597-7ba3-5d61-bb65-def4a80eb571, identifier: TZ82859
2026-03-30 10:53:58 [auto1.de] INFO: Found listing with ID: SG57857
2026-03-30 10:53:58 [auto1.de] INFO: Found listing with ID: XX51534
2026-03-30 10:53:58 [auto1.de] INFO: Found listing with ID: LT69845
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT69845%27 HTTP/1.1" 200 None
2026-03-30 10:53:58 [auto1.de] INFO: Scrape type for LT69845: 1
2026-03-30 10:53:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75d65597-7ba3-5d61-bb65-def4a80eb571 with identifier: TZ82859
2026-03-30 10:53:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75d65597-7ba3-5d61-bb65-def4a80eb571 with identifier: TZ82859
2026-03-30 10:53:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75d65597-7ba3-5d61-bb65-def4a80eb571 with identifier: TZ82859 to the API
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TZ82859>
{'auction_title': '',
 'c_o_2_emission_value': 194,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 280,
 'expiration_date': '2026-03-31T15:27:34Z',
 'fuel_type': 'petrol',
 'id': '75d65597-7ba3-5d61-bb65-def4a80eb571',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ82859',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 47697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_54a31ef0aa832a0c1354ba41f277acbf.jpg',
                'https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_1e35e5e7669843452c3bc30f0ad0b56b.jpg',
                'https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_17aa4e2568711368d78d0ae957d76d72.jpg',
                'https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_fcf248344abd1491094a5596d8ca6c17.jpg',
                'https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_4637d9f9496d0089092559c2566ac391.jpg',
                'https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_adc331fbb7da82b64dfe04e140a62167.jpg',
                'https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_e803eed82fa7e55f6282f6f8034a18de.jpg',
                'https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_2e915f73c65c89e0e741ca98b063fdf1.jpg',
                'https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_914a03fd3558a86ff275a63d1f222869.jpg',
                'https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_3de742e9a8aa3245bdb8cc331a90b523.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d65597-7ba3-5d61-bb65-def4a80eb571/75d65597-7ba3-5d61-bb65-def4a80eb571_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_54a31ef0aa832a0c1354ba41f277acbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d65597-7ba3-5d61-bb65-def4a80eb571/75d65597-7ba3-5d61-bb65-def4a80eb571_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_1e35e5e7669843452c3bc30f0ad0b56b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d65597-7ba3-5d61-bb65-def4a80eb571/75d65597-7ba3-5d61-bb65-def4a80eb571_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_17aa4e2568711368d78d0ae957d76d72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d65597-7ba3-5d61-bb65-def4a80eb571/75d65597-7ba3-5d61-bb65-def4a80eb571_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_fcf248344abd1491094a5596d8ca6c17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d65597-7ba3-5d61-bb65-def4a80eb571/75d65597-7ba3-5d61-bb65-def4a80eb571_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_4637d9f9496d0089092559c2566ac391.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d65597-7ba3-5d61-bb65-def4a80eb571/75d65597-7ba3-5d61-bb65-def4a80eb571_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_adc331fbb7da82b64dfe04e140a62167.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d65597-7ba3-5d61-bb65-def4a80eb571/75d65597-7ba3-5d61-bb65-def4a80eb571_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_e803eed82fa7e55f6282f6f8034a18de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d65597-7ba3-5d61-bb65-def4a80eb571/75d65597-7ba3-5d61-bb65-def4a80eb571_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_2e915f73c65c89e0e741ca98b063fdf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d65597-7ba3-5d61-bb65-def4a80eb571/75d65597-7ba3-5d61-bb65-def4a80eb571_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_914a03fd3558a86ff275a63d1f222869.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d65597-7ba3-5d61-bb65-def4a80eb571/75d65597-7ba3-5d61-bb65-def4a80eb571_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/f4/eef4d1a02dea9f88a40077c88b13d61d/pa/TZ82859_3de742e9a8aa3245bdb8cc331a90b523.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 2.0 T-GDI N Performance 2WD',
 'transmission': 'automatic',
 'trim': 'N Performance 2WD',
 'year': 2021}
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ82859%27 HTTP/1.1" 200 None
2026-03-30 10:53:59 [auto1.de] INFO: Saving data for TZ82859: {'created_time': 1774868039.020768, 'last_price_update_time': 1774868039.020778, 'auction_closing_time': 1774970854.0}
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ82859') HTTP/1.1" 204 0
2026-03-30 10:53:59 [auto1.de] INFO: Found listing with ID: FR24268
2026-03-30 10:53:59 [auto1.de] INFO: Found listing with ID: GL08454
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL08454%27 HTTP/1.1" 200 None
2026-03-30 10:53:59 [auto1.de] INFO: Scrape type for GL08454: 2
2026-03-30 10:53:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e8fe8f8-f8b0-51f8-9f9a-6cf41cb4153a with identifier: GL08454
2026-03-30 10:53:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e8fe8f8-f8b0-51f8-9f9a-6cf41cb4153a with scrape type 2
2026-03-30 10:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e8fe8f8-f8b0-51f8-9f9a-6cf41cb4153a with scrape type 2
2026-03-30 10:53:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e8fe8f8-f8b0-51f8-9f9a-6cf41cb4153a, identifier: GL08454
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_037182e911010f90e4078066886d54a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_037182e911010f90e4078066886d54a3.jpg not downloaded yet
2026-03-30 10:53:59 [auto1.de] INFO: Found listing with ID: DW74206
2026-03-30 10:53:59 [auto1.de] INFO: Found listing with ID: VU47981
2026-03-30 10:53:59 [auto1.de] INFO: Found listing with ID: XP46744
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP46744%27 HTTP/1.1" 200 None
2026-03-30 10:53:59 [auto1.de] INFO: Scrape type for XP46744: 2
2026-03-30 10:53:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00c70592-bb99-5208-af3f-530484214779 with identifier: XP46744
2026-03-30 10:53:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00c70592-bb99-5208-af3f-530484214779 with scrape type 2
2026-03-30 10:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00c70592-bb99-5208-af3f-530484214779 with scrape type 2
2026-03-30 10:53:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00c70592-bb99-5208-af3f-530484214779, identifier: XP46744
2026-03-30 10:53:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e8fe8f8-f8b0-51f8-9f9a-6cf41cb4153a with identifier: GL08454
2026-03-30 10:53:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e8fe8f8-f8b0-51f8-9f9a-6cf41cb4153a with identifier: GL08454
2026-03-30 10:53:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e8fe8f8-f8b0-51f8-9f9a-6cf41cb4153a with identifier: GL08454 to the API
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:35:00Z',
 'fuel_type': 'diesel',
 'id': '5e8fe8f8-f8b0-51f8-9f9a-6cf41cb4153a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL08454',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 241657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-18',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2015}
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL08454%27 HTTP/1.1" 200 None
2026-03-30 10:53:59 [auto1.de] INFO: Saving data for GL08454: {'auction_closing_time': 1774971300.0, 'created_time': 1774466954.086349, 'last_price_update_time': 1774868039.756661}
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL08454') HTTP/1.1" 204 0
2026-03-30 10:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS92150> (referer: https://www.auto1.com/v1/car-details-view/YS92150/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 335f734b-cb4d-5240-af4d-05caa25d8873 with identifier: RE58657
2026-03-30 10:53:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 335f734b-cb4d-5240-af4d-05caa25d8873 with scrape type 1
2026-03-30 10:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 335f734b-cb4d-5240-af4d-05caa25d8873
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_e77d45c2dfd3c0e3506633b2d0f4def5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_e77d45c2dfd3c0e3506633b2d0f4def5.jpg not downloaded yet
2026-03-30 10:53:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00c70592-bb99-5208-af3f-530484214779 with identifier: XP46744
2026-03-30 10:53:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00c70592-bb99-5208-af3f-530484214779 with identifier: XP46744
2026-03-30 10:53:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00c70592-bb99-5208-af3f-530484214779 with identifier: XP46744 to the API
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:28:36Z',
 'fuel_type': 'petrol',
 'id': '00c70592-bb99-5208-af3f-530484214779',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP46744',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 271974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-30',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP46744%27 HTTP/1.1" 200 None
2026-03-30 10:54:00 [auto1.de] INFO: Saving data for XP46744: {'auction_closing_time': 1774970916.0, 'created_time': 1774378298.7032, 'last_price_update_time': 1774868040.171875}
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP46744') HTTP/1.1" 204 0
2026-03-30 10:54:00 [auto1.de] INFO: Found listing with ID: NJ00528
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ00528%27 HTTP/1.1" 200 None
2026-03-30 10:54:00 [auto1.de] INFO: Scrape type for NJ00528: 2
2026-03-30 10:54:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 097e98d2-9a3e-5b50-954f-715a4d45e0d5 with identifier: NJ00528
2026-03-30 10:54:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 097e98d2-9a3e-5b50-954f-715a4d45e0d5 with scrape type 2
2026-03-30 10:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 097e98d2-9a3e-5b50-954f-715a4d45e0d5 with scrape type 2
2026-03-30 10:54:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 097e98d2-9a3e-5b50-954f-715a4d45e0d5, identifier: NJ00528
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_794d44be24e67d0eca1b273f901c4861.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_794d44be24e67d0eca1b273f901c4861.jpg not downloaded yet
2026-03-30 10:54:00 [auto1.de] INFO: Found listing with ID: MW86699
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW86699%27 HTTP/1.1" 200 None
2026-03-30 10:54:00 [auto1.de] INFO: Scrape type for MW86699: 2
2026-03-30 10:54:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c194bf1-b5f7-5967-bde6-6c2c33d26897 with identifier: MW86699
2026-03-30 10:54:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c194bf1-b5f7-5967-bde6-6c2c33d26897 with scrape type 2
2026-03-30 10:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c194bf1-b5f7-5967-bde6-6c2c33d26897 with scrape type 2
2026-03-30 10:54:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c194bf1-b5f7-5967-bde6-6c2c33d26897, identifier: MW86699
2026-03-30 10:54:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 097e98d2-9a3e-5b50-954f-715a4d45e0d5 with identifier: NJ00528
2026-03-30 10:54:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 097e98d2-9a3e-5b50-954f-715a4d45e0d5 with identifier: NJ00528
2026-03-30 10:54:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 097e98d2-9a3e-5b50-954f-715a4d45e0d5 with identifier: NJ00528 to the API
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:43:35Z',
 'fuel_type': 'petrol',
 'id': '097e98d2-9a3e-5b50-954f-715a4d45e0d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ00528',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 134094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-14',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ00528%27 HTTP/1.1" 200 None
2026-03-30 10:54:00 [auto1.de] INFO: Saving data for NJ00528: {'auction_closing_time': 1774971815.0, 'created_time': 1774379641.552146, 'last_price_update_time': 1774868040.782011}
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ00528') HTTP/1.1" 204 0
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_28fcb811266e844a60de978085f40840.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_28fcb811266e844a60de978085f40840.jpg not downloaded yet
2026-03-30 10:54:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c194bf1-b5f7-5967-bde6-6c2c33d26897 with identifier: MW86699
2026-03-30 10:54:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c194bf1-b5f7-5967-bde6-6c2c33d26897 with identifier: MW86699
2026-03-30 10:54:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c194bf1-b5f7-5967-bde6-6c2c33d26897 with identifier: MW86699 to the API
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:03:18Z',
 'fuel_type': 'petrol',
 'id': '5c194bf1-b5f7-5967-bde6-6c2c33d26897',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW86699',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Brava',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1996-09-15',
 'seller_name': None,
 'title': 'Fiat Brava 1.4 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 1996}
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW86699%27 HTTP/1.1" 200 None
2026-03-30 10:54:01 [auto1.de] INFO: Saving data for MW86699: {'auction_closing_time': 1774969398.0, 'created_time': 1774379688.104899, 'last_price_update_time': 1774868041.219997}
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW86699') HTTP/1.1" 204 0
2026-03-30 10:54:01 [auto1.de] INFO: Found listing with ID: NA02682
2026-03-30 10:54:01 [auto1.de] INFO: Found listing with ID: NM13557
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM13557%27 HTTP/1.1" 200 None
2026-03-30 10:54:01 [auto1.de] INFO: Scrape type for NM13557: 2
2026-03-30 10:54:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 933ba3db-e198-5b31-af85-d67d4ca00d61 with identifier: NM13557
2026-03-30 10:54:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 933ba3db-e198-5b31-af85-d67d4ca00d61 with scrape type 2
2026-03-30 10:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 933ba3db-e198-5b31-af85-d67d4ca00d61 with scrape type 2
2026-03-30 10:54:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 933ba3db-e198-5b31-af85-d67d4ca00d61, identifier: NM13557
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_76d9b8b3f203e8a1dd9cfc94b7fec89a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_76d9b8b3f203e8a1dd9cfc94b7fec89a.jpg not downloaded yet
2026-03-30 10:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WB89242> (referer: https://www.auto1.com/v1/car-details-view/WB89242/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:01 [auto1.de] INFO: Found listing with ID: DA44712
2026-03-30 10:54:01 [auto1.de] INFO: Found listing with ID: MT86254
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT86254%27 HTTP/1.1" 200 None
2026-03-30 10:54:01 [auto1.de] INFO: Scrape type for MT86254: 2
2026-03-30 10:54:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d1e42ee-7d8c-5414-9582-2faa3fb7c853 with identifier: MT86254
2026-03-30 10:54:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d1e42ee-7d8c-5414-9582-2faa3fb7c853 with scrape type 2
2026-03-30 10:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d1e42ee-7d8c-5414-9582-2faa3fb7c853 with scrape type 2
2026-03-30 10:54:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d1e42ee-7d8c-5414-9582-2faa3fb7c853, identifier: MT86254
2026-03-30 10:54:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 933ba3db-e198-5b31-af85-d67d4ca00d61 with identifier: NM13557
2026-03-30 10:54:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 933ba3db-e198-5b31-af85-d67d4ca00d61 with identifier: NM13557
2026-03-30 10:54:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 933ba3db-e198-5b31-af85-d67d4ca00d61 with identifier: NM13557 to the API
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:13:46Z',
 'fuel_type': 'petrol',
 'id': '933ba3db-e198-5b31-af85-d67d4ca00d61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM13557',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 106460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-09',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 150 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2006}
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM13557%27 HTTP/1.1" 200 None
2026-03-30 10:54:01 [auto1.de] INFO: Saving data for NM13557: {'auction_closing_time': 1774970026.0, 'created_time': 1773304224.448062, 'last_price_update_time': 1774868041.980695}
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM13557') HTTP/1.1" 204 0
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_fd80e20b9f5fb21eaac5a0b5575c174d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_fd80e20b9f5fb21eaac5a0b5575c174d.jpg not downloaded yet
2026-03-30 10:54:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 126d9a5c-9ab5-59ca-90d4-6cc84c968d31 with identifier: YS92150
2026-03-30 10:54:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 126d9a5c-9ab5-59ca-90d4-6cc84c968d31 with scrape type 1
2026-03-30 10:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 126d9a5c-9ab5-59ca-90d4-6cc84c968d31
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F1f%252Fb31fb8493e9197968eda94f361b630f9%252Fpa%252FYS92150_d75bfc8a572f8e85798fa89a31cf34e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_d75bfc8a572f8e85798fa89a31cf34e6.jpg already downloaded
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F1f%252Fb31fb8493e9197968eda94f361b630f9%252Fpa%252FYS92150_d97aae03b27fbf4a839656f508f4799e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_d97aae03b27fbf4a839656f508f4799e.jpg already downloaded
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F1f%252Fb31fb8493e9197968eda94f361b630f9%252Fpa%252FYS92150_81bf715fa471cefb1375ff09d0707a06.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_81bf715fa471cefb1375ff09d0707a06.jpg already downloaded
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F1f%252Fb31fb8493e9197968eda94f361b630f9%252Fpa%252FYS92150_071114d14bb3aa3aac36b3975d159156.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_071114d14bb3aa3aac36b3975d159156.jpg already downloaded
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F1f%252Fb31fb8493e9197968eda94f361b630f9%252Fpa%252FYS92150_d8712ff93b43c8db86416646c2bcdc8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_d8712ff93b43c8db86416646c2bcdc8d.jpg already downloaded
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F1f%252Fb31fb8493e9197968eda94f361b630f9%252Fpa%252FYS92150_2dad58cd092cf1e443c86ee5cdcf01ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_2dad58cd092cf1e443c86ee5cdcf01ec.jpg already downloaded
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F1f%252Fb31fb8493e9197968eda94f361b630f9%252Fpa%252FYS92150_fc947104ef3c31cbee88323ad8dd82c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_fc947104ef3c31cbee88323ad8dd82c1.jpg already downloaded
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F1f%252Fb31fb8493e9197968eda94f361b630f9%252Fpa%252FYS92150_82639bf564dd8aa8faa9747d3f77b7c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_82639bf564dd8aa8faa9747d3f77b7c8.jpg already downloaded
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F1f%252Fb31fb8493e9197968eda94f361b630f9%252Fpa%252FYS92150_9e7ad3d8e67ed72c77c423e99d3e20f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_9e7ad3d8e67ed72c77c423e99d3e20f3.jpg already downloaded
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F1f%252Fb31fb8493e9197968eda94f361b630f9%252Fpa%252FYS92150_098a86f1300ba8c4df02ae18efcc5a90.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_098a86f1300ba8c4df02ae18efcc5a90.jpg already downloaded
2026-03-30 10:54:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 126d9a5c-9ab5-59ca-90d4-6cc84c968d31, identifier: YS92150
2026-03-30 10:54:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_abcc54ae8983ff09abf3c9b6b2b28e9c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d1e42ee-7d8c-5414-9582-2faa3fb7c853 with identifier: MT86254
2026-03-30 10:54:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d1e42ee-7d8c-5414-9582-2faa3fb7c853 with identifier: MT86254
2026-03-30 10:54:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d1e42ee-7d8c-5414-9582-2faa3fb7c853 with identifier: MT86254 to the API
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:55:31Z',
 'fuel_type': 'petrol',
 'id': '9d1e42ee-7d8c-5414-9582-2faa3fb7c853',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT86254',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 166607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-06',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250 4Matic AMG',
 'transmission': 'automatic',
 'trim': '4Matic AMG',
 'year': 2017}
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT86254%27 HTTP/1.1" 200 None
2026-03-30 10:54:02 [auto1.de] INFO: Saving data for MT86254: {'auction_closing_time': 1774972531.0, 'created_time': 1773304482.781775, 'last_price_update_time': 1774868042.886509}
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT86254') HTTP/1.1" 204 0
2026-03-30 10:54:02 [auto1.de] INFO: Found listing with ID: AZ21199
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ21199%27 HTTP/1.1" 200 None
2026-03-30 10:54:02 [auto1.de] INFO: Scrape type for AZ21199: 2
2026-03-30 10:54:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c291e52-a49f-5ceb-b196-9e8066fcba31 with identifier: AZ21199
2026-03-30 10:54:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c291e52-a49f-5ceb-b196-9e8066fcba31 with scrape type 2
2026-03-30 10:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c291e52-a49f-5ceb-b196-9e8066fcba31 with scrape type 2
2026-03-30 10:54:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c291e52-a49f-5ceb-b196-9e8066fcba31, identifier: AZ21199
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_d85ca818fae864fb5f5f8333e25893b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_d85ca818fae864fb5f5f8333e25893b2.jpg not downloaded yet
2026-03-30 10:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW36019/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 126d9a5c-9ab5-59ca-90d4-6cc84c968d31 with identifier: YS92150
2026-03-30 10:54:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 126d9a5c-9ab5-59ca-90d4-6cc84c968d31 with identifier: YS92150
2026-03-30 10:54:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 126d9a5c-9ab5-59ca-90d4-6cc84c968d31 with identifier: YS92150 to the API
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YS92150>
{'auction_title': '',
 'c_o_2_emission_value': 210,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 235,
 'expiration_date': '2026-03-31T15:46:57Z',
 'fuel_type': 'diesel',
 'id': '126d9a5c-9ab5-59ca-90d4-6cc84c968d31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS92150',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 123129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_d75bfc8a572f8e85798fa89a31cf34e6.jpg',
                'https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_d97aae03b27fbf4a839656f508f4799e.jpg',
                'https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_81bf715fa471cefb1375ff09d0707a06.jpg',
                'https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_071114d14bb3aa3aac36b3975d159156.jpg',
                'https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_d8712ff93b43c8db86416646c2bcdc8d.jpg',
                'https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_2dad58cd092cf1e443c86ee5cdcf01ec.jpg',
                'https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_fc947104ef3c31cbee88323ad8dd82c1.jpg',
                'https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_82639bf564dd8aa8faa9747d3f77b7c8.jpg',
                'https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_9e7ad3d8e67ed72c77c423e99d3e20f3.jpg',
                'https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_098a86f1300ba8c4df02ae18efcc5a90.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126d9a5c-9ab5-59ca-90d4-6cc84c968d31/126d9a5c-9ab5-59ca-90d4-6cc84c968d31_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_d75bfc8a572f8e85798fa89a31cf34e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126d9a5c-9ab5-59ca-90d4-6cc84c968d31/126d9a5c-9ab5-59ca-90d4-6cc84c968d31_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3114272,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_d97aae03b27fbf4a839656f508f4799e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126d9a5c-9ab5-59ca-90d4-6cc84c968d31/126d9a5c-9ab5-59ca-90d4-6cc84c968d31_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3127686,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_81bf715fa471cefb1375ff09d0707a06.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126d9a5c-9ab5-59ca-90d4-6cc84c968d31/126d9a5c-9ab5-59ca-90d4-6cc84c968d31_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_071114d14bb3aa3aac36b3975d159156.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126d9a5c-9ab5-59ca-90d4-6cc84c968d31/126d9a5c-9ab5-59ca-90d4-6cc84c968d31_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3030830,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_d8712ff93b43c8db86416646c2bcdc8d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126d9a5c-9ab5-59ca-90d4-6cc84c968d31/126d9a5c-9ab5-59ca-90d4-6cc84c968d31_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_2dad58cd092cf1e443c86ee5cdcf01ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126d9a5c-9ab5-59ca-90d4-6cc84c968d31/126d9a5c-9ab5-59ca-90d4-6cc84c968d31_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_fc947104ef3c31cbee88323ad8dd82c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126d9a5c-9ab5-59ca-90d4-6cc84c968d31/126d9a5c-9ab5-59ca-90d4-6cc84c968d31_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_82639bf564dd8aa8faa9747d3f77b7c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126d9a5c-9ab5-59ca-90d4-6cc84c968d31/126d9a5c-9ab5-59ca-90d4-6cc84c968d31_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2937918,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_9e7ad3d8e67ed72c77c423e99d3e20f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126d9a5c-9ab5-59ca-90d4-6cc84c968d31/126d9a5c-9ab5-59ca-90d4-6cc84c968d31_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/1f/b31fb8493e9197968eda94f361b630f9/pa/YS92150_098a86f1300ba8c4df02ae18efcc5a90.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC90 2.0 D5 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2018}
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS92150%27 HTTP/1.1" 200 None
2026-03-30 10:54:03 [auto1.de] INFO: Saving data for YS92150: {'created_time': 1774868043.528576, 'last_price_update_time': 1774868043.528589, 'auction_closing_time': 1774972017.0}
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS92150') HTTP/1.1" 204 0
2026-03-30 10:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_037182e911010f90e4078066886d54a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:03 [auto1.de] INFO: Found listing with ID: UH34281
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH34281%27 HTTP/1.1" 200 None
2026-03-30 10:54:03 [auto1.de] INFO: Scrape type for UH34281: 2
2026-03-30 10:54:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1da6558-16d2-54a9-b080-6b374b459487 with identifier: UH34281
2026-03-30 10:54:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1da6558-16d2-54a9-b080-6b374b459487 with scrape type 2
2026-03-30 10:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1da6558-16d2-54a9-b080-6b374b459487 with scrape type 2
2026-03-30 10:54:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1da6558-16d2-54a9-b080-6b374b459487, identifier: UH34281
2026-03-30 10:54:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c291e52-a49f-5ceb-b196-9e8066fcba31 with identifier: AZ21199
2026-03-30 10:54:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c291e52-a49f-5ceb-b196-9e8066fcba31 with identifier: AZ21199
2026-03-30 10:54:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c291e52-a49f-5ceb-b196-9e8066fcba31 with identifier: AZ21199 to the API
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:57:49Z',
 'fuel_type': 'petrol',
 'id': '2c291e52-a49f-5ceb-b196-9e8066fcba31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ21199',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 50225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-18',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 T Exclusive',
 'transmission': 'automatic',
 'trim': 'T Exclusive',
 'year': 2018}
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ21199%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [auto1.de] INFO: Saving data for AZ21199: {'auction_closing_time': 1774972669.0, 'created_time': 1773686124.02904, 'last_price_update_time': 1774868044.043818}
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ21199') HTTP/1.1" 204 0
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_810ee657ed76a3a6199bc904c0eda2e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_810ee657ed76a3a6199bc904c0eda2e6.jpg not downloaded yet
2026-03-30 10:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_e77d45c2dfd3c0e3506633b2d0f4def5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1da6558-16d2-54a9-b080-6b374b459487 with identifier: UH34281
2026-03-30 10:54:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1da6558-16d2-54a9-b080-6b374b459487 with identifier: UH34281
2026-03-30 10:54:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1da6558-16d2-54a9-b080-6b374b459487 with identifier: UH34281 to the API
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-31T15:56:36Z',
 'fuel_type': 'diesel',
 'id': 'a1da6558-16d2-54a9-b080-6b374b459487',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH34281',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 290016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-17',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH34281%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [auto1.de] INFO: Saving data for UH34281: {'auction_closing_time': 1774972596.0, 'created_time': 1773811823.548891, 'last_price_update_time': 1774868044.406836}
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH34281') HTTP/1.1" 204 0
2026-03-30 10:54:04 [auto1.de] INFO: Found listing with ID: TA68581
2026-03-30 10:54:04 [auto1.de] INFO: Found listing with ID: XL72684
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL72684%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [auto1.de] INFO: Scrape type for XL72684: 2
2026-03-30 10:54:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08998606-7749-5b6f-92cf-0e62c86d7053 with identifier: XL72684
2026-03-30 10:54:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08998606-7749-5b6f-92cf-0e62c86d7053 with scrape type 2
2026-03-30 10:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08998606-7749-5b6f-92cf-0e62c86d7053 with scrape type 2
2026-03-30 10:54:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08998606-7749-5b6f-92cf-0e62c86d7053, identifier: XL72684
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_8ff802f14a5a85c44ec79ea9794029a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_8ff802f14a5a85c44ec79ea9794029a0.jpg not downloaded yet
2026-03-30 10:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA73332> (referer: https://www.auto1.com/v1/car-details-view/DA73332/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4251811d-4fbb-5258-bf89-163b5f98834a with identifier: WB89242
2026-03-30 10:54:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4251811d-4fbb-5258-bf89-163b5f98834a with scrape type 1
2026-03-30 10:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4251811d-4fbb-5258-bf89-163b5f98834a
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fd1%252F12d12f46de9b8caacd8bc33876438661%252Fpa%252FWB89242_05a63ffbfd01c1358a189fcb1029a22a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_05a63ffbfd01c1358a189fcb1029a22a.jpg already downloaded
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fd1%252F12d12f46de9b8caacd8bc33876438661%252Fpa%252FWB89242_55b1f33c172b8789eb0df3b20cd189a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_55b1f33c172b8789eb0df3b20cd189a6.jpg already downloaded
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fd1%252F12d12f46de9b8caacd8bc33876438661%252Fpa%252FWB89242_0030d72ac290c00e62f08bc9104325ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_0030d72ac290c00e62f08bc9104325ea.jpg already downloaded
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fd1%252F12d12f46de9b8caacd8bc33876438661%252Fpa%252FWB89242_2ca0ba2da6d3e9a47629c96f834acc1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_2ca0ba2da6d3e9a47629c96f834acc1b.jpg already downloaded
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fd1%252F12d12f46de9b8caacd8bc33876438661%252Fpa%252FWB89242_dafebdc4fef786a40c0e55f5a66120c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_dafebdc4fef786a40c0e55f5a66120c2.jpg already downloaded
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fd1%252F12d12f46de9b8caacd8bc33876438661%252Fpa%252FWB89242_92bb1f843f67a748f59b77449b2f4584.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_92bb1f843f67a748f59b77449b2f4584.jpg already downloaded
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fd1%252F12d12f46de9b8caacd8bc33876438661%252Fpa%252FWB89242_023c0f9f2764b7eb697cf26cee8e8d0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_023c0f9f2764b7eb697cf26cee8e8d0a.jpg already downloaded
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fd1%252F12d12f46de9b8caacd8bc33876438661%252Fpa%252FWB89242_34896ac9096de02b3a616e16b98dcd15.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_34896ac9096de02b3a616e16b98dcd15.jpg already downloaded
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fd1%252F12d12f46de9b8caacd8bc33876438661%252Fpa%252FWB89242_649d716d0f5ee4a7a1f2ea1cfb91ba94.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_649d716d0f5ee4a7a1f2ea1cfb91ba94.jpg already downloaded
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fd1%252F12d12f46de9b8caacd8bc33876438661%252Fpa%252FWB89242_d56c2ef23e9ec8cb365e140715855d23.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_d56c2ef23e9ec8cb365e140715855d23.jpg already downloaded
2026-03-30 10:54:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4251811d-4fbb-5258-bf89-163b5f98834a, identifier: WB89242
2026-03-30 10:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_28fcb811266e844a60de978085f40840.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_794d44be24e67d0eca1b273f901c4861.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:04 [scrapy.extensions.logstats] INFO: Crawled 771 pages (at 31 pages/min), scraped 867 items (at 106 items/min)
2026-03-30 10:54:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:54:04 [auto1.de] INFO: Found listing with ID: YY27100
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY27100%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [auto1.de] INFO: Scrape type for YY27100: 2
2026-03-30 10:54:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eb63017-b9e6-5e74-b64f-46e048d9e221 with identifier: YY27100
2026-03-30 10:54:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eb63017-b9e6-5e74-b64f-46e048d9e221 with scrape type 2
2026-03-30 10:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eb63017-b9e6-5e74-b64f-46e048d9e221 with scrape type 2
2026-03-30 10:54:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6eb63017-b9e6-5e74-b64f-46e048d9e221, identifier: YY27100
2026-03-30 10:54:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08998606-7749-5b6f-92cf-0e62c86d7053 with identifier: XL72684
2026-03-30 10:54:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08998606-7749-5b6f-92cf-0e62c86d7053 with identifier: XL72684
2026-03-30 10:54:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08998606-7749-5b6f-92cf-0e62c86d7053 with identifier: XL72684 to the API
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:06:27Z',
 'fuel_type': 'petrol',
 'id': '08998606-7749-5b6f-92cf-0e62c86d7053',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL72684',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 57724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-27',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL72684%27 HTTP/1.1" 200 None
2026-03-30 10:54:05 [auto1.de] INFO: Saving data for XL72684: {'auction_closing_time': 1774969587.0, 'created_time': 1773427157.500397, 'last_price_update_time': 1774868045.42525}
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL72684') HTTP/1.1" 204 0
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_745000c76a9b33d2cee852b4aa10fb1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_745000c76a9b33d2cee852b4aa10fb1f.jpg not downloaded yet
2026-03-30 10:54:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4251811d-4fbb-5258-bf89-163b5f98834a with identifier: WB89242
2026-03-30 10:54:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4251811d-4fbb-5258-bf89-163b5f98834a with identifier: WB89242
2026-03-30 10:54:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4251811d-4fbb-5258-bf89-163b5f98834a with identifier: WB89242 to the API
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WB89242>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:14:02Z',
 'fuel_type': 'petrol',
 'id': '4251811d-4fbb-5258-bf89-163b5f98834a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB89242',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 102840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_05a63ffbfd01c1358a189fcb1029a22a.jpg',
                'https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_55b1f33c172b8789eb0df3b20cd189a6.jpg',
                'https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_0030d72ac290c00e62f08bc9104325ea.jpg',
                'https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_2ca0ba2da6d3e9a47629c96f834acc1b.jpg',
                'https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_dafebdc4fef786a40c0e55f5a66120c2.jpg',
                'https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_92bb1f843f67a748f59b77449b2f4584.jpg',
                'https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_023c0f9f2764b7eb697cf26cee8e8d0a.jpg',
                'https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_34896ac9096de02b3a616e16b98dcd15.jpg',
                'https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_649d716d0f5ee4a7a1f2ea1cfb91ba94.jpg',
                'https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_d56c2ef23e9ec8cb365e140715855d23.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251811d-4fbb-5258-bf89-163b5f98834a/4251811d-4fbb-5258-bf89-163b5f98834a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_05a63ffbfd01c1358a189fcb1029a22a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251811d-4fbb-5258-bf89-163b5f98834a/4251811d-4fbb-5258-bf89-163b5f98834a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_55b1f33c172b8789eb0df3b20cd189a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251811d-4fbb-5258-bf89-163b5f98834a/4251811d-4fbb-5258-bf89-163b5f98834a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_0030d72ac290c00e62f08bc9104325ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251811d-4fbb-5258-bf89-163b5f98834a/4251811d-4fbb-5258-bf89-163b5f98834a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2822711,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_2ca0ba2da6d3e9a47629c96f834acc1b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251811d-4fbb-5258-bf89-163b5f98834a/4251811d-4fbb-5258-bf89-163b5f98834a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_dafebdc4fef786a40c0e55f5a66120c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251811d-4fbb-5258-bf89-163b5f98834a/4251811d-4fbb-5258-bf89-163b5f98834a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_92bb1f843f67a748f59b77449b2f4584.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251811d-4fbb-5258-bf89-163b5f98834a/4251811d-4fbb-5258-bf89-163b5f98834a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2837878,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_023c0f9f2764b7eb697cf26cee8e8d0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251811d-4fbb-5258-bf89-163b5f98834a/4251811d-4fbb-5258-bf89-163b5f98834a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3011722,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_34896ac9096de02b3a616e16b98dcd15.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251811d-4fbb-5258-bf89-163b5f98834a/4251811d-4fbb-5258-bf89-163b5f98834a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_649d716d0f5ee4a7a1f2ea1cfb91ba94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251811d-4fbb-5258-bf89-163b5f98834a/4251811d-4fbb-5258-bf89-163b5f98834a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/d1/12d12f46de9b8caacd8bc33876438661/pa/WB89242_d56c2ef23e9ec8cb365e140715855d23.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Yeti 1.2 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2011}
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB89242%27 HTTP/1.1" 200 None
2026-03-30 10:54:05 [auto1.de] INFO: Saving data for WB89242: {'created_time': 1774868045.808529, 'last_price_update_time': 1774868045.80854, 'auction_closing_time': 1774970042.0}
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB89242') HTTP/1.1" 204 0
2026-03-30 10:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41ff650>
2026-03-30 10:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_abcc54ae8983ff09abf3c9b6b2b28e9c.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_abcc54ae8983ff09abf3c9b6b2b28e9c.jpg saved to cache
2026-03-30 10:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e1809b1-19ca-5719-bde1-98be240fe3bf
2026-03-30 10:54:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6eb63017-b9e6-5e74-b64f-46e048d9e221 with identifier: YY27100
2026-03-30 10:54:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6eb63017-b9e6-5e74-b64f-46e048d9e221 with identifier: YY27100
2026-03-30 10:54:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6eb63017-b9e6-5e74-b64f-46e048d9e221 with identifier: YY27100 to the API
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:14:49Z',
 'fuel_type': 'petrol',
 'id': '6eb63017-b9e6-5e74-b64f-46e048d9e221',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY27100',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 114110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-31',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 TGDI GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2019}
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY27100%27 HTTP/1.1" 200 None
2026-03-30 10:54:06 [auto1.de] INFO: Saving data for YY27100: {'auction_closing_time': 1774970089.0, 'created_time': 1774435184.550795, 'last_price_update_time': 1774868046.212788}
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY27100') HTTP/1.1" 204 0
2026-03-30 10:54:06 [auto1.de] INFO: Found listing with ID: VZ54866
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ54866%27 HTTP/1.1" 200 None
2026-03-30 10:54:06 [auto1.de] INFO: Scrape type for VZ54866: 2
2026-03-30 10:54:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd54febd-bd19-5a83-92ca-5ebbdb889029 with identifier: VZ54866
2026-03-30 10:54:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd54febd-bd19-5a83-92ca-5ebbdb889029 with scrape type 2
2026-03-30 10:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd54febd-bd19-5a83-92ca-5ebbdb889029 with scrape type 2
2026-03-30 10:54:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd54febd-bd19-5a83-92ca-5ebbdb889029, identifier: VZ54866
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_c3a39524a76f488ba0ac0c611db234ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_c3a39524a76f488ba0ac0c611db234ff.jpg not downloaded yet
2026-03-30 10:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3e0350>
2026-03-30 10:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_037182e911010f90e4078066886d54a3.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_037182e911010f90e4078066886d54a3.jpg saved to cache
2026-03-30 10:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3e1809b1-19ca-5719-bde1-98be240fe3bf
2026-03-30 10:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_76d9b8b3f203e8a1dd9cfc94b7fec89a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:06 [auto1.de] INFO: Found listing with ID: HF82525
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF82525%27 HTTP/1.1" 200 None
2026-03-30 10:54:06 [auto1.de] INFO: Scrape type for HF82525: 2
2026-03-30 10:54:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b05a34b3-1d14-5861-b9f3-1470fabb9ff1 with identifier: HF82525
2026-03-30 10:54:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b05a34b3-1d14-5861-b9f3-1470fabb9ff1 with scrape type 2
2026-03-30 10:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b05a34b3-1d14-5861-b9f3-1470fabb9ff1 with scrape type 2
2026-03-30 10:54:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b05a34b3-1d14-5861-b9f3-1470fabb9ff1, identifier: HF82525
2026-03-30 10:54:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd54febd-bd19-5a83-92ca-5ebbdb889029 with identifier: VZ54866
2026-03-30 10:54:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd54febd-bd19-5a83-92ca-5ebbdb889029 with identifier: VZ54866
2026-03-30 10:54:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd54febd-bd19-5a83-92ca-5ebbdb889029 with identifier: VZ54866 to the API
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-31T15:18:01Z',
 'fuel_type': 'diesel',
 'id': 'cd54febd-bd19-5a83-92ca-5ebbdb889029',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ54866',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 180956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-21',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2015}
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ54866%27 HTTP/1.1" 200 None
2026-03-30 10:54:06 [auto1.de] INFO: Saving data for VZ54866: {'auction_closing_time': 1774970281.0, 'created_time': 1773345920.77422, 'last_price_update_time': 1774868046.877714}
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ54866') HTTP/1.1" 204 0
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_ef73750063736b63c5ddaafb2a53ef4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_ef73750063736b63c5ddaafb2a53ef4b.jpg not downloaded yet
2026-03-30 10:54:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef86290>
2026-03-30 10:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_e77d45c2dfd3c0e3506633b2d0f4def5.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_e77d45c2dfd3c0e3506633b2d0f4def5.jpg saved to cache
2026-03-30 10:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 335f734b-cb4d-5240-af4d-05caa25d8873
2026-03-30 10:54:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e with identifier: DA73332
2026-03-30 10:54:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e with scrape type 1
2026-03-30 10:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_b4d18db5c118ed799db315fe4c8413a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_b4d18db5c118ed799db315fe4c8413a1.jpg not downloaded yet
2026-03-30 10:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_fd80e20b9f5fb21eaac5a0b5575c174d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b05a34b3-1d14-5861-b9f3-1470fabb9ff1 with identifier: HF82525
2026-03-30 10:54:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b05a34b3-1d14-5861-b9f3-1470fabb9ff1 with identifier: HF82525
2026-03-30 10:54:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b05a34b3-1d14-5861-b9f3-1470fabb9ff1 with identifier: HF82525 to the API
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:48:17Z',
 'fuel_type': 'diesel',
 'id': 'b05a34b3-1d14-5861-b9f3-1470fabb9ff1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF82525',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 209250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-17',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF82525%27 HTTP/1.1" 200 None
2026-03-30 10:54:07 [auto1.de] INFO: Saving data for HF82525: {'auction_closing_time': 1774972097.0, 'created_time': 1773467329.235129, 'last_price_update_time': 1774868047.352228}
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF82525') HTTP/1.1" 204 0
2026-03-30 10:54:07 [auto1.de] INFO: Found listing with ID: TH25711
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH25711%27 HTTP/1.1" 200 None
2026-03-30 10:54:07 [auto1.de] INFO: Scrape type for TH25711: 2
2026-03-30 10:54:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42997fde-d984-5ca5-88c4-64e56a41d913 with identifier: TH25711
2026-03-30 10:54:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42997fde-d984-5ca5-88c4-64e56a41d913 with scrape type 2
2026-03-30 10:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42997fde-d984-5ca5-88c4-64e56a41d913 with scrape type 2
2026-03-30 10:54:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42997fde-d984-5ca5-88c4-64e56a41d913, identifier: TH25711
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_48301fc56c6e9dbeaaa9b2d98be27667.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_48301fc56c6e9dbeaaa9b2d98be27667.jpg not downloaded yet
2026-03-30 10:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT69845/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41f0350>
2026-03-30 10:54:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_28fcb811266e844a60de978085f40840.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_28fcb811266e844a60de978085f40840.jpg saved to cache
2026-03-30 10:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 335f734b-cb4d-5240-af4d-05caa25d8873
2026-03-30 10:54:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef52810>
2026-03-30 10:54:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_794d44be24e67d0eca1b273f901c4861.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_794d44be24e67d0eca1b273f901c4861.jpg saved to cache
2026-03-30 10:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3e1809b1-19ca-5719-bde1-98be240fe3bf
2026-03-30 10:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_810ee657ed76a3a6199bc904c0eda2e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_d85ca818fae864fb5f5f8333e25893b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:07 [auto1.de] INFO: Found listing with ID: DN72747
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN72747%27 HTTP/1.1" 200 None
2026-03-30 10:54:07 [auto1.de] INFO: Scrape type for DN72747: 2
2026-03-30 10:54:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72c698cc-e6fb-5a2e-8a0f-9fc99033eff6 with identifier: DN72747
2026-03-30 10:54:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72c698cc-e6fb-5a2e-8a0f-9fc99033eff6 with scrape type 2
2026-03-30 10:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72c698cc-e6fb-5a2e-8a0f-9fc99033eff6 with scrape type 2
2026-03-30 10:54:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72c698cc-e6fb-5a2e-8a0f-9fc99033eff6, identifier: DN72747
2026-03-30 10:54:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42997fde-d984-5ca5-88c4-64e56a41d913 with identifier: TH25711
2026-03-30 10:54:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42997fde-d984-5ca5-88c4-64e56a41d913 with identifier: TH25711
2026-03-30 10:54:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42997fde-d984-5ca5-88c4-64e56a41d913 with identifier: TH25711 to the API
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:14:31Z',
 'fuel_type': 'petrol',
 'id': '42997fde-d984-5ca5-88c4-64e56a41d913',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH25711',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 181101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-29',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH25711%27 HTTP/1.1" 200 None
2026-03-30 10:54:08 [auto1.de] INFO: Saving data for TH25711: {'auction_closing_time': 1774970071.0, 'created_time': 1774435865.407096, 'last_price_update_time': 1774868048.198027}
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH25711') HTTP/1.1" 204 0
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_2275602dd573bbe682dd44fd4f59c704.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_2275602dd573bbe682dd44fd4f59c704.jpg not downloaded yet
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_bbd1e230630641876462c046c2ff25e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_bbd1e230630641876462c046c2ff25e7.jpg not downloaded yet
2026-03-30 10:54:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72c698cc-e6fb-5a2e-8a0f-9fc99033eff6 with identifier: DN72747
2026-03-30 10:54:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72c698cc-e6fb-5a2e-8a0f-9fc99033eff6 with identifier: DN72747
2026-03-30 10:54:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72c698cc-e6fb-5a2e-8a0f-9fc99033eff6 with identifier: DN72747 to the API
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:58:05Z',
 'fuel_type': 'petrol',
 'id': '72c698cc-e6fb-5a2e-8a0f-9fc99033eff6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN72747',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 41264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-30',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN72747%27 HTTP/1.1" 200 None
2026-03-30 10:54:08 [auto1.de] INFO: Saving data for DN72747: {'auction_closing_time': 1774972685.0, 'created_time': 1773400023.799322, 'last_price_update_time': 1774868048.612131}
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN72747') HTTP/1.1" 204 0
2026-03-30 10:54:08 [auto1.de] INFO: Found listing with ID: MW50067
2026-03-30 10:54:08 [auto1.de] INFO: Found listing with ID: SA11397
2026-03-30 10:54:08 [auto1.de] INFO: Found listing with ID: PJ34176
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34176%27 HTTP/1.1" 200 None
2026-03-30 10:54:08 [auto1.de] INFO: Scrape type for PJ34176: 2
2026-03-30 10:54:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a74c57c-74b0-5049-b731-395f84e6ac0d with identifier: PJ34176
2026-03-30 10:54:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a74c57c-74b0-5049-b731-395f84e6ac0d with scrape type 2
2026-03-30 10:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a74c57c-74b0-5049-b731-395f84e6ac0d with scrape type 2
2026-03-30 10:54:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a74c57c-74b0-5049-b731-395f84e6ac0d, identifier: PJ34176
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_571baea77f4f38786c4fbbf3fb1cd252.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_571baea77f4f38786c4fbbf3fb1cd252.jpg not downloaded yet
2026-03-30 10:54:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f621af90>
2026-03-30 10:54:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_76d9b8b3f203e8a1dd9cfc94b7fec89a.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_76d9b8b3f203e8a1dd9cfc94b7fec89a.jpg saved to cache
2026-03-30 10:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3e1809b1-19ca-5719-bde1-98be240fe3bf
2026-03-30 10:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_8ff802f14a5a85c44ec79ea9794029a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:08 [auto1.de] INFO: Found listing with ID: LU37598
2026-03-30 10:54:08 [auto1.de] INFO: Found listing with ID: PX72797
2026-03-30 10:54:08 [auto1.de] INFO: Found listing with ID: UT71403
2026-03-30 10:54:08 [auto1.de] INFO: Found listing with ID: FB21783
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB21783%27 HTTP/1.1" 200 None
2026-03-30 10:54:08 [auto1.de] INFO: Scrape type for FB21783: 2
2026-03-30 10:54:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2f4aff5-7350-57bf-9067-ac06612f441b with identifier: FB21783
2026-03-30 10:54:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2f4aff5-7350-57bf-9067-ac06612f441b with scrape type 2
2026-03-30 10:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2f4aff5-7350-57bf-9067-ac06612f441b with scrape type 2
2026-03-30 10:54:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2f4aff5-7350-57bf-9067-ac06612f441b, identifier: FB21783
2026-03-30 10:54:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a74c57c-74b0-5049-b731-395f84e6ac0d with identifier: PJ34176
2026-03-30 10:54:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a74c57c-74b0-5049-b731-395f84e6ac0d with identifier: PJ34176
2026-03-30 10:54:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a74c57c-74b0-5049-b731-395f84e6ac0d with identifier: PJ34176 to the API
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:47:05Z',
 'fuel_type': 'diesel',
 'id': '0a74c57c-74b0-5049-b731-395f84e6ac0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ34176',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 189382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-29',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Standard',
 'transmission': 'automatic',
 'trim': 'Standard',
 'year': 2009}
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34176%27 HTTP/1.1" 200 None
2026-03-30 10:54:09 [auto1.de] INFO: Saving data for PJ34176: {'auction_closing_time': 1774972025.0, 'created_time': 1774434936.254883, 'last_price_update_time': 1774868049.370967}
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ34176') HTTP/1.1" 204 0
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_d90159d8a25e05b3f148f330d4460dee.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_d90159d8a25e05b3f148f330d4460dee.jpg not downloaded yet
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_67557e729e162290401bbe921277cc92.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_67557e729e162290401bbe921277cc92.jpg not downloaded yet
2026-03-30 10:54:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefef650>
2026-03-30 10:54:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_fd80e20b9f5fb21eaac5a0b5575c174d.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_fd80e20b9f5fb21eaac5a0b5575c174d.jpg saved to cache
2026-03-30 10:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 335f734b-cb4d-5240-af4d-05caa25d8873
2026-03-30 10:54:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_745000c76a9b33d2cee852b4aa10fb1f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2f4aff5-7350-57bf-9067-ac06612f441b with identifier: FB21783
2026-03-30 10:54:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2f4aff5-7350-57bf-9067-ac06612f441b with identifier: FB21783
2026-03-30 10:54:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2f4aff5-7350-57bf-9067-ac06612f441b with identifier: FB21783 to the API
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:15:48Z',
 'fuel_type': 'petrol',
 'id': 'b2f4aff5-7350-57bf-9067-ac06612f441b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB21783',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 66857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-08-18',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2024}
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB21783%27 HTTP/1.1" 200 None
2026-03-30 10:54:09 [auto1.de] INFO: Saving data for FB21783: {'auction_closing_time': 1774970148.0, 'created_time': 1774377072.343597, 'last_price_update_time': 1774868049.894006}
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB21783') HTTP/1.1" 204 0
2026-03-30 10:54:09 [auto1.de] INFO: Found listing with ID: UE09477
2026-03-30 10:54:09 [auto1.de] INFO: Found listing with ID: BU78099
2026-03-30 10:54:09 [auto1.de] INFO: Found listing with ID: NA02612
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA02612%27 HTTP/1.1" 200 None
2026-03-30 10:54:09 [auto1.de] INFO: Scrape type for NA02612: 1
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_2b151241bc40acf430417d57f6dfbbfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_2b151241bc40acf430417d57f6dfbbfc.jpg not downloaded yet
2026-03-30 10:54:09 [auto1.de] INFO: Channel: 24h | Page: 49 | totalHits: 9521 | hits on page: 40
2026-03-30 10:54:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4222510>
2026-03-30 10:54:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_810ee657ed76a3a6199bc904c0eda2e6.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_810ee657ed76a3a6199bc904c0eda2e6.jpg saved to cache
2026-03-30 10:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 335f734b-cb4d-5240-af4d-05caa25d8873
2026-03-30 10:54:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4291910>
2026-03-30 10:54:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_d85ca818fae864fb5f5f8333e25893b2.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_d85ca818fae864fb5f5f8333e25893b2.jpg saved to cache
2026-03-30 10:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3e1809b1-19ca-5719-bde1-98be240fe3bf
2026-03-30 10:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_c3a39524a76f488ba0ac0c611db234ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: XS36937
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: FR24268
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_63c861d4f972e966a37066836eb6ecb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_63c861d4f972e966a37066836eb6ecb6.jpg not downloaded yet
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_fcfe413720b13ebf2c3f015e82391de7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_fcfe413720b13ebf2c3f015e82391de7.jpg not downloaded yet
2026-03-30 10:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_b4d18db5c118ed799db315fe4c8413a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_ef73750063736b63c5ddaafb2a53ef4b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: SL68511
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: LD55315
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD55315%27 HTTP/1.1" 200 None
2026-03-30 10:54:10 [auto1.de] INFO: Scrape type for LD55315: 2
2026-03-30 10:54:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 572d4468-e213-5fbc-8e17-12d59cc1f1eb with identifier: LD55315
2026-03-30 10:54:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 572d4468-e213-5fbc-8e17-12d59cc1f1eb with scrape type 2
2026-03-30 10:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 572d4468-e213-5fbc-8e17-12d59cc1f1eb with scrape type 2
2026-03-30 10:54:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 572d4468-e213-5fbc-8e17-12d59cc1f1eb, identifier: LD55315
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: WM67864
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM67864%27 HTTP/1.1" 200 None
2026-03-30 10:54:10 [auto1.de] INFO: Scrape type for WM67864: 1
2026-03-30 10:54:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f420cc90>
2026-03-30 10:54:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_8ff802f14a5a85c44ec79ea9794029a0.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_8ff802f14a5a85c44ec79ea9794029a0.jpg saved to cache
2026-03-30 10:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3e1809b1-19ca-5719-bde1-98be240fe3bf
2026-03-30 10:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_2275602dd573bbe682dd44fd4f59c704.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_48301fc56c6e9dbeaaa9b2d98be27667.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 572d4468-e213-5fbc-8e17-12d59cc1f1eb with identifier: LD55315
2026-03-30 10:54:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 572d4468-e213-5fbc-8e17-12d59cc1f1eb with identifier: LD55315
2026-03-30 10:54:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 572d4468-e213-5fbc-8e17-12d59cc1f1eb with identifier: LD55315 to the API
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 420,
 'expiration_date': '2026-03-31T15:08:49Z',
 'fuel_type': 'petrol',
 'id': '572d4468-e213-5fbc-8e17-12d59cc1f1eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD55315',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 162335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-27',
 'seller_name': None,
 'title': 'Porsche Cayenne S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD55315%27 HTTP/1.1" 200 None
2026-03-30 10:54:10 [auto1.de] INFO: Saving data for LD55315: {'auction_closing_time': 1774969729.0, 'created_time': 1773775781.682164, 'last_price_update_time': 1774868050.593384}
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD55315') HTTP/1.1" 204 0
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_2435deadb360271583744d6636114262.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_2435deadb360271583744d6636114262.jpg not downloaded yet
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_4ffcc61cc43244824187328ab3f6b103.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_4ffcc61cc43244824187328ab3f6b103.jpg not downloaded yet
2026-03-30 10:54:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f434d850>
2026-03-30 10:54:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_745000c76a9b33d2cee852b4aa10fb1f.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_745000c76a9b33d2cee852b4aa10fb1f.jpg saved to cache
2026-03-30 10:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 335f734b-cb4d-5240-af4d-05caa25d8873
2026-03-30 10:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_bbd1e230630641876462c046c2ff25e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: SF57435
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF57435%27 HTTP/1.1" 200 None
2026-03-30 10:54:10 [auto1.de] INFO: Scrape type for SF57435: 2
2026-03-30 10:54:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d84a18ef-8f08-5782-b325-608d165633d5 with identifier: SF57435
2026-03-30 10:54:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d84a18ef-8f08-5782-b325-608d165633d5 with scrape type 2
2026-03-30 10:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d84a18ef-8f08-5782-b325-608d165633d5 with scrape type 2
2026-03-30 10:54:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d84a18ef-8f08-5782-b325-608d165633d5, identifier: SF57435
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: PG06086
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: CG60356
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: UP12847
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP12847%27 HTTP/1.1" 200 None
2026-03-30 10:54:10 [auto1.de] INFO: Scrape type for UP12847: 2
2026-03-30 10:54:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74a46640-acf2-5891-a890-707658421d4e with identifier: UP12847
2026-03-30 10:54:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74a46640-acf2-5891-a890-707658421d4e with scrape type 2
2026-03-30 10:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74a46640-acf2-5891-a890-707658421d4e with scrape type 2
2026-03-30 10:54:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74a46640-acf2-5891-a890-707658421d4e, identifier: UP12847
2026-03-30 10:54:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_571baea77f4f38786c4fbbf3fb1cd252.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d84a18ef-8f08-5782-b325-608d165633d5 with identifier: SF57435
2026-03-30 10:54:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d84a18ef-8f08-5782-b325-608d165633d5 with identifier: SF57435
2026-03-30 10:54:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d84a18ef-8f08-5782-b325-608d165633d5 with identifier: SF57435 to the API
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:17:35Z',
 'fuel_type': 'diesel',
 'id': 'd84a18ef-8f08-5782-b325-608d165633d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF57435',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 188392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-31',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF57435%27 HTTP/1.1" 200 None
2026-03-30 10:54:11 [auto1.de] INFO: Saving data for SF57435: {'auction_closing_time': 1774970255.0, 'created_time': 1773945763.891004, 'last_price_update_time': 1774868051.377697}
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF57435') HTTP/1.1" 204 0
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_7c597bc4cabc6f1d35944aab3f26df39.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_7c597bc4cabc6f1d35944aab3f26df39.jpg not downloaded yet
2026-03-30 10:54:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74a46640-acf2-5891-a890-707658421d4e with identifier: UP12847
2026-03-30 10:54:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74a46640-acf2-5891-a890-707658421d4e with identifier: UP12847
2026-03-30 10:54:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74a46640-acf2-5891-a890-707658421d4e with identifier: UP12847 to the API
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 199,
 'expiration_date': '2026-03-31T15:04:24Z',
 'fuel_type': 'diesel',
 'id': '74a46640-acf2-5891-a890-707658421d4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP12847',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 95856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-20',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Edition FWD',
 'transmission': 'automatic',
 'trim': 'Edition FWD',
 'year': 2020}
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP12847%27 HTTP/1.1" 200 None
2026-03-30 10:54:11 [auto1.de] INFO: Saving data for UP12847: {'auction_closing_time': 1774969464.0, 'created_time': 1773134504.729153, 'last_price_update_time': 1774868051.876904}
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP12847') HTTP/1.1" 204 0
2026-03-30 10:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeec1610>
2026-03-30 10:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_c3a39524a76f488ba0ac0c611db234ff.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_c3a39524a76f488ba0ac0c611db234ff.jpg saved to cache
2026-03-30 10:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3e1809b1-19ca-5719-bde1-98be240fe3bf
2026-03-30 10:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee0ff10>
2026-03-30 10:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_b4d18db5c118ed799db315fe4c8413a1.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_b4d18db5c118ed799db315fe4c8413a1.jpg saved to cache
2026-03-30 10:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e
2026-03-30 10:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef4f790>
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_ef73750063736b63c5ddaafb2a53ef4b.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_ef73750063736b63c5ddaafb2a53ef4b.jpg saved to cache
2026-03-30 10:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 335f734b-cb4d-5240-af4d-05caa25d8873
2026-03-30 10:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_2b151241bc40acf430417d57f6dfbbfc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_d90159d8a25e05b3f148f330d4460dee.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_67557e729e162290401bbe921277cc92.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:12 [auto1.de] INFO: Found listing with ID: JU05593
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU05593%27 HTTP/1.1" 200 None
2026-03-30 10:54:12 [auto1.de] INFO: Scrape type for JU05593: 2
2026-03-30 10:54:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee82c9de-f9ec-52c5-98d9-8cd01ea503f7 with identifier: JU05593
2026-03-30 10:54:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee82c9de-f9ec-52c5-98d9-8cd01ea503f7 with scrape type 2
2026-03-30 10:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee82c9de-f9ec-52c5-98d9-8cd01ea503f7 with scrape type 2
2026-03-30 10:54:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee82c9de-f9ec-52c5-98d9-8cd01ea503f7, identifier: JU05593
2026-03-30 10:54:12 [auto1.de] INFO: Found listing with ID: GA58316
2026-03-30 10:54:12 [auto1.de] INFO: Found listing with ID: DF16911
2026-03-30 10:54:12 [auto1.de] INFO: Found listing with ID: TW14325
2026-03-30 10:54:12 [auto1.de] INFO: Found listing with ID: WA27160
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA27160%27 HTTP/1.1" 200 None
2026-03-30 10:54:12 [auto1.de] INFO: Scrape type for WA27160: 2
2026-03-30 10:54:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7de7602d-3556-5c92-abcf-12c81adabb4a with identifier: WA27160
2026-03-30 10:54:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7de7602d-3556-5c92-abcf-12c81adabb4a with scrape type 2
2026-03-30 10:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7de7602d-3556-5c92-abcf-12c81adabb4a with scrape type 2
2026-03-30 10:54:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7de7602d-3556-5c92-abcf-12c81adabb4a, identifier: WA27160
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f432ebd0>
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_2275602dd573bbe682dd44fd4f59c704.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_2275602dd573bbe682dd44fd4f59c704.jpg saved to cache
2026-03-30 10:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 335f734b-cb4d-5240-af4d-05caa25d8873
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee44d550>
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_48301fc56c6e9dbeaaa9b2d98be27667.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_48301fc56c6e9dbeaaa9b2d98be27667.jpg saved to cache
2026-03-30 10:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3e1809b1-19ca-5719-bde1-98be240fe3bf
2026-03-30 10:54:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee82c9de-f9ec-52c5-98d9-8cd01ea503f7 with identifier: JU05593
2026-03-30 10:54:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee82c9de-f9ec-52c5-98d9-8cd01ea503f7 with identifier: JU05593
2026-03-30 10:54:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee82c9de-f9ec-52c5-98d9-8cd01ea503f7 with identifier: JU05593 to the API
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:49:19Z',
 'fuel_type': 'diesel',
 'id': 'ee82c9de-f9ec-52c5-98d9-8cd01ea503f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU05593',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 182997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-25',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2014}
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU05593%27 HTTP/1.1" 200 None
2026-03-30 10:54:12 [auto1.de] INFO: Saving data for JU05593: {'auction_closing_time': 1774972159.0, 'created_time': 1773302637.100624, 'last_price_update_time': 1774868052.730102}
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU05593') HTTP/1.1" 204 0
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_f7fdf56eeded638346e82efb7916071b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_f7fdf56eeded638346e82efb7916071b.jpg not downloaded yet
2026-03-30 10:54:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7de7602d-3556-5c92-abcf-12c81adabb4a with identifier: WA27160
2026-03-30 10:54:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7de7602d-3556-5c92-abcf-12c81adabb4a with identifier: WA27160
2026-03-30 10:54:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7de7602d-3556-5c92-abcf-12c81adabb4a with identifier: WA27160 to the API
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:45:07Z',
 'fuel_type': 'petrol',
 'id': '7de7602d-3556-5c92-abcf-12c81adabb4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA27160',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 116147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-01',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2017}
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA27160%27 HTTP/1.1" 200 None
2026-03-30 10:54:13 [auto1.de] INFO: Saving data for WA27160: {'auction_closing_time': 1774971907.0, 'created_time': 1773305346.264737, 'last_price_update_time': 1774868053.111434}
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA27160') HTTP/1.1" 204 0
2026-03-30 10:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_63c861d4f972e966a37066836eb6ecb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_fcfe413720b13ebf2c3f015e82391de7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:13 [auto1.de] INFO: Found listing with ID: HB96099
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB96099%27 HTTP/1.1" 200 None
2026-03-30 10:54:13 [auto1.de] INFO: Scrape type for HB96099: 2
2026-03-30 10:54:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ff81d2c-d91a-574d-b651-943910004d2e with identifier: HB96099
2026-03-30 10:54:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ff81d2c-d91a-574d-b651-943910004d2e with scrape type 2
2026-03-30 10:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ff81d2c-d91a-574d-b651-943910004d2e with scrape type 2
2026-03-30 10:54:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ff81d2c-d91a-574d-b651-943910004d2e, identifier: HB96099
2026-03-30 10:54:13 [auto1.de] INFO: Found listing with ID: TY90085
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY90085%27 HTTP/1.1" 200 None
2026-03-30 10:54:13 [auto1.de] INFO: Scrape type for TY90085: 2
2026-03-30 10:54:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db1d74ae-360a-5cc2-b29a-86a4b44659a1 with identifier: TY90085
2026-03-30 10:54:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db1d74ae-360a-5cc2-b29a-86a4b44659a1 with scrape type 2
2026-03-30 10:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db1d74ae-360a-5cc2-b29a-86a4b44659a1 with scrape type 2
2026-03-30 10:54:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db1d74ae-360a-5cc2-b29a-86a4b44659a1, identifier: TY90085
2026-03-30 10:54:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f432d910>
2026-03-30 10:54:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_bbd1e230630641876462c046c2ff25e7.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_bbd1e230630641876462c046c2ff25e7.jpg saved to cache
2026-03-30 10:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e
2026-03-30 10:54:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee0ed90>
2026-03-30 10:54:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_571baea77f4f38786c4fbbf3fb1cd252.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_571baea77f4f38786c4fbbf3fb1cd252.jpg saved to cache
2026-03-30 10:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3e1809b1-19ca-5719-bde1-98be240fe3bf
2026-03-30 10:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_2435deadb360271583744d6636114262.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ff81d2c-d91a-574d-b651-943910004d2e with identifier: HB96099
2026-03-30 10:54:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ff81d2c-d91a-574d-b651-943910004d2e with identifier: HB96099
2026-03-30 10:54:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ff81d2c-d91a-574d-b651-943910004d2e with identifier: HB96099 to the API
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:08:34Z',
 'fuel_type': 'petrol',
 'id': '7ff81d2c-d91a-574d-b651-943910004d2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB96099',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 187130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-28',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2015}
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB96099%27 HTTP/1.1" 200 None
2026-03-30 10:54:13 [auto1.de] INFO: Saving data for HB96099: {'auction_closing_time': 1774969714.0, 'created_time': 1774377097.495915, 'last_price_update_time': 1774868053.814501}
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB96099') HTTP/1.1" 204 0
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_2c04caa74572c4603db1e0800937b51c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_2c04caa74572c4603db1e0800937b51c.jpg not downloaded yet
2026-03-30 10:54:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db1d74ae-360a-5cc2-b29a-86a4b44659a1 with identifier: TY90085
2026-03-30 10:54:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db1d74ae-360a-5cc2-b29a-86a4b44659a1 with identifier: TY90085
2026-03-30 10:54:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db1d74ae-360a-5cc2-b29a-86a4b44659a1 with identifier: TY90085 to the API
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:44:08Z',
 'fuel_type': 'diesel',
 'id': 'db1d74ae-360a-5cc2-b29a-86a4b44659a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY90085',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 61204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TDI 4Drive',
 'transmission': 'automatic',
 'trim': '4Drive',
 'year': 2022}
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY90085%27 HTTP/1.1" 200 None
2026-03-30 10:54:14 [auto1.de] INFO: Saving data for TY90085: {'auction_closing_time': 1774971848.0, 'created_time': 1774463664.12299, 'last_price_update_time': 1774868054.172071}
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY90085') HTTP/1.1" 204 0
2026-03-30 10:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_4ffcc61cc43244824187328ab3f6b103.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:14 [auto1.de] INFO: Found listing with ID: VZ64604
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ64604%27 HTTP/1.1" 200 None
2026-03-30 10:54:14 [auto1.de] INFO: Scrape type for VZ64604: 2
2026-03-30 10:54:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a9b0d15-022b-5ceb-9abb-460858439244 with identifier: VZ64604
2026-03-30 10:54:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a9b0d15-022b-5ceb-9abb-460858439244 with scrape type 2
2026-03-30 10:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a9b0d15-022b-5ceb-9abb-460858439244 with scrape type 2
2026-03-30 10:54:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a9b0d15-022b-5ceb-9abb-460858439244, identifier: VZ64604
2026-03-30 10:54:14 [auto1.de] INFO: Found listing with ID: HN33663
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN33663%27 HTTP/1.1" 200 None
2026-03-30 10:54:14 [auto1.de] INFO: Scrape type for HN33663: 2
2026-03-30 10:54:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00e3e56e-ebfa-5271-8992-bc9d865a431c with identifier: HN33663
2026-03-30 10:54:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00e3e56e-ebfa-5271-8992-bc9d865a431c with scrape type 2
2026-03-30 10:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00e3e56e-ebfa-5271-8992-bc9d865a431c with scrape type 2
2026-03-30 10:54:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00e3e56e-ebfa-5271-8992-bc9d865a431c, identifier: HN33663
2026-03-30 10:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41fc450>
2026-03-30 10:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd6%252F94d654524003606aee81a097c83f1d00%252Fpa%252FGW79397_2b151241bc40acf430417d57f6dfbbfc.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_2b151241bc40acf430417d57f6dfbbfc.jpg saved to cache
2026-03-30 10:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3e1809b1-19ca-5719-bde1-98be240fe3bf
2026-03-30 10:54:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e1809b1-19ca-5719-bde1-98be240fe3bf, skipping ID generation
2026-03-30 10:54:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e1809b1-19ca-5719-bde1-98be240fe3bf with scrape type 1
2026-03-30 10:54:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e1809b1-19ca-5719-bde1-98be240fe3bf sending to next pipeline
2026-03-30 10:54:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e1809b1-19ca-5719-bde1-98be240fe3bf, identifier: GW79397
2026-03-30 10:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee4a2350>
2026-03-30 10:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_d90159d8a25e05b3f148f330d4460dee.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_d90159d8a25e05b3f148f330d4460dee.jpg saved to cache
2026-03-30 10:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 335f734b-cb4d-5240-af4d-05caa25d8873
2026-03-30 10:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee56650>
2026-03-30 10:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_67557e729e162290401bbe921277cc92.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_67557e729e162290401bbe921277cc92.jpg saved to cache
2026-03-30 10:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e
2026-03-30 10:54:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a9b0d15-022b-5ceb-9abb-460858439244 with identifier: VZ64604
2026-03-30 10:54:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a9b0d15-022b-5ceb-9abb-460858439244 with identifier: VZ64604
2026-03-30 10:54:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a9b0d15-022b-5ceb-9abb-460858439244 with identifier: VZ64604 to the API
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-31T15:57:55Z',
 'fuel_type': 'petrol',
 'id': '7a9b0d15-022b-5ceb-9abb-460858439244',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ64604',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 278251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-27',
 'seller_name': None,
 'title': 'Mazda 6 2.5 Sports-Line',
 'transmission': 'automatic',
 'trim': 'Sports-Line',
 'year': 2014}
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ64604%27 HTTP/1.1" 200 None
2026-03-30 10:54:15 [auto1.de] INFO: Saving data for VZ64604: {'auction_closing_time': 1774972675.0, 'created_time': 1774348814.015597, 'last_price_update_time': 1774868055.321144}
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ64604') HTTP/1.1" 204 0
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_113cee33d938c6a9650677f51bdfc939.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_113cee33d938c6a9650677f51bdfc939.jpg not downloaded yet
2026-03-30 10:54:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00e3e56e-ebfa-5271-8992-bc9d865a431c with identifier: HN33663
2026-03-30 10:54:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00e3e56e-ebfa-5271-8992-bc9d865a431c with identifier: HN33663
2026-03-30 10:54:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00e3e56e-ebfa-5271-8992-bc9d865a431c with identifier: HN33663 to the API
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:53:53Z',
 'fuel_type': 'petrol',
 'id': '00e3e56e-ebfa-5271-8992-bc9d865a431c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN33663',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 30729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-20',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2018}
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN33663%27 HTTP/1.1" 200 None
2026-03-30 10:54:15 [auto1.de] INFO: Saving data for HN33663: {'auction_closing_time': 1774972433.0, 'created_time': 1773400464.317496, 'last_price_update_time': 1774868055.741854}
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN33663') HTTP/1.1" 204 0
2026-03-30 10:54:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e1809b1-19ca-5719-bde1-98be240fe3bf with identifier: GW79397
2026-03-30 10:54:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e1809b1-19ca-5719-bde1-98be240fe3bf with identifier: GW79397
2026-03-30 10:54:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e1809b1-19ca-5719-bde1-98be240fe3bf with identifier: GW79397 to the API
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_2b151241bc40acf430417d57f6dfbbfc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:45:41Z',
 'fuel_type': 'electro',
 'id': '3e1809b1-19ca-5719-bde1-98be240fe3bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW79397',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_abcc54ae8983ff09abf3c9b6b2b28e9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_037182e911010f90e4078066886d54a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_794d44be24e67d0eca1b273f901c4861.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_76d9b8b3f203e8a1dd9cfc94b7fec89a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_d85ca818fae864fb5f5f8333e25893b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_8ff802f14a5a85c44ec79ea9794029a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_c3a39524a76f488ba0ac0c611db234ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_48301fc56c6e9dbeaaa9b2d98be27667.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_571baea77f4f38786c4fbbf3fb1cd252.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1809b1-19ca-5719-bde1-98be240fe3bf/3e1809b1-19ca-5719-bde1-98be240fe3bf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d6/94d654524003606aee81a097c83f1d00/pa/GW79397_2b151241bc40acf430417d57f6dfbbfc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-12-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW79397%27 HTTP/1.1" 200 None
2026-03-30 10:54:16 [auto1.de] INFO: Saving data for GW79397: {'created_time': 1774868056.115483, 'last_price_update_time': 1774868056.115494, 'auction_closing_time': 1774971941.0}
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW79397') HTTP/1.1" 204 0
2026-03-30 10:54:16 [auto1.de] INFO: Found listing with ID: GU26871
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU26871%27 HTTP/1.1" 200 None
2026-03-30 10:54:16 [auto1.de] INFO: Scrape type for GU26871: 2
2026-03-30 10:54:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38cfd057-b906-5e0e-8b6b-3fe26a5639a3 with identifier: GU26871
2026-03-30 10:54:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38cfd057-b906-5e0e-8b6b-3fe26a5639a3 with scrape type 2
2026-03-30 10:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38cfd057-b906-5e0e-8b6b-3fe26a5639a3 with scrape type 2
2026-03-30 10:54:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38cfd057-b906-5e0e-8b6b-3fe26a5639a3, identifier: GU26871
2026-03-30 10:54:16 [auto1.de] INFO: Found listing with ID: FX70736
2026-03-30 10:54:16 [auto1.de] INFO: Found listing with ID: CY30248
2026-03-30 10:54:16 [auto1.de] INFO: Found listing with ID: HS46985
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS46985%27 HTTP/1.1" 200 None
2026-03-30 10:54:16 [auto1.de] INFO: Scrape type for HS46985: 2
2026-03-30 10:54:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4283425-2d0b-50fa-952c-9007d00c7daa with identifier: HS46985
2026-03-30 10:54:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4283425-2d0b-50fa-952c-9007d00c7daa with scrape type 2
2026-03-30 10:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4283425-2d0b-50fa-952c-9007d00c7daa with scrape type 2
2026-03-30 10:54:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4283425-2d0b-50fa-952c-9007d00c7daa, identifier: HS46985
2026-03-30 10:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NA02612/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f432f810>
2026-03-30 10:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_63c861d4f972e966a37066836eb6ecb6.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_63c861d4f972e966a37066836eb6ecb6.jpg saved to cache
2026-03-30 10:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 335f734b-cb4d-5240-af4d-05caa25d8873
2026-03-30 10:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43aa7d0>
2026-03-30 10:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_fcfe413720b13ebf2c3f015e82391de7.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_fcfe413720b13ebf2c3f015e82391de7.jpg saved to cache
2026-03-30 10:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e
2026-03-30 10:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee484f50>
2026-03-30 10:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5c%252Fcd5cba1743fa39623217d40361c84e53%252Fpa%252FRE58657_2435deadb360271583744d6636114262.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_2435deadb360271583744d6636114262.jpg saved to cache
2026-03-30 10:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 335f734b-cb4d-5240-af4d-05caa25d8873
2026-03-30 10:54:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 335f734b-cb4d-5240-af4d-05caa25d8873, skipping ID generation
2026-03-30 10:54:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 335f734b-cb4d-5240-af4d-05caa25d8873 with scrape type 1
2026-03-30 10:54:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 335f734b-cb4d-5240-af4d-05caa25d8873 sending to next pipeline
2026-03-30 10:54:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 335f734b-cb4d-5240-af4d-05caa25d8873, identifier: RE58657
2026-03-30 10:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_7c597bc4cabc6f1d35944aab3f26df39.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38cfd057-b906-5e0e-8b6b-3fe26a5639a3 with identifier: GU26871
2026-03-30 10:54:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38cfd057-b906-5e0e-8b6b-3fe26a5639a3 with identifier: GU26871
2026-03-30 10:54:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38cfd057-b906-5e0e-8b6b-3fe26a5639a3 with identifier: GU26871 to the API
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:47:12Z',
 'fuel_type': 'diesel',
 'id': '38cfd057-b906-5e0e-8b6b-3fe26a5639a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU26871',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 114850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-30',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion Tech',
 'year': 2016}
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU26871%27 HTTP/1.1" 200 None
2026-03-30 10:54:16 [auto1.de] INFO: Saving data for GU26871: {'auction_closing_time': 1774972032.0, 'created_time': 1774463634.671245, 'last_price_update_time': 1774868056.970579}
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU26871') HTTP/1.1" 204 0
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_ff25906a60113182cdee350c6c5e320b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_ff25906a60113182cdee350c6c5e320b.jpg not downloaded yet
2026-03-30 10:54:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4283425-2d0b-50fa-952c-9007d00c7daa with identifier: HS46985
2026-03-30 10:54:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4283425-2d0b-50fa-952c-9007d00c7daa with identifier: HS46985
2026-03-30 10:54:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4283425-2d0b-50fa-952c-9007d00c7daa with identifier: HS46985 to the API
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:07:33Z',
 'fuel_type': 'diesel',
 'id': 'a4283425-2d0b-50fa-952c-9007d00c7daa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS46985',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 135695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-09',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 CRDi Platinum Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Platinum Edition 4WD',
 'year': 2017}
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS46985%27 HTTP/1.1" 200 None
2026-03-30 10:54:17 [auto1.de] INFO: Saving data for HS46985: {'auction_closing_time': 1774969653.0, 'created_time': 1773466659.548302, 'last_price_update_time': 1774868057.450726}
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS46985') HTTP/1.1" 204 0
2026-03-30 10:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW36019> (referer: https://www.auto1.com/v1/car-details-view/SW36019/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 335f734b-cb4d-5240-af4d-05caa25d8873 with identifier: RE58657
2026-03-30 10:54:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 335f734b-cb4d-5240-af4d-05caa25d8873 with identifier: RE58657
2026-03-30 10:54:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 335f734b-cb4d-5240-af4d-05caa25d8873 with identifier: RE58657 to the API
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_2435deadb360271583744d6636114262.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:56:22Z',
 'fuel_type': 'petrol',
 'id': '335f734b-cb4d-5240-af4d-05caa25d8873',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE58657',
 'listing': 'auction',
 'location': 'DE, Bielefeld',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 97904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_e77d45c2dfd3c0e3506633b2d0f4def5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_28fcb811266e844a60de978085f40840.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_fd80e20b9f5fb21eaac5a0b5575c174d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_810ee657ed76a3a6199bc904c0eda2e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_745000c76a9b33d2cee852b4aa10fb1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_ef73750063736b63c5ddaafb2a53ef4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_2275602dd573bbe682dd44fd4f59c704.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_d90159d8a25e05b3f148f330d4460dee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_63c861d4f972e966a37066836eb6ecb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335f734b-cb4d-5240-af4d-05caa25d8873/335f734b-cb4d-5240-af4d-05caa25d8873_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/5c/cd5cba1743fa39623217d40361c84e53/pa/RE58657_2435deadb360271583744d6636114262.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2017}
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE58657%27 HTTP/1.1" 200 None
2026-03-30 10:54:17 [auto1.de] INFO: Saving data for RE58657: {'created_time': 1774868057.897481, 'last_price_update_time': 1774868057.897492, 'auction_closing_time': 1774972582.0}
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE58657') HTTP/1.1" 204 0
2026-03-30 10:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_f7fdf56eeded638346e82efb7916071b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:17 [auto1.de] INFO: Found listing with ID: HX97789
2026-03-30 10:54:17 [auto1.de] INFO: Found listing with ID: CT48596
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT48596%27 HTTP/1.1" 200 None
2026-03-30 10:54:17 [auto1.de] INFO: Scrape type for CT48596: 2
2026-03-30 10:54:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1bf16a3-6f64-5d2e-83e6-134afe243dc0 with identifier: CT48596
2026-03-30 10:54:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1bf16a3-6f64-5d2e-83e6-134afe243dc0 with scrape type 2
2026-03-30 10:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1bf16a3-6f64-5d2e-83e6-134afe243dc0 with scrape type 2
2026-03-30 10:54:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1bf16a3-6f64-5d2e-83e6-134afe243dc0, identifier: CT48596
2026-03-30 10:54:18 [auto1.de] INFO: Found listing with ID: BW50194
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW50194%27 HTTP/1.1" 200 None
2026-03-30 10:54:18 [auto1.de] INFO: Scrape type for BW50194: 2
2026-03-30 10:54:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ee5b388-a344-5df2-8702-a6078db42cf8 with identifier: BW50194
2026-03-30 10:54:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ee5b388-a344-5df2-8702-a6078db42cf8 with scrape type 2
2026-03-30 10:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ee5b388-a344-5df2-8702-a6078db42cf8 with scrape type 2
2026-03-30 10:54:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ee5b388-a344-5df2-8702-a6078db42cf8, identifier: BW50194
2026-03-30 10:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LT69845> (referer: https://www.auto1.com/v1/car-details-view/LT69845/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee488890>
2026-03-30 10:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_4ffcc61cc43244824187328ab3f6b103.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_4ffcc61cc43244824187328ab3f6b103.jpg saved to cache
2026-03-30 10:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e
2026-03-30 10:54:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1bf16a3-6f64-5d2e-83e6-134afe243dc0 with identifier: CT48596
2026-03-30 10:54:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1bf16a3-6f64-5d2e-83e6-134afe243dc0 with identifier: CT48596
2026-03-30 10:54:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1bf16a3-6f64-5d2e-83e6-134afe243dc0 with identifier: CT48596 to the API
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:49:26Z',
 'fuel_type': 'petrol',
 'id': 'a1bf16a3-6f64-5d2e-83e6-134afe243dc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT48596',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 153337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-24',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT48596%27 HTTP/1.1" 200 None
2026-03-30 10:54:18 [auto1.de] INFO: Saving data for CT48596: {'auction_closing_time': 1774972166.0, 'created_time': 1773686326.538484, 'last_price_update_time': 1774868058.622578}
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT48596') HTTP/1.1" 204 0
2026-03-30 10:54:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ee5b388-a344-5df2-8702-a6078db42cf8 with identifier: BW50194
2026-03-30 10:54:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ee5b388-a344-5df2-8702-a6078db42cf8 with identifier: BW50194
2026-03-30 10:54:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ee5b388-a344-5df2-8702-a6078db42cf8 with identifier: BW50194 to the API
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:16:43Z',
 'fuel_type': 'petrol',
 'id': '1ee5b388-a344-5df2-8702-a6078db42cf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW50194',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 147246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW50194%27 HTTP/1.1" 200 None
2026-03-30 10:54:19 [auto1.de] INFO: Saving data for BW50194: {'auction_closing_time': 1774970203.0, 'created_time': 1774377083.748055, 'last_price_update_time': 1774868059.578987}
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW50194') HTTP/1.1" 204 0
2026-03-30 10:54:19 [auto1.de] INFO: Found listing with ID: WX56329
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX56329%27 HTTP/1.1" 200 None
2026-03-30 10:54:19 [auto1.de] INFO: Scrape type for WX56329: 2
2026-03-30 10:54:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1de1e365-0a77-5ada-a9b3-536595ff22e8 with identifier: WX56329
2026-03-30 10:54:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1de1e365-0a77-5ada-a9b3-536595ff22e8 with scrape type 2
2026-03-30 10:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1de1e365-0a77-5ada-a9b3-536595ff22e8 with scrape type 2
2026-03-30 10:54:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1de1e365-0a77-5ada-a9b3-536595ff22e8, identifier: WX56329
2026-03-30 10:54:19 [auto1.de] INFO: Found listing with ID: JH99279
2026-03-30 10:54:19 [auto1.de] INFO: Found listing with ID: PX60465
2026-03-30 10:54:19 [auto1.de] INFO: Found listing with ID: RA28898
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA28898%27 HTTP/1.1" 200 None
2026-03-30 10:54:19 [auto1.de] INFO: Scrape type for RA28898: 2
2026-03-30 10:54:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53293c24-8afc-5baf-944a-84ed56b799a6 with identifier: RA28898
2026-03-30 10:54:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53293c24-8afc-5baf-944a-84ed56b799a6 with scrape type 2
2026-03-30 10:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53293c24-8afc-5baf-944a-84ed56b799a6 with scrape type 2
2026-03-30 10:54:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53293c24-8afc-5baf-944a-84ed56b799a6, identifier: RA28898
2026-03-30 10:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WM67864/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43a9310>
2026-03-30 10:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_7c597bc4cabc6f1d35944aab3f26df39.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_7c597bc4cabc6f1d35944aab3f26df39.jpg saved to cache
2026-03-30 10:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e
2026-03-30 10:54:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 600d9f2a-3d9a-5807-9f51-aa8c5831d8ba with identifier: SW36019
2026-03-30 10:54:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 600d9f2a-3d9a-5807-9f51-aa8c5831d8ba with scrape type 1
2026-03-30 10:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 600d9f2a-3d9a-5807-9f51-aa8c5831d8ba
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fd5%252Fd6d58ffc63a8be99e1f74e4abc063f27%252Fpa%252FSW36019_ccb4b9234b162e00375c1c047b8a1c48.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_ccb4b9234b162e00375c1c047b8a1c48.jpg already downloaded
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fd5%252Fd6d58ffc63a8be99e1f74e4abc063f27%252Fpa%252FSW36019_696de1c214fbe72d3f39ecb406844be3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_696de1c214fbe72d3f39ecb406844be3.jpg already downloaded
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fd5%252Fd6d58ffc63a8be99e1f74e4abc063f27%252Fpa%252FSW36019_819694ba185e96e9ed77713a3c74e05d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_819694ba185e96e9ed77713a3c74e05d.jpg already downloaded
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fd5%252Fd6d58ffc63a8be99e1f74e4abc063f27%252Fpa%252FSW36019_5d6ae85e2d8d04f988088b46009d0f20.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_5d6ae85e2d8d04f988088b46009d0f20.jpg already downloaded
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fd5%252Fd6d58ffc63a8be99e1f74e4abc063f27%252Fpa%252FSW36019_c7efd22c780e6ecaca3ca8ec9e2ff77d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_c7efd22c780e6ecaca3ca8ec9e2ff77d.jpg already downloaded
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fd5%252Fd6d58ffc63a8be99e1f74e4abc063f27%252Fpa%252FSW36019_81224426963f0d42e9804eea1c0653b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_81224426963f0d42e9804eea1c0653b8.jpg already downloaded
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fd5%252Fd6d58ffc63a8be99e1f74e4abc063f27%252Fpa%252FSW36019_712014929ab7aa6c38ecec95fb47e64e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_712014929ab7aa6c38ecec95fb47e64e.jpg already downloaded
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fd5%252Fd6d58ffc63a8be99e1f74e4abc063f27%252Fpa%252FSW36019_a4a3c14c1d6b7d6bba637eda79a1603e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_a4a3c14c1d6b7d6bba637eda79a1603e.jpg already downloaded
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fd5%252Fd6d58ffc63a8be99e1f74e4abc063f27%252Fpa%252FSW36019_071f67f8e02faacbb96e4db2fa22dec4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_071f67f8e02faacbb96e4db2fa22dec4.jpg already downloaded
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fd5%252Fd6d58ffc63a8be99e1f74e4abc063f27%252Fpa%252FSW36019_bfc28cffe72c9081dd6890df9fb2286a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_bfc28cffe72c9081dd6890df9fb2286a.jpg already downloaded
2026-03-30 10:54:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 600d9f2a-3d9a-5807-9f51-aa8c5831d8ba, identifier: SW36019
2026-03-30 10:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_2c04caa74572c4603db1e0800937b51c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1de1e365-0a77-5ada-a9b3-536595ff22e8 with identifier: WX56329
2026-03-30 10:54:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1de1e365-0a77-5ada-a9b3-536595ff22e8 with identifier: WX56329
2026-03-30 10:54:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1de1e365-0a77-5ada-a9b3-536595ff22e8 with identifier: WX56329 to the API
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:23:57Z',
 'fuel_type': 'diesel',
 'id': '1de1e365-0a77-5ada-a9b3-536595ff22e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX56329',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Kombi',
 'odometer': 108776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-26',
 'seller_name': None,
 'title': 'Volkswagen T6 Kombi 2.0 TDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2017}
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX56329%27 HTTP/1.1" 200 None
2026-03-30 10:54:20 [auto1.de] INFO: Saving data for WX56329: {'auction_closing_time': 1774970637.0, 'created_time': 1773429270.890055, 'last_price_update_time': 1774868060.53708}
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX56329') HTTP/1.1" 204 0
2026-03-30 10:54:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53293c24-8afc-5baf-944a-84ed56b799a6 with identifier: RA28898
2026-03-30 10:54:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53293c24-8afc-5baf-944a-84ed56b799a6 with identifier: RA28898
2026-03-30 10:54:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53293c24-8afc-5baf-944a-84ed56b799a6 with identifier: RA28898 to the API
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:56:43Z',
 'fuel_type': 'diesel',
 'id': '53293c24-8afc-5baf-944a-84ed56b799a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA28898',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Kombi',
 'odometer': 94295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-18',
 'seller_name': None,
 'title': 'Volkswagen T6 Kombi 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA28898%27 HTTP/1.1" 200 None
2026-03-30 10:54:20 [auto1.de] INFO: Saving data for RA28898: {'auction_closing_time': 1774972603.0, 'created_time': 1774463479.617163, 'last_price_update_time': 1774868060.891329}
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA28898') HTTP/1.1" 204 0
2026-03-30 10:54:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 600d9f2a-3d9a-5807-9f51-aa8c5831d8ba with identifier: SW36019
2026-03-30 10:54:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 600d9f2a-3d9a-5807-9f51-aa8c5831d8ba with identifier: SW36019
2026-03-30 10:54:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 600d9f2a-3d9a-5807-9f51-aa8c5831d8ba with identifier: SW36019 to the API
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SW36019>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:54:31Z',
 'fuel_type': 'diesel',
 'id': '600d9f2a-3d9a-5807-9f51-aa8c5831d8ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW36019',
 'listing': 'auction',
 'location': 'DE, Hodenhagen',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 239247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_ccb4b9234b162e00375c1c047b8a1c48.jpg',
                'https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_696de1c214fbe72d3f39ecb406844be3.jpg',
                'https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_819694ba185e96e9ed77713a3c74e05d.jpg',
                'https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_5d6ae85e2d8d04f988088b46009d0f20.jpg',
                'https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_c7efd22c780e6ecaca3ca8ec9e2ff77d.jpg',
                'https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_81224426963f0d42e9804eea1c0653b8.jpg',
                'https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_712014929ab7aa6c38ecec95fb47e64e.jpg',
                'https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_a4a3c14c1d6b7d6bba637eda79a1603e.jpg',
                'https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_071f67f8e02faacbb96e4db2fa22dec4.jpg',
                'https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_bfc28cffe72c9081dd6890df9fb2286a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600d9f2a-3d9a-5807-9f51-aa8c5831d8ba/600d9f2a-3d9a-5807-9f51-aa8c5831d8ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2826302,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_ccb4b9234b162e00375c1c047b8a1c48.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600d9f2a-3d9a-5807-9f51-aa8c5831d8ba/600d9f2a-3d9a-5807-9f51-aa8c5831d8ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2983916,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_696de1c214fbe72d3f39ecb406844be3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600d9f2a-3d9a-5807-9f51-aa8c5831d8ba/600d9f2a-3d9a-5807-9f51-aa8c5831d8ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3036307,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_819694ba185e96e9ed77713a3c74e05d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600d9f2a-3d9a-5807-9f51-aa8c5831d8ba/600d9f2a-3d9a-5807-9f51-aa8c5831d8ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_5d6ae85e2d8d04f988088b46009d0f20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600d9f2a-3d9a-5807-9f51-aa8c5831d8ba/600d9f2a-3d9a-5807-9f51-aa8c5831d8ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2910860,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_c7efd22c780e6ecaca3ca8ec9e2ff77d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600d9f2a-3d9a-5807-9f51-aa8c5831d8ba/600d9f2a-3d9a-5807-9f51-aa8c5831d8ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2978917,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_81224426963f0d42e9804eea1c0653b8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600d9f2a-3d9a-5807-9f51-aa8c5831d8ba/600d9f2a-3d9a-5807-9f51-aa8c5831d8ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2941782,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_712014929ab7aa6c38ecec95fb47e64e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600d9f2a-3d9a-5807-9f51-aa8c5831d8ba/600d9f2a-3d9a-5807-9f51-aa8c5831d8ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2966090,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_a4a3c14c1d6b7d6bba637eda79a1603e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600d9f2a-3d9a-5807-9f51-aa8c5831d8ba/600d9f2a-3d9a-5807-9f51-aa8c5831d8ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2887084,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_071f67f8e02faacbb96e4db2fa22dec4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600d9f2a-3d9a-5807-9f51-aa8c5831d8ba/600d9f2a-3d9a-5807-9f51-aa8c5831d8ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/d5/d6d58ffc63a8be99e1f74e4abc063f27/pa/SW36019_bfc28cffe72c9081dd6890df9fb2286a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW36019%27 HTTP/1.1" 200 None
2026-03-30 10:54:21 [auto1.de] INFO: Saving data for SW36019: {'created_time': 1774868061.246076, 'last_price_update_time': 1774868061.246088, 'auction_closing_time': 1774972471.0}
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW36019') HTTP/1.1" 204 0
2026-03-30 10:54:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f424f9d0>
2026-03-30 10:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_f7fdf56eeded638346e82efb7916071b.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_f7fdf56eeded638346e82efb7916071b.jpg saved to cache
2026-03-30 10:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e
2026-03-30 10:54:21 [auto1.de] INFO: Channel: 24h | Page: 50 | totalHits: 9522 | hits on page: 40
2026-03-30 10:54:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 982e367f-53e6-5356-9bae-02a3bd2e6369 with identifier: LT69845
2026-03-30 10:54:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 982e367f-53e6-5356-9bae-02a3bd2e6369 with scrape type 1
2026-03-30 10:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 982e367f-53e6-5356-9bae-02a3bd2e6369
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1f%252F4b1f8cd91adb8e3faf45c9f7048405c1%252Fpa%252FLT69845_79a62fbb56e76f63a660afa3d9d3ca9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_79a62fbb56e76f63a660afa3d9d3ca9d.jpg not downloaded yet
2026-03-30 10:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_113cee33d938c6a9650677f51bdfc939.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:21 [auto1.de] INFO: Found listing with ID: FX29035
2026-03-30 10:54:21 [auto1.de] INFO: Found listing with ID: FU46952
2026-03-30 10:54:21 [auto1.de] INFO: Found listing with ID: FH56609
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH56609%27 HTTP/1.1" 200 None
2026-03-30 10:54:21 [auto1.de] INFO: Scrape type for FH56609: 2
2026-03-30 10:54:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fc1c15b-443a-56f3-8c9f-3853653b1b67 with identifier: FH56609
2026-03-30 10:54:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fc1c15b-443a-56f3-8c9f-3853653b1b67 with scrape type 2
2026-03-30 10:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fc1c15b-443a-56f3-8c9f-3853653b1b67 with scrape type 2
2026-03-30 10:54:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3fc1c15b-443a-56f3-8c9f-3853653b1b67, identifier: FH56609
2026-03-30 10:54:21 [auto1.de] INFO: Found listing with ID: HX50499
2026-03-30 10:54:21 [auto1.de] INFO: Found listing with ID: AG44550
2026-03-30 10:54:21 [auto1.de] INFO: Found listing with ID: ZJ46963
2026-03-30 10:54:21 [auto1.de] INFO: Found listing with ID: XC07507
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC07507%27 HTTP/1.1" 200 None
2026-03-30 10:54:21 [auto1.de] INFO: Scrape type for XC07507: 1
2026-03-30 10:54:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3fc1c15b-443a-56f3-8c9f-3853653b1b67 with identifier: FH56609
2026-03-30 10:54:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3fc1c15b-443a-56f3-8c9f-3853653b1b67 with identifier: FH56609
2026-03-30 10:54:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3fc1c15b-443a-56f3-8c9f-3853653b1b67 with identifier: FH56609 to the API
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:43:55Z',
 'fuel_type': 'petrol',
 'id': '3fc1c15b-443a-56f3-8c9f-3853653b1b67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH56609',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 24928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-18',
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT SportLine',
 'transmission': 'automatic',
 'trim': 'SportLine',
 'year': 2023}
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH56609%27 HTTP/1.1" 200 None
2026-03-30 10:54:21 [auto1.de] INFO: Saving data for FH56609: {'auction_closing_time': 1774971835.0, 'created_time': 1773859827.944372, 'last_price_update_time': 1774868061.808824}
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH56609') HTTP/1.1" 204 0
2026-03-30 10:54:21 [auto1.de] INFO: Found listing with ID: MJ50234
2026-03-30 10:54:21 [auto1.de] INFO: Found listing with ID: EZ29207
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ29207%27 HTTP/1.1" 200 None
2026-03-30 10:54:21 [auto1.de] INFO: Scrape type for EZ29207: 2
2026-03-30 10:54:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fe94700-d209-56a6-b4ae-747de24ff4d9 with identifier: EZ29207
2026-03-30 10:54:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fe94700-d209-56a6-b4ae-747de24ff4d9 with scrape type 2
2026-03-30 10:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fe94700-d209-56a6-b4ae-747de24ff4d9 with scrape type 2
2026-03-30 10:54:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fe94700-d209-56a6-b4ae-747de24ff4d9, identifier: EZ29207
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1f%252F4b1f8cd91adb8e3faf45c9f7048405c1%252Fpa%252FLT69845_a2693d6426b461d1da807a50bd727807.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_a2693d6426b461d1da807a50bd727807.jpg not downloaded yet
2026-03-30 10:54:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_ff25906a60113182cdee350c6c5e320b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:22 [auto1.de] INFO: Found listing with ID: ZP20879
2026-03-30 10:54:22 [auto1.de] INFO: Found listing with ID: HV43954
2026-03-30 10:54:22 [auto1.de] INFO: Found listing with ID: TP76478
2026-03-30 10:54:22 [auto1.de] INFO: Found listing with ID: PV23969
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV23969%27 HTTP/1.1" 200 None
2026-03-30 10:54:22 [auto1.de] INFO: Scrape type for PV23969: 2
2026-03-30 10:54:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7a84283-ec50-5a24-ab67-a4fa292e7966 with identifier: PV23969
2026-03-30 10:54:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7a84283-ec50-5a24-ab67-a4fa292e7966 with scrape type 2
2026-03-30 10:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7a84283-ec50-5a24-ab67-a4fa292e7966 with scrape type 2
2026-03-30 10:54:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7a84283-ec50-5a24-ab67-a4fa292e7966, identifier: PV23969
2026-03-30 10:54:22 [auto1.de] INFO: Found listing with ID: TJ17702
2026-03-30 10:54:22 [auto1.de] INFO: Found listing with ID: CT53281
2026-03-30 10:54:22 [auto1.de] INFO: Found listing with ID: BK50422
2026-03-30 10:54:22 [auto1.de] INFO: Found listing with ID: WF84421
2026-03-30 10:54:22 [auto1.de] INFO: Found listing with ID: MR23969
2026-03-30 10:54:22 [auto1.de] INFO: Found listing with ID: PP91103
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP91103%27 HTTP/1.1" 200 None
2026-03-30 10:54:22 [auto1.de] INFO: Scrape type for PP91103: 2
2026-03-30 10:54:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8bf26a1-ad43-51b1-af56-5cdceabf0935 with identifier: PP91103
2026-03-30 10:54:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8bf26a1-ad43-51b1-af56-5cdceabf0935 with scrape type 2
2026-03-30 10:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8bf26a1-ad43-51b1-af56-5cdceabf0935 with scrape type 2
2026-03-30 10:54:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8bf26a1-ad43-51b1-af56-5cdceabf0935, identifier: PP91103
2026-03-30 10:54:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fe94700-d209-56a6-b4ae-747de24ff4d9 with identifier: EZ29207
2026-03-30 10:54:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fe94700-d209-56a6-b4ae-747de24ff4d9 with identifier: EZ29207
2026-03-30 10:54:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fe94700-d209-56a6-b4ae-747de24ff4d9 with identifier: EZ29207 to the API
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:53:54Z',
 'fuel_type': 'petrol',
 'id': '0fe94700-d209-56a6-b4ae-747de24ff4d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ29207',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 161406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-22',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ29207%27 HTTP/1.1" 200 None
2026-03-30 10:54:22 [auto1.de] INFO: Saving data for EZ29207: {'auction_closing_time': 1774972434.0, 'created_time': 1774466746.922057, 'last_price_update_time': 1774868062.651664}
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ29207') HTTP/1.1" 204 0
2026-03-30 10:54:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f436cd50>
2026-03-30 10:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_2c04caa74572c4603db1e0800937b51c.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_2c04caa74572c4603db1e0800937b51c.jpg saved to cache
2026-03-30 10:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e
2026-03-30 10:54:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7a84283-ec50-5a24-ab67-a4fa292e7966 with identifier: PV23969
2026-03-30 10:54:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7a84283-ec50-5a24-ab67-a4fa292e7966 with identifier: PV23969
2026-03-30 10:54:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7a84283-ec50-5a24-ab67-a4fa292e7966 with identifier: PV23969 to the API
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:04:03Z',
 'fuel_type': 'petrol',
 'id': 'f7a84283-ec50-5a24-ab67-a4fa292e7966',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV23969',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 106733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-05',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T4 R Design 2WD',
 'transmission': 'automatic',
 'trim': 'R Design 2WD',
 'year': 2019}
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV23969%27 HTTP/1.1" 200 None
2026-03-30 10:54:23 [auto1.de] INFO: Saving data for PV23969: {'auction_closing_time': 1774969443.0, 'created_time': 1773661882.265473, 'last_price_update_time': 1774868063.187129}
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV23969') HTTP/1.1" 204 0
2026-03-30 10:54:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8bf26a1-ad43-51b1-af56-5cdceabf0935 with identifier: PP91103
2026-03-30 10:54:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8bf26a1-ad43-51b1-af56-5cdceabf0935 with identifier: PP91103
2026-03-30 10:54:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8bf26a1-ad43-51b1-af56-5cdceabf0935 with identifier: PP91103 to the API
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-31T15:36:13Z',
 'fuel_type': 'petrol',
 'id': 'd8bf26a1-ad43-51b1-af56-5cdceabf0935',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP91103',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 63095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-04',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP91103%27 HTTP/1.1" 200 None
2026-03-30 10:54:23 [auto1.de] INFO: Saving data for PP91103: {'auction_closing_time': 1774971373.0, 'created_time': 1774435341.668614, 'last_price_update_time': 1774868063.544041}
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP91103') HTTP/1.1" 204 0
2026-03-30 10:54:23 [auto1.de] INFO: Found listing with ID: KW20728
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW20728%27 HTTP/1.1" 200 None
2026-03-30 10:54:23 [auto1.de] INFO: Scrape type for KW20728: 2
2026-03-30 10:54:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea4de49f-e525-5d64-89ac-14a789bc564f with identifier: KW20728
2026-03-30 10:54:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea4de49f-e525-5d64-89ac-14a789bc564f with scrape type 2
2026-03-30 10:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea4de49f-e525-5d64-89ac-14a789bc564f with scrape type 2
2026-03-30 10:54:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea4de49f-e525-5d64-89ac-14a789bc564f, identifier: KW20728
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1f%252F4b1f8cd91adb8e3faf45c9f7048405c1%252Fpa%252FLT69845_b0a902eb85d8ea3d04fee50a5bdf540e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_b0a902eb85d8ea3d04fee50a5bdf540e.jpg not downloaded yet
2026-03-30 10:54:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeedfb90>
2026-03-30 10:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_113cee33d938c6a9650677f51bdfc939.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_113cee33d938c6a9650677f51bdfc939.jpg saved to cache
2026-03-30 10:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e
2026-03-30 10:54:23 [auto1.de] INFO: Found listing with ID: SE81381
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE81381%27 HTTP/1.1" 200 None
2026-03-30 10:54:23 [auto1.de] INFO: Scrape type for SE81381: 2
2026-03-30 10:54:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19b38a29-dde2-5f68-b666-343c58cf789d with identifier: SE81381
2026-03-30 10:54:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19b38a29-dde2-5f68-b666-343c58cf789d with scrape type 2
2026-03-30 10:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19b38a29-dde2-5f68-b666-343c58cf789d with scrape type 2
2026-03-30 10:54:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19b38a29-dde2-5f68-b666-343c58cf789d, identifier: SE81381
2026-03-30 10:54:23 [auto1.de] INFO: Found listing with ID: LK15200
2026-03-30 10:54:23 [auto1.de] INFO: Found listing with ID: CR45674
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR45674%27 HTTP/1.1" 200 None
2026-03-30 10:54:23 [auto1.de] INFO: Scrape type for CR45674: 2
2026-03-30 10:54:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23b347fb-a2d9-54c9-8f0d-b9456209069e with identifier: CR45674
2026-03-30 10:54:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23b347fb-a2d9-54c9-8f0d-b9456209069e with scrape type 2
2026-03-30 10:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23b347fb-a2d9-54c9-8f0d-b9456209069e with scrape type 2
2026-03-30 10:54:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23b347fb-a2d9-54c9-8f0d-b9456209069e, identifier: CR45674
2026-03-30 10:54:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea4de49f-e525-5d64-89ac-14a789bc564f with identifier: KW20728
2026-03-30 10:54:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea4de49f-e525-5d64-89ac-14a789bc564f with identifier: KW20728
2026-03-30 10:54:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea4de49f-e525-5d64-89ac-14a789bc564f with identifier: KW20728 to the API
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-31T15:37:43Z',
 'fuel_type': 'petrol',
 'id': 'ea4de49f-e525-5d64-89ac-14a789bc564f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW20728',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 87282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-23',
 'seller_name': None,
 'title': 'Ford Focus 2.0 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2017}
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW20728%27 HTTP/1.1" 200 None
2026-03-30 10:54:24 [auto1.de] INFO: Saving data for KW20728: {'auction_closing_time': 1774971463.0, 'created_time': 1774378369.445977, 'last_price_update_time': 1774868064.33676}
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW20728') HTTP/1.1" 204 0
2026-03-30 10:54:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19b38a29-dde2-5f68-b666-343c58cf789d with identifier: SE81381
2026-03-30 10:54:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19b38a29-dde2-5f68-b666-343c58cf789d with identifier: SE81381
2026-03-30 10:54:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19b38a29-dde2-5f68-b666-343c58cf789d with identifier: SE81381 to the API
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:58:02Z',
 'fuel_type': 'petrol',
 'id': '19b38a29-dde2-5f68-b666-343c58cf789d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE81381',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 186887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-11',
 'seller_name': None,
 'title': 'Volkswagen Golf V 2.0 TFSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2007}
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE81381%27 HTTP/1.1" 200 None
2026-03-30 10:54:24 [auto1.de] INFO: Saving data for SE81381: {'auction_closing_time': 1774972682.0, 'created_time': 1773134623.178792, 'last_price_update_time': 1774868064.713322}
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE81381') HTTP/1.1" 204 0
2026-03-30 10:54:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23b347fb-a2d9-54c9-8f0d-b9456209069e with identifier: CR45674
2026-03-30 10:54:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23b347fb-a2d9-54c9-8f0d-b9456209069e with identifier: CR45674
2026-03-30 10:54:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23b347fb-a2d9-54c9-8f0d-b9456209069e with identifier: CR45674 to the API
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:34:05Z',
 'fuel_type': 'petrol',
 'id': '23b347fb-a2d9-54c9-8f0d-b9456209069e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR45674',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 67685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-08',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR45674%27 HTTP/1.1" 200 None
2026-03-30 10:54:25 [auto1.de] INFO: Saving data for CR45674: {'auction_closing_time': 1774971245.0, 'created_time': 1773660075.042238, 'last_price_update_time': 1774868065.112858}
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR45674') HTTP/1.1" 204 0
2026-03-30 10:54:25 [auto1.de] INFO: Found listing with ID: LA45338
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA45338%27 HTTP/1.1" 200 None
2026-03-30 10:54:25 [auto1.de] INFO: Scrape type for LA45338: 2
2026-03-30 10:54:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2c63081-3a81-5f10-9220-e797fc365bf7 with identifier: LA45338
2026-03-30 10:54:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2c63081-3a81-5f10-9220-e797fc365bf7 with scrape type 2
2026-03-30 10:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2c63081-3a81-5f10-9220-e797fc365bf7 with scrape type 2
2026-03-30 10:54:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2c63081-3a81-5f10-9220-e797fc365bf7, identifier: LA45338
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1f%252F4b1f8cd91adb8e3faf45c9f7048405c1%252Fpa%252FLT69845_30a0bdabfc512ce2ddc59e5f5b584975.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_30a0bdabfc512ce2ddc59e5f5b584975.jpg not downloaded yet
2026-03-30 10:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7c5d0>
2026-03-30 10:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F36%252F8936144a729b007e551f3390a8da2620%252Fpa%252FDA73332_ff25906a60113182cdee350c6c5e320b.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_ff25906a60113182cdee350c6c5e320b.jpg saved to cache
2026-03-30 10:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e
2026-03-30 10:54:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e, skipping ID generation
2026-03-30 10:54:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e with scrape type 1
2026-03-30 10:54:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e sending to next pipeline
2026-03-30 10:54:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e, identifier: DA73332
2026-03-30 10:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_79a62fbb56e76f63a660afa3d9d3ca9d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:25 [auto1.de] INFO: Found listing with ID: VP65266
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP65266%27 HTTP/1.1" 200 None
2026-03-30 10:54:25 [auto1.de] INFO: Scrape type for VP65266: 2
2026-03-30 10:54:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a32aa8f8-c983-546f-a3c7-6f5bcca8dad6 with identifier: VP65266
2026-03-30 10:54:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a32aa8f8-c983-546f-a3c7-6f5bcca8dad6 with scrape type 2
2026-03-30 10:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a32aa8f8-c983-546f-a3c7-6f5bcca8dad6 with scrape type 2
2026-03-30 10:54:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a32aa8f8-c983-546f-a3c7-6f5bcca8dad6, identifier: VP65266
2026-03-30 10:54:25 [auto1.de] INFO: Found listing with ID: MA62044
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA62044%27 HTTP/1.1" 200 None
2026-03-30 10:54:25 [auto1.de] INFO: Scrape type for MA62044: 2
2026-03-30 10:54:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a89fb981-8e68-5ec3-9196-e5058131be17 with identifier: MA62044
2026-03-30 10:54:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a89fb981-8e68-5ec3-9196-e5058131be17 with scrape type 2
2026-03-30 10:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a89fb981-8e68-5ec3-9196-e5058131be17 with scrape type 2
2026-03-30 10:54:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a89fb981-8e68-5ec3-9196-e5058131be17, identifier: MA62044
2026-03-30 10:54:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2c63081-3a81-5f10-9220-e797fc365bf7 with identifier: LA45338
2026-03-30 10:54:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2c63081-3a81-5f10-9220-e797fc365bf7 with identifier: LA45338
2026-03-30 10:54:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2c63081-3a81-5f10-9220-e797fc365bf7 with identifier: LA45338 to the API
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:53:13Z',
 'fuel_type': 'petrol',
 'id': 'f2c63081-3a81-5f10-9220-e797fc365bf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA45338',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 65940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-20',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA45338%27 HTTP/1.1" 200 None
2026-03-30 10:54:26 [auto1.de] INFO: Saving data for LA45338: {'auction_closing_time': 1774972393.0, 'created_time': 1773773431.75689, 'last_price_update_time': 1774868066.010359}
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA45338') HTTP/1.1" 204 0
2026-03-30 10:54:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e with identifier: DA73332
2026-03-30 10:54:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e with identifier: DA73332
2026-03-30 10:54:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e with identifier: DA73332 to the API
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_ff25906a60113182cdee350c6c5e320b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:19:46Z',
 'fuel_type': 'diesel',
 'id': 'dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA73332',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 108532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_b4d18db5c118ed799db315fe4c8413a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_bbd1e230630641876462c046c2ff25e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_67557e729e162290401bbe921277cc92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_fcfe413720b13ebf2c3f015e82391de7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_4ffcc61cc43244824187328ab3f6b103.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_7c597bc4cabc6f1d35944aab3f26df39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_f7fdf56eeded638346e82efb7916071b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_2c04caa74572c4603db1e0800937b51c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_113cee33d938c6a9650677f51bdfc939.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e/dd223ab7-7af3-5b24-b2d4-f3d4a5c76a2e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/36/8936144a729b007e551f3390a8da2620/pa/DA73332_ff25906a60113182cdee350c6c5e320b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-12',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 Blue-HDi Feel M',
 'transmission': 'manual',
 'trim': 'Feel M',
 'year': 2018}
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA73332%27 HTTP/1.1" 200 None
2026-03-30 10:54:26 [auto1.de] INFO: Saving data for DA73332: {'created_time': 1774868066.377583, 'last_price_update_time': 1774868066.377594, 'auction_closing_time': 1774970386.0}
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA73332') HTTP/1.1" 204 0
2026-03-30 10:54:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a32aa8f8-c983-546f-a3c7-6f5bcca8dad6 with identifier: VP65266
2026-03-30 10:54:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a32aa8f8-c983-546f-a3c7-6f5bcca8dad6 with identifier: VP65266
2026-03-30 10:54:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a32aa8f8-c983-546f-a3c7-6f5bcca8dad6 with identifier: VP65266 to the API
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:57:03Z',
 'fuel_type': 'diesel',
 'id': 'a32aa8f8-c983-546f-a3c7-6f5bcca8dad6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP65266',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 104089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-09',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2017}
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP65266%27 HTTP/1.1" 200 None
2026-03-30 10:54:26 [auto1.de] INFO: Saving data for VP65266: {'auction_closing_time': 1774972623.0, 'created_time': 1774348878.887277, 'last_price_update_time': 1774868066.730346}
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VP65266') HTTP/1.1" 204 0
2026-03-30 10:54:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a89fb981-8e68-5ec3-9196-e5058131be17 with identifier: MA62044
2026-03-30 10:54:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a89fb981-8e68-5ec3-9196-e5058131be17 with identifier: MA62044
2026-03-30 10:54:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a89fb981-8e68-5ec3-9196-e5058131be17 with identifier: MA62044 to the API
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:13:51Z',
 'fuel_type': 'diesel',
 'id': 'a89fb981-8e68-5ec3-9196-e5058131be17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA62044',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 39198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-05',
 'seller_name': None,
 'title': 'Audi Q5 40 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA62044%27 HTTP/1.1" 200 None
2026-03-30 10:54:27 [auto1.de] INFO: Saving data for MA62044: {'auction_closing_time': 1774970031.0, 'created_time': 1773427127.370296, 'last_price_update_time': 1774868067.496514}
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA62044') HTTP/1.1" 204 0
2026-03-30 10:54:27 [auto1.de] INFO: Found listing with ID: FD13282
2026-03-30 10:54:27 [auto1.de] INFO: Found listing with ID: FP43907
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP43907%27 HTTP/1.1" 200 None
2026-03-30 10:54:27 [auto1.de] INFO: Scrape type for FP43907: 2
2026-03-30 10:54:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75473fdb-1a33-5aed-bf2f-c442be43d5d7 with identifier: FP43907
2026-03-30 10:54:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75473fdb-1a33-5aed-bf2f-c442be43d5d7 with scrape type 2
2026-03-30 10:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75473fdb-1a33-5aed-bf2f-c442be43d5d7 with scrape type 2
2026-03-30 10:54:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75473fdb-1a33-5aed-bf2f-c442be43d5d7, identifier: FP43907
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1f%252F4b1f8cd91adb8e3faf45c9f7048405c1%252Fpa%252FLT69845_6ffca8a89def68e0b65a437810b6bddd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_6ffca8a89def68e0b65a437810b6bddd.jpg not downloaded yet
2026-03-30 10:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_a2693d6426b461d1da807a50bd727807.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:27 [auto1.de] INFO: Found listing with ID: LF99231
2026-03-30 10:54:27 [auto1.de] INFO: Found listing with ID: PW87460
2026-03-30 10:54:27 [auto1.de] INFO: Found listing with ID: FV18875
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV18875%27 HTTP/1.1" 200 None
2026-03-30 10:54:27 [auto1.de] INFO: Scrape type for FV18875: 2
2026-03-30 10:54:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98bbae2d-9906-5312-b2e2-53540539993b with identifier: FV18875
2026-03-30 10:54:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98bbae2d-9906-5312-b2e2-53540539993b with scrape type 2
2026-03-30 10:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98bbae2d-9906-5312-b2e2-53540539993b with scrape type 2
2026-03-30 10:54:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98bbae2d-9906-5312-b2e2-53540539993b, identifier: FV18875
2026-03-30 10:54:27 [auto1.de] INFO: Found listing with ID: CT54176
2026-03-30 10:54:27 [auto1.de] INFO: Found listing with ID: WR22738
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR22738%27 HTTP/1.1" 200 None
2026-03-30 10:54:27 [auto1.de] INFO: Scrape type for WR22738: 2
2026-03-30 10:54:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ffce5b4-bd0c-5557-9200-003f04e6ecf2 with identifier: WR22738
2026-03-30 10:54:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ffce5b4-bd0c-5557-9200-003f04e6ecf2 with scrape type 2
2026-03-30 10:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ffce5b4-bd0c-5557-9200-003f04e6ecf2 with scrape type 2
2026-03-30 10:54:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ffce5b4-bd0c-5557-9200-003f04e6ecf2, identifier: WR22738
2026-03-30 10:54:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75473fdb-1a33-5aed-bf2f-c442be43d5d7 with identifier: FP43907
2026-03-30 10:54:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75473fdb-1a33-5aed-bf2f-c442be43d5d7 with identifier: FP43907
2026-03-30 10:54:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75473fdb-1a33-5aed-bf2f-c442be43d5d7 with identifier: FP43907 to the API
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:10:19Z',
 'fuel_type': 'diesel',
 'id': '75473fdb-1a33-5aed-bf2f-c442be43d5d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP43907',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 191296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-19',
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP43907%27 HTTP/1.1" 200 None
2026-03-30 10:54:28 [auto1.de] INFO: Saving data for FP43907: {'auction_closing_time': 1774969819.0, 'created_time': 1773660576.542521, 'last_price_update_time': 1774868068.406957}
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP43907') HTTP/1.1" 204 0
2026-03-30 10:54:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98bbae2d-9906-5312-b2e2-53540539993b with identifier: FV18875
2026-03-30 10:54:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98bbae2d-9906-5312-b2e2-53540539993b with identifier: FV18875
2026-03-30 10:54:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98bbae2d-9906-5312-b2e2-53540539993b with identifier: FV18875 to the API
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-03-30 10:54:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:51:56Z',
 'fuel_type': 'petrol',
 'id': '98bbae2d-9906-5312-b2e2-53540539993b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV18875',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 0,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-30',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2008}
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV18875%27 HTTP/1.1" 200 None
2026-03-30 10:54:28 [auto1.de] INFO: Saving data for FV18875: {'auction_closing_time': 1774972316.0, 'created_time': 1774522291.704897, 'last_price_update_time': 1774868068.741818}
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV18875') HTTP/1.1" 204 0
2026-03-30 10:54:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ffce5b4-bd0c-5557-9200-003f04e6ecf2 with identifier: WR22738
2026-03-30 10:54:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ffce5b4-bd0c-5557-9200-003f04e6ecf2 with identifier: WR22738
2026-03-30 10:54:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ffce5b4-bd0c-5557-9200-003f04e6ecf2 with identifier: WR22738 to the API
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:47:36Z',
 'fuel_type': 'diesel',
 'id': '2ffce5b4-bd0c-5557-9200-003f04e6ecf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR22738',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 104978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seller_name': None,
 'title': 'Audi A4 40 TDI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR22738%27 HTTP/1.1" 200 None
2026-03-30 10:54:29 [auto1.de] INFO: Saving data for WR22738: {'auction_closing_time': 1774972056.0, 'created_time': 1774435179.332135, 'last_price_update_time': 1774868069.116505}
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR22738') HTTP/1.1" 204 0
2026-03-30 10:54:29 [auto1.de] INFO: Found listing with ID: LE88532
2026-03-30 10:54:29 [auto1.de] INFO: Found listing with ID: PL37483
2026-03-30 10:54:29 [auto1.de] INFO: Found listing with ID: SR56375
2026-03-30 10:54:29 [auto1.de] INFO: Found listing with ID: CP67844
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP67844%27 HTTP/1.1" 200 None
2026-03-30 10:54:29 [auto1.de] INFO: Scrape type for CP67844: 2
2026-03-30 10:54:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d541502-2a20-5051-b8ec-b218b8fa4755 with identifier: CP67844
2026-03-30 10:54:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d541502-2a20-5051-b8ec-b218b8fa4755 with scrape type 2
2026-03-30 10:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d541502-2a20-5051-b8ec-b218b8fa4755 with scrape type 2
2026-03-30 10:54:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d541502-2a20-5051-b8ec-b218b8fa4755, identifier: CP67844
2026-03-30 10:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_b0a902eb85d8ea3d04fee50a5bdf540e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:29 [auto1.de] INFO: Found listing with ID: KP08574
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP08574%27 HTTP/1.1" 200 None
2026-03-30 10:54:29 [auto1.de] INFO: Scrape type for KP08574: 2
2026-03-30 10:54:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54841e71-f2d2-52aa-821f-45aae9be12b9 with identifier: KP08574
2026-03-30 10:54:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54841e71-f2d2-52aa-821f-45aae9be12b9 with scrape type 2
2026-03-30 10:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54841e71-f2d2-52aa-821f-45aae9be12b9 with scrape type 2
2026-03-30 10:54:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54841e71-f2d2-52aa-821f-45aae9be12b9, identifier: KP08574
2026-03-30 10:54:29 [auto1.de] INFO: Found listing with ID: RU48636
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU48636%27 HTTP/1.1" 200 None
2026-03-30 10:54:29 [auto1.de] INFO: Scrape type for RU48636: 2
2026-03-30 10:54:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d373ac33-ac01-53b7-80f8-b1fb85856766 with identifier: RU48636
2026-03-30 10:54:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d373ac33-ac01-53b7-80f8-b1fb85856766 with scrape type 2
2026-03-30 10:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d373ac33-ac01-53b7-80f8-b1fb85856766 with scrape type 2
2026-03-30 10:54:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d373ac33-ac01-53b7-80f8-b1fb85856766, identifier: RU48636
2026-03-30 10:54:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d541502-2a20-5051-b8ec-b218b8fa4755 with identifier: CP67844
2026-03-30 10:54:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d541502-2a20-5051-b8ec-b218b8fa4755 with identifier: CP67844
2026-03-30 10:54:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d541502-2a20-5051-b8ec-b218b8fa4755 with identifier: CP67844 to the API
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 435,
 'expiration_date': '2026-03-31T15:51:52Z',
 'fuel_type': 'petrol',
 'id': '3d541502-2a20-5051-b8ec-b218b8fa4755',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP67844',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GL-Klasse',
 'odometer': 193380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-27',
 'seller_name': None,
 'title': 'Mercedes-Benz GL-Klasse GL 500 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2013}
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP67844%27 HTTP/1.1" 200 None
2026-03-30 10:54:29 [auto1.de] INFO: Saving data for CP67844: {'auction_closing_time': 1774972312.0, 'created_time': 1773688755.097876, 'last_price_update_time': 1774868069.91017}
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP67844') HTTP/1.1" 204 0
2026-03-30 10:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42780d0>
2026-03-30 10:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_982e367f-53e6-5356-9bae-02a3bd2e6369/982e367f-53e6-5356-9bae-02a3bd2e6369_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1f%252F4b1f8cd91adb8e3faf45c9f7048405c1%252Fpa%252FLT69845_79a62fbb56e76f63a660afa3d9d3ca9d.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_79a62fbb56e76f63a660afa3d9d3ca9d.jpg saved to cache
2026-03-30 10:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 982e367f-53e6-5356-9bae-02a3bd2e6369
2026-03-30 10:54:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54841e71-f2d2-52aa-821f-45aae9be12b9 with identifier: KP08574
2026-03-30 10:54:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54841e71-f2d2-52aa-821f-45aae9be12b9 with identifier: KP08574
2026-03-30 10:54:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54841e71-f2d2-52aa-821f-45aae9be12b9 with identifier: KP08574 to the API
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:23:56Z',
 'fuel_type': 'petrol',
 'id': '54841e71-f2d2-52aa-821f-45aae9be12b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP08574',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 53436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-03',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2010}
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP08574%27 HTTP/1.1" 200 None
2026-03-30 10:54:30 [auto1.de] INFO: Saving data for KP08574: {'auction_closing_time': 1774970636.0, 'created_time': 1774380003.041197, 'last_price_update_time': 1774868070.281985}
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP08574') HTTP/1.1" 204 0
2026-03-30 10:54:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d373ac33-ac01-53b7-80f8-b1fb85856766 with identifier: RU48636
2026-03-30 10:54:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d373ac33-ac01-53b7-80f8-b1fb85856766 with identifier: RU48636
2026-03-30 10:54:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d373ac33-ac01-53b7-80f8-b1fb85856766 with identifier: RU48636 to the API
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:13:24Z',
 'fuel_type': 'diesel',
 'id': 'd373ac33-ac01-53b7-80f8-b1fb85856766',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU48636',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 259817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-06-30',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.9 TDI Special',
 'transmission': 'manual',
 'trim': 'Special',
 'year': 2002}
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU48636%27 HTTP/1.1" 200 None
2026-03-30 10:54:30 [auto1.de] INFO: Saving data for RU48636: {'auction_closing_time': 1774970004.0, 'created_time': 1774262475.394517, 'last_price_update_time': 1774868070.607826}
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU48636') HTTP/1.1" 204 0
2026-03-30 10:54:30 [auto1.de] INFO: Found listing with ID: JW60141
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW60141%27 HTTP/1.1" 200 None
2026-03-30 10:54:30 [auto1.de] INFO: Scrape type for JW60141: 2
2026-03-30 10:54:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf40b359-fc9d-5229-94b8-357149240425 with identifier: JW60141
2026-03-30 10:54:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf40b359-fc9d-5229-94b8-357149240425 with scrape type 2
2026-03-30 10:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf40b359-fc9d-5229-94b8-357149240425 with scrape type 2
2026-03-30 10:54:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf40b359-fc9d-5229-94b8-357149240425, identifier: JW60141
2026-03-30 10:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f432a5d0>
2026-03-30 10:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_982e367f-53e6-5356-9bae-02a3bd2e6369/982e367f-53e6-5356-9bae-02a3bd2e6369_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1f%252F4b1f8cd91adb8e3faf45c9f7048405c1%252Fpa%252FLT69845_a2693d6426b461d1da807a50bd727807.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_a2693d6426b461d1da807a50bd727807.jpg saved to cache
2026-03-30 10:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 982e367f-53e6-5356-9bae-02a3bd2e6369
2026-03-30 10:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_30a0bdabfc512ce2ddc59e5f5b584975.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:30 [auto1.de] INFO: Found listing with ID: JE85586
2026-03-30 10:54:30 [auto1.de] INFO: Found listing with ID: GU24584
2026-03-30 10:54:30 [auto1.de] INFO: Found listing with ID: SC69057
2026-03-30 10:54:30 [auto1.de] INFO: Found listing with ID: GZ10091
2026-03-30 10:54:30 [auto1.de] INFO: Found listing with ID: KX05344
2026-03-30 10:54:30 [auto1.de] INFO: Found listing with ID: LT00985
2026-03-30 10:54:30 [auto1.de] INFO: Found listing with ID: PN40620
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN40620%27 HTTP/1.1" 200 None
2026-03-30 10:54:30 [auto1.de] INFO: Scrape type for PN40620: 2
2026-03-30 10:54:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d01ecc69-26b9-570a-99d5-4381e3fbb1ef with identifier: PN40620
2026-03-30 10:54:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d01ecc69-26b9-570a-99d5-4381e3fbb1ef with scrape type 2
2026-03-30 10:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d01ecc69-26b9-570a-99d5-4381e3fbb1ef with scrape type 2
2026-03-30 10:54:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d01ecc69-26b9-570a-99d5-4381e3fbb1ef, identifier: PN40620
2026-03-30 10:54:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf40b359-fc9d-5229-94b8-357149240425 with identifier: JW60141
2026-03-30 10:54:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf40b359-fc9d-5229-94b8-357149240425 with identifier: JW60141
2026-03-30 10:54:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf40b359-fc9d-5229-94b8-357149240425 with identifier: JW60141 to the API
2026-03-30 10:54:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 326,
 'expiration_date': '2026-03-31T15:21:18Z',
 'fuel_type': 'hybrid',
 'id': 'cf40b359-fc9d-5229-94b8-357149240425',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW60141',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 4851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-07-29',
 'seller_name': None,
 'title': 'BMW X1 xDrive 30e',
 'transmission': 'automatic',
 'trim': '',
 'year': 2025}
2026-03-30 10:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW60141%27 HTTP/1.1" 200 None
2026-03-30 10:54:31 [auto1.de] INFO: Saving data for JW60141: {'auction_closing_time': 1774970478.0, 'created_time': 1773345630.829725, 'last_price_update_time': 1774868071.929268}
2026-03-30 10:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW60141') HTTP/1.1" 204 0
2026-03-30 10:54:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d01ecc69-26b9-570a-99d5-4381e3fbb1ef with identifier: PN40620
2026-03-30 10:54:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d01ecc69-26b9-570a-99d5-4381e3fbb1ef with identifier: PN40620
2026-03-30 10:54:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d01ecc69-26b9-570a-99d5-4381e3fbb1ef with identifier: PN40620 to the API
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:51:04Z',
 'fuel_type': 'diesel',
 'id': 'd01ecc69-26b9-570a-99d5-4381e3fbb1ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN40620',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 203863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-07',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2016}
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN40620%27 HTTP/1.1" 200 None
2026-03-30 10:54:32 [auto1.de] INFO: Saving data for PN40620: {'auction_closing_time': 1774972264.0, 'created_time': 1774435228.740791, 'last_price_update_time': 1774868072.430459}
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN40620') HTTP/1.1" 204 0
2026-03-30 10:54:32 [auto1.de] INFO: Found listing with ID: LD36602
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD36602%27 HTTP/1.1" 200 None
2026-03-30 10:54:32 [auto1.de] INFO: Scrape type for LD36602: 2
2026-03-30 10:54:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5abe55d-9b7c-568f-b8c5-28889928b7b8 with identifier: LD36602
2026-03-30 10:54:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5abe55d-9b7c-568f-b8c5-28889928b7b8 with scrape type 2
2026-03-30 10:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5abe55d-9b7c-568f-b8c5-28889928b7b8 with scrape type 2
2026-03-30 10:54:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5abe55d-9b7c-568f-b8c5-28889928b7b8, identifier: LD36602
2026-03-30 10:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f420f2d0>
2026-03-30 10:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_982e367f-53e6-5356-9bae-02a3bd2e6369/982e367f-53e6-5356-9bae-02a3bd2e6369_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1f%252F4b1f8cd91adb8e3faf45c9f7048405c1%252Fpa%252FLT69845_b0a902eb85d8ea3d04fee50a5bdf540e.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_b0a902eb85d8ea3d04fee50a5bdf540e.jpg saved to cache
2026-03-30 10:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 982e367f-53e6-5356-9bae-02a3bd2e6369
2026-03-30 10:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_6ffca8a89def68e0b65a437810b6bddd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:32 [auto1.de] INFO: Found listing with ID: MJ50234
2026-03-30 10:54:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5abe55d-9b7c-568f-b8c5-28889928b7b8 with identifier: LD36602
2026-03-30 10:54:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5abe55d-9b7c-568f-b8c5-28889928b7b8 with identifier: LD36602
2026-03-30 10:54:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5abe55d-9b7c-568f-b8c5-28889928b7b8 with identifier: LD36602 to the API
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:26:54Z',
 'fuel_type': 'diesel',
 'id': 'd5abe55d-9b7c-568f-b8c5-28889928b7b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD36602',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 127528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Soleil',
 'transmission': 'automatic',
 'trim': 'Soleil',
 'year': 2019}
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD36602%27 HTTP/1.1" 200 None
2026-03-30 10:54:32 [auto1.de] INFO: Saving data for LD36602: {'auction_closing_time': 1774970814.0, 'created_time': 1773661816.780897, 'last_price_update_time': 1774868072.974534}
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD36602') HTTP/1.1" 204 0
2026-03-30 10:54:32 [auto1.de] INFO: Found listing with ID: XH94103
2026-03-30 10:54:32 [auto1.de] INFO: Found listing with ID: LW48159
2026-03-30 10:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW48159%27 HTTP/1.1" 200 None
2026-03-30 10:54:33 [auto1.de] INFO: Scrape type for LW48159: 2
2026-03-30 10:54:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7caad671-d630-5a8d-910a-969ac1e72ce6 with identifier: LW48159
2026-03-30 10:54:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7caad671-d630-5a8d-910a-969ac1e72ce6 with scrape type 2
2026-03-30 10:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7caad671-d630-5a8d-910a-969ac1e72ce6 with scrape type 2
2026-03-30 10:54:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7caad671-d630-5a8d-910a-969ac1e72ce6, identifier: LW48159
2026-03-30 10:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WM67864> (referer: https://www.auto1.com/v1/car-details-view/WM67864/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f429cf10>
2026-03-30 10:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_982e367f-53e6-5356-9bae-02a3bd2e6369/982e367f-53e6-5356-9bae-02a3bd2e6369_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1f%252F4b1f8cd91adb8e3faf45c9f7048405c1%252Fpa%252FLT69845_30a0bdabfc512ce2ddc59e5f5b584975.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_30a0bdabfc512ce2ddc59e5f5b584975.jpg saved to cache
2026-03-30 10:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 982e367f-53e6-5356-9bae-02a3bd2e6369
2026-03-30 10:54:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7caad671-d630-5a8d-910a-969ac1e72ce6 with identifier: LW48159
2026-03-30 10:54:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7caad671-d630-5a8d-910a-969ac1e72ce6 with identifier: LW48159
2026-03-30 10:54:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7caad671-d630-5a8d-910a-969ac1e72ce6 with identifier: LW48159 to the API
2026-03-30 10:54:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-31T15:32:40Z',
 'fuel_type': 'diesel',
 'id': '7caad671-d630-5a8d-910a-969ac1e72ce6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW48159',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 190446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-16',
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi Energy L1H1 2,7t Expression',
 'transmission': 'manual',
 'trim': 'L1H1 2,7t Expression',
 'year': 2016}
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW48159%27 HTTP/1.1" 200 None
2026-03-30 10:54:34 [auto1.de] INFO: Saving data for LW48159: {'auction_closing_time': 1774971160.0, 'created_time': 1774377078.377557, 'last_price_update_time': 1774868074.095778}
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW48159') HTTP/1.1" 204 0
2026-03-30 10:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LU03314> (referer: https://www.auto1.com/v1/car-details-view/LU03314/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:34 [auto1.de] INFO: Found listing with ID: CX13675
2026-03-30 10:54:34 [auto1.de] INFO: Found listing with ID: WP33305
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP33305%27 HTTP/1.1" 200 None
2026-03-30 10:54:34 [auto1.de] INFO: Scrape type for WP33305: 2
2026-03-30 10:54:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0deadc9a-2f2c-598e-b2cb-d90f3cd71265 with identifier: WP33305
2026-03-30 10:54:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0deadc9a-2f2c-598e-b2cb-d90f3cd71265 with scrape type 2
2026-03-30 10:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0deadc9a-2f2c-598e-b2cb-d90f3cd71265 with scrape type 2
2026-03-30 10:54:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0deadc9a-2f2c-598e-b2cb-d90f3cd71265, identifier: WP33305
2026-03-30 10:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NA02612> (referer: https://www.auto1.com/v1/car-details-view/NA02612/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee41a390>
2026-03-30 10:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_982e367f-53e6-5356-9bae-02a3bd2e6369/982e367f-53e6-5356-9bae-02a3bd2e6369_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1f%252F4b1f8cd91adb8e3faf45c9f7048405c1%252Fpa%252FLT69845_6ffca8a89def68e0b65a437810b6bddd.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_6ffca8a89def68e0b65a437810b6bddd.jpg saved to cache
2026-03-30 10:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 982e367f-53e6-5356-9bae-02a3bd2e6369
2026-03-30 10:54:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 982e367f-53e6-5356-9bae-02a3bd2e6369, skipping ID generation
2026-03-30 10:54:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 982e367f-53e6-5356-9bae-02a3bd2e6369 with scrape type 1
2026-03-30 10:54:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 982e367f-53e6-5356-9bae-02a3bd2e6369 sending to next pipeline
2026-03-30 10:54:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 982e367f-53e6-5356-9bae-02a3bd2e6369, identifier: LT69845
2026-03-30 10:54:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0deadc9a-2f2c-598e-b2cb-d90f3cd71265 with identifier: WP33305
2026-03-30 10:54:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0deadc9a-2f2c-598e-b2cb-d90f3cd71265 with identifier: WP33305
2026-03-30 10:54:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0deadc9a-2f2c-598e-b2cb-d90f3cd71265 with identifier: WP33305 to the API
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 575,
 'expiration_date': '2026-03-31T15:39:20Z',
 'fuel_type': 'petrol',
 'id': '0deadc9a-2f2c-598e-b2cb-d90f3cd71265',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP33305',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 114017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-05',
 'seller_name': None,
 'title': 'BMW X6 M',
 'transmission': 'automatic',
 'trim': 'BW',
 'year': 2015}
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP33305%27 HTTP/1.1" 200 None
2026-03-30 10:54:34 [auto1.de] INFO: Saving data for WP33305: {'auction_closing_time': 1774971560.0, 'created_time': 1773134914.126513, 'last_price_update_time': 1774868074.766304}
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP33305') HTTP/1.1" 204 0
2026-03-30 10:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 982e367f-53e6-5356-9bae-02a3bd2e6369 with identifier: LT69845
2026-03-30 10:54:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 982e367f-53e6-5356-9bae-02a3bd2e6369 with identifier: LT69845
2026-03-30 10:54:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 982e367f-53e6-5356-9bae-02a3bd2e6369 with identifier: LT69845 to the API
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_6ffca8a89def68e0b65a437810b6bddd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-31T15:54:38Z',
 'fuel_type': 'petrol',
 'id': '982e367f-53e6-5356-9bae-02a3bd2e6369',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT69845',
 'listing': 'auction',
 'location': 'DE, Hagen',
 'make': 'Saab',
 'model': '9-3',
 'odometer': 175723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982e367f-53e6-5356-9bae-02a3bd2e6369/982e367f-53e6-5356-9bae-02a3bd2e6369_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_79a62fbb56e76f63a660afa3d9d3ca9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982e367f-53e6-5356-9bae-02a3bd2e6369/982e367f-53e6-5356-9bae-02a3bd2e6369_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_a2693d6426b461d1da807a50bd727807.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982e367f-53e6-5356-9bae-02a3bd2e6369/982e367f-53e6-5356-9bae-02a3bd2e6369_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_b0a902eb85d8ea3d04fee50a5bdf540e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982e367f-53e6-5356-9bae-02a3bd2e6369/982e367f-53e6-5356-9bae-02a3bd2e6369_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_30a0bdabfc512ce2ddc59e5f5b584975.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982e367f-53e6-5356-9bae-02a3bd2e6369/982e367f-53e6-5356-9bae-02a3bd2e6369_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/1f/4b1f8cd91adb8e3faf45c9f7048405c1/pa/LT69845_6ffca8a89def68e0b65a437810b6bddd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Saab 9-3 2.0 T Arc',
 'transmission': 'manual',
 'trim': 'T Arc',
 'year': 2005}
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT69845%27 HTTP/1.1" 200 None
2026-03-30 10:54:35 [auto1.de] INFO: Saving data for LT69845: {'created_time': 1774868075.177328, 'last_price_update_time': 1774868075.177338, 'auction_closing_time': 1774972478.0}
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT69845') HTTP/1.1" 204 0
2026-03-30 10:54:35 [auto1.de] INFO: Found listing with ID: RZ13865
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ13865%27 HTTP/1.1" 200 None
2026-03-30 10:54:35 [auto1.de] INFO: Scrape type for RZ13865: 2
2026-03-30 10:54:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89c583e8-d036-5994-9405-6a89a2971632 with identifier: RZ13865
2026-03-30 10:54:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89c583e8-d036-5994-9405-6a89a2971632 with scrape type 2
2026-03-30 10:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89c583e8-d036-5994-9405-6a89a2971632 with scrape type 2
2026-03-30 10:54:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89c583e8-d036-5994-9405-6a89a2971632, identifier: RZ13865
2026-03-30 10:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC07507/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d1b893a-e560-50f2-8819-5971416bd34d with identifier: WM67864
2026-03-30 10:54:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d1b893a-e560-50f2-8819-5971416bd34d with scrape type 1
2026-03-30 10:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8d1b893a-e560-50f2-8819-5971416bd34d
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F15%252F9415ce8f5a5d0350952620118b3e47e8%252Fpa%252FWM67864_c9c7f523c727e23a5a05a7b12638ecf6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_c9c7f523c727e23a5a05a7b12638ecf6.jpg not downloaded yet
2026-03-30 10:54:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89c583e8-d036-5994-9405-6a89a2971632 with identifier: RZ13865
2026-03-30 10:54:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89c583e8-d036-5994-9405-6a89a2971632 with identifier: RZ13865
2026-03-30 10:54:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89c583e8-d036-5994-9405-6a89a2971632 with identifier: RZ13865 to the API
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:31:41Z',
 'fuel_type': 'diesel',
 'id': '89c583e8-d036-5994-9405-6a89a2971632',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ13865',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 145870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-13',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro Design',
 'transmission': 'automatic',
 'trim': 'quattro Design',
 'year': 2018}
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ13865%27 HTTP/1.1" 200 None
2026-03-30 10:54:35 [auto1.de] INFO: Saving data for RZ13865: {'auction_closing_time': 1774971101.0, 'created_time': 1773307980.318219, 'last_price_update_time': 1774868075.677768}
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ13865') HTTP/1.1" 204 0
2026-03-30 10:54:35 [auto1.de] INFO: Found listing with ID: WB34474
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB34474%27 HTTP/1.1" 200 None
2026-03-30 10:54:35 [auto1.de] INFO: Scrape type for WB34474: 2
2026-03-30 10:54:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b7647c7-20dc-599a-9cf4-cb937c09b661 with identifier: WB34474
2026-03-30 10:54:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b7647c7-20dc-599a-9cf4-cb937c09b661 with scrape type 2
2026-03-30 10:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b7647c7-20dc-599a-9cf4-cb937c09b661 with scrape type 2
2026-03-30 10:54:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b7647c7-20dc-599a-9cf4-cb937c09b661, identifier: WB34474
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F15%252F9415ce8f5a5d0350952620118b3e47e8%252Fpa%252FWM67864_50d12adc07152b88d671edaa614969a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_50d12adc07152b88d671edaa614969a4.jpg not downloaded yet
2026-03-30 10:54:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3 with identifier: LU03314
2026-03-30 10:54:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3 with scrape type 1
2026-03-30 10:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_56ea32ca54751cb62d8a54c8b26a8c93.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_56ea32ca54751cb62d8a54c8b26a8c93.jpg not downloaded yet
2026-03-30 10:54:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 596a498b-0259-54c0-bdd0-7cfc5c37cdae with identifier: NA02612
2026-03-30 10:54:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 596a498b-0259-54c0-bdd0-7cfc5c37cdae with scrape type 1
2026-03-30 10:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 596a498b-0259-54c0-bdd0-7cfc5c37cdae
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F10%252F831039dd20f44c16b99bbc2816cd38ab%252Fpa%252FNA02612_1a7dc0919fdd5ace20420b8bbf34649d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_1a7dc0919fdd5ace20420b8bbf34649d.jpg already downloaded
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F10%252F831039dd20f44c16b99bbc2816cd38ab%252Fpa%252FNA02612_0a94e72e3bb97b5cf709f8e751085de3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_0a94e72e3bb97b5cf709f8e751085de3.jpg already downloaded
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F10%252F831039dd20f44c16b99bbc2816cd38ab%252Fpa%252FNA02612_2a3020ec2222100f6ba33d8b8a473999.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_2a3020ec2222100f6ba33d8b8a473999.jpg already downloaded
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F10%252F831039dd20f44c16b99bbc2816cd38ab%252Fpa%252FNA02612_52c4c65ff39b965c5de1d76901208a67.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_52c4c65ff39b965c5de1d76901208a67.jpg already downloaded
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F10%252F831039dd20f44c16b99bbc2816cd38ab%252Fpa%252FNA02612_6fa3fa5751c2ab26df7a62db606f6a9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_6fa3fa5751c2ab26df7a62db606f6a9f.jpg already downloaded
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F10%252F831039dd20f44c16b99bbc2816cd38ab%252Fpa%252FNA02612_27d6e86c9fa8108c04b646ccfb2e5b6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_27d6e86c9fa8108c04b646ccfb2e5b6f.jpg already downloaded
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F10%252F831039dd20f44c16b99bbc2816cd38ab%252Fpa%252FNA02612_0c64246be1140a5d79210b1310c88e23.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_0c64246be1140a5d79210b1310c88e23.jpg already downloaded
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F10%252F831039dd20f44c16b99bbc2816cd38ab%252Fpa%252FNA02612_57d14e257de5f9e6acd6c21ccd9dd6a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_57d14e257de5f9e6acd6c21ccd9dd6a2.jpg already downloaded
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F10%252F831039dd20f44c16b99bbc2816cd38ab%252Fpa%252FNA02612_9cb12622f16254ffa984f3fa87c6f45b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_9cb12622f16254ffa984f3fa87c6f45b.jpg already downloaded
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F10%252F831039dd20f44c16b99bbc2816cd38ab%252Fpa%252FNA02612_cbd8ed250cd386cb8a2d8110156f9d53.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_cbd8ed250cd386cb8a2d8110156f9d53.jpg already downloaded
2026-03-30 10:54:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 596a498b-0259-54c0-bdd0-7cfc5c37cdae, identifier: NA02612
2026-03-30 10:54:36 [auto1.de] INFO: Channel: 24h | Page: 51 | totalHits: 9523 | hits on page: 40
2026-03-30 10:54:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b7647c7-20dc-599a-9cf4-cb937c09b661 with identifier: WB34474
2026-03-30 10:54:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b7647c7-20dc-599a-9cf4-cb937c09b661 with identifier: WB34474
2026-03-30 10:54:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b7647c7-20dc-599a-9cf4-cb937c09b661 with identifier: WB34474 to the API
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:15:52Z',
 'fuel_type': 'diesel',
 'id': '1b7647c7-20dc-599a-9cf4-cb937c09b661',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB34474',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 180998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-16',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB34474%27 HTTP/1.1" 200 None
2026-03-30 10:54:36 [auto1.de] INFO: Saving data for WB34474: {'auction_closing_time': 1774970152.0, 'created_time': 1773302843.623825, 'last_price_update_time': 1774868076.605787}
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB34474') HTTP/1.1" 204 0
2026-03-30 10:54:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 596a498b-0259-54c0-bdd0-7cfc5c37cdae with identifier: NA02612
2026-03-30 10:54:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 596a498b-0259-54c0-bdd0-7cfc5c37cdae with identifier: NA02612
2026-03-30 10:54:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 596a498b-0259-54c0-bdd0-7cfc5c37cdae with identifier: NA02612 to the API
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NA02612>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 72,
 'expiration_date': '2026-03-31T15:29:13Z',
 'fuel_type': 'petrol',
 'id': '596a498b-0259-54c0-bdd0-7cfc5c37cdae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA02612',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 53451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_1a7dc0919fdd5ace20420b8bbf34649d.jpg',
                'https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_0a94e72e3bb97b5cf709f8e751085de3.jpg',
                'https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_2a3020ec2222100f6ba33d8b8a473999.jpg',
                'https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_52c4c65ff39b965c5de1d76901208a67.jpg',
                'https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_6fa3fa5751c2ab26df7a62db606f6a9f.jpg',
                'https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_27d6e86c9fa8108c04b646ccfb2e5b6f.jpg',
                'https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_0c64246be1140a5d79210b1310c88e23.jpg',
                'https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_57d14e257de5f9e6acd6c21ccd9dd6a2.jpg',
                'https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_9cb12622f16254ffa984f3fa87c6f45b.jpg',
                'https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_cbd8ed250cd386cb8a2d8110156f9d53.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_596a498b-0259-54c0-bdd0-7cfc5c37cdae/596a498b-0259-54c0-bdd0-7cfc5c37cdae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3217759,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_1a7dc0919fdd5ace20420b8bbf34649d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_596a498b-0259-54c0-bdd0-7cfc5c37cdae/596a498b-0259-54c0-bdd0-7cfc5c37cdae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2851150,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_0a94e72e3bb97b5cf709f8e751085de3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_596a498b-0259-54c0-bdd0-7cfc5c37cdae/596a498b-0259-54c0-bdd0-7cfc5c37cdae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_2a3020ec2222100f6ba33d8b8a473999.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_596a498b-0259-54c0-bdd0-7cfc5c37cdae/596a498b-0259-54c0-bdd0-7cfc5c37cdae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2740942,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_52c4c65ff39b965c5de1d76901208a67.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_596a498b-0259-54c0-bdd0-7cfc5c37cdae/596a498b-0259-54c0-bdd0-7cfc5c37cdae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_6fa3fa5751c2ab26df7a62db606f6a9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_596a498b-0259-54c0-bdd0-7cfc5c37cdae/596a498b-0259-54c0-bdd0-7cfc5c37cdae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_27d6e86c9fa8108c04b646ccfb2e5b6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_596a498b-0259-54c0-bdd0-7cfc5c37cdae/596a498b-0259-54c0-bdd0-7cfc5c37cdae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3009770,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_0c64246be1140a5d79210b1310c88e23.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_596a498b-0259-54c0-bdd0-7cfc5c37cdae/596a498b-0259-54c0-bdd0-7cfc5c37cdae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_57d14e257de5f9e6acd6c21ccd9dd6a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_596a498b-0259-54c0-bdd0-7cfc5c37cdae/596a498b-0259-54c0-bdd0-7cfc5c37cdae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3253050,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_9cb12622f16254ffa984f3fa87c6f45b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_596a498b-0259-54c0-bdd0-7cfc5c37cdae/596a498b-0259-54c0-bdd0-7cfc5c37cdae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3220578,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/10/831039dd20f44c16b99bbc2816cd38ab/pa/NA02612_cbd8ed250cd386cb8a2d8110156f9d53.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-23',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 X-Play club',
 'transmission': 'manual',
 'trim': 'X-Play club',
 'year': 2019}
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA02612%27 HTTP/1.1" 200 None
2026-03-30 10:54:37 [auto1.de] INFO: Saving data for NA02612: {'created_time': 1774868077.090916, 'last_price_update_time': 1774868077.090927, 'auction_closing_time': 1774970953.0}
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA02612') HTTP/1.1" 204 0
2026-03-30 10:54:37 [auto1.de] INFO: Found listing with ID: MD28081
2026-03-30 10:54:37 [auto1.de] INFO: Found listing with ID: ES68106
2026-03-30 10:54:37 [auto1.de] INFO: Found listing with ID: FN23082
2026-03-30 10:54:37 [auto1.de] INFO: Found listing with ID: HS86233
2026-03-30 10:54:37 [auto1.de] INFO: Found listing with ID: DE92254
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE92254%27 HTTP/1.1" 200 None
2026-03-30 10:54:37 [auto1.de] INFO: Scrape type for DE92254: 2
2026-03-30 10:54:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 150a7f73-3cff-5d05-a2bc-2111649a9ae9 with identifier: DE92254
2026-03-30 10:54:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 150a7f73-3cff-5d05-a2bc-2111649a9ae9 with scrape type 2
2026-03-30 10:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 150a7f73-3cff-5d05-a2bc-2111649a9ae9 with scrape type 2
2026-03-30 10:54:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 150a7f73-3cff-5d05-a2bc-2111649a9ae9, identifier: DE92254
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F15%252F9415ce8f5a5d0350952620118b3e47e8%252Fpa%252FWM67864_760b319017afb78511547c1313fa1966.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_760b319017afb78511547c1313fa1966.jpg not downloaded yet
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_81cf502c577e29a24dedb07e599eb977.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_81cf502c577e29a24dedb07e599eb977.jpg not downloaded yet
2026-03-30 10:54:37 [auto1.de] INFO: Found listing with ID: HW93090
2026-03-30 10:54:37 [auto1.de] INFO: Found listing with ID: XW62515
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW62515%27 HTTP/1.1" 200 None
2026-03-30 10:54:37 [auto1.de] INFO: Scrape type for XW62515: 2
2026-03-30 10:54:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77c17b73-e08e-5deb-8994-0fc0abed8263 with identifier: XW62515
2026-03-30 10:54:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77c17b73-e08e-5deb-8994-0fc0abed8263 with scrape type 2
2026-03-30 10:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77c17b73-e08e-5deb-8994-0fc0abed8263 with scrape type 2
2026-03-30 10:54:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77c17b73-e08e-5deb-8994-0fc0abed8263, identifier: XW62515
2026-03-30 10:54:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 150a7f73-3cff-5d05-a2bc-2111649a9ae9 with identifier: DE92254
2026-03-30 10:54:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 150a7f73-3cff-5d05-a2bc-2111649a9ae9 with identifier: DE92254
2026-03-30 10:54:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 150a7f73-3cff-5d05-a2bc-2111649a9ae9 with identifier: DE92254 to the API
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:52:32Z',
 'fuel_type': 'diesel',
 'id': '150a7f73-3cff-5d05-a2bc-2111649a9ae9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE92254',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 148388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-19',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE92254%27 HTTP/1.1" 200 None
2026-03-30 10:54:37 [auto1.de] INFO: Saving data for DE92254: {'auction_closing_time': 1774972352.0, 'created_time': 1774467382.399256, 'last_price_update_time': 1774868077.78342}
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE92254') HTTP/1.1" 204 0
2026-03-30 10:54:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77c17b73-e08e-5deb-8994-0fc0abed8263 with identifier: XW62515
2026-03-30 10:54:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77c17b73-e08e-5deb-8994-0fc0abed8263 with identifier: XW62515
2026-03-30 10:54:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77c17b73-e08e-5deb-8994-0fc0abed8263 with identifier: XW62515 to the API
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:12:46Z',
 'fuel_type': 'petrol',
 'id': '77c17b73-e08e-5deb-8994-0fc0abed8263',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW62515',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 128537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-28',
 'seller_name': None,
 'title': 'Hyundai i20 1.4 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2009}
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW62515%27 HTTP/1.1" 200 None
2026-03-30 10:54:38 [auto1.de] INFO: Saving data for XW62515: {'auction_closing_time': 1774969966.0, 'created_time': 1773945996.480906, 'last_price_update_time': 1774868078.221824}
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW62515') HTTP/1.1" 204 0
2026-03-30 10:54:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:38 [auto1.de] INFO: Found listing with ID: FF42934
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF42934%27 HTTP/1.1" 200 None
2026-03-30 10:54:38 [auto1.de] INFO: Scrape type for FF42934: 2
2026-03-30 10:54:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 206a553a-dd2c-527b-a3f5-a13f6b77a663 with identifier: FF42934
2026-03-30 10:54:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 206a553a-dd2c-527b-a3f5-a13f6b77a663 with scrape type 2
2026-03-30 10:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 206a553a-dd2c-527b-a3f5-a13f6b77a663 with scrape type 2
2026-03-30 10:54:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 206a553a-dd2c-527b-a3f5-a13f6b77a663, identifier: FF42934
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F15%252F9415ce8f5a5d0350952620118b3e47e8%252Fpa%252FWM67864_7c3514dc75dc3872380d941a126eac04.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_7c3514dc75dc3872380d941a126eac04.jpg not downloaded yet
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_cdfd7badad832747b16be6e097204b1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_cdfd7badad832747b16be6e097204b1b.jpg not downloaded yet
2026-03-30 10:54:38 [auto1.de] INFO: Found listing with ID: NC54536
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC54536%27 HTTP/1.1" 200 None
2026-03-30 10:54:38 [auto1.de] INFO: Scrape type for NC54536: 2
2026-03-30 10:54:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7050b51a-5b5f-5d5c-9b4d-a2e92c134786 with identifier: NC54536
2026-03-30 10:54:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7050b51a-5b5f-5d5c-9b4d-a2e92c134786 with scrape type 2
2026-03-30 10:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7050b51a-5b5f-5d5c-9b4d-a2e92c134786 with scrape type 2
2026-03-30 10:54:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7050b51a-5b5f-5d5c-9b4d-a2e92c134786, identifier: NC54536
2026-03-30 10:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_c9c7f523c727e23a5a05a7b12638ecf6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 206a553a-dd2c-527b-a3f5-a13f6b77a663 with identifier: FF42934
2026-03-30 10:54:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 206a553a-dd2c-527b-a3f5-a13f6b77a663 with identifier: FF42934
2026-03-30 10:54:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 206a553a-dd2c-527b-a3f5-a13f6b77a663 with identifier: FF42934 to the API
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:19:39Z',
 'fuel_type': 'diesel',
 'id': '206a553a-dd2c-527b-a3f5-a13f6b77a663',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF42934',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 170220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-09',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2020}
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF42934%27 HTTP/1.1" 200 None
2026-03-30 10:54:38 [auto1.de] INFO: Saving data for FF42934: {'auction_closing_time': 1774970379.0, 'created_time': 1773945052.987004, 'last_price_update_time': 1774868078.856403}
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF42934') HTTP/1.1" 204 0
2026-03-30 10:54:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7050b51a-5b5f-5d5c-9b4d-a2e92c134786 with identifier: NC54536
2026-03-30 10:54:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7050b51a-5b5f-5d5c-9b4d-a2e92c134786 with identifier: NC54536
2026-03-30 10:54:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7050b51a-5b5f-5d5c-9b4d-a2e92c134786 with identifier: NC54536 to the API
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:45:53Z',
 'fuel_type': 'petrol',
 'id': '7050b51a-5b5f-5d5c-9b4d-a2e92c134786',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC54536',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 38049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-10',
 'seller_name': None,
 'title': 'Renault Clio 1.3 TCe R.S. Line',
 'transmission': 'manual',
 'trim': 'R.S. Line',
 'year': 2022}
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC54536%27 HTTP/1.1" 200 None
2026-03-30 10:54:39 [auto1.de] INFO: Saving data for NC54536: {'auction_closing_time': 1774971953.0, 'created_time': 1774377043.504059, 'last_price_update_time': 1774868079.249643}
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC54536') HTTP/1.1" 204 0
2026-03-30 10:54:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:39 [auto1.de] INFO: Found listing with ID: LJ09333
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ09333%27 HTTP/1.1" 200 None
2026-03-30 10:54:39 [auto1.de] INFO: Scrape type for LJ09333: 2
2026-03-30 10:54:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87269153-a533-52bd-9e59-b139cf8afdca with identifier: LJ09333
2026-03-30 10:54:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87269153-a533-52bd-9e59-b139cf8afdca with scrape type 2
2026-03-30 10:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87269153-a533-52bd-9e59-b139cf8afdca with scrape type 2
2026-03-30 10:54:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87269153-a533-52bd-9e59-b139cf8afdca, identifier: LJ09333
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F15%252F9415ce8f5a5d0350952620118b3e47e8%252Fpa%252FWM67864_eb1f4d0f6ef2d339f77a95dba00fb6ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_eb1f4d0f6ef2d339f77a95dba00fb6ed.jpg not downloaded yet
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_3b2317203efa1248645c86fe96a627d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_3b2317203efa1248645c86fe96a627d7.jpg not downloaded yet
2026-03-30 10:54:39 [auto1.de] INFO: Found listing with ID: UJ91538
2026-03-30 10:54:39 [auto1.de] INFO: Found listing with ID: ZC81938
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC81938%27 HTTP/1.1" 200 None
2026-03-30 10:54:39 [auto1.de] INFO: Scrape type for ZC81938: 2
2026-03-30 10:54:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dec7a5e-0f3e-5466-bb19-96ed357128e4 with identifier: ZC81938
2026-03-30 10:54:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dec7a5e-0f3e-5466-bb19-96ed357128e4 with scrape type 2
2026-03-30 10:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dec7a5e-0f3e-5466-bb19-96ed357128e4 with scrape type 2
2026-03-30 10:54:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2dec7a5e-0f3e-5466-bb19-96ed357128e4, identifier: ZC81938
2026-03-30 10:54:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87269153-a533-52bd-9e59-b139cf8afdca with identifier: LJ09333
2026-03-30 10:54:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87269153-a533-52bd-9e59-b139cf8afdca with identifier: LJ09333
2026-03-30 10:54:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87269153-a533-52bd-9e59-b139cf8afdca with identifier: LJ09333 to the API
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:17:52Z',
 'fuel_type': 'petrol',
 'id': '87269153-a533-52bd-9e59-b139cf8afdca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ09333',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 110950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2016}
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ09333%27 HTTP/1.1" 200 None
2026-03-30 10:54:39 [auto1.de] INFO: Saving data for LJ09333: {'auction_closing_time': 1774970272.0, 'created_time': 1774377949.523464, 'last_price_update_time': 1774868079.870465}
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ09333') HTTP/1.1" 204 0
2026-03-30 10:54:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2dec7a5e-0f3e-5466-bb19-96ed357128e4 with identifier: ZC81938
2026-03-30 10:54:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2dec7a5e-0f3e-5466-bb19-96ed357128e4 with identifier: ZC81938
2026-03-30 10:54:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2dec7a5e-0f3e-5466-bb19-96ed357128e4 with identifier: ZC81938 to the API
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:04:10Z',
 'fuel_type': 'petrol',
 'id': '2dec7a5e-0f3e-5466-bb19-96ed357128e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC81938',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 62507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-10',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC81938%27 HTTP/1.1" 200 None
2026-03-30 10:54:40 [auto1.de] INFO: Saving data for ZC81938: {'auction_closing_time': 1774969450.0, 'created_time': 1774416676.699189, 'last_price_update_time': 1774868080.255278}
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC81938') HTTP/1.1" 204 0
2026-03-30 10:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_50d12adc07152b88d671edaa614969a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:40 [auto1.de] INFO: Found listing with ID: VH09784
2026-03-30 10:54:40 [auto1.de] INFO: Found listing with ID: HL66127
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL66127%27 HTTP/1.1" 200 None
2026-03-30 10:54:40 [auto1.de] INFO: Scrape type for HL66127: 2
2026-03-30 10:54:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cafc69d-0065-50ce-a31e-92d0cd4b0eba with identifier: HL66127
2026-03-30 10:54:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cafc69d-0065-50ce-a31e-92d0cd4b0eba with scrape type 2
2026-03-30 10:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cafc69d-0065-50ce-a31e-92d0cd4b0eba with scrape type 2
2026-03-30 10:54:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9cafc69d-0065-50ce-a31e-92d0cd4b0eba, identifier: HL66127
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F15%252F9415ce8f5a5d0350952620118b3e47e8%252Fpa%252FWM67864_9d8524e95e8f68ac34895a3e483a9edf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_9d8524e95e8f68ac34895a3e483a9edf.jpg not downloaded yet
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_49bb548040fb7dc4418057a7cde99b79.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_49bb548040fb7dc4418057a7cde99b79.jpg not downloaded yet
2026-03-30 10:54:40 [auto1.de] INFO: Found listing with ID: VL46234
2026-03-30 10:54:40 [auto1.de] INFO: Found listing with ID: CA30799
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA30799%27 HTTP/1.1" 200 None
2026-03-30 10:54:40 [auto1.de] INFO: Scrape type for CA30799: 1
2026-03-30 10:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_81cf502c577e29a24dedb07e599eb977.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_760b319017afb78511547c1313fa1966.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9cafc69d-0065-50ce-a31e-92d0cd4b0eba with identifier: HL66127
2026-03-30 10:54:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9cafc69d-0065-50ce-a31e-92d0cd4b0eba with identifier: HL66127
2026-03-30 10:54:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9cafc69d-0065-50ce-a31e-92d0cd4b0eba with identifier: HL66127 to the API
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:24:48Z',
 'fuel_type': 'diesel',
 'id': '9cafc69d-0065-50ce-a31e-92d0cd4b0eba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL66127',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 72179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-01',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi L1H1 SpaceClass',
 'transmission': 'automatic',
 'trim': 'L1H1 SpaceClass',
 'year': 2020}
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL66127%27 HTTP/1.1" 200 None
2026-03-30 10:54:40 [auto1.de] INFO: Saving data for HL66127: {'auction_closing_time': 1774970688.0, 'created_time': 1774379790.362145, 'last_price_update_time': 1774868080.780529}
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL66127') HTTP/1.1" 204 0
2026-03-30 10:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4325c50>
2026-03-30 10:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1b893a-e560-50f2-8819-5971416bd34d/8d1b893a-e560-50f2-8819-5971416bd34d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F15%252F9415ce8f5a5d0350952620118b3e47e8%252Fpa%252FWM67864_c9c7f523c727e23a5a05a7b12638ecf6.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_c9c7f523c727e23a5a05a7b12638ecf6.jpg saved to cache
2026-03-30 10:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d1b893a-e560-50f2-8819-5971416bd34d
2026-03-30 10:54:40 [auto1.de] INFO: Found listing with ID: RT03172
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT03172%27 HTTP/1.1" 200 None
2026-03-30 10:54:40 [auto1.de] INFO: Scrape type for RT03172: 2
2026-03-30 10:54:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31692785-d037-535b-b2a4-57da027d702d with identifier: RT03172
2026-03-30 10:54:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31692785-d037-535b-b2a4-57da027d702d with scrape type 2
2026-03-30 10:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31692785-d037-535b-b2a4-57da027d702d with scrape type 2
2026-03-30 10:54:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31692785-d037-535b-b2a4-57da027d702d, identifier: RT03172
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_36167b2500ee914dbe90f0615a245799.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_36167b2500ee914dbe90f0615a245799.jpg not downloaded yet
2026-03-30 10:54:41 [auto1.de] INFO: Found listing with ID: BY18801
2026-03-30 10:54:41 [auto1.de] INFO: Found listing with ID: LE94201
2026-03-30 10:54:41 [auto1.de] INFO: Found listing with ID: YU07668
2026-03-30 10:54:41 [auto1.de] INFO: Found listing with ID: GR50767
2026-03-30 10:54:41 [auto1.de] INFO: Found listing with ID: GG43334
2026-03-30 10:54:41 [auto1.de] INFO: Found listing with ID: ZL47575
2026-03-30 10:54:41 [auto1.de] INFO: Found listing with ID: KY88001
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY88001%27 HTTP/1.1" 200 None
2026-03-30 10:54:41 [auto1.de] INFO: Scrape type for KY88001: 2
2026-03-30 10:54:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18d0a870-a505-5e0c-8e89-db1aa8ebcd14 with identifier: KY88001
2026-03-30 10:54:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18d0a870-a505-5e0c-8e89-db1aa8ebcd14 with scrape type 2
2026-03-30 10:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18d0a870-a505-5e0c-8e89-db1aa8ebcd14 with scrape type 2
2026-03-30 10:54:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18d0a870-a505-5e0c-8e89-db1aa8ebcd14, identifier: KY88001
2026-03-30 10:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_7c3514dc75dc3872380d941a126eac04.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31692785-d037-535b-b2a4-57da027d702d with identifier: RT03172
2026-03-30 10:54:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31692785-d037-535b-b2a4-57da027d702d with identifier: RT03172
2026-03-30 10:54:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31692785-d037-535b-b2a4-57da027d702d with identifier: RT03172 to the API
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:39:33Z',
 'fuel_type': 'diesel',
 'id': '31692785-d037-535b-b2a4-57da027d702d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT03172',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 261785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi L2H2 HKa 3,5t',
 'transmission': 'manual',
 'trim': 'L2H2 HKa 3,5t',
 'year': 2021}
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT03172%27 HTTP/1.1" 200 None
2026-03-30 10:54:41 [auto1.de] INFO: Saving data for RT03172: {'auction_closing_time': 1774971573.0, 'created_time': 1774467190.993049, 'last_price_update_time': 1774868081.494432}
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT03172') HTTP/1.1" 204 0
2026-03-30 10:54:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18d0a870-a505-5e0c-8e89-db1aa8ebcd14 with identifier: KY88001
2026-03-30 10:54:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18d0a870-a505-5e0c-8e89-db1aa8ebcd14 with identifier: KY88001
2026-03-30 10:54:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18d0a870-a505-5e0c-8e89-db1aa8ebcd14 with identifier: KY88001 to the API
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:23:05Z',
 'fuel_type': 'diesel',
 'id': '18d0a870-a505-5e0c-8e89-db1aa8ebcd14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY88001',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 114289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-24',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI ultra',
 'transmission': 'automatic',
 'trim': 'ultra',
 'year': 2018}
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY88001%27 HTTP/1.1" 200 None
2026-03-30 10:54:42 [auto1.de] INFO: Saving data for KY88001: {'auction_closing_time': 1774970585.0, 'created_time': 1774467174.625026, 'last_price_update_time': 1774868082.144883}
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY88001') HTTP/1.1" 204 0
2026-03-30 10:54:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefe3dd0>
2026-03-30 10:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1b893a-e560-50f2-8819-5971416bd34d/8d1b893a-e560-50f2-8819-5971416bd34d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F15%252F9415ce8f5a5d0350952620118b3e47e8%252Fpa%252FWM67864_50d12adc07152b88d671edaa614969a4.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_50d12adc07152b88d671edaa614969a4.jpg saved to cache
2026-03-30 10:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d1b893a-e560-50f2-8819-5971416bd34d
2026-03-30 10:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_cdfd7badad832747b16be6e097204b1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:42 [auto1.de] INFO: Found listing with ID: FL34122
2026-03-30 10:54:42 [auto1.de] INFO: Found listing with ID: MU80081
2026-03-30 10:54:42 [auto1.de] INFO: Found listing with ID: BP88986
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP88986%27 HTTP/1.1" 200 None
2026-03-30 10:54:42 [auto1.de] INFO: Scrape type for BP88986: 2
2026-03-30 10:54:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d5b562b-5368-549c-8655-89ba2b6132b1 with identifier: BP88986
2026-03-30 10:54:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d5b562b-5368-549c-8655-89ba2b6132b1 with scrape type 2
2026-03-30 10:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d5b562b-5368-549c-8655-89ba2b6132b1 with scrape type 2
2026-03-30 10:54:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d5b562b-5368-549c-8655-89ba2b6132b1, identifier: BP88986
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_78c72694ab0dfd74d632decd0d6e90e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_78c72694ab0dfd74d632decd0d6e90e8.jpg not downloaded yet
2026-03-30 10:54:42 [auto1.de] INFO: Found listing with ID: LN11972
2026-03-30 10:54:42 [auto1.de] INFO: Found listing with ID: RN93387
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN93387%27 HTTP/1.1" 200 None
2026-03-30 10:54:42 [auto1.de] INFO: Scrape type for RN93387: 2
2026-03-30 10:54:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e48a9cbf-c584-58bd-9fcc-2e952987e2a5 with identifier: RN93387
2026-03-30 10:54:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e48a9cbf-c584-58bd-9fcc-2e952987e2a5 with scrape type 2
2026-03-30 10:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e48a9cbf-c584-58bd-9fcc-2e952987e2a5 with scrape type 2
2026-03-30 10:54:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e48a9cbf-c584-58bd-9fcc-2e952987e2a5, identifier: RN93387
2026-03-30 10:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_eb1f4d0f6ef2d339f77a95dba00fb6ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_3b2317203efa1248645c86fe96a627d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d5b562b-5368-549c-8655-89ba2b6132b1 with identifier: BP88986
2026-03-30 10:54:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d5b562b-5368-549c-8655-89ba2b6132b1 with identifier: BP88986
2026-03-30 10:54:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d5b562b-5368-549c-8655-89ba2b6132b1 with identifier: BP88986 to the API
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:12:02Z',
 'fuel_type': 'petrol',
 'id': '1d5b562b-5368-549c-8655-89ba2b6132b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP88986',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 161787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP88986%27 HTTP/1.1" 200 None
2026-03-30 10:54:42 [auto1.de] INFO: Saving data for BP88986: {'auction_closing_time': 1774969922.0, 'created_time': 1773945951.793686, 'last_price_update_time': 1774868082.825787}
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP88986') HTTP/1.1" 204 0
2026-03-30 10:54:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e48a9cbf-c584-58bd-9fcc-2e952987e2a5 with identifier: RN93387
2026-03-30 10:54:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e48a9cbf-c584-58bd-9fcc-2e952987e2a5 with identifier: RN93387
2026-03-30 10:54:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e48a9cbf-c584-58bd-9fcc-2e952987e2a5 with identifier: RN93387 to the API
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:48:33Z',
 'fuel_type': 'petrol',
 'id': 'e48a9cbf-c584-58bd-9fcc-2e952987e2a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN93387',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 136601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-25',
 'seller_name': None,
 'title': 'Mazda 2 1.5 Center-Line',
 'transmission': 'automatic',
 'trim': 'Center-Line',
 'year': 2012}
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN93387%27 HTTP/1.1" 200 None
2026-03-30 10:54:43 [auto1.de] INFO: Saving data for RN93387: {'auction_closing_time': 1774972113.0, 'created_time': 1773811849.351866, 'last_price_update_time': 1774868083.170657}
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN93387') HTTP/1.1" 204 0
2026-03-30 10:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef19090>
2026-03-30 10:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_81cf502c577e29a24dedb07e599eb977.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_81cf502c577e29a24dedb07e599eb977.jpg saved to cache
2026-03-30 10:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3
2026-03-30 10:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4195650>
2026-03-30 10:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1b893a-e560-50f2-8819-5971416bd34d/8d1b893a-e560-50f2-8819-5971416bd34d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F15%252F9415ce8f5a5d0350952620118b3e47e8%252Fpa%252FWM67864_760b319017afb78511547c1313fa1966.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_760b319017afb78511547c1313fa1966.jpg saved to cache
2026-03-30 10:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d1b893a-e560-50f2-8819-5971416bd34d
2026-03-30 10:54:43 [auto1.de] INFO: Found listing with ID: PK44731
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK44731%27 HTTP/1.1" 200 None
2026-03-30 10:54:43 [auto1.de] INFO: Scrape type for PK44731: 2
2026-03-30 10:54:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ea4f200-b5e0-5802-be1e-e908c36df6ac with identifier: PK44731
2026-03-30 10:54:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ea4f200-b5e0-5802-be1e-e908c36df6ac with scrape type 2
2026-03-30 10:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ea4f200-b5e0-5802-be1e-e908c36df6ac with scrape type 2
2026-03-30 10:54:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ea4f200-b5e0-5802-be1e-e908c36df6ac, identifier: PK44731
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_f922ad5dbef80e1da190f5bb0a1ab21c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_f922ad5dbef80e1da190f5bb0a1ab21c.jpg not downloaded yet
2026-03-30 10:54:43 [auto1.de] INFO: Found listing with ID: ZZ22411
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ22411%27 HTTP/1.1" 200 None
2026-03-30 10:54:43 [auto1.de] INFO: Scrape type for ZZ22411: 2
2026-03-30 10:54:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cd13770-e3ab-5dd1-a40a-74b445278f11 with identifier: ZZ22411
2026-03-30 10:54:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cd13770-e3ab-5dd1-a40a-74b445278f11 with scrape type 2
2026-03-30 10:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cd13770-e3ab-5dd1-a40a-74b445278f11 with scrape type 2
2026-03-30 10:54:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cd13770-e3ab-5dd1-a40a-74b445278f11, identifier: ZZ22411
2026-03-30 10:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeedda50>
2026-03-30 10:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1b893a-e560-50f2-8819-5971416bd34d/8d1b893a-e560-50f2-8819-5971416bd34d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F15%252F9415ce8f5a5d0350952620118b3e47e8%252Fpa%252FWM67864_7c3514dc75dc3872380d941a126eac04.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_7c3514dc75dc3872380d941a126eac04.jpg saved to cache
2026-03-30 10:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d1b893a-e560-50f2-8819-5971416bd34d
2026-03-30 10:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_9d8524e95e8f68ac34895a3e483a9edf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ea4f200-b5e0-5802-be1e-e908c36df6ac with identifier: PK44731
2026-03-30 10:54:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ea4f200-b5e0-5802-be1e-e908c36df6ac with identifier: PK44731
2026-03-30 10:54:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ea4f200-b5e0-5802-be1e-e908c36df6ac with identifier: PK44731 to the API
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-31T15:44:20Z',
 'fuel_type': 'petrol',
 'id': '7ea4f200-b5e0-5802-be1e-e908c36df6ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK44731',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon Shooting Brake',
 'odometer': 39926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-06',
 'seller_name': None,
 'title': 'Volkswagen Arteon Shooting Brake 2.0 TSI R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2022}
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK44731%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [auto1.de] INFO: Saving data for PK44731: {'auction_closing_time': 1774971860.0, 'created_time': 1774466021.366471, 'last_price_update_time': 1774868084.15298}
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK44731') HTTP/1.1" 204 0
2026-03-30 10:54:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cd13770-e3ab-5dd1-a40a-74b445278f11 with identifier: ZZ22411
2026-03-30 10:54:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cd13770-e3ab-5dd1-a40a-74b445278f11 with identifier: ZZ22411
2026-03-30 10:54:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cd13770-e3ab-5dd1-a40a-74b445278f11 with identifier: ZZ22411 to the API
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:53:59Z',
 'fuel_type': 'diesel',
 'id': '1cd13770-e3ab-5dd1-a40a-74b445278f11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ22411',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 129947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-21',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Comfortline 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline 4Motion BlueMotion Tech',
 'year': 2017}
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ22411%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [auto1.de] INFO: Saving data for ZZ22411: {'auction_closing_time': 1774972439.0, 'created_time': 1774466695.86351, 'last_price_update_time': 1774868084.514266}
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ22411') HTTP/1.1" 204 0
2026-03-30 10:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4186ed0>
2026-03-30 10:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_cdfd7badad832747b16be6e097204b1b.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_cdfd7badad832747b16be6e097204b1b.jpg saved to cache
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3
2026-03-30 10:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_49bb548040fb7dc4418057a7cde99b79.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:44 [auto1.de] INFO: Found listing with ID: BP08791
2026-03-30 10:54:44 [auto1.de] INFO: Found listing with ID: YJ10280
2026-03-30 10:54:44 [auto1.de] INFO: Found listing with ID: CE25056
2026-03-30 10:54:44 [auto1.de] INFO: Found listing with ID: FK56908
2026-03-30 10:54:44 [auto1.de] INFO: Found listing with ID: ZU35501
2026-03-30 10:54:44 [auto1.de] INFO: Found listing with ID: FV09782
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV09782%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [auto1.de] INFO: Scrape type for FV09782: 2
2026-03-30 10:54:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 128ccae1-57f4-5f1f-b938-1362c20c67c4 with identifier: FV09782
2026-03-30 10:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 128ccae1-57f4-5f1f-b938-1362c20c67c4 with scrape type 2
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 128ccae1-57f4-5f1f-b938-1362c20c67c4 with scrape type 2
2026-03-30 10:54:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 128ccae1-57f4-5f1f-b938-1362c20c67c4, identifier: FV09782
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_61aa67b284b92c87f5c98c9c372e3108.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_61aa67b284b92c87f5c98c9c372e3108.jpg not downloaded yet
2026-03-30 10:54:44 [auto1.de] INFO: Found listing with ID: CS08298
2026-03-30 10:54:44 [auto1.de] INFO: Found listing with ID: EL87499
2026-03-30 10:54:44 [auto1.de] INFO: Found listing with ID: CU51755
2026-03-30 10:54:44 [auto1.de] INFO: Found listing with ID: LE51560
2026-03-30 10:54:44 [auto1.de] INFO: Found listing with ID: PY43658
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY43658%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [auto1.de] INFO: Scrape type for PY43658: 2
2026-03-30 10:54:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1c95963-cffe-579e-94cf-f60d75ae9058 with identifier: PY43658
2026-03-30 10:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1c95963-cffe-579e-94cf-f60d75ae9058 with scrape type 2
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1c95963-cffe-579e-94cf-f60d75ae9058 with scrape type 2
2026-03-30 10:54:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1c95963-cffe-579e-94cf-f60d75ae9058, identifier: PY43658
2026-03-30 10:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_36167b2500ee914dbe90f0615a245799.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 128ccae1-57f4-5f1f-b938-1362c20c67c4 with identifier: FV09782
2026-03-30 10:54:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 128ccae1-57f4-5f1f-b938-1362c20c67c4 with identifier: FV09782
2026-03-30 10:54:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 128ccae1-57f4-5f1f-b938-1362c20c67c4 with identifier: FV09782 to the API
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:25:58Z',
 'fuel_type': 'petrol',
 'id': '128ccae1-57f4-5f1f-b938-1362c20c67c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV09782',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 163561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-29',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2015}
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV09782%27 HTTP/1.1" 200 None
2026-03-30 10:54:45 [auto1.de] INFO: Saving data for FV09782: {'auction_closing_time': 1774970758.0, 'created_time': 1773946463.653878, 'last_price_update_time': 1774868085.397846}
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV09782') HTTP/1.1" 204 0
2026-03-30 10:54:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1c95963-cffe-579e-94cf-f60d75ae9058 with identifier: PY43658
2026-03-30 10:54:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1c95963-cffe-579e-94cf-f60d75ae9058 with identifier: PY43658
2026-03-30 10:54:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1c95963-cffe-579e-94cf-f60d75ae9058 with identifier: PY43658 to the API
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:55:13Z',
 'fuel_type': 'petrol',
 'id': 'c1c95963-cffe-579e-94cf-f60d75ae9058',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY43658',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 165882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-06',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.3 ClearTec EDITION',
 'transmission': 'manual',
 'trim': 'ClearTec EDITION',
 'year': 2010}
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY43658%27 HTTP/1.1" 200 None
2026-03-30 10:54:45 [auto1.de] INFO: Saving data for PY43658: {'auction_closing_time': 1774972513.0, 'created_time': 1774436002.425341, 'last_price_update_time': 1774868085.8181}
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY43658') HTTP/1.1" 204 0
2026-03-30 10:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4234650>
2026-03-30 10:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1b893a-e560-50f2-8819-5971416bd34d/8d1b893a-e560-50f2-8819-5971416bd34d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F15%252F9415ce8f5a5d0350952620118b3e47e8%252Fpa%252FWM67864_eb1f4d0f6ef2d339f77a95dba00fb6ed.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_eb1f4d0f6ef2d339f77a95dba00fb6ed.jpg saved to cache
2026-03-30 10:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d1b893a-e560-50f2-8819-5971416bd34d
2026-03-30 10:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eed37690>
2026-03-30 10:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_3b2317203efa1248645c86fe96a627d7.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_3b2317203efa1248645c86fe96a627d7.jpg saved to cache
2026-03-30 10:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3
2026-03-30 10:54:45 [auto1.de] INFO: Found listing with ID: CW81112
2026-03-30 10:54:45 [auto1.de] INFO: Found listing with ID: HW93090
2026-03-30 10:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_fcd800525d1de0510697bfbf1ef96c72.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_fcd800525d1de0510697bfbf1ef96c72.jpg not downloaded yet
2026-03-30 10:54:46 [auto1.de] INFO: Found listing with ID: PH95596
2026-03-30 10:54:46 [auto1.de] INFO: Found listing with ID: MN27803
2026-03-30 10:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN27803%27 HTTP/1.1" 200 None
2026-03-30 10:54:46 [auto1.de] INFO: Scrape type for MN27803: 2
2026-03-30 10:54:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7013d74-76ef-5791-99c7-135e5149cd32 with identifier: MN27803
2026-03-30 10:54:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7013d74-76ef-5791-99c7-135e5149cd32 with scrape type 2
2026-03-30 10:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7013d74-76ef-5791-99c7-135e5149cd32 with scrape type 2
2026-03-30 10:54:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7013d74-76ef-5791-99c7-135e5149cd32, identifier: MN27803
2026-03-30 10:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_78c72694ab0dfd74d632decd0d6e90e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7013d74-76ef-5791-99c7-135e5149cd32 with identifier: MN27803
2026-03-30 10:54:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7013d74-76ef-5791-99c7-135e5149cd32 with identifier: MN27803
2026-03-30 10:54:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7013d74-76ef-5791-99c7-135e5149cd32 with identifier: MN27803 to the API
2026-03-30 10:54:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:53:25Z',
 'fuel_type': 'petrol',
 'id': 'f7013d74-76ef-5791-99c7-135e5149cd32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN27803',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 152512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-15',
 'seller_name': None,
 'title': 'Skoda Yeti 1.2 TSI Twenty Ambition',
 'transmission': 'manual',
 'trim': 'Twenty Ambition',
 'year': 2012}
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN27803%27 HTTP/1.1" 200 None
2026-03-30 10:54:47 [auto1.de] INFO: Saving data for MN27803: {'auction_closing_time': 1774972405.0, 'created_time': 1774550585.08588, 'last_price_update_time': 1774868087.069621}
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN27803') HTTP/1.1" 204 0
2026-03-30 10:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee61f90>
2026-03-30 10:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1b893a-e560-50f2-8819-5971416bd34d/8d1b893a-e560-50f2-8819-5971416bd34d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F15%252F9415ce8f5a5d0350952620118b3e47e8%252Fpa%252FWM67864_9d8524e95e8f68ac34895a3e483a9edf.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_9d8524e95e8f68ac34895a3e483a9edf.jpg saved to cache
2026-03-30 10:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d1b893a-e560-50f2-8819-5971416bd34d
2026-03-30 10:54:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d1b893a-e560-50f2-8819-5971416bd34d, skipping ID generation
2026-03-30 10:54:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d1b893a-e560-50f2-8819-5971416bd34d with scrape type 1
2026-03-30 10:54:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d1b893a-e560-50f2-8819-5971416bd34d sending to next pipeline
2026-03-30 10:54:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d1b893a-e560-50f2-8819-5971416bd34d, identifier: WM67864
2026-03-30 10:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4329d10>
2026-03-30 10:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_49bb548040fb7dc4418057a7cde99b79.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_49bb548040fb7dc4418057a7cde99b79.jpg saved to cache
2026-03-30 10:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3
2026-03-30 10:54:47 [auto1.de] INFO: Found listing with ID: LX54044
2026-03-30 10:54:47 [auto1.de] INFO: Found listing with ID: FC32673
2026-03-30 10:54:47 [auto1.de] INFO: Found listing with ID: YA43957
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA43957%27 HTTP/1.1" 200 None
2026-03-30 10:54:47 [auto1.de] INFO: Scrape type for YA43957: 2
2026-03-30 10:54:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9bac955-af60-592e-a66f-b8f796565574 with identifier: YA43957
2026-03-30 10:54:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9bac955-af60-592e-a66f-b8f796565574 with scrape type 2
2026-03-30 10:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9bac955-af60-592e-a66f-b8f796565574 with scrape type 2
2026-03-30 10:54:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9bac955-af60-592e-a66f-b8f796565574, identifier: YA43957
2026-03-30 10:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d1b893a-e560-50f2-8819-5971416bd34d with identifier: WM67864
2026-03-30 10:54:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d1b893a-e560-50f2-8819-5971416bd34d with identifier: WM67864
2026-03-30 10:54:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d1b893a-e560-50f2-8819-5971416bd34d with identifier: WM67864 to the API
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_9d8524e95e8f68ac34895a3e483a9edf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:03:58Z',
 'fuel_type': 'petrol',
 'id': '8d1b893a-e560-50f2-8819-5971416bd34d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM67864',
 'listing': 'auction',
 'location': 'DE, Heidelberg',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 99124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1b893a-e560-50f2-8819-5971416bd34d/8d1b893a-e560-50f2-8819-5971416bd34d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_c9c7f523c727e23a5a05a7b12638ecf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1b893a-e560-50f2-8819-5971416bd34d/8d1b893a-e560-50f2-8819-5971416bd34d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_50d12adc07152b88d671edaa614969a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1b893a-e560-50f2-8819-5971416bd34d/8d1b893a-e560-50f2-8819-5971416bd34d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_760b319017afb78511547c1313fa1966.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1b893a-e560-50f2-8819-5971416bd34d/8d1b893a-e560-50f2-8819-5971416bd34d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_7c3514dc75dc3872380d941a126eac04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1b893a-e560-50f2-8819-5971416bd34d/8d1b893a-e560-50f2-8819-5971416bd34d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_eb1f4d0f6ef2d339f77a95dba00fb6ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1b893a-e560-50f2-8819-5971416bd34d/8d1b893a-e560-50f2-8819-5971416bd34d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/15/9415ce8f5a5d0350952620118b3e47e8/pa/WM67864_9d8524e95e8f68ac34895a3e483a9edf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2006}
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM67864%27 HTTP/1.1" 200 None
2026-03-30 10:54:47 [auto1.de] INFO: Saving data for WM67864: {'created_time': 1774868087.873235, 'last_price_update_time': 1774868087.873245, 'auction_closing_time': 1774969438.0}
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM67864') HTTP/1.1" 204 0
2026-03-30 10:54:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9bac955-af60-592e-a66f-b8f796565574 with identifier: YA43957
2026-03-30 10:54:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9bac955-af60-592e-a66f-b8f796565574 with identifier: YA43957
2026-03-30 10:54:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9bac955-af60-592e-a66f-b8f796565574 with identifier: YA43957 to the API
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:14:56Z',
 'fuel_type': 'petrol',
 'id': 'f9bac955-af60-592e-a66f-b8f796565574',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA43957',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 83453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-27',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2017}
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA43957%27 HTTP/1.1" 200 None
2026-03-30 10:54:48 [auto1.de] INFO: Saving data for YA43957: {'auction_closing_time': 1774970096.0, 'created_time': 1774465465.668739, 'last_price_update_time': 1774868088.223467}
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA43957') HTTP/1.1" 204 0
2026-03-30 10:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41ff0d0>
2026-03-30 10:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_36167b2500ee914dbe90f0615a245799.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_36167b2500ee914dbe90f0615a245799.jpg saved to cache
2026-03-30 10:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3
2026-03-30 10:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_f922ad5dbef80e1da190f5bb0a1ab21c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:48 [auto1.de] INFO: Found listing with ID: WP05993
2026-03-30 10:54:48 [auto1.de] INFO: Found listing with ID: KF61768
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF61768%27 HTTP/1.1" 200 None
2026-03-30 10:54:48 [auto1.de] INFO: Scrape type for KF61768: 2
2026-03-30 10:54:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 819e4182-bc38-5617-87d4-de71a15d73aa with identifier: KF61768
2026-03-30 10:54:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 819e4182-bc38-5617-87d4-de71a15d73aa with scrape type 2
2026-03-30 10:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 819e4182-bc38-5617-87d4-de71a15d73aa with scrape type 2
2026-03-30 10:54:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 819e4182-bc38-5617-87d4-de71a15d73aa, identifier: KF61768
2026-03-30 10:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XC07507> (referer: https://www.auto1.com/v1/car-details-view/XC07507/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_61aa67b284b92c87f5c98c9c372e3108.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 819e4182-bc38-5617-87d4-de71a15d73aa with identifier: KF61768
2026-03-30 10:54:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 819e4182-bc38-5617-87d4-de71a15d73aa with identifier: KF61768
2026-03-30 10:54:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 819e4182-bc38-5617-87d4-de71a15d73aa with identifier: KF61768 to the API
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:58:17Z',
 'fuel_type': 'diesel',
 'id': '819e4182-bc38-5617-87d4-de71a15d73aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF61768',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 88814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-08',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CDI BlueTEC Elegance',
 'transmission': 'automatic',
 'trim': 'BlueTEC Elegance',
 'year': 2015}
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF61768%27 HTTP/1.1" 200 None
2026-03-30 10:54:48 [auto1.de] INFO: Saving data for KF61768: {'auction_closing_time': 1774972697.0, 'created_time': 1774467129.353052, 'last_price_update_time': 1774868088.751347}
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF61768') HTTP/1.1" 204 0
2026-03-30 10:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee93f50>
2026-03-30 10:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_78c72694ab0dfd74d632decd0d6e90e8.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_78c72694ab0dfd74d632decd0d6e90e8.jpg saved to cache
2026-03-30 10:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3
2026-03-30 10:54:48 [auto1.de] INFO: Channel: 24h | Page: 52 | totalHits: 9524 | hits on page: 40
2026-03-30 10:54:48 [auto1.de] INFO: Found listing with ID: VD73221
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD73221%27 HTTP/1.1" 200 None
2026-03-30 10:54:48 [auto1.de] INFO: Scrape type for VD73221: 2
2026-03-30 10:54:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e3cfe9b-e704-511a-80a8-89a0e2423cd2 with identifier: VD73221
2026-03-30 10:54:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e3cfe9b-e704-511a-80a8-89a0e2423cd2 with scrape type 2
2026-03-30 10:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e3cfe9b-e704-511a-80a8-89a0e2423cd2 with scrape type 2
2026-03-30 10:54:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e3cfe9b-e704-511a-80a8-89a0e2423cd2, identifier: VD73221
2026-03-30 10:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA30799/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e3cfe9b-e704-511a-80a8-89a0e2423cd2 with identifier: VD73221
2026-03-30 10:54:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e3cfe9b-e704-511a-80a8-89a0e2423cd2 with identifier: VD73221
2026-03-30 10:54:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e3cfe9b-e704-511a-80a8-89a0e2423cd2 with identifier: VD73221 to the API
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:44:02Z',
 'fuel_type': 'diesel',
 'id': '8e3cfe9b-e704-511a-80a8-89a0e2423cd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD73221',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 177653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-23',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline FWD',
 'transmission': 'automatic',
 'trim': 'Comfortline FWD',
 'year': 2020}
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD73221%27 HTTP/1.1" 200 None
2026-03-30 10:54:49 [auto1.de] INFO: Saving data for VD73221: {'auction_closing_time': 1774971842.0, 'created_time': 1774637836.718089, 'last_price_update_time': 1774868089.328476}
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VD73221') HTTP/1.1" 204 0
2026-03-30 10:54:49 [auto1.de] INFO: Found listing with ID: MU75641
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU75641%27 HTTP/1.1" 200 None
2026-03-30 10:54:49 [auto1.de] INFO: Scrape type for MU75641: 2
2026-03-30 10:54:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5c75a32-30ac-54fc-89ef-62ac34c9b2f2 with identifier: MU75641
2026-03-30 10:54:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5c75a32-30ac-54fc-89ef-62ac34c9b2f2 with scrape type 2
2026-03-30 10:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5c75a32-30ac-54fc-89ef-62ac34c9b2f2 with scrape type 2
2026-03-30 10:54:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5c75a32-30ac-54fc-89ef-62ac34c9b2f2, identifier: MU75641
2026-03-30 10:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_fcd800525d1de0510697bfbf1ef96c72.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:49 [auto1.de] INFO: Found listing with ID: FM79917
2026-03-30 10:54:49 [auto1.de] INFO: Found listing with ID: MY93423
2026-03-30 10:54:49 [auto1.de] INFO: Found listing with ID: JS17929
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS17929%27 HTTP/1.1" 200 None
2026-03-30 10:54:49 [auto1.de] INFO: Scrape type for JS17929: 2
2026-03-30 10:54:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d02233f-2aad-5cdb-be25-c5d509cddc9c with identifier: JS17929
2026-03-30 10:54:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d02233f-2aad-5cdb-be25-c5d509cddc9c with scrape type 2
2026-03-30 10:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d02233f-2aad-5cdb-be25-c5d509cddc9c with scrape type 2
2026-03-30 10:54:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d02233f-2aad-5cdb-be25-c5d509cddc9c, identifier: JS17929
2026-03-30 10:54:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5c75a32-30ac-54fc-89ef-62ac34c9b2f2 with identifier: MU75641
2026-03-30 10:54:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5c75a32-30ac-54fc-89ef-62ac34c9b2f2 with identifier: MU75641
2026-03-30 10:54:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5c75a32-30ac-54fc-89ef-62ac34c9b2f2 with identifier: MU75641 to the API
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:22:48Z',
 'fuel_type': 'petrol',
 'id': 'b5c75a32-30ac-54fc-89ef-62ac34c9b2f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU75641',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 53274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-26',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Style',
 'year': 2015}
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU75641%27 HTTP/1.1" 200 None
2026-03-30 10:54:49 [auto1.de] INFO: Saving data for MU75641: {'auction_closing_time': 1774970568.0, 'created_time': 1773137135.801775, 'last_price_update_time': 1774868089.939578}
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU75641') HTTP/1.1" 204 0
2026-03-30 10:54:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4286250>
2026-03-30 10:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_f922ad5dbef80e1da190f5bb0a1ab21c.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_f922ad5dbef80e1da190f5bb0a1ab21c.jpg saved to cache
2026-03-30 10:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3
2026-03-30 10:54:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acbb2900-f379-58b4-ad9e-0a79ce382f9e with identifier: XC07507
2026-03-30 10:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acbb2900-f379-58b4-ad9e-0a79ce382f9e with scrape type 1
2026-03-30 10:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item acbb2900-f379-58b4-ad9e-0a79ce382f9e
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_f463f97274d51569514bb1ad46252016.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_f463f97274d51569514bb1ad46252016.jpg not downloaded yet
2026-03-30 10:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7ed50>
2026-03-30 10:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_61aa67b284b92c87f5c98c9c372e3108.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_61aa67b284b92c87f5c98c9c372e3108.jpg saved to cache
2026-03-30 10:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3
2026-03-30 10:54:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d02233f-2aad-5cdb-be25-c5d509cddc9c with identifier: JS17929
2026-03-30 10:54:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d02233f-2aad-5cdb-be25-c5d509cddc9c with identifier: JS17929
2026-03-30 10:54:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d02233f-2aad-5cdb-be25-c5d509cddc9c with identifier: JS17929 to the API
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-31T15:52:52Z',
 'fuel_type': 'petrol',
 'id': '3d02233f-2aad-5cdb-be25-c5d509cddc9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS17929',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 20533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seller_name': None,
 'title': 'BMW 2er M235i Gran Coupe xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2020}
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS17929%27 HTTP/1.1" 200 None
2026-03-30 10:54:50 [auto1.de] INFO: Saving data for JS17929: {'auction_closing_time': 1774972372.0, 'created_time': 1774468013.418081, 'last_price_update_time': 1774868090.492436}
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS17929') HTTP/1.1" 204 0
2026-03-30 10:54:50 [auto1.de] INFO: Found listing with ID: HV93263
2026-03-30 10:54:50 [auto1.de] INFO: Found listing with ID: KT31788
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT31788%27 HTTP/1.1" 200 None
2026-03-30 10:54:50 [auto1.de] INFO: Scrape type for KT31788: 2
2026-03-30 10:54:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bb80415-8f77-5a3e-93c7-ee0e39d2c482 with identifier: KT31788
2026-03-30 10:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bb80415-8f77-5a3e-93c7-ee0e39d2c482 with scrape type 2
2026-03-30 10:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bb80415-8f77-5a3e-93c7-ee0e39d2c482 with scrape type 2
2026-03-30 10:54:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bb80415-8f77-5a3e-93c7-ee0e39d2c482, identifier: KT31788
2026-03-30 10:54:50 [auto1.de] INFO: Found listing with ID: LW15180
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW15180%27 HTTP/1.1" 200 None
2026-03-30 10:54:50 [auto1.de] INFO: Scrape type for LW15180: 2
2026-03-30 10:54:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2262f8d6-df01-54d9-a603-470e05568a95 with identifier: LW15180
2026-03-30 10:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2262f8d6-df01-54d9-a603-470e05568a95 with scrape type 2
2026-03-30 10:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2262f8d6-df01-54d9-a603-470e05568a95 with scrape type 2
2026-03-30 10:54:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2262f8d6-df01-54d9-a603-470e05568a95, identifier: LW15180
2026-03-30 10:54:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bb80415-8f77-5a3e-93c7-ee0e39d2c482 with identifier: KT31788
2026-03-30 10:54:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bb80415-8f77-5a3e-93c7-ee0e39d2c482 with identifier: KT31788
2026-03-30 10:54:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bb80415-8f77-5a3e-93c7-ee0e39d2c482 with identifier: KT31788 to the API
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:23:31Z',
 'fuel_type': 'diesel',
 'id': '6bb80415-8f77-5a3e-93c7-ee0e39d2c482',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT31788',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 267017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-08',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC AMG Line',
 'transmission': 'automatic',
 'trim': 'T BlueTEC AMG Line',
 'year': 2016}
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT31788%27 HTTP/1.1" 200 None
2026-03-30 10:54:51 [auto1.de] INFO: Saving data for KT31788: {'auction_closing_time': 1774970611.0, 'created_time': 1774435132.897771, 'last_price_update_time': 1774868091.085217}
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT31788') HTTP/1.1" 204 0
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_ece4f3c0ed1d4254c9178777eeb2b772.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_ece4f3c0ed1d4254c9178777eeb2b772.jpg not downloaded yet
2026-03-30 10:54:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2262f8d6-df01-54d9-a603-470e05568a95 with identifier: LW15180
2026-03-30 10:54:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2262f8d6-df01-54d9-a603-470e05568a95 with identifier: LW15180
2026-03-30 10:54:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2262f8d6-df01-54d9-a603-470e05568a95 with identifier: LW15180 to the API
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:35:06Z',
 'fuel_type': 'diesel',
 'id': '2262f8d6-df01-54d9-a603-470e05568a95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW15180',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 141890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-20',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 350 d BlueTEC',
 'transmission': 'automatic',
 'trim': 'BlueTEC',
 'year': 2015}
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW15180%27 HTTP/1.1" 200 None
2026-03-30 10:54:51 [auto1.de] INFO: Saving data for LW15180: {'auction_closing_time': 1774971306.0, 'created_time': 1773945199.581287, 'last_price_update_time': 1774868091.557429}
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW15180') HTTP/1.1" 204 0
2026-03-30 10:54:51 [auto1.de] INFO: Found listing with ID: PY86398
2026-03-30 10:54:51 [auto1.de] INFO: Found listing with ID: JT36836
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT36836%27 HTTP/1.1" 200 None
2026-03-30 10:54:51 [auto1.de] INFO: Scrape type for JT36836: 2
2026-03-30 10:54:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75e13ba9-7205-5952-b910-3d981d4ce48c with identifier: JT36836
2026-03-30 10:54:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75e13ba9-7205-5952-b910-3d981d4ce48c with scrape type 2
2026-03-30 10:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75e13ba9-7205-5952-b910-3d981d4ce48c with scrape type 2
2026-03-30 10:54:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75e13ba9-7205-5952-b910-3d981d4ce48c, identifier: JT36836
2026-03-30 10:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4185c50>
2026-03-30 10:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_fcd800525d1de0510697bfbf1ef96c72.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_fcd800525d1de0510697bfbf1ef96c72.jpg saved to cache
2026-03-30 10:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3
2026-03-30 10:54:51 [auto1.de] INFO: Found listing with ID: NY45531
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY45531%27 HTTP/1.1" 200 None
2026-03-30 10:54:51 [auto1.de] INFO: Scrape type for NY45531: 2
2026-03-30 10:54:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b16720f5-1c89-53c8-aa4b-102af96b953e with identifier: NY45531
2026-03-30 10:54:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b16720f5-1c89-53c8-aa4b-102af96b953e with scrape type 2
2026-03-30 10:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b16720f5-1c89-53c8-aa4b-102af96b953e with scrape type 2
2026-03-30 10:54:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b16720f5-1c89-53c8-aa4b-102af96b953e, identifier: NY45531
2026-03-30 10:54:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75e13ba9-7205-5952-b910-3d981d4ce48c with identifier: JT36836
2026-03-30 10:54:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75e13ba9-7205-5952-b910-3d981d4ce48c with identifier: JT36836
2026-03-30 10:54:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75e13ba9-7205-5952-b910-3d981d4ce48c with identifier: JT36836 to the API
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:30:09Z',
 'fuel_type': 'petrol',
 'id': '75e13ba9-7205-5952-b910-3d981d4ce48c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT36836',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 92376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-31',
 'seller_name': None,
 'title': 'Skoda Fabia 1.6 Style Edition',
 'transmission': 'manual',
 'trim': 'Style Edition',
 'year': 2009}
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT36836%27 HTTP/1.1" 200 None
2026-03-30 10:54:52 [auto1.de] INFO: Saving data for JT36836: {'auction_closing_time': 1774971009.0, 'created_time': 1773307160.553159, 'last_price_update_time': 1774868092.167434}
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT36836') HTTP/1.1" 204 0
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_e323f821eea2e98e4ed7763082f933b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_e323f821eea2e98e4ed7763082f933b3.jpg not downloaded yet
2026-03-30 10:54:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b16720f5-1c89-53c8-aa4b-102af96b953e with identifier: NY45531
2026-03-30 10:54:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b16720f5-1c89-53c8-aa4b-102af96b953e with identifier: NY45531
2026-03-30 10:54:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b16720f5-1c89-53c8-aa4b-102af96b953e with identifier: NY45531 to the API
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:01:49Z',
 'fuel_type': 'diesel',
 'id': 'b16720f5-1c89-53c8-aa4b-102af96b953e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY45531',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 448054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-21',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2013}
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY45531%27 HTTP/1.1" 200 None
2026-03-30 10:54:52 [auto1.de] INFO: Saving data for NY45531: {'auction_closing_time': 1774969309.0, 'created_time': 1774436019.697552, 'last_price_update_time': 1774868092.561348}
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY45531') HTTP/1.1" 204 0
2026-03-30 10:54:52 [auto1.de] INFO: Found listing with ID: FH56090
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH56090%27 HTTP/1.1" 200 None
2026-03-30 10:54:52 [auto1.de] INFO: Scrape type for FH56090: 2
2026-03-30 10:54:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e5f9b9b-7a4e-5b00-b3df-871bd95d615a with identifier: FH56090
2026-03-30 10:54:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e5f9b9b-7a4e-5b00-b3df-871bd95d615a with scrape type 2
2026-03-30 10:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e5f9b9b-7a4e-5b00-b3df-871bd95d615a with scrape type 2
2026-03-30 10:54:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e5f9b9b-7a4e-5b00-b3df-871bd95d615a, identifier: FH56090
2026-03-30 10:54:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:52 [auto1.de] INFO: Found listing with ID: SB57558
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB57558%27 HTTP/1.1" 200 None
2026-03-30 10:54:52 [auto1.de] INFO: Scrape type for SB57558: 2
2026-03-30 10:54:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e652c2c-3c5b-5a91-b492-47f282c929d5 with identifier: SB57558
2026-03-30 10:54:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e652c2c-3c5b-5a91-b492-47f282c929d5 with scrape type 2
2026-03-30 10:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e652c2c-3c5b-5a91-b492-47f282c929d5 with scrape type 2
2026-03-30 10:54:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e652c2c-3c5b-5a91-b492-47f282c929d5, identifier: SB57558
2026-03-30 10:54:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e5f9b9b-7a4e-5b00-b3df-871bd95d615a with identifier: FH56090
2026-03-30 10:54:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e5f9b9b-7a4e-5b00-b3df-871bd95d615a with identifier: FH56090
2026-03-30 10:54:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e5f9b9b-7a4e-5b00-b3df-871bd95d615a with identifier: FH56090 to the API
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:04:23Z',
 'fuel_type': 'diesel',
 'id': '7e5f9b9b-7a4e-5b00-b3df-871bd95d615a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH56090',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 123004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seller_name': None,
 'title': 'Land Rover Evoque D165 Mild-Hybrid R-Dynamic SE',
 'transmission': 'automatic',
 'trim': 'R-Dynamic SE',
 'year': 2022}
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH56090%27 HTTP/1.1" 200 None
2026-03-30 10:54:53 [auto1.de] INFO: Saving data for FH56090: {'auction_closing_time': 1774969463.0, 'created_time': 1773223588.011561, 'last_price_update_time': 1774868093.281911}
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH56090') HTTP/1.1" 204 0
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_8c32a8358569a8b98bdbdd25e29171fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_8c32a8358569a8b98bdbdd25e29171fe.jpg not downloaded yet
2026-03-30 10:54:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e652c2c-3c5b-5a91-b492-47f282c929d5 with identifier: SB57558
2026-03-30 10:54:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e652c2c-3c5b-5a91-b492-47f282c929d5 with identifier: SB57558
2026-03-30 10:54:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e652c2c-3c5b-5a91-b492-47f282c929d5 with identifier: SB57558 to the API
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:43:48Z',
 'fuel_type': 'diesel',
 'id': '0e652c2c-3c5b-5a91-b492-47f282c929d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB57558',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 129906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-21',
 'seller_name': None,
 'title': 'Volkswagen Beetle 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2015}
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB57558%27 HTTP/1.1" 200 None
2026-03-30 10:54:53 [auto1.de] INFO: Saving data for SB57558: {'auction_closing_time': 1774971828.0, 'created_time': 1773688617.330396, 'last_price_update_time': 1774868093.661027}
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB57558') HTTP/1.1" 204 0
2026-03-30 10:54:53 [auto1.de] INFO: Found listing with ID: MS42171
2026-03-30 10:54:53 [auto1.de] INFO: Found listing with ID: AE33479
2026-03-30 10:54:53 [auto1.de] INFO: Found listing with ID: JR74397
2026-03-30 10:54:53 [auto1.de] INFO: Found listing with ID: VU57107
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU57107%27 HTTP/1.1" 200 None
2026-03-30 10:54:53 [auto1.de] INFO: Scrape type for VU57107: 2
2026-03-30 10:54:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5752b88-fded-5b46-97a0-cbc1ce54e6d2 with identifier: VU57107
2026-03-30 10:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5752b88-fded-5b46-97a0-cbc1ce54e6d2 with scrape type 2
2026-03-30 10:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5752b88-fded-5b46-97a0-cbc1ce54e6d2 with scrape type 2
2026-03-30 10:54:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5752b88-fded-5b46-97a0-cbc1ce54e6d2, identifier: VU57107
2026-03-30 10:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_f463f97274d51569514bb1ad46252016.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:53 [auto1.de] INFO: Found listing with ID: LC01777
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC01777%27 HTTP/1.1" 200 None
2026-03-30 10:54:53 [auto1.de] INFO: Scrape type for LC01777: 2
2026-03-30 10:54:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b514e4b-aa92-5535-ac9c-3e8fa793ed84 with identifier: LC01777
2026-03-30 10:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b514e4b-aa92-5535-ac9c-3e8fa793ed84 with scrape type 2
2026-03-30 10:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b514e4b-aa92-5535-ac9c-3e8fa793ed84 with scrape type 2
2026-03-30 10:54:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b514e4b-aa92-5535-ac9c-3e8fa793ed84, identifier: LC01777
2026-03-30 10:54:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5752b88-fded-5b46-97a0-cbc1ce54e6d2 with identifier: VU57107
2026-03-30 10:54:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5752b88-fded-5b46-97a0-cbc1ce54e6d2 with identifier: VU57107
2026-03-30 10:54:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5752b88-fded-5b46-97a0-cbc1ce54e6d2 with identifier: VU57107 to the API
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:39:25Z',
 'fuel_type': 'diesel',
 'id': 'f5752b88-fded-5b46-97a0-cbc1ce54e6d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU57107',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 196140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU57107%27 HTTP/1.1" 200 None
2026-03-30 10:54:54 [auto1.de] INFO: Saving data for VU57107: {'auction_closing_time': 1774971565.0, 'created_time': 1773305361.475116, 'last_price_update_time': 1774868094.243258}
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU57107') HTTP/1.1" 204 0
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_8c33bde5fe9ca5c508eb0a4b8f537797.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_8c33bde5fe9ca5c508eb0a4b8f537797.jpg not downloaded yet
2026-03-30 10:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_ece4f3c0ed1d4254c9178777eeb2b772.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b514e4b-aa92-5535-ac9c-3e8fa793ed84 with identifier: LC01777
2026-03-30 10:54:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b514e4b-aa92-5535-ac9c-3e8fa793ed84 with identifier: LC01777
2026-03-30 10:54:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b514e4b-aa92-5535-ac9c-3e8fa793ed84 with identifier: LC01777 to the API
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:00:53Z',
 'fuel_type': 'diesel',
 'id': '2b514e4b-aa92-5535-ac9c-3e8fa793ed84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC01777',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 167495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-14',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2015}
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC01777%27 HTTP/1.1" 200 None
2026-03-30 10:54:54 [auto1.de] INFO: Saving data for LC01777: {'auction_closing_time': 1774969253.0, 'created_time': 1773343554.892887, 'last_price_update_time': 1774868094.726576}
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC01777') HTTP/1.1" 204 0
2026-03-30 10:54:54 [auto1.de] INFO: Found listing with ID: DX26542
2026-03-30 10:54:54 [auto1.de] INFO: Found listing with ID: SN70569
2026-03-30 10:54:54 [auto1.de] INFO: Found listing with ID: JD23265
2026-03-30 10:54:54 [auto1.de] INFO: Found listing with ID: VR87804
2026-03-30 10:54:54 [auto1.de] INFO: Found listing with ID: KM31933
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM31933%27 HTTP/1.1" 200 None
2026-03-30 10:54:54 [auto1.de] INFO: Scrape type for KM31933: 2
2026-03-30 10:54:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eb8951f-1e8a-5257-8de8-bdfec2864452 with identifier: KM31933
2026-03-30 10:54:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eb8951f-1e8a-5257-8de8-bdfec2864452 with scrape type 2
2026-03-30 10:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2eb8951f-1e8a-5257-8de8-bdfec2864452 with scrape type 2
2026-03-30 10:54:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2eb8951f-1e8a-5257-8de8-bdfec2864452, identifier: KM31933
2026-03-30 10:54:54 [auto1.de] INFO: Found listing with ID: JT74267
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT74267%27 HTTP/1.1" 200 None
2026-03-30 10:54:54 [auto1.de] INFO: Scrape type for JT74267: 2
2026-03-30 10:54:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d61f7b5-0f0a-516f-ba60-99185df3dd7d with identifier: JT74267
2026-03-30 10:54:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d61f7b5-0f0a-516f-ba60-99185df3dd7d with scrape type 2
2026-03-30 10:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d61f7b5-0f0a-516f-ba60-99185df3dd7d with scrape type 2
2026-03-30 10:54:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d61f7b5-0f0a-516f-ba60-99185df3dd7d, identifier: JT74267
2026-03-30 10:54:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2eb8951f-1e8a-5257-8de8-bdfec2864452 with identifier: KM31933
2026-03-30 10:54:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2eb8951f-1e8a-5257-8de8-bdfec2864452 with identifier: KM31933
2026-03-30 10:54:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2eb8951f-1e8a-5257-8de8-bdfec2864452 with identifier: KM31933 to the API
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:21:40Z',
 'fuel_type': 'petrol',
 'id': '2eb8951f-1e8a-5257-8de8-bdfec2864452',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM31933',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 112494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-13',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Goal',
 'transmission': 'automatic',
 'trim': 'Goal',
 'year': 2006}
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM31933%27 HTTP/1.1" 200 None
2026-03-30 10:54:55 [auto1.de] INFO: Saving data for KM31933: {'auction_closing_time': 1774970500.0, 'created_time': 1774466158.397527, 'last_price_update_time': 1774868095.321412}
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM31933') HTTP/1.1" 204 0
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_3817dd9989c02d97f9d778aa884622a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_3817dd9989c02d97f9d778aa884622a0.jpg not downloaded yet
2026-03-30 10:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_e323f821eea2e98e4ed7763082f933b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d61f7b5-0f0a-516f-ba60-99185df3dd7d with identifier: JT74267
2026-03-30 10:54:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d61f7b5-0f0a-516f-ba60-99185df3dd7d with identifier: JT74267
2026-03-30 10:54:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d61f7b5-0f0a-516f-ba60-99185df3dd7d with identifier: JT74267 to the API
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:20:28Z',
 'fuel_type': 'petrol',
 'id': '1d61f7b5-0f0a-516f-ba60-99185df3dd7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT74267',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 88921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-14',
 'seller_name': None,
 'title': 'Renault Talisman 1.8 TCe Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2019}
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT74267%27 HTTP/1.1" 200 None
2026-03-30 10:54:55 [auto1.de] INFO: Saving data for JT74267: {'auction_closing_time': 1774970428.0, 'created_time': 1774550616.915093, 'last_price_update_time': 1774868095.693958}
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT74267') HTTP/1.1" 204 0
2026-03-30 10:54:55 [auto1.de] INFO: Found listing with ID: LW16241
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW16241%27 HTTP/1.1" 200 None
2026-03-30 10:54:55 [auto1.de] INFO: Scrape type for LW16241: 2
2026-03-30 10:54:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c28c361c-95d8-5bc0-97f7-50719167a0d3 with identifier: LW16241
2026-03-30 10:54:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c28c361c-95d8-5bc0-97f7-50719167a0d3 with scrape type 2
2026-03-30 10:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c28c361c-95d8-5bc0-97f7-50719167a0d3 with scrape type 2
2026-03-30 10:54:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c28c361c-95d8-5bc0-97f7-50719167a0d3, identifier: LW16241
2026-03-30 10:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f432f390>
2026-03-30 10:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_f463f97274d51569514bb1ad46252016.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_f463f97274d51569514bb1ad46252016.jpg saved to cache
2026-03-30 10:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item acbb2900-f379-58b4-ad9e-0a79ce382f9e
2026-03-30 10:54:55 [auto1.de] INFO: Found listing with ID: LF00427
2026-03-30 10:54:55 [auto1.de] INFO: Found listing with ID: MU75641
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU75641%27 HTTP/1.1" 200 None
2026-03-30 10:54:55 [auto1.de] INFO: Scrape type for MU75641: 0
2026-03-30 10:54:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c28c361c-95d8-5bc0-97f7-50719167a0d3 with identifier: LW16241
2026-03-30 10:54:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c28c361c-95d8-5bc0-97f7-50719167a0d3 with identifier: LW16241
2026-03-30 10:54:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c28c361c-95d8-5bc0-97f7-50719167a0d3 with identifier: LW16241 to the API
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:27:17Z',
 'fuel_type': 'petrol',
 'id': 'c28c361c-95d8-5bc0-97f7-50719167a0d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW16241',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 89205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-07',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Black Shadow 4x2',
 'transmission': 'manual',
 'trim': 'Black Shadow 4x2',
 'year': 2017}
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW16241%27 HTTP/1.1" 200 None
2026-03-30 10:54:56 [auto1.de] INFO: Saving data for LW16241: {'auction_closing_time': 1774970837.0, 'created_time': 1774503049.998186, 'last_price_update_time': 1774868096.238907}
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW16241') HTTP/1.1" 204 0
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_810919dad1041dcf95477e2b9cba5d2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_810919dad1041dcf95477e2b9cba5d2f.jpg not downloaded yet
2026-03-30 10:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_8c32a8358569a8b98bdbdd25e29171fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:56 [auto1.de] INFO: Found listing with ID: YP91302
2026-03-30 10:54:56 [auto1.de] INFO: Found listing with ID: GG82433
2026-03-30 10:54:56 [auto1.de] INFO: Found listing with ID: EH94652
2026-03-30 10:54:56 [auto1.de] INFO: Found listing with ID: XV47342
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV47342%27 HTTP/1.1" 200 None
2026-03-30 10:54:56 [auto1.de] INFO: Scrape type for XV47342: 2
2026-03-30 10:54:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ebd1b57-df7c-5590-ae28-cceb2213d34d with identifier: XV47342
2026-03-30 10:54:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ebd1b57-df7c-5590-ae28-cceb2213d34d with scrape type 2
2026-03-30 10:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ebd1b57-df7c-5590-ae28-cceb2213d34d with scrape type 2
2026-03-30 10:54:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ebd1b57-df7c-5590-ae28-cceb2213d34d, identifier: XV47342
2026-03-30 10:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4303b10>
2026-03-30 10:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_ece4f3c0ed1d4254c9178777eeb2b772.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_ece4f3c0ed1d4254c9178777eeb2b772.jpg saved to cache
2026-03-30 10:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item acbb2900-f379-58b4-ad9e-0a79ce382f9e
2026-03-30 10:54:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ebd1b57-df7c-5590-ae28-cceb2213d34d with identifier: XV47342
2026-03-30 10:54:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ebd1b57-df7c-5590-ae28-cceb2213d34d with identifier: XV47342
2026-03-30 10:54:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ebd1b57-df7c-5590-ae28-cceb2213d34d with identifier: XV47342 to the API
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:53:23Z',
 'fuel_type': 'petrol',
 'id': '3ebd1b57-df7c-5590-ae28-cceb2213d34d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV47342',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 223741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-19',
 'seller_name': None,
 'title': 'Audi A6 1.8 TFSI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV47342%27 HTTP/1.1" 200 None
2026-03-30 10:54:56 [auto1.de] INFO: Saving data for XV47342: {'auction_closing_time': 1774972403.0, 'created_time': 1773138294.821897, 'last_price_update_time': 1774868096.801147}
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV47342') HTTP/1.1" 204 0
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_9d467855697d109110ce82f611626887.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_9d467855697d109110ce82f611626887.jpg not downloaded yet
2026-03-30 10:54:56 [auto1.de] INFO: Found listing with ID: VT28358
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT28358%27 HTTP/1.1" 200 None
2026-03-30 10:54:56 [auto1.de] INFO: Scrape type for VT28358: 2
2026-03-30 10:54:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df44666b-d88e-5c67-8401-8ea053a4194c with identifier: VT28358
2026-03-30 10:54:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df44666b-d88e-5c67-8401-8ea053a4194c with scrape type 2
2026-03-30 10:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df44666b-d88e-5c67-8401-8ea053a4194c with scrape type 2
2026-03-30 10:54:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df44666b-d88e-5c67-8401-8ea053a4194c, identifier: VT28358
2026-03-30 10:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefdf850>
2026-03-30 10:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_e323f821eea2e98e4ed7763082f933b3.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_e323f821eea2e98e4ed7763082f933b3.jpg saved to cache
2026-03-30 10:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item acbb2900-f379-58b4-ad9e-0a79ce382f9e
2026-03-30 10:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_8c33bde5fe9ca5c508eb0a4b8f537797.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df44666b-d88e-5c67-8401-8ea053a4194c with identifier: VT28358
2026-03-30 10:54:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df44666b-d88e-5c67-8401-8ea053a4194c with identifier: VT28358
2026-03-30 10:54:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df44666b-d88e-5c67-8401-8ea053a4194c with identifier: VT28358 to the API
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-31T15:51:33Z',
 'fuel_type': 'petrol',
 'id': 'df44666b-d88e-5c67-8401-8ea053a4194c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT28358',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 19051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-22',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Stepway Expression',
 'transmission': 'automatic',
 'trim': 'Stepway Expression',
 'year': 2023}
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT28358%27 HTTP/1.1" 200 None
2026-03-30 10:54:57 [auto1.de] INFO: Saving data for VT28358: {'auction_closing_time': 1774972293.0, 'created_time': 1774467643.342953, 'last_price_update_time': 1774868097.495263}
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT28358') HTTP/1.1" 204 0
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_b7c0f456cc615981589d5562fa8bb882.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_b7c0f456cc615981589d5562fa8bb882.jpg not downloaded yet
2026-03-30 10:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_3817dd9989c02d97f9d778aa884622a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:57 [auto1.de] INFO: Found listing with ID: AD89648
2026-03-30 10:54:57 [auto1.de] INFO: Found listing with ID: YM49351
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM49351%27 HTTP/1.1" 200 None
2026-03-30 10:54:57 [auto1.de] INFO: Scrape type for YM49351: 2
2026-03-30 10:54:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f86e7789-aec6-5e86-aa09-6e496a30a608 with identifier: YM49351
2026-03-30 10:54:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f86e7789-aec6-5e86-aa09-6e496a30a608 with scrape type 2
2026-03-30 10:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f86e7789-aec6-5e86-aa09-6e496a30a608 with scrape type 2
2026-03-30 10:54:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f86e7789-aec6-5e86-aa09-6e496a30a608, identifier: YM49351
2026-03-30 10:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee3f2d0>
2026-03-30 10:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_8c32a8358569a8b98bdbdd25e29171fe.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_8c32a8358569a8b98bdbdd25e29171fe.jpg saved to cache
2026-03-30 10:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item acbb2900-f379-58b4-ad9e-0a79ce382f9e
2026-03-30 10:54:57 [auto1.de] INFO: Channel: 24h | Page: 53 | totalHits: 9525 | hits on page: 40
2026-03-30 10:54:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f86e7789-aec6-5e86-aa09-6e496a30a608 with identifier: YM49351
2026-03-30 10:54:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f86e7789-aec6-5e86-aa09-6e496a30a608 with identifier: YM49351
2026-03-30 10:54:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f86e7789-aec6-5e86-aa09-6e496a30a608 with identifier: YM49351 to the API
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:32:32Z',
 'fuel_type': 'petrol',
 'id': 'f86e7789-aec6-5e86-aa09-6e496a30a608',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM49351',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 150327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-21',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Track & Style 4Motion',
 'transmission': 'manual',
 'trim': 'Track & Style 4Motion',
 'year': 2011}
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM49351%27 HTTP/1.1" 200 None
2026-03-30 10:54:58 [auto1.de] INFO: Saving data for YM49351: {'auction_closing_time': 1774971152.0, 'created_time': 1774378287.591482, 'last_price_update_time': 1774868098.014369}
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM49351') HTTP/1.1" 204 0
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_5a5baac7e02d3cd50173f3daa449cfac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_5a5baac7e02d3cd50173f3daa449cfac.jpg not downloaded yet
2026-03-30 10:54:58 [auto1.de] INFO: Found listing with ID: EP59038
2026-03-30 10:54:58 [auto1.de] INFO: Found listing with ID: XE63092
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE63092%27 HTTP/1.1" 200 None
2026-03-30 10:54:58 [auto1.de] INFO: Scrape type for XE63092: 2
2026-03-30 10:54:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa06a494-2dc7-5411-8f9f-4f27c1ace785 with identifier: XE63092
2026-03-30 10:54:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa06a494-2dc7-5411-8f9f-4f27c1ace785 with scrape type 2
2026-03-30 10:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa06a494-2dc7-5411-8f9f-4f27c1ace785 with scrape type 2
2026-03-30 10:54:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa06a494-2dc7-5411-8f9f-4f27c1ace785, identifier: XE63092
2026-03-30 10:54:58 [auto1.de] INFO: Found listing with ID: RM09243
2026-03-30 10:54:58 [auto1.de] INFO: Found listing with ID: CW91808
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW91808%27 HTTP/1.1" 200 None
2026-03-30 10:54:58 [auto1.de] INFO: Scrape type for CW91808: 2
2026-03-30 10:54:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98fba4f9-3190-5be1-983a-90e29ab6aebe with identifier: CW91808
2026-03-30 10:54:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98fba4f9-3190-5be1-983a-90e29ab6aebe with scrape type 2
2026-03-30 10:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98fba4f9-3190-5be1-983a-90e29ab6aebe with scrape type 2
2026-03-30 10:54:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98fba4f9-3190-5be1-983a-90e29ab6aebe, identifier: CW91808
2026-03-30 10:54:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee622d0>
2026-03-30 10:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_8c33bde5fe9ca5c508eb0a4b8f537797.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_8c33bde5fe9ca5c508eb0a4b8f537797.jpg saved to cache
2026-03-30 10:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item acbb2900-f379-58b4-ad9e-0a79ce382f9e
2026-03-30 10:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_810919dad1041dcf95477e2b9cba5d2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa06a494-2dc7-5411-8f9f-4f27c1ace785 with identifier: XE63092
2026-03-30 10:54:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa06a494-2dc7-5411-8f9f-4f27c1ace785 with identifier: XE63092
2026-03-30 10:54:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa06a494-2dc7-5411-8f9f-4f27c1ace785 with identifier: XE63092 to the API
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:17:24Z',
 'fuel_type': 'diesel',
 'id': 'fa06a494-2dc7-5411-8f9f-4f27c1ace785',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE63092',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 104675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-06',
 'seller_name': None,
 'title': 'BMW 2er 220d Gran Coupe M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE63092%27 HTTP/1.1" 200 None
2026-03-30 10:54:59 [auto1.de] INFO: Saving data for XE63092: {'auction_closing_time': 1774970244.0, 'created_time': 1774463711.201948, 'last_price_update_time': 1774868099.172276}
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE63092') HTTP/1.1" 204 0
2026-03-30 10:54:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98fba4f9-3190-5be1-983a-90e29ab6aebe with identifier: CW91808
2026-03-30 10:54:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98fba4f9-3190-5be1-983a-90e29ab6aebe with identifier: CW91808
2026-03-30 10:54:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98fba4f9-3190-5be1-983a-90e29ab6aebe with identifier: CW91808 to the API
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:03:14Z',
 'fuel_type': 'diesel',
 'id': '98fba4f9-3190-5be1-983a-90e29ab6aebe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW91808',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Country Tourer',
 'odometer': 204947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-30',
 'seller_name': None,
 'title': 'Opel Insignia Country Tourer 2.0 CDTI Basis 4x4',
 'transmission': 'automatic',
 'trim': 'Basis 4x4',
 'year': 2016}
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW91808%27 HTTP/1.1" 200 None
2026-03-30 10:54:59 [auto1.de] INFO: Saving data for CW91808: {'auction_closing_time': 1774969394.0, 'created_time': 1773659363.79611, 'last_price_update_time': 1774868099.540324}
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW91808') HTTP/1.1" 204 0
2026-03-30 10:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_9d467855697d109110ce82f611626887.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:59 [auto1.de] INFO: Found listing with ID: GS35122
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS35122%27 HTTP/1.1" 200 None
2026-03-30 10:54:59 [auto1.de] INFO: Scrape type for GS35122: 2
2026-03-30 10:54:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69346047-1d03-5f6e-a7fe-24a88269a72b with identifier: GS35122
2026-03-30 10:54:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69346047-1d03-5f6e-a7fe-24a88269a72b with scrape type 2
2026-03-30 10:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69346047-1d03-5f6e-a7fe-24a88269a72b with scrape type 2
2026-03-30 10:54:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69346047-1d03-5f6e-a7fe-24a88269a72b, identifier: GS35122
2026-03-30 10:54:59 [auto1.de] INFO: Found listing with ID: FK98396
2026-03-30 10:54:59 [auto1.de] INFO: Found listing with ID: TS14604
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS14604%27 HTTP/1.1" 200 None
2026-03-30 10:54:59 [auto1.de] INFO: Scrape type for TS14604: 2
2026-03-30 10:54:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f77f11fd-c314-5ab0-b688-b64703d6628a with identifier: TS14604
2026-03-30 10:54:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f77f11fd-c314-5ab0-b688-b64703d6628a with scrape type 2
2026-03-30 10:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f77f11fd-c314-5ab0-b688-b64703d6628a with scrape type 2
2026-03-30 10:54:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f77f11fd-c314-5ab0-b688-b64703d6628a, identifier: TS14604
2026-03-30 10:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f41ea290>
2026-03-30 10:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_3817dd9989c02d97f9d778aa884622a0.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_3817dd9989c02d97f9d778aa884622a0.jpg saved to cache
2026-03-30 10:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item acbb2900-f379-58b4-ad9e-0a79ce382f9e
2026-03-30 10:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_56ea32ca54751cb62d8a54c8b26a8c93.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69346047-1d03-5f6e-a7fe-24a88269a72b with identifier: GS35122
2026-03-30 10:54:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69346047-1d03-5f6e-a7fe-24a88269a72b with identifier: GS35122
2026-03-30 10:54:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69346047-1d03-5f6e-a7fe-24a88269a72b with identifier: GS35122 to the API
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:01:39Z',
 'fuel_type': 'diesel',
 'id': '69346047-1d03-5f6e-a7fe-24a88269a72b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS35122',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 65406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-15',
 'seller_name': None,
 'title': 'Audi Q5 40 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2020}
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS35122%27 HTTP/1.1" 200 None
2026-03-30 10:55:00 [auto1.de] INFO: Saving data for GS35122: {'auction_closing_time': 1774969299.0, 'created_time': 1773685859.345659, 'last_price_update_time': 1774868100.262256}
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS35122') HTTP/1.1" 204 0
2026-03-30 10:55:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f77f11fd-c314-5ab0-b688-b64703d6628a with identifier: TS14604
2026-03-30 10:55:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f77f11fd-c314-5ab0-b688-b64703d6628a with identifier: TS14604
2026-03-30 10:55:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f77f11fd-c314-5ab0-b688-b64703d6628a with identifier: TS14604 to the API
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:30:48Z',
 'fuel_type': 'diesel',
 'id': 'f77f11fd-c314-5ab0-b688-b64703d6628a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS14604',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 211330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-02',
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS14604%27 HTTP/1.1" 200 None
2026-03-30 10:55:00 [auto1.de] INFO: Saving data for TS14604: {'auction_closing_time': 1774971048.0, 'created_time': 1774377753.880333, 'last_price_update_time': 1774868100.592549}
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS14604') HTTP/1.1" 204 0
2026-03-30 10:55:00 [auto1.de] INFO: Found listing with ID: VT89208
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT89208%27 HTTP/1.1" 200 None
2026-03-30 10:55:00 [auto1.de] INFO: Scrape type for VT89208: 2
2026-03-30 10:55:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0ad0110-39cd-59b9-b01c-41cea58ba5c9 with identifier: VT89208
2026-03-30 10:55:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0ad0110-39cd-59b9-b01c-41cea58ba5c9 with scrape type 2
2026-03-30 10:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0ad0110-39cd-59b9-b01c-41cea58ba5c9 with scrape type 2
2026-03-30 10:55:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0ad0110-39cd-59b9-b01c-41cea58ba5c9, identifier: VT89208
2026-03-30 10:55:01 [auto1.de] INFO: Found listing with ID: GA97720
2026-03-30 10:55:01 [auto1.de] INFO: Found listing with ID: CT77406
2026-03-30 10:55:01 [auto1.de] INFO: Found listing with ID: DB10875
2026-03-30 10:55:01 [auto1.de] INFO: Found listing with ID: JG98331
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG98331%27 HTTP/1.1" 200 None
2026-03-30 10:55:01 [auto1.de] INFO: Scrape type for JG98331: 2
2026-03-30 10:55:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a8f0c9e-92d1-51b3-a1c5-16606a5611ae with identifier: JG98331
2026-03-30 10:55:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a8f0c9e-92d1-51b3-a1c5-16606a5611ae with scrape type 2
2026-03-30 10:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a8f0c9e-92d1-51b3-a1c5-16606a5611ae with scrape type 2
2026-03-30 10:55:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a8f0c9e-92d1-51b3-a1c5-16606a5611ae, identifier: JG98331
2026-03-30 10:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA30799> (referer: https://www.auto1.com/v1/car-details-view/CA30799/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee478a10>
2026-03-30 10:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_810919dad1041dcf95477e2b9cba5d2f.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_810919dad1041dcf95477e2b9cba5d2f.jpg saved to cache
2026-03-30 10:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item acbb2900-f379-58b4-ad9e-0a79ce382f9e
2026-03-30 10:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_b7c0f456cc615981589d5562fa8bb882.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0ad0110-39cd-59b9-b01c-41cea58ba5c9 with identifier: VT89208
2026-03-30 10:55:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0ad0110-39cd-59b9-b01c-41cea58ba5c9 with identifier: VT89208
2026-03-30 10:55:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0ad0110-39cd-59b9-b01c-41cea58ba5c9 with identifier: VT89208 to the API
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:20:42Z',
 'fuel_type': 'petrol',
 'id': 'c0ad0110-39cd-59b9-b01c-41cea58ba5c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT89208',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 206838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-24',
 'seller_name': None,
 'title': 'Skoda Octavia 1.8 TSI Sport Edition',
 'transmission': 'manual',
 'trim': 'Sport Edition',
 'year': 2007}
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT89208%27 HTTP/1.1" 200 None
2026-03-30 10:55:02 [auto1.de] INFO: Saving data for VT89208: {'auction_closing_time': 1774970442.0, 'created_time': 1774377688.042198, 'last_price_update_time': 1774868102.375524}
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT89208') HTTP/1.1" 204 0
2026-03-30 10:55:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a8f0c9e-92d1-51b3-a1c5-16606a5611ae with identifier: JG98331
2026-03-30 10:55:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a8f0c9e-92d1-51b3-a1c5-16606a5611ae with identifier: JG98331
2026-03-30 10:55:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a8f0c9e-92d1-51b3-a1c5-16606a5611ae with identifier: JG98331 to the API
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:40:53Z',
 'fuel_type': 'petrol',
 'id': '6a8f0c9e-92d1-51b3-a1c5-16606a5611ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG98331',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 111602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-11',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2005}
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG98331%27 HTTP/1.1" 200 None
2026-03-30 10:55:02 [auto1.de] INFO: Saving data for JG98331: {'auction_closing_time': 1774971653.0, 'created_time': 1773303873.52871, 'last_price_update_time': 1774868102.908746}
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG98331') HTTP/1.1" 204 0
2026-03-30 10:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_5a5baac7e02d3cd50173f3daa449cfac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:02 [auto1.de] INFO: Found listing with ID: GA83394
2026-03-30 10:55:02 [auto1.de] INFO: Found listing with ID: VS58629
2026-03-30 10:55:02 [auto1.de] INFO: Found listing with ID: ND00067
2026-03-30 10:55:02 [auto1.de] INFO: Found listing with ID: SH97654
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH97654%27 HTTP/1.1" 200 None
2026-03-30 10:55:02 [auto1.de] INFO: Scrape type for SH97654: 2
2026-03-30 10:55:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3caab5d-36e2-51a0-acef-75dfebf59376 with identifier: SH97654
2026-03-30 10:55:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3caab5d-36e2-51a0-acef-75dfebf59376 with scrape type 2
2026-03-30 10:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3caab5d-36e2-51a0-acef-75dfebf59376 with scrape type 2
2026-03-30 10:55:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3caab5d-36e2-51a0-acef-75dfebf59376, identifier: SH97654
2026-03-30 10:55:03 [auto1.de] INFO: Found listing with ID: NH29659
2026-03-30 10:55:03 [auto1.de] INFO: Found listing with ID: JS22549
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS22549%27 HTTP/1.1" 200 None
2026-03-30 10:55:03 [auto1.de] INFO: Scrape type for JS22549: 2
2026-03-30 10:55:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2243b299-44d8-5973-bb6b-68d811da7df6 with identifier: JS22549
2026-03-30 10:55:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2243b299-44d8-5973-bb6b-68d811da7df6 with scrape type 2
2026-03-30 10:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2243b299-44d8-5973-bb6b-68d811da7df6 with scrape type 2
2026-03-30 10:55:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2243b299-44d8-5973-bb6b-68d811da7df6, identifier: JS22549
2026-03-30 10:55:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3caab5d-36e2-51a0-acef-75dfebf59376 with identifier: SH97654
2026-03-30 10:55:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3caab5d-36e2-51a0-acef-75dfebf59376 with identifier: SH97654
2026-03-30 10:55:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3caab5d-36e2-51a0-acef-75dfebf59376 with identifier: SH97654 to the API
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:53:42Z',
 'fuel_type': 'petrol',
 'id': 'e3caab5d-36e2-51a0-acef-75dfebf59376',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH97654',
 'listing': 'auction',
 'make': 'MG Rover',
 'model': '25',
 'odometer': 108759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-10-30',
 'seller_name': None,
 'title': 'MG Rover 25 1.6 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2001}
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH97654%27 HTTP/1.1" 200 None
2026-03-30 10:55:03 [auto1.de] INFO: Saving data for SH97654: {'auction_closing_time': 1774972422.0, 'created_time': 1774262789.651127, 'last_price_update_time': 1774868103.587108}
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SH97654') HTTP/1.1" 204 0
2026-03-30 10:55:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2243b299-44d8-5973-bb6b-68d811da7df6 with identifier: JS22549
2026-03-30 10:55:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2243b299-44d8-5973-bb6b-68d811da7df6 with identifier: JS22549
2026-03-30 10:55:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2243b299-44d8-5973-bb6b-68d811da7df6 with identifier: JS22549 to the API
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-31T15:52:28Z',
 'fuel_type': 'petrol',
 'id': '2243b299-44d8-5973-bb6b-68d811da7df6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS22549',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 146839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-20',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS22549%27 HTTP/1.1" 200 None
2026-03-30 10:55:04 [auto1.de] INFO: Saving data for JS22549: {'auction_closing_time': 1774972348.0, 'created_time': 1773775229.652342, 'last_price_update_time': 1774868104.017388}
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS22549') HTTP/1.1" 204 0
2026-03-30 10:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eed0f1d0>
2026-03-30 10:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_9d467855697d109110ce82f611626887.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_9d467855697d109110ce82f611626887.jpg saved to cache
2026-03-30 10:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item acbb2900-f379-58b4-ad9e-0a79ce382f9e
2026-03-30 10:55:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4196c10>
2026-03-30 10:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3aa89912fcf2354101ed2152306dc%252Fpa%252FLU03314_56ea32ca54751cb62d8a54c8b26a8c93.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_56ea32ca54751cb62d8a54c8b26a8c93.jpg saved to cache
2026-03-30 10:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3
2026-03-30 10:55:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3, skipping ID generation
2026-03-30 10:55:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3 with scrape type 1
2026-03-30 10:55:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3 sending to next pipeline
2026-03-30 10:55:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3, identifier: LU03314
2026-03-30 10:55:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c with identifier: CA30799
2026-03-30 10:55:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c with scrape type 1
2026-03-30 10:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_c4a1737c17dd5f43c534c7733f06c695.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_c4a1737c17dd5f43c534c7733f06c695.jpg not downloaded yet
2026-03-30 10:55:04 [auto1.de] INFO: Found listing with ID: KW34435
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW34435%27 HTTP/1.1" 200 None
2026-03-30 10:55:04 [auto1.de] INFO: Scrape type for KW34435: 2
2026-03-30 10:55:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cb20f71-c8c5-56bc-ba1d-f72fa7226991 with identifier: KW34435
2026-03-30 10:55:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cb20f71-c8c5-56bc-ba1d-f72fa7226991 with scrape type 2
2026-03-30 10:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cb20f71-c8c5-56bc-ba1d-f72fa7226991 with scrape type 2
2026-03-30 10:55:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cb20f71-c8c5-56bc-ba1d-f72fa7226991, identifier: KW34435
2026-03-30 10:55:04 [auto1.de] INFO: Found listing with ID: WU48136
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU48136%27 HTTP/1.1" 200 None
2026-03-30 10:55:04 [auto1.de] INFO: Scrape type for WU48136: 2
2026-03-30 10:55:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22b4b106-3e53-53ef-a0cb-e3dafacf3320 with identifier: WU48136
2026-03-30 10:55:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22b4b106-3e53-53ef-a0cb-e3dafacf3320 with scrape type 2
2026-03-30 10:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22b4b106-3e53-53ef-a0cb-e3dafacf3320 with scrape type 2
2026-03-30 10:55:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22b4b106-3e53-53ef-a0cb-e3dafacf3320, identifier: WU48136
2026-03-30 10:55:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3 with identifier: LU03314
2026-03-30 10:55:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3 with identifier: LU03314
2026-03-30 10:55:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3 with identifier: LU03314 to the API
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_56ea32ca54751cb62d8a54c8b26a8c93.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:10:22Z',
 'fuel_type': 'diesel',
 'id': 'f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU03314',
 'listing': 'auction',
 'location': 'DE, Eichenzell',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 51544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2730357,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_56ea32ca54751cb62d8a54c8b26a8c93.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_81cf502c577e29a24dedb07e599eb977.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_cdfd7badad832747b16be6e097204b1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_3b2317203efa1248645c86fe96a627d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_49bb548040fb7dc4418057a7cde99b79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_36167b2500ee914dbe90f0615a245799.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_78c72694ab0dfd74d632decd0d6e90e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_f922ad5dbef80e1da190f5bb0a1ab21c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_61aa67b284b92c87f5c98c9c372e3108.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3/f5a2f904-35c8-5fa3-983b-1e11b0ea4ae3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/c3/23c3aa89912fcf2354101ed2152306dc/pa/LU03314_fcd800525d1de0510697bfbf1ef96c72.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2024}
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU03314%27 HTTP/1.1" 200 None
2026-03-30 10:55:05 [auto1.de] INFO: Saving data for LU03314: {'created_time': 1774868105.054164, 'last_price_update_time': 1774868105.054179, 'auction_closing_time': 1774969822.0}
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU03314') HTTP/1.1" 204 0
2026-03-30 10:55:05 [scrapy.extensions.logstats] INFO: Crawled 785 pages (at 14 pages/min), scraped 965 items (at 98 items/min)
2026-03-30 10:55:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:55:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cb20f71-c8c5-56bc-ba1d-f72fa7226991 with identifier: KW34435
2026-03-30 10:55:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cb20f71-c8c5-56bc-ba1d-f72fa7226991 with identifier: KW34435
2026-03-30 10:55:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cb20f71-c8c5-56bc-ba1d-f72fa7226991 with identifier: KW34435 to the API
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:02:29Z',
 'fuel_type': 'petrol',
 'id': '5cb20f71-c8c5-56bc-ba1d-f72fa7226991',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW34435',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 179405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-26',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 170 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2005}
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW34435%27 HTTP/1.1" 200 None
2026-03-30 10:55:05 [auto1.de] INFO: Saving data for KW34435: {'auction_closing_time': 1774969349.0, 'created_time': 1773305829.021094, 'last_price_update_time': 1774868105.414468}
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW34435') HTTP/1.1" 204 0
2026-03-30 10:55:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22b4b106-3e53-53ef-a0cb-e3dafacf3320 with identifier: WU48136
2026-03-30 10:55:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22b4b106-3e53-53ef-a0cb-e3dafacf3320 with identifier: WU48136
2026-03-30 10:55:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22b4b106-3e53-53ef-a0cb-e3dafacf3320 with identifier: WU48136 to the API
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:29:33Z',
 'fuel_type': 'petrol',
 'id': '22b4b106-3e53-53ef-a0cb-e3dafacf3320',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU48136',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 67153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-07',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-30 10:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU48136%27 HTTP/1.1" 200 None
2026-03-30 10:55:06 [auto1.de] INFO: Saving data for WU48136: {'auction_closing_time': 1774970973.0, 'created_time': 1773344548.353933, 'last_price_update_time': 1774868106.865384}
2026-03-30 10:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WU48136') HTTP/1.1" 204 0
2026-03-30 10:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_7af5aea626521fdb939e1e884ccd5e8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_7af5aea626521fdb939e1e884ccd5e8b.jpg not downloaded yet
2026-03-30 10:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef1ab10>
2026-03-30 10:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_b7c0f456cc615981589d5562fa8bb882.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_b7c0f456cc615981589d5562fa8bb882.jpg saved to cache
2026-03-30 10:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item acbb2900-f379-58b4-ad9e-0a79ce382f9e
2026-03-30 10:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4228190>
2026-03-30 10:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fab%252F8fabb12e9ac47a01fbd9b0b8c41bb51a%252Fpa%252FXC07507_5a5baac7e02d3cd50173f3daa449cfac.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_5a5baac7e02d3cd50173f3daa449cfac.jpg saved to cache
2026-03-30 10:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item acbb2900-f379-58b4-ad9e-0a79ce382f9e
2026-03-30 10:55:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acbb2900-f379-58b4-ad9e-0a79ce382f9e, skipping ID generation
2026-03-30 10:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acbb2900-f379-58b4-ad9e-0a79ce382f9e with scrape type 1
2026-03-30 10:55:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item acbb2900-f379-58b4-ad9e-0a79ce382f9e sending to next pipeline
2026-03-30 10:55:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acbb2900-f379-58b4-ad9e-0a79ce382f9e, identifier: XC07507
2026-03-30 10:55:07 [auto1.de] INFO: Found listing with ID: WB92909
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB92909%27 HTTP/1.1" 200 None
2026-03-30 10:55:07 [auto1.de] INFO: Scrape type for WB92909: 2
2026-03-30 10:55:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89a1d81e-7cb5-53e1-95f5-35b7ee2a17ba with identifier: WB92909
2026-03-30 10:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89a1d81e-7cb5-53e1-95f5-35b7ee2a17ba with scrape type 2
2026-03-30 10:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89a1d81e-7cb5-53e1-95f5-35b7ee2a17ba with scrape type 2
2026-03-30 10:55:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89a1d81e-7cb5-53e1-95f5-35b7ee2a17ba, identifier: WB92909
2026-03-30 10:55:07 [auto1.de] INFO: Found listing with ID: KZ13921
2026-03-30 10:55:07 [auto1.de] INFO: Found listing with ID: GR74650
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR74650%27 HTTP/1.1" 200 None
2026-03-30 10:55:07 [auto1.de] INFO: Scrape type for GR74650: 2
2026-03-30 10:55:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a53c1fa2-c153-50d2-bdd3-4dd9ff300ae7 with identifier: GR74650
2026-03-30 10:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a53c1fa2-c153-50d2-bdd3-4dd9ff300ae7 with scrape type 2
2026-03-30 10:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a53c1fa2-c153-50d2-bdd3-4dd9ff300ae7 with scrape type 2
2026-03-30 10:55:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a53c1fa2-c153-50d2-bdd3-4dd9ff300ae7, identifier: GR74650
2026-03-30 10:55:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acbb2900-f379-58b4-ad9e-0a79ce382f9e with identifier: XC07507
2026-03-30 10:55:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acbb2900-f379-58b4-ad9e-0a79ce382f9e with identifier: XC07507
2026-03-30 10:55:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acbb2900-f379-58b4-ad9e-0a79ce382f9e with identifier: XC07507 to the API
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_5a5baac7e02d3cd50173f3daa449cfac.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:41:07Z',
 'fuel_type': 'diesel',
 'id': 'acbb2900-f379-58b4-ad9e-0a79ce382f9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC07507',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 217376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_f463f97274d51569514bb1ad46252016.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_ece4f3c0ed1d4254c9178777eeb2b772.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_e323f821eea2e98e4ed7763082f933b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_8c32a8358569a8b98bdbdd25e29171fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_8c33bde5fe9ca5c508eb0a4b8f537797.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_3817dd9989c02d97f9d778aa884622a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_810919dad1041dcf95477e2b9cba5d2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_9d467855697d109110ce82f611626887.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_b7c0f456cc615981589d5562fa8bb882.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acbb2900-f379-58b4-ad9e-0a79ce382f9e/acbb2900-f379-58b4-ad9e-0a79ce382f9e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/ab/8fabb12e9ac47a01fbd9b0b8c41bb51a/pa/XC07507_5a5baac7e02d3cd50173f3daa449cfac.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Lounge BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2015}
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC07507%27 HTTP/1.1" 200 None
2026-03-30 10:55:07 [auto1.de] INFO: Saving data for XC07507: {'created_time': 1774868107.891128, 'last_price_update_time': 1774868107.891141, 'auction_closing_time': 1774971667.0}
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC07507') HTTP/1.1" 204 0
2026-03-30 10:55:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89a1d81e-7cb5-53e1-95f5-35b7ee2a17ba with identifier: WB92909
2026-03-30 10:55:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89a1d81e-7cb5-53e1-95f5-35b7ee2a17ba with identifier: WB92909
2026-03-30 10:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89a1d81e-7cb5-53e1-95f5-35b7ee2a17ba with identifier: WB92909 to the API
2026-03-30 10:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:05:35Z',
 'fuel_type': 'petrol',
 'id': '89a1d81e-7cb5-53e1-95f5-35b7ee2a17ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB92909',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 39942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-27',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TSI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2024}
2026-03-30 10:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB92909%27 HTTP/1.1" 200 None
2026-03-30 10:55:08 [auto1.de] INFO: Saving data for WB92909: {'auction_closing_time': 1774969535.0, 'created_time': 1774435114.010783, 'last_price_update_time': 1774868108.66181}
2026-03-30 10:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB92909') HTTP/1.1" 204 0
2026-03-30 10:55:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a53c1fa2-c153-50d2-bdd3-4dd9ff300ae7 with identifier: GR74650
2026-03-30 10:55:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a53c1fa2-c153-50d2-bdd3-4dd9ff300ae7 with identifier: GR74650
2026-03-30 10:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a53c1fa2-c153-50d2-bdd3-4dd9ff300ae7 with identifier: GR74650 to the API
2026-03-30 10:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:18:07Z',
 'fuel_type': 'petrol',
 'id': 'a53c1fa2-c153-50d2-bdd3-4dd9ff300ae7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR74650',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 114414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-06',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Match',
 'transmission': 'automatic',
 'trim': 'Match',
 'year': 2012}
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR74650%27 HTTP/1.1" 200 None
2026-03-30 10:55:09 [auto1.de] INFO: Saving data for GR74650: {'auction_closing_time': 1774970287.0, 'created_time': 1773304827.23722, 'last_price_update_time': 1774868109.069401}
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR74650') HTTP/1.1" 204 0
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_6941ac1ba34c7e45917aaf1e7d9ff554.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_6941ac1ba34c7e45917aaf1e7d9ff554.jpg not downloaded yet
2026-03-30 10:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:09 [auto1.de] INFO: Found listing with ID: WX92371
2026-03-30 10:55:09 [auto1.de] INFO: Found listing with ID: XY85080
2026-03-30 10:55:09 [auto1.de] INFO: Found listing with ID: SV18640
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV18640%27 HTTP/1.1" 200 None
2026-03-30 10:55:09 [auto1.de] INFO: Scrape type for SV18640: 2
2026-03-30 10:55:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe424dd7-4aa9-51df-bf36-6ec09af33c02 with identifier: SV18640
2026-03-30 10:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe424dd7-4aa9-51df-bf36-6ec09af33c02 with scrape type 2
2026-03-30 10:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe424dd7-4aa9-51df-bf36-6ec09af33c02 with scrape type 2
2026-03-30 10:55:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe424dd7-4aa9-51df-bf36-6ec09af33c02, identifier: SV18640
2026-03-30 10:55:09 [auto1.de] INFO: Found listing with ID: XT03032
2026-03-30 10:55:09 [auto1.de] INFO: Found listing with ID: DZ69719
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ69719%27 HTTP/1.1" 200 None
2026-03-30 10:55:09 [auto1.de] INFO: Scrape type for DZ69719: 2
2026-03-30 10:55:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84b0e8e2-fb3d-5dcb-b662-42eb6128173b with identifier: DZ69719
2026-03-30 10:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84b0e8e2-fb3d-5dcb-b662-42eb6128173b with scrape type 2
2026-03-30 10:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84b0e8e2-fb3d-5dcb-b662-42eb6128173b with scrape type 2
2026-03-30 10:55:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84b0e8e2-fb3d-5dcb-b662-42eb6128173b, identifier: DZ69719
2026-03-30 10:55:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe424dd7-4aa9-51df-bf36-6ec09af33c02 with identifier: SV18640
2026-03-30 10:55:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe424dd7-4aa9-51df-bf36-6ec09af33c02 with identifier: SV18640
2026-03-30 10:55:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe424dd7-4aa9-51df-bf36-6ec09af33c02 with identifier: SV18640 to the API
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:39:56Z',
 'fuel_type': 'diesel',
 'id': 'fe424dd7-4aa9-51df-bf36-6ec09af33c02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV18640',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 14308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-05',
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Beach',
 'transmission': 'automatic',
 'trim': 'Beach',
 'year': 2017}
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV18640%27 HTTP/1.1" 200 None
2026-03-30 10:55:09 [auto1.de] INFO: Saving data for SV18640: {'auction_closing_time': 1774971596.0, 'created_time': 1773344493.145375, 'last_price_update_time': 1774868109.685842}
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV18640') HTTP/1.1" 204 0
2026-03-30 10:55:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84b0e8e2-fb3d-5dcb-b662-42eb6128173b with identifier: DZ69719
2026-03-30 10:55:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84b0e8e2-fb3d-5dcb-b662-42eb6128173b with identifier: DZ69719
2026-03-30 10:55:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84b0e8e2-fb3d-5dcb-b662-42eb6128173b with identifier: DZ69719 to the API
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:55:31Z',
 'fuel_type': 'petrol',
 'id': '84b0e8e2-fb3d-5dcb-b662-42eb6128173b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ69719',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 209264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-11-19',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2000}
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ69719%27 HTTP/1.1" 200 None
2026-03-30 10:55:10 [auto1.de] INFO: Saving data for DZ69719: {'auction_closing_time': 1774972531.0, 'created_time': 1774293832.084984, 'last_price_update_time': 1774868110.070051}
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ69719') HTTP/1.1" 204 0
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_9a448f805530cc4c78c800475d52fcd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_9a448f805530cc4c78c800475d52fcd6.jpg not downloaded yet
2026-03-30 10:55:10 [auto1.de] INFO: Found listing with ID: LL54952
2026-03-30 10:55:10 [auto1.de] INFO: Found listing with ID: DM70532
2026-03-30 10:55:10 [auto1.de] INFO: Found listing with ID: EA23074
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA23074%27 HTTP/1.1" 200 None
2026-03-30 10:55:10 [auto1.de] INFO: Scrape type for EA23074: 2
2026-03-30 10:55:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0a83148-99ee-52a0-8616-d2dcc963e14e with identifier: EA23074
2026-03-30 10:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0a83148-99ee-52a0-8616-d2dcc963e14e with scrape type 2
2026-03-30 10:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0a83148-99ee-52a0-8616-d2dcc963e14e with scrape type 2
2026-03-30 10:55:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0a83148-99ee-52a0-8616-d2dcc963e14e, identifier: EA23074
2026-03-30 10:55:10 [auto1.de] INFO: Found listing with ID: LC58523
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC58523%27 HTTP/1.1" 200 None
2026-03-30 10:55:10 [auto1.de] INFO: Scrape type for LC58523: 2
2026-03-30 10:55:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ea27f8f-126f-5a52-9f73-b54b254d68b5 with identifier: LC58523
2026-03-30 10:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ea27f8f-126f-5a52-9f73-b54b254d68b5 with scrape type 2
2026-03-30 10:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ea27f8f-126f-5a52-9f73-b54b254d68b5 with scrape type 2
2026-03-30 10:55:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ea27f8f-126f-5a52-9f73-b54b254d68b5, identifier: LC58523
2026-03-30 10:55:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0a83148-99ee-52a0-8616-d2dcc963e14e with identifier: EA23074
2026-03-30 10:55:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0a83148-99ee-52a0-8616-d2dcc963e14e with identifier: EA23074
2026-03-30 10:55:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0a83148-99ee-52a0-8616-d2dcc963e14e with identifier: EA23074 to the API
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-31T15:53:35Z',
 'fuel_type': 'diesel',
 'id': 'f0a83148-99ee-52a0-8616-d2dcc963e14e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA23074',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 115340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 400 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA23074%27 HTTP/1.1" 200 None
2026-03-30 10:55:10 [auto1.de] INFO: Saving data for EA23074: {'auction_closing_time': 1774972415.0, 'created_time': 1773344943.575611, 'last_price_update_time': 1774868110.673648}
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA23074') HTTP/1.1" 204 0
2026-03-30 10:55:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ea27f8f-126f-5a52-9f73-b54b254d68b5 with identifier: LC58523
2026-03-30 10:55:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ea27f8f-126f-5a52-9f73-b54b254d68b5 with identifier: LC58523
2026-03-30 10:55:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ea27f8f-126f-5a52-9f73-b54b254d68b5 with identifier: LC58523 to the API
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-31T15:21:48Z',
 'fuel_type': 'diesel',
 'id': '8ea27f8f-126f-5a52-9f73-b54b254d68b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC58523',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 49554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-06',
 'seller_name': None,
 'title': 'Audi Q7 50 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC58523%27 HTTP/1.1" 200 None
2026-03-30 10:55:11 [auto1.de] INFO: Saving data for LC58523: {'auction_closing_time': 1774970508.0, 'created_time': 1773304076.114046, 'last_price_update_time': 1774868111.233083}
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC58523') HTTP/1.1" 204 0
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_5b3694020bb467ad2674be2791b5c1a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_5b3694020bb467ad2674be2791b5c1a5.jpg not downloaded yet
2026-03-30 10:55:11 [auto1.de] INFO: Found listing with ID: RM09243
2026-03-30 10:55:11 [auto1.de] INFO: Found listing with ID: XM80704
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM80704%27 HTTP/1.1" 200 None
2026-03-30 10:55:11 [auto1.de] INFO: Scrape type for XM80704: 2
2026-03-30 10:55:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77d3ffca-bc48-53af-b8e4-f0b8e6ad5ac8 with identifier: XM80704
2026-03-30 10:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77d3ffca-bc48-53af-b8e4-f0b8e6ad5ac8 with scrape type 2
2026-03-30 10:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77d3ffca-bc48-53af-b8e4-f0b8e6ad5ac8 with scrape type 2
2026-03-30 10:55:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77d3ffca-bc48-53af-b8e4-f0b8e6ad5ac8, identifier: XM80704
2026-03-30 10:55:11 [auto1.de] INFO: Channel: 24h | Page: 54 | totalHits: 9525 | hits on page: 40
2026-03-30 10:55:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77d3ffca-bc48-53af-b8e4-f0b8e6ad5ac8 with identifier: XM80704
2026-03-30 10:55:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77d3ffca-bc48-53af-b8e4-f0b8e6ad5ac8 with identifier: XM80704
2026-03-30 10:55:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77d3ffca-bc48-53af-b8e4-f0b8e6ad5ac8 with identifier: XM80704 to the API
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:08:29Z',
 'fuel_type': 'diesel',
 'id': '77d3ffca-bc48-53af-b8e4-f0b8e6ad5ac8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM80704',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 240974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-18',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 320 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM80704%27 HTTP/1.1" 200 None
2026-03-30 10:55:11 [auto1.de] INFO: Saving data for XM80704: {'auction_closing_time': 1774969709.0, 'created_time': 1773946439.279203, 'last_price_update_time': 1774868111.732604}
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM80704') HTTP/1.1" 204 0
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_ad1a9674846f7138e5b5a2e3d2613375.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_ad1a9674846f7138e5b5a2e3d2613375.jpg not downloaded yet
2026-03-30 10:55:11 [auto1.de] INFO: Found listing with ID: MS18756
2026-03-30 10:55:11 [auto1.de] INFO: Found listing with ID: BH54798
2026-03-30 10:55:11 [auto1.de] INFO: Found listing with ID: WU88616
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU88616%27 HTTP/1.1" 200 None
2026-03-30 10:55:11 [auto1.de] INFO: Scrape type for WU88616: 2
2026-03-30 10:55:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b730de8-26b9-5ccb-a21b-19bcdbabe531 with identifier: WU88616
2026-03-30 10:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b730de8-26b9-5ccb-a21b-19bcdbabe531 with scrape type 2
2026-03-30 10:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b730de8-26b9-5ccb-a21b-19bcdbabe531 with scrape type 2
2026-03-30 10:55:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b730de8-26b9-5ccb-a21b-19bcdbabe531, identifier: WU88616
2026-03-30 10:55:11 [auto1.de] INFO: Found listing with ID: TH95550
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH95550%27 HTTP/1.1" 200 None
2026-03-30 10:55:11 [auto1.de] INFO: Scrape type for TH95550: 2
2026-03-30 10:55:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 369366b2-0a29-5a2d-83d0-4df999618950 with identifier: TH95550
2026-03-30 10:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 369366b2-0a29-5a2d-83d0-4df999618950 with scrape type 2
2026-03-30 10:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 369366b2-0a29-5a2d-83d0-4df999618950 with scrape type 2
2026-03-30 10:55:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 369366b2-0a29-5a2d-83d0-4df999618950, identifier: TH95550
2026-03-30 10:55:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b730de8-26b9-5ccb-a21b-19bcdbabe531 with identifier: WU88616
2026-03-30 10:55:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b730de8-26b9-5ccb-a21b-19bcdbabe531 with identifier: WU88616
2026-03-30 10:55:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b730de8-26b9-5ccb-a21b-19bcdbabe531 with identifier: WU88616 to the API
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:49:15Z',
 'fuel_type': 'diesel',
 'id': '6b730de8-26b9-5ccb-a21b-19bcdbabe531',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU88616',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 265567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-12-09',
 'seller_name': None,
 'title': 'Audi A4 1.9 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU88616%27 HTTP/1.1" 200 None
2026-03-30 10:55:12 [auto1.de] INFO: Saving data for WU88616: {'auction_closing_time': 1774972155.0, 'created_time': 1773302277.505475, 'last_price_update_time': 1774868112.599524}
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WU88616') HTTP/1.1" 204 0
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_f9e00f1246b8dd9578d205e9ddcbebf7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_f9e00f1246b8dd9578d205e9ddcbebf7.jpg not downloaded yet
2026-03-30 10:55:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 369366b2-0a29-5a2d-83d0-4df999618950 with identifier: TH95550
2026-03-30 10:55:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 369366b2-0a29-5a2d-83d0-4df999618950 with identifier: TH95550
2026-03-30 10:55:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 369366b2-0a29-5a2d-83d0-4df999618950 with identifier: TH95550 to the API
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-31T15:23:05Z',
 'fuel_type': 'petrol',
 'id': '369366b2-0a29-5a2d-83d0-4df999618950',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH95550',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 68883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-28',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 Edition 2WD',
 'transmission': 'manual',
 'trim': 'Edition 2WD',
 'year': 2012}
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH95550%27 HTTP/1.1" 200 None
2026-03-30 10:55:13 [auto1.de] INFO: Saving data for TH95550: {'auction_closing_time': 1774970585.0, 'created_time': 1773945668.662743, 'last_price_update_time': 1774868113.056768}
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH95550') HTTP/1.1" 204 0
2026-03-30 10:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_9a448f805530cc4c78c800475d52fcd6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:13 [auto1.de] INFO: Found listing with ID: ZM28041
2026-03-30 10:55:13 [auto1.de] INFO: Found listing with ID: SM60062
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM60062%27 HTTP/1.1" 200 None
2026-03-30 10:55:13 [auto1.de] INFO: Scrape type for SM60062: 2
2026-03-30 10:55:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8119520c-caa9-5393-8e2b-0d278c5875d7 with identifier: SM60062
2026-03-30 10:55:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8119520c-caa9-5393-8e2b-0d278c5875d7 with scrape type 2
2026-03-30 10:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8119520c-caa9-5393-8e2b-0d278c5875d7 with scrape type 2
2026-03-30 10:55:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8119520c-caa9-5393-8e2b-0d278c5875d7, identifier: SM60062
2026-03-30 10:55:13 [auto1.de] INFO: Found listing with ID: RL71472
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL71472%27 HTTP/1.1" 200 None
2026-03-30 10:55:13 [auto1.de] INFO: Scrape type for RL71472: 2
2026-03-30 10:55:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d1a027f-b206-52f9-94c4-b69633f21573 with identifier: RL71472
2026-03-30 10:55:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d1a027f-b206-52f9-94c4-b69633f21573 with scrape type 2
2026-03-30 10:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d1a027f-b206-52f9-94c4-b69633f21573 with scrape type 2
2026-03-30 10:55:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d1a027f-b206-52f9-94c4-b69633f21573, identifier: RL71472
2026-03-30 10:55:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8119520c-caa9-5393-8e2b-0d278c5875d7 with identifier: SM60062
2026-03-30 10:55:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8119520c-caa9-5393-8e2b-0d278c5875d7 with identifier: SM60062
2026-03-30 10:55:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8119520c-caa9-5393-8e2b-0d278c5875d7 with identifier: SM60062 to the API
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:47:28Z',
 'fuel_type': 'petrol',
 'id': '8119520c-caa9-5393-8e2b-0d278c5875d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM60062',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 139491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-20',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2016}
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM60062%27 HTTP/1.1" 200 None
2026-03-30 10:55:13 [auto1.de] INFO: Saving data for SM60062: {'auction_closing_time': 1774972048.0, 'created_time': 1773945626.878473, 'last_price_update_time': 1774868113.975825}
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM60062') HTTP/1.1" 204 0
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_982906049847c89da222598a2b3aab1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_982906049847c89da222598a2b3aab1e.jpg not downloaded yet
2026-03-30 10:55:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d1a027f-b206-52f9-94c4-b69633f21573 with identifier: RL71472
2026-03-30 10:55:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d1a027f-b206-52f9-94c4-b69633f21573 with identifier: RL71472
2026-03-30 10:55:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d1a027f-b206-52f9-94c4-b69633f21573 with identifier: RL71472 to the API
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:07:29Z',
 'fuel_type': 'petrol',
 'id': '6d1a027f-b206-52f9-94c4-b69633f21573',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL71472',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 175767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-29',
 'seller_name': None,
 'title': 'BMW 1er 120i',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL71472%27 HTTP/1.1" 200 None
2026-03-30 10:55:14 [auto1.de] INFO: Saving data for RL71472: {'auction_closing_time': 1774969649.0, 'created_time': 1774463596.45392, 'last_price_update_time': 1774868114.395256}
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL71472') HTTP/1.1" 204 0
2026-03-30 10:55:14 [auto1.de] INFO: Found listing with ID: UD08597
2026-03-30 10:55:14 [auto1.de] INFO: Found listing with ID: KU34267
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU34267%27 HTTP/1.1" 200 None
2026-03-30 10:55:14 [auto1.de] INFO: Scrape type for KU34267: 2
2026-03-30 10:55:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a5cde2c-6309-59cf-b08e-6ebb25c1ffb7 with identifier: KU34267
2026-03-30 10:55:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a5cde2c-6309-59cf-b08e-6ebb25c1ffb7 with scrape type 2
2026-03-30 10:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a5cde2c-6309-59cf-b08e-6ebb25c1ffb7 with scrape type 2
2026-03-30 10:55:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a5cde2c-6309-59cf-b08e-6ebb25c1ffb7, identifier: KU34267
2026-03-30 10:55:14 [auto1.de] INFO: Found listing with ID: XG52732
2026-03-30 10:55:14 [auto1.de] INFO: Found listing with ID: ZH99212
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH99212%27 HTTP/1.1" 200 None
2026-03-30 10:55:14 [auto1.de] INFO: Scrape type for ZH99212: 2
2026-03-30 10:55:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fa77f50-95ed-5a18-9d18-97f37b6fa419 with identifier: ZH99212
2026-03-30 10:55:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fa77f50-95ed-5a18-9d18-97f37b6fa419 with scrape type 2
2026-03-30 10:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fa77f50-95ed-5a18-9d18-97f37b6fa419 with scrape type 2
2026-03-30 10:55:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9fa77f50-95ed-5a18-9d18-97f37b6fa419, identifier: ZH99212
2026-03-30 10:55:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a5cde2c-6309-59cf-b08e-6ebb25c1ffb7 with identifier: KU34267
2026-03-30 10:55:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a5cde2c-6309-59cf-b08e-6ebb25c1ffb7 with identifier: KU34267
2026-03-30 10:55:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a5cde2c-6309-59cf-b08e-6ebb25c1ffb7 with identifier: KU34267 to the API
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:52:13Z',
 'fuel_type': 'petrol',
 'id': '5a5cde2c-6309-59cf-b08e-6ebb25c1ffb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU34267',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 146296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-15',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Sound BlueMotion',
 'transmission': 'automatic',
 'trim': 'Sound BlueMotion',
 'year': 2017}
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU34267%27 HTTP/1.1" 200 None
2026-03-30 10:55:15 [auto1.de] INFO: Saving data for KU34267: {'auction_closing_time': 1774972333.0, 'created_time': 1774377054.858429, 'last_price_update_time': 1774868115.452341}
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU34267') HTTP/1.1" 204 0
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_28bd77de12b56f272e91c077c8063000.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_28bd77de12b56f272e91c077c8063000.jpg not downloaded yet
2026-03-30 10:55:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9fa77f50-95ed-5a18-9d18-97f37b6fa419 with identifier: ZH99212
2026-03-30 10:55:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9fa77f50-95ed-5a18-9d18-97f37b6fa419 with identifier: ZH99212
2026-03-30 10:55:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9fa77f50-95ed-5a18-9d18-97f37b6fa419 with identifier: ZH99212 to the API
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:04:58Z',
 'fuel_type': 'petrol',
 'id': '9fa77f50-95ed-5a18-9d18-97f37b6fa419',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH99212',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 177847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-29',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 MyLive',
 'transmission': 'manual',
 'trim': 'MyLive',
 'year': 2011}
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH99212%27 HTTP/1.1" 200 None
2026-03-30 10:55:15 [auto1.de] INFO: Saving data for ZH99212: {'auction_closing_time': 1774969498.0, 'created_time': 1774466345.912533, 'last_price_update_time': 1774868115.941834}
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH99212') HTTP/1.1" 204 0
2026-03-30 10:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef61c90>
2026-03-30 10:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_9a448f805530cc4c78c800475d52fcd6.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_9a448f805530cc4c78c800475d52fcd6.jpg saved to cache
2026-03-30 10:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c
2026-03-30 10:55:16 [auto1.de] INFO: Found listing with ID: CT69735
2026-03-30 10:55:16 [auto1.de] INFO: Found listing with ID: NA97113
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA97113%27 HTTP/1.1" 200 None
2026-03-30 10:55:16 [auto1.de] INFO: Scrape type for NA97113: 2
2026-03-30 10:55:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 118038d6-fad1-5e61-b07b-fe16c5c7e675 with identifier: NA97113
2026-03-30 10:55:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 118038d6-fad1-5e61-b07b-fe16c5c7e675 with scrape type 2
2026-03-30 10:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 118038d6-fad1-5e61-b07b-fe16c5c7e675 with scrape type 2
2026-03-30 10:55:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 118038d6-fad1-5e61-b07b-fe16c5c7e675, identifier: NA97113
2026-03-30 10:55:16 [auto1.de] INFO: Found listing with ID: AF65109
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF65109%27 HTTP/1.1" 200 None
2026-03-30 10:55:16 [auto1.de] INFO: Scrape type for AF65109: 2
2026-03-30 10:55:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdda2df8-f946-5002-b77e-971d62c95614 with identifier: AF65109
2026-03-30 10:55:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdda2df8-f946-5002-b77e-971d62c95614 with scrape type 2
2026-03-30 10:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdda2df8-f946-5002-b77e-971d62c95614 with scrape type 2
2026-03-30 10:55:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdda2df8-f946-5002-b77e-971d62c95614, identifier: AF65109
2026-03-30 10:55:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 118038d6-fad1-5e61-b07b-fe16c5c7e675 with identifier: NA97113
2026-03-30 10:55:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 118038d6-fad1-5e61-b07b-fe16c5c7e675 with identifier: NA97113
2026-03-30 10:55:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 118038d6-fad1-5e61-b07b-fe16c5c7e675 with identifier: NA97113 to the API
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:44:34Z',
 'fuel_type': 'diesel',
 'id': '118038d6-fad1-5e61-b07b-fe16c5c7e675',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA97113',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 243525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-09',
 'seller_name': None,
 'title': 'Honda CR-V 1.6 DTEC Elegance 4WD',
 'transmission': 'automatic',
 'trim': 'Elegance 4WD',
 'year': 2016}
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA97113%27 HTTP/1.1" 200 None
2026-03-30 10:55:16 [auto1.de] INFO: Saving data for NA97113: {'auction_closing_time': 1774971874.0, 'created_time': 1774466674.7575, 'last_price_update_time': 1774868116.966427}
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA97113') HTTP/1.1" 204 0
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_8129acae03aff09f72e498bdef56584c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_8129acae03aff09f72e498bdef56584c.jpg not downloaded yet
2026-03-30 10:55:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdda2df8-f946-5002-b77e-971d62c95614 with identifier: AF65109
2026-03-30 10:55:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdda2df8-f946-5002-b77e-971d62c95614 with identifier: AF65109
2026-03-30 10:55:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdda2df8-f946-5002-b77e-971d62c95614 with identifier: AF65109 to the API
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 575,
 'expiration_date': '2026-03-31T15:09:56Z',
 'fuel_type': 'petrol',
 'id': 'cdda2df8-f946-5002-b77e-971d62c95614',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF65109',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 115438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-18',
 'seller_name': None,
 'title': 'BMW 5er M5',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF65109%27 HTTP/1.1" 200 None
2026-03-30 10:55:17 [auto1.de] INFO: Saving data for AF65109: {'auction_closing_time': 1774969796.0, 'created_time': 1774377098.182397, 'last_price_update_time': 1774868117.352797}
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF65109') HTTP/1.1" 204 0
2026-03-30 10:55:17 [auto1.de] INFO: Found listing with ID: KH68440
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH68440%27 HTTP/1.1" 200 None
2026-03-30 10:55:17 [auto1.de] INFO: Scrape type for KH68440: 2
2026-03-30 10:55:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e32eb1f-73ef-5f29-9585-014ce22eb1c6 with identifier: KH68440
2026-03-30 10:55:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e32eb1f-73ef-5f29-9585-014ce22eb1c6 with scrape type 2
2026-03-30 10:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e32eb1f-73ef-5f29-9585-014ce22eb1c6 with scrape type 2
2026-03-30 10:55:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e32eb1f-73ef-5f29-9585-014ce22eb1c6, identifier: KH68440
2026-03-30 10:55:17 [auto1.de] INFO: Found listing with ID: VC66912
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC66912%27 HTTP/1.1" 200 None
2026-03-30 10:55:17 [auto1.de] INFO: Scrape type for VC66912: 2
2026-03-30 10:55:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e691e855-e0b1-5b0e-9b42-bd7d726e6e16 with identifier: VC66912
2026-03-30 10:55:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e691e855-e0b1-5b0e-9b42-bd7d726e6e16 with scrape type 2
2026-03-30 10:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e691e855-e0b1-5b0e-9b42-bd7d726e6e16 with scrape type 2
2026-03-30 10:55:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e691e855-e0b1-5b0e-9b42-bd7d726e6e16, identifier: VC66912
2026-03-30 10:55:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e32eb1f-73ef-5f29-9585-014ce22eb1c6 with identifier: KH68440
2026-03-30 10:55:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e32eb1f-73ef-5f29-9585-014ce22eb1c6 with identifier: KH68440
2026-03-30 10:55:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e32eb1f-73ef-5f29-9585-014ce22eb1c6 with identifier: KH68440 to the API
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-31T15:27:03Z',
 'fuel_type': 'petrol',
 'id': '2e32eb1f-73ef-5f29-9585-014ce22eb1c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH68440',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 60391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI R 20 Years 4Motion',
 'transmission': 'automatic',
 'trim': 'R 20 Years 4Motion',
 'year': 2024}
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH68440%27 HTTP/1.1" 200 None
2026-03-30 10:55:17 [auto1.de] INFO: Saving data for KH68440: {'auction_closing_time': 1774970823.0, 'created_time': 1774467462.311796, 'last_price_update_time': 1774868117.947135}
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH68440') HTTP/1.1" 204 0
2026-03-30 10:55:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e691e855-e0b1-5b0e-9b42-bd7d726e6e16 with identifier: VC66912
2026-03-30 10:55:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e691e855-e0b1-5b0e-9b42-bd7d726e6e16 with identifier: VC66912
2026-03-30 10:55:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e691e855-e0b1-5b0e-9b42-bd7d726e6e16 with identifier: VC66912 to the API
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:23:32Z',
 'fuel_type': 'diesel',
 'id': 'e691e855-e0b1-5b0e-9b42-bd7d726e6e16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC66912',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 127978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-25',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Special',
 'transmission': 'manual',
 'trim': 'Special',
 'year': 2013}
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC66912%27 HTTP/1.1" 200 None
2026-03-30 10:55:18 [auto1.de] INFO: Saving data for VC66912: {'auction_closing_time': 1774970612.0, 'created_time': 1773131853.681423, 'last_price_update_time': 1774868118.299636}
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC66912') HTTP/1.1" 204 0
2026-03-30 10:55:18 [auto1.de] INFO: Found listing with ID: NM38216
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM38216%27 HTTP/1.1" 200 None
2026-03-30 10:55:18 [auto1.de] INFO: Scrape type for NM38216: 2
2026-03-30 10:55:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aad1289-9445-5cf2-88a0-9f77b2f96e0e with identifier: NM38216
2026-03-30 10:55:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aad1289-9445-5cf2-88a0-9f77b2f96e0e with scrape type 2
2026-03-30 10:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4aad1289-9445-5cf2-88a0-9f77b2f96e0e with scrape type 2
2026-03-30 10:55:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4aad1289-9445-5cf2-88a0-9f77b2f96e0e, identifier: NM38216
2026-03-30 10:55:18 [auto1.de] INFO: Found listing with ID: PF21402
2026-03-30 10:55:18 [auto1.de] INFO: Found listing with ID: FY91209
2026-03-30 10:55:18 [auto1.de] INFO: Found listing with ID: HC53321
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC53321%27 HTTP/1.1" 200 None
2026-03-30 10:55:18 [auto1.de] INFO: Scrape type for HC53321: 2
2026-03-30 10:55:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c677cca-832b-53ca-9df9-1cd61d72557e with identifier: HC53321
2026-03-30 10:55:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c677cca-832b-53ca-9df9-1cd61d72557e with scrape type 2
2026-03-30 10:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c677cca-832b-53ca-9df9-1cd61d72557e with scrape type 2
2026-03-30 10:55:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c677cca-832b-53ca-9df9-1cd61d72557e, identifier: HC53321
2026-03-30 10:55:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4aad1289-9445-5cf2-88a0-9f77b2f96e0e with identifier: NM38216
2026-03-30 10:55:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4aad1289-9445-5cf2-88a0-9f77b2f96e0e with identifier: NM38216
2026-03-30 10:55:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4aad1289-9445-5cf2-88a0-9f77b2f96e0e with identifier: NM38216 to the API
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:35:33Z',
 'fuel_type': 'petrol',
 'id': '4aad1289-9445-5cf2-88a0-9f77b2f96e0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM38216',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 54436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-25',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2016}
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM38216%27 HTTP/1.1" 200 None
2026-03-30 10:55:18 [auto1.de] INFO: Saving data for NM38216: {'auction_closing_time': 1774971333.0, 'created_time': 1774465879.17738, 'last_price_update_time': 1774868118.971687}
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM38216') HTTP/1.1" 204 0
2026-03-30 10:55:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c677cca-832b-53ca-9df9-1cd61d72557e with identifier: HC53321
2026-03-30 10:55:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c677cca-832b-53ca-9df9-1cd61d72557e with identifier: HC53321
2026-03-30 10:55:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c677cca-832b-53ca-9df9-1cd61d72557e with identifier: HC53321 to the API
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:48:33Z',
 'fuel_type': 'diesel',
 'id': '6c677cca-832b-53ca-9df9-1cd61d72557e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC53321',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris Touring Sports',
 'odometer': 337230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-18',
 'seller_name': None,
 'title': 'Toyota Auris Touring Sports 2.0 D-4D Life+',
 'transmission': 'manual',
 'trim': 'Life+',
 'year': 2013}
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC53321%27 HTTP/1.1" 200 None
2026-03-30 10:55:19 [auto1.de] INFO: Saving data for HC53321: {'auction_closing_time': 1774972113.0, 'created_time': 1774377297.221694, 'last_price_update_time': 1774868119.353342}
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC53321') HTTP/1.1" 204 0
2026-03-30 10:55:19 [auto1.de] INFO: Found listing with ID: DS39411
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS39411%27 HTTP/1.1" 200 None
2026-03-30 10:55:19 [auto1.de] INFO: Scrape type for DS39411: 2
2026-03-30 10:55:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64f5d52d-375f-5126-8cf0-579fc38a6ec1 with identifier: DS39411
2026-03-30 10:55:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64f5d52d-375f-5126-8cf0-579fc38a6ec1 with scrape type 2
2026-03-30 10:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64f5d52d-375f-5126-8cf0-579fc38a6ec1 with scrape type 2
2026-03-30 10:55:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64f5d52d-375f-5126-8cf0-579fc38a6ec1, identifier: DS39411
2026-03-30 10:55:19 [auto1.de] INFO: Found listing with ID: PT02757
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT02757%27 HTTP/1.1" 200 None
2026-03-30 10:55:19 [auto1.de] INFO: Scrape type for PT02757: 2
2026-03-30 10:55:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8faf850-8250-5e08-b69f-59f2ee12e8ef with identifier: PT02757
2026-03-30 10:55:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8faf850-8250-5e08-b69f-59f2ee12e8ef with scrape type 2
2026-03-30 10:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8faf850-8250-5e08-b69f-59f2ee12e8ef with scrape type 2
2026-03-30 10:55:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8faf850-8250-5e08-b69f-59f2ee12e8ef, identifier: PT02757
2026-03-30 10:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_28bd77de12b56f272e91c077c8063000.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64f5d52d-375f-5126-8cf0-579fc38a6ec1 with identifier: DS39411
2026-03-30 10:55:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64f5d52d-375f-5126-8cf0-579fc38a6ec1 with identifier: DS39411
2026-03-30 10:55:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64f5d52d-375f-5126-8cf0-579fc38a6ec1 with identifier: DS39411 to the API
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:35:49Z',
 'fuel_type': 'diesel',
 'id': '64f5d52d-375f-5126-8cf0-579fc38a6ec1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS39411',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 183249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-06',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2019}
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS39411%27 HTTP/1.1" 200 None
2026-03-30 10:55:19 [auto1.de] INFO: Saving data for DS39411: {'auction_closing_time': 1774971349.0, 'created_time': 1773345418.494086, 'last_price_update_time': 1774868119.978855}
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS39411') HTTP/1.1" 204 0
2026-03-30 10:55:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8faf850-8250-5e08-b69f-59f2ee12e8ef with identifier: PT02757
2026-03-30 10:55:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8faf850-8250-5e08-b69f-59f2ee12e8ef with identifier: PT02757
2026-03-30 10:55:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8faf850-8250-5e08-b69f-59f2ee12e8ef with identifier: PT02757 to the API
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:51:40Z',
 'fuel_type': 'petrol',
 'id': 'b8faf850-8250-5e08-b69f-59f2ee12e8ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT02757',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 201844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-06',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2006}
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT02757%27 HTTP/1.1" 200 None
2026-03-30 10:55:20 [auto1.de] INFO: Saving data for PT02757: {'auction_closing_time': 1774972300.0, 'created_time': 1773343033.178466, 'last_price_update_time': 1774868120.480278}
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT02757') HTTP/1.1" 204 0
2026-03-30 10:55:20 [auto1.de] INFO: Found listing with ID: KA78171
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA78171%27 HTTP/1.1" 200 None
2026-03-30 10:55:20 [auto1.de] INFO: Scrape type for KA78171: 2
2026-03-30 10:55:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5df4d151-de4b-53e2-997c-b6036b74f43f with identifier: KA78171
2026-03-30 10:55:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5df4d151-de4b-53e2-997c-b6036b74f43f with scrape type 2
2026-03-30 10:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5df4d151-de4b-53e2-997c-b6036b74f43f with scrape type 2
2026-03-30 10:55:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5df4d151-de4b-53e2-997c-b6036b74f43f, identifier: KA78171
2026-03-30 10:55:20 [auto1.de] INFO: Found listing with ID: UY83334
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY83334%27 HTTP/1.1" 200 None
2026-03-30 10:55:20 [auto1.de] INFO: Scrape type for UY83334: 2
2026-03-30 10:55:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3183ad36-a216-52cd-bdbc-79abc5d89edb with identifier: UY83334
2026-03-30 10:55:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3183ad36-a216-52cd-bdbc-79abc5d89edb with scrape type 2
2026-03-30 10:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3183ad36-a216-52cd-bdbc-79abc5d89edb with scrape type 2
2026-03-30 10:55:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3183ad36-a216-52cd-bdbc-79abc5d89edb, identifier: UY83334
2026-03-30 10:55:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5df4d151-de4b-53e2-997c-b6036b74f43f with identifier: KA78171
2026-03-30 10:55:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5df4d151-de4b-53e2-997c-b6036b74f43f with identifier: KA78171
2026-03-30 10:55:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5df4d151-de4b-53e2-997c-b6036b74f43f with identifier: KA78171 to the API
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:34:52Z',
 'fuel_type': 'diesel',
 'id': '5df4d151-de4b-53e2-997c-b6036b74f43f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA78171',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 147424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-06',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business Edition BlueMotion',
 'transmission': 'manual',
 'trim': 'Business Edition BlueMotion',
 'year': 2014}
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA78171%27 HTTP/1.1" 200 None
2026-03-30 10:55:21 [auto1.de] INFO: Saving data for KA78171: {'auction_closing_time': 1774971292.0, 'created_time': 1773662173.252506, 'last_price_update_time': 1774868121.091796}
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA78171') HTTP/1.1" 204 0
2026-03-30 10:55:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3183ad36-a216-52cd-bdbc-79abc5d89edb with identifier: UY83334
2026-03-30 10:55:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3183ad36-a216-52cd-bdbc-79abc5d89edb with identifier: UY83334
2026-03-30 10:55:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3183ad36-a216-52cd-bdbc-79abc5d89edb with identifier: UY83334 to the API
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 511,
 'expiration_date': '2026-03-31T15:19:01Z',
 'fuel_type': 'petrol',
 'id': '3183ad36-a216-52cd-bdbc-79abc5d89edb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY83334',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 74633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-06',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 580 Mild-Hybrid 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY83334%27 HTTP/1.1" 200 None
2026-03-30 10:55:21 [auto1.de] INFO: Saving data for UY83334: {'auction_closing_time': 1774970341.0, 'created_time': 1774466073.533093, 'last_price_update_time': 1774868121.474192}
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY83334') HTTP/1.1" 204 0
2026-03-30 10:55:21 [auto1.de] INFO: Found listing with ID: DL52557
2026-03-30 10:55:21 [auto1.de] INFO: Found listing with ID: KK91301
2026-03-30 10:55:21 [auto1.de] INFO: Found listing with ID: XP97772
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP97772%27 HTTP/1.1" 200 None
2026-03-30 10:55:21 [auto1.de] INFO: Scrape type for XP97772: 2
2026-03-30 10:55:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98f76118-ecc8-526c-88a9-ef1128837b90 with identifier: XP97772
2026-03-30 10:55:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98f76118-ecc8-526c-88a9-ef1128837b90 with scrape type 2
2026-03-30 10:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98f76118-ecc8-526c-88a9-ef1128837b90 with scrape type 2
2026-03-30 10:55:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98f76118-ecc8-526c-88a9-ef1128837b90, identifier: XP97772
2026-03-30 10:55:21 [auto1.de] INFO: Found listing with ID: KD43899
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD43899%27 HTTP/1.1" 200 None
2026-03-30 10:55:21 [auto1.de] INFO: Scrape type for KD43899: 2
2026-03-30 10:55:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13d44d8d-d4d8-56aa-b55d-a60c99126645 with identifier: KD43899
2026-03-30 10:55:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13d44d8d-d4d8-56aa-b55d-a60c99126645 with scrape type 2
2026-03-30 10:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13d44d8d-d4d8-56aa-b55d-a60c99126645 with scrape type 2
2026-03-30 10:55:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13d44d8d-d4d8-56aa-b55d-a60c99126645, identifier: KD43899
2026-03-30 10:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_8129acae03aff09f72e498bdef56584c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98f76118-ecc8-526c-88a9-ef1128837b90 with identifier: XP97772
2026-03-30 10:55:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98f76118-ecc8-526c-88a9-ef1128837b90 with identifier: XP97772
2026-03-30 10:55:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98f76118-ecc8-526c-88a9-ef1128837b90 with identifier: XP97772 to the API
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:30:47Z',
 'fuel_type': 'diesel',
 'id': '98f76118-ecc8-526c-88a9-ef1128837b90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP97772',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 160188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-21',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 CRDi Spirit 2WD',
 'transmission': 'manual',
 'trim': 'Spirit 2WD',
 'year': 2013}
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP97772%27 HTTP/1.1" 200 None
2026-03-30 10:55:22 [auto1.de] INFO: Saving data for XP97772: {'auction_closing_time': 1774971047.0, 'created_time': 1773775958.134578, 'last_price_update_time': 1774868122.047653}
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP97772') HTTP/1.1" 204 0
2026-03-30 10:55:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13d44d8d-d4d8-56aa-b55d-a60c99126645 with identifier: KD43899
2026-03-30 10:55:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13d44d8d-d4d8-56aa-b55d-a60c99126645 with identifier: KD43899
2026-03-30 10:55:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13d44d8d-d4d8-56aa-b55d-a60c99126645 with identifier: KD43899 to the API
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:35:43Z',
 'fuel_type': 'diesel',
 'id': '13d44d8d-d4d8-56aa-b55d-a60c99126645',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD43899',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 175675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-02',
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Platinum Edition 4WD',
 'year': 2015}
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD43899%27 HTTP/1.1" 200 None
2026-03-30 10:55:22 [auto1.de] INFO: Saving data for KD43899: {'auction_closing_time': 1774971343.0, 'created_time': 1773302641.886832, 'last_price_update_time': 1774868122.501303}
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD43899') HTTP/1.1" 204 0
2026-03-30 10:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef1b0d0>
2026-03-30 10:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_28bd77de12b56f272e91c077c8063000.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_28bd77de12b56f272e91c077c8063000.jpg saved to cache
2026-03-30 10:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c
2026-03-30 10:55:22 [auto1.de] INFO: Found listing with ID: AS97650
2026-03-30 10:55:22 [auto1.de] INFO: Found listing with ID: GJ82091
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ82091%27 HTTP/1.1" 200 None
2026-03-30 10:55:22 [auto1.de] INFO: Scrape type for GJ82091: 2
2026-03-30 10:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c53b6c9c-95aa-5388-911b-b07c3c92d4e4 with identifier: GJ82091
2026-03-30 10:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c53b6c9c-95aa-5388-911b-b07c3c92d4e4 with scrape type 2
2026-03-30 10:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c53b6c9c-95aa-5388-911b-b07c3c92d4e4 with scrape type 2
2026-03-30 10:55:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c53b6c9c-95aa-5388-911b-b07c3c92d4e4, identifier: GJ82091
2026-03-30 10:55:22 [auto1.de] INFO: Found listing with ID: CU14282
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU14282%27 HTTP/1.1" 200 None
2026-03-30 10:55:22 [auto1.de] INFO: Scrape type for CU14282: 2
2026-03-30 10:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eebfe3a5-6922-57ac-bc69-dde44088d26a with identifier: CU14282
2026-03-30 10:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eebfe3a5-6922-57ac-bc69-dde44088d26a with scrape type 2
2026-03-30 10:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eebfe3a5-6922-57ac-bc69-dde44088d26a with scrape type 2
2026-03-30 10:55:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eebfe3a5-6922-57ac-bc69-dde44088d26a, identifier: CU14282
2026-03-30 10:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c53b6c9c-95aa-5388-911b-b07c3c92d4e4 with identifier: GJ82091
2026-03-30 10:55:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c53b6c9c-95aa-5388-911b-b07c3c92d4e4 with identifier: GJ82091
2026-03-30 10:55:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c53b6c9c-95aa-5388-911b-b07c3c92d4e4 with identifier: GJ82091 to the API
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:44:17Z',
 'fuel_type': 'diesel',
 'id': 'c53b6c9c-95aa-5388-911b-b07c3c92d4e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ82091',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 219357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-03',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ82091%27 HTTP/1.1" 200 None
2026-03-30 10:55:23 [auto1.de] INFO: Saving data for GJ82091: {'auction_closing_time': 1774971857.0, 'created_time': 1773303042.395166, 'last_price_update_time': 1774868123.153508}
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ82091') HTTP/1.1" 204 0
2026-03-30 10:55:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eebfe3a5-6922-57ac-bc69-dde44088d26a with identifier: CU14282
2026-03-30 10:55:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eebfe3a5-6922-57ac-bc69-dde44088d26a with identifier: CU14282
2026-03-30 10:55:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eebfe3a5-6922-57ac-bc69-dde44088d26a with identifier: CU14282 to the API
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:12:37Z',
 'fuel_type': 'diesel',
 'id': 'eebfe3a5-6922-57ac-bc69-dde44088d26a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU14282',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 121242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-30',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU14282%27 HTTP/1.1" 200 None
2026-03-30 10:55:23 [auto1.de] INFO: Saving data for CU14282: {'auction_closing_time': 1774969957.0, 'created_time': 1774377762.059301, 'last_price_update_time': 1774868123.526084}
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU14282') HTTP/1.1" 204 0
2026-03-30 10:55:23 [auto1.de] INFO: Found listing with ID: VV40094
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV40094%27 HTTP/1.1" 200 None
2026-03-30 10:55:23 [auto1.de] INFO: Scrape type for VV40094: 2
2026-03-30 10:55:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cee8bce3-e29d-5fcf-9367-b248c8303e9e with identifier: VV40094
2026-03-30 10:55:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cee8bce3-e29d-5fcf-9367-b248c8303e9e with scrape type 2
2026-03-30 10:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cee8bce3-e29d-5fcf-9367-b248c8303e9e with scrape type 2
2026-03-30 10:55:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cee8bce3-e29d-5fcf-9367-b248c8303e9e, identifier: VV40094
2026-03-30 10:55:23 [auto1.de] INFO: Found listing with ID: HN95943
2026-03-30 10:55:23 [auto1.de] INFO: Found listing with ID: YM22646
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM22646%27 HTTP/1.1" 200 None
2026-03-30 10:55:23 [auto1.de] INFO: Scrape type for YM22646: 1
2026-03-30 10:55:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cee8bce3-e29d-5fcf-9367-b248c8303e9e with identifier: VV40094
2026-03-30 10:55:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cee8bce3-e29d-5fcf-9367-b248c8303e9e with identifier: VV40094
2026-03-30 10:55:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cee8bce3-e29d-5fcf-9367-b248c8303e9e with identifier: VV40094 to the API
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:38:33Z',
 'fuel_type': 'petrol',
 'id': 'cee8bce3-e29d-5fcf-9367-b248c8303e9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV40094',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 41917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-21',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV40094%27 HTTP/1.1" 200 None
2026-03-30 10:55:24 [auto1.de] INFO: Saving data for VV40094: {'auction_closing_time': 1774971513.0, 'created_time': 1773916891.639768, 'last_price_update_time': 1774868124.011813}
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV40094') HTTP/1.1" 204 0
2026-03-30 10:55:24 [auto1.de] INFO: Found listing with ID: WJ35456
2026-03-30 10:55:24 [auto1.de] INFO: Found listing with ID: XF49404
2026-03-30 10:55:24 [auto1.de] INFO: Found listing with ID: KE08458
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE08458%27 HTTP/1.1" 200 None
2026-03-30 10:55:24 [auto1.de] INFO: Scrape type for KE08458: 2
2026-03-30 10:55:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 561105ca-32c7-56b1-a17c-3ad194e8fa8b with identifier: KE08458
2026-03-30 10:55:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 561105ca-32c7-56b1-a17c-3ad194e8fa8b with scrape type 2
2026-03-30 10:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 561105ca-32c7-56b1-a17c-3ad194e8fa8b with scrape type 2
2026-03-30 10:55:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 561105ca-32c7-56b1-a17c-3ad194e8fa8b, identifier: KE08458
2026-03-30 10:55:24 [auto1.de] INFO: Found listing with ID: BU66338
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU66338%27 HTTP/1.1" 200 None
2026-03-30 10:55:24 [auto1.de] INFO: Scrape type for BU66338: 2
2026-03-30 10:55:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc89cc87-e8db-5e53-81d7-9c905c6ebb9b with identifier: BU66338
2026-03-30 10:55:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc89cc87-e8db-5e53-81d7-9c905c6ebb9b with scrape type 2
2026-03-30 10:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc89cc87-e8db-5e53-81d7-9c905c6ebb9b with scrape type 2
2026-03-30 10:55:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc89cc87-e8db-5e53-81d7-9c905c6ebb9b, identifier: BU66338
2026-03-30 10:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee0e050>
2026-03-30 10:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_8129acae03aff09f72e498bdef56584c.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_8129acae03aff09f72e498bdef56584c.jpg saved to cache
2026-03-30 10:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c
2026-03-30 10:55:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:24 [auto1.de] INFO: Channel: 24h | Page: 55 | totalHits: 9528 | hits on page: 40
2026-03-30 10:55:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 561105ca-32c7-56b1-a17c-3ad194e8fa8b with identifier: KE08458
2026-03-30 10:55:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 561105ca-32c7-56b1-a17c-3ad194e8fa8b with identifier: KE08458
2026-03-30 10:55:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 561105ca-32c7-56b1-a17c-3ad194e8fa8b with identifier: KE08458 to the API
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:33:18Z',
 'fuel_type': 'petrol',
 'id': '561105ca-32c7-56b1-a17c-3ad194e8fa8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE08458',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 70041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-26',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Lounge Sport & Style BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Lounge Sport & Style BlueMotion Tech',
 'year': 2015}
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE08458%27 HTTP/1.1" 200 None
2026-03-30 10:55:24 [auto1.de] INFO: Saving data for KE08458: {'auction_closing_time': 1774971198.0, 'created_time': 1773307457.0918, 'last_price_update_time': 1774868124.80694}
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE08458') HTTP/1.1" 204 0
2026-03-30 10:55:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc89cc87-e8db-5e53-81d7-9c905c6ebb9b with identifier: BU66338
2026-03-30 10:55:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc89cc87-e8db-5e53-81d7-9c905c6ebb9b with identifier: BU66338
2026-03-30 10:55:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc89cc87-e8db-5e53-81d7-9c905c6ebb9b with identifier: BU66338 to the API
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:38:44Z',
 'fuel_type': 'diesel',
 'id': 'dc89cc87-e8db-5e53-81d7-9c905c6ebb9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU66338',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 166517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-14',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Startline',
 'transmission': 'manual',
 'trim': 'Startline',
 'year': 2012}
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU66338%27 HTTP/1.1" 200 None
2026-03-30 10:55:25 [auto1.de] INFO: Saving data for BU66338: {'auction_closing_time': 1774971524.0, 'created_time': 1773228843.809383, 'last_price_update_time': 1774868125.670549}
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU66338') HTTP/1.1" 204 0
2026-03-30 10:55:25 [auto1.de] INFO: Found listing with ID: UM54862
2026-03-30 10:55:25 [auto1.de] INFO: Found listing with ID: UX53934
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX53934%27 HTTP/1.1" 200 None
2026-03-30 10:55:25 [auto1.de] INFO: Scrape type for UX53934: 2
2026-03-30 10:55:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54f0ca0f-4d67-54f4-b180-d36d93f527e7 with identifier: UX53934
2026-03-30 10:55:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54f0ca0f-4d67-54f4-b180-d36d93f527e7 with scrape type 2
2026-03-30 10:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54f0ca0f-4d67-54f4-b180-d36d93f527e7 with scrape type 2
2026-03-30 10:55:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54f0ca0f-4d67-54f4-b180-d36d93f527e7, identifier: UX53934
2026-03-30 10:55:25 [auto1.de] INFO: Found listing with ID: AF76763
2026-03-30 10:55:25 [auto1.de] INFO: Found listing with ID: YA34461
2026-03-30 10:55:25 [auto1.de] INFO: Found listing with ID: ES39418
2026-03-30 10:55:25 [auto1.de] INFO: Found listing with ID: VK59895
2026-03-30 10:55:25 [auto1.de] INFO: Found listing with ID: YC86222
2026-03-30 10:55:25 [auto1.de] INFO: Found listing with ID: HP20518
2026-03-30 10:55:25 [auto1.de] INFO: Found listing with ID: TA49456
2026-03-30 10:55:25 [auto1.de] INFO: Found listing with ID: YR12178
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR12178%27 HTTP/1.1" 200 None
2026-03-30 10:55:25 [auto1.de] INFO: Scrape type for YR12178: 2
2026-03-30 10:55:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a7c1a41-88de-56d2-90bd-72183fb7b726 with identifier: YR12178
2026-03-30 10:55:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a7c1a41-88de-56d2-90bd-72183fb7b726 with scrape type 2
2026-03-30 10:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a7c1a41-88de-56d2-90bd-72183fb7b726 with scrape type 2
2026-03-30 10:55:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a7c1a41-88de-56d2-90bd-72183fb7b726, identifier: YR12178
2026-03-30 10:55:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54f0ca0f-4d67-54f4-b180-d36d93f527e7 with identifier: UX53934
2026-03-30 10:55:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54f0ca0f-4d67-54f4-b180-d36d93f527e7 with identifier: UX53934
2026-03-30 10:55:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54f0ca0f-4d67-54f4-b180-d36d93f527e7 with identifier: UX53934 to the API
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:23:37Z',
 'fuel_type': 'diesel',
 'id': '54f0ca0f-4d67-54f4-b180-d36d93f527e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX53934',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 63950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-27',
 'seller_name': None,
 'title': 'Fiat Tipo 1.3 M-Jet Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2017}
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX53934%27 HTTP/1.1" 200 None
2026-03-30 10:55:26 [auto1.de] INFO: Saving data for UX53934: {'auction_closing_time': 1774970617.0, 'created_time': 1774294081.488948, 'last_price_update_time': 1774868126.247269}
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX53934') HTTP/1.1" 204 0
2026-03-30 10:55:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a7c1a41-88de-56d2-90bd-72183fb7b726 with identifier: YR12178
2026-03-30 10:55:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a7c1a41-88de-56d2-90bd-72183fb7b726 with identifier: YR12178
2026-03-30 10:55:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a7c1a41-88de-56d2-90bd-72183fb7b726 with identifier: YR12178 to the API
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:59:46Z',
 'fuel_type': 'petrol',
 'id': '0a7c1a41-88de-56d2-90bd-72183fb7b726',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR12178',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 282088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-06',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR12178%27 HTTP/1.1" 200 None
2026-03-30 10:55:26 [auto1.de] INFO: Saving data for YR12178: {'auction_closing_time': 1774972786.0, 'created_time': 1773984694.649687, 'last_price_update_time': 1774868126.725919}
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR12178') HTTP/1.1" 204 0
2026-03-30 10:55:26 [auto1.de] INFO: Found listing with ID: YU36554
2026-03-30 10:55:26 [auto1.de] INFO: Found listing with ID: RP11152
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP11152%27 HTTP/1.1" 200 None
2026-03-30 10:55:26 [auto1.de] INFO: Scrape type for RP11152: 2
2026-03-30 10:55:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b351ce0-5fa6-504e-9df7-39156c080be9 with identifier: RP11152
2026-03-30 10:55:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b351ce0-5fa6-504e-9df7-39156c080be9 with scrape type 2
2026-03-30 10:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b351ce0-5fa6-504e-9df7-39156c080be9 with scrape type 2
2026-03-30 10:55:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b351ce0-5fa6-504e-9df7-39156c080be9, identifier: RP11152
2026-03-30 10:55:26 [auto1.de] INFO: Found listing with ID: MR49496
2026-03-30 10:55:26 [auto1.de] INFO: Found listing with ID: MN22228
2026-03-30 10:55:26 [auto1.de] INFO: Found listing with ID: CR26660
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26660%27 HTTP/1.1" 200 None
2026-03-30 10:55:26 [auto1.de] INFO: Scrape type for CR26660: 2
2026-03-30 10:55:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a911f53-4293-57e1-af13-34c9a9b4f4ad with identifier: CR26660
2026-03-30 10:55:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a911f53-4293-57e1-af13-34c9a9b4f4ad with scrape type 2
2026-03-30 10:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a911f53-4293-57e1-af13-34c9a9b4f4ad with scrape type 2
2026-03-30 10:55:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a911f53-4293-57e1-af13-34c9a9b4f4ad, identifier: CR26660
2026-03-30 10:55:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b351ce0-5fa6-504e-9df7-39156c080be9 with identifier: RP11152
2026-03-30 10:55:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b351ce0-5fa6-504e-9df7-39156c080be9 with identifier: RP11152
2026-03-30 10:55:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b351ce0-5fa6-504e-9df7-39156c080be9 with identifier: RP11152 to the API
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:41:23Z',
 'fuel_type': 'petrol',
 'id': '1b351ce0-5fa6-504e-9df7-39156c080be9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP11152',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 95745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-15',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 170 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2006}
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP11152%27 HTTP/1.1" 200 None
2026-03-30 10:55:27 [auto1.de] INFO: Saving data for RP11152: {'auction_closing_time': 1774971683.0, 'created_time': 1774348790.259237, 'last_price_update_time': 1774868127.294141}
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP11152') HTTP/1.1" 204 0
2026-03-30 10:55:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a911f53-4293-57e1-af13-34c9a9b4f4ad with identifier: CR26660
2026-03-30 10:55:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a911f53-4293-57e1-af13-34c9a9b4f4ad with identifier: CR26660
2026-03-30 10:55:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a911f53-4293-57e1-af13-34c9a9b4f4ad with identifier: CR26660 to the API
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:36:20Z',
 'fuel_type': 'petrol',
 'id': '3a911f53-4293-57e1-af13-34c9a9b4f4ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR26660',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 120278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-19',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Like',
 'transmission': 'manual',
 'trim': 'Like',
 'year': 2018}
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26660%27 HTTP/1.1" 200 None
2026-03-30 10:55:27 [auto1.de] INFO: Saving data for CR26660: {'auction_closing_time': 1774971380.0, 'created_time': 1774463710.836487, 'last_price_update_time': 1774868127.672459}
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR26660') HTTP/1.1" 204 0
2026-03-30 10:55:27 [auto1.de] INFO: Found listing with ID: YZ97980
2026-03-30 10:55:27 [auto1.de] INFO: Found listing with ID: SA90137
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA90137%27 HTTP/1.1" 200 None
2026-03-30 10:55:27 [auto1.de] INFO: Scrape type for SA90137: 2
2026-03-30 10:55:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c468a05-220f-5413-8d7c-81e550e0e6c5 with identifier: SA90137
2026-03-30 10:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c468a05-220f-5413-8d7c-81e550e0e6c5 with scrape type 2
2026-03-30 10:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c468a05-220f-5413-8d7c-81e550e0e6c5 with scrape type 2
2026-03-30 10:55:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c468a05-220f-5413-8d7c-81e550e0e6c5, identifier: SA90137
2026-03-30 10:55:27 [auto1.de] INFO: Found listing with ID: PH88321
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH88321%27 HTTP/1.1" 200 None
2026-03-30 10:55:27 [auto1.de] INFO: Scrape type for PH88321: 2
2026-03-30 10:55:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd1f6b86-b368-5d48-ad89-5d40cc92e398 with identifier: PH88321
2026-03-30 10:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd1f6b86-b368-5d48-ad89-5d40cc92e398 with scrape type 2
2026-03-30 10:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd1f6b86-b368-5d48-ad89-5d40cc92e398 with scrape type 2
2026-03-30 10:55:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd1f6b86-b368-5d48-ad89-5d40cc92e398, identifier: PH88321
2026-03-30 10:55:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c468a05-220f-5413-8d7c-81e550e0e6c5 with identifier: SA90137
2026-03-30 10:55:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c468a05-220f-5413-8d7c-81e550e0e6c5 with identifier: SA90137
2026-03-30 10:55:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c468a05-220f-5413-8d7c-81e550e0e6c5 with identifier: SA90137 to the API
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:09:00Z',
 'fuel_type': 'petrol',
 'id': '6c468a05-220f-5413-8d7c-81e550e0e6c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA90137',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 44129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-16',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 TGDI GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2020}
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA90137%27 HTTP/1.1" 200 None
2026-03-30 10:55:28 [auto1.de] INFO: Saving data for SA90137: {'auction_closing_time': 1774969740.0, 'created_time': 1774466743.796276, 'last_price_update_time': 1774868128.278122}
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA90137') HTTP/1.1" 204 0
2026-03-30 10:55:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd1f6b86-b368-5d48-ad89-5d40cc92e398 with identifier: PH88321
2026-03-30 10:55:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd1f6b86-b368-5d48-ad89-5d40cc92e398 with identifier: PH88321
2026-03-30 10:55:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd1f6b86-b368-5d48-ad89-5d40cc92e398 with identifier: PH88321 to the API
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:35:54Z',
 'fuel_type': 'diesel',
 'id': 'dd1f6b86-b368-5d48-ad89-5d40cc92e398',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH88321',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 211403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-19',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 1.6 CDTI DPF Business Innovation',
 'transmission': 'automatic',
 'trim': 'Business Innovation',
 'year': 2017}
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH88321%27 HTTP/1.1" 200 None
2026-03-30 10:55:28 [auto1.de] INFO: Saving data for PH88321: {'auction_closing_time': 1774971354.0, 'created_time': 1773946378.709626, 'last_price_update_time': 1774868128.648874}
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH88321') HTTP/1.1" 204 0
2026-03-30 10:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_c4a1737c17dd5f43c534c7733f06c695.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:28 [auto1.de] INFO: Found listing with ID: JW05825
2026-03-30 10:55:28 [auto1.de] INFO: Found listing with ID: AK76136
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK76136%27 HTTP/1.1" 200 None
2026-03-30 10:55:28 [auto1.de] INFO: Scrape type for AK76136: 2
2026-03-30 10:55:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b4fd8cf-d8de-5caf-952c-c9072c99e682 with identifier: AK76136
2026-03-30 10:55:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b4fd8cf-d8de-5caf-952c-c9072c99e682 with scrape type 2
2026-03-30 10:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b4fd8cf-d8de-5caf-952c-c9072c99e682 with scrape type 2
2026-03-30 10:55:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b4fd8cf-d8de-5caf-952c-c9072c99e682, identifier: AK76136
2026-03-30 10:55:28 [auto1.de] INFO: Found listing with ID: MD97257
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD97257%27 HTTP/1.1" 200 None
2026-03-30 10:55:28 [auto1.de] INFO: Scrape type for MD97257: 2
2026-03-30 10:55:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ed2b4aa-3185-5661-8cbb-af5d0ae5465d with identifier: MD97257
2026-03-30 10:55:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ed2b4aa-3185-5661-8cbb-af5d0ae5465d with scrape type 2
2026-03-30 10:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ed2b4aa-3185-5661-8cbb-af5d0ae5465d with scrape type 2
2026-03-30 10:55:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ed2b4aa-3185-5661-8cbb-af5d0ae5465d, identifier: MD97257
2026-03-30 10:55:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b4fd8cf-d8de-5caf-952c-c9072c99e682 with identifier: AK76136
2026-03-30 10:55:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b4fd8cf-d8de-5caf-952c-c9072c99e682 with identifier: AK76136
2026-03-30 10:55:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b4fd8cf-d8de-5caf-952c-c9072c99e682 with identifier: AK76136 to the API
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-31T15:53:57Z',
 'fuel_type': 'diesel',
 'id': '3b4fd8cf-d8de-5caf-952c-c9072c99e682',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK76136',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 155967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-12',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI Atmosphere 4Motion',
 'transmission': 'automatic',
 'trim': 'Atmosphere 4Motion',
 'year': 2019}
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK76136%27 HTTP/1.1" 200 None
2026-03-30 10:55:29 [auto1.de] INFO: Saving data for AK76136: {'auction_closing_time': 1774972437.0, 'created_time': 1773343955.714506, 'last_price_update_time': 1774868129.22939}
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK76136') HTTP/1.1" 204 0
2026-03-30 10:55:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ed2b4aa-3185-5661-8cbb-af5d0ae5465d with identifier: MD97257
2026-03-30 10:55:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ed2b4aa-3185-5661-8cbb-af5d0ae5465d with identifier: MD97257
2026-03-30 10:55:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ed2b4aa-3185-5661-8cbb-af5d0ae5465d with identifier: MD97257 to the API
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:31:07Z',
 'fuel_type': 'diesel',
 'id': '5ed2b4aa-3185-5661-8cbb-af5d0ae5465d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD97257',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 205195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-15',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2016}
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD97257%27 HTTP/1.1" 200 None
2026-03-30 10:55:29 [auto1.de] INFO: Saving data for MD97257: {'auction_closing_time': 1774971067.0, 'created_time': 1773305392.249778, 'last_price_update_time': 1774868129.677239}
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD97257') HTTP/1.1" 204 0
2026-03-30 10:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_7af5aea626521fdb939e1e884ccd5e8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:29 [auto1.de] INFO: Found listing with ID: RN76659
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN76659%27 HTTP/1.1" 200 None
2026-03-30 10:55:29 [auto1.de] INFO: Scrape type for RN76659: 2
2026-03-30 10:55:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62b8e836-8737-5e15-abc2-978d2726961b with identifier: RN76659
2026-03-30 10:55:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62b8e836-8737-5e15-abc2-978d2726961b with scrape type 2
2026-03-30 10:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62b8e836-8737-5e15-abc2-978d2726961b with scrape type 2
2026-03-30 10:55:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62b8e836-8737-5e15-abc2-978d2726961b, identifier: RN76659
2026-03-30 10:55:29 [auto1.de] INFO: Found listing with ID: FV82403
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV82403%27 HTTP/1.1" 200 None
2026-03-30 10:55:29 [auto1.de] INFO: Scrape type for FV82403: 2
2026-03-30 10:55:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f45d931-bca1-5294-9a47-498caa43ca63 with identifier: FV82403
2026-03-30 10:55:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f45d931-bca1-5294-9a47-498caa43ca63 with scrape type 2
2026-03-30 10:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f45d931-bca1-5294-9a47-498caa43ca63 with scrape type 2
2026-03-30 10:55:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f45d931-bca1-5294-9a47-498caa43ca63, identifier: FV82403
2026-03-30 10:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_6941ac1ba34c7e45917aaf1e7d9ff554.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62b8e836-8737-5e15-abc2-978d2726961b with identifier: RN76659
2026-03-30 10:55:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62b8e836-8737-5e15-abc2-978d2726961b with identifier: RN76659
2026-03-30 10:55:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62b8e836-8737-5e15-abc2-978d2726961b with identifier: RN76659 to the API
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:09:06Z',
 'fuel_type': 'petrol',
 'id': '62b8e836-8737-5e15-abc2-978d2726961b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN76659',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 118178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-28',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2015}
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN76659%27 HTTP/1.1" 200 None
2026-03-30 10:55:30 [auto1.de] INFO: Saving data for RN76659: {'auction_closing_time': 1774969746.0, 'created_time': 1773687618.058402, 'last_price_update_time': 1774868130.290205}
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN76659') HTTP/1.1" 204 0
2026-03-30 10:55:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f45d931-bca1-5294-9a47-498caa43ca63 with identifier: FV82403
2026-03-30 10:55:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f45d931-bca1-5294-9a47-498caa43ca63 with identifier: FV82403
2026-03-30 10:55:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f45d931-bca1-5294-9a47-498caa43ca63 with identifier: FV82403 to the API
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:33:09Z',
 'fuel_type': 'petrol',
 'id': '6f45d931-bca1-5294-9a47-498caa43ca63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV82403',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 47409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-29',
 'seller_name': None,
 'title': 'Honda Civic 1.0 VTEC Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2018}
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV82403%27 HTTP/1.1" 200 None
2026-03-30 10:55:30 [auto1.de] INFO: Saving data for FV82403: {'auction_closing_time': 1774971189.0, 'created_time': 1773224035.810118, 'last_price_update_time': 1774868130.675368}
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV82403') HTTP/1.1" 204 0
2026-03-30 10:55:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4347310>
2026-03-30 10:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_c4a1737c17dd5f43c534c7733f06c695.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_c4a1737c17dd5f43c534c7733f06c695.jpg saved to cache
2026-03-30 10:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c
2026-03-30 10:55:30 [auto1.de] INFO: Found listing with ID: MK13186
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK13186%27 HTTP/1.1" 200 None
2026-03-30 10:55:30 [auto1.de] INFO: Scrape type for MK13186: 2
2026-03-30 10:55:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15dc95ec-d944-5d5f-87af-33d4a4668770 with identifier: MK13186
2026-03-30 10:55:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15dc95ec-d944-5d5f-87af-33d4a4668770 with scrape type 2
2026-03-30 10:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15dc95ec-d944-5d5f-87af-33d4a4668770 with scrape type 2
2026-03-30 10:55:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15dc95ec-d944-5d5f-87af-33d4a4668770, identifier: MK13186
2026-03-30 10:55:30 [auto1.de] INFO: Found listing with ID: SR89713
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR89713%27 HTTP/1.1" 200 None
2026-03-30 10:55:31 [auto1.de] INFO: Scrape type for SR89713: 2
2026-03-30 10:55:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58fe3926-6c4d-5974-8efc-a11e2df3b155 with identifier: SR89713
2026-03-30 10:55:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58fe3926-6c4d-5974-8efc-a11e2df3b155 with scrape type 2
2026-03-30 10:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58fe3926-6c4d-5974-8efc-a11e2df3b155 with scrape type 2
2026-03-30 10:55:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58fe3926-6c4d-5974-8efc-a11e2df3b155, identifier: SR89713
2026-03-30 10:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_f9e00f1246b8dd9578d205e9ddcbebf7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15dc95ec-d944-5d5f-87af-33d4a4668770 with identifier: MK13186
2026-03-30 10:55:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15dc95ec-d944-5d5f-87af-33d4a4668770 with identifier: MK13186
2026-03-30 10:55:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15dc95ec-d944-5d5f-87af-33d4a4668770 with identifier: MK13186 to the API
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:06:38Z',
 'fuel_type': 'diesel',
 'id': '15dc95ec-d944-5d5f-87af-33d4a4668770',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK13186',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 185384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seller_name': None,
 'title': 'Audi A6 40 TDI Mild-Hybrid Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2020}
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK13186%27 HTTP/1.1" 200 None
2026-03-30 10:55:31 [auto1.de] INFO: Saving data for MK13186: {'auction_closing_time': 1774969598.0, 'created_time': 1773307516.373091, 'last_price_update_time': 1774868131.835962}
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK13186') HTTP/1.1" 204 0
2026-03-30 10:55:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58fe3926-6c4d-5974-8efc-a11e2df3b155 with identifier: SR89713
2026-03-30 10:55:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58fe3926-6c4d-5974-8efc-a11e2df3b155 with identifier: SR89713
2026-03-30 10:55:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58fe3926-6c4d-5974-8efc-a11e2df3b155 with identifier: SR89713 to the API
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:10:09Z',
 'fuel_type': 'petrol',
 'id': '58fe3926-6c4d-5974-8efc-a11e2df3b155',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR89713',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 28520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-30',
 'seller_name': None,
 'title': 'Dacia Duster 1.3 TCe Journey+',
 'transmission': 'manual',
 'trim': 'Journey+',
 'year': 2023}
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR89713%27 HTTP/1.1" 200 None
2026-03-30 10:55:32 [auto1.de] INFO: Saving data for SR89713: {'auction_closing_time': 1774969809.0, 'created_time': 1774466504.282013, 'last_price_update_time': 1774868132.187085}
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR89713') HTTP/1.1" 204 0
2026-03-30 10:55:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee48f8d0>
2026-03-30 10:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_7af5aea626521fdb939e1e884ccd5e8b.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_7af5aea626521fdb939e1e884ccd5e8b.jpg saved to cache
2026-03-30 10:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c
2026-03-30 10:55:32 [auto1.de] INFO: Found listing with ID: YZ92306
2026-03-30 10:55:32 [auto1.de] INFO: Found listing with ID: FJ41734
2026-03-30 10:55:32 [auto1.de] INFO: Found listing with ID: XS76137
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS76137%27 HTTP/1.1" 200 None
2026-03-30 10:55:32 [auto1.de] INFO: Scrape type for XS76137: 2
2026-03-30 10:55:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f62fa4b1-ddec-53e2-8190-767a02d55d66 with identifier: XS76137
2026-03-30 10:55:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f62fa4b1-ddec-53e2-8190-767a02d55d66 with scrape type 2
2026-03-30 10:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f62fa4b1-ddec-53e2-8190-767a02d55d66 with scrape type 2
2026-03-30 10:55:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f62fa4b1-ddec-53e2-8190-767a02d55d66, identifier: XS76137
2026-03-30 10:55:32 [auto1.de] INFO: Found listing with ID: EK84177
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK84177%27 HTTP/1.1" 200 None
2026-03-30 10:55:32 [auto1.de] INFO: Scrape type for EK84177: 2
2026-03-30 10:55:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0146f2c-c6f9-5fd5-b899-dbd063957b74 with identifier: EK84177
2026-03-30 10:55:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0146f2c-c6f9-5fd5-b899-dbd063957b74 with scrape type 2
2026-03-30 10:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0146f2c-c6f9-5fd5-b899-dbd063957b74 with scrape type 2
2026-03-30 10:55:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0146f2c-c6f9-5fd5-b899-dbd063957b74, identifier: EK84177
2026-03-30 10:55:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f62fa4b1-ddec-53e2-8190-767a02d55d66 with identifier: XS76137
2026-03-30 10:55:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f62fa4b1-ddec-53e2-8190-767a02d55d66 with identifier: XS76137
2026-03-30 10:55:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f62fa4b1-ddec-53e2-8190-767a02d55d66 with identifier: XS76137 to the API
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:22:24Z',
 'fuel_type': 'diesel',
 'id': 'f62fa4b1-ddec-53e2-8190-767a02d55d66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS76137',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 315190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-02',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2013}
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS76137%27 HTTP/1.1" 200 None
2026-03-30 10:55:32 [auto1.de] INFO: Saving data for XS76137: {'auction_closing_time': 1774970544.0, 'created_time': 1773304978.717352, 'last_price_update_time': 1774868132.968494}
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS76137') HTTP/1.1" 204 0
2026-03-30 10:55:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0146f2c-c6f9-5fd5-b899-dbd063957b74 with identifier: EK84177
2026-03-30 10:55:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0146f2c-c6f9-5fd5-b899-dbd063957b74 with identifier: EK84177
2026-03-30 10:55:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0146f2c-c6f9-5fd5-b899-dbd063957b74 with identifier: EK84177 to the API
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 199,
 'expiration_date': '2026-03-31T15:54:55Z',
 'fuel_type': 'diesel',
 'id': 'a0146f2c-c6f9-5fd5-b899-dbd063957b74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK84177',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 93668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-17',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2019}
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK84177%27 HTTP/1.1" 200 None
2026-03-30 10:55:33 [auto1.de] INFO: Saving data for EK84177: {'auction_closing_time': 1774972495.0, 'created_time': 1774379605.501176, 'last_price_update_time': 1774868133.323845}
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK84177') HTTP/1.1" 204 0
2026-03-30 10:55:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef1a750>
2026-03-30 10:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_6941ac1ba34c7e45917aaf1e7d9ff554.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_6941ac1ba34c7e45917aaf1e7d9ff554.jpg saved to cache
2026-03-30 10:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c
2026-03-30 10:55:33 [auto1.de] INFO: Found listing with ID: DY62455
2026-03-30 10:55:33 [auto1.de] INFO: Found listing with ID: MM64069
2026-03-30 10:55:33 [auto1.de] INFO: Found listing with ID: TE08407
2026-03-30 10:55:33 [auto1.de] INFO: Found listing with ID: GL59238
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL59238%27 HTTP/1.1" 200 None
2026-03-30 10:55:33 [auto1.de] INFO: Scrape type for GL59238: 2
2026-03-30 10:55:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73a0be74-ac5e-5dac-915d-2a31f195cd8c with identifier: GL59238
2026-03-30 10:55:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73a0be74-ac5e-5dac-915d-2a31f195cd8c with scrape type 2
2026-03-30 10:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73a0be74-ac5e-5dac-915d-2a31f195cd8c with scrape type 2
2026-03-30 10:55:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73a0be74-ac5e-5dac-915d-2a31f195cd8c, identifier: GL59238
2026-03-30 10:55:33 [auto1.de] INFO: Found listing with ID: FB79973
2026-03-30 10:55:33 [auto1.de] INFO: Found listing with ID: YB11592
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB11592%27 HTTP/1.1" 200 None
2026-03-30 10:55:33 [auto1.de] INFO: Scrape type for YB11592: 2
2026-03-30 10:55:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c45888a-029c-5503-be5d-4f3d5b6b23eb with identifier: YB11592
2026-03-30 10:55:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c45888a-029c-5503-be5d-4f3d5b6b23eb with scrape type 2
2026-03-30 10:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c45888a-029c-5503-be5d-4f3d5b6b23eb with scrape type 2
2026-03-30 10:55:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c45888a-029c-5503-be5d-4f3d5b6b23eb, identifier: YB11592
2026-03-30 10:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_5b3694020bb467ad2674be2791b5c1a5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73a0be74-ac5e-5dac-915d-2a31f195cd8c with identifier: GL59238
2026-03-30 10:55:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73a0be74-ac5e-5dac-915d-2a31f195cd8c with identifier: GL59238
2026-03-30 10:55:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73a0be74-ac5e-5dac-915d-2a31f195cd8c with identifier: GL59238 to the API
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:24:41Z',
 'fuel_type': 'diesel',
 'id': '73a0be74-ac5e-5dac-915d-2a31f195cd8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL59238',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 183905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-02',
 'seller_name': None,
 'title': 'BMW 1er 118d M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2015}
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL59238%27 HTTP/1.1" 200 None
2026-03-30 10:55:34 [auto1.de] INFO: Saving data for GL59238: {'auction_closing_time': 1774970681.0, 'created_time': 1774350150.843204, 'last_price_update_time': 1774868134.064989}
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL59238') HTTP/1.1" 204 0
2026-03-30 10:55:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c45888a-029c-5503-be5d-4f3d5b6b23eb with identifier: YB11592
2026-03-30 10:55:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c45888a-029c-5503-be5d-4f3d5b6b23eb with identifier: YB11592
2026-03-30 10:55:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c45888a-029c-5503-be5d-4f3d5b6b23eb with identifier: YB11592 to the API
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-31T15:51:59Z',
 'fuel_type': 'diesel',
 'id': '0c45888a-029c-5503-be5d-4f3d5b6b23eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB11592',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 238891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-25',
 'seller_name': None,
 'title': 'BMW X5 xDrive 40d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB11592%27 HTTP/1.1" 200 None
2026-03-30 10:55:34 [auto1.de] INFO: Saving data for YB11592: {'auction_closing_time': 1774972319.0, 'created_time': 1774377838.483666, 'last_price_update_time': 1774868134.510524}
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB11592') HTTP/1.1" 204 0
2026-03-30 10:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_ad1a9674846f7138e5b5a2e3d2613375.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:34 [auto1.de] INFO: Found listing with ID: CC88338
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC88338%27 HTTP/1.1" 200 None
2026-03-30 10:55:34 [auto1.de] INFO: Scrape type for CC88338: 2
2026-03-30 10:55:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b87110df-378c-537c-a543-7a421bc9813c with identifier: CC88338
2026-03-30 10:55:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b87110df-378c-537c-a543-7a421bc9813c with scrape type 2
2026-03-30 10:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b87110df-378c-537c-a543-7a421bc9813c with scrape type 2
2026-03-30 10:55:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b87110df-378c-537c-a543-7a421bc9813c, identifier: CC88338
2026-03-30 10:55:34 [auto1.de] INFO: Found listing with ID: FJ58055
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ58055%27 HTTP/1.1" 200 None
2026-03-30 10:55:34 [auto1.de] INFO: Scrape type for FJ58055: 2
2026-03-30 10:55:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84f8b5cb-ad78-5ddd-b7f7-9de1862f0055 with identifier: FJ58055
2026-03-30 10:55:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84f8b5cb-ad78-5ddd-b7f7-9de1862f0055 with scrape type 2
2026-03-30 10:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84f8b5cb-ad78-5ddd-b7f7-9de1862f0055 with scrape type 2
2026-03-30 10:55:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84f8b5cb-ad78-5ddd-b7f7-9de1862f0055, identifier: FJ58055
2026-03-30 10:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefdf410>
2026-03-30 10:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_f9e00f1246b8dd9578d205e9ddcbebf7.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_f9e00f1246b8dd9578d205e9ddcbebf7.jpg saved to cache
2026-03-30 10:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c
2026-03-30 10:55:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b87110df-378c-537c-a543-7a421bc9813c with identifier: CC88338
2026-03-30 10:55:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b87110df-378c-537c-a543-7a421bc9813c with identifier: CC88338
2026-03-30 10:55:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b87110df-378c-537c-a543-7a421bc9813c with identifier: CC88338 to the API
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:14:18Z',
 'fuel_type': 'diesel',
 'id': 'b87110df-378c-537c-a543-7a421bc9813c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC88338',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 153181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-29',
 'seller_name': None,
 'title': 'Hyundai ix20 1.6 CRDi Classic Blue',
 'transmission': 'manual',
 'trim': 'Classic Blue',
 'year': 2015}
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC88338%27 HTTP/1.1" 200 None
2026-03-30 10:55:35 [auto1.de] INFO: Saving data for CC88338: {'auction_closing_time': 1774970058.0, 'created_time': 1773345024.585002, 'last_price_update_time': 1774868135.584423}
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC88338') HTTP/1.1" 204 0
2026-03-30 10:55:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84f8b5cb-ad78-5ddd-b7f7-9de1862f0055 with identifier: FJ58055
2026-03-30 10:55:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84f8b5cb-ad78-5ddd-b7f7-9de1862f0055 with identifier: FJ58055
2026-03-30 10:55:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84f8b5cb-ad78-5ddd-b7f7-9de1862f0055 with identifier: FJ58055 to the API
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:06:13Z',
 'fuel_type': 'petrol',
 'id': '84f8b5cb-ad78-5ddd-b7f7-9de1862f0055',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ58055',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 2042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-08-31',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Essence',
 'transmission': 'manual',
 'trim': 'Essence',
 'year': 2025}
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ58055%27 HTTP/1.1" 200 None
2026-03-30 10:55:35 [auto1.de] INFO: Saving data for FJ58055: {'auction_closing_time': 1774969573.0, 'created_time': 1773308058.215707, 'last_price_update_time': 1774868135.975201}
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ58055') HTTP/1.1" 204 0
2026-03-30 10:55:35 [auto1.de] INFO: Found listing with ID: MG02873
2026-03-30 10:55:35 [auto1.de] INFO: Found listing with ID: LC10044
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC10044%27 HTTP/1.1" 200 None
2026-03-30 10:55:36 [auto1.de] INFO: Scrape type for LC10044: 2
2026-03-30 10:55:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fdb7e92-2728-5608-aa71-e481247a9b51 with identifier: LC10044
2026-03-30 10:55:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fdb7e92-2728-5608-aa71-e481247a9b51 with scrape type 2
2026-03-30 10:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fdb7e92-2728-5608-aa71-e481247a9b51 with scrape type 2
2026-03-30 10:55:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fdb7e92-2728-5608-aa71-e481247a9b51, identifier: LC10044
2026-03-30 10:55:36 [auto1.de] INFO: Found listing with ID: FC64824
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC64824%27 HTTP/1.1" 200 None
2026-03-30 10:55:36 [auto1.de] INFO: Scrape type for FC64824: 1
2026-03-30 10:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_982906049847c89da222598a2b3aab1e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fdb7e92-2728-5608-aa71-e481247a9b51 with identifier: LC10044
2026-03-30 10:55:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fdb7e92-2728-5608-aa71-e481247a9b51 with identifier: LC10044
2026-03-30 10:55:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fdb7e92-2728-5608-aa71-e481247a9b51 with identifier: LC10044 to the API
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:26:56Z',
 'fuel_type': 'petrol',
 'id': '6fdb7e92-2728-5608-aa71-e481247a9b51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC10044',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 134457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-05',
 'seller_name': None,
 'title': 'Opel Corsa 1.0 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2006}
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC10044%27 HTTP/1.1" 200 None
2026-03-30 10:55:36 [auto1.de] INFO: Saving data for LC10044: {'auction_closing_time': 1774970816.0, 'created_time': 1774380083.294014, 'last_price_update_time': 1774868136.432163}
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC10044') HTTP/1.1" 204 0
2026-03-30 10:55:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5bfea10>
2026-03-30 10:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_5b3694020bb467ad2674be2791b5c1a5.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_5b3694020bb467ad2674be2791b5c1a5.jpg saved to cache
2026-03-30 10:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c
2026-03-30 10:55:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee7f890>
2026-03-30 10:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_ad1a9674846f7138e5b5a2e3d2613375.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_ad1a9674846f7138e5b5a2e3d2613375.jpg saved to cache
2026-03-30 10:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c
2026-03-30 10:55:36 [auto1.de] INFO: Channel: 24h | Page: 56 | totalHits: 9528 | hits on page: 40
2026-03-30 10:55:36 [auto1.de] INFO: Found listing with ID: BY54192
2026-03-30 10:55:36 [auto1.de] INFO: Found listing with ID: PF70269
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF70269%27 HTTP/1.1" 200 None
2026-03-30 10:55:36 [auto1.de] INFO: Scrape type for PF70269: 2
2026-03-30 10:55:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd8dfd82-70f9-5024-8f10-488b4bf8b2f9 with identifier: PF70269
2026-03-30 10:55:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd8dfd82-70f9-5024-8f10-488b4bf8b2f9 with scrape type 2
2026-03-30 10:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd8dfd82-70f9-5024-8f10-488b4bf8b2f9 with scrape type 2
2026-03-30 10:55:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd8dfd82-70f9-5024-8f10-488b4bf8b2f9, identifier: PF70269
2026-03-30 10:55:36 [auto1.de] INFO: Found listing with ID: BN35753
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN35753%27 HTTP/1.1" 200 None
2026-03-30 10:55:36 [auto1.de] INFO: Scrape type for BN35753: 2
2026-03-30 10:55:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 383a04fd-0599-50c0-a18e-27d7d3e2e704 with identifier: BN35753
2026-03-30 10:55:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 383a04fd-0599-50c0-a18e-27d7d3e2e704 with scrape type 2
2026-03-30 10:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 383a04fd-0599-50c0-a18e-27d7d3e2e704 with scrape type 2
2026-03-30 10:55:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 383a04fd-0599-50c0-a18e-27d7d3e2e704, identifier: BN35753
2026-03-30 10:55:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd8dfd82-70f9-5024-8f10-488b4bf8b2f9 with identifier: PF70269
2026-03-30 10:55:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd8dfd82-70f9-5024-8f10-488b4bf8b2f9 with identifier: PF70269
2026-03-30 10:55:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd8dfd82-70f9-5024-8f10-488b4bf8b2f9 with identifier: PF70269 to the API
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 113,
 'expiration_date': '2026-03-31T15:01:38Z',
 'fuel_type': 'petrol',
 'id': 'fd8dfd82-70f9-5024-8f10-488b4bf8b2f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF70269',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Lancer',
 'odometer': 113538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1993-06-30',
 'seller_name': None,
 'title': 'Mitsubishi Lancer 1.6 GLXI',
 'transmission': 'manual',
 'trim': 'GLXI',
 'year': 1993}
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF70269%27 HTTP/1.1" 200 None
2026-03-30 10:55:37 [auto1.de] INFO: Saving data for PF70269: {'auction_closing_time': 1774969298.0, 'created_time': 1774379428.100482, 'last_price_update_time': 1774868137.236487}
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF70269') HTTP/1.1" 204 0
2026-03-30 10:55:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 383a04fd-0599-50c0-a18e-27d7d3e2e704 with identifier: BN35753
2026-03-30 10:55:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 383a04fd-0599-50c0-a18e-27d7d3e2e704 with identifier: BN35753
2026-03-30 10:55:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 383a04fd-0599-50c0-a18e-27d7d3e2e704 with identifier: BN35753 to the API
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:30:12Z',
 'fuel_type': 'petrol',
 'id': '383a04fd-0599-50c0-a18e-27d7d3e2e704',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN35753',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 80309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'BlueMotion Tech',
 'year': 2016}
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN35753%27 HTTP/1.1" 200 None
2026-03-30 10:55:37 [auto1.de] INFO: Saving data for BN35753: {'auction_closing_time': 1774971012.0, 'created_time': 1773686694.901724, 'last_price_update_time': 1774868137.71153}
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN35753') HTTP/1.1" 204 0
2026-03-30 10:55:37 [auto1.de] INFO: Found listing with ID: TA32643
2026-03-30 10:55:37 [auto1.de] INFO: Found listing with ID: VB44523
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB44523%27 HTTP/1.1" 200 None
2026-03-30 10:55:37 [auto1.de] INFO: Scrape type for VB44523: 2
2026-03-30 10:55:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fae686b-3402-510b-8f42-89dab50cb7ab with identifier: VB44523
2026-03-30 10:55:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fae686b-3402-510b-8f42-89dab50cb7ab with scrape type 2
2026-03-30 10:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fae686b-3402-510b-8f42-89dab50cb7ab with scrape type 2
2026-03-30 10:55:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fae686b-3402-510b-8f42-89dab50cb7ab, identifier: VB44523
2026-03-30 10:55:37 [auto1.de] INFO: Found listing with ID: AF76763
2026-03-30 10:55:37 [auto1.de] INFO: Found listing with ID: YA34461
2026-03-30 10:55:37 [auto1.de] INFO: Found listing with ID: ES39418
2026-03-30 10:55:37 [auto1.de] INFO: Found listing with ID: SA32858
2026-03-30 10:55:37 [auto1.de] INFO: Found listing with ID: JA20872
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA20872%27 HTTP/1.1" 200 None
2026-03-30 10:55:37 [auto1.de] INFO: Scrape type for JA20872: 2
2026-03-30 10:55:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c63c4d34-961d-5a8c-b50e-03b68d61b4f3 with identifier: JA20872
2026-03-30 10:55:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c63c4d34-961d-5a8c-b50e-03b68d61b4f3 with scrape type 2
2026-03-30 10:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c63c4d34-961d-5a8c-b50e-03b68d61b4f3 with scrape type 2
2026-03-30 10:55:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c63c4d34-961d-5a8c-b50e-03b68d61b4f3, identifier: JA20872
2026-03-30 10:55:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fae686b-3402-510b-8f42-89dab50cb7ab with identifier: VB44523
2026-03-30 10:55:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fae686b-3402-510b-8f42-89dab50cb7ab with identifier: VB44523
2026-03-30 10:55:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fae686b-3402-510b-8f42-89dab50cb7ab with identifier: VB44523 to the API
2026-03-30 10:55:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:59:45Z',
 'fuel_type': 'diesel',
 'id': '1fae686b-3402-510b-8f42-89dab50cb7ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB44523',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 155964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-27',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 TDCi Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2019}
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB44523%27 HTTP/1.1" 200 None
2026-03-30 10:55:39 [auto1.de] INFO: Saving data for VB44523: {'auction_closing_time': 1774972785.0, 'created_time': 1774378654.329533, 'last_price_update_time': 1774868139.071313}
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB44523') HTTP/1.1" 204 0
2026-03-30 10:55:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c63c4d34-961d-5a8c-b50e-03b68d61b4f3 with identifier: JA20872
2026-03-30 10:55:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c63c4d34-961d-5a8c-b50e-03b68d61b4f3 with identifier: JA20872
2026-03-30 10:55:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c63c4d34-961d-5a8c-b50e-03b68d61b4f3 with identifier: JA20872 to the API
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:11:44Z',
 'fuel_type': 'petrol',
 'id': 'c63c4d34-961d-5a8c-b50e-03b68d61b4f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA20872',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 78580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-27',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Edition Start/Stop 4x4',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop 4x4',
 'year': 2019}
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA20872%27 HTTP/1.1" 200 None
2026-03-30 10:55:39 [auto1.de] INFO: Saving data for JA20872: {'auction_closing_time': 1774969904.0, 'created_time': 1773343716.324601, 'last_price_update_time': 1774868139.58187}
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA20872') HTTP/1.1" 204 0
2026-03-30 10:55:39 [auto1.de] INFO: Found listing with ID: KU64879
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU64879%27 HTTP/1.1" 200 None
2026-03-30 10:55:39 [auto1.de] INFO: Scrape type for KU64879: 2
2026-03-30 10:55:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd1e78bd-6446-5b79-8735-c78801f89b52 with identifier: KU64879
2026-03-30 10:55:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd1e78bd-6446-5b79-8735-c78801f89b52 with scrape type 2
2026-03-30 10:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd1e78bd-6446-5b79-8735-c78801f89b52 with scrape type 2
2026-03-30 10:55:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd1e78bd-6446-5b79-8735-c78801f89b52, identifier: KU64879
2026-03-30 10:55:39 [auto1.de] INFO: Found listing with ID: VN21885
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN21885%27 HTTP/1.1" 200 None
2026-03-30 10:55:39 [auto1.de] INFO: Scrape type for VN21885: 2
2026-03-30 10:55:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2f7084c-6e68-5696-b22d-262e3cc0363a with identifier: VN21885
2026-03-30 10:55:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2f7084c-6e68-5696-b22d-262e3cc0363a with scrape type 2
2026-03-30 10:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2f7084c-6e68-5696-b22d-262e3cc0363a with scrape type 2
2026-03-30 10:55:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2f7084c-6e68-5696-b22d-262e3cc0363a, identifier: VN21885
2026-03-30 10:55:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd1e78bd-6446-5b79-8735-c78801f89b52 with identifier: KU64879
2026-03-30 10:55:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd1e78bd-6446-5b79-8735-c78801f89b52 with identifier: KU64879
2026-03-30 10:55:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd1e78bd-6446-5b79-8735-c78801f89b52 with identifier: KU64879 to the API
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:02:57Z',
 'fuel_type': 'petrol',
 'id': 'bd1e78bd-6446-5b79-8735-c78801f89b52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU64879',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 164902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-28',
 'seller_name': None,
 'title': 'Kia Venga 1.4 FIFA World Cup Edition',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2013}
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU64879%27 HTTP/1.1" 200 None
2026-03-30 10:55:40 [auto1.de] INFO: Saving data for KU64879: {'auction_closing_time': 1774969377.0, 'created_time': 1773399992.378106, 'last_price_update_time': 1774868140.202921}
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU64879') HTTP/1.1" 204 0
2026-03-30 10:55:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f420ead0>
2026-03-30 10:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F81%252F13818645c1e25c66bfbdde6c3d845ef8%252Fpa%252FCA30799_982906049847c89da222598a2b3aab1e.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_982906049847c89da222598a2b3aab1e.jpg saved to cache
2026-03-30 10:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c
2026-03-30 10:55:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c, skipping ID generation
2026-03-30 10:55:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c with scrape type 1
2026-03-30 10:55:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c sending to next pipeline
2026-03-30 10:55:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c, identifier: CA30799
2026-03-30 10:55:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2f7084c-6e68-5696-b22d-262e3cc0363a with identifier: VN21885
2026-03-30 10:55:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2f7084c-6e68-5696-b22d-262e3cc0363a with identifier: VN21885
2026-03-30 10:55:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2f7084c-6e68-5696-b22d-262e3cc0363a with identifier: VN21885 to the API
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:18:28Z',
 'fuel_type': 'petrol',
 'id': 'b2f7084c-6e68-5696-b22d-262e3cc0363a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN21885',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 204439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-31',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2008}
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN21885%27 HTTP/1.1" 200 None
2026-03-30 10:55:40 [auto1.de] INFO: Saving data for VN21885: {'auction_closing_time': 1774970308.0, 'created_time': 1772728415.241166, 'last_price_update_time': 1774868140.76607}
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN21885') HTTP/1.1" 204 0
2026-03-30 10:55:40 [auto1.de] INFO: Found listing with ID: YE54237
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE54237%27 HTTP/1.1" 200 None
2026-03-30 10:55:40 [auto1.de] INFO: Scrape type for YE54237: 2
2026-03-30 10:55:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96d94082-a4bc-5d28-950d-ce93232afd6f with identifier: YE54237
2026-03-30 10:55:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96d94082-a4bc-5d28-950d-ce93232afd6f with scrape type 2
2026-03-30 10:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96d94082-a4bc-5d28-950d-ce93232afd6f with scrape type 2
2026-03-30 10:55:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96d94082-a4bc-5d28-950d-ce93232afd6f, identifier: YE54237
2026-03-30 10:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM22646/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c with identifier: CA30799
2026-03-30 10:55:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c with identifier: CA30799
2026-03-30 10:55:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c with identifier: CA30799 to the API
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_982906049847c89da222598a2b3aab1e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 90,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:14:35Z',
 'fuel_type': 'petrol',
 'id': '41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA30799',
 'listing': 'auction',
 'location': 'DE, Wismar',
 'make': 'Fiat',
 'model': '500',
 'odometer': 70074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2324418,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_c4a1737c17dd5f43c534c7733f06c695.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2252889,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_7af5aea626521fdb939e1e884ccd5e8b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2277407,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_6941ac1ba34c7e45917aaf1e7d9ff554.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_9a448f805530cc4c78c800475d52fcd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2415921,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_5b3694020bb467ad2674be2791b5c1a5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2240182,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_ad1a9674846f7138e5b5a2e3d2613375.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1889862,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_f9e00f1246b8dd9578d205e9ddcbebf7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2239551,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_982906049847c89da222598a2b3aab1e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_28bd77de12b56f272e91c077c8063000.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c/41a6db8c-5ad4-5fc7-80a5-7b3ad1031a3c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/81/13818645c1e25c66bfbdde6c3d845ef8/pa/CA30799_8129acae03aff09f72e498bdef56584c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 0.9 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA30799%27 HTTP/1.1" 200 None
2026-03-30 10:55:41 [auto1.de] INFO: Saving data for CA30799: {'created_time': 1774868141.3446, 'last_price_update_time': 1774868141.344612, 'auction_closing_time': 1774970075.0}
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA30799') HTTP/1.1" 204 0
2026-03-30 10:55:41 [auto1.de] INFO: Found listing with ID: KN60852
2026-03-30 10:55:41 [auto1.de] INFO: Found listing with ID: FL96741
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL96741%27 HTTP/1.1" 200 None
2026-03-30 10:55:41 [auto1.de] INFO: Scrape type for FL96741: 1
2026-03-30 10:55:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96d94082-a4bc-5d28-950d-ce93232afd6f with identifier: YE54237
2026-03-30 10:55:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96d94082-a4bc-5d28-950d-ce93232afd6f with identifier: YE54237
2026-03-30 10:55:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96d94082-a4bc-5d28-950d-ce93232afd6f with identifier: YE54237 to the API
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:08:49Z',
 'fuel_type': 'diesel',
 'id': '96d94082-a4bc-5d28-950d-ce93232afd6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE54237',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 105353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-01',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2017}
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE54237%27 HTTP/1.1" 200 None
2026-03-30 10:55:41 [auto1.de] INFO: Saving data for YE54237: {'auction_closing_time': 1774969729.0, 'created_time': 1774465550.510243, 'last_price_update_time': 1774868141.666059}
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE54237') HTTP/1.1" 204 0
2026-03-30 10:55:41 [auto1.de] INFO: Found listing with ID: XZ96479
2026-03-30 10:55:41 [auto1.de] INFO: Found listing with ID: SU53309
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU53309%27 HTTP/1.1" 200 None
2026-03-30 10:55:41 [auto1.de] INFO: Scrape type for SU53309: 2
2026-03-30 10:55:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72559f42-c56c-5778-8594-81b87b589c05 with identifier: SU53309
2026-03-30 10:55:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72559f42-c56c-5778-8594-81b87b589c05 with scrape type 2
2026-03-30 10:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72559f42-c56c-5778-8594-81b87b589c05 with scrape type 2
2026-03-30 10:55:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72559f42-c56c-5778-8594-81b87b589c05, identifier: SU53309
2026-03-30 10:55:41 [auto1.de] INFO: Found listing with ID: HJ41200
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ41200%27 HTTP/1.1" 200 None
2026-03-30 10:55:41 [auto1.de] INFO: Scrape type for HJ41200: 2
2026-03-30 10:55:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3bb55bf-fcf4-5ca0-b21a-99eed685bcfa with identifier: HJ41200
2026-03-30 10:55:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3bb55bf-fcf4-5ca0-b21a-99eed685bcfa with scrape type 2
2026-03-30 10:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3bb55bf-fcf4-5ca0-b21a-99eed685bcfa with scrape type 2
2026-03-30 10:55:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3bb55bf-fcf4-5ca0-b21a-99eed685bcfa, identifier: HJ41200
2026-03-30 10:55:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72559f42-c56c-5778-8594-81b87b589c05 with identifier: SU53309
2026-03-30 10:55:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72559f42-c56c-5778-8594-81b87b589c05 with identifier: SU53309
2026-03-30 10:55:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72559f42-c56c-5778-8594-81b87b589c05 with identifier: SU53309 to the API
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:33:40Z',
 'fuel_type': 'diesel',
 'id': '72559f42-c56c-5778-8594-81b87b589c05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU53309',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 131781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-14',
 'seller_name': None,
 'title': 'BMW 3er 320d Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2019}
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU53309%27 HTTP/1.1" 200 None
2026-03-30 10:55:42 [auto1.de] INFO: Saving data for SU53309: {'auction_closing_time': 1774971220.0, 'created_time': 1773346288.098219, 'last_price_update_time': 1774868142.232212}
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU53309') HTTP/1.1" 204 0
2026-03-30 10:55:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3bb55bf-fcf4-5ca0-b21a-99eed685bcfa with identifier: HJ41200
2026-03-30 10:55:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3bb55bf-fcf4-5ca0-b21a-99eed685bcfa with identifier: HJ41200
2026-03-30 10:55:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3bb55bf-fcf4-5ca0-b21a-99eed685bcfa with identifier: HJ41200 to the API
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:12:27Z',
 'fuel_type': 'petrol',
 'id': 'e3bb55bf-fcf4-5ca0-b21a-99eed685bcfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ41200',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 140215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-15',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': '4Motion BlueMotion',
 'year': 2019}
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ41200%27 HTTP/1.1" 200 None
2026-03-30 10:55:43 [auto1.de] INFO: Saving data for HJ41200: {'auction_closing_time': 1774969947.0, 'created_time': 1773133222.861691, 'last_price_update_time': 1774868143.349106}
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ41200') HTTP/1.1" 204 0
2026-03-30 10:55:43 [auto1.de] INFO: Found listing with ID: VL69924
2026-03-30 10:55:43 [auto1.de] INFO: Found listing with ID: VH72223
2026-03-30 10:55:43 [auto1.de] INFO: Found listing with ID: LN72061
2026-03-30 10:55:43 [auto1.de] INFO: Found listing with ID: YR94789
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR94789%27 HTTP/1.1" 200 None
2026-03-30 10:55:43 [auto1.de] INFO: Scrape type for YR94789: 1
2026-03-30 10:55:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:43 [auto1.de] INFO: Found listing with ID: PF91020
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF91020%27 HTTP/1.1" 200 None
2026-03-30 10:55:43 [auto1.de] INFO: Scrape type for PF91020: 2
2026-03-30 10:55:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40c8aa97-204c-513c-8a8d-7fb8c2c89718 with identifier: PF91020
2026-03-30 10:55:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40c8aa97-204c-513c-8a8d-7fb8c2c89718 with scrape type 2
2026-03-30 10:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40c8aa97-204c-513c-8a8d-7fb8c2c89718 with scrape type 2
2026-03-30 10:55:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40c8aa97-204c-513c-8a8d-7fb8c2c89718, identifier: PF91020
2026-03-30 10:55:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40c8aa97-204c-513c-8a8d-7fb8c2c89718 with identifier: PF91020
2026-03-30 10:55:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40c8aa97-204c-513c-8a8d-7fb8c2c89718 with identifier: PF91020
2026-03-30 10:55:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40c8aa97-204c-513c-8a8d-7fb8c2c89718 with identifier: PF91020 to the API
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-31T15:29:32Z',
 'fuel_type': 'petrol',
 'id': '40c8aa97-204c-513c-8a8d-7fb8c2c89718',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF91020',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 96159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-19',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI R BlueMotion 4Motion',
 'transmission': 'automatic',
 'trim': 'R BlueMotion 4Motion',
 'year': 2017}
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF91020%27 HTTP/1.1" 200 None
2026-03-30 10:55:43 [auto1.de] INFO: Saving data for PF91020: {'auction_closing_time': 1774970972.0, 'created_time': 1774436006.920964, 'last_price_update_time': 1774868143.85663}
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF91020') HTTP/1.1" 204 0
2026-03-30 10:55:43 [auto1.de] INFO: Found listing with ID: FU89113
2026-03-30 10:55:43 [auto1.de] INFO: Found listing with ID: LY71761
2026-03-30 10:55:43 [auto1.de] INFO: Found listing with ID: FE80519
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE80519%27 HTTP/1.1" 200 None
2026-03-30 10:55:43 [auto1.de] INFO: Scrape type for FE80519: 2
2026-03-30 10:55:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 006f4412-829d-5971-ac24-1254abb4a8cb with identifier: FE80519
2026-03-30 10:55:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 006f4412-829d-5971-ac24-1254abb4a8cb with scrape type 2
2026-03-30 10:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 006f4412-829d-5971-ac24-1254abb4a8cb with scrape type 2
2026-03-30 10:55:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 006f4412-829d-5971-ac24-1254abb4a8cb, identifier: FE80519
2026-03-30 10:55:44 [auto1.de] INFO: Found listing with ID: NF54912
2026-03-30 10:55:44 [auto1.de] INFO: Found listing with ID: KK55590
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK55590%27 HTTP/1.1" 200 None
2026-03-30 10:55:44 [auto1.de] INFO: Scrape type for KK55590: 2
2026-03-30 10:55:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c310414-1a13-5ce3-8e4e-fb4933e50b17 with identifier: KK55590
2026-03-30 10:55:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c310414-1a13-5ce3-8e4e-fb4933e50b17 with scrape type 2
2026-03-30 10:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c310414-1a13-5ce3-8e4e-fb4933e50b17 with scrape type 2
2026-03-30 10:55:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c310414-1a13-5ce3-8e4e-fb4933e50b17, identifier: KK55590
2026-03-30 10:55:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 006f4412-829d-5971-ac24-1254abb4a8cb with identifier: FE80519
2026-03-30 10:55:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 006f4412-829d-5971-ac24-1254abb4a8cb with identifier: FE80519
2026-03-30 10:55:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 006f4412-829d-5971-ac24-1254abb4a8cb with identifier: FE80519 to the API
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:31:50Z',
 'fuel_type': 'petrol',
 'id': '006f4412-829d-5971-ac24-1254abb4a8cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE80519',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 170303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-16',
 'seller_name': None,
 'title': 'Ford C-Max 1.8 Flexifuel Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2008}
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE80519%27 HTTP/1.1" 200 None
2026-03-30 10:55:44 [auto1.de] INFO: Saving data for FE80519: {'auction_closing_time': 1774971110.0, 'created_time': 1774636925.407606, 'last_price_update_time': 1774868144.525005}
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE80519') HTTP/1.1" 204 0
2026-03-30 10:55:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c310414-1a13-5ce3-8e4e-fb4933e50b17 with identifier: KK55590
2026-03-30 10:55:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c310414-1a13-5ce3-8e4e-fb4933e50b17 with identifier: KK55590
2026-03-30 10:55:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c310414-1a13-5ce3-8e4e-fb4933e50b17 with identifier: KK55590 to the API
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:13:43Z',
 'fuel_type': 'petrol',
 'id': '9c310414-1a13-5ce3-8e4e-fb4933e50b17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK55590',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 112914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Lounge Sport & Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Lounge Sport & Style 4Motion',
 'year': 2015}
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK55590%27 HTTP/1.1" 200 None
2026-03-30 10:55:44 [auto1.de] INFO: Saving data for KK55590: {'auction_closing_time': 1774970023.0, 'created_time': 1773686833.927118, 'last_price_update_time': 1774868144.884029}
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK55590') HTTP/1.1" 204 0
2026-03-30 10:55:44 [auto1.de] INFO: Found listing with ID: MC31762
2026-03-30 10:55:44 [auto1.de] INFO: Found listing with ID: VZ67143
2026-03-30 10:55:44 [auto1.de] INFO: Found listing with ID: EF20977
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF20977%27 HTTP/1.1" 200 None
2026-03-30 10:55:45 [auto1.de] INFO: Scrape type for EF20977: 2
2026-03-30 10:55:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7ff14fc-bc77-5d56-9eee-14e267e69288 with identifier: EF20977
2026-03-30 10:55:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7ff14fc-bc77-5d56-9eee-14e267e69288 with scrape type 2
2026-03-30 10:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7ff14fc-bc77-5d56-9eee-14e267e69288 with scrape type 2
2026-03-30 10:55:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7ff14fc-bc77-5d56-9eee-14e267e69288, identifier: EF20977
2026-03-30 10:55:45 [auto1.de] INFO: Found listing with ID: WP07187
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP07187%27 HTTP/1.1" 200 None
2026-03-30 10:55:45 [auto1.de] INFO: Scrape type for WP07187: 1
2026-03-30 10:55:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7ff14fc-bc77-5d56-9eee-14e267e69288 with identifier: EF20977
2026-03-30 10:55:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7ff14fc-bc77-5d56-9eee-14e267e69288 with identifier: EF20977
2026-03-30 10:55:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7ff14fc-bc77-5d56-9eee-14e267e69288 with identifier: EF20977 to the API
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:02:33Z',
 'fuel_type': 'petrol',
 'id': 'a7ff14fc-bc77-5d56-9eee-14e267e69288',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF20977',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 88461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-28',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2016}
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF20977%27 HTTP/1.1" 200 None
2026-03-30 10:55:45 [auto1.de] INFO: Saving data for EF20977: {'auction_closing_time': 1774969353.0, 'created_time': 1774463908.222709, 'last_price_update_time': 1774868145.466104}
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF20977') HTTP/1.1" 204 0
2026-03-30 10:55:45 [auto1.de] INFO: Found listing with ID: UD38277
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD38277%27 HTTP/1.1" 200 None
2026-03-30 10:55:45 [auto1.de] INFO: Scrape type for UD38277: 2
2026-03-30 10:55:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a8d7bf6-cfc0-52a0-8548-9208b8b38bd6 with identifier: UD38277
2026-03-30 10:55:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a8d7bf6-cfc0-52a0-8548-9208b8b38bd6 with scrape type 2
2026-03-30 10:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a8d7bf6-cfc0-52a0-8548-9208b8b38bd6 with scrape type 2
2026-03-30 10:55:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a8d7bf6-cfc0-52a0-8548-9208b8b38bd6, identifier: UD38277
2026-03-30 10:55:45 [auto1.de] INFO: Found listing with ID: LH84474
2026-03-30 10:55:45 [auto1.de] INFO: Found listing with ID: ZK41607
2026-03-30 10:55:45 [auto1.de] INFO: Found listing with ID: YM31567
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM31567%27 HTTP/1.1" 200 None
2026-03-30 10:55:45 [auto1.de] INFO: Scrape type for YM31567: 2
2026-03-30 10:55:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 294bd3c4-c7a0-5649-b201-68a4c8dcc2b1 with identifier: YM31567
2026-03-30 10:55:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 294bd3c4-c7a0-5649-b201-68a4c8dcc2b1 with scrape type 2
2026-03-30 10:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 294bd3c4-c7a0-5649-b201-68a4c8dcc2b1 with scrape type 2
2026-03-30 10:55:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 294bd3c4-c7a0-5649-b201-68a4c8dcc2b1, identifier: YM31567
2026-03-30 10:55:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a8d7bf6-cfc0-52a0-8548-9208b8b38bd6 with identifier: UD38277
2026-03-30 10:55:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a8d7bf6-cfc0-52a0-8548-9208b8b38bd6 with identifier: UD38277
2026-03-30 10:55:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a8d7bf6-cfc0-52a0-8548-9208b8b38bd6 with identifier: UD38277 to the API
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:21:22Z',
 'fuel_type': 'diesel',
 'id': '2a8d7bf6-cfc0-52a0-8548-9208b8b38bd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD38277',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 167995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-27',
 'seller_name': None,
 'title': 'Audi A3 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2017}
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD38277%27 HTTP/1.1" 200 None
2026-03-30 10:55:46 [auto1.de] INFO: Saving data for UD38277: {'auction_closing_time': 1774970482.0, 'created_time': 1773662271.071525, 'last_price_update_time': 1774868146.027391}
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD38277') HTTP/1.1" 204 0
2026-03-30 10:55:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 294bd3c4-c7a0-5649-b201-68a4c8dcc2b1 with identifier: YM31567
2026-03-30 10:55:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 294bd3c4-c7a0-5649-b201-68a4c8dcc2b1 with identifier: YM31567
2026-03-30 10:55:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 294bd3c4-c7a0-5649-b201-68a4c8dcc2b1 with identifier: YM31567 to the API
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:57:33Z',
 'fuel_type': 'diesel',
 'id': '294bd3c4-c7a0-5649-b201-68a4c8dcc2b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM31567',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 278079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-13',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2017}
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM31567%27 HTTP/1.1" 200 None
2026-03-30 10:55:46 [auto1.de] INFO: Saving data for YM31567: {'auction_closing_time': 1774972653.0, 'created_time': 1773686140.14214, 'last_price_update_time': 1774868146.468361}
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM31567') HTTP/1.1" 204 0
2026-03-30 10:55:46 [auto1.de] INFO: Found listing with ID: DS53999
2026-03-30 10:55:46 [auto1.de] INFO: Found listing with ID: SG45173
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG45173%27 HTTP/1.1" 200 None
2026-03-30 10:55:46 [auto1.de] INFO: Scrape type for SG45173: 2
2026-03-30 10:55:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b642dacb-0574-53a7-ba9c-15986f86269b with identifier: SG45173
2026-03-30 10:55:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b642dacb-0574-53a7-ba9c-15986f86269b with scrape type 2
2026-03-30 10:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b642dacb-0574-53a7-ba9c-15986f86269b with scrape type 2
2026-03-30 10:55:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b642dacb-0574-53a7-ba9c-15986f86269b, identifier: SG45173
2026-03-30 10:55:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:46 [auto1.de] INFO: Found listing with ID: US29975
2026-03-30 10:55:46 [auto1.de] INFO: Found listing with ID: TV42528
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV42528%27 HTTP/1.1" 200 None
2026-03-30 10:55:46 [auto1.de] INFO: Scrape type for TV42528: 2
2026-03-30 10:55:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42ae6f73-80cc-5e1f-b4e3-ba489e08c115 with identifier: TV42528
2026-03-30 10:55:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42ae6f73-80cc-5e1f-b4e3-ba489e08c115 with scrape type 2
2026-03-30 10:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42ae6f73-80cc-5e1f-b4e3-ba489e08c115 with scrape type 2
2026-03-30 10:55:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42ae6f73-80cc-5e1f-b4e3-ba489e08c115, identifier: TV42528
2026-03-30 10:55:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b642dacb-0574-53a7-ba9c-15986f86269b with identifier: SG45173
2026-03-30 10:55:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b642dacb-0574-53a7-ba9c-15986f86269b with identifier: SG45173
2026-03-30 10:55:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b642dacb-0574-53a7-ba9c-15986f86269b with identifier: SG45173 to the API
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:29:45Z',
 'fuel_type': 'diesel',
 'id': 'b642dacb-0574-53a7-ba9c-15986f86269b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG45173',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 87662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-01',
 'seller_name': None,
 'title': 'BMW 5er 520d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG45173%27 HTTP/1.1" 200 None
2026-03-30 10:55:47 [auto1.de] INFO: Saving data for SG45173: {'auction_closing_time': 1774970985.0, 'created_time': 1774467928.74569, 'last_price_update_time': 1774868147.140282}
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG45173') HTTP/1.1" 204 0
2026-03-30 10:55:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42ae6f73-80cc-5e1f-b4e3-ba489e08c115 with identifier: TV42528
2026-03-30 10:55:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42ae6f73-80cc-5e1f-b4e3-ba489e08c115 with identifier: TV42528
2026-03-30 10:55:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42ae6f73-80cc-5e1f-b4e3-ba489e08c115 with identifier: TV42528 to the API
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:18:29Z',
 'fuel_type': 'petrol',
 'id': '42ae6f73-80cc-5e1f-b4e3-ba489e08c115',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV42528',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 122750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-28',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV42528%27 HTTP/1.1" 200 None
2026-03-30 10:55:47 [auto1.de] INFO: Saving data for TV42528: {'auction_closing_time': 1774970309.0, 'created_time': 1774435375.139107, 'last_price_update_time': 1774868147.486583}
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV42528') HTTP/1.1" 204 0
2026-03-30 10:55:47 [auto1.de] INFO: Found listing with ID: AY72100
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY72100%27 HTTP/1.1" 200 None
2026-03-30 10:55:47 [auto1.de] INFO: Scrape type for AY72100: 2
2026-03-30 10:55:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d27e1bc4-1470-5fc2-b9a2-9f50a6b0bde9 with identifier: AY72100
2026-03-30 10:55:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d27e1bc4-1470-5fc2-b9a2-9f50a6b0bde9 with scrape type 2
2026-03-30 10:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d27e1bc4-1470-5fc2-b9a2-9f50a6b0bde9 with scrape type 2
2026-03-30 10:55:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d27e1bc4-1470-5fc2-b9a2-9f50a6b0bde9, identifier: AY72100
2026-03-30 10:55:47 [auto1.de] INFO: Found listing with ID: XK43796
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK43796%27 HTTP/1.1" 200 None
2026-03-30 10:55:47 [auto1.de] INFO: Scrape type for XK43796: 2
2026-03-30 10:55:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c739cf7a-bcbb-5a85-8b6d-a86c4b62efa0 with identifier: XK43796
2026-03-30 10:55:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c739cf7a-bcbb-5a85-8b6d-a86c4b62efa0 with scrape type 2
2026-03-30 10:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c739cf7a-bcbb-5a85-8b6d-a86c4b62efa0 with scrape type 2
2026-03-30 10:55:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c739cf7a-bcbb-5a85-8b6d-a86c4b62efa0, identifier: XK43796
2026-03-30 10:55:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d27e1bc4-1470-5fc2-b9a2-9f50a6b0bde9 with identifier: AY72100
2026-03-30 10:55:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d27e1bc4-1470-5fc2-b9a2-9f50a6b0bde9 with identifier: AY72100
2026-03-30 10:55:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d27e1bc4-1470-5fc2-b9a2-9f50a6b0bde9 with identifier: AY72100 to the API
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:48:58Z',
 'fuel_type': 'diesel',
 'id': 'd27e1bc4-1470-5fc2-b9a2-9f50a6b0bde9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY72100',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 221447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-02',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2014}
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY72100%27 HTTP/1.1" 200 None
2026-03-30 10:55:48 [auto1.de] INFO: Saving data for AY72100: {'auction_closing_time': 1774972138.0, 'created_time': 1773301246.039899, 'last_price_update_time': 1774868148.153726}
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY72100') HTTP/1.1" 204 0
2026-03-30 10:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c739cf7a-bcbb-5a85-8b6d-a86c4b62efa0 with identifier: XK43796
2026-03-30 10:55:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c739cf7a-bcbb-5a85-8b6d-a86c4b62efa0 with identifier: XK43796
2026-03-30 10:55:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c739cf7a-bcbb-5a85-8b6d-a86c4b62efa0 with identifier: XK43796 to the API
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:58:58Z',
 'fuel_type': 'diesel',
 'id': 'c739cf7a-bcbb-5a85-8b6d-a86c4b62efa0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK43796',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 115599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-23',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK43796%27 HTTP/1.1" 200 None
2026-03-30 10:55:48 [auto1.de] INFO: Saving data for XK43796: {'auction_closing_time': 1774972738.0, 'created_time': 1773302124.70476, 'last_price_update_time': 1774868148.582209}
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK43796') HTTP/1.1" 204 0
2026-03-30 10:55:48 [auto1.de] INFO: Found listing with ID: CL04690
2026-03-30 10:55:48 [auto1.de] INFO: Found listing with ID: UH91278
2026-03-30 10:55:48 [auto1.de] INFO: Found listing with ID: SG73532
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG73532%27 HTTP/1.1" 200 None
2026-03-30 10:55:48 [auto1.de] INFO: Scrape type for SG73532: 2
2026-03-30 10:55:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c7ba88a-a311-5a75-a1d0-73612a12ab62 with identifier: SG73532
2026-03-30 10:55:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c7ba88a-a311-5a75-a1d0-73612a12ab62 with scrape type 2
2026-03-30 10:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c7ba88a-a311-5a75-a1d0-73612a12ab62 with scrape type 2
2026-03-30 10:55:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c7ba88a-a311-5a75-a1d0-73612a12ab62, identifier: SG73532
2026-03-30 10:55:48 [auto1.de] INFO: Found listing with ID: CB34821
2026-03-30 10:55:48 [auto1.de] INFO: Found listing with ID: GU29210
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU29210%27 HTTP/1.1" 200 None
2026-03-30 10:55:48 [auto1.de] INFO: Scrape type for GU29210: 1
2026-03-30 10:55:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c7ba88a-a311-5a75-a1d0-73612a12ab62 with identifier: SG73532
2026-03-30 10:55:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c7ba88a-a311-5a75-a1d0-73612a12ab62 with identifier: SG73532
2026-03-30 10:55:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c7ba88a-a311-5a75-a1d0-73612a12ab62 with identifier: SG73532 to the API
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:17:57Z',
 'fuel_type': 'hybrid',
 'id': '4c7ba88a-a311-5a75-a1d0-73612a12ab62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG73532',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 52691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-27',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2021}
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG73532%27 HTTP/1.1" 200 None
2026-03-30 10:55:49 [auto1.de] INFO: Saving data for SG73532: {'auction_closing_time': 1774970277.0, 'created_time': 1774463704.198307, 'last_price_update_time': 1774868149.053}
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG73532') HTTP/1.1" 204 0
2026-03-30 10:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL96741/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FC64824/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:49 [auto1.de] INFO: Found listing with ID: HY62017
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY62017%27 HTTP/1.1" 200 None
2026-03-30 10:55:49 [auto1.de] INFO: Scrape type for HY62017: 2
2026-03-30 10:55:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f23eb98b-300c-5bbb-884f-779440bec312 with identifier: HY62017
2026-03-30 10:55:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23eb98b-300c-5bbb-884f-779440bec312 with scrape type 2
2026-03-30 10:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f23eb98b-300c-5bbb-884f-779440bec312 with scrape type 2
2026-03-30 10:55:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f23eb98b-300c-5bbb-884f-779440bec312, identifier: HY62017
2026-03-30 10:55:49 [auto1.de] INFO: Found listing with ID: UZ92171
2026-03-30 10:55:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f23eb98b-300c-5bbb-884f-779440bec312 with identifier: HY62017
2026-03-30 10:55:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f23eb98b-300c-5bbb-884f-779440bec312 with identifier: HY62017
2026-03-30 10:55:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f23eb98b-300c-5bbb-884f-779440bec312 with identifier: HY62017 to the API
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:39:36Z',
 'fuel_type': 'diesel',
 'id': 'f23eb98b-300c-5bbb-884f-779440bec312',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY62017',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 174810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-15',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.7 BLUE dCi BOSE-Edition',
 'transmission': 'automatic',
 'trim': 'BOSE-Edition',
 'year': 2020}
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY62017%27 HTTP/1.1" 200 None
2026-03-30 10:55:49 [auto1.de] INFO: Saving data for HY62017: {'auction_closing_time': 1774971576.0, 'created_time': 1774467927.996187, 'last_price_update_time': 1774868149.666807}
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY62017') HTTP/1.1" 204 0
2026-03-30 10:55:49 [auto1.de] INFO: Found listing with ID: KM62528
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM62528%27 HTTP/1.1" 200 None
2026-03-30 10:55:49 [auto1.de] INFO: Scrape type for KM62528: 2
2026-03-30 10:55:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58317ff2-908e-599e-9116-5adb2b50b60e with identifier: KM62528
2026-03-30 10:55:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58317ff2-908e-599e-9116-5adb2b50b60e with scrape type 2
2026-03-30 10:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58317ff2-908e-599e-9116-5adb2b50b60e with scrape type 2
2026-03-30 10:55:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58317ff2-908e-599e-9116-5adb2b50b60e, identifier: KM62528
2026-03-30 10:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR94789/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:49 [auto1.de] INFO: Channel: 24h | Page: 57 | totalHits: 9528 | hits on page: 40
2026-03-30 10:55:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58317ff2-908e-599e-9116-5adb2b50b60e with identifier: KM62528
2026-03-30 10:55:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58317ff2-908e-599e-9116-5adb2b50b60e with identifier: KM62528
2026-03-30 10:55:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58317ff2-908e-599e-9116-5adb2b50b60e with identifier: KM62528 to the API
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:10:04Z',
 'fuel_type': 'diesel',
 'id': '58317ff2-908e-599e-9116-5adb2b50b60e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM62528',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 171948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-30',
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Energy Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2016}
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM62528%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [auto1.de] INFO: Saving data for KM62528: {'auction_closing_time': 1774969804.0, 'created_time': 1774291400.040427, 'last_price_update_time': 1774868150.146276}
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM62528') HTTP/1.1" 204 0
2026-03-30 10:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YM22646> (referer: https://www.auto1.com/v1/car-details-view/YM22646/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:50 [auto1.de] INFO: Found listing with ID: AF02059
2026-03-30 10:55:50 [auto1.de] INFO: Found listing with ID: XC72019
2026-03-30 10:55:50 [auto1.de] INFO: Found listing with ID: HG55526
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG55526%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [auto1.de] INFO: Scrape type for HG55526: 2
2026-03-30 10:55:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8614f9f-3ffa-579f-b5bd-ac0432038d33 with identifier: HG55526
2026-03-30 10:55:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8614f9f-3ffa-579f-b5bd-ac0432038d33 with scrape type 2
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8614f9f-3ffa-579f-b5bd-ac0432038d33 with scrape type 2
2026-03-30 10:55:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8614f9f-3ffa-579f-b5bd-ac0432038d33, identifier: HG55526
2026-03-30 10:55:50 [auto1.de] INFO: Found listing with ID: DE91366
2026-03-30 10:55:50 [auto1.de] INFO: Found listing with ID: TW83791
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW83791%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [auto1.de] INFO: Scrape type for TW83791: 2
2026-03-30 10:55:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c95008dc-ead7-5bc7-a5fc-8ea92c5b4969 with identifier: TW83791
2026-03-30 10:55:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c95008dc-ead7-5bc7-a5fc-8ea92c5b4969 with scrape type 2
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c95008dc-ead7-5bc7-a5fc-8ea92c5b4969 with scrape type 2
2026-03-30 10:55:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c95008dc-ead7-5bc7-a5fc-8ea92c5b4969, identifier: TW83791
2026-03-30 10:55:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8614f9f-3ffa-579f-b5bd-ac0432038d33 with identifier: HG55526
2026-03-30 10:55:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8614f9f-3ffa-579f-b5bd-ac0432038d33 with identifier: HG55526
2026-03-30 10:55:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8614f9f-3ffa-579f-b5bd-ac0432038d33 with identifier: HG55526 to the API
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:47:34Z',
 'fuel_type': 'petrol',
 'id': 'b8614f9f-3ffa-579f-b5bd-ac0432038d33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG55526',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 98652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-10',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG55526%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [auto1.de] INFO: Saving data for HG55526: {'auction_closing_time': 1774972054.0, 'created_time': 1773725452.527821, 'last_price_update_time': 1774868150.798634}
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG55526') HTTP/1.1" 204 0
2026-03-30 10:55:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c95008dc-ead7-5bc7-a5fc-8ea92c5b4969 with identifier: TW83791
2026-03-30 10:55:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c95008dc-ead7-5bc7-a5fc-8ea92c5b4969 with identifier: TW83791
2026-03-30 10:55:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c95008dc-ead7-5bc7-a5fc-8ea92c5b4969 with identifier: TW83791 to the API
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:41:29Z',
 'fuel_type': 'petrol',
 'id': 'c95008dc-ead7-5bc7-a5fc-8ea92c5b4969',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW83791',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 121580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-28',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI United',
 'transmission': 'automatic',
 'trim': 'United',
 'year': 2008}
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW83791%27 HTTP/1.1" 200 None
2026-03-30 10:55:51 [auto1.de] INFO: Saving data for TW83791: {'auction_closing_time': 1774971689.0, 'created_time': 1773776364.619453, 'last_price_update_time': 1774868151.19778}
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW83791') HTTP/1.1" 204 0
2026-03-30 10:55:51 [auto1.de] INFO: Found listing with ID: AE75299
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE75299%27 HTTP/1.1" 200 None
2026-03-30 10:55:51 [auto1.de] INFO: Scrape type for AE75299: 2
2026-03-30 10:55:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2878f254-5e67-5cfa-95e0-83953dc6bfac with identifier: AE75299
2026-03-30 10:55:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2878f254-5e67-5cfa-95e0-83953dc6bfac with scrape type 2
2026-03-30 10:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2878f254-5e67-5cfa-95e0-83953dc6bfac with scrape type 2
2026-03-30 10:55:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2878f254-5e67-5cfa-95e0-83953dc6bfac, identifier: AE75299
2026-03-30 10:55:51 [auto1.de] INFO: Found listing with ID: LC46015
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC46015%27 HTTP/1.1" 200 None
2026-03-30 10:55:51 [auto1.de] INFO: Scrape type for LC46015: 2
2026-03-30 10:55:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46d0c560-27cf-5bbf-b82f-b7ec85b6cb77 with identifier: LC46015
2026-03-30 10:55:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46d0c560-27cf-5bbf-b82f-b7ec85b6cb77 with scrape type 2
2026-03-30 10:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46d0c560-27cf-5bbf-b82f-b7ec85b6cb77 with scrape type 2
2026-03-30 10:55:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46d0c560-27cf-5bbf-b82f-b7ec85b6cb77, identifier: LC46015
2026-03-30 10:55:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2878f254-5e67-5cfa-95e0-83953dc6bfac with identifier: AE75299
2026-03-30 10:55:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2878f254-5e67-5cfa-95e0-83953dc6bfac with identifier: AE75299
2026-03-30 10:55:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2878f254-5e67-5cfa-95e0-83953dc6bfac with identifier: AE75299 to the API
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:20:48Z',
 'fuel_type': 'petrol',
 'id': '2878f254-5e67-5cfa-95e0-83953dc6bfac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE75299',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 121611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-28',
 'seller_name': None,
 'title': 'BMW 1er 118i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2018}
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE75299%27 HTTP/1.1" 200 None
2026-03-30 10:55:51 [auto1.de] INFO: Saving data for AE75299: {'auction_closing_time': 1774970448.0, 'created_time': 1773860946.803279, 'last_price_update_time': 1774868151.779902}
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE75299') HTTP/1.1" 204 0
2026-03-30 10:55:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46d0c560-27cf-5bbf-b82f-b7ec85b6cb77 with identifier: LC46015
2026-03-30 10:55:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46d0c560-27cf-5bbf-b82f-b7ec85b6cb77 with identifier: LC46015
2026-03-30 10:55:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46d0c560-27cf-5bbf-b82f-b7ec85b6cb77 with identifier: LC46015 to the API
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:48:26Z',
 'fuel_type': 'petrol',
 'id': '46d0c560-27cf-5bbf-b82f-b7ec85b6cb77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC46015',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 56384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-23',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2019}
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC46015%27 HTTP/1.1" 200 None
2026-03-30 10:55:52 [auto1.de] INFO: Saving data for LC46015: {'auction_closing_time': 1774972106.0, 'created_time': 1773688435.278159, 'last_price_update_time': 1774868152.140535}
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC46015') HTTP/1.1" 204 0
2026-03-30 10:55:52 [auto1.de] INFO: Found listing with ID: EL20809
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL20809%27 HTTP/1.1" 200 None
2026-03-30 10:55:52 [auto1.de] INFO: Scrape type for EL20809: 2
2026-03-30 10:55:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 601116ac-b079-5635-9f36-48932ea42286 with identifier: EL20809
2026-03-30 10:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 601116ac-b079-5635-9f36-48932ea42286 with scrape type 2
2026-03-30 10:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 601116ac-b079-5635-9f36-48932ea42286 with scrape type 2
2026-03-30 10:55:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 601116ac-b079-5635-9f36-48932ea42286, identifier: EL20809
2026-03-30 10:55:52 [auto1.de] INFO: Found listing with ID: GR51738
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR51738%27 HTTP/1.1" 200 None
2026-03-30 10:55:52 [auto1.de] INFO: Scrape type for GR51738: 2
2026-03-30 10:55:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46d43433-44b7-5607-9f57-90e53c6aee5a with identifier: GR51738
2026-03-30 10:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46d43433-44b7-5607-9f57-90e53c6aee5a with scrape type 2
2026-03-30 10:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46d43433-44b7-5607-9f57-90e53c6aee5a with scrape type 2
2026-03-30 10:55:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46d43433-44b7-5607-9f57-90e53c6aee5a, identifier: GR51738
2026-03-30 10:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP07187/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 601116ac-b079-5635-9f36-48932ea42286 with identifier: EL20809
2026-03-30 10:55:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 601116ac-b079-5635-9f36-48932ea42286 with identifier: EL20809
2026-03-30 10:55:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 601116ac-b079-5635-9f36-48932ea42286 with identifier: EL20809 to the API
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:48:45Z',
 'fuel_type': 'petrol',
 'id': '601116ac-b079-5635-9f36-48932ea42286',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL20809',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 130567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-06',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Sport & Style 4Motion',
 'transmission': 'manual',
 'trim': 'Sport & Style 4Motion',
 'year': 2009}
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL20809%27 HTTP/1.1" 200 None
2026-03-30 10:55:52 [auto1.de] INFO: Saving data for EL20809: {'auction_closing_time': 1774972125.0, 'created_time': 1773741398.880805, 'last_price_update_time': 1774868152.740858}
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL20809') HTTP/1.1" 204 0
2026-03-30 10:55:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46d43433-44b7-5607-9f57-90e53c6aee5a with identifier: GR51738
2026-03-30 10:55:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46d43433-44b7-5607-9f57-90e53c6aee5a with identifier: GR51738
2026-03-30 10:55:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46d43433-44b7-5607-9f57-90e53c6aee5a with identifier: GR51738 to the API
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:46:47Z',
 'fuel_type': 'petrol',
 'id': '46d43433-44b7-5607-9f57-90e53c6aee5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR51738',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 150048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-19',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR51738%27 HTTP/1.1" 200 None
2026-03-30 10:55:53 [auto1.de] INFO: Saving data for GR51738: {'auction_closing_time': 1774972007.0, 'created_time': 1773686827.335533, 'last_price_update_time': 1774868153.232867}
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR51738') HTTP/1.1" 204 0
2026-03-30 10:55:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c958bc95-5874-5814-bae6-988836f812e4 with identifier: YM22646
2026-03-30 10:55:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c958bc95-5874-5814-bae6-988836f812e4 with scrape type 1
2026-03-30 10:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c958bc95-5874-5814-bae6-988836f812e4
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_856cfc2ce9457a4a8b49028156d6db4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_856cfc2ce9457a4a8b49028156d6db4e.jpg not downloaded yet
2026-03-30 10:55:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:53 [auto1.de] INFO: Found listing with ID: RM36813
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM36813%27 HTTP/1.1" 200 None
2026-03-30 10:55:53 [auto1.de] INFO: Scrape type for RM36813: 2
2026-03-30 10:55:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bebd2a49-8928-5f8e-889d-62b83589e327 with identifier: RM36813
2026-03-30 10:55:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bebd2a49-8928-5f8e-889d-62b83589e327 with scrape type 2
2026-03-30 10:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bebd2a49-8928-5f8e-889d-62b83589e327 with scrape type 2
2026-03-30 10:55:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bebd2a49-8928-5f8e-889d-62b83589e327, identifier: RM36813
2026-03-30 10:55:53 [auto1.de] INFO: Found listing with ID: VE81778
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE81778%27 HTTP/1.1" 200 None
2026-03-30 10:55:53 [auto1.de] INFO: Scrape type for VE81778: 2
2026-03-30 10:55:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d3de502-3aee-5fd3-9e96-2355f6652e70 with identifier: VE81778
2026-03-30 10:55:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d3de502-3aee-5fd3-9e96-2355f6652e70 with scrape type 2
2026-03-30 10:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d3de502-3aee-5fd3-9e96-2355f6652e70 with scrape type 2
2026-03-30 10:55:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d3de502-3aee-5fd3-9e96-2355f6652e70, identifier: VE81778
2026-03-30 10:55:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bebd2a49-8928-5f8e-889d-62b83589e327 with identifier: RM36813
2026-03-30 10:55:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bebd2a49-8928-5f8e-889d-62b83589e327 with identifier: RM36813
2026-03-30 10:55:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bebd2a49-8928-5f8e-889d-62b83589e327 with identifier: RM36813 to the API
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 435,
 'expiration_date': '2026-03-31T15:12:52Z',
 'fuel_type': 'diesel',
 'id': 'bebd2a49-8928-5f8e-889d-62b83589e327',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM36813',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ7',
 'odometer': 156477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-15',
 'seller_name': None,
 'title': 'Audi SQ7 4.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM36813%27 HTTP/1.1" 200 None
2026-03-30 10:55:53 [auto1.de] INFO: Saving data for RM36813: {'auction_closing_time': 1774969972.0, 'created_time': 1774348670.589747, 'last_price_update_time': 1774868153.841215}
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM36813') HTTP/1.1" 204 0
2026-03-30 10:55:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d3de502-3aee-5fd3-9e96-2355f6652e70 with identifier: VE81778
2026-03-30 10:55:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d3de502-3aee-5fd3-9e96-2355f6652e70 with identifier: VE81778
2026-03-30 10:55:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d3de502-3aee-5fd3-9e96-2355f6652e70 with identifier: VE81778 to the API
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:02:46Z',
 'fuel_type': 'diesel',
 'id': '1d3de502-3aee-5fd3-9e96-2355f6652e70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE81778',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 198826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-11-17',
 'seller_name': None,
 'title': 'Renault Trafic 2.5 dCi L1H1 2,7t verglast',
 'transmission': 'manual',
 'trim': 'L1H1 2,7t verglast',
 'year': 2003}
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE81778%27 HTTP/1.1" 200 None
2026-03-30 10:55:54 [auto1.de] INFO: Saving data for VE81778: {'auction_closing_time': 1774969366.0, 'created_time': 1774467397.225969, 'last_price_update_time': 1774868154.230957}
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE81778') HTTP/1.1" 204 0
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_1381da30f15d88bd87a194a53e3dfe73.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_1381da30f15d88bd87a194a53e3dfe73.jpg not downloaded yet
2026-03-30 10:55:54 [auto1.de] INFO: Found listing with ID: ND85219
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND85219%27 HTTP/1.1" 200 None
2026-03-30 10:55:54 [auto1.de] INFO: Scrape type for ND85219: 2
2026-03-30 10:55:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f72bd26-f6c3-588c-8f3b-73c3b96b99d2 with identifier: ND85219
2026-03-30 10:55:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f72bd26-f6c3-588c-8f3b-73c3b96b99d2 with scrape type 2
2026-03-30 10:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f72bd26-f6c3-588c-8f3b-73c3b96b99d2 with scrape type 2
2026-03-30 10:55:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f72bd26-f6c3-588c-8f3b-73c3b96b99d2, identifier: ND85219
2026-03-30 10:55:54 [auto1.de] INFO: Found listing with ID: HX51661
2026-03-30 10:55:54 [auto1.de] INFO: Found listing with ID: FK17584
2026-03-30 10:55:54 [auto1.de] INFO: Found listing with ID: ND90480
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND90480%27 HTTP/1.1" 200 None
2026-03-30 10:55:54 [auto1.de] INFO: Scrape type for ND90480: 2
2026-03-30 10:55:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb7c30a6-6e12-5e52-a886-43df343326bf with identifier: ND90480
2026-03-30 10:55:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb7c30a6-6e12-5e52-a886-43df343326bf with scrape type 2
2026-03-30 10:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb7c30a6-6e12-5e52-a886-43df343326bf with scrape type 2
2026-03-30 10:55:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb7c30a6-6e12-5e52-a886-43df343326bf, identifier: ND90480
2026-03-30 10:55:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f72bd26-f6c3-588c-8f3b-73c3b96b99d2 with identifier: ND85219
2026-03-30 10:55:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f72bd26-f6c3-588c-8f3b-73c3b96b99d2 with identifier: ND85219
2026-03-30 10:55:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f72bd26-f6c3-588c-8f3b-73c3b96b99d2 with identifier: ND85219 to the API
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:00:19Z',
 'fuel_type': 'diesel',
 'id': '2f72bd26-f6c3-588c-8f3b-73c3b96b99d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND85219',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 89609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-28',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Allure L2',
 'transmission': 'automatic',
 'trim': 'Allure L2',
 'year': 2018}
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND85219%27 HTTP/1.1" 200 None
2026-03-30 10:55:54 [auto1.de] INFO: Saving data for ND85219: {'auction_closing_time': 1774969219.0, 'created_time': 1774463709.332808, 'last_price_update_time': 1774868154.833019}
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND85219') HTTP/1.1" 204 0
2026-03-30 10:55:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb7c30a6-6e12-5e52-a886-43df343326bf with identifier: ND90480
2026-03-30 10:55:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb7c30a6-6e12-5e52-a886-43df343326bf with identifier: ND90480
2026-03-30 10:55:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb7c30a6-6e12-5e52-a886-43df343326bf with identifier: ND90480 to the API
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:08:56Z',
 'fuel_type': 'diesel',
 'id': 'cb7c30a6-6e12-5e52-a886-43df343326bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND90480',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 69105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-26',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Mild-Hybrid Select 2WD',
 'transmission': 'automatic',
 'trim': 'Select 2WD',
 'year': 2021}
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND90480%27 HTTP/1.1" 200 None
2026-03-30 10:55:55 [auto1.de] INFO: Saving data for ND90480: {'auction_closing_time': 1774969736.0, 'created_time': 1774416649.510945, 'last_price_update_time': 1774868155.194203}
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND90480') HTTP/1.1" 204 0
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_12f4a1451a468d8d714daf41dc4f10be.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_12f4a1451a468d8d714daf41dc4f10be.jpg not downloaded yet
2026-03-30 10:55:55 [auto1.de] INFO: Found listing with ID: AH35551
2026-03-30 10:55:55 [auto1.de] INFO: Found listing with ID: EM14245
2026-03-30 10:55:55 [auto1.de] INFO: Found listing with ID: PV86472
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV86472%27 HTTP/1.1" 200 None
2026-03-30 10:55:55 [auto1.de] INFO: Scrape type for PV86472: 2
2026-03-30 10:55:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7956529b-c27c-5921-8412-ce99524658f8 with identifier: PV86472
2026-03-30 10:55:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7956529b-c27c-5921-8412-ce99524658f8 with scrape type 2
2026-03-30 10:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7956529b-c27c-5921-8412-ce99524658f8 with scrape type 2
2026-03-30 10:55:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7956529b-c27c-5921-8412-ce99524658f8, identifier: PV86472
2026-03-30 10:55:55 [auto1.de] INFO: Found listing with ID: ZG41092
2026-03-30 10:55:55 [auto1.de] INFO: Found listing with ID: WP00727
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP00727%27 HTTP/1.1" 200 None
2026-03-30 10:55:55 [auto1.de] INFO: Scrape type for WP00727: 2
2026-03-30 10:55:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0750801-5c1b-5e6e-a232-8b74b43ca1ad with identifier: WP00727
2026-03-30 10:55:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0750801-5c1b-5e6e-a232-8b74b43ca1ad with scrape type 2
2026-03-30 10:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0750801-5c1b-5e6e-a232-8b74b43ca1ad with scrape type 2
2026-03-30 10:55:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0750801-5c1b-5e6e-a232-8b74b43ca1ad, identifier: WP00727
2026-03-30 10:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GU29210/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7956529b-c27c-5921-8412-ce99524658f8 with identifier: PV86472
2026-03-30 10:55:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7956529b-c27c-5921-8412-ce99524658f8 with identifier: PV86472
2026-03-30 10:55:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7956529b-c27c-5921-8412-ce99524658f8 with identifier: PV86472 to the API
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:36:49Z',
 'fuel_type': 'petrol',
 'id': '7956529b-c27c-5921-8412-ce99524658f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV86472',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 174959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-07-14',
 'seller_name': None,
 'title': 'Audi A4 1.8 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV86472%27 HTTP/1.1" 200 None
2026-03-30 10:55:55 [auto1.de] INFO: Saving data for PV86472: {'auction_closing_time': 1774971409.0, 'created_time': 1773687893.247975, 'last_price_update_time': 1774868155.831106}
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV86472') HTTP/1.1" 204 0
2026-03-30 10:55:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0750801-5c1b-5e6e-a232-8b74b43ca1ad with identifier: WP00727
2026-03-30 10:55:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0750801-5c1b-5e6e-a232-8b74b43ca1ad with identifier: WP00727
2026-03-30 10:55:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0750801-5c1b-5e6e-a232-8b74b43ca1ad with identifier: WP00727 to the API
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:06:26Z',
 'fuel_type': 'petrol',
 'id': 'c0750801-5c1b-5e6e-a232-8b74b43ca1ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP00727',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 68691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-06',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 170 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2006}
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP00727%27 HTTP/1.1" 200 None
2026-03-30 10:55:56 [auto1.de] INFO: Saving data for WP00727: {'auction_closing_time': 1774969586.0, 'created_time': 1774435232.021975, 'last_price_update_time': 1774868156.287689}
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP00727') HTTP/1.1" 204 0
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_42a117290aed78dba96bb1b41c796937.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_42a117290aed78dba96bb1b41c796937.jpg not downloaded yet
2026-03-30 10:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_856cfc2ce9457a4a8b49028156d6db4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:56 [auto1.de] INFO: Found listing with ID: VJ37696
2026-03-30 10:55:56 [auto1.de] INFO: Found listing with ID: VY63136
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY63136%27 HTTP/1.1" 200 None
2026-03-30 10:55:56 [auto1.de] INFO: Scrape type for VY63136: 2
2026-03-30 10:55:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23813948-c00f-5cd9-8948-fa31fb8fab91 with identifier: VY63136
2026-03-30 10:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23813948-c00f-5cd9-8948-fa31fb8fab91 with scrape type 2
2026-03-30 10:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23813948-c00f-5cd9-8948-fa31fb8fab91 with scrape type 2
2026-03-30 10:55:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23813948-c00f-5cd9-8948-fa31fb8fab91, identifier: VY63136
2026-03-30 10:55:56 [auto1.de] INFO: Found listing with ID: BZ91502
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ91502%27 HTTP/1.1" 200 None
2026-03-30 10:55:56 [auto1.de] INFO: Scrape type for BZ91502: 2
2026-03-30 10:55:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dfd6d77-6e42-514b-aa1d-d52ebc564fd6 with identifier: BZ91502
2026-03-30 10:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dfd6d77-6e42-514b-aa1d-d52ebc564fd6 with scrape type 2
2026-03-30 10:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dfd6d77-6e42-514b-aa1d-d52ebc564fd6 with scrape type 2
2026-03-30 10:55:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6dfd6d77-6e42-514b-aa1d-d52ebc564fd6, identifier: BZ91502
2026-03-30 10:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23813948-c00f-5cd9-8948-fa31fb8fab91 with identifier: VY63136
2026-03-30 10:55:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23813948-c00f-5cd9-8948-fa31fb8fab91 with identifier: VY63136
2026-03-30 10:55:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23813948-c00f-5cd9-8948-fa31fb8fab91 with identifier: VY63136 to the API
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:51:03Z',
 'fuel_type': 'petrol',
 'id': '23813948-c00f-5cd9-8948-fa31fb8fab91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY63136',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 51948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-24',
 'seller_name': None,
 'title': 'Cupra Formentor 1.5 TSI ACT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY63136%27 HTTP/1.1" 200 None
2026-03-30 10:55:56 [auto1.de] INFO: Saving data for VY63136: {'auction_closing_time': 1774972263.0, 'created_time': 1774379906.053024, 'last_price_update_time': 1774868156.898676}
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY63136') HTTP/1.1" 204 0
2026-03-30 10:55:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6dfd6d77-6e42-514b-aa1d-d52ebc564fd6 with identifier: BZ91502
2026-03-30 10:55:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6dfd6d77-6e42-514b-aa1d-d52ebc564fd6 with identifier: BZ91502
2026-03-30 10:55:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6dfd6d77-6e42-514b-aa1d-d52ebc564fd6 with identifier: BZ91502 to the API
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:37:44Z',
 'fuel_type': 'diesel',
 'id': '6dfd6d77-6e42-514b-aa1d-d52ebc564fd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ91502',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 95527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-28',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi 300 L1 Trend',
 'transmission': 'manual',
 'trim': '300 L1 Trend',
 'year': 2015}
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ91502%27 HTTP/1.1" 200 None
2026-03-30 10:55:57 [auto1.de] INFO: Saving data for BZ91502: {'auction_closing_time': 1774971464.0, 'created_time': 1774377794.26082, 'last_price_update_time': 1774868157.269846}
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ91502') HTTP/1.1" 204 0
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_9cb6cdfc03fd9efd4acc4f7e8164988c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_9cb6cdfc03fd9efd4acc4f7e8164988c.jpg not downloaded yet
2026-03-30 10:55:57 [auto1.de] INFO: Found listing with ID: GM66597
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM66597%27 HTTP/1.1" 200 None
2026-03-30 10:55:57 [auto1.de] INFO: Scrape type for GM66597: 2
2026-03-30 10:55:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b125a375-4290-54c0-95dd-c34e34d39b82 with identifier: GM66597
2026-03-30 10:55:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b125a375-4290-54c0-95dd-c34e34d39b82 with scrape type 2
2026-03-30 10:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b125a375-4290-54c0-95dd-c34e34d39b82 with scrape type 2
2026-03-30 10:55:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b125a375-4290-54c0-95dd-c34e34d39b82, identifier: GM66597
2026-03-30 10:55:57 [auto1.de] INFO: Found listing with ID: NC83571
2026-03-30 10:55:57 [auto1.de] INFO: Found listing with ID: XZ84287
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ84287%27 HTTP/1.1" 200 None
2026-03-30 10:55:57 [auto1.de] INFO: Scrape type for XZ84287: 2
2026-03-30 10:55:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8c1f222-9ede-5774-818e-2dac79926f3a with identifier: XZ84287
2026-03-30 10:55:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8c1f222-9ede-5774-818e-2dac79926f3a with scrape type 2
2026-03-30 10:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8c1f222-9ede-5774-818e-2dac79926f3a with scrape type 2
2026-03-30 10:55:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8c1f222-9ede-5774-818e-2dac79926f3a, identifier: XZ84287
2026-03-30 10:55:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b125a375-4290-54c0-95dd-c34e34d39b82 with identifier: GM66597
2026-03-30 10:55:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b125a375-4290-54c0-95dd-c34e34d39b82 with identifier: GM66597
2026-03-30 10:55:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b125a375-4290-54c0-95dd-c34e34d39b82 with identifier: GM66597 to the API
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:04:24Z',
 'fuel_type': 'diesel',
 'id': 'b125a375-4290-54c0-95dd-c34e34d39b82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM66597',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 173244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-01',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2011}
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM66597%27 HTTP/1.1" 200 None
2026-03-30 10:55:57 [auto1.de] INFO: Saving data for GM66597: {'auction_closing_time': 1774969464.0, 'created_time': 1773984683.460141, 'last_price_update_time': 1774868157.889822}
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM66597') HTTP/1.1" 204 0
2026-03-30 10:55:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8c1f222-9ede-5774-818e-2dac79926f3a with identifier: XZ84287
2026-03-30 10:55:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8c1f222-9ede-5774-818e-2dac79926f3a with identifier: XZ84287
2026-03-30 10:55:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8c1f222-9ede-5774-818e-2dac79926f3a with identifier: XZ84287 to the API
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:02:25Z',
 'fuel_type': 'petrol',
 'id': 'a8c1f222-9ede-5774-818e-2dac79926f3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ84287',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 137529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-30',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.4 Turbo Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2011}
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ84287%27 HTTP/1.1" 200 None
2026-03-30 10:55:58 [auto1.de] INFO: Saving data for XZ84287: {'auction_closing_time': 1774969345.0, 'created_time': 1773302267.687473, 'last_price_update_time': 1774868158.27559}
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ84287') HTTP/1.1" 204 0
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_0b56df8261ba6327cc1536476bbbcbba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_0b56df8261ba6327cc1536476bbbcbba.jpg not downloaded yet
2026-03-30 10:55:58 [auto1.de] INFO: Found listing with ID: UZ22488
2026-03-30 10:55:58 [auto1.de] INFO: Found listing with ID: PX60208
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX60208%27 HTTP/1.1" 200 None
2026-03-30 10:55:58 [auto1.de] INFO: Scrape type for PX60208: 2
2026-03-30 10:55:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e19c8b7c-5e6e-5cd2-af8a-33ee233078c0 with identifier: PX60208
2026-03-30 10:55:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e19c8b7c-5e6e-5cd2-af8a-33ee233078c0 with scrape type 2
2026-03-30 10:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e19c8b7c-5e6e-5cd2-af8a-33ee233078c0 with scrape type 2
2026-03-30 10:55:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e19c8b7c-5e6e-5cd2-af8a-33ee233078c0, identifier: PX60208
2026-03-30 10:55:58 [auto1.de] INFO: Found listing with ID: SM33942
2026-03-30 10:55:58 [auto1.de] INFO: Found listing with ID: YW60751
2026-03-30 10:55:58 [auto1.de] INFO: Found listing with ID: PC62388
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC62388%27 HTTP/1.1" 200 None
2026-03-30 10:55:58 [auto1.de] INFO: Scrape type for PC62388: 2
2026-03-30 10:55:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64ef8d2d-70e1-5f6b-b8e9-6765594a4cab with identifier: PC62388
2026-03-30 10:55:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64ef8d2d-70e1-5f6b-b8e9-6765594a4cab with scrape type 2
2026-03-30 10:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64ef8d2d-70e1-5f6b-b8e9-6765594a4cab with scrape type 2
2026-03-30 10:55:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64ef8d2d-70e1-5f6b-b8e9-6765594a4cab, identifier: PC62388
2026-03-30 10:55:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f43955d0>
2026-03-30 10:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_856cfc2ce9457a4a8b49028156d6db4e.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_856cfc2ce9457a4a8b49028156d6db4e.jpg saved to cache
2026-03-30 10:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c958bc95-5874-5814-bae6-988836f812e4
2026-03-30 10:55:58 [auto1.de] INFO: Channel: 24h | Page: 58 | totalHits: 9529 | hits on page: 40
2026-03-30 10:55:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e19c8b7c-5e6e-5cd2-af8a-33ee233078c0 with identifier: PX60208
2026-03-30 10:55:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e19c8b7c-5e6e-5cd2-af8a-33ee233078c0 with identifier: PX60208
2026-03-30 10:55:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e19c8b7c-5e6e-5cd2-af8a-33ee233078c0 with identifier: PX60208 to the API
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:22:44Z',
 'fuel_type': 'diesel',
 'id': 'e19c8b7c-5e6e-5cd2-af8a-33ee233078c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX60208',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 291183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-30',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX60208%27 HTTP/1.1" 200 None
2026-03-30 10:55:59 [auto1.de] INFO: Saving data for PX60208: {'auction_closing_time': 1774970564.0, 'created_time': 1774292569.7423, 'last_price_update_time': 1774868159.07131}
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX60208') HTTP/1.1" 204 0
2026-03-30 10:55:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64ef8d2d-70e1-5f6b-b8e9-6765594a4cab with identifier: PC62388
2026-03-30 10:55:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64ef8d2d-70e1-5f6b-b8e9-6765594a4cab with identifier: PC62388
2026-03-30 10:55:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64ef8d2d-70e1-5f6b-b8e9-6765594a4cab with identifier: PC62388 to the API
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:45:28Z',
 'fuel_type': 'petrol',
 'id': '64ef8d2d-70e1-5f6b-b8e9-6765594a4cab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC62388',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 197449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-19',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Elegance',
 'year': 2010}
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC62388%27 HTTP/1.1" 200 None
2026-03-30 10:55:59 [auto1.de] INFO: Saving data for PC62388: {'auction_closing_time': 1774971928.0, 'created_time': 1773688891.405326, 'last_price_update_time': 1774868159.517894}
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC62388') HTTP/1.1" 204 0
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_753507badf0448e114fe4515597c8c4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_753507badf0448e114fe4515597c8c4a.jpg not downloaded yet
2026-03-30 10:55:59 [auto1.de] INFO: Found listing with ID: ZL97952
2026-03-30 10:55:59 [auto1.de] INFO: Found listing with ID: YR16927
2026-03-30 10:55:59 [auto1.de] INFO: Found listing with ID: NY36854
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY36854%27 HTTP/1.1" 200 None
2026-03-30 10:55:59 [auto1.de] INFO: Scrape type for NY36854: 2
2026-03-30 10:55:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b603ced0-850d-59e0-be4f-220759549b8e with identifier: NY36854
2026-03-30 10:55:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b603ced0-850d-59e0-be4f-220759549b8e with scrape type 2
2026-03-30 10:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b603ced0-850d-59e0-be4f-220759549b8e with scrape type 2
2026-03-30 10:55:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b603ced0-850d-59e0-be4f-220759549b8e, identifier: NY36854
2026-03-30 10:55:59 [auto1.de] INFO: Found listing with ID: GM71398
2026-03-30 10:55:59 [auto1.de] INFO: Found listing with ID: ML46855
2026-03-30 10:55:59 [auto1.de] INFO: Found listing with ID: YC00634
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00634%27 HTTP/1.1" 200 None
2026-03-30 10:55:59 [auto1.de] INFO: Scrape type for YC00634: 2
2026-03-30 10:55:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6ae06aa-42ec-51d3-8600-c3055236d282 with identifier: YC00634
2026-03-30 10:55:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6ae06aa-42ec-51d3-8600-c3055236d282 with scrape type 2
2026-03-30 10:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6ae06aa-42ec-51d3-8600-c3055236d282 with scrape type 2
2026-03-30 10:55:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6ae06aa-42ec-51d3-8600-c3055236d282, identifier: YC00634
2026-03-30 10:55:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b603ced0-850d-59e0-be4f-220759549b8e with identifier: NY36854
2026-03-30 10:55:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b603ced0-850d-59e0-be4f-220759549b8e with identifier: NY36854
2026-03-30 10:55:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b603ced0-850d-59e0-be4f-220759549b8e with identifier: NY36854 to the API
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:19:25Z',
 'fuel_type': 'diesel',
 'id': 'b603ced0-850d-59e0-be4f-220759549b8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY36854',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 278371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-02',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2010}
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY36854%27 HTTP/1.1" 200 None
2026-03-30 10:56:00 [auto1.de] INFO: Saving data for NY36854: {'auction_closing_time': 1774970365.0, 'created_time': 1773304060.67535, 'last_price_update_time': 1774868160.293762}
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY36854') HTTP/1.1" 204 0
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_7faee754e26f4c22bc311556b5b68a8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_7faee754e26f4c22bc311556b5b68a8e.jpg not downloaded yet
2026-03-30 10:56:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6ae06aa-42ec-51d3-8600-c3055236d282 with identifier: YC00634
2026-03-30 10:56:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6ae06aa-42ec-51d3-8600-c3055236d282 with identifier: YC00634
2026-03-30 10:56:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6ae06aa-42ec-51d3-8600-c3055236d282 with identifier: YC00634 to the API
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-31T15:56:34Z',
 'fuel_type': 'diesel',
 'id': 'c6ae06aa-42ec-51d3-8600-c3055236d282',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC00634',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 160994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-14',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Sports-Line',
 'transmission': 'automatic',
 'trim': 'Sports-Line',
 'year': 2014}
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00634%27 HTTP/1.1" 200 None
2026-03-30 10:56:00 [auto1.de] INFO: Saving data for YC00634: {'auction_closing_time': 1774972594.0, 'created_time': 1773741503.762713, 'last_price_update_time': 1774868160.656605}
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC00634') HTTP/1.1" 204 0
2026-03-30 10:56:00 [auto1.de] INFO: Found listing with ID: XT70791
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT70791%27 HTTP/1.1" 200 None
2026-03-30 10:56:00 [auto1.de] INFO: Scrape type for XT70791: 2
2026-03-30 10:56:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58c05eaa-42e9-518b-9d25-db2791ac9396 with identifier: XT70791
2026-03-30 10:56:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58c05eaa-42e9-518b-9d25-db2791ac9396 with scrape type 2
2026-03-30 10:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58c05eaa-42e9-518b-9d25-db2791ac9396 with scrape type 2
2026-03-30 10:56:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58c05eaa-42e9-518b-9d25-db2791ac9396, identifier: XT70791
2026-03-30 10:56:00 [auto1.de] INFO: Found listing with ID: JD44610
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD44610%27 HTTP/1.1" 200 None
2026-03-30 10:56:00 [auto1.de] INFO: Scrape type for JD44610: 2
2026-03-30 10:56:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 598e8ac1-c609-5f51-b183-68e7f793fa58 with identifier: JD44610
2026-03-30 10:56:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 598e8ac1-c609-5f51-b183-68e7f793fa58 with scrape type 2
2026-03-30 10:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 598e8ac1-c609-5f51-b183-68e7f793fa58 with scrape type 2
2026-03-30 10:56:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 598e8ac1-c609-5f51-b183-68e7f793fa58, identifier: JD44610
2026-03-30 10:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FC64824> (referer: https://www.auto1.com/v1/car-details-view/FC64824/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58c05eaa-42e9-518b-9d25-db2791ac9396 with identifier: XT70791
2026-03-30 10:56:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58c05eaa-42e9-518b-9d25-db2791ac9396 with identifier: XT70791
2026-03-30 10:56:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58c05eaa-42e9-518b-9d25-db2791ac9396 with identifier: XT70791 to the API
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:56:48Z',
 'fuel_type': 'petrol',
 'id': '58c05eaa-42e9-518b-9d25-db2791ac9396',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT70791',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 80200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-06',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT70791%27 HTTP/1.1" 200 None
2026-03-30 10:56:01 [auto1.de] INFO: Saving data for XT70791: {'auction_closing_time': 1774972608.0, 'created_time': 1773303421.244047, 'last_price_update_time': 1774868161.304588}
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT70791') HTTP/1.1" 204 0
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_51fc831de9bf8b81a92e5a2fceb0213d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_51fc831de9bf8b81a92e5a2fceb0213d.jpg not downloaded yet
2026-03-30 10:56:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 598e8ac1-c609-5f51-b183-68e7f793fa58 with identifier: JD44610
2026-03-30 10:56:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 598e8ac1-c609-5f51-b183-68e7f793fa58 with identifier: JD44610
2026-03-30 10:56:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 598e8ac1-c609-5f51-b183-68e7f793fa58 with identifier: JD44610 to the API
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:44:28Z',
 'fuel_type': 'diesel',
 'id': '598e8ac1-c609-5f51-b183-68e7f793fa58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD44610',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 108635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.7 dCi N-Connecta 4x4',
 'transmission': 'automatic',
 'trim': 'N-Connecta 4x4',
 'year': 2020}
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD44610%27 HTTP/1.1" 200 None
2026-03-30 10:56:01 [auto1.de] INFO: Saving data for JD44610: {'auction_closing_time': 1774971868.0, 'created_time': 1773340590.821809, 'last_price_update_time': 1774868161.657405}
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD44610') HTTP/1.1" 204 0
2026-03-30 10:56:01 [auto1.de] INFO: Found listing with ID: KW33977
2026-03-30 10:56:01 [auto1.de] INFO: Found listing with ID: TR81994
2026-03-30 10:56:01 [auto1.de] INFO: Found listing with ID: EE94897
2026-03-30 10:56:01 [auto1.de] INFO: Found listing with ID: LN73232
2026-03-30 10:56:01 [auto1.de] INFO: Found listing with ID: AY88007
2026-03-30 10:56:01 [auto1.de] INFO: Found listing with ID: CY03369
2026-03-30 10:56:01 [auto1.de] INFO: Found listing with ID: CM48950
2026-03-30 10:56:01 [auto1.de] INFO: Found listing with ID: GG80957
2026-03-30 10:56:01 [auto1.de] INFO: Found listing with ID: UX22346
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX22346%27 HTTP/1.1" 200 None
2026-03-30 10:56:01 [auto1.de] INFO: Scrape type for UX22346: 2
2026-03-30 10:56:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fea2dbfe-56b2-521f-a763-1a623a98fda2 with identifier: UX22346
2026-03-30 10:56:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fea2dbfe-56b2-521f-a763-1a623a98fda2 with scrape type 2
2026-03-30 10:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fea2dbfe-56b2-521f-a763-1a623a98fda2 with scrape type 2
2026-03-30 10:56:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fea2dbfe-56b2-521f-a763-1a623a98fda2, identifier: UX22346
2026-03-30 10:56:01 [auto1.de] INFO: Found listing with ID: WC68946
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC68946%27 HTTP/1.1" 200 None
2026-03-30 10:56:01 [auto1.de] INFO: Scrape type for WC68946: 2
2026-03-30 10:56:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49c6bfd1-295c-5de2-8590-66c75c42836d with identifier: WC68946
2026-03-30 10:56:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49c6bfd1-295c-5de2-8590-66c75c42836d with scrape type 2
2026-03-30 10:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49c6bfd1-295c-5de2-8590-66c75c42836d with scrape type 2
2026-03-30 10:56:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49c6bfd1-295c-5de2-8590-66c75c42836d, identifier: WC68946
2026-03-30 10:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL96741> (referer: https://www.auto1.com/v1/car-details-view/FL96741/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR94789> (referer: https://www.auto1.com/v1/car-details-view/YR94789/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fea2dbfe-56b2-521f-a763-1a623a98fda2 with identifier: UX22346
2026-03-30 10:56:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fea2dbfe-56b2-521f-a763-1a623a98fda2 with identifier: UX22346
2026-03-30 10:56:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fea2dbfe-56b2-521f-a763-1a623a98fda2 with identifier: UX22346 to the API
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:26:11Z',
 'fuel_type': 'petrol',
 'id': 'fea2dbfe-56b2-521f-a763-1a623a98fda2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX22346',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 122046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-17',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TSI FR-Line',
 'transmission': 'automatic',
 'trim': 'FR-Line',
 'year': 2017}
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX22346%27 HTTP/1.1" 200 None
2026-03-30 10:56:02 [auto1.de] INFO: Saving data for UX22346: {'auction_closing_time': 1774970771.0, 'created_time': 1773223521.278482, 'last_price_update_time': 1774868162.261291}
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX22346') HTTP/1.1" 204 0
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_02d458d453607f0eeac0e740ed6f8643.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_02d458d453607f0eeac0e740ed6f8643.jpg not downloaded yet
2026-03-30 10:56:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49c6bfd1-295c-5de2-8590-66c75c42836d with identifier: WC68946
2026-03-30 10:56:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49c6bfd1-295c-5de2-8590-66c75c42836d with identifier: WC68946
2026-03-30 10:56:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49c6bfd1-295c-5de2-8590-66c75c42836d with identifier: WC68946 to the API
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:06:17Z',
 'fuel_type': 'diesel',
 'id': '49c6bfd1-295c-5de2-8590-66c75c42836d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC68946',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 271432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-14',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d kompakt BlueTEC Avantgarde Edition',
 'transmission': 'automatic',
 'trim': 'kompakt BlueTEC Avantgarde Edition',
 'year': 2015}
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC68946%27 HTTP/1.1" 200 None
2026-03-30 10:56:02 [auto1.de] INFO: Saving data for WC68946: {'auction_closing_time': 1774969577.0, 'created_time': 1774117872.359449, 'last_price_update_time': 1774868162.693128}
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC68946') HTTP/1.1" 204 0
2026-03-30 10:56:02 [auto1.de] INFO: Found listing with ID: GB09367
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB09367%27 HTTP/1.1" 200 None
2026-03-30 10:56:02 [auto1.de] INFO: Scrape type for GB09367: 2
2026-03-30 10:56:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3be65556-cd53-54c7-856b-571da8160014 with identifier: GB09367
2026-03-30 10:56:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3be65556-cd53-54c7-856b-571da8160014 with scrape type 2
2026-03-30 10:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3be65556-cd53-54c7-856b-571da8160014 with scrape type 2
2026-03-30 10:56:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3be65556-cd53-54c7-856b-571da8160014, identifier: GB09367
2026-03-30 10:56:02 [auto1.de] INFO: Found listing with ID: CM75281
2026-03-30 10:56:02 [auto1.de] INFO: Found listing with ID: UN10442
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN10442%27 HTTP/1.1" 200 None
2026-03-30 10:56:02 [auto1.de] INFO: Scrape type for UN10442: 2
2026-03-30 10:56:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f69f424d-a598-580d-ba3d-46c00af4afd7 with identifier: UN10442
2026-03-30 10:56:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f69f424d-a598-580d-ba3d-46c00af4afd7 with scrape type 2
2026-03-30 10:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f69f424d-a598-580d-ba3d-46c00af4afd7 with scrape type 2
2026-03-30 10:56:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f69f424d-a598-580d-ba3d-46c00af4afd7, identifier: UN10442
2026-03-30 10:56:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 487bff8d-754d-57dd-b599-1467472a76a7 with identifier: FC64824
2026-03-30 10:56:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 487bff8d-754d-57dd-b599-1467472a76a7 with scrape type 1
2026-03-30 10:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 487bff8d-754d-57dd-b599-1467472a76a7
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fed%252F3aed35a7ff0b9437838f89eb3936df5a%252Fpa%252FFC64824_0a4434b0a87659d7f76bbe258b16d932.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_0a4434b0a87659d7f76bbe258b16d932.jpg already downloaded
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fed%252F3aed35a7ff0b9437838f89eb3936df5a%252Fpa%252FFC64824_10a62af18e2987a3ad158cede8897f24.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_10a62af18e2987a3ad158cede8897f24.jpg already downloaded
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fed%252F3aed35a7ff0b9437838f89eb3936df5a%252Fpa%252FFC64824_7790dfb97cb282c470b5a56e5c7882a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_7790dfb97cb282c470b5a56e5c7882a2.jpg already downloaded
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fed%252F3aed35a7ff0b9437838f89eb3936df5a%252Fpa%252FFC64824_4f4cb5ae387a84a9fc00ab9a2710ea2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_4f4cb5ae387a84a9fc00ab9a2710ea2f.jpg already downloaded
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fed%252F3aed35a7ff0b9437838f89eb3936df5a%252Fpa%252FFC64824_c9833ec785b1bdf516a1ff2855e20ac1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_c9833ec785b1bdf516a1ff2855e20ac1.jpg already downloaded
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fed%252F3aed35a7ff0b9437838f89eb3936df5a%252Fpa%252FFC64824_dfb50d0bda09a7016715e58a71e87de8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_dfb50d0bda09a7016715e58a71e87de8.jpg already downloaded
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fed%252F3aed35a7ff0b9437838f89eb3936df5a%252Fpa%252FFC64824_96a1508525d6092ce4b498ca2c29dd96.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_96a1508525d6092ce4b498ca2c29dd96.jpg already downloaded
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fed%252F3aed35a7ff0b9437838f89eb3936df5a%252Fpa%252FFC64824_2d5a474ce825522b2be4b419e9460709.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_2d5a474ce825522b2be4b419e9460709.jpg already downloaded
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fed%252F3aed35a7ff0b9437838f89eb3936df5a%252Fpa%252FFC64824_0e92ec5e8e76307a12af48d54af7c7ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_0e92ec5e8e76307a12af48d54af7c7ea.jpg already downloaded
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fed%252F3aed35a7ff0b9437838f89eb3936df5a%252Fpa%252FFC64824_bc7a011293104c008abdd26a53e5b8e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_bc7a011293104c008abdd26a53e5b8e3.jpg already downloaded
2026-03-30 10:56:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 487bff8d-754d-57dd-b599-1467472a76a7, identifier: FC64824
2026-03-30 10:56:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3be65556-cd53-54c7-856b-571da8160014 with identifier: GB09367
2026-03-30 10:56:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3be65556-cd53-54c7-856b-571da8160014 with identifier: GB09367
2026-03-30 10:56:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3be65556-cd53-54c7-856b-571da8160014 with identifier: GB09367 to the API
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-31T15:02:01Z',
 'fuel_type': 'diesel',
 'id': '3be65556-cd53-54c7-856b-571da8160014',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB09367',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 113237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-05',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Sports-Line AWD',
 'transmission': 'automatic',
 'trim': 'Sports-Line AWD',
 'year': 2016}
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB09367%27 HTTP/1.1" 200 None
2026-03-30 10:56:03 [auto1.de] INFO: Saving data for GB09367: {'auction_closing_time': 1774969321.0, 'created_time': 1774468183.900149, 'last_price_update_time': 1774868163.572929}
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB09367') HTTP/1.1" 204 0
2026-03-30 10:56:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f69f424d-a598-580d-ba3d-46c00af4afd7 with identifier: UN10442
2026-03-30 10:56:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f69f424d-a598-580d-ba3d-46c00af4afd7 with identifier: UN10442
2026-03-30 10:56:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f69f424d-a598-580d-ba3d-46c00af4afd7 with identifier: UN10442 to the API
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:29:55Z',
 'fuel_type': 'petrol',
 'id': 'f69f424d-a598-580d-ba3d-46c00af4afd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN10442',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 119632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-16',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2019}
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN10442%27 HTTP/1.1" 200 None
2026-03-30 10:56:03 [auto1.de] INFO: Saving data for UN10442: {'auction_closing_time': 1774970995.0, 'created_time': 1774262290.015779, 'last_price_update_time': 1774868163.923031}
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN10442') HTTP/1.1" 204 0
2026-03-30 10:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP07187> (referer: https://www.auto1.com/v1/car-details-view/WP07187/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 487bff8d-754d-57dd-b599-1467472a76a7 with identifier: FC64824
2026-03-30 10:56:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 487bff8d-754d-57dd-b599-1467472a76a7 with identifier: FC64824
2026-03-30 10:56:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 487bff8d-754d-57dd-b599-1467472a76a7 with identifier: FC64824 to the API
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FC64824>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:43:22Z',
 'fuel_type': 'petrol',
 'id': '487bff8d-754d-57dd-b599-1467472a76a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC64824',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 135948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_0a4434b0a87659d7f76bbe258b16d932.jpg',
                'https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_10a62af18e2987a3ad158cede8897f24.jpg',
                'https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_7790dfb97cb282c470b5a56e5c7882a2.jpg',
                'https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_4f4cb5ae387a84a9fc00ab9a2710ea2f.jpg',
                'https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_c9833ec785b1bdf516a1ff2855e20ac1.jpg',
                'https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_dfb50d0bda09a7016715e58a71e87de8.jpg',
                'https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_96a1508525d6092ce4b498ca2c29dd96.jpg',
                'https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_2d5a474ce825522b2be4b419e9460709.jpg',
                'https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_0e92ec5e8e76307a12af48d54af7c7ea.jpg',
                'https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_bc7a011293104c008abdd26a53e5b8e3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_487bff8d-754d-57dd-b599-1467472a76a7/487bff8d-754d-57dd-b599-1467472a76a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_0a4434b0a87659d7f76bbe258b16d932.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_487bff8d-754d-57dd-b599-1467472a76a7/487bff8d-754d-57dd-b599-1467472a76a7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_10a62af18e2987a3ad158cede8897f24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_487bff8d-754d-57dd-b599-1467472a76a7/487bff8d-754d-57dd-b599-1467472a76a7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_7790dfb97cb282c470b5a56e5c7882a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_487bff8d-754d-57dd-b599-1467472a76a7/487bff8d-754d-57dd-b599-1467472a76a7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_4f4cb5ae387a84a9fc00ab9a2710ea2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_487bff8d-754d-57dd-b599-1467472a76a7/487bff8d-754d-57dd-b599-1467472a76a7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_c9833ec785b1bdf516a1ff2855e20ac1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_487bff8d-754d-57dd-b599-1467472a76a7/487bff8d-754d-57dd-b599-1467472a76a7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_dfb50d0bda09a7016715e58a71e87de8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_487bff8d-754d-57dd-b599-1467472a76a7/487bff8d-754d-57dd-b599-1467472a76a7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_96a1508525d6092ce4b498ca2c29dd96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_487bff8d-754d-57dd-b599-1467472a76a7/487bff8d-754d-57dd-b599-1467472a76a7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_2d5a474ce825522b2be4b419e9460709.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_487bff8d-754d-57dd-b599-1467472a76a7/487bff8d-754d-57dd-b599-1467472a76a7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_0e92ec5e8e76307a12af48d54af7c7ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_487bff8d-754d-57dd-b599-1467472a76a7/487bff8d-754d-57dd-b599-1467472a76a7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ed/3aed35a7ff0b9437838f89eb3936df5a/pa/FC64824_bc7a011293104c008abdd26a53e5b8e3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A5 Sportback 40 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC64824%27 HTTP/1.1" 200 None
2026-03-30 10:56:04 [auto1.de] INFO: Saving data for FC64824: {'created_time': 1774868164.272914, 'last_price_update_time': 1774868164.272925, 'auction_closing_time': 1774971802.0}
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC64824') HTTP/1.1" 204 0
2026-03-30 10:56:04 [auto1.de] INFO: Found listing with ID: EG89523
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG89523%27 HTTP/1.1" 200 None
2026-03-30 10:56:04 [auto1.de] INFO: Scrape type for EG89523: 2
2026-03-30 10:56:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f1511bc-6e5c-5ff6-b4f9-1d92da55b379 with identifier: EG89523
2026-03-30 10:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f1511bc-6e5c-5ff6-b4f9-1d92da55b379 with scrape type 2
2026-03-30 10:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f1511bc-6e5c-5ff6-b4f9-1d92da55b379 with scrape type 2
2026-03-30 10:56:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f1511bc-6e5c-5ff6-b4f9-1d92da55b379, identifier: EG89523
2026-03-30 10:56:04 [auto1.de] INFO: Found listing with ID: BS87926
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS87926%27 HTTP/1.1" 200 None
2026-03-30 10:56:04 [auto1.de] INFO: Scrape type for BS87926: 1
2026-03-30 10:56:04 [scrapy.extensions.logstats] INFO: Crawled 799 pages (at 14 pages/min), scraped 1067 items (at 102 items/min)
2026-03-30 10:56:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:56:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f1511bc-6e5c-5ff6-b4f9-1d92da55b379 with identifier: EG89523
2026-03-30 10:56:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f1511bc-6e5c-5ff6-b4f9-1d92da55b379 with identifier: EG89523
2026-03-30 10:56:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f1511bc-6e5c-5ff6-b4f9-1d92da55b379 with identifier: EG89523 to the API
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:26:06Z',
 'fuel_type': 'petrol',
 'id': '9f1511bc-6e5c-5ff6-b4f9-1d92da55b379',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG89523',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 26251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-20',
 'seller_name': None,
 'title': 'Audi A1 1.4 TFSI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2011}
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG89523%27 HTTP/1.1" 200 None
2026-03-30 10:56:04 [auto1.de] INFO: Saving data for EG89523: {'auction_closing_time': 1774970766.0, 'created_time': 1774377089.526878, 'last_price_update_time': 1774868164.720426}
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG89523') HTTP/1.1" 204 0
2026-03-30 10:56:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46856877-b8d0-5527-8585-25e182d2ac9c with identifier: FL96741
2026-03-30 10:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46856877-b8d0-5527-8585-25e182d2ac9c with scrape type 1
2026-03-30 10:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46856877-b8d0-5527-8585-25e182d2ac9c
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_fc9e2884144046a7279bd78fce651a95.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_fc9e2884144046a7279bd78fce651a95.jpg not downloaded yet
2026-03-30 10:56:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c83b191b-b4e4-5ae7-ad70-0fee672d34dd with identifier: YR94789
2026-03-30 10:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c83b191b-b4e4-5ae7-ad70-0fee672d34dd with scrape type 1
2026-03-30 10:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c83b191b-b4e4-5ae7-ad70-0fee672d34dd
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_f3d8446796dfff9a4a7c4642cebf9619.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_f3d8446796dfff9a4a7c4642cebf9619.jpg not downloaded yet
2026-03-30 10:56:04 [auto1.de] INFO: Found listing with ID: PE93085
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE93085%27 HTTP/1.1" 200 None
2026-03-30 10:56:04 [auto1.de] INFO: Scrape type for PE93085: 2
2026-03-30 10:56:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a069a5c-c7df-5dba-a11e-c56adc0613f0 with identifier: PE93085
2026-03-30 10:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a069a5c-c7df-5dba-a11e-c56adc0613f0 with scrape type 2
2026-03-30 10:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a069a5c-c7df-5dba-a11e-c56adc0613f0 with scrape type 2
2026-03-30 10:56:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a069a5c-c7df-5dba-a11e-c56adc0613f0, identifier: PE93085
2026-03-30 10:56:04 [auto1.de] INFO: Found listing with ID: RY52055
2026-03-30 10:56:04 [auto1.de] INFO: Found listing with ID: NE14712
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE14712%27 HTTP/1.1" 200 None
2026-03-30 10:56:04 [auto1.de] INFO: Scrape type for NE14712: 2
2026-03-30 10:56:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25da080e-0dab-53ea-982a-f7e0a44388ff with identifier: NE14712
2026-03-30 10:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25da080e-0dab-53ea-982a-f7e0a44388ff with scrape type 2
2026-03-30 10:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25da080e-0dab-53ea-982a-f7e0a44388ff with scrape type 2
2026-03-30 10:56:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25da080e-0dab-53ea-982a-f7e0a44388ff, identifier: NE14712
2026-03-30 10:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GU29210> (referer: https://www.auto1.com/v1/car-details-view/GU29210/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a069a5c-c7df-5dba-a11e-c56adc0613f0 with identifier: PE93085
2026-03-30 10:56:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a069a5c-c7df-5dba-a11e-c56adc0613f0 with identifier: PE93085
2026-03-30 10:56:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a069a5c-c7df-5dba-a11e-c56adc0613f0 with identifier: PE93085 to the API
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:23:36Z',
 'fuel_type': 'petrol',
 'id': '1a069a5c-c7df-5dba-a11e-c56adc0613f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE93085',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 138436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2011}
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE93085%27 HTTP/1.1" 200 None
2026-03-30 10:56:05 [auto1.de] INFO: Saving data for PE93085: {'auction_closing_time': 1774970616.0, 'created_time': 1773945791.888326, 'last_price_update_time': 1774868165.429566}
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE93085') HTTP/1.1" 204 0
2026-03-30 10:56:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25da080e-0dab-53ea-982a-f7e0a44388ff with identifier: NE14712
2026-03-30 10:56:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25da080e-0dab-53ea-982a-f7e0a44388ff with identifier: NE14712
2026-03-30 10:56:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25da080e-0dab-53ea-982a-f7e0a44388ff with identifier: NE14712 to the API
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:47:49Z',
 'fuel_type': 'petrol',
 'id': '25da080e-0dab-53ea-982a-f7e0a44388ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE14712',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 135203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-07',
 'seller_name': None,
 'title': 'Volvo S60 2.0 T5 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2016}
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE14712%27 HTTP/1.1" 200 None
2026-03-30 10:56:05 [auto1.de] INFO: Saving data for NE14712: {'auction_closing_time': 1774972069.0, 'created_time': 1773662046.295508, 'last_price_update_time': 1774868165.778734}
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE14712') HTTP/1.1" 204 0
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_7e1bb9d5f0d6cb27662527c2b9638f9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_7e1bb9d5f0d6cb27662527c2b9638f9e.jpg not downloaded yet
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_56a0d150f0bf9c9e87c0073bff35d58d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_56a0d150f0bf9c9e87c0073bff35d58d.jpg not downloaded yet
2026-03-30 10:56:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36a570be-00bb-5ef8-bd79-d967d1366cb8 with identifier: WP07187
2026-03-30 10:56:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36a570be-00bb-5ef8-bd79-d967d1366cb8 with scrape type 1
2026-03-30 10:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36a570be-00bb-5ef8-bd79-d967d1366cb8
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3b%252Fbb3bab8c72bbd21eae19faa1b61224c6%252Fpa%252FWP07187_bdfe2d4d9475e596f1edeb9f16741497.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_bdfe2d4d9475e596f1edeb9f16741497.jpg already downloaded
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3b%252Fbb3bab8c72bbd21eae19faa1b61224c6%252Fpa%252FWP07187_91ab3afac55721ffef33580998f63268.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_91ab3afac55721ffef33580998f63268.jpg already downloaded
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3b%252Fbb3bab8c72bbd21eae19faa1b61224c6%252Fpa%252FWP07187_7a3e8205741bdbcb6c4a5fe0b209a6a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_7a3e8205741bdbcb6c4a5fe0b209a6a7.jpg already downloaded
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3b%252Fbb3bab8c72bbd21eae19faa1b61224c6%252Fpa%252FWP07187_bc1ee0d739c7f592c2f53569ee8492c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_bc1ee0d739c7f592c2f53569ee8492c2.jpg already downloaded
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3b%252Fbb3bab8c72bbd21eae19faa1b61224c6%252Fpa%252FWP07187_df7eb78a7eb01e94484676ca5fa0d464.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_df7eb78a7eb01e94484676ca5fa0d464.jpg already downloaded
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3b%252Fbb3bab8c72bbd21eae19faa1b61224c6%252Fpa%252FWP07187_e220a7f18173adc0c666cf0911c07c60.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_e220a7f18173adc0c666cf0911c07c60.jpg already downloaded
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3b%252Fbb3bab8c72bbd21eae19faa1b61224c6%252Fpa%252FWP07187_c8cb7abbb71d7742fe40d133058c7ceb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_c8cb7abbb71d7742fe40d133058c7ceb.jpg already downloaded
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3b%252Fbb3bab8c72bbd21eae19faa1b61224c6%252Fpa%252FWP07187_69a1fba53dfe06d43cdc4aee335063d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_69a1fba53dfe06d43cdc4aee335063d8.jpg already downloaded
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3b%252Fbb3bab8c72bbd21eae19faa1b61224c6%252Fpa%252FWP07187_0cb832c9d46435f98aa6204ee110003a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_0cb832c9d46435f98aa6204ee110003a.jpg already downloaded
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3b%252Fbb3bab8c72bbd21eae19faa1b61224c6%252Fpa%252FWP07187_6820620c865f9573a1c403efc70bd0af.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_6820620c865f9573a1c403efc70bd0af.jpg already downloaded
2026-03-30 10:56:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36a570be-00bb-5ef8-bd79-d967d1366cb8, identifier: WP07187
2026-03-30 10:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_51fc831de9bf8b81a92e5a2fceb0213d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:06 [auto1.de] INFO: Found listing with ID: WM94615
2026-03-30 10:56:06 [auto1.de] INFO: Found listing with ID: KV84716
2026-03-30 10:56:06 [auto1.de] INFO: Found listing with ID: BS29922
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS29922%27 HTTP/1.1" 200 None
2026-03-30 10:56:06 [auto1.de] INFO: Scrape type for BS29922: 2
2026-03-30 10:56:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af411224-d51a-5786-98d9-d8b9e10679ec with identifier: BS29922
2026-03-30 10:56:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af411224-d51a-5786-98d9-d8b9e10679ec with scrape type 2
2026-03-30 10:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af411224-d51a-5786-98d9-d8b9e10679ec with scrape type 2
2026-03-30 10:56:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af411224-d51a-5786-98d9-d8b9e10679ec, identifier: BS29922
2026-03-30 10:56:06 [auto1.de] INFO: Found listing with ID: CE86831
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE86831%27 HTTP/1.1" 200 None
2026-03-30 10:56:06 [auto1.de] INFO: Scrape type for CE86831: 2
2026-03-30 10:56:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f57eb112-58cf-5b2c-9d7d-e27e42707263 with identifier: CE86831
2026-03-30 10:56:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f57eb112-58cf-5b2c-9d7d-e27e42707263 with scrape type 2
2026-03-30 10:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f57eb112-58cf-5b2c-9d7d-e27e42707263 with scrape type 2
2026-03-30 10:56:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f57eb112-58cf-5b2c-9d7d-e27e42707263, identifier: CE86831
2026-03-30 10:56:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36a570be-00bb-5ef8-bd79-d967d1366cb8 with identifier: WP07187
2026-03-30 10:56:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36a570be-00bb-5ef8-bd79-d967d1366cb8 with identifier: WP07187
2026-03-30 10:56:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36a570be-00bb-5ef8-bd79-d967d1366cb8 with identifier: WP07187 to the API
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WP07187>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:31:48Z',
 'fuel_type': 'diesel',
 'id': '36a570be-00bb-5ef8-bd79-d967d1366cb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP07187',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 114873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_bdfe2d4d9475e596f1edeb9f16741497.jpg',
                'https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_91ab3afac55721ffef33580998f63268.jpg',
                'https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_7a3e8205741bdbcb6c4a5fe0b209a6a7.jpg',
                'https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_bc1ee0d739c7f592c2f53569ee8492c2.jpg',
                'https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_df7eb78a7eb01e94484676ca5fa0d464.jpg',
                'https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_e220a7f18173adc0c666cf0911c07c60.jpg',
                'https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_c8cb7abbb71d7742fe40d133058c7ceb.jpg',
                'https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_69a1fba53dfe06d43cdc4aee335063d8.jpg',
                'https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_0cb832c9d46435f98aa6204ee110003a.jpg',
                'https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_6820620c865f9573a1c403efc70bd0af.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a570be-00bb-5ef8-bd79-d967d1366cb8/36a570be-00bb-5ef8-bd79-d967d1366cb8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_bdfe2d4d9475e596f1edeb9f16741497.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a570be-00bb-5ef8-bd79-d967d1366cb8/36a570be-00bb-5ef8-bd79-d967d1366cb8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2929387,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_91ab3afac55721ffef33580998f63268.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a570be-00bb-5ef8-bd79-d967d1366cb8/36a570be-00bb-5ef8-bd79-d967d1366cb8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_7a3e8205741bdbcb6c4a5fe0b209a6a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a570be-00bb-5ef8-bd79-d967d1366cb8/36a570be-00bb-5ef8-bd79-d967d1366cb8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_bc1ee0d739c7f592c2f53569ee8492c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a570be-00bb-5ef8-bd79-d967d1366cb8/36a570be-00bb-5ef8-bd79-d967d1366cb8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2562574,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_df7eb78a7eb01e94484676ca5fa0d464.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a570be-00bb-5ef8-bd79-d967d1366cb8/36a570be-00bb-5ef8-bd79-d967d1366cb8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_e220a7f18173adc0c666cf0911c07c60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a570be-00bb-5ef8-bd79-d967d1366cb8/36a570be-00bb-5ef8-bd79-d967d1366cb8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_c8cb7abbb71d7742fe40d133058c7ceb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a570be-00bb-5ef8-bd79-d967d1366cb8/36a570be-00bb-5ef8-bd79-d967d1366cb8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_69a1fba53dfe06d43cdc4aee335063d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a570be-00bb-5ef8-bd79-d967d1366cb8/36a570be-00bb-5ef8-bd79-d967d1366cb8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_0cb832c9d46435f98aa6204ee110003a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a570be-00bb-5ef8-bd79-d967d1366cb8/36a570be-00bb-5ef8-bd79-d967d1366cb8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3b/bb3bab8c72bbd21eae19faa1b61224c6/pa/WP07187_6820620c865f9573a1c403efc70bd0af.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Business Innovation',
 'transmission': 'automatic',
 'trim': 'Business Innovation',
 'year': 2016}
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP07187%27 HTTP/1.1" 200 None
2026-03-30 10:56:06 [auto1.de] INFO: Saving data for WP07187: {'created_time': 1774868166.709454, 'last_price_update_time': 1774868166.709465, 'auction_closing_time': 1774971108.0}
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP07187') HTTP/1.1" 204 0
2026-03-30 10:56:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af411224-d51a-5786-98d9-d8b9e10679ec with identifier: BS29922
2026-03-30 10:56:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af411224-d51a-5786-98d9-d8b9e10679ec with identifier: BS29922
2026-03-30 10:56:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af411224-d51a-5786-98d9-d8b9e10679ec with identifier: BS29922 to the API
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:15:20Z',
 'fuel_type': 'hybrid',
 'id': 'af411224-d51a-5786-98d9-d8b9e10679ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS29922',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 51137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Vignale',
 'transmission': 'automatic',
 'trim': 'Vignale',
 'year': 2021}
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS29922%27 HTTP/1.1" 200 None
2026-03-30 10:56:07 [auto1.de] INFO: Saving data for BS29922: {'auction_closing_time': 1774970120.0, 'created_time': 1774463714.99066, 'last_price_update_time': 1774868167.176123}
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS29922') HTTP/1.1" 204 0
2026-03-30 10:56:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f57eb112-58cf-5b2c-9d7d-e27e42707263 with identifier: CE86831
2026-03-30 10:56:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f57eb112-58cf-5b2c-9d7d-e27e42707263 with identifier: CE86831
2026-03-30 10:56:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f57eb112-58cf-5b2c-9d7d-e27e42707263 with identifier: CE86831 to the API
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-31T15:59:10Z',
 'fuel_type': 'petrol',
 'id': 'f57eb112-58cf-5b2c-9d7d-e27e42707263',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE86831',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 252527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-09',
 'seller_name': None,
 'title': 'BMW 6er 650 CI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE86831%27 HTTP/1.1" 200 None
2026-03-30 10:56:07 [auto1.de] INFO: Saving data for CE86831: {'auction_closing_time': 1774972750.0, 'created_time': 1773307974.172934, 'last_price_update_time': 1774868167.531504}
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE86831') HTTP/1.1" 204 0
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_d6e626ec63cf2b6b2577667d7cbd6f5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_d6e626ec63cf2b6b2577667d7cbd6f5a.jpg not downloaded yet
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_fba3efde266699d253b4e9d5ef719859.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_fba3efde266699d253b4e9d5ef719859.jpg not downloaded yet
2026-03-30 10:56:07 [auto1.de] INFO: Found listing with ID: DB31408
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB31408%27 HTTP/1.1" 200 None
2026-03-30 10:56:07 [auto1.de] INFO: Scrape type for DB31408: 2
2026-03-30 10:56:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b4f275b-d183-5381-902f-5b31555b635c with identifier: DB31408
2026-03-30 10:56:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b4f275b-d183-5381-902f-5b31555b635c with scrape type 2
2026-03-30 10:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b4f275b-d183-5381-902f-5b31555b635c with scrape type 2
2026-03-30 10:56:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b4f275b-d183-5381-902f-5b31555b635c, identifier: DB31408
2026-03-30 10:56:07 [auto1.de] INFO: Found listing with ID: JC54567
2026-03-30 10:56:07 [auto1.de] INFO: Found listing with ID: AJ98197
2026-03-30 10:56:07 [auto1.de] INFO: Found listing with ID: HA89318
2026-03-30 10:56:07 [auto1.de] INFO: Found listing with ID: LC13671
2026-03-30 10:56:07 [auto1.de] INFO: Found listing with ID: GG09705
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG09705%27 HTTP/1.1" 200 None
2026-03-30 10:56:07 [auto1.de] INFO: Scrape type for GG09705: 2
2026-03-30 10:56:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0210db53-f9f0-5f3d-a6fb-a29bb9d64b56 with identifier: GG09705
2026-03-30 10:56:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0210db53-f9f0-5f3d-a6fb-a29bb9d64b56 with scrape type 2
2026-03-30 10:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0210db53-f9f0-5f3d-a6fb-a29bb9d64b56 with scrape type 2
2026-03-30 10:56:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0210db53-f9f0-5f3d-a6fb-a29bb9d64b56, identifier: GG09705
2026-03-30 10:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b4f275b-d183-5381-902f-5b31555b635c with identifier: DB31408
2026-03-30 10:56:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b4f275b-d183-5381-902f-5b31555b635c with identifier: DB31408
2026-03-30 10:56:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b4f275b-d183-5381-902f-5b31555b635c with identifier: DB31408 to the API
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:49:04Z',
 'fuel_type': 'petrol',
 'id': '5b4f275b-d183-5381-902f-5b31555b635c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB31408',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 52652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-25',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2024}
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB31408%27 HTTP/1.1" 200 None
2026-03-30 10:56:08 [auto1.de] INFO: Saving data for DB31408: {'auction_closing_time': 1774972144.0, 'created_time': 1774348864.780619, 'last_price_update_time': 1774868168.172666}
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB31408') HTTP/1.1" 204 0
2026-03-30 10:56:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0210db53-f9f0-5f3d-a6fb-a29bb9d64b56 with identifier: GG09705
2026-03-30 10:56:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0210db53-f9f0-5f3d-a6fb-a29bb9d64b56 with identifier: GG09705
2026-03-30 10:56:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0210db53-f9f0-5f3d-a6fb-a29bb9d64b56 with identifier: GG09705 to the API
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:14:31Z',
 'fuel_type': 'petrol',
 'id': '0210db53-f9f0-5f3d-a6fb-a29bb9d64b56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG09705',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 97811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-01',
 'seller_name': None,
 'title': 'Seat Leon 1.8 TSI Xcellence',
 'transmission': 'automatic',
 'trim': 'Xcellence',
 'year': 2018}
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG09705%27 HTTP/1.1" 200 None
2026-03-30 10:56:08 [auto1.de] INFO: Saving data for GG09705: {'auction_closing_time': 1774970071.0, 'created_time': 1773685867.62397, 'last_price_update_time': 1774868168.552506}
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG09705') HTTP/1.1" 204 0
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_1a8cb48fb7263c48f3642c080d32c402.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_1a8cb48fb7263c48f3642c080d32c402.jpg not downloaded yet
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_39ee0983777ab55fae0c6e6723077d04.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_39ee0983777ab55fae0c6e6723077d04.jpg not downloaded yet
2026-03-30 10:56:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4825a8bf-d35d-5f09-850c-b24e7644b19e with identifier: GU29210
2026-03-30 10:56:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4825a8bf-d35d-5f09-850c-b24e7644b19e with scrape type 1
2026-03-30 10:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4825a8bf-d35d-5f09-850c-b24e7644b19e
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_4374485b59a3fae342ddef2b5bc4ef5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_4374485b59a3fae342ddef2b5bc4ef5f.jpg not downloaded yet
2026-03-30 10:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee489050>
2026-03-30 10:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_51fc831de9bf8b81a92e5a2fceb0213d.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_51fc831de9bf8b81a92e5a2fceb0213d.jpg saved to cache
2026-03-30 10:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c958bc95-5874-5814-bae6-988836f812e4
2026-03-30 10:56:08 [auto1.de] INFO: Found listing with ID: YK86609
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK86609%27 HTTP/1.1" 200 None
2026-03-30 10:56:08 [auto1.de] INFO: Scrape type for YK86609: 2
2026-03-30 10:56:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e88aa941-3b0f-50bd-b4fd-a5a856afb2c8 with identifier: YK86609
2026-03-30 10:56:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88aa941-3b0f-50bd-b4fd-a5a856afb2c8 with scrape type 2
2026-03-30 10:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e88aa941-3b0f-50bd-b4fd-a5a856afb2c8 with scrape type 2
2026-03-30 10:56:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e88aa941-3b0f-50bd-b4fd-a5a856afb2c8, identifier: YK86609
2026-03-30 10:56:08 [auto1.de] INFO: Found listing with ID: FJ28912
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ28912%27 HTTP/1.1" 200 None
2026-03-30 10:56:08 [auto1.de] INFO: Scrape type for FJ28912: 2
2026-03-30 10:56:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52b0a05c-d84f-5ddb-a30a-d75de012bac7 with identifier: FJ28912
2026-03-30 10:56:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52b0a05c-d84f-5ddb-a30a-d75de012bac7 with scrape type 2
2026-03-30 10:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52b0a05c-d84f-5ddb-a30a-d75de012bac7 with scrape type 2
2026-03-30 10:56:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52b0a05c-d84f-5ddb-a30a-d75de012bac7, identifier: FJ28912
2026-03-30 10:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_02d458d453607f0eeac0e740ed6f8643.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e88aa941-3b0f-50bd-b4fd-a5a856afb2c8 with identifier: YK86609
2026-03-30 10:56:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e88aa941-3b0f-50bd-b4fd-a5a856afb2c8 with identifier: YK86609
2026-03-30 10:56:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e88aa941-3b0f-50bd-b4fd-a5a856afb2c8 with identifier: YK86609 to the API
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:59:13Z',
 'fuel_type': 'petrol',
 'id': 'e88aa941-3b0f-50bd-b4fd-a5a856afb2c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK86609',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 32841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-03',
 'seller_name': None,
 'title': 'Audi Q3 40 TFSI quattro Advanced',
 'transmission': 'automatic',
 'trim': 'quattro Advanced',
 'year': 2019}
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK86609%27 HTTP/1.1" 200 None
2026-03-30 10:56:09 [auto1.de] INFO: Saving data for YK86609: {'auction_closing_time': 1774972753.0, 'created_time': 1773305557.995452, 'last_price_update_time': 1774868169.314109}
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK86609') HTTP/1.1" 204 0
2026-03-30 10:56:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52b0a05c-d84f-5ddb-a30a-d75de012bac7 with identifier: FJ28912
2026-03-30 10:56:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52b0a05c-d84f-5ddb-a30a-d75de012bac7 with identifier: FJ28912
2026-03-30 10:56:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52b0a05c-d84f-5ddb-a30a-d75de012bac7 with identifier: FJ28912 to the API
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-31T15:18:33Z',
 'fuel_type': 'diesel',
 'id': '52b0a05c-d84f-5ddb-a30a-d75de012bac7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ28912',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat Alltrack',
 'odometer': 325889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-22',
 'seller_name': None,
 'title': 'Volkswagen Passat Alltrack 2.0 TDI 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': '4Motion BlueMotion Tech',
 'year': 2015}
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ28912%27 HTTP/1.1" 200 None
2026-03-30 10:56:09 [auto1.de] INFO: Saving data for FJ28912: {'auction_closing_time': 1774970313.0, 'created_time': 1773305640.801435, 'last_price_update_time': 1774868169.705188}
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ28912') HTTP/1.1" 204 0
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_b4f4e599d061a6b53387f2d2b4deeaeb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_b4f4e599d061a6b53387f2d2b4deeaeb.jpg not downloaded yet
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_e8da5421a90d954b7a640ce375646412.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_e8da5421a90d954b7a640ce375646412.jpg not downloaded yet
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_1ec91414125c75abc5d1614506a81a64.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_1ec91414125c75abc5d1614506a81a64.jpg not downloaded yet
2026-03-30 10:56:09 [auto1.de] INFO: Found listing with ID: WG79560
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG79560%27 HTTP/1.1" 200 None
2026-03-30 10:56:09 [auto1.de] INFO: Scrape type for WG79560: 2
2026-03-30 10:56:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c7de17e-748d-5749-a9b9-4227584fe3cf with identifier: WG79560
2026-03-30 10:56:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c7de17e-748d-5749-a9b9-4227584fe3cf with scrape type 2
2026-03-30 10:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c7de17e-748d-5749-a9b9-4227584fe3cf with scrape type 2
2026-03-30 10:56:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c7de17e-748d-5749-a9b9-4227584fe3cf, identifier: WG79560
2026-03-30 10:56:09 [auto1.de] INFO: Found listing with ID: NT37937
2026-03-30 10:56:09 [auto1.de] INFO: Found listing with ID: HK26466
2026-03-30 10:56:09 [auto1.de] INFO: Found listing with ID: EG62319
2026-03-30 10:56:09 [auto1.de] INFO: Found listing with ID: CT63766
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT63766%27 HTTP/1.1" 200 None
2026-03-30 10:56:09 [auto1.de] INFO: Scrape type for CT63766: 2
2026-03-30 10:56:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9e6d27a-e018-5965-8361-cb4f89a39b2d with identifier: CT63766
2026-03-30 10:56:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9e6d27a-e018-5965-8361-cb4f89a39b2d with scrape type 2
2026-03-30 10:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9e6d27a-e018-5965-8361-cb4f89a39b2d with scrape type 2
2026-03-30 10:56:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9e6d27a-e018-5965-8361-cb4f89a39b2d, identifier: CT63766
2026-03-30 10:56:10 [auto1.de] INFO: Channel: 24h | Page: 59 | totalHits: 9530 | hits on page: 40
2026-03-30 10:56:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c7de17e-748d-5749-a9b9-4227584fe3cf with identifier: WG79560
2026-03-30 10:56:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c7de17e-748d-5749-a9b9-4227584fe3cf with identifier: WG79560
2026-03-30 10:56:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c7de17e-748d-5749-a9b9-4227584fe3cf with identifier: WG79560 to the API
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:26:44Z',
 'fuel_type': 'petrol',
 'id': '1c7de17e-748d-5749-a9b9-4227584fe3cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG79560',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 182682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-31',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG79560%27 HTTP/1.1" 200 None
2026-03-30 10:56:10 [auto1.de] INFO: Saving data for WG79560: {'auction_closing_time': 1774970804.0, 'created_time': 1773860670.9355, 'last_price_update_time': 1774868170.400411}
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG79560') HTTP/1.1" 204 0
2026-03-30 10:56:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9e6d27a-e018-5965-8361-cb4f89a39b2d with identifier: CT63766
2026-03-30 10:56:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9e6d27a-e018-5965-8361-cb4f89a39b2d with identifier: CT63766
2026-03-30 10:56:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9e6d27a-e018-5965-8361-cb4f89a39b2d with identifier: CT63766 to the API
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:04:29Z',
 'fuel_type': 'diesel',
 'id': 'd9e6d27a-e018-5965-8361-cb4f89a39b2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT63766',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 106889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-10',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 116 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2010}
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT63766%27 HTTP/1.1" 200 None
2026-03-30 10:56:10 [auto1.de] INFO: Saving data for CT63766: {'auction_closing_time': 1774969469.0, 'created_time': 1774377174.976765, 'last_price_update_time': 1774868170.902368}
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT63766') HTTP/1.1" 204 0
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_676901d1b333b024a80a461a672507a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_676901d1b333b024a80a461a672507a2.jpg not downloaded yet
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_f54be514570ac59ea9c703549f5f26a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_f54be514570ac59ea9c703549f5f26a8.jpg not downloaded yet
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_dfd467cb2ffdcf1f9462924e571a9379.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_dfd467cb2ffdcf1f9462924e571a9379.jpg not downloaded yet
2026-03-30 10:56:10 [auto1.de] INFO: Found listing with ID: PC84380
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC84380%27 HTTP/1.1" 200 None
2026-03-30 10:56:10 [auto1.de] INFO: Scrape type for PC84380: 2
2026-03-30 10:56:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92e548b5-19f7-5077-b6d7-19990e5aa924 with identifier: PC84380
2026-03-30 10:56:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92e548b5-19f7-5077-b6d7-19990e5aa924 with scrape type 2
2026-03-30 10:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92e548b5-19f7-5077-b6d7-19990e5aa924 with scrape type 2
2026-03-30 10:56:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92e548b5-19f7-5077-b6d7-19990e5aa924, identifier: PC84380
2026-03-30 10:56:11 [auto1.de] INFO: Found listing with ID: MH30608
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH30608%27 HTTP/1.1" 200 None
2026-03-30 10:56:11 [auto1.de] INFO: Scrape type for MH30608: 2
2026-03-30 10:56:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29707c12-86e9-56d6-a916-20dad1f0e699 with identifier: MH30608
2026-03-30 10:56:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29707c12-86e9-56d6-a916-20dad1f0e699 with scrape type 2
2026-03-30 10:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29707c12-86e9-56d6-a916-20dad1f0e699 with scrape type 2
2026-03-30 10:56:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29707c12-86e9-56d6-a916-20dad1f0e699, identifier: MH30608
2026-03-30 10:56:11 [auto1.de] INFO: Found listing with ID: DA75370
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA75370%27 HTTP/1.1" 200 None
2026-03-30 10:56:11 [auto1.de] INFO: Scrape type for DA75370: 2
2026-03-30 10:56:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bfaa2b9-6bf0-5b7e-9a35-03f02081cc15 with identifier: DA75370
2026-03-30 10:56:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bfaa2b9-6bf0-5b7e-9a35-03f02081cc15 with scrape type 2
2026-03-30 10:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bfaa2b9-6bf0-5b7e-9a35-03f02081cc15 with scrape type 2
2026-03-30 10:56:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1bfaa2b9-6bf0-5b7e-9a35-03f02081cc15, identifier: DA75370
2026-03-30 10:56:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92e548b5-19f7-5077-b6d7-19990e5aa924 with identifier: PC84380
2026-03-30 10:56:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92e548b5-19f7-5077-b6d7-19990e5aa924 with identifier: PC84380
2026-03-30 10:56:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92e548b5-19f7-5077-b6d7-19990e5aa924 with identifier: PC84380 to the API
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-31T15:23:17Z',
 'fuel_type': 'hybrid',
 'id': '92e548b5-19f7-5077-b6d7-19990e5aa924',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC84380',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 51222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-11',
 'seller_name': None,
 'title': 'Audi Q5 55 TFSIe quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2020}
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC84380%27 HTTP/1.1" 200 None
2026-03-30 10:56:11 [auto1.de] INFO: Saving data for PC84380: {'auction_closing_time': 1774970597.0, 'created_time': 1774463764.102757, 'last_price_update_time': 1774868171.625416}
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC84380') HTTP/1.1" 204 0
2026-03-30 10:56:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29707c12-86e9-56d6-a916-20dad1f0e699 with identifier: MH30608
2026-03-30 10:56:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29707c12-86e9-56d6-a916-20dad1f0e699 with identifier: MH30608
2026-03-30 10:56:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29707c12-86e9-56d6-a916-20dad1f0e699 with identifier: MH30608 to the API
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:42:48Z',
 'fuel_type': 'hybrid',
 'id': '29707c12-86e9-56d6-a916-20dad1f0e699',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH30608',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 77379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-11',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2021}
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH30608%27 HTTP/1.1" 200 None
2026-03-30 10:56:12 [auto1.de] INFO: Saving data for MH30608: {'auction_closing_time': 1774971768.0, 'created_time': 1774463697.47416, 'last_price_update_time': 1774868172.096861}
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH30608') HTTP/1.1" 204 0
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_c5940c8d8acaf63665b1b54e214a80de.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_c5940c8d8acaf63665b1b54e214a80de.jpg not downloaded yet
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_04216d08507532ac5e65dfc92010635a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_04216d08507532ac5e65dfc92010635a.jpg not downloaded yet
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_a2cafa77fbb90844d408ec1a842c7ae0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_a2cafa77fbb90844d408ec1a842c7ae0.jpg not downloaded yet
2026-03-30 10:56:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1bfaa2b9-6bf0-5b7e-9a35-03f02081cc15 with identifier: DA75370
2026-03-30 10:56:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1bfaa2b9-6bf0-5b7e-9a35-03f02081cc15 with identifier: DA75370
2026-03-30 10:56:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1bfaa2b9-6bf0-5b7e-9a35-03f02081cc15 with identifier: DA75370 to the API
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:47:02Z',
 'fuel_type': 'hybrid',
 'id': '1bfaa2b9-6bf0-5b7e-9a35-03f02081cc15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA75370',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 34295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-27',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid N Line 4WD',
 'transmission': 'automatic',
 'trim': 'N Line 4WD',
 'year': 2023}
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA75370%27 HTTP/1.1" 200 None
2026-03-30 10:56:12 [auto1.de] INFO: Saving data for DA75370: {'auction_closing_time': 1774972022.0, 'created_time': 1773224662.817515, 'last_price_update_time': 1774868172.639118}
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA75370') HTTP/1.1" 204 0
2026-03-30 10:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefdf850>
2026-03-30 10:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_02d458d453607f0eeac0e740ed6f8643.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_02d458d453607f0eeac0e740ed6f8643.jpg saved to cache
2026-03-30 10:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c958bc95-5874-5814-bae6-988836f812e4
2026-03-30 10:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_f3d8446796dfff9a4a7c4642cebf9619.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:12 [auto1.de] INFO: Found listing with ID: GM71398
2026-03-30 10:56:12 [auto1.de] INFO: Found listing with ID: YF33441
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF33441%27 HTTP/1.1" 200 None
2026-03-30 10:56:12 [auto1.de] INFO: Scrape type for YF33441: 2
2026-03-30 10:56:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c69d5300-a50a-55b5-a023-0a364eb96750 with identifier: YF33441
2026-03-30 10:56:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c69d5300-a50a-55b5-a023-0a364eb96750 with scrape type 2
2026-03-30 10:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c69d5300-a50a-55b5-a023-0a364eb96750 with scrape type 2
2026-03-30 10:56:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c69d5300-a50a-55b5-a023-0a364eb96750, identifier: YF33441
2026-03-30 10:56:12 [auto1.de] INFO: Found listing with ID: TN32839
2026-03-30 10:56:12 [auto1.de] INFO: Found listing with ID: SY11471
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY11471%27 HTTP/1.1" 200 None
2026-03-30 10:56:12 [auto1.de] INFO: Scrape type for SY11471: 2
2026-03-30 10:56:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54716543-4f38-5af4-843d-2b9efb9b671c with identifier: SY11471
2026-03-30 10:56:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54716543-4f38-5af4-843d-2b9efb9b671c with scrape type 2
2026-03-30 10:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54716543-4f38-5af4-843d-2b9efb9b671c with scrape type 2
2026-03-30 10:56:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54716543-4f38-5af4-843d-2b9efb9b671c, identifier: SY11471
2026-03-30 10:56:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c69d5300-a50a-55b5-a023-0a364eb96750 with identifier: YF33441
2026-03-30 10:56:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c69d5300-a50a-55b5-a023-0a364eb96750 with identifier: YF33441
2026-03-30 10:56:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c69d5300-a50a-55b5-a023-0a364eb96750 with identifier: YF33441 to the API
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 50,
 'expiration_date': '2026-03-31T15:36:53Z',
 'fuel_type': 'petrol',
 'id': 'c69d5300-a50a-55b5-a023-0a364eb96750',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF33441',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 4578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1991-08-31',
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 C',
 'transmission': 'manual',
 'trim': 'C',
 'year': 1991}
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF33441%27 HTTP/1.1" 200 None
2026-03-30 10:56:13 [auto1.de] INFO: Saving data for YF33441: {'auction_closing_time': 1774971413.0, 'created_time': 1774294348.255585, 'last_price_update_time': 1774868173.276798}
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF33441') HTTP/1.1" 204 0
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_114d49eb9e89f717937381b4806e22bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_114d49eb9e89f717937381b4806e22bc.jpg not downloaded yet
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_ab3a5d5062e527888452238cb9a2ee8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_ab3a5d5062e527888452238cb9a2ee8f.jpg not downloaded yet
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_59c8bc5dfc1ac4c19c05804062299b16.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_59c8bc5dfc1ac4c19c05804062299b16.jpg not downloaded yet
2026-03-30 10:56:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54716543-4f38-5af4-843d-2b9efb9b671c with identifier: SY11471
2026-03-30 10:56:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54716543-4f38-5af4-843d-2b9efb9b671c with identifier: SY11471
2026-03-30 10:56:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54716543-4f38-5af4-843d-2b9efb9b671c with identifier: SY11471 to the API
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:00:21Z',
 'fuel_type': 'petrol',
 'id': '54716543-4f38-5af4-843d-2b9efb9b671c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY11471',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 115564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-13',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2010}
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY11471%27 HTTP/1.1" 200 None
2026-03-30 10:56:13 [auto1.de] INFO: Saving data for SY11471: {'auction_closing_time': 1774969221.0, 'created_time': 1773224773.670652, 'last_price_update_time': 1774868173.67348}
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY11471') HTTP/1.1" 204 0
2026-03-30 10:56:13 [auto1.de] INFO: Found listing with ID: VN84329
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN84329%27 HTTP/1.1" 200 None
2026-03-30 10:56:13 [auto1.de] INFO: Scrape type for VN84329: 2
2026-03-30 10:56:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7860c633-8e6e-56f2-83ae-64d1f2825e24 with identifier: VN84329
2026-03-30 10:56:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7860c633-8e6e-56f2-83ae-64d1f2825e24 with scrape type 2
2026-03-30 10:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7860c633-8e6e-56f2-83ae-64d1f2825e24 with scrape type 2
2026-03-30 10:56:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7860c633-8e6e-56f2-83ae-64d1f2825e24, identifier: VN84329
2026-03-30 10:56:13 [auto1.de] INFO: Found listing with ID: CF57490
2026-03-30 10:56:13 [auto1.de] INFO: Found listing with ID: XA59462
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59462%27 HTTP/1.1" 200 None
2026-03-30 10:56:13 [auto1.de] INFO: Scrape type for XA59462: 2
2026-03-30 10:56:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46c72616-74c7-5471-883d-55d612d18e30 with identifier: XA59462
2026-03-30 10:56:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46c72616-74c7-5471-883d-55d612d18e30 with scrape type 2
2026-03-30 10:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46c72616-74c7-5471-883d-55d612d18e30 with scrape type 2
2026-03-30 10:56:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46c72616-74c7-5471-883d-55d612d18e30, identifier: XA59462
2026-03-30 10:56:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7860c633-8e6e-56f2-83ae-64d1f2825e24 with identifier: VN84329
2026-03-30 10:56:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7860c633-8e6e-56f2-83ae-64d1f2825e24 with identifier: VN84329
2026-03-30 10:56:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7860c633-8e6e-56f2-83ae-64d1f2825e24 with identifier: VN84329 to the API
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:07:42Z',
 'fuel_type': 'petrol',
 'id': '7860c633-8e6e-56f2-83ae-64d1f2825e24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN84329',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 66100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-18',
 'seller_name': None,
 'title': 'Honda CR-V 2.0 i-VTEC Executive 4WD',
 'transmission': 'automatic',
 'trim': 'Executive 4WD',
 'year': 2013}
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN84329%27 HTTP/1.1" 200 None
2026-03-30 10:56:14 [auto1.de] INFO: Saving data for VN84329: {'auction_closing_time': 1774969662.0, 'created_time': 1773305618.116912, 'last_price_update_time': 1774868174.277798}
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN84329') HTTP/1.1" 204 0
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_e32e0c292fe97c5dbbd3c3f0e2f840b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_e32e0c292fe97c5dbbd3c3f0e2f840b1.jpg not downloaded yet
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_03adb230b068ccadc81429503673db22.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_03adb230b068ccadc81429503673db22.jpg not downloaded yet
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_73549c36a74f7a969952acc2b4059b05.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_73549c36a74f7a969952acc2b4059b05.jpg not downloaded yet
2026-03-30 10:56:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46c72616-74c7-5471-883d-55d612d18e30 with identifier: XA59462
2026-03-30 10:56:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46c72616-74c7-5471-883d-55d612d18e30 with identifier: XA59462
2026-03-30 10:56:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46c72616-74c7-5471-883d-55d612d18e30 with identifier: XA59462 to the API
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:09:32Z',
 'fuel_type': 'diesel',
 'id': '46c72616-74c7-5471-883d-55d612d18e30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA59462',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 117304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-09',
 'seller_name': None,
 'title': 'Peugeot Expert 1.6 HDi L1H1 Kasten Avantage',
 'transmission': 'manual',
 'trim': 'L1H1 Kasten Avantage',
 'year': 2012}
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59462%27 HTTP/1.1" 200 None
2026-03-30 10:56:14 [auto1.de] INFO: Saving data for XA59462: {'auction_closing_time': 1774969772.0, 'created_time': 1774434911.20212, 'last_price_update_time': 1774868174.73397}
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA59462') HTTP/1.1" 204 0
2026-03-30 10:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4396150>
2026-03-30 10:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_f3d8446796dfff9a4a7c4642cebf9619.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_f3d8446796dfff9a4a7c4642cebf9619.jpg saved to cache
2026-03-30 10:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c83b191b-b4e4-5ae7-ad70-0fee672d34dd
2026-03-30 10:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_fc9e2884144046a7279bd78fce651a95.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:14 [auto1.de] INFO: Found listing with ID: DK08351
2026-03-30 10:56:14 [auto1.de] INFO: Found listing with ID: LU02094
2026-03-30 10:56:14 [auto1.de] INFO: Found listing with ID: LX46621
2026-03-30 10:56:14 [auto1.de] INFO: Found listing with ID: VJ16820
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ16820%27 HTTP/1.1" 200 None
2026-03-30 10:56:14 [auto1.de] INFO: Scrape type for VJ16820: 2
2026-03-30 10:56:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4a507f2-f8e0-5a61-a837-1d8e5b267450 with identifier: VJ16820
2026-03-30 10:56:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4a507f2-f8e0-5a61-a837-1d8e5b267450 with scrape type 2
2026-03-30 10:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4a507f2-f8e0-5a61-a837-1d8e5b267450 with scrape type 2
2026-03-30 10:56:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4a507f2-f8e0-5a61-a837-1d8e5b267450, identifier: VJ16820
2026-03-30 10:56:14 [auto1.de] INFO: Found listing with ID: XE05025
2026-03-30 10:56:14 [auto1.de] INFO: Found listing with ID: RH52660
2026-03-30 10:56:14 [auto1.de] INFO: Found listing with ID: UC30179
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC30179%27 HTTP/1.1" 200 None
2026-03-30 10:56:15 [auto1.de] INFO: Scrape type for UC30179: 2
2026-03-30 10:56:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c8cf750-9ba8-5e19-88e6-f50349ce6ecc with identifier: UC30179
2026-03-30 10:56:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c8cf750-9ba8-5e19-88e6-f50349ce6ecc with scrape type 2
2026-03-30 10:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c8cf750-9ba8-5e19-88e6-f50349ce6ecc with scrape type 2
2026-03-30 10:56:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c8cf750-9ba8-5e19-88e6-f50349ce6ecc, identifier: UC30179
2026-03-30 10:56:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4a507f2-f8e0-5a61-a837-1d8e5b267450 with identifier: VJ16820
2026-03-30 10:56:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4a507f2-f8e0-5a61-a837-1d8e5b267450 with identifier: VJ16820
2026-03-30 10:56:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4a507f2-f8e0-5a61-a837-1d8e5b267450 with identifier: VJ16820 to the API
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:18:50Z',
 'fuel_type': 'petrol',
 'id': 'f4a507f2-f8e0-5a61-a837-1d8e5b267450',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ16820',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 101869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-24',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI ACT Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2016}
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ16820%27 HTTP/1.1" 200 None
2026-03-30 10:56:15 [auto1.de] INFO: Saving data for VJ16820: {'auction_closing_time': 1774970330.0, 'created_time': 1774464649.153757, 'last_price_update_time': 1774868175.485435}
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ16820') HTTP/1.1" 204 0
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_534db5c757c14e84133bef3a1e124165.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_534db5c757c14e84133bef3a1e124165.jpg not downloaded yet
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_de5dad87d09d7e0d92d1751307aed863.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_de5dad87d09d7e0d92d1751307aed863.jpg not downloaded yet
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_d7529feb629e6cb1ce955ca78970f0fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_d7529feb629e6cb1ce955ca78970f0fd.jpg not downloaded yet
2026-03-30 10:56:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c8cf750-9ba8-5e19-88e6-f50349ce6ecc with identifier: UC30179
2026-03-30 10:56:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c8cf750-9ba8-5e19-88e6-f50349ce6ecc with identifier: UC30179
2026-03-30 10:56:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c8cf750-9ba8-5e19-88e6-f50349ce6ecc with identifier: UC30179 to the API
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:08:01Z',
 'fuel_type': 'petrol',
 'id': '6c8cf750-9ba8-5e19-88e6-f50349ce6ecc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC30179',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'New Beetle',
 'odometer': 163367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-08-20',
 'seller_name': None,
 'title': 'Volkswagen New Beetle 2.0 Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2003}
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC30179%27 HTTP/1.1" 200 None
2026-03-30 10:56:15 [auto1.de] INFO: Saving data for UC30179: {'auction_closing_time': 1774969681.0, 'created_time': 1774293518.491864, 'last_price_update_time': 1774868175.988707}
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC30179') HTTP/1.1" 204 0
2026-03-30 10:56:16 [auto1.de] INFO: Found listing with ID: LC23112
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC23112%27 HTTP/1.1" 200 None
2026-03-30 10:56:16 [auto1.de] INFO: Scrape type for LC23112: 2
2026-03-30 10:56:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1124f95-c167-5c2c-8d2e-96ff79efd9d0 with identifier: LC23112
2026-03-30 10:56:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1124f95-c167-5c2c-8d2e-96ff79efd9d0 with scrape type 2
2026-03-30 10:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1124f95-c167-5c2c-8d2e-96ff79efd9d0 with scrape type 2
2026-03-30 10:56:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1124f95-c167-5c2c-8d2e-96ff79efd9d0, identifier: LC23112
2026-03-30 10:56:16 [auto1.de] INFO: Found listing with ID: SV97177
2026-03-30 10:56:16 [auto1.de] INFO: Found listing with ID: MK30505
2026-03-30 10:56:16 [auto1.de] INFO: Found listing with ID: FM76670
2026-03-30 10:56:16 [auto1.de] INFO: Found listing with ID: XF39485
2026-03-30 10:56:16 [auto1.de] INFO: Found listing with ID: XH71010
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH71010%27 HTTP/1.1" 200 None
2026-03-30 10:56:16 [auto1.de] INFO: Scrape type for XH71010: 2
2026-03-30 10:56:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a40ac14-39e9-5fe3-ad2c-dd953df12750 with identifier: XH71010
2026-03-30 10:56:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a40ac14-39e9-5fe3-ad2c-dd953df12750 with scrape type 2
2026-03-30 10:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a40ac14-39e9-5fe3-ad2c-dd953df12750 with scrape type 2
2026-03-30 10:56:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a40ac14-39e9-5fe3-ad2c-dd953df12750, identifier: XH71010
2026-03-30 10:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS87926/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1124f95-c167-5c2c-8d2e-96ff79efd9d0 with identifier: LC23112
2026-03-30 10:56:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1124f95-c167-5c2c-8d2e-96ff79efd9d0 with identifier: LC23112
2026-03-30 10:56:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1124f95-c167-5c2c-8d2e-96ff79efd9d0 with identifier: LC23112 to the API
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:25:23Z',
 'fuel_type': 'diesel',
 'id': 'e1124f95-c167-5c2c-8d2e-96ff79efd9d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC23112',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Amarok',
 'odometer': 141114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-24',
 'seller_name': None,
 'title': 'Volkswagen Amarok 3.0 V6 TDI Highline DoubleCab 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline DoubleCab 4Motion',
 'year': 2017}
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC23112%27 HTTP/1.1" 200 None
2026-03-30 10:56:17 [auto1.de] INFO: Saving data for LC23112: {'auction_closing_time': 1774970723.0, 'created_time': 1773303615.468554, 'last_price_update_time': 1774868177.162907}
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC23112') HTTP/1.1" 204 0
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_6dcf13973b62e2a1d18fdd48ddacec69.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_6dcf13973b62e2a1d18fdd48ddacec69.jpg not downloaded yet
2026-03-30 10:56:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a40ac14-39e9-5fe3-ad2c-dd953df12750 with identifier: XH71010
2026-03-30 10:56:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a40ac14-39e9-5fe3-ad2c-dd953df12750 with identifier: XH71010
2026-03-30 10:56:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a40ac14-39e9-5fe3-ad2c-dd953df12750 with identifier: XH71010 to the API
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:00:27Z',
 'fuel_type': 'diesel',
 'id': '7a40ac14-39e9-5fe3-ad2c-dd953df12750',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH71010',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 201924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-16',
 'seller_name': None,
 'title': 'Fiat Doblo 1.6 JTDM Dynamic Maxi',
 'transmission': 'manual',
 'trim': 'Dynamic Maxi',
 'year': 2014}
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH71010%27 HTTP/1.1" 200 None
2026-03-30 10:56:17 [auto1.de] INFO: Saving data for XH71010: {'auction_closing_time': 1774969227.0, 'created_time': 1773306536.235322, 'last_price_update_time': 1774868177.546227}
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH71010') HTTP/1.1" 204 0
2026-03-30 10:56:17 [auto1.de] INFO: Found listing with ID: SS89837
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89837%27 HTTP/1.1" 200 None
2026-03-30 10:56:17 [auto1.de] INFO: Scrape type for SS89837: 2
2026-03-30 10:56:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af5ef14d-97b1-5d99-8162-22faedcb1f8d with identifier: SS89837
2026-03-30 10:56:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af5ef14d-97b1-5d99-8162-22faedcb1f8d with scrape type 2
2026-03-30 10:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af5ef14d-97b1-5d99-8162-22faedcb1f8d with scrape type 2
2026-03-30 10:56:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af5ef14d-97b1-5d99-8162-22faedcb1f8d, identifier: SS89837
2026-03-30 10:56:17 [auto1.de] INFO: Found listing with ID: LD10656
2026-03-30 10:56:17 [auto1.de] INFO: Found listing with ID: MS24005
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS24005%27 HTTP/1.1" 200 None
2026-03-30 10:56:17 [auto1.de] INFO: Scrape type for MS24005: 2
2026-03-30 10:56:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc64c441-8776-5447-96ba-3a085764646a with identifier: MS24005
2026-03-30 10:56:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc64c441-8776-5447-96ba-3a085764646a with scrape type 2
2026-03-30 10:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc64c441-8776-5447-96ba-3a085764646a with scrape type 2
2026-03-30 10:56:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc64c441-8776-5447-96ba-3a085764646a, identifier: MS24005
2026-03-30 10:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4177190>
2026-03-30 10:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_fc9e2884144046a7279bd78fce651a95.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_fc9e2884144046a7279bd78fce651a95.jpg saved to cache
2026-03-30 10:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46856877-b8d0-5527-8585-25e182d2ac9c
2026-03-30 10:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_56a0d150f0bf9c9e87c0073bff35d58d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af5ef14d-97b1-5d99-8162-22faedcb1f8d with identifier: SS89837
2026-03-30 10:56:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af5ef14d-97b1-5d99-8162-22faedcb1f8d with identifier: SS89837
2026-03-30 10:56:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af5ef14d-97b1-5d99-8162-22faedcb1f8d with identifier: SS89837 to the API
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 188,
 'expiration_date': '2026-03-31T15:42:04Z',
 'fuel_type': 'petrol',
 'id': 'af5ef14d-97b1-5d99-8162-22faedcb1f8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS89837',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Magentis',
 'odometer': 243624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-29',
 'seller_name': None,
 'title': 'Kia Magentis 2.7 EX Top',
 'transmission': 'automatic',
 'trim': 'EX Top',
 'year': 2007}
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89837%27 HTTP/1.1" 200 None
2026-03-30 10:56:18 [auto1.de] INFO: Saving data for SS89837: {'auction_closing_time': 1774971724.0, 'created_time': 1773306283.460617, 'last_price_update_time': 1774868178.206732}
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS89837') HTTP/1.1" 204 0
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_86b822aae37ad4e1ca1f7e00dbdf6600.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_86b822aae37ad4e1ca1f7e00dbdf6600.jpg not downloaded yet
2026-03-30 10:56:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc64c441-8776-5447-96ba-3a085764646a with identifier: MS24005
2026-03-30 10:56:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc64c441-8776-5447-96ba-3a085764646a with identifier: MS24005
2026-03-30 10:56:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc64c441-8776-5447-96ba-3a085764646a with identifier: MS24005 to the API
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 605,
 'expiration_date': '2026-03-31T15:19:55Z',
 'fuel_type': 'petrol',
 'id': 'cc64c441-8776-5447-96ba-3a085764646a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS24005',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S8',
 'odometer': 90480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-22',
 'seller_name': None,
 'title': 'Audi S8 4.0 V8 TFSI quattro Plus',
 'transmission': 'automatic',
 'trim': 'quattro Plus',
 'year': 2017}
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS24005%27 HTTP/1.1" 200 None
2026-03-30 10:56:18 [auto1.de] INFO: Saving data for MS24005: {'auction_closing_time': 1774970395.0, 'created_time': 1773306891.754998, 'last_price_update_time': 1774868178.571051}
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS24005') HTTP/1.1" 204 0
2026-03-30 10:56:18 [auto1.de] INFO: Found listing with ID: DE25074
2026-03-30 10:56:18 [auto1.de] INFO: Found listing with ID: FF52766
2026-03-30 10:56:18 [auto1.de] INFO: Found listing with ID: CT52786
2026-03-30 10:56:18 [auto1.de] INFO: Found listing with ID: VT05900
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT05900%27 HTTP/1.1" 200 None
2026-03-30 10:56:18 [auto1.de] INFO: Scrape type for VT05900: 2
2026-03-30 10:56:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dedfd2c-f900-5c6d-8922-7e10cf766717 with identifier: VT05900
2026-03-30 10:56:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dedfd2c-f900-5c6d-8922-7e10cf766717 with scrape type 2
2026-03-30 10:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8dedfd2c-f900-5c6d-8922-7e10cf766717 with scrape type 2
2026-03-30 10:56:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8dedfd2c-f900-5c6d-8922-7e10cf766717, identifier: VT05900
2026-03-30 10:56:18 [auto1.de] INFO: Found listing with ID: XL44945
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL44945%27 HTTP/1.1" 200 None
2026-03-30 10:56:18 [auto1.de] INFO: Scrape type for XL44945: 1
2026-03-30 10:56:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8dedfd2c-f900-5c6d-8922-7e10cf766717 with identifier: VT05900
2026-03-30 10:56:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8dedfd2c-f900-5c6d-8922-7e10cf766717 with identifier: VT05900
2026-03-30 10:56:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8dedfd2c-f900-5c6d-8922-7e10cf766717 with identifier: VT05900 to the API
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:24:23Z',
 'fuel_type': 'petrol',
 'id': '8dedfd2c-f900-5c6d-8922-7e10cf766717',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT05900',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 43735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-28',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 TGDI GT",
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT05900%27 HTTP/1.1" 200 None
2026-03-30 10:56:19 [auto1.de] INFO: Saving data for VT05900: {'auction_closing_time': 1774970663.0, 'created_time': 1773303887.597543, 'last_price_update_time': 1774868179.099779}
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT05900') HTTP/1.1" 204 0
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_e6422d1551eb2b112f679962c0bfd490.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_e6422d1551eb2b112f679962c0bfd490.jpg not downloaded yet
2026-03-30 10:56:19 [auto1.de] INFO: Found listing with ID: NR70794
2026-03-30 10:56:19 [auto1.de] INFO: Found listing with ID: MS10711
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS10711%27 HTTP/1.1" 200 None
2026-03-30 10:56:19 [auto1.de] INFO: Scrape type for MS10711: 2
2026-03-30 10:56:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ba1c028-2506-5074-afc8-8f03c8ec323f with identifier: MS10711
2026-03-30 10:56:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ba1c028-2506-5074-afc8-8f03c8ec323f with scrape type 2
2026-03-30 10:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ba1c028-2506-5074-afc8-8f03c8ec323f with scrape type 2
2026-03-30 10:56:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ba1c028-2506-5074-afc8-8f03c8ec323f, identifier: MS10711
2026-03-30 10:56:19 [auto1.de] INFO: Found listing with ID: UX16759
2026-03-30 10:56:19 [auto1.de] INFO: Found listing with ID: WU59517
2026-03-30 10:56:19 [auto1.de] INFO: Found listing with ID: ND84220
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND84220%27 HTTP/1.1" 200 None
2026-03-30 10:56:19 [auto1.de] INFO: Scrape type for ND84220: 2
2026-03-30 10:56:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdf61f62-a527-55bd-98a2-0d87b7535870 with identifier: ND84220
2026-03-30 10:56:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdf61f62-a527-55bd-98a2-0d87b7535870 with scrape type 2
2026-03-30 10:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdf61f62-a527-55bd-98a2-0d87b7535870 with scrape type 2
2026-03-30 10:56:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fdf61f62-a527-55bd-98a2-0d87b7535870, identifier: ND84220
2026-03-30 10:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_1381da30f15d88bd87a194a53e3dfe73.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_7e1bb9d5f0d6cb27662527c2b9638f9e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ba1c028-2506-5074-afc8-8f03c8ec323f with identifier: MS10711
2026-03-30 10:56:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ba1c028-2506-5074-afc8-8f03c8ec323f with identifier: MS10711
2026-03-30 10:56:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ba1c028-2506-5074-afc8-8f03c8ec323f with identifier: MS10711 to the API
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:41:35Z',
 'fuel_type': 'petrol',
 'id': '4ba1c028-2506-5074-afc8-8f03c8ec323f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS10711',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 143668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-14',
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2018}
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS10711%27 HTTP/1.1" 200 None
2026-03-30 10:56:19 [auto1.de] INFO: Saving data for MS10711: {'auction_closing_time': 1774971695.0, 'created_time': 1773344143.517005, 'last_price_update_time': 1774868179.877036}
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS10711') HTTP/1.1" 204 0
2026-03-30 10:56:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fdf61f62-a527-55bd-98a2-0d87b7535870 with identifier: ND84220
2026-03-30 10:56:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fdf61f62-a527-55bd-98a2-0d87b7535870 with identifier: ND84220
2026-03-30 10:56:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fdf61f62-a527-55bd-98a2-0d87b7535870 with identifier: ND84220 to the API
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:18:37Z',
 'fuel_type': 'diesel',
 'id': 'fdf61f62-a527-55bd-98a2-0d87b7535870',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND84220',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 217483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-23',
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND84220%27 HTTP/1.1" 200 None
2026-03-30 10:56:20 [auto1.de] INFO: Saving data for ND84220: {'auction_closing_time': 1774970317.0, 'created_time': 1773686171.871162, 'last_price_update_time': 1774868180.252231}
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND84220') HTTP/1.1" 204 0
2026-03-30 10:56:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f414f710>
2026-03-30 10:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_56a0d150f0bf9c9e87c0073bff35d58d.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_56a0d150f0bf9c9e87c0073bff35d58d.jpg saved to cache
2026-03-30 10:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c83b191b-b4e4-5ae7-ad70-0fee672d34dd
2026-03-30 10:56:20 [auto1.de] INFO: Found listing with ID: YK91002
2026-03-30 10:56:20 [auto1.de] INFO: Found listing with ID: ZF79650
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF79650%27 HTTP/1.1" 200 None
2026-03-30 10:56:20 [auto1.de] INFO: Scrape type for ZF79650: 2
2026-03-30 10:56:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b55da0d-3db2-586d-8319-26da95655437 with identifier: ZF79650
2026-03-30 10:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b55da0d-3db2-586d-8319-26da95655437 with scrape type 2
2026-03-30 10:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b55da0d-3db2-586d-8319-26da95655437 with scrape type 2
2026-03-30 10:56:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b55da0d-3db2-586d-8319-26da95655437, identifier: ZF79650
2026-03-30 10:56:20 [auto1.de] INFO: Found listing with ID: SB50693
2026-03-30 10:56:20 [auto1.de] INFO: Found listing with ID: AS63846
2026-03-30 10:56:20 [auto1.de] INFO: Found listing with ID: DZ51927
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ51927%27 HTTP/1.1" 200 None
2026-03-30 10:56:20 [auto1.de] INFO: Scrape type for DZ51927: 2
2026-03-30 10:56:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f95f05c-4d7d-54e2-b856-d28ba7b711cb with identifier: DZ51927
2026-03-30 10:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f95f05c-4d7d-54e2-b856-d28ba7b711cb with scrape type 2
2026-03-30 10:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f95f05c-4d7d-54e2-b856-d28ba7b711cb with scrape type 2
2026-03-30 10:56:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f95f05c-4d7d-54e2-b856-d28ba7b711cb, identifier: DZ51927
2026-03-30 10:56:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b55da0d-3db2-586d-8319-26da95655437 with identifier: ZF79650
2026-03-30 10:56:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b55da0d-3db2-586d-8319-26da95655437 with identifier: ZF79650
2026-03-30 10:56:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b55da0d-3db2-586d-8319-26da95655437 with identifier: ZF79650 to the API
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:12:18Z',
 'fuel_type': 'diesel',
 'id': '6b55da0d-3db2-586d-8319-26da95655437',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF79650',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 134792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-07',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2016}
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF79650%27 HTTP/1.1" 200 None
2026-03-30 10:56:20 [auto1.de] INFO: Saving data for ZF79650: {'auction_closing_time': 1774969938.0, 'created_time': 1773226784.452195, 'last_price_update_time': 1774868180.932721}
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF79650') HTTP/1.1" 204 0
2026-03-30 10:56:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f95f05c-4d7d-54e2-b856-d28ba7b711cb with identifier: DZ51927
2026-03-30 10:56:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f95f05c-4d7d-54e2-b856-d28ba7b711cb with identifier: DZ51927
2026-03-30 10:56:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f95f05c-4d7d-54e2-b856-d28ba7b711cb with identifier: DZ51927 to the API
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:53:13Z',
 'fuel_type': 'diesel',
 'id': '3f95f05c-4d7d-54e2-b856-d28ba7b711cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ51927',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 203059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-22',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2015}
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ51927%27 HTTP/1.1" 200 None
2026-03-30 10:56:21 [auto1.de] INFO: Saving data for DZ51927: {'auction_closing_time': 1774972393.0, 'created_time': 1773308064.282465, 'last_price_update_time': 1774868181.358228}
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ51927') HTTP/1.1" 204 0
2026-03-30 10:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_42a117290aed78dba96bb1b41c796937.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:21 [auto1.de] INFO: Found listing with ID: TR42945
2026-03-30 10:56:21 [auto1.de] INFO: Found listing with ID: DA75370
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA75370%27 HTTP/1.1" 200 None
2026-03-30 10:56:21 [auto1.de] INFO: Scrape type for DA75370: 0
2026-03-30 10:56:21 [auto1.de] INFO: Found listing with ID: ZD23730
2026-03-30 10:56:21 [auto1.de] INFO: Found listing with ID: YK76722
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK76722%27 HTTP/1.1" 200 None
2026-03-30 10:56:21 [auto1.de] INFO: Scrape type for YK76722: 2
2026-03-30 10:56:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db45a5ab-cba5-5112-8e51-7ca9ef72a96e with identifier: YK76722
2026-03-30 10:56:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db45a5ab-cba5-5112-8e51-7ca9ef72a96e with scrape type 2
2026-03-30 10:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db45a5ab-cba5-5112-8e51-7ca9ef72a96e with scrape type 2
2026-03-30 10:56:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db45a5ab-cba5-5112-8e51-7ca9ef72a96e, identifier: YK76722
2026-03-30 10:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_d6e626ec63cf2b6b2577667d7cbd6f5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db45a5ab-cba5-5112-8e51-7ca9ef72a96e with identifier: YK76722
2026-03-30 10:56:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db45a5ab-cba5-5112-8e51-7ca9ef72a96e with identifier: YK76722
2026-03-30 10:56:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db45a5ab-cba5-5112-8e51-7ca9ef72a96e with identifier: YK76722 to the API
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:44:37Z',
 'fuel_type': 'diesel',
 'id': 'db45a5ab-cba5-5112-8e51-7ca9ef72a96e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK76722',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 101137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-22',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2022}
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK76722%27 HTTP/1.1" 200 None
2026-03-30 10:56:21 [auto1.de] INFO: Saving data for YK76722: {'auction_closing_time': 1774971877.0, 'created_time': 1773133026.907332, 'last_price_update_time': 1774868181.857216}
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK76722') HTTP/1.1" 204 0
2026-03-30 10:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_12f4a1451a468d8d714daf41dc4f10be.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:22 [auto1.de] INFO: Found listing with ID: LX13795
2026-03-30 10:56:22 [auto1.de] INFO: Found listing with ID: HE06850
2026-03-30 10:56:22 [auto1.de] INFO: Found listing with ID: EB21377
2026-03-30 10:56:22 [auto1.de] INFO: Found listing with ID: FU32442
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU32442%27 HTTP/1.1" 200 None
2026-03-30 10:56:22 [auto1.de] INFO: Scrape type for FU32442: 2
2026-03-30 10:56:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc8e0426-c36e-5e09-9a06-85afce3b0ca8 with identifier: FU32442
2026-03-30 10:56:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc8e0426-c36e-5e09-9a06-85afce3b0ca8 with scrape type 2
2026-03-30 10:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc8e0426-c36e-5e09-9a06-85afce3b0ca8 with scrape type 2
2026-03-30 10:56:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc8e0426-c36e-5e09-9a06-85afce3b0ca8, identifier: FU32442
2026-03-30 10:56:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee44f490>
2026-03-30 10:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_1381da30f15d88bd87a194a53e3dfe73.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_1381da30f15d88bd87a194a53e3dfe73.jpg saved to cache
2026-03-30 10:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c958bc95-5874-5814-bae6-988836f812e4
2026-03-30 10:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419e690>
2026-03-30 10:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_7e1bb9d5f0d6cb27662527c2b9638f9e.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_7e1bb9d5f0d6cb27662527c2b9638f9e.jpg saved to cache
2026-03-30 10:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46856877-b8d0-5527-8585-25e182d2ac9c
2026-03-30 10:56:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc8e0426-c36e-5e09-9a06-85afce3b0ca8 with identifier: FU32442
2026-03-30 10:56:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc8e0426-c36e-5e09-9a06-85afce3b0ca8 with identifier: FU32442
2026-03-30 10:56:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc8e0426-c36e-5e09-9a06-85afce3b0ca8 with identifier: FU32442 to the API
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:39:38Z',
 'fuel_type': 'petrol',
 'id': 'cc8e0426-c36e-5e09-9a06-85afce3b0ca8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU32442',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 172456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-05-31',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 1999}
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU32442%27 HTTP/1.1" 200 None
2026-03-30 10:56:22 [auto1.de] INFO: Saving data for FU32442: {'auction_closing_time': 1774971578.0, 'created_time': 1773344825.04082, 'last_price_update_time': 1774868182.808353}
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU32442') HTTP/1.1" 204 0
2026-03-30 10:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_4374485b59a3fae342ddef2b5bc4ef5f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:22 [auto1.de] INFO: Found listing with ID: NH59879
2026-03-30 10:56:22 [auto1.de] INFO: Found listing with ID: HE72355
2026-03-30 10:56:22 [auto1.de] INFO: Found listing with ID: SC06159
2026-03-30 10:56:22 [auto1.de] INFO: Found listing with ID: WD01270
2026-03-30 10:56:22 [auto1.de] INFO: Found listing with ID: FP18966
2026-03-30 10:56:22 [auto1.de] INFO: Found listing with ID: LU76842
2026-03-30 10:56:22 [auto1.de] INFO: Found listing with ID: HE37410
2026-03-30 10:56:22 [auto1.de] INFO: Found listing with ID: EN21542
2026-03-30 10:56:22 [auto1.de] INFO: Found listing with ID: PW82256
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW82256%27 HTTP/1.1" 200 None
2026-03-30 10:56:22 [auto1.de] INFO: Scrape type for PW82256: 2
2026-03-30 10:56:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae459311-38e8-5391-91d7-a92e736c0086 with identifier: PW82256
2026-03-30 10:56:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae459311-38e8-5391-91d7-a92e736c0086 with scrape type 2
2026-03-30 10:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae459311-38e8-5391-91d7-a92e736c0086 with scrape type 2
2026-03-30 10:56:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae459311-38e8-5391-91d7-a92e736c0086, identifier: PW82256
2026-03-30 10:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_9cb6cdfc03fd9efd4acc4f7e8164988c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae459311-38e8-5391-91d7-a92e736c0086 with identifier: PW82256
2026-03-30 10:56:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae459311-38e8-5391-91d7-a92e736c0086 with identifier: PW82256
2026-03-30 10:56:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae459311-38e8-5391-91d7-a92e736c0086 with identifier: PW82256 to the API
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:42:19Z',
 'fuel_type': 'petrol',
 'id': 'ae459311-38e8-5391-91d7-a92e736c0086',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW82256',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 117008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-16',
 'seller_name': None,
 'title': 'BMW 3er 320i GT xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2020}
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW82256%27 HTTP/1.1" 200 None
2026-03-30 10:56:23 [auto1.de] INFO: Saving data for PW82256: {'auction_closing_time': 1774971739.0, 'created_time': 1773945104.206985, 'last_price_update_time': 1774868183.278321}
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW82256') HTTP/1.1" 204 0
2026-03-30 10:56:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee44de10>
2026-03-30 10:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_42a117290aed78dba96bb1b41c796937.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_42a117290aed78dba96bb1b41c796937.jpg saved to cache
2026-03-30 10:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c958bc95-5874-5814-bae6-988836f812e4
2026-03-30 10:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3ecb50>
2026-03-30 10:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_d6e626ec63cf2b6b2577667d7cbd6f5a.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_d6e626ec63cf2b6b2577667d7cbd6f5a.jpg saved to cache
2026-03-30 10:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46856877-b8d0-5527-8585-25e182d2ac9c
2026-03-30 10:56:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeed3990>
2026-03-30 10:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_12f4a1451a468d8d714daf41dc4f10be.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_12f4a1451a468d8d714daf41dc4f10be.jpg saved to cache
2026-03-30 10:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c958bc95-5874-5814-bae6-988836f812e4
2026-03-30 10:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_0b56df8261ba6327cc1536476bbbcbba.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_a2cafa77fbb90844d408ec1a842c7ae0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_39ee0983777ab55fae0c6e6723077d04.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:23 [auto1.de] INFO: Found listing with ID: ZU35260
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU35260%27 HTTP/1.1" 200 None
2026-03-30 10:56:23 [auto1.de] INFO: Scrape type for ZU35260: 2
2026-03-30 10:56:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0217c534-08c7-50ed-9334-0d4551abd654 with identifier: ZU35260
2026-03-30 10:56:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0217c534-08c7-50ed-9334-0d4551abd654 with scrape type 2
2026-03-30 10:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0217c534-08c7-50ed-9334-0d4551abd654 with scrape type 2
2026-03-30 10:56:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0217c534-08c7-50ed-9334-0d4551abd654, identifier: ZU35260
2026-03-30 10:56:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0217c534-08c7-50ed-9334-0d4551abd654 with identifier: ZU35260
2026-03-30 10:56:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0217c534-08c7-50ed-9334-0d4551abd654 with identifier: ZU35260
2026-03-30 10:56:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0217c534-08c7-50ed-9334-0d4551abd654 with identifier: ZU35260 to the API
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:20:56Z',
 'fuel_type': 'diesel',
 'id': '0217c534-08c7-50ed-9334-0d4551abd654',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU35260',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 145618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-31',
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 DDiS Comfort+ 4x4',
 'transmission': 'manual',
 'trim': 'Comfort+ 4x4',
 'year': 2016}
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU35260%27 HTTP/1.1" 200 None
2026-03-30 10:56:24 [auto1.de] INFO: Saving data for ZU35260: {'auction_closing_time': 1774970456.0, 'created_time': 1773341739.53229, 'last_price_update_time': 1774868184.113269}
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU35260') HTTP/1.1" 204 0
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f480afd0>
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_4374485b59a3fae342ddef2b5bc4ef5f.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_4374485b59a3fae342ddef2b5bc4ef5f.jpg saved to cache
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4825a8bf-d35d-5f09-850c-b24e7644b19e
2026-03-30 10:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_753507badf0448e114fe4515597c8c4a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:24 [auto1.de] INFO: Found listing with ID: LT86298
2026-03-30 10:56:24 [auto1.de] INFO: Found listing with ID: KK61253
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK61253%27 HTTP/1.1" 200 None
2026-03-30 10:56:24 [auto1.de] INFO: Scrape type for KK61253: 0
2026-03-30 10:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_d7529feb629e6cb1ce955ca78970f0fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_73549c36a74f7a969952acc2b4059b05.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4808e50>
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_9cb6cdfc03fd9efd4acc4f7e8164988c.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_9cb6cdfc03fd9efd4acc4f7e8164988c.jpg saved to cache
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c958bc95-5874-5814-bae6-988836f812e4
2026-03-30 10:56:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4143bd0>
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_0b56df8261ba6327cc1536476bbbcbba.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_0b56df8261ba6327cc1536476bbbcbba.jpg saved to cache
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c958bc95-5874-5814-bae6-988836f812e4
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefd7350>
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_a2cafa77fbb90844d408ec1a842c7ae0.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_a2cafa77fbb90844d408ec1a842c7ae0.jpg saved to cache
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4825a8bf-d35d-5f09-850c-b24e7644b19e
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3ed390>
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_39ee0983777ab55fae0c6e6723077d04.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_39ee0983777ab55fae0c6e6723077d04.jpg saved to cache
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c83b191b-b4e4-5ae7-ad70-0fee672d34dd
2026-03-30 10:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_7faee754e26f4c22bc311556b5b68a8e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_e6422d1551eb2b112f679962c0bfd490.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_6dcf13973b62e2a1d18fdd48ddacec69.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeef37d0>
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_753507badf0448e114fe4515597c8c4a.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_753507badf0448e114fe4515597c8c4a.jpg saved to cache
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c958bc95-5874-5814-bae6-988836f812e4
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee44e0d0>
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_d7529feb629e6cb1ce955ca78970f0fd.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_d7529feb629e6cb1ce955ca78970f0fd.jpg saved to cache
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4825a8bf-d35d-5f09-850c-b24e7644b19e
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f419a3d0>
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_73549c36a74f7a969952acc2b4059b05.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_73549c36a74f7a969952acc2b4059b05.jpg saved to cache
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4825a8bf-d35d-5f09-850c-b24e7644b19e
2026-03-30 10:56:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee44cbd0>
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5806dbd71c9c1e13d7206850151a231%252Fpa%252FYM22646_7faee754e26f4c22bc311556b5b68a8e.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_7faee754e26f4c22bc311556b5b68a8e.jpg saved to cache
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c958bc95-5874-5814-bae6-988836f812e4
2026-03-30 10:56:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c958bc95-5874-5814-bae6-988836f812e4, skipping ID generation
2026-03-30 10:56:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c958bc95-5874-5814-bae6-988836f812e4 with scrape type 1
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c958bc95-5874-5814-bae6-988836f812e4 sending to next pipeline
2026-03-30 10:56:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c958bc95-5874-5814-bae6-988836f812e4, identifier: YM22646
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f591f8d0>
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_e6422d1551eb2b112f679962c0bfd490.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_e6422d1551eb2b112f679962c0bfd490.jpg saved to cache
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4825a8bf-d35d-5f09-850c-b24e7644b19e
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee5ffd0>
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_6dcf13973b62e2a1d18fdd48ddacec69.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_6dcf13973b62e2a1d18fdd48ddacec69.jpg saved to cache
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4825a8bf-d35d-5f09-850c-b24e7644b19e
2026-03-30 10:56:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c958bc95-5874-5814-bae6-988836f812e4 with identifier: YM22646
2026-03-30 10:56:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c958bc95-5874-5814-bae6-988836f812e4 with identifier: YM22646
2026-03-30 10:56:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c958bc95-5874-5814-bae6-988836f812e4 with identifier: YM22646 to the API
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_7faee754e26f4c22bc311556b5b68a8e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:27:19Z',
 'fuel_type': 'petrol',
 'id': 'c958bc95-5874-5814-bae6-988836f812e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM22646',
 'listing': 'auction',
 'location': 'DE, Bielefeld',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 48831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_856cfc2ce9457a4a8b49028156d6db4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2659176,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_1381da30f15d88bd87a194a53e3dfe73.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2758904,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_12f4a1451a468d8d714daf41dc4f10be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2552831,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_42a117290aed78dba96bb1b41c796937.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2713160,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_9cb6cdfc03fd9efd4acc4f7e8164988c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2686127,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_0b56df8261ba6327cc1536476bbbcbba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2671618,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_753507badf0448e114fe4515597c8c4a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2873273,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_7faee754e26f4c22bc311556b5b68a8e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_51fc831de9bf8b81a92e5a2fceb0213d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c958bc95-5874-5814-bae6-988836f812e4/c958bc95-5874-5814-bae6-988836f812e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5806dbd71c9c1e13d7206850151a231/pa/YM22646_02d458d453607f0eeac0e740ed6f8643.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-08-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Adam 1.2 Jam',
 'transmission': 'manual',
 'trim': 'Jam',
 'year': 2015}
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM22646%27 HTTP/1.1" 200 None
2026-03-30 10:56:25 [auto1.de] INFO: Saving data for YM22646: {'created_time': 1774868185.353836, 'last_price_update_time': 1774868185.353847, 'auction_closing_time': 1774970839.0}
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM22646') HTTP/1.1" 204 0
2026-03-30 10:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_59c8bc5dfc1ac4c19c05804062299b16.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_86b822aae37ad4e1ca1f7e00dbdf6600.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS87926> (referer: https://www.auto1.com/v1/car-details-view/BS87926/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_fba3efde266699d253b4e9d5ef719859.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_e32e0c292fe97c5dbbd3c3f0e2f840b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_03adb230b068ccadc81429503673db22.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_de5dad87d09d7e0d92d1751307aed863.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_114d49eb9e89f717937381b4806e22bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_ab3a5d5062e527888452238cb9a2ee8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_dfd467cb2ffdcf1f9462924e571a9379.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_1ec91414125c75abc5d1614506a81a64.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_c5940c8d8acaf63665b1b54e214a80de.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f4347a10>
2026-03-30 10:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_59c8bc5dfc1ac4c19c05804062299b16.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_59c8bc5dfc1ac4c19c05804062299b16.jpg saved to cache
2026-03-30 10:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4825a8bf-d35d-5f09-850c-b24e7644b19e
2026-03-30 10:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42b7750>
2026-03-30 10:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_86b822aae37ad4e1ca1f7e00dbdf6600.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_86b822aae37ad4e1ca1f7e00dbdf6600.jpg saved to cache
2026-03-30 10:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4825a8bf-d35d-5f09-850c-b24e7644b19e
2026-03-30 10:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_b4f4e599d061a6b53387f2d2b4deeaeb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_04216d08507532ac5e65dfc92010635a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac6ab20f-4eee-5099-ad9e-f207405ff14c with identifier: BS87926
2026-03-30 10:56:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac6ab20f-4eee-5099-ad9e-f207405ff14c with scrape type 1
2026-03-30 10:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac6ab20f-4eee-5099-ad9e-f207405ff14c
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff9%252Fdaf95abe3f4f4c7e51de6f73b139b834%252Fpa%252FBS87926_15bbec5e85219834cab097fb830c6728.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_15bbec5e85219834cab097fb830c6728.jpg already downloaded
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff9%252Fdaf95abe3f4f4c7e51de6f73b139b834%252Fpa%252FBS87926_d5c409fe848e31f82cf47842b1154cbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_d5c409fe848e31f82cf47842b1154cbd.jpg already downloaded
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff9%252Fdaf95abe3f4f4c7e51de6f73b139b834%252Fpa%252FBS87926_2538ec93dd214c605e641a31f339e5e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_2538ec93dd214c605e641a31f339e5e0.jpg already downloaded
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff9%252Fdaf95abe3f4f4c7e51de6f73b139b834%252Fpa%252FBS87926_b8999594f81f1fe58c5b9cf4762b9b19.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_b8999594f81f1fe58c5b9cf4762b9b19.jpg already downloaded
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff9%252Fdaf95abe3f4f4c7e51de6f73b139b834%252Fpa%252FBS87926_beb384ad46a617b3b6ef06a7541a3b89.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_beb384ad46a617b3b6ef06a7541a3b89.jpg already downloaded
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff9%252Fdaf95abe3f4f4c7e51de6f73b139b834%252Fpa%252FBS87926_cc400904e3869a80ac83ac5261dbdf42.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_cc400904e3869a80ac83ac5261dbdf42.jpg already downloaded
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff9%252Fdaf95abe3f4f4c7e51de6f73b139b834%252Fpa%252FBS87926_f436151946913f9d0441d972290a86d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_f436151946913f9d0441d972290a86d8.jpg already downloaded
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff9%252Fdaf95abe3f4f4c7e51de6f73b139b834%252Fpa%252FBS87926_a687be618e143d5e7758ad9d9f78de33.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_a687be618e143d5e7758ad9d9f78de33.jpg already downloaded
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff9%252Fdaf95abe3f4f4c7e51de6f73b139b834%252Fpa%252FBS87926_30da0d6dbab0274e3f71fb4a5b485f9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_30da0d6dbab0274e3f71fb4a5b485f9d.jpg already downloaded
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff9%252Fdaf95abe3f4f4c7e51de6f73b139b834%252Fpa%252FBS87926_3d9358e6f1d49d07d24ef86d3911bae7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_3d9358e6f1d49d07d24ef86d3911bae7.jpg already downloaded
2026-03-30 10:56:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac6ab20f-4eee-5099-ad9e-f207405ff14c, identifier: BS87926
2026-03-30 10:56:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f42b6790>
2026-03-30 10:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_fba3efde266699d253b4e9d5ef719859.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_fba3efde266699d253b4e9d5ef719859.jpg saved to cache
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c83b191b-b4e4-5ae7-ad70-0fee672d34dd
2026-03-30 10:56:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef77710>
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_e32e0c292fe97c5dbbd3c3f0e2f840b1.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_e32e0c292fe97c5dbbd3c3f0e2f840b1.jpg saved to cache
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 46856877-b8d0-5527-8585-25e182d2ac9c
2026-03-30 10:56:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeb34d0>
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_03adb230b068ccadc81429503673db22.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_03adb230b068ccadc81429503673db22.jpg saved to cache
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c83b191b-b4e4-5ae7-ad70-0fee672d34dd
2026-03-30 10:56:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f5c07710>
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_de5dad87d09d7e0d92d1751307aed863.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_de5dad87d09d7e0d92d1751307aed863.jpg saved to cache
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c83b191b-b4e4-5ae7-ad70-0fee672d34dd
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3d0ad0>
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_114d49eb9e89f717937381b4806e22bc.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_114d49eb9e89f717937381b4806e22bc.jpg saved to cache
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46856877-b8d0-5527-8585-25e182d2ac9c
2026-03-30 10:56:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eed06d10>
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_ab3a5d5062e527888452238cb9a2ee8f.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_ab3a5d5062e527888452238cb9a2ee8f.jpg saved to cache
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c83b191b-b4e4-5ae7-ad70-0fee672d34dd
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f06d0>
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_dfd467cb2ffdcf1f9462924e571a9379.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_dfd467cb2ffdcf1f9462924e571a9379.jpg saved to cache
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4825a8bf-d35d-5f09-850c-b24e7644b19e
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eeeba110>
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fbf%252F23bf9f57e4de00bf73da79e92808d704%252Fpa%252FGU29210_1ec91414125c75abc5d1614506a81a64.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_1ec91414125c75abc5d1614506a81a64.jpg saved to cache
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4825a8bf-d35d-5f09-850c-b24e7644b19e
2026-03-30 10:56:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4825a8bf-d35d-5f09-850c-b24e7644b19e, skipping ID generation
2026-03-30 10:56:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4825a8bf-d35d-5f09-850c-b24e7644b19e with scrape type 1
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4825a8bf-d35d-5f09-850c-b24e7644b19e sending to next pipeline
2026-03-30 10:56:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4825a8bf-d35d-5f09-850c-b24e7644b19e, identifier: GU29210
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eef0fb10>
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_c5940c8d8acaf63665b1b54e214a80de.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_c5940c8d8acaf63665b1b54e214a80de.jpg saved to cache
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46856877-b8d0-5527-8585-25e182d2ac9c
2026-03-30 10:56:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac6ab20f-4eee-5099-ad9e-f207405ff14c with identifier: BS87926
2026-03-30 10:56:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac6ab20f-4eee-5099-ad9e-f207405ff14c with identifier: BS87926
2026-03-30 10:56:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac6ab20f-4eee-5099-ad9e-f207405ff14c with identifier: BS87926 to the API
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BS87926>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:16:33Z',
 'fuel_type': 'petrol',
 'id': 'ac6ab20f-4eee-5099-ad9e-f207405ff14c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS87926',
 'listing': 'auction',
 'location': 'DE, Mönchengladbach',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 134243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_15bbec5e85219834cab097fb830c6728.jpg',
                'https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_d5c409fe848e31f82cf47842b1154cbd.jpg',
                'https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_2538ec93dd214c605e641a31f339e5e0.jpg',
                'https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_b8999594f81f1fe58c5b9cf4762b9b19.jpg',
                'https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_beb384ad46a617b3b6ef06a7541a3b89.jpg',
                'https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_cc400904e3869a80ac83ac5261dbdf42.jpg',
                'https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_f436151946913f9d0441d972290a86d8.jpg',
                'https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_a687be618e143d5e7758ad9d9f78de33.jpg',
                'https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_30da0d6dbab0274e3f71fb4a5b485f9d.jpg',
                'https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_3d9358e6f1d49d07d24ef86d3911bae7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac6ab20f-4eee-5099-ad9e-f207405ff14c/ac6ab20f-4eee-5099-ad9e-f207405ff14c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_15bbec5e85219834cab097fb830c6728.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac6ab20f-4eee-5099-ad9e-f207405ff14c/ac6ab20f-4eee-5099-ad9e-f207405ff14c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_d5c409fe848e31f82cf47842b1154cbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac6ab20f-4eee-5099-ad9e-f207405ff14c/ac6ab20f-4eee-5099-ad9e-f207405ff14c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_2538ec93dd214c605e641a31f339e5e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac6ab20f-4eee-5099-ad9e-f207405ff14c/ac6ab20f-4eee-5099-ad9e-f207405ff14c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_b8999594f81f1fe58c5b9cf4762b9b19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac6ab20f-4eee-5099-ad9e-f207405ff14c/ac6ab20f-4eee-5099-ad9e-f207405ff14c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_beb384ad46a617b3b6ef06a7541a3b89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac6ab20f-4eee-5099-ad9e-f207405ff14c/ac6ab20f-4eee-5099-ad9e-f207405ff14c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_cc400904e3869a80ac83ac5261dbdf42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac6ab20f-4eee-5099-ad9e-f207405ff14c/ac6ab20f-4eee-5099-ad9e-f207405ff14c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_f436151946913f9d0441d972290a86d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac6ab20f-4eee-5099-ad9e-f207405ff14c/ac6ab20f-4eee-5099-ad9e-f207405ff14c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_a687be618e143d5e7758ad9d9f78de33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac6ab20f-4eee-5099-ad9e-f207405ff14c/ac6ab20f-4eee-5099-ad9e-f207405ff14c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_30da0d6dbab0274e3f71fb4a5b485f9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac6ab20f-4eee-5099-ad9e-f207405ff14c/ac6ab20f-4eee-5099-ad9e-f207405ff14c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f9/daf95abe3f4f4c7e51de6f73b139b834/pa/BS87926_3d9358e6f1d49d07d24ef86d3911bae7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2017}
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS87926%27 HTTP/1.1" 200 None
2026-03-30 10:56:27 [auto1.de] INFO: Saving data for BS87926: {'created_time': 1774868187.127315, 'last_price_update_time': 1774868187.127324, 'auction_closing_time': 1774970193.0}
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS87926') HTTP/1.1" 204 0
2026-03-30 10:56:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4825a8bf-d35d-5f09-850c-b24e7644b19e with identifier: GU29210
2026-03-30 10:56:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4825a8bf-d35d-5f09-850c-b24e7644b19e with identifier: GU29210
2026-03-30 10:56:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4825a8bf-d35d-5f09-850c-b24e7644b19e with identifier: GU29210 to the API
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_1ec91414125c75abc5d1614506a81a64.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:27:15Z',
 'fuel_type': 'diesel',
 'id': '4825a8bf-d35d-5f09-850c-b24e7644b19e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU29210',
 'listing': 'auction',
 'location': 'DE, Mülheim an der Ruhr',
 'make': 'Volvo',
 'model': 'S80',
 'odometer': 129213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_4374485b59a3fae342ddef2b5bc4ef5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_1ec91414125c75abc5d1614506a81a64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_dfd467cb2ffdcf1f9462924e571a9379.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_a2cafa77fbb90844d408ec1a842c7ae0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_59c8bc5dfc1ac4c19c05804062299b16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_73549c36a74f7a969952acc2b4059b05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_d7529feb629e6cb1ce955ca78970f0fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_6dcf13973b62e2a1d18fdd48ddacec69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_86b822aae37ad4e1ca1f7e00dbdf6600.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4825a8bf-d35d-5f09-850c-b24e7644b19e/4825a8bf-d35d-5f09-850c-b24e7644b19e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/bf/23bf9f57e4de00bf73da79e92808d704/pa/GU29210_e6422d1551eb2b112f679962c0bfd490.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo S80 2.0 D4 Summum',
 'transmission': 'automatic',
 'trim': 'Summum',
 'year': 2014}
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU29210%27 HTTP/1.1" 200 None
2026-03-30 10:56:27 [auto1.de] INFO: Saving data for GU29210: {'created_time': 1774868187.52953, 'last_price_update_time': 1774868187.529542, 'auction_closing_time': 1774970835.0}
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU29210') HTTP/1.1" 204 0
2026-03-30 10:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL44945/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_534db5c757c14e84133bef3a1e124165.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee473010>
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_b4f4e599d061a6b53387f2d2b4deeaeb.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_b4f4e599d061a6b53387f2d2b4deeaeb.jpg saved to cache
2026-03-30 10:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46856877-b8d0-5527-8585-25e182d2ac9c
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13f40c5650>
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_04216d08507532ac5e65dfc92010635a.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_04216d08507532ac5e65dfc92010635a.jpg saved to cache
2026-03-30 10:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c83b191b-b4e4-5ae7-ad70-0fee672d34dd
2026-03-30 10:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_676901d1b333b024a80a461a672507a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_e8da5421a90d954b7a640ce375646412.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_f54be514570ac59ea9c703549f5f26a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee471090>
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_534db5c757c14e84133bef3a1e124165.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_534db5c757c14e84133bef3a1e124165.jpg saved to cache
2026-03-30 10:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 46856877-b8d0-5527-8585-25e182d2ac9c
2026-03-30 10:56:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13ee3f0590>
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_676901d1b333b024a80a461a672507a2.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_676901d1b333b024a80a461a672507a2.jpg saved to cache
2026-03-30 10:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46856877-b8d0-5527-8585-25e182d2ac9c
2026-03-30 10:56:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eefde090>
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_e8da5421a90d954b7a640ce375646412.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_e8da5421a90d954b7a640ce375646412.jpg saved to cache
2026-03-30 10:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c83b191b-b4e4-5ae7-ad70-0fee672d34dd
2026-03-30 10:56:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eed57790>
2026-03-30 10:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F26%252F0126194caea97a14e5726fc6a8cffd8d%252Fpa%252FYR94789_f54be514570ac59ea9c703549f5f26a8.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_f54be514570ac59ea9c703549f5f26a8.jpg saved to cache
2026-03-30 10:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c83b191b-b4e4-5ae7-ad70-0fee672d34dd
2026-03-30 10:56:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c83b191b-b4e4-5ae7-ad70-0fee672d34dd, skipping ID generation
2026-03-30 10:56:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c83b191b-b4e4-5ae7-ad70-0fee672d34dd with scrape type 1
2026-03-30 10:56:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c83b191b-b4e4-5ae7-ad70-0fee672d34dd sending to next pipeline
2026-03-30 10:56:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c83b191b-b4e4-5ae7-ad70-0fee672d34dd, identifier: YR94789
2026-03-30 10:56:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c83b191b-b4e4-5ae7-ad70-0fee672d34dd with identifier: YR94789
2026-03-30 10:56:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c83b191b-b4e4-5ae7-ad70-0fee672d34dd with identifier: YR94789
2026-03-30 10:56:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c83b191b-b4e4-5ae7-ad70-0fee672d34dd with identifier: YR94789 to the API
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_f54be514570ac59ea9c703549f5f26a8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 90,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:58:06Z',
 'fuel_type': 'petrol',
 'id': 'c83b191b-b4e4-5ae7-ad70-0fee672d34dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR94789',
 'listing': 'auction',
 'location': 'DE, Reutlingen',
 'make': 'Fiat',
 'model': '500',
 'odometer': 71183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_f3d8446796dfff9a4a7c4642cebf9619.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_56a0d150f0bf9c9e87c0073bff35d58d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3004952,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_fba3efde266699d253b4e9d5ef719859.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_39ee0983777ab55fae0c6e6723077d04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2992925,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_e8da5421a90d954b7a640ce375646412.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3076259,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_f54be514570ac59ea9c703549f5f26a8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_04216d08507532ac5e65dfc92010635a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2979013,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_ab3a5d5062e527888452238cb9a2ee8f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2767876,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_03adb230b068ccadc81429503673db22.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c83b191b-b4e4-5ae7-ad70-0fee672d34dd/c83b191b-b4e4-5ae7-ad70-0fee672d34dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2751565,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/26/0126194caea97a14e5726fc6a8cffd8d/pa/YR94789_de5dad87d09d7e0d92d1751307aed863.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 0.9 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2013}
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR94789%27 HTTP/1.1" 200 None
2026-03-30 10:56:28 [auto1.de] INFO: Saving data for YR94789: {'created_time': 1774868188.806474, 'last_price_update_time': 1774868188.806488, 'auction_closing_time': 1774972686.0}
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR94789') HTTP/1.1" 204 0
2026-03-30 10:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_1a8cb48fb7263c48f3642c080d32c402.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:28 [auto1.de] INFO: Channel: 24h | Page: 60 | totalHits: 9530 | hits on page: 40
2026-03-30 10:56:28 [auto1.de] INFO: Found listing with ID: KK35526
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK35526%27 HTTP/1.1" 200 None
2026-03-30 10:56:28 [auto1.de] INFO: Scrape type for KK35526: 0
2026-03-30 10:56:28 [auto1.de] INFO: Found listing with ID: VW77341
2026-03-30 10:56:28 [auto1.de] INFO: Found listing with ID: WZ77198
2026-03-30 10:56:28 [auto1.de] INFO: Found listing with ID: TG94099
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG94099%27 HTTP/1.1" 200 None
2026-03-30 10:56:28 [auto1.de] INFO: Scrape type for TG94099: 0
2026-03-30 10:56:28 [auto1.de] INFO: Found listing with ID: YU83796
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU83796%27 HTTP/1.1" 200 None
2026-03-30 10:56:28 [auto1.de] INFO: Scrape type for YU83796: 0
2026-03-30 10:56:28 [auto1.de] INFO: Found listing with ID: UC27013
2026-03-30 10:56:28 [auto1.de] INFO: Found listing with ID: HJ07036
2026-03-30 10:56:28 [auto1.de] INFO: Found listing with ID: ZL07849
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL07849%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Scrape type for ZL07849: 0
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: CK09368
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK09368%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Scrape type for CK09368: 0
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: TX17036
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX17036%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Scrape type for TX17036: 0
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: NH50671
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: JZ46683
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: KT14337
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT14337%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Scrape type for KT14337: 0
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: VP04465
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: SE69152
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE69152%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Scrape type for SE69152: 0
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: UH00780
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH00780%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Scrape type for UH00780: 0
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: NN66793
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN66793%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Scrape type for NN66793: 0
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: MB72804
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: XL83626
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: NH44567
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH44567%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Scrape type for NH44567: 0
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: YB27715
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: RC35240
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC35240%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Scrape type for RC35240: 0
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: CN96399
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN96399%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Scrape type for CN96399: 0
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: SW53580
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: CM53141
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: BR53160
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR53160%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Scrape type for BR53160: 0
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: ZU01908
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: SB15541
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: CX00387
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX00387%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Scrape type for CX00387: 0
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: ZJ50870
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: SA09294
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: US58549
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: XS09920
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: TB77328
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77328%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Scrape type for TB77328: 0
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: TH98147
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: RE75426
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE75426%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Scrape type for RE75426: 0
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: ML92935
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML92935%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Scrape type for ML92935: 0
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: RZ20134
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: SB11032
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB11032%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Scrape type for SB11032: 0
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: GW45177
2026-03-30 10:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f13eee81010>
2026-03-30 10:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F8c%252F9c8c57d610fc3c8a06b0b9b1480343b3%252Fpa%252FFL96741_1a8cb48fb7263c48f3642c080d32c402.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_1a8cb48fb7263c48f3642c080d32c402.jpg saved to cache
2026-03-30 10:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46856877-b8d0-5527-8585-25e182d2ac9c
2026-03-30 10:56:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46856877-b8d0-5527-8585-25e182d2ac9c, skipping ID generation
2026-03-30 10:56:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46856877-b8d0-5527-8585-25e182d2ac9c with scrape type 1
2026-03-30 10:56:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46856877-b8d0-5527-8585-25e182d2ac9c sending to next pipeline
2026-03-30 10:56:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46856877-b8d0-5527-8585-25e182d2ac9c, identifier: FL96741
2026-03-30 10:56:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46856877-b8d0-5527-8585-25e182d2ac9c with identifier: FL96741
2026-03-30 10:56:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46856877-b8d0-5527-8585-25e182d2ac9c with identifier: FL96741
2026-03-30 10:56:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46856877-b8d0-5527-8585-25e182d2ac9c with identifier: FL96741 to the API
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_1a8cb48fb7263c48f3642c080d32c402.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:42:09Z',
 'fuel_type': 'diesel',
 'id': '46856877-b8d0-5527-8585-25e182d2ac9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL96741',
 'listing': 'auction',
 'location': 'DE, Schweinfurt',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 190881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_fc9e2884144046a7279bd78fce651a95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_7e1bb9d5f0d6cb27662527c2b9638f9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_d6e626ec63cf2b6b2577667d7cbd6f5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2026923,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_1a8cb48fb7263c48f3642c080d32c402.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199068,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_b4f4e599d061a6b53387f2d2b4deeaeb.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2076185,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_676901d1b333b024a80a461a672507a2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_c5940c8d8acaf63665b1b54e214a80de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_114d49eb9e89f717937381b4806e22bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2056745,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_e32e0c292fe97c5dbbd3c3f0e2f840b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46856877-b8d0-5527-8585-25e182d2ac9c/46856877-b8d0-5527-8585-25e182d2ac9c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2174688,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/8c/9c8c57d610fc3c8a06b0b9b1480343b3/pa/FL96741_534db5c757c14e84133bef3a1e124165.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda CR-V 2.2 DTEC Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2012}
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL96741%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Saving data for FL96741: {'created_time': 1774868189.839964, 'last_price_update_time': 1774868189.839975, 'auction_closing_time': 1774971729.0}
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL96741') HTTP/1.1" 204 0
2026-03-30 10:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL44945> (referer: https://www.auto1.com/v1/car-details-view/XL44945/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afe07f55-31df-5cd8-a808-397be2247f5b with identifier: XL44945
2026-03-30 10:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afe07f55-31df-5cd8-a808-397be2247f5b with scrape type 1
2026-03-30 10:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item afe07f55-31df-5cd8-a808-397be2247f5b
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F24%252F8324922ac1b6eae01bf9cff2b1880a18%252Fpa%252FXL44945_ae4cb33ab4afce1c3bf18fa58b8ccd59.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_ae4cb33ab4afce1c3bf18fa58b8ccd59.jpg already downloaded
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F24%252F8324922ac1b6eae01bf9cff2b1880a18%252Fpa%252FXL44945_c1456e19fa0384bd09cb172baf0eda33.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_c1456e19fa0384bd09cb172baf0eda33.jpg already downloaded
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F24%252F8324922ac1b6eae01bf9cff2b1880a18%252Fpa%252FXL44945_4f458e7e938d094e86161f0605832448.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_4f458e7e938d094e86161f0605832448.jpg already downloaded
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F24%252F8324922ac1b6eae01bf9cff2b1880a18%252Fpa%252FXL44945_8bd42f3308130166836def47e17c5ee8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_8bd42f3308130166836def47e17c5ee8.jpg already downloaded
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F24%252F8324922ac1b6eae01bf9cff2b1880a18%252Fpa%252FXL44945_e6f1d3d64e9461219fcfb80fb4e9b771.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_e6f1d3d64e9461219fcfb80fb4e9b771.jpg already downloaded
2026-03-30 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F24%252F8324922ac1b6eae01bf9cff2b1880a18%252Fpa%252FXL44945_3af91e452deb867b8dae5d0e47f0daa6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_3af91e452deb867b8dae5d0e47f0daa6.jpg already downloaded
2026-03-30 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F24%252F8324922ac1b6eae01bf9cff2b1880a18%252Fpa%252FXL44945_de63e9cc231108ef557370f56d0f26f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_de63e9cc231108ef557370f56d0f26f1.jpg already downloaded
2026-03-30 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F24%252F8324922ac1b6eae01bf9cff2b1880a18%252Fpa%252FXL44945_51b1623e6b6025bc2dada28acd2a950d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_51b1623e6b6025bc2dada28acd2a950d.jpg already downloaded
2026-03-30 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F24%252F8324922ac1b6eae01bf9cff2b1880a18%252Fpa%252FXL44945_9b994c50c00a3b6b0c1935107a32ae57.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_9b994c50c00a3b6b0c1935107a32ae57.jpg already downloaded
2026-03-30 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F24%252F8324922ac1b6eae01bf9cff2b1880a18%252Fpa%252FXL44945_2e088f3e60d845262f5df0f48d2c4896.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_2e088f3e60d845262f5df0f48d2c4896.jpg already downloaded
2026-03-30 10:56:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afe07f55-31df-5cd8-a808-397be2247f5b, identifier: XL44945
2026-03-30 10:56:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afe07f55-31df-5cd8-a808-397be2247f5b with identifier: XL44945
2026-03-30 10:56:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afe07f55-31df-5cd8-a808-397be2247f5b with identifier: XL44945
2026-03-30 10:56:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afe07f55-31df-5cd8-a808-397be2247f5b with identifier: XL44945 to the API
2026-03-30 10:56:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XL44945>
{'auction_title': '',
 'c_o_2_emission_value': 225,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:49:08Z',
 'fuel_type': 'diesel',
 'id': 'afe07f55-31df-5cd8-a808-397be2247f5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL44945',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 70343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_ae4cb33ab4afce1c3bf18fa58b8ccd59.jpg',
                'https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_c1456e19fa0384bd09cb172baf0eda33.jpg',
                'https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_4f458e7e938d094e86161f0605832448.jpg',
                'https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_8bd42f3308130166836def47e17c5ee8.jpg',
                'https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_e6f1d3d64e9461219fcfb80fb4e9b771.jpg',
                'https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_3af91e452deb867b8dae5d0e47f0daa6.jpg',
                'https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_de63e9cc231108ef557370f56d0f26f1.jpg',
                'https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_51b1623e6b6025bc2dada28acd2a950d.jpg',
                'https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_9b994c50c00a3b6b0c1935107a32ae57.jpg',
                'https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_2e088f3e60d845262f5df0f48d2c4896.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afe07f55-31df-5cd8-a808-397be2247f5b/afe07f55-31df-5cd8-a808-397be2247f5b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_ae4cb33ab4afce1c3bf18fa58b8ccd59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afe07f55-31df-5cd8-a808-397be2247f5b/afe07f55-31df-5cd8-a808-397be2247f5b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_c1456e19fa0384bd09cb172baf0eda33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afe07f55-31df-5cd8-a808-397be2247f5b/afe07f55-31df-5cd8-a808-397be2247f5b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_4f458e7e938d094e86161f0605832448.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afe07f55-31df-5cd8-a808-397be2247f5b/afe07f55-31df-5cd8-a808-397be2247f5b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_8bd42f3308130166836def47e17c5ee8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afe07f55-31df-5cd8-a808-397be2247f5b/afe07f55-31df-5cd8-a808-397be2247f5b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_e6f1d3d64e9461219fcfb80fb4e9b771.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afe07f55-31df-5cd8-a808-397be2247f5b/afe07f55-31df-5cd8-a808-397be2247f5b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_3af91e452deb867b8dae5d0e47f0daa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afe07f55-31df-5cd8-a808-397be2247f5b/afe07f55-31df-5cd8-a808-397be2247f5b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_de63e9cc231108ef557370f56d0f26f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afe07f55-31df-5cd8-a808-397be2247f5b/afe07f55-31df-5cd8-a808-397be2247f5b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_51b1623e6b6025bc2dada28acd2a950d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afe07f55-31df-5cd8-a808-397be2247f5b/afe07f55-31df-5cd8-a808-397be2247f5b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_9b994c50c00a3b6b0c1935107a32ae57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afe07f55-31df-5cd8-a808-397be2247f5b/afe07f55-31df-5cd8-a808-397be2247f5b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/24/8324922ac1b6eae01bf9cff2b1880a18/pa/XL44945_2e088f3e60d845262f5df0f48d2c4896.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport D300 Mild-Hybrid HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2021}
2026-03-30 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL44945%27 HTTP/1.1" 200 None
2026-03-30 10:56:31 [auto1.de] INFO: Saving data for XL44945: {'created_time': 1774868191.88995, 'last_price_update_time': 1774868191.889961, 'auction_closing_time': 1774972148.0}
2026-03-30 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL44945') HTTP/1.1" 204 0
2026-03-30 10:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:32 [auto1.de] INFO: Channel: 24h | Page: 61 | totalHits: 9531 | hits on page: 40
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: GW45177
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: PH37878
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH37878%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for PH37878: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: TS70088
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS70088%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for TS70088: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: SR07530
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: ZG29710
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG29710%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for ZG29710: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: HH97697
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: LZ90334
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ90334%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for LZ90334: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: CD25494
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD25494%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for CD25494: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: XV83798
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV83798%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for XV83798: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: XC52601
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC52601%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for XC52601: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: EA67051
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA67051%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for EA67051: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: ZB59914
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: TJ43394
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: LS48573
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: ZT46656
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: EV60549
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV60549%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for EV60549: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: XP13096
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP13096%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for XP13096: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: LZ55907
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ55907%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for LZ55907: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: PY11088
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: NC09398
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: RY54075
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: SN65200
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN65200%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for SN65200: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: GW59315
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW59315%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for GW59315: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: KP40220
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: LE91288
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: MZ36812
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ36812%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for MZ36812: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: FM88493
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM88493%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for FM88493: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: KX98673
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: XW15114
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW15114%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for XW15114: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: TC34492
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC34492%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for TC34492: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: CL81037
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL81037%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for CL81037: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: CX20587
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: FA98768
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: VE81864
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: TD89084
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD89084%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for TD89084: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: NA47397
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: NJ85165
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: MS93141
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: PY91444
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY91444%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for PY91444: 0
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: MT16554
2026-03-30 10:56:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:43 [auto1.de] INFO: Channel: 24h | Page: 62 | totalHits: 9532 | hits on page: 40
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: MT16554
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: UJ03238
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: MJ68387
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: CL53186
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: ZT52694
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: VG52459
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG52459%27 HTTP/1.1" 200 None
2026-03-30 10:56:43 [auto1.de] INFO: Scrape type for VG52459: 0
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: HX90718
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX90718%27 HTTP/1.1" 200 None
2026-03-30 10:56:43 [auto1.de] INFO: Scrape type for HX90718: 0
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: VD66153
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD66153%27 HTTP/1.1" 200 None
2026-03-30 10:56:43 [auto1.de] INFO: Scrape type for VD66153: 0
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: ZE47556
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE47556%27 HTTP/1.1" 200 None
2026-03-30 10:56:43 [auto1.de] INFO: Scrape type for ZE47556: 0
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: UX02896
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: DD06486
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: BF72847
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: GB26940
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: VT33840
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT33840%27 HTTP/1.1" 200 None
2026-03-30 10:56:43 [auto1.de] INFO: Scrape type for VT33840: 0
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: GC65720
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC65720%27 HTTP/1.1" 200 None
2026-03-30 10:56:43 [auto1.de] INFO: Scrape type for GC65720: 0
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: FG52095
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: HR38686
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR38686%27 HTTP/1.1" 200 None
2026-03-30 10:56:43 [auto1.de] INFO: Scrape type for HR38686: 0
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: VK11112
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: CX31809
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: XR03491
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: XN56575
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN56575%27 HTTP/1.1" 200 None
2026-03-30 10:56:43 [auto1.de] INFO: Scrape type for XN56575: 0
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: CX99229
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: UB29489
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: EC79499
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: ZW29576
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: RJ65711
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: PT66900
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: AH96089
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH96089%27 HTTP/1.1" 200 None
2026-03-30 10:56:43 [auto1.de] INFO: Scrape type for AH96089: 0
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: MM27884
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM27884%27 HTTP/1.1" 200 None
2026-03-30 10:56:43 [auto1.de] INFO: Scrape type for MM27884: 0
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: DD72399
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: BZ48067
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ48067%27 HTTP/1.1" 200 None
2026-03-30 10:56:43 [auto1.de] INFO: Scrape type for BZ48067: 0
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: LE66161
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: UA27287
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: ME76972
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME76972%27 HTTP/1.1" 200 None
2026-03-30 10:56:43 [auto1.de] INFO: Scrape type for ME76972: 0
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: TG05254
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG05254%27 HTTP/1.1" 200 None
2026-03-30 10:56:43 [auto1.de] INFO: Scrape type for TG05254: 0
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: JA57202
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA57202%27 HTTP/1.1" 200 None
2026-03-30 10:56:43 [auto1.de] INFO: Scrape type for JA57202: 0
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: SK58991
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK58991%27 HTTP/1.1" 200 None
2026-03-30 10:56:43 [auto1.de] INFO: Scrape type for SK58991: 0
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: XZ11049
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ11049%27 HTTP/1.1" 200 None
2026-03-30 10:56:43 [auto1.de] INFO: Scrape type for XZ11049: 0
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: NF89910
2026-03-30 10:56:43 [auto1.de] INFO: Found listing with ID: FE38357
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE38357%27 HTTP/1.1" 200 None
2026-03-30 10:56:43 [auto1.de] INFO: Scrape type for FE38357: 0
2026-03-30 10:56:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:51 [auto1.de] INFO: Channel: 24h | Page: 63 | totalHits: 9533 | hits on page: 40
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: FE38357
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE38357%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for FE38357: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: ZX71728
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX71728%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for ZX71728: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: ZM89162
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM89162%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for ZM89162: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: DW65340
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: MU67757
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: PC88628
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC88628%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for PC88628: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: KL56138
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: GD26673
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD26673%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for GD26673: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: HT75427
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT75427%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for HT75427: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: YK11401
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: FH85509
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH85509%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for FH85509: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: GT95887
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT95887%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for GT95887: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: RY03254
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: HC65117
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: GB84908
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: EK94658
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: ED11962
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: VN83925
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN83925%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for VN83925: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: XT16299
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: UP75905
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP75905%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for UP75905: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: MY33164
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY33164%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for MY33164: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: VF16052
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF16052%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for VF16052: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: XX48334
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: DB70642
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB70642%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for DB70642: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: HR43739
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: EG30770
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG30770%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for EG30770: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: SK51252
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK51252%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for SK51252: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: HT21123
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: DZ62505
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: WH88293
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: RF59698
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: XW26615
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW26615%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for XW26615: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: UM20037
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: JB45196
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB45196%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for JB45196: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: CW07169
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: CS17567
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: LY36951
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY36951%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for LY36951: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: CX43876
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: UX30776
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX30776%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for UX30776: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: SP41930
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41930%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for SP41930: 0
2026-03-30 10:56:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:53 [auto1.de] INFO: Channel: 24h | Page: 64 | totalHits: 9533 | hits on page: 40
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: MF04152
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF04152%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for MF04152: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: GJ50570
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ50570%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for GJ50570: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: VR14324
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR14324%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for VR14324: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: PA10623
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA10623%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for PA10623: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: YF78149
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF78149%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for YF78149: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: ZB29861
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB29861%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for ZB29861: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: RM92330
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM92330%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for RM92330: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: KU93017
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU93017%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for KU93017: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: AD78216
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD78216%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for AD78216: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: JH04930
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: VK94539
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: SZ33813
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ33813%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for SZ33813: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: EL52621
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL52621%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for EL52621: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: DV12193
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: GK03673
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: RY37161
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: UU64568
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: AN57238
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: FY49050
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY49050%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for FY49050: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: EA94412
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA94412%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for EA94412: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: KD88298
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD88298%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for KD88298: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: HD75815
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD75815%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for HD75815: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: AL25278
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL25278%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for AL25278: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: VW31483
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: UN85261
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN85261%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for UN85261: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: DE44108
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE44108%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for DE44108: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: PS73688
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: HK59987
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: KU46528
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU46528%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for KU46528: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: GG93073
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: JV37184
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: CS96512
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: AV64350
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: FN76281
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN76281%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for FN76281: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: TT64948
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT64948%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for TT64948: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: YM08945
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM08945%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for YM08945: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: KB35641
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB35641%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for KB35641: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: AC60710
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC60710%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for AC60710: 0
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: HB23810
2026-03-30 10:56:53 [auto1.de] INFO: Found listing with ID: PJ19730
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ19730%27 HTTP/1.1" 200 None
2026-03-30 10:56:53 [auto1.de] INFO: Scrape type for PJ19730: 0
2026-03-30 10:56:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:01 [auto1.de] INFO: Channel: 24h | Page: 65 | totalHits: 9534 | hits on page: 40
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: PJ19730
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ19730%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for PJ19730: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: TD77753
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD77753%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for TD77753: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: BF77211
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF77211%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for BF77211: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: PN21197
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN21197%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for PN21197: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: MJ18001
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: AE43577
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE43577%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for AE43577: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: YG65441
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: AG29353
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG29353%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for AG29353: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: TZ85703
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ85703%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for TZ85703: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: UR86054
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR86054%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for UR86054: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: TY20529
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: RX59443
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX59443%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for RX59443: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: UB75058
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB75058%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for UB75058: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: TE16173
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: SC19124
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: YT41914
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: SV96004
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: CF37997
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF37997%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for CF37997: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: FA11917
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA11917%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for FA11917: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: DX58927
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX58927%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for DX58927: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: XD63498
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: JB86449
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: WP35762
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP35762%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for WP35762: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: UZ06003
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ06003%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for UZ06003: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: FU96820
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: LZ51048
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ51048%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for LZ51048: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: CS88634
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS88634%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for CS88634: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: VV53605
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV53605%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for VV53605: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: YS60575
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS60575%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for YS60575: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: HL59368
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: DG33425
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG33425%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for DG33425: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: GD75642
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD75642%27 HTTP/1.1" 200 None
2026-03-30 10:57:01 [auto1.de] INFO: Scrape type for GD75642: 0
2026-03-30 10:57:01 [auto1.de] INFO: Found listing with ID: DB45885
2026-03-30 10:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB45885%27 HTTP/1.1" 200 None
2026-03-30 10:57:02 [auto1.de] INFO: Scrape type for DB45885: 0
2026-03-30 10:57:02 [auto1.de] INFO: Found listing with ID: SF11828
2026-03-30 10:57:02 [auto1.de] INFO: Found listing with ID: RY63211
2026-03-30 10:57:02 [auto1.de] INFO: Found listing with ID: RM00087
2026-03-30 10:57:02 [auto1.de] INFO: Found listing with ID: JE79553
2026-03-30 10:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE79553%27 HTTP/1.1" 200 None
2026-03-30 10:57:02 [auto1.de] INFO: Scrape type for JE79553: 0
2026-03-30 10:57:02 [auto1.de] INFO: Found listing with ID: LM55241
2026-03-30 10:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM55241%27 HTTP/1.1" 200 None
2026-03-30 10:57:02 [auto1.de] INFO: Scrape type for LM55241: 0
2026-03-30 10:57:02 [auto1.de] INFO: Found listing with ID: HH37402
2026-03-30 10:57:02 [auto1.de] INFO: Found listing with ID: GN88157
2026-03-30 10:57:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:03 [auto1.de] INFO: Channel: 24h | Page: 66 | totalHits: 9535 | hits on page: 40
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: GN88157
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: TN02521
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN02521%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for TN02521: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: DJ06926
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ06926%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for DJ06926: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: HP46959
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP46959%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for HP46959: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: EP15828
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP15828%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for EP15828: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: CD29935
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD29935%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for CD29935: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: BX02893
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX02893%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for BX02893: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: TF97551
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF97551%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for TF97551: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: UW91893
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW91893%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for UW91893: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: RD82198
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: HH96934
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH96934%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for HH96934: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: YR25521
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR25521%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for YR25521: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: TF02726
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: RE43747
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE43747%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for RE43747: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: KJ12622
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: HG84341
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG84341%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for HG84341: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: MB78581
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB78581%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for MB78581: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: BP06971
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: ET95564
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: TB48945
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: KP65433
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP65433%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for KP65433: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: LG15498
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: VG83409
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG83409%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for VG83409: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: PV53792
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: BN18490
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: XD17470
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD17470%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for XD17470: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: FN61491
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN61491%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for FN61491: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: FK15614
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: BN13564
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: TC53143
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: DP33373
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP33373%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for DP33373: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: RS49275
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: NT12498
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT12498%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for NT12498: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: AF38150
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF38150%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for AF38150: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: HU95530
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU95530%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for HU95530: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: DR13547
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR13547%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for DR13547: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: EW76258
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW76258%27 HTTP/1.1" 200 None
2026-03-30 10:57:03 [auto1.de] INFO: Scrape type for EW76258: 0
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: AV87266
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: PV47102
2026-03-30 10:57:03 [auto1.de] INFO: Found listing with ID: AU31378
2026-03-30 10:57:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:04 [scrapy.extensions.logstats] INFO: Crawled 812 pages (at 13 pages/min), scraped 1107 items (at 40 items/min)
2026-03-30 10:57:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:06 [auto1.de] INFO: Channel: 24h | Page: 67 | totalHits: 9535 | hits on page: 40
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: GZ16727
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ16727%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for GZ16727: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: RW74261
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW74261%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for RW74261: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: UW81873
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW81873%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for UW81873: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: US20964
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: YG60561
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG60561%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for YG60561: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: MU83144
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU83144%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for MU83144: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: DN83607
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN83607%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for DN83607: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: CH63331
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH63331%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for CH63331: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: AW55090
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW55090%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for AW55090: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: DF41364
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: KS24021
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS24021%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for KS24021: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: FG90508
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: HX93212
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX93212%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for HX93212: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: YM41627
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: DW80278
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: FH27884
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: YE99980
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE99980%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for YE99980: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: NE04560
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE04560%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for NE04560: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: JT04540
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: AN60739
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: BM26089
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: YY75784
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: SY47476
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY47476%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for SY47476: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: HN83229
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN83229%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for HN83229: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: AF40953
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: VC76519
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: PS21174
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS21174%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for PS21174: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: YJ43291
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ43291%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for YJ43291: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: MM49725
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM49725%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for MM49725: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: TZ88543
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: AL17171
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL17171%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for AL17171: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: VZ09254
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: SS05467
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: RF02857
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF02857%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for RF02857: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: ZM27094
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: GF71499
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF71499%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for GF71499: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: EN37654
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN37654%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for EN37654: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: SK33918
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK33918%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for SK33918: 0
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: VV18496
2026-03-30 10:57:06 [auto1.de] INFO: Found listing with ID: BN15380
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN15380%27 HTTP/1.1" 200 None
2026-03-30 10:57:06 [auto1.de] INFO: Scrape type for BN15380: 0
2026-03-30 10:57:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:07 [auto1.de] INFO: Channel: 24h | Page: 68 | totalHits: 9535 | hits on page: 40
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: TE38995
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: GM10989
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM10989%27 HTTP/1.1" 200 None
2026-03-30 10:57:07 [auto1.de] INFO: Scrape type for GM10989: 0
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: KX99318
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: UC44293
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: DT29379
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: MY20439
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY20439%27 HTTP/1.1" 200 None
2026-03-30 10:57:07 [auto1.de] INFO: Scrape type for MY20439: 0
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: MM40978
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM40978%27 HTTP/1.1" 200 None
2026-03-30 10:57:07 [auto1.de] INFO: Scrape type for MM40978: 0
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: PX34024
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: NZ57035
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ57035%27 HTTP/1.1" 200 None
2026-03-30 10:57:07 [auto1.de] INFO: Scrape type for NZ57035: 0
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: FT91283
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT91283%27 HTTP/1.1" 200 None
2026-03-30 10:57:07 [auto1.de] INFO: Scrape type for FT91283: 0
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: LH58112
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: HJ00196
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ00196%27 HTTP/1.1" 200 None
2026-03-30 10:57:07 [auto1.de] INFO: Scrape type for HJ00196: 0
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: CD55313
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD55313%27 HTTP/1.1" 200 None
2026-03-30 10:57:07 [auto1.de] INFO: Scrape type for CD55313: 0
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: LY25058
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY25058%27 HTTP/1.1" 200 None
2026-03-30 10:57:07 [auto1.de] INFO: Scrape type for LY25058: 0
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: FA41844
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA41844%27 HTTP/1.1" 200 None
2026-03-30 10:57:07 [auto1.de] INFO: Scrape type for FA41844: 0
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: ST24513
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: ZY45638
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: ZS74444
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS74444%27 HTTP/1.1" 200 None
2026-03-30 10:57:07 [auto1.de] INFO: Scrape type for ZS74444: 0
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: ET18482
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET18482%27 HTTP/1.1" 200 None
2026-03-30 10:57:07 [auto1.de] INFO: Scrape type for ET18482: 0
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: SV36392
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: AV80430
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV80430%27 HTTP/1.1" 200 None
2026-03-30 10:57:07 [auto1.de] INFO: Scrape type for AV80430: 0
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: EK76620
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: GX57450
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: ZW22441
2026-03-30 10:57:07 [auto1.de] INFO: Found listing with ID: VS99519
2026-03-30 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS99519%27 HTTP/1.1" 200 None
2026-03-30 10:57:08 [auto1.de] INFO: Scrape type for VS99519: 0
2026-03-30 10:57:08 [auto1.de] INFO: Found listing with ID: FR72780
2026-03-30 10:57:08 [auto1.de] INFO: Found listing with ID: ZS81921
2026-03-30 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS81921%27 HTTP/1.1" 200 None
2026-03-30 10:57:08 [auto1.de] INFO: Scrape type for ZS81921: 0
2026-03-30 10:57:08 [auto1.de] INFO: Found listing with ID: YR18351
2026-03-30 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR18351%27 HTTP/1.1" 200 None
2026-03-30 10:57:08 [auto1.de] INFO: Scrape type for YR18351: 0
2026-03-30 10:57:08 [auto1.de] INFO: Found listing with ID: BP99192
2026-03-30 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP99192%27 HTTP/1.1" 200 None
2026-03-30 10:57:08 [auto1.de] INFO: Scrape type for BP99192: 0
2026-03-30 10:57:08 [auto1.de] INFO: Found listing with ID: TK82535
2026-03-30 10:57:08 [auto1.de] INFO: Found listing with ID: SR73766
2026-03-30 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR73766%27 HTTP/1.1" 200 None
2026-03-30 10:57:08 [auto1.de] INFO: Scrape type for SR73766: 0
2026-03-30 10:57:08 [auto1.de] INFO: Found listing with ID: NR41937
2026-03-30 10:57:08 [auto1.de] INFO: Found listing with ID: JD16678
2026-03-30 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD16678%27 HTTP/1.1" 200 None
2026-03-30 10:57:08 [auto1.de] INFO: Scrape type for JD16678: 0
2026-03-30 10:57:08 [auto1.de] INFO: Found listing with ID: DP71871
2026-03-30 10:57:08 [auto1.de] INFO: Found listing with ID: PC52157
2026-03-30 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC52157%27 HTTP/1.1" 200 None
2026-03-30 10:57:08 [auto1.de] INFO: Scrape type for PC52157: 0
2026-03-30 10:57:08 [auto1.de] INFO: Found listing with ID: YL08953
2026-03-30 10:57:08 [auto1.de] INFO: Found listing with ID: RS18612
2026-03-30 10:57:08 [auto1.de] INFO: Found listing with ID: AB94973
2026-03-30 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB94973%27 HTTP/1.1" 200 None
2026-03-30 10:57:08 [auto1.de] INFO: Scrape type for AB94973: 0
2026-03-30 10:57:08 [auto1.de] INFO: Found listing with ID: VL32137
2026-03-30 10:57:08 [auto1.de] INFO: Found listing with ID: DB97906
2026-03-30 10:57:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:10 [auto1.de] INFO: Channel: 24h | Page: 69 | totalHits: 9535 | hits on page: 40
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: DZ46114
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ46114%27 HTTP/1.1" 200 None
2026-03-30 10:57:10 [auto1.de] INFO: Scrape type for DZ46114: 0
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: ZL58365
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: SH12390
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH12390%27 HTTP/1.1" 200 None
2026-03-30 10:57:10 [auto1.de] INFO: Scrape type for SH12390: 0
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: ED21052
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED21052%27 HTTP/1.1" 200 None
2026-03-30 10:57:10 [auto1.de] INFO: Scrape type for ED21052: 0
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: KB70594
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: JF05487
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: XE53561
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: ZS93402
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: TS21217
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: VC14600
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC14600%27 HTTP/1.1" 200 None
2026-03-30 10:57:10 [auto1.de] INFO: Scrape type for VC14600: 0
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: EN27989
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN27989%27 HTTP/1.1" 200 None
2026-03-30 10:57:10 [auto1.de] INFO: Scrape type for EN27989: 0
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: BP13198
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP13198%27 HTTP/1.1" 200 None
2026-03-30 10:57:10 [auto1.de] INFO: Scrape type for BP13198: 0
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: PV48618
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: WM91773
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: JB80786
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB80786%27 HTTP/1.1" 200 None
2026-03-30 10:57:10 [auto1.de] INFO: Scrape type for JB80786: 0
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: MJ09553
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ09553%27 HTTP/1.1" 200 None
2026-03-30 10:57:10 [auto1.de] INFO: Scrape type for MJ09553: 0
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: JA13261
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA13261%27 HTTP/1.1" 200 None
2026-03-30 10:57:10 [auto1.de] INFO: Scrape type for JA13261: 0
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: FV55966
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: SY32033
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: FY66164
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: FG89265
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: NJ23402
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ23402%27 HTTP/1.1" 200 None
2026-03-30 10:57:10 [auto1.de] INFO: Scrape type for NJ23402: 0
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: VM87282
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM87282%27 HTTP/1.1" 200 None
2026-03-30 10:57:10 [auto1.de] INFO: Scrape type for VM87282: 0
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: SJ00642
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ00642%27 HTTP/1.1" 200 None
2026-03-30 10:57:10 [auto1.de] INFO: Scrape type for SJ00642: 0
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: KP36820
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: SN63221
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: EM09093
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: GH85781
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH85781%27 HTTP/1.1" 200 None
2026-03-30 10:57:10 [auto1.de] INFO: Scrape type for GH85781: 0
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: LV95619
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV95619%27 HTTP/1.1" 200 None
2026-03-30 10:57:10 [auto1.de] INFO: Scrape type for LV95619: 0
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: HT22196
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT22196%27 HTTP/1.1" 200 None
2026-03-30 10:57:10 [auto1.de] INFO: Scrape type for HT22196: 0
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: XY36888
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: ZS85717
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: KC21551
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: GF22355
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: VX60164
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: VV62637
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: BY75346
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY75346%27 HTTP/1.1" 200 None
2026-03-30 10:57:10 [auto1.de] INFO: Scrape type for BY75346: 0
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: CC27418
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC27418%27 HTTP/1.1" 200 None
2026-03-30 10:57:10 [auto1.de] INFO: Scrape type for CC27418: 0
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: HT72839
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT72839%27 HTTP/1.1" 200 None
2026-03-30 10:57:10 [auto1.de] INFO: Scrape type for HT72839: 0
2026-03-30 10:57:10 [auto1.de] INFO: Found listing with ID: SW78620
2026-03-30 10:57:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:11 [auto1.de] INFO: Channel: 24h | Page: 70 | totalHits: 9535 | hits on page: 40
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: XC84450
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: LT35519
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: UY47574
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: RC64435
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: KU11171
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: JB30434
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: MP54327
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: KG86059
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG86059%27 HTTP/1.1" 200 None
2026-03-30 10:57:11 [auto1.de] INFO: Scrape type for KG86059: 0
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: FZ65862
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ65862%27 HTTP/1.1" 200 None
2026-03-30 10:57:11 [auto1.de] INFO: Scrape type for FZ65862: 0
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: XU97028
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU97028%27 HTTP/1.1" 200 None
2026-03-30 10:57:11 [auto1.de] INFO: Scrape type for XU97028: 0
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: TF75057
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: TG66732
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: KX83375
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: DM93215
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM93215%27 HTTP/1.1" 200 None
2026-03-30 10:57:11 [auto1.de] INFO: Scrape type for DM93215: 0
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: EK40849
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: PU51927
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: PL78548
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: FD53596
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: RD37486
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: HW52746
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: PX20909
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX20909%27 HTTP/1.1" 200 None
2026-03-30 10:57:11 [auto1.de] INFO: Scrape type for PX20909: 0
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: CL67420
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: CC87438
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: KA69379
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: WM40779
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM40779%27 HTTP/1.1" 200 None
2026-03-30 10:57:11 [auto1.de] INFO: Scrape type for WM40779: 0
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: CJ14168
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: FR51775
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: VP95743
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP95743%27 HTTP/1.1" 200 None
2026-03-30 10:57:11 [auto1.de] INFO: Scrape type for VP95743: 0
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: BV91761
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: UP50948
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: CY77324
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY77324%27 HTTP/1.1" 200 None
2026-03-30 10:57:11 [auto1.de] INFO: Scrape type for CY77324: 0
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: TX22736
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: KP46159
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP46159%27 HTTP/1.1" 200 None
2026-03-30 10:57:11 [auto1.de] INFO: Scrape type for KP46159: 0
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: YF64568
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: AA32108
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA32108%27 HTTP/1.1" 200 None
2026-03-30 10:57:11 [auto1.de] INFO: Scrape type for AA32108: 0
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: EN61962
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: ZG21023
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: BB43937
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: XC39500
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC39500%27 HTTP/1.1" 200 None
2026-03-30 10:57:11 [auto1.de] INFO: Scrape type for XC39500: 0
2026-03-30 10:57:11 [auto1.de] INFO: Found listing with ID: SZ69357
2026-03-30 10:57:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:24 [auto1.de] INFO: Channel: 24h | Page: 71 | totalHits: 9535 | hits on page: 40
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: BP51481
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP51481%27 HTTP/1.1" 200 None
2026-03-30 10:57:24 [auto1.de] INFO: Scrape type for BP51481: 0
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: MU18409
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU18409%27 HTTP/1.1" 200 None
2026-03-30 10:57:24 [auto1.de] INFO: Scrape type for MU18409: 0
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: AA81624
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA81624%27 HTTP/1.1" 200 None
2026-03-30 10:57:24 [auto1.de] INFO: Scrape type for AA81624: 0
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: XW22041
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: MV69505
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV69505%27 HTTP/1.1" 200 None
2026-03-30 10:57:24 [auto1.de] INFO: Scrape type for MV69505: 0
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: GT74179
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT74179%27 HTTP/1.1" 200 None
2026-03-30 10:57:24 [auto1.de] INFO: Scrape type for GT74179: 0
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: ZP13586
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP13586%27 HTTP/1.1" 200 None
2026-03-30 10:57:24 [auto1.de] INFO: Scrape type for ZP13586: 0
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: LT01619
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01619%27 HTTP/1.1" 200 None
2026-03-30 10:57:24 [auto1.de] INFO: Scrape type for LT01619: 0
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: YW85241
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW85241%27 HTTP/1.1" 200 None
2026-03-30 10:57:24 [auto1.de] INFO: Scrape type for YW85241: 0
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: UX63116
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX63116%27 HTTP/1.1" 200 None
2026-03-30 10:57:24 [auto1.de] INFO: Scrape type for UX63116: 0
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: BX27275
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX27275%27 HTTP/1.1" 200 None
2026-03-30 10:57:24 [auto1.de] INFO: Scrape type for BX27275: 0
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: XK12555
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK12555%27 HTTP/1.1" 200 None
2026-03-30 10:57:24 [auto1.de] INFO: Scrape type for XK12555: 0
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: ZJ08126
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: VN44067
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: BR93746
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: PC62397
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: JV60507
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: ZR63828
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT99965%27 HTTP/1.1" 200 None
2026-03-30 10:57:24 [auto1.de] INFO: Scrape type for MT99965: 0
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: PW74632
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW74632%27 HTTP/1.1" 200 None
2026-03-30 10:57:24 [auto1.de] INFO: Scrape type for PW74632: 0
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: ME72449
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72449%27 HTTP/1.1" 200 None
2026-03-30 10:57:24 [auto1.de] INFO: Scrape type for ME72449: 0
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: KR66468
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR66468%27 HTTP/1.1" 200 None
2026-03-30 10:57:24 [auto1.de] INFO: Scrape type for KR66468: 0
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: GN45872
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: RT76020
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT76020%27 HTTP/1.1" 200 None
2026-03-30 10:57:24 [auto1.de] INFO: Scrape type for RT76020: 0
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: RV72396
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: GE15008
2026-03-30 10:57:24 [auto1.de] INFO: Found listing with ID: SA16616
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA16616%27 HTTP/1.1" 200 None
2026-03-30 10:57:24 [auto1.de] INFO: Scrape type for SA16616: 2
2026-03-30 10:57:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eddad159-d1a9-5919-bd96-6eecff54c4af with identifier: SA16616
2026-03-30 10:57:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eddad159-d1a9-5919-bd96-6eecff54c4af with scrape type 2
2026-03-30 10:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eddad159-d1a9-5919-bd96-6eecff54c4af with scrape type 2
2026-03-30 10:57:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eddad159-d1a9-5919-bd96-6eecff54c4af, identifier: SA16616
2026-03-30 10:57:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eddad159-d1a9-5919-bd96-6eecff54c4af with identifier: SA16616
2026-03-30 10:57:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eddad159-d1a9-5919-bd96-6eecff54c4af with identifier: SA16616
2026-03-30 10:57:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eddad159-d1a9-5919-bd96-6eecff54c4af with identifier: SA16616 to the API
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:38:17Z',
 'fuel_type': 'petrol',
 'id': 'eddad159-d1a9-5919-bd96-6eecff54c4af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA16616',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 187628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-19',
 'seller_name': None,
 'title': 'Mazda 3 1.6 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2006}
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA16616%27 HTTP/1.1" 200 None
2026-03-30 10:57:24 [auto1.de] INFO: Saving data for SA16616: {'auction_closing_time': 1774885097.0, 'created_time': 1773467266.313422, 'last_price_update_time': 1774868244.968995}
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA16616') HTTP/1.1" 204 0
2026-03-30 10:57:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:25 [auto1.de] INFO: Found listing with ID: FH74417
2026-03-30 10:57:25 [auto1.de] INFO: Found listing with ID: RG72110
2026-03-30 10:57:25 [auto1.de] INFO: Found listing with ID: HN36676
2026-03-30 10:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN36676%27 HTTP/1.1" 200 None
2026-03-30 10:57:25 [auto1.de] INFO: Scrape type for HN36676: 2
2026-03-30 10:57:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27a0d7b0-4392-5c97-868b-18d02001ac77 with identifier: HN36676
2026-03-30 10:57:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27a0d7b0-4392-5c97-868b-18d02001ac77 with scrape type 2
2026-03-30 10:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27a0d7b0-4392-5c97-868b-18d02001ac77 with scrape type 2
2026-03-30 10:57:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27a0d7b0-4392-5c97-868b-18d02001ac77, identifier: HN36676
2026-03-30 10:57:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27a0d7b0-4392-5c97-868b-18d02001ac77 with identifier: HN36676
2026-03-30 10:57:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27a0d7b0-4392-5c97-868b-18d02001ac77 with identifier: HN36676
2026-03-30 10:57:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27a0d7b0-4392-5c97-868b-18d02001ac77 with identifier: HN36676 to the API
2026-03-30 10:57:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-30T15:09:59Z',
 'fuel_type': 'petrol',
 'id': '27a0d7b0-4392-5c97-868b-18d02001ac77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN36676',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': 'Sebring',
 'odometer': 174517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-12-04',
 'seller_name': None,
 'title': 'Chrysler Sebring 2.7 Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2002}
2026-03-30 10:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN36676%27 HTTP/1.1" 200 None
2026-03-30 10:57:25 [auto1.de] INFO: Saving data for HN36676: {'auction_closing_time': 1774883399.0, 'created_time': 1774550474.514363, 'last_price_update_time': 1774868245.962409}
2026-03-30 10:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN36676') HTTP/1.1" 204 0
2026-03-30 10:57:25 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-30 10:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX89684%27 HTTP/1.1" 200 None
2026-03-30 10:57:26 [auto1.de] INFO: Scrape type for BX89684: 2
2026-03-30 10:57:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cf1e8d8-4956-52d3-8c36-e9dc3a96456a with identifier: BX89684
2026-03-30 10:57:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cf1e8d8-4956-52d3-8c36-e9dc3a96456a with scrape type 2
2026-03-30 10:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cf1e8d8-4956-52d3-8c36-e9dc3a96456a with scrape type 2
2026-03-30 10:57:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cf1e8d8-4956-52d3-8c36-e9dc3a96456a, identifier: BX89684
2026-03-30 10:57:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cf1e8d8-4956-52d3-8c36-e9dc3a96456a with identifier: BX89684
2026-03-30 10:57:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cf1e8d8-4956-52d3-8c36-e9dc3a96456a with identifier: BX89684
2026-03-30 10:57:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cf1e8d8-4956-52d3-8c36-e9dc3a96456a with identifier: BX89684 to the API
2026-03-30 10:57:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:03:38Z',
 'fuel_type': 'petrol',
 'id': '6cf1e8d8-4956-52d3-8c36-e9dc3a96456a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX89684',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 155945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-27',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2006}
2026-03-30 10:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX89684%27 HTTP/1.1" 200 None
2026-03-30 10:57:26 [auto1.de] INFO: Saving data for BX89684: {'auction_closing_time': 1774883018.0, 'created_time': 1773946208.620454, 'last_price_update_time': 1774868246.367149}
2026-03-30 10:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX89684') HTTP/1.1" 204 0
2026-03-30 10:57:26 [auto1.de] INFO: Found listing with ID: GN07930
2026-03-30 10:57:26 [auto1.de] INFO: Found listing with ID: AB70277
2026-03-30 10:57:26 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-30 10:57:26 [auto1.de] INFO: Found listing with ID: HM22337
2026-03-30 10:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM22337%27 HTTP/1.1" 200 None
2026-03-30 10:57:26 [auto1.de] INFO: Scrape type for HM22337: 2
2026-03-30 10:57:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6080de5b-3c86-5ee7-9767-e56b5d8eea38 with identifier: HM22337
2026-03-30 10:57:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6080de5b-3c86-5ee7-9767-e56b5d8eea38 with scrape type 2
2026-03-30 10:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6080de5b-3c86-5ee7-9767-e56b5d8eea38 with scrape type 2
2026-03-30 10:57:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6080de5b-3c86-5ee7-9767-e56b5d8eea38, identifier: HM22337
2026-03-30 10:57:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6080de5b-3c86-5ee7-9767-e56b5d8eea38 with identifier: HM22337
2026-03-30 10:57:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6080de5b-3c86-5ee7-9767-e56b5d8eea38 with identifier: HM22337
2026-03-30 10:57:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6080de5b-3c86-5ee7-9767-e56b5d8eea38 with identifier: HM22337 to the API
2026-03-30 10:57:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:54:19Z',
 'fuel_type': 'petrol',
 'id': '6080de5b-3c86-5ee7-9767-e56b5d8eea38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM22337',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 84539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-20',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-30 10:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM22337%27 HTTP/1.1" 200 None
2026-03-30 10:57:26 [auto1.de] INFO: Saving data for HM22337: {'auction_closing_time': 1774886059.0, 'created_time': 1774780294.565825, 'last_price_update_time': 1774868246.984737}
2026-03-30 10:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM22337') HTTP/1.1" 204 0
2026-03-30 10:57:27 [auto1.de] INFO: Found listing with ID: PY59919
2026-03-30 10:57:27 [auto1.de] INFO: Found listing with ID: SU78317
2026-03-30 10:57:27 [auto1.de] INFO: Found listing with ID: MP03054
2026-03-30 10:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP03054%27 HTTP/1.1" 200 None
2026-03-30 10:57:27 [auto1.de] INFO: Scrape type for MP03054: 2
2026-03-30 10:57:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 174bb4a7-d776-5517-8bb0-4198b3aac9fb with identifier: MP03054
2026-03-30 10:57:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 174bb4a7-d776-5517-8bb0-4198b3aac9fb with scrape type 2
2026-03-30 10:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 174bb4a7-d776-5517-8bb0-4198b3aac9fb with scrape type 2
2026-03-30 10:57:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 174bb4a7-d776-5517-8bb0-4198b3aac9fb, identifier: MP03054
2026-03-30 10:57:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 174bb4a7-d776-5517-8bb0-4198b3aac9fb with identifier: MP03054
2026-03-30 10:57:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 174bb4a7-d776-5517-8bb0-4198b3aac9fb with identifier: MP03054
2026-03-30 10:57:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 174bb4a7-d776-5517-8bb0-4198b3aac9fb with identifier: MP03054 to the API
2026-03-30 10:57:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:14:21Z',
 'fuel_type': 'diesel',
 'id': '174bb4a7-d776-5517-8bb0-4198b3aac9fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP03054',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 213582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-14',
 'seller_name': None,
 'title': 'Toyota Avensis 2.0 D-4D Travel',
 'transmission': 'manual',
 'trim': 'Travel',
 'year': 2007}
2026-03-30 10:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP03054%27 HTTP/1.1" 200 None
2026-03-30 10:57:27 [auto1.de] INFO: Saving data for MP03054: {'auction_closing_time': 1774883661.0, 'created_time': 1774550592.443565, 'last_price_update_time': 1774868247.707726}
2026-03-30 10:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP03054') HTTP/1.1" 204 0
2026-03-30 10:57:27 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-30 10:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF20752%27 HTTP/1.1" 200 None
2026-03-30 10:57:27 [auto1.de] INFO: Scrape type for PF20752: 2
2026-03-30 10:57:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9eb0f89a-3b8c-547a-8c83-7d8d8486c4da with identifier: PF20752
2026-03-30 10:57:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eb0f89a-3b8c-547a-8c83-7d8d8486c4da with scrape type 2
2026-03-30 10:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9eb0f89a-3b8c-547a-8c83-7d8d8486c4da with scrape type 2
2026-03-30 10:57:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9eb0f89a-3b8c-547a-8c83-7d8d8486c4da, identifier: PF20752
2026-03-30 10:57:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9eb0f89a-3b8c-547a-8c83-7d8d8486c4da with identifier: PF20752
2026-03-30 10:57:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9eb0f89a-3b8c-547a-8c83-7d8d8486c4da with identifier: PF20752
2026-03-30 10:57:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9eb0f89a-3b8c-547a-8c83-7d8d8486c4da with identifier: PF20752 to the API
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:37:05Z',
 'fuel_type': 'petrol',
 'id': '9eb0f89a-3b8c-547a-8c83-7d8d8486c4da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF20752',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 166341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-12',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2010}
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF20752%27 HTTP/1.1" 200 None
2026-03-30 10:57:28 [auto1.de] INFO: Saving data for PF20752: {'auction_closing_time': 1774885025.0, 'created_time': 1773819042.811559, 'last_price_update_time': 1774868248.183702}
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF20752') HTTP/1.1" 204 0
2026-03-30 10:57:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:29 [auto1.de] INFO: Channel: 24h | Page: 72 | totalHits: 9536 | hits on page: 40
2026-03-30 10:57:29 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-30 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF20752%27 HTTP/1.1" 200 None
2026-03-30 10:57:29 [auto1.de] INFO: Scrape type for PF20752: 0
2026-03-30 10:57:29 [auto1.de] INFO: Found listing with ID: BE10482
2026-03-30 10:57:29 [auto1.de] INFO: Found listing with ID: JM25076
2026-03-30 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM25076%27 HTTP/1.1" 200 None
2026-03-30 10:57:29 [auto1.de] INFO: Scrape type for JM25076: 2
2026-03-30 10:57:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 786528db-670c-5175-ab21-60d62ae69c69 with identifier: JM25076
2026-03-30 10:57:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 786528db-670c-5175-ab21-60d62ae69c69 with scrape type 2
2026-03-30 10:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 786528db-670c-5175-ab21-60d62ae69c69 with scrape type 2
2026-03-30 10:57:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 786528db-670c-5175-ab21-60d62ae69c69, identifier: JM25076
2026-03-30 10:57:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 786528db-670c-5175-ab21-60d62ae69c69 with identifier: JM25076
2026-03-30 10:57:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 786528db-670c-5175-ab21-60d62ae69c69 with identifier: JM25076
2026-03-30 10:57:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 786528db-670c-5175-ab21-60d62ae69c69 with identifier: JM25076 to the API
2026-03-30 10:57:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:19:48Z',
 'fuel_type': 'petrol',
 'id': '786528db-670c-5175-ab21-60d62ae69c69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM25076',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 80868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-17',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 TGDI GT",
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-03-30 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM25076%27 HTTP/1.1" 200 None
2026-03-30 10:57:29 [auto1.de] INFO: Saving data for JM25076: {'auction_closing_time': 1774883988.0, 'created_time': 1774780255.713329, 'last_price_update_time': 1774868249.641282}
2026-03-30 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM25076') HTTP/1.1" 204 0
2026-03-30 10:57:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:29 [auto1.de] INFO: Found listing with ID: DY40129
2026-03-30 10:57:29 [auto1.de] INFO: Found listing with ID: HD80802
2026-03-30 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD80802%27 HTTP/1.1" 200 None
2026-03-30 10:57:29 [auto1.de] INFO: Scrape type for HD80802: 2
2026-03-30 10:57:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8965acc5-c4f9-542d-95f5-c19e2aa7bf25 with identifier: HD80802
2026-03-30 10:57:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8965acc5-c4f9-542d-95f5-c19e2aa7bf25 with scrape type 2
2026-03-30 10:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8965acc5-c4f9-542d-95f5-c19e2aa7bf25 with scrape type 2
2026-03-30 10:57:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8965acc5-c4f9-542d-95f5-c19e2aa7bf25, identifier: HD80802
2026-03-30 10:57:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8965acc5-c4f9-542d-95f5-c19e2aa7bf25 with identifier: HD80802
2026-03-30 10:57:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8965acc5-c4f9-542d-95f5-c19e2aa7bf25 with identifier: HD80802
2026-03-30 10:57:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8965acc5-c4f9-542d-95f5-c19e2aa7bf25 with identifier: HD80802 to the API
2026-03-30 10:57:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:12:13Z',
 'fuel_type': 'petrol',
 'id': '8965acc5-c4f9-542d-95f5-c19e2aa7bf25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD80802',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 103357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-28',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD80802%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Saving data for HD80802: {'auction_closing_time': 1774883533.0, 'created_time': 1774636936.447051, 'last_price_update_time': 1774868250.074026}
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD80802') HTTP/1.1" 204 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: CR70620
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70620%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for CR70620: 2
2026-03-30 10:57:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3064c95f-23c0-5049-97d5-c53a75d03869 with identifier: CR70620
2026-03-30 10:57:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3064c95f-23c0-5049-97d5-c53a75d03869 with scrape type 2
2026-03-30 10:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3064c95f-23c0-5049-97d5-c53a75d03869 with scrape type 2
2026-03-30 10:57:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3064c95f-23c0-5049-97d5-c53a75d03869, identifier: CR70620
2026-03-30 10:57:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3064c95f-23c0-5049-97d5-c53a75d03869 with identifier: CR70620
2026-03-30 10:57:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3064c95f-23c0-5049-97d5-c53a75d03869 with identifier: CR70620
2026-03-30 10:57:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3064c95f-23c0-5049-97d5-c53a75d03869 with identifier: CR70620 to the API
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:21:15Z',
 'fuel_type': 'petrol',
 'id': '3064c95f-23c0-5049-97d5-c53a75d03869',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR70620',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 260555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-13',
 'seller_name': None,
 'title': 'Audi A4 2.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70620%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Saving data for CR70620: {'auction_closing_time': 1774884075.0, 'created_time': 1773138916.136949, 'last_price_update_time': 1774868250.499537}
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR70620') HTTP/1.1" 204 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: BV77129
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: FY87536
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY87536%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for FY87536: 2
2026-03-30 10:57:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33e35780-76f8-5445-adec-7dae87def37a with identifier: FY87536
2026-03-30 10:57:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33e35780-76f8-5445-adec-7dae87def37a with scrape type 2
2026-03-30 10:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33e35780-76f8-5445-adec-7dae87def37a with scrape type 2
2026-03-30 10:57:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33e35780-76f8-5445-adec-7dae87def37a, identifier: FY87536
2026-03-30 10:57:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33e35780-76f8-5445-adec-7dae87def37a with identifier: FY87536
2026-03-30 10:57:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33e35780-76f8-5445-adec-7dae87def37a with identifier: FY87536
2026-03-30 10:57:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33e35780-76f8-5445-adec-7dae87def37a with identifier: FY87536 to the API
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:59:52Z',
 'fuel_type': 'diesel',
 'id': '33e35780-76f8-5445-adec-7dae87def37a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY87536',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 145756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-19',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY87536%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Saving data for FY87536: {'auction_closing_time': 1774886392.0, 'created_time': 1774551177.68908, 'last_price_update_time': 1774868250.873205}
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY87536') HTTP/1.1" 204 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: PX43483
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX43483%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for PX43483: 2
2026-03-30 10:57:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18f11b17-0b15-57ec-944c-16c43066bff1 with identifier: PX43483
2026-03-30 10:57:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18f11b17-0b15-57ec-944c-16c43066bff1 with scrape type 2
2026-03-30 10:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18f11b17-0b15-57ec-944c-16c43066bff1 with scrape type 2
2026-03-30 10:57:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18f11b17-0b15-57ec-944c-16c43066bff1, identifier: PX43483
2026-03-30 10:57:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18f11b17-0b15-57ec-944c-16c43066bff1 with identifier: PX43483
2026-03-30 10:57:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18f11b17-0b15-57ec-944c-16c43066bff1 with identifier: PX43483
2026-03-30 10:57:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18f11b17-0b15-57ec-944c-16c43066bff1 with identifier: PX43483 to the API
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:55:58Z',
 'fuel_type': 'diesel',
 'id': '18f11b17-0b15-57ec-944c-16c43066bff1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX43483',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 163426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-28',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 350 d 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2011}
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX43483%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Saving data for PX43483: {'auction_closing_time': 1774886158.0, 'created_time': 1774780279.459557, 'last_price_update_time': 1774868251.652675}
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX43483') HTTP/1.1" 204 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: YH32466
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: ZW96632
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: KS38701
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS38701%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for KS38701: 2
2026-03-30 10:57:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 961c2a2a-99ef-5b32-9cc0-703c8bfd3e46 with identifier: KS38701
2026-03-30 10:57:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 961c2a2a-99ef-5b32-9cc0-703c8bfd3e46 with scrape type 2
2026-03-30 10:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 961c2a2a-99ef-5b32-9cc0-703c8bfd3e46 with scrape type 2
2026-03-30 10:57:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 961c2a2a-99ef-5b32-9cc0-703c8bfd3e46, identifier: KS38701
2026-03-30 10:57:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 961c2a2a-99ef-5b32-9cc0-703c8bfd3e46 with identifier: KS38701
2026-03-30 10:57:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 961c2a2a-99ef-5b32-9cc0-703c8bfd3e46 with identifier: KS38701
2026-03-30 10:57:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 961c2a2a-99ef-5b32-9cc0-703c8bfd3e46 with identifier: KS38701 to the API
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:02:24Z',
 'fuel_type': 'petrol',
 'id': '961c2a2a-99ef-5b32-9cc0-703c8bfd3e46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS38701',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 81854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-29',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS38701%27 HTTP/1.1" 200 None
2026-03-30 10:57:32 [auto1.de] INFO: Saving data for KS38701: {'auction_closing_time': 1774882944.0, 'created_time': 1774780297.90031, 'last_price_update_time': 1774868252.673664}
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS38701') HTTP/1.1" 204 0
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: ZY10708
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: NW88180
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: HC26014
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: LN64409
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN64409%27 HTTP/1.1" 200 None
2026-03-30 10:57:32 [auto1.de] INFO: Scrape type for LN64409: 2
2026-03-30 10:57:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5a3e5d5-8c8b-59ea-a3c4-86582f7898bd with identifier: LN64409
2026-03-30 10:57:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5a3e5d5-8c8b-59ea-a3c4-86582f7898bd with scrape type 2
2026-03-30 10:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5a3e5d5-8c8b-59ea-a3c4-86582f7898bd with scrape type 2
2026-03-30 10:57:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5a3e5d5-8c8b-59ea-a3c4-86582f7898bd, identifier: LN64409
2026-03-30 10:57:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5a3e5d5-8c8b-59ea-a3c4-86582f7898bd with identifier: LN64409
2026-03-30 10:57:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5a3e5d5-8c8b-59ea-a3c4-86582f7898bd with identifier: LN64409
2026-03-30 10:57:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5a3e5d5-8c8b-59ea-a3c4-86582f7898bd with identifier: LN64409 to the API
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:40:21Z',
 'fuel_type': 'diesel',
 'id': 'f5a3e5d5-8c8b-59ea-a3c4-86582f7898bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN64409',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 115630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-29',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2017}
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN64409%27 HTTP/1.1" 200 None
2026-03-30 10:57:33 [auto1.de] INFO: Saving data for LN64409: {'auction_closing_time': 1774885221.0, 'created_time': 1774550569.058108, 'last_price_update_time': 1774868253.205198}
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN64409') HTTP/1.1" 204 0
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: JS58048
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: KY70270
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: BB56040
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: RC36772
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: RE36292
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE36292%27 HTTP/1.1" 200 None
2026-03-30 10:57:33 [auto1.de] INFO: Scrape type for RE36292: 2
2026-03-30 10:57:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5ab2777-d4b8-514f-bcb1-62728189980d with identifier: RE36292
2026-03-30 10:57:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5ab2777-d4b8-514f-bcb1-62728189980d with scrape type 2
2026-03-30 10:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5ab2777-d4b8-514f-bcb1-62728189980d with scrape type 2
2026-03-30 10:57:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5ab2777-d4b8-514f-bcb1-62728189980d, identifier: RE36292
2026-03-30 10:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5ab2777-d4b8-514f-bcb1-62728189980d with identifier: RE36292
2026-03-30 10:57:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5ab2777-d4b8-514f-bcb1-62728189980d with identifier: RE36292
2026-03-30 10:57:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5ab2777-d4b8-514f-bcb1-62728189980d with identifier: RE36292 to the API
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 232,
 'expiration_date': '2026-03-30T15:17:24Z',
 'fuel_type': 'diesel',
 'id': 'e5ab2777-d4b8-514f-bcb1-62728189980d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE36292',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 241115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-02',
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2006}
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE36292%27 HTTP/1.1" 200 None
2026-03-30 10:57:33 [auto1.de] INFO: Saving data for RE36292: {'auction_closing_time': 1774883844.0, 'created_time': 1773467412.16631, 'last_price_update_time': 1774868253.654062}
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE36292') HTTP/1.1" 204 0
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: UG24074
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG24074%27 HTTP/1.1" 200 None
2026-03-30 10:57:33 [auto1.de] INFO: Scrape type for UG24074: 2
2026-03-30 10:57:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 906729cf-654a-51d2-93e0-daf61bef56d9 with identifier: UG24074
2026-03-30 10:57:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 906729cf-654a-51d2-93e0-daf61bef56d9 with scrape type 2
2026-03-30 10:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 906729cf-654a-51d2-93e0-daf61bef56d9 with scrape type 2
2026-03-30 10:57:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 906729cf-654a-51d2-93e0-daf61bef56d9, identifier: UG24074
2026-03-30 10:57:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 906729cf-654a-51d2-93e0-daf61bef56d9 with identifier: UG24074
2026-03-30 10:57:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 906729cf-654a-51d2-93e0-daf61bef56d9 with identifier: UG24074
2026-03-30 10:57:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 906729cf-654a-51d2-93e0-daf61bef56d9 with identifier: UG24074 to the API
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:38:27Z',
 'fuel_type': 'petrol',
 'id': '906729cf-654a-51d2-93e0-daf61bef56d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG24074',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 133966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-11-27',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2003}
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG24074%27 HTTP/1.1" 200 None
2026-03-30 10:57:34 [auto1.de] INFO: Saving data for UG24074: {'auction_closing_time': 1774885107.0, 'created_time': 1773468612.4118, 'last_price_update_time': 1774868254.031231}
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG24074') HTTP/1.1" 204 0
2026-03-30 10:57:34 [auto1.de] INFO: Found listing with ID: ZA01516
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA01516%27 HTTP/1.1" 200 None
2026-03-30 10:57:34 [auto1.de] INFO: Scrape type for ZA01516: 2
2026-03-30 10:57:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f219faf7-5c71-5a8e-8d18-aeb43b4a3141 with identifier: ZA01516
2026-03-30 10:57:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f219faf7-5c71-5a8e-8d18-aeb43b4a3141 with scrape type 2
2026-03-30 10:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f219faf7-5c71-5a8e-8d18-aeb43b4a3141 with scrape type 2
2026-03-30 10:57:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f219faf7-5c71-5a8e-8d18-aeb43b4a3141, identifier: ZA01516
2026-03-30 10:57:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f219faf7-5c71-5a8e-8d18-aeb43b4a3141 with identifier: ZA01516
2026-03-30 10:57:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f219faf7-5c71-5a8e-8d18-aeb43b4a3141 with identifier: ZA01516
2026-03-30 10:57:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f219faf7-5c71-5a8e-8d18-aeb43b4a3141 with identifier: ZA01516 to the API
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:34:04Z',
 'fuel_type': 'petrol',
 'id': 'f219faf7-5c71-5a8e-8d18-aeb43b4a3141',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA01516',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 219234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-06-21',
 'seller_name': None,
 'title': 'Hyundai Santa Fe 2.4 GLS',
 'transmission': 'manual',
 'trim': 'GLS',
 'year': 2004}
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA01516%27 HTTP/1.1" 200 None
2026-03-30 10:57:34 [auto1.de] INFO: Saving data for ZA01516: {'auction_closing_time': 1774884844.0, 'created_time': 1773384332.763705, 'last_price_update_time': 1774868254.452867}
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA01516') HTTP/1.1" 204 0
2026-03-30 10:57:34 [auto1.de] INFO: Channel: 24h | Page: 73 | totalHits: 9537 | hits on page: 40
2026-03-30 10:57:34 [auto1.de] INFO: Found listing with ID: NX65869
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX65869%27 HTTP/1.1" 200 None
2026-03-30 10:57:34 [auto1.de] INFO: Scrape type for NX65869: 2
2026-03-30 10:57:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d8827a7-57cb-5090-86dc-403fb6360a31 with identifier: NX65869
2026-03-30 10:57:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d8827a7-57cb-5090-86dc-403fb6360a31 with scrape type 2
2026-03-30 10:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d8827a7-57cb-5090-86dc-403fb6360a31 with scrape type 2
2026-03-30 10:57:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d8827a7-57cb-5090-86dc-403fb6360a31, identifier: NX65869
2026-03-30 10:57:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d8827a7-57cb-5090-86dc-403fb6360a31 with identifier: NX65869
2026-03-30 10:57:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d8827a7-57cb-5090-86dc-403fb6360a31 with identifier: NX65869
2026-03-30 10:57:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d8827a7-57cb-5090-86dc-403fb6360a31 with identifier: NX65869 to the API
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:40:23Z',
 'fuel_type': 'petrol',
 'id': '5d8827a7-57cb-5090-86dc-403fb6360a31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX65869',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Bora',
 'odometer': 177352,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-02-24',
 'seller_name': None,
 'title': 'Volkswagen Bora 2.0 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2000}
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX65869%27 HTTP/1.1" 200 None
2026-03-30 10:57:34 [auto1.de] INFO: Saving data for NX65869: {'auction_closing_time': 1774885223.0, 'created_time': 1773657476.384113, 'last_price_update_time': 1774868254.954114}
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX65869') HTTP/1.1" 204 0
2026-03-30 10:57:34 [auto1.de] INFO: Found listing with ID: KV42803
2026-03-30 10:57:34 [auto1.de] INFO: Found listing with ID: TJ48176
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ48176%27 HTTP/1.1" 200 None
2026-03-30 10:57:34 [auto1.de] INFO: Scrape type for TJ48176: 2
2026-03-30 10:57:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31cb73c7-b46e-5ebf-909b-fd53b8990e56 with identifier: TJ48176
2026-03-30 10:57:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31cb73c7-b46e-5ebf-909b-fd53b8990e56 with scrape type 2
2026-03-30 10:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31cb73c7-b46e-5ebf-909b-fd53b8990e56 with scrape type 2
2026-03-30 10:57:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31cb73c7-b46e-5ebf-909b-fd53b8990e56, identifier: TJ48176
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: KF39369
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: CX65130
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: EM69588
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM69588%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for EM69588: 2
2026-03-30 10:57:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31db30a8-be10-5ca3-9f4e-26199e8473dc with identifier: EM69588
2026-03-30 10:57:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31db30a8-be10-5ca3-9f4e-26199e8473dc with scrape type 2
2026-03-30 10:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31db30a8-be10-5ca3-9f4e-26199e8473dc with scrape type 2
2026-03-30 10:57:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31db30a8-be10-5ca3-9f4e-26199e8473dc, identifier: EM69588
2026-03-30 10:57:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31cb73c7-b46e-5ebf-909b-fd53b8990e56 with identifier: TJ48176
2026-03-30 10:57:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31cb73c7-b46e-5ebf-909b-fd53b8990e56 with identifier: TJ48176
2026-03-30 10:57:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31cb73c7-b46e-5ebf-909b-fd53b8990e56 with identifier: TJ48176 to the API
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:53:28Z',
 'fuel_type': 'diesel',
 'id': '31cb73c7-b46e-5ebf-909b-fd53b8990e56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ48176',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XE',
 'odometer': 150311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-28',
 'seller_name': None,
 'title': 'Jaguar XE 20d Pure',
 'transmission': 'automatic',
 'trim': 'Pure',
 'year': 2016}
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ48176%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Saving data for TJ48176: {'auction_closing_time': 1774886008.0, 'created_time': 1774463596.861935, 'last_price_update_time': 1774868255.492293}
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ48176') HTTP/1.1" 204 0
2026-03-30 10:57:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31db30a8-be10-5ca3-9f4e-26199e8473dc with identifier: EM69588
2026-03-30 10:57:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31db30a8-be10-5ca3-9f4e-26199e8473dc with identifier: EM69588
2026-03-30 10:57:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31db30a8-be10-5ca3-9f4e-26199e8473dc with identifier: EM69588 to the API
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:54:29Z',
 'fuel_type': 'petrol',
 'id': '31db30a8-be10-5ca3-9f4e-26199e8473dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM69588',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Fox',
 'odometer': 160238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-11',
 'seller_name': None,
 'title': 'Volkswagen Fox 1.2',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM69588%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Saving data for EM69588: {'auction_closing_time': 1774886069.0, 'created_time': 1773484509.804162, 'last_price_update_time': 1774868255.787124}
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM69588') HTTP/1.1" 204 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: NH05952
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: MM90300
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: WW07339
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW07339%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for WW07339: 2
2026-03-30 10:57:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 130a45ca-a8c0-5dc9-9177-d7e6bd73c71e with identifier: WW07339
2026-03-30 10:57:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 130a45ca-a8c0-5dc9-9177-d7e6bd73c71e with scrape type 2
2026-03-30 10:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 130a45ca-a8c0-5dc9-9177-d7e6bd73c71e with scrape type 2
2026-03-30 10:57:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 130a45ca-a8c0-5dc9-9177-d7e6bd73c71e, identifier: WW07339
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: FY70837
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: YL11317
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: ZH40630
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: RA38840
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA38840%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for RA38840: 2
2026-03-30 10:57:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c63fa6d-0b08-5761-93dc-5a2e10b15a27 with identifier: RA38840
2026-03-30 10:57:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c63fa6d-0b08-5761-93dc-5a2e10b15a27 with scrape type 2
2026-03-30 10:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c63fa6d-0b08-5761-93dc-5a2e10b15a27 with scrape type 2
2026-03-30 10:57:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c63fa6d-0b08-5761-93dc-5a2e10b15a27, identifier: RA38840
2026-03-30 10:57:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 130a45ca-a8c0-5dc9-9177-d7e6bd73c71e with identifier: WW07339
2026-03-30 10:57:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 130a45ca-a8c0-5dc9-9177-d7e6bd73c71e with identifier: WW07339
2026-03-30 10:57:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 130a45ca-a8c0-5dc9-9177-d7e6bd73c71e with identifier: WW07339 to the API
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:45:23Z',
 'fuel_type': 'petrol',
 'id': '130a45ca-a8c0-5dc9-9177-d7e6bd73c71e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW07339',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'Justy',
 'odometer': 228616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-17',
 'seller_name': None,
 'title': 'Subaru Justy 1.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW07339%27 HTTP/1.1" 200 None
2026-03-30 10:57:36 [auto1.de] INFO: Saving data for WW07339: {'auction_closing_time': 1774885523.0, 'created_time': 1773860459.951665, 'last_price_update_time': 1774868256.294421}
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW07339') HTTP/1.1" 204 0
2026-03-30 10:57:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c63fa6d-0b08-5761-93dc-5a2e10b15a27 with identifier: RA38840
2026-03-30 10:57:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c63fa6d-0b08-5761-93dc-5a2e10b15a27 with identifier: RA38840
2026-03-30 10:57:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c63fa6d-0b08-5761-93dc-5a2e10b15a27 with identifier: RA38840 to the API
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 50,
 'expiration_date': '2026-03-30T15:49:36Z',
 'fuel_type': 'petrol',
 'id': '8c63fa6d-0b08-5761-93dc-5a2e10b15a27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA38840',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 124875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-02-06',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 1997}
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA38840%27 HTTP/1.1" 200 None
2026-03-30 10:57:36 [auto1.de] INFO: Saving data for RA38840: {'auction_closing_time': 1774885776.0, 'created_time': 1773467503.566884, 'last_price_update_time': 1774868256.663507}
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA38840') HTTP/1.1" 204 0
2026-03-30 10:57:36 [auto1.de] INFO: Found listing with ID: UH53806
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH53806%27 HTTP/1.1" 200 None
2026-03-30 10:57:36 [auto1.de] INFO: Scrape type for UH53806: 2
2026-03-30 10:57:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9582c0ae-baed-506d-9ed4-36a06b54fa34 with identifier: UH53806
2026-03-30 10:57:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9582c0ae-baed-506d-9ed4-36a06b54fa34 with scrape type 2
2026-03-30 10:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9582c0ae-baed-506d-9ed4-36a06b54fa34 with scrape type 2
2026-03-30 10:57:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9582c0ae-baed-506d-9ed4-36a06b54fa34, identifier: UH53806
2026-03-30 10:57:36 [auto1.de] INFO: Found listing with ID: RR52693
2026-03-30 10:57:36 [auto1.de] INFO: Found listing with ID: ES51146
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES51146%27 HTTP/1.1" 200 None
2026-03-30 10:57:36 [auto1.de] INFO: Scrape type for ES51146: 2
2026-03-30 10:57:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f843921-8ecd-5515-89ad-a5a557d6ac29 with identifier: ES51146
2026-03-30 10:57:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f843921-8ecd-5515-89ad-a5a557d6ac29 with scrape type 2
2026-03-30 10:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f843921-8ecd-5515-89ad-a5a557d6ac29 with scrape type 2
2026-03-30 10:57:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f843921-8ecd-5515-89ad-a5a557d6ac29, identifier: ES51146
2026-03-30 10:57:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9582c0ae-baed-506d-9ed4-36a06b54fa34 with identifier: UH53806
2026-03-30 10:57:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9582c0ae-baed-506d-9ed4-36a06b54fa34 with identifier: UH53806
2026-03-30 10:57:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9582c0ae-baed-506d-9ed4-36a06b54fa34 with identifier: UH53806 to the API
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:35:38Z',
 'fuel_type': 'petrol',
 'id': '9582c0ae-baed-506d-9ed4-36a06b54fa34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH53806',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 92513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-04-21',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH53806%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Saving data for UH53806: {'auction_closing_time': 1774884938.0, 'created_time': 1773830026.394437, 'last_price_update_time': 1774868257.212787}
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH53806') HTTP/1.1" 204 0
2026-03-30 10:57:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f843921-8ecd-5515-89ad-a5a557d6ac29 with identifier: ES51146
2026-03-30 10:57:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f843921-8ecd-5515-89ad-a5a557d6ac29 with identifier: ES51146
2026-03-30 10:57:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f843921-8ecd-5515-89ad-a5a557d6ac29 with identifier: ES51146 to the API
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:44:30Z',
 'fuel_type': 'petrol',
 'id': '4f843921-8ecd-5515-89ad-a5a557d6ac29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES51146',
 'listing': 'auction',
 'make': 'Audi',
 'model': '80',
 'odometer': 253065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1993-02-28',
 'seller_name': None,
 'title': 'Audi 80 2.0',
 'transmission': 'manual',
 'trim': '',
 'year': 1993}
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES51146%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Saving data for ES51146: {'auction_closing_time': 1774885470.0, 'created_time': 1773301181.714873, 'last_price_update_time': 1774868257.514808}
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES51146') HTTP/1.1" 204 0
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: HT08782
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT08782%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Scrape type for HT08782: 2
2026-03-30 10:57:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b10d11d-caf5-5e4e-afa8-52a1e96bde02 with identifier: HT08782
2026-03-30 10:57:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b10d11d-caf5-5e4e-afa8-52a1e96bde02 with scrape type 2
2026-03-30 10:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b10d11d-caf5-5e4e-afa8-52a1e96bde02 with scrape type 2
2026-03-30 10:57:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b10d11d-caf5-5e4e-afa8-52a1e96bde02, identifier: HT08782
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: NK75444
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: RC32924
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC32924%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Scrape type for RC32924: 2
2026-03-30 10:57:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93b02d40-9955-5521-9d4f-8f622c06155b with identifier: RC32924
2026-03-30 10:57:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93b02d40-9955-5521-9d4f-8f622c06155b with scrape type 2
2026-03-30 10:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93b02d40-9955-5521-9d4f-8f622c06155b with scrape type 2
2026-03-30 10:57:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93b02d40-9955-5521-9d4f-8f622c06155b, identifier: RC32924
2026-03-30 10:57:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b10d11d-caf5-5e4e-afa8-52a1e96bde02 with identifier: HT08782
2026-03-30 10:57:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b10d11d-caf5-5e4e-afa8-52a1e96bde02 with identifier: HT08782
2026-03-30 10:57:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b10d11d-caf5-5e4e-afa8-52a1e96bde02 with identifier: HT08782 to the API
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:16:34Z',
 'fuel_type': 'petrol',
 'id': '7b10d11d-caf5-5e4e-afa8-52a1e96bde02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT08782',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 147785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-18',
 'seller_name': None,
 'title': 'Mazda 2 1.3 Impuls',
 'transmission': 'manual',
 'trim': 'Impuls',
 'year': 2010}
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT08782%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Saving data for HT08782: {'auction_closing_time': 1774883794.0, 'created_time': 1773858993.78401, 'last_price_update_time': 1774868257.99527}
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT08782') HTTP/1.1" 204 0
2026-03-30 10:57:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93b02d40-9955-5521-9d4f-8f622c06155b with identifier: RC32924
2026-03-30 10:57:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93b02d40-9955-5521-9d4f-8f622c06155b with identifier: RC32924
2026-03-30 10:57:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93b02d40-9955-5521-9d4f-8f622c06155b with identifier: RC32924 to the API
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:41:39Z',
 'fuel_type': 'diesel',
 'id': '93b02d40-9955-5521-9d4f-8f622c06155b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC32924',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 244449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-02',
 'seller_name': None,
 'title': 'Seat Altea 2.0 TDI Comfort Limited',
 'transmission': 'automatic',
 'trim': 'Comfort Limited',
 'year': 2008}
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC32924%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Saving data for RC32924: {'auction_closing_time': 1774885299.0, 'created_time': 1773468575.479436, 'last_price_update_time': 1774868258.289376}
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC32924') HTTP/1.1" 204 0
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: LJ58074
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: LE65557
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: YY18465
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: VC28435
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC28435%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for VC28435: 2
2026-03-30 10:57:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bca1d92-4a16-5add-acfe-5d582413c9e8 with identifier: VC28435
2026-03-30 10:57:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bca1d92-4a16-5add-acfe-5d582413c9e8 with scrape type 2
2026-03-30 10:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bca1d92-4a16-5add-acfe-5d582413c9e8 with scrape type 2
2026-03-30 10:57:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bca1d92-4a16-5add-acfe-5d582413c9e8, identifier: VC28435
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: AA06623
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: XN76849
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN76849%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for XN76849: 2
2026-03-30 10:57:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 770d59f1-3dc1-5275-b5e1-1e5b9a867ed9 with identifier: XN76849
2026-03-30 10:57:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 770d59f1-3dc1-5275-b5e1-1e5b9a867ed9 with scrape type 2
2026-03-30 10:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 770d59f1-3dc1-5275-b5e1-1e5b9a867ed9 with scrape type 2
2026-03-30 10:57:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 770d59f1-3dc1-5275-b5e1-1e5b9a867ed9, identifier: XN76849
2026-03-30 10:57:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bca1d92-4a16-5add-acfe-5d582413c9e8 with identifier: VC28435
2026-03-30 10:57:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bca1d92-4a16-5add-acfe-5d582413c9e8 with identifier: VC28435
2026-03-30 10:57:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bca1d92-4a16-5add-acfe-5d582413c9e8 with identifier: VC28435 to the API
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:28:03Z',
 'fuel_type': 'gas',
 'id': '7bca1d92-4a16-5add-acfe-5d582413c9e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC28435',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 281030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-03',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 Kasten EcoFuel',
 'transmission': 'manual',
 'trim': 'Kasten EcoFuel',
 'year': 2008}
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC28435%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Saving data for VC28435: {'auction_closing_time': 1774884483.0, 'created_time': 1773467637.420659, 'last_price_update_time': 1774868258.827088}
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC28435') HTTP/1.1" 204 0
2026-03-30 10:57:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 770d59f1-3dc1-5275-b5e1-1e5b9a867ed9 with identifier: XN76849
2026-03-30 10:57:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 770d59f1-3dc1-5275-b5e1-1e5b9a867ed9 with identifier: XN76849
2026-03-30 10:57:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 770d59f1-3dc1-5275-b5e1-1e5b9a867ed9 with identifier: XN76849 to the API
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:01:10Z',
 'fuel_type': 'hybrid',
 'id': '770d59f1-3dc1-5275-b5e1-1e5b9a867ed9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN76849',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 34571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-07',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S E Hybrid ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2019}
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN76849%27 HTTP/1.1" 200 None
2026-03-30 10:57:39 [auto1.de] INFO: Saving data for XN76849: {'auction_closing_time': 1774882870.0, 'created_time': 1774780290.013294, 'last_price_update_time': 1774868259.220435}
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN76849') HTTP/1.1" 204 0
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: KP69989
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: HJ76482
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: GT35568
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT35568%27 HTTP/1.1" 200 None
2026-03-30 10:57:39 [auto1.de] INFO: Scrape type for GT35568: 2
2026-03-30 10:57:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ab83750-9366-5dd9-8fe5-04bbb7feaab0 with identifier: GT35568
2026-03-30 10:57:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ab83750-9366-5dd9-8fe5-04bbb7feaab0 with scrape type 2
2026-03-30 10:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ab83750-9366-5dd9-8fe5-04bbb7feaab0 with scrape type 2
2026-03-30 10:57:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ab83750-9366-5dd9-8fe5-04bbb7feaab0, identifier: GT35568
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: VY63295
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: XF10018
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF10018%27 HTTP/1.1" 200 None
2026-03-30 10:57:39 [auto1.de] INFO: Scrape type for XF10018: 2
2026-03-30 10:57:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65b9c3bf-c416-5fb5-afbf-5c24c9da1ffa with identifier: XF10018
2026-03-30 10:57:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65b9c3bf-c416-5fb5-afbf-5c24c9da1ffa with scrape type 2
2026-03-30 10:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65b9c3bf-c416-5fb5-afbf-5c24c9da1ffa with scrape type 2
2026-03-30 10:57:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65b9c3bf-c416-5fb5-afbf-5c24c9da1ffa, identifier: XF10018
2026-03-30 10:57:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ab83750-9366-5dd9-8fe5-04bbb7feaab0 with identifier: GT35568
2026-03-30 10:57:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ab83750-9366-5dd9-8fe5-04bbb7feaab0 with identifier: GT35568
2026-03-30 10:57:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ab83750-9366-5dd9-8fe5-04bbb7feaab0 with identifier: GT35568 to the API
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:41:36Z',
 'fuel_type': 'petrol',
 'id': '8ab83750-9366-5dd9-8fe5-04bbb7feaab0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT35568',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 200001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-14',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Ti-VCT Ghia',
 'transmission': 'manual',
 'trim': 'Ghia',
 'year': 2007}
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT35568%27 HTTP/1.1" 200 None
2026-03-30 10:57:39 [auto1.de] INFO: Saving data for GT35568: {'auction_closing_time': 1774885296.0, 'created_time': 1773687923.907596, 'last_price_update_time': 1774868259.719895}
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT35568') HTTP/1.1" 204 0
2026-03-30 10:57:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65b9c3bf-c416-5fb5-afbf-5c24c9da1ffa with identifier: XF10018
2026-03-30 10:57:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65b9c3bf-c416-5fb5-afbf-5c24c9da1ffa with identifier: XF10018
2026-03-30 10:57:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65b9c3bf-c416-5fb5-afbf-5c24c9da1ffa with identifier: XF10018 to the API
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:21:27Z',
 'fuel_type': 'petrol',
 'id': '65b9c3bf-c416-5fb5-afbf-5c24c9da1ffa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF10018',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 113972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-05-29',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2003}
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF10018%27 HTTP/1.1" 200 None
2026-03-30 10:57:40 [auto1.de] INFO: Saving data for XF10018: {'auction_closing_time': 1774884087.0, 'created_time': 1774637026.351342, 'last_price_update_time': 1774868260.005146}
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF10018') HTTP/1.1" 204 0
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: TJ90592
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ90592%27 HTTP/1.1" 200 None
2026-03-30 10:57:40 [auto1.de] INFO: Scrape type for TJ90592: 2
2026-03-30 10:57:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d877cb38-0d56-5c78-b126-41477dbd36bd with identifier: TJ90592
2026-03-30 10:57:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d877cb38-0d56-5c78-b126-41477dbd36bd with scrape type 2
2026-03-30 10:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d877cb38-0d56-5c78-b126-41477dbd36bd with scrape type 2
2026-03-30 10:57:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d877cb38-0d56-5c78-b126-41477dbd36bd, identifier: TJ90592
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: KV42803
2026-03-30 10:57:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d877cb38-0d56-5c78-b126-41477dbd36bd with identifier: TJ90592
2026-03-30 10:57:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d877cb38-0d56-5c78-b126-41477dbd36bd with identifier: TJ90592
2026-03-30 10:57:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d877cb38-0d56-5c78-b126-41477dbd36bd with identifier: TJ90592 to the API
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:08:20Z',
 'fuel_type': 'diesel',
 'id': 'd877cb38-0d56-5c78-b126-41477dbd36bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ90592',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 86704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-22',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Drive',
 'transmission': 'automatic',
 'trim': 'Drive',
 'year': 2015}
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ90592%27 HTTP/1.1" 200 None
2026-03-30 10:57:40 [auto1.de] INFO: Saving data for TJ90592: {'auction_closing_time': 1774883300.0, 'created_time': 1774550517.125127, 'last_price_update_time': 1774868260.408672}
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ90592') HTTP/1.1" 204 0
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: PJ98033
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: CV58900
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV58900%27 HTTP/1.1" 200 None
2026-03-30 10:57:40 [auto1.de] INFO: Scrape type for CV58900: 2
2026-03-30 10:57:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdc2634c-adea-598c-887d-0ca33258d67c with identifier: CV58900
2026-03-30 10:57:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdc2634c-adea-598c-887d-0ca33258d67c with scrape type 2
2026-03-30 10:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdc2634c-adea-598c-887d-0ca33258d67c with scrape type 2
2026-03-30 10:57:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdc2634c-adea-598c-887d-0ca33258d67c, identifier: CV58900
2026-03-30 10:57:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdc2634c-adea-598c-887d-0ca33258d67c with identifier: CV58900
2026-03-30 10:57:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdc2634c-adea-598c-887d-0ca33258d67c with identifier: CV58900
2026-03-30 10:57:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdc2634c-adea-598c-887d-0ca33258d67c with identifier: CV58900 to the API
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:47:51Z',
 'fuel_type': 'petrol',
 'id': 'bdc2634c-adea-598c-887d-0ca33258d67c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV58900',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 127789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-26',
 'seller_name': None,
 'title': 'Mazda 2 1.25 Comfort',
 'transmission': 'manual',
 'trim': '1.5 Comfort',
 'year': 2007}
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV58900%27 HTTP/1.1" 200 None
2026-03-30 10:57:40 [auto1.de] INFO: Saving data for CV58900: {'auction_closing_time': 1774885671.0, 'created_time': 1773467796.821622, 'last_price_update_time': 1774868260.80968}
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV58900') HTTP/1.1" 204 0
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: RG53469
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG53469%27 HTTP/1.1" 200 None
2026-03-30 10:57:40 [auto1.de] INFO: Scrape type for RG53469: 2
2026-03-30 10:57:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff59bb02-77b9-58e4-9262-dd8d949208dc with identifier: RG53469
2026-03-30 10:57:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff59bb02-77b9-58e4-9262-dd8d949208dc with scrape type 2
2026-03-30 10:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff59bb02-77b9-58e4-9262-dd8d949208dc with scrape type 2
2026-03-30 10:57:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff59bb02-77b9-58e4-9262-dd8d949208dc, identifier: RG53469
2026-03-30 10:57:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff59bb02-77b9-58e4-9262-dd8d949208dc with identifier: RG53469
2026-03-30 10:57:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff59bb02-77b9-58e4-9262-dd8d949208dc with identifier: RG53469
2026-03-30 10:57:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff59bb02-77b9-58e4-9262-dd8d949208dc with identifier: RG53469 to the API
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 188,
 'expiration_date': '2026-03-30T15:32:40Z',
 'fuel_type': 'hybrid',
 'id': 'ff59bb02-77b9-58e4-9262-dd8d949208dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG53469',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Eclipse Cross',
 'odometer': 49763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seller_name': None,
 'title': 'Mitsubishi Eclipse Cross 2.4 Plug-in Hybrid Top 4WD',
 'transmission': 'automatic',
 'trim': 'Top 4WD',
 'year': 2021}
2026-03-30 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG53469%27 HTTP/1.1" 200 None
2026-03-30 10:57:42 [auto1.de] INFO: Saving data for RG53469: {'auction_closing_time': 1774884760.0, 'created_time': 1774780298.277851, 'last_price_update_time': 1774868262.160708}
2026-03-30 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG53469') HTTP/1.1" 204 0
2026-03-30 10:57:42 [auto1.de] INFO: Found listing with ID: ZS29776
2026-03-30 10:57:42 [auto1.de] INFO: Found listing with ID: AT97457
2026-03-30 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT97457%27 HTTP/1.1" 200 None
2026-03-30 10:57:42 [auto1.de] INFO: Scrape type for AT97457: 2
2026-03-30 10:57:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3cf4d08-105e-58a5-be2c-45d8b81b7bc5 with identifier: AT97457
2026-03-30 10:57:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3cf4d08-105e-58a5-be2c-45d8b81b7bc5 with scrape type 2
2026-03-30 10:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3cf4d08-105e-58a5-be2c-45d8b81b7bc5 with scrape type 2
2026-03-30 10:57:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3cf4d08-105e-58a5-be2c-45d8b81b7bc5, identifier: AT97457
2026-03-30 10:57:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3cf4d08-105e-58a5-be2c-45d8b81b7bc5 with identifier: AT97457
2026-03-30 10:57:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3cf4d08-105e-58a5-be2c-45d8b81b7bc5 with identifier: AT97457
2026-03-30 10:57:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3cf4d08-105e-58a5-be2c-45d8b81b7bc5 with identifier: AT97457 to the API
2026-03-30 10:57:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:36:19Z',
 'fuel_type': 'petrol',
 'id': 'd3cf4d08-105e-58a5-be2c-45d8b81b7bc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT97457',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 118136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-13',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 Exécutive',
 'transmission': 'manual',
 'trim': 'Exécutive',
 'year': 2007}
2026-03-30 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT97457%27 HTTP/1.1" 200 None
2026-03-30 10:57:42 [auto1.de] INFO: Saving data for AT97457: {'auction_closing_time': 1774884979.0, 'created_time': 1774637103.892126, 'last_price_update_time': 1774868262.546713}
2026-03-30 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT97457') HTTP/1.1" 204 0
2026-03-30 10:57:42 [auto1.de] INFO: Channel: 24h | Page: 74 | totalHits: 9538 | hits on page: 40
2026-03-30 10:57:42 [auto1.de] INFO: Found listing with ID: DS41181
2026-03-30 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS41181%27 HTTP/1.1" 200 None
2026-03-30 10:57:42 [auto1.de] INFO: Scrape type for DS41181: 2
2026-03-30 10:57:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0380dcce-71c1-5496-8471-38d71ca3c2b0 with identifier: DS41181
2026-03-30 10:57:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0380dcce-71c1-5496-8471-38d71ca3c2b0 with scrape type 2
2026-03-30 10:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0380dcce-71c1-5496-8471-38d71ca3c2b0 with scrape type 2
2026-03-30 10:57:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0380dcce-71c1-5496-8471-38d71ca3c2b0, identifier: DS41181
2026-03-30 10:57:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0380dcce-71c1-5496-8471-38d71ca3c2b0 with identifier: DS41181
2026-03-30 10:57:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0380dcce-71c1-5496-8471-38d71ca3c2b0 with identifier: DS41181
2026-03-30 10:57:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0380dcce-71c1-5496-8471-38d71ca3c2b0 with identifier: DS41181 to the API
2026-03-30 10:57:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:52:38Z',
 'fuel_type': 'petrol',
 'id': '0380dcce-71c1-5496-8471-38d71ca3c2b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS41181',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 108487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-31',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS41181%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Saving data for DS41181: {'auction_closing_time': 1774885958.0, 'created_time': 1773859505.631224, 'last_price_update_time': 1774868263.043473}
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS41181') HTTP/1.1" 204 0
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: WF02803
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF02803%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Scrape type for WF02803: 2
2026-03-30 10:57:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ba1cbac-68d6-53c7-aea6-b09faa682ac7 with identifier: WF02803
2026-03-30 10:57:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ba1cbac-68d6-53c7-aea6-b09faa682ac7 with scrape type 2
2026-03-30 10:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ba1cbac-68d6-53c7-aea6-b09faa682ac7 with scrape type 2
2026-03-30 10:57:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ba1cbac-68d6-53c7-aea6-b09faa682ac7, identifier: WF02803
2026-03-30 10:57:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: WY61426
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY61426%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Scrape type for WY61426: 2
2026-03-30 10:57:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 995eec35-b357-5e59-81d8-5091672dc975 with identifier: WY61426
2026-03-30 10:57:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 995eec35-b357-5e59-81d8-5091672dc975 with scrape type 2
2026-03-30 10:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 995eec35-b357-5e59-81d8-5091672dc975 with scrape type 2
2026-03-30 10:57:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 995eec35-b357-5e59-81d8-5091672dc975, identifier: WY61426
2026-03-30 10:57:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ba1cbac-68d6-53c7-aea6-b09faa682ac7 with identifier: WF02803
2026-03-30 10:57:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ba1cbac-68d6-53c7-aea6-b09faa682ac7 with identifier: WF02803
2026-03-30 10:57:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ba1cbac-68d6-53c7-aea6-b09faa682ac7 with identifier: WF02803 to the API
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:59:07Z',
 'fuel_type': 'diesel',
 'id': '5ba1cbac-68d6-53c7-aea6-b09faa682ac7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF02803',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 151727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-25',
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 TDI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2015}
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF02803%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Saving data for WF02803: {'auction_closing_time': 1774886347.0, 'created_time': 1773513089.472475, 'last_price_update_time': 1774868263.541559}
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF02803') HTTP/1.1" 204 0
2026-03-30 10:57:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 995eec35-b357-5e59-81d8-5091672dc975 with identifier: WY61426
2026-03-30 10:57:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 995eec35-b357-5e59-81d8-5091672dc975 with identifier: WY61426
2026-03-30 10:57:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 995eec35-b357-5e59-81d8-5091672dc975 with identifier: WY61426 to the API
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 182,
 'expiration_date': '2026-03-30T15:59:46Z',
 'fuel_type': 'petrol',
 'id': '995eec35-b357-5e59-81d8-5091672dc975',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY61426',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 68375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-08',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY61426%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Saving data for WY61426: {'auction_closing_time': 1774886386.0, 'created_time': 1773773680.689393, 'last_price_update_time': 1774868263.881784}
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY61426') HTTP/1.1" 204 0
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: GX28379
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: LN95655
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN95655%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Scrape type for LN95655: 2
2026-03-30 10:57:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fdc891e-df5b-55c3-9a01-af9f940861c2 with identifier: LN95655
2026-03-30 10:57:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fdc891e-df5b-55c3-9a01-af9f940861c2 with scrape type 2
2026-03-30 10:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fdc891e-df5b-55c3-9a01-af9f940861c2 with scrape type 2
2026-03-30 10:57:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fdc891e-df5b-55c3-9a01-af9f940861c2, identifier: LN95655
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: BV92050
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV92050%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Scrape type for BV92050: 2
2026-03-30 10:57:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05f8b392-8071-518b-a87f-29d09bb94c67 with identifier: BV92050
2026-03-30 10:57:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05f8b392-8071-518b-a87f-29d09bb94c67 with scrape type 2
2026-03-30 10:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05f8b392-8071-518b-a87f-29d09bb94c67 with scrape type 2
2026-03-30 10:57:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05f8b392-8071-518b-a87f-29d09bb94c67, identifier: BV92050
2026-03-30 10:57:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fdc891e-df5b-55c3-9a01-af9f940861c2 with identifier: LN95655
2026-03-30 10:57:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fdc891e-df5b-55c3-9a01-af9f940861c2 with identifier: LN95655
2026-03-30 10:57:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fdc891e-df5b-55c3-9a01-af9f940861c2 with identifier: LN95655 to the API
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:48:19Z',
 'fuel_type': 'diesel',
 'id': '1fdc891e-df5b-55c3-9a01-af9f940861c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN95655',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 114729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-25',
 'seller_name': None,
 'title': 'Jaguar F-Pace 25d R-Sport AWD',
 'transmission': 'automatic',
 'trim': 'R-Sport AWD',
 'year': 2018}
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN95655%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Saving data for LN95655: {'auction_closing_time': 1774885699.0, 'created_time': 1774378065.626057, 'last_price_update_time': 1774868264.390046}
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN95655') HTTP/1.1" 204 0
2026-03-30 10:57:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05f8b392-8071-518b-a87f-29d09bb94c67 with identifier: BV92050
2026-03-30 10:57:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05f8b392-8071-518b-a87f-29d09bb94c67 with identifier: BV92050
2026-03-30 10:57:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05f8b392-8071-518b-a87f-29d09bb94c67 with identifier: BV92050 to the API
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:36:37Z',
 'fuel_type': 'petrol',
 'id': '05f8b392-8071-518b-a87f-29d09bb94c67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV92050',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 231997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1993-02-04',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse 200 E',
 'transmission': 'automatic',
 'trim': '',
 'year': 1993}
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV92050%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Saving data for BV92050: {'auction_closing_time': 1774884997.0, 'created_time': 1774463608.812638, 'last_price_update_time': 1774868264.677283}
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV92050') HTTP/1.1" 204 0
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: UH31359
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: LG46226
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: BE23086
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: HP19661
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP19661%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Scrape type for HP19661: 2
2026-03-30 10:57:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8238ec44-0383-5046-be1a-e7c42cc33bdb with identifier: HP19661
2026-03-30 10:57:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8238ec44-0383-5046-be1a-e7c42cc33bdb with scrape type 2
2026-03-30 10:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8238ec44-0383-5046-be1a-e7c42cc33bdb with scrape type 2
2026-03-30 10:57:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8238ec44-0383-5046-be1a-e7c42cc33bdb, identifier: HP19661
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: ZA83090
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: NX62884
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: UL88623
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL88623%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Scrape type for UL88623: 2
2026-03-30 10:57:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 958a3d2b-100b-5ae8-811c-6a87a035140d with identifier: UL88623
2026-03-30 10:57:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 958a3d2b-100b-5ae8-811c-6a87a035140d with scrape type 2
2026-03-30 10:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 958a3d2b-100b-5ae8-811c-6a87a035140d with scrape type 2
2026-03-30 10:57:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 958a3d2b-100b-5ae8-811c-6a87a035140d, identifier: UL88623
2026-03-30 10:57:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8238ec44-0383-5046-be1a-e7c42cc33bdb with identifier: HP19661
2026-03-30 10:57:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8238ec44-0383-5046-be1a-e7c42cc33bdb with identifier: HP19661
2026-03-30 10:57:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8238ec44-0383-5046-be1a-e7c42cc33bdb with identifier: HP19661 to the API
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:08:28Z',
 'fuel_type': 'petrol',
 'id': '8238ec44-0383-5046-be1a-e7c42cc33bdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP19661',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 91691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-26',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 Kombi',
 'transmission': 'manual',
 'trim': 'Kombi',
 'year': 2005}
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP19661%27 HTTP/1.1" 200 None
2026-03-30 10:57:45 [auto1.de] INFO: Saving data for HP19661: {'auction_closing_time': 1774883308.0, 'created_time': 1774550615.240825, 'last_price_update_time': 1774868265.220993}
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP19661') HTTP/1.1" 204 0
2026-03-30 10:57:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 958a3d2b-100b-5ae8-811c-6a87a035140d with identifier: UL88623
2026-03-30 10:57:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 958a3d2b-100b-5ae8-811c-6a87a035140d with identifier: UL88623
2026-03-30 10:57:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 958a3d2b-100b-5ae8-811c-6a87a035140d with identifier: UL88623 to the API
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:09:38Z',
 'fuel_type': 'petrol',
 'id': '958a3d2b-100b-5ae8-811c-6a87a035140d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL88623',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 109444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-08',
 'seller_name': None,
 'title': 'Opel Grandland X 1.2 Turbo Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2018}
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL88623%27 HTTP/1.1" 200 None
2026-03-30 10:57:45 [auto1.de] INFO: Saving data for UL88623: {'auction_closing_time': 1774883378.0, 'created_time': 1773945331.322579, 'last_price_update_time': 1774868265.610635}
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL88623') HTTP/1.1" 204 0
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: FA69463
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA69463%27 HTTP/1.1" 200 None
2026-03-30 10:57:45 [auto1.de] INFO: Scrape type for FA69463: 2
2026-03-30 10:57:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8997a21-bf40-5799-9a09-62dcdd2b49c7 with identifier: FA69463
2026-03-30 10:57:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8997a21-bf40-5799-9a09-62dcdd2b49c7 with scrape type 2
2026-03-30 10:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8997a21-bf40-5799-9a09-62dcdd2b49c7 with scrape type 2
2026-03-30 10:57:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8997a21-bf40-5799-9a09-62dcdd2b49c7, identifier: FA69463
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: JJ76956
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: NW73502
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW73502%27 HTTP/1.1" 200 None
2026-03-30 10:57:45 [auto1.de] INFO: Scrape type for NW73502: 2
2026-03-30 10:57:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a491d60-8326-519a-b074-575ebff9da3e with identifier: NW73502
2026-03-30 10:57:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a491d60-8326-519a-b074-575ebff9da3e with scrape type 2
2026-03-30 10:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a491d60-8326-519a-b074-575ebff9da3e with scrape type 2
2026-03-30 10:57:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a491d60-8326-519a-b074-575ebff9da3e, identifier: NW73502
2026-03-30 10:57:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8997a21-bf40-5799-9a09-62dcdd2b49c7 with identifier: FA69463
2026-03-30 10:57:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8997a21-bf40-5799-9a09-62dcdd2b49c7 with identifier: FA69463
2026-03-30 10:57:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8997a21-bf40-5799-9a09-62dcdd2b49c7 with identifier: FA69463 to the API
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:52:58Z',
 'fuel_type': 'diesel',
 'id': 'e8997a21-bf40-5799-9a09-62dcdd2b49c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA69463',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 198185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-02',
 'seller_name': None,
 'title': 'Volvo XC60 2.4D DRIVe Summum Drive',
 'transmission': 'manual',
 'trim': 'Summum Drive',
 'year': 2009}
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA69463%27 HTTP/1.1" 200 None
2026-03-30 10:57:46 [auto1.de] INFO: Saving data for FA69463: {'auction_closing_time': 1774885978.0, 'created_time': 1773513881.506305, 'last_price_update_time': 1774868266.229997}
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA69463') HTTP/1.1" 204 0
2026-03-30 10:57:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a491d60-8326-519a-b074-575ebff9da3e with identifier: NW73502
2026-03-30 10:57:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a491d60-8326-519a-b074-575ebff9da3e with identifier: NW73502
2026-03-30 10:57:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a491d60-8326-519a-b074-575ebff9da3e with identifier: NW73502 to the API
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-30T15:00:15Z',
 'fuel_type': 'petrol',
 'id': '8a491d60-8326-519a-b074-575ebff9da3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW73502',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 317425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-05-04',
 'seller_name': None,
 'title': 'BMW 6er 645 CI',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW73502%27 HTTP/1.1" 200 None
2026-03-30 10:57:46 [auto1.de] INFO: Saving data for NW73502: {'auction_closing_time': 1774882815.0, 'created_time': 1774034330.250205, 'last_price_update_time': 1774868266.520552}
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW73502') HTTP/1.1" 204 0
2026-03-30 10:57:46 [auto1.de] INFO: Found listing with ID: GN33586
2026-03-30 10:57:46 [auto1.de] INFO: Found listing with ID: WG22836
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG22836%27 HTTP/1.1" 200 None
2026-03-30 10:57:46 [auto1.de] INFO: Scrape type for WG22836: 2
2026-03-30 10:57:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88f41d6b-1fc2-5ab4-8785-f664f32ba71c with identifier: WG22836
2026-03-30 10:57:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88f41d6b-1fc2-5ab4-8785-f664f32ba71c with scrape type 2
2026-03-30 10:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88f41d6b-1fc2-5ab4-8785-f664f32ba71c with scrape type 2
2026-03-30 10:57:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88f41d6b-1fc2-5ab4-8785-f664f32ba71c, identifier: WG22836
2026-03-30 10:57:46 [auto1.de] INFO: Found listing with ID: BV67523
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV67523%27 HTTP/1.1" 200 None
2026-03-30 10:57:46 [auto1.de] INFO: Scrape type for BV67523: 2
2026-03-30 10:57:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7a78ee6-6592-5869-bc2b-45d05206171f with identifier: BV67523
2026-03-30 10:57:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7a78ee6-6592-5869-bc2b-45d05206171f with scrape type 2
2026-03-30 10:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7a78ee6-6592-5869-bc2b-45d05206171f with scrape type 2
2026-03-30 10:57:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7a78ee6-6592-5869-bc2b-45d05206171f, identifier: BV67523
2026-03-30 10:57:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88f41d6b-1fc2-5ab4-8785-f664f32ba71c with identifier: WG22836
2026-03-30 10:57:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88f41d6b-1fc2-5ab4-8785-f664f32ba71c with identifier: WG22836
2026-03-30 10:57:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88f41d6b-1fc2-5ab4-8785-f664f32ba71c with identifier: WG22836 to the API
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:21:29Z',
 'fuel_type': 'petrol',
 'id': '88f41d6b-1fc2-5ab4-8785-f664f32ba71c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG22836',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 118621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-12-03',
 'seller_name': None,
 'title': 'Mazda 2 1.25 Comfort',
 'transmission': 'manual',
 'trim': '1.5 Comfort',
 'year': 2003}
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG22836%27 HTTP/1.1" 200 None
2026-03-30 10:57:47 [auto1.de] INFO: Saving data for WG22836: {'auction_closing_time': 1774884089.0, 'created_time': 1774550593.125223, 'last_price_update_time': 1774868267.102776}
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG22836') HTTP/1.1" 204 0
2026-03-30 10:57:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7a78ee6-6592-5869-bc2b-45d05206171f with identifier: BV67523
2026-03-30 10:57:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7a78ee6-6592-5869-bc2b-45d05206171f with identifier: BV67523
2026-03-30 10:57:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7a78ee6-6592-5869-bc2b-45d05206171f with identifier: BV67523 to the API
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:14:45Z',
 'fuel_type': 'diesel',
 'id': 'e7a78ee6-6592-5869-bc2b-45d05206171f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV67523',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 25778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-02',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi EcoBlue Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2024}
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV67523%27 HTTP/1.1" 200 None
2026-03-30 10:57:47 [auto1.de] INFO: Saving data for BV67523: {'auction_closing_time': 1774883685.0, 'created_time': 1774780303.697476, 'last_price_update_time': 1774868267.39004}
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV67523') HTTP/1.1" 204 0
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: HN88809
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: NV36056
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: GF37615
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: VF27943
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF27943%27 HTTP/1.1" 200 None
2026-03-30 10:57:47 [auto1.de] INFO: Scrape type for VF27943: 2
2026-03-30 10:57:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea833b6c-3be3-50c1-98c9-7fde0aa973e4 with identifier: VF27943
2026-03-30 10:57:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea833b6c-3be3-50c1-98c9-7fde0aa973e4 with scrape type 2
2026-03-30 10:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea833b6c-3be3-50c1-98c9-7fde0aa973e4 with scrape type 2
2026-03-30 10:57:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea833b6c-3be3-50c1-98c9-7fde0aa973e4, identifier: VF27943
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: NW01649
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01649%27 HTTP/1.1" 200 None
2026-03-30 10:57:47 [auto1.de] INFO: Scrape type for NW01649: 2
2026-03-30 10:57:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f50f3c7b-fd7a-5219-8b35-ea992b9249cc with identifier: NW01649
2026-03-30 10:57:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f50f3c7b-fd7a-5219-8b35-ea992b9249cc with scrape type 2
2026-03-30 10:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f50f3c7b-fd7a-5219-8b35-ea992b9249cc with scrape type 2
2026-03-30 10:57:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f50f3c7b-fd7a-5219-8b35-ea992b9249cc, identifier: NW01649
2026-03-30 10:57:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea833b6c-3be3-50c1-98c9-7fde0aa973e4 with identifier: VF27943
2026-03-30 10:57:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea833b6c-3be3-50c1-98c9-7fde0aa973e4 with identifier: VF27943
2026-03-30 10:57:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea833b6c-3be3-50c1-98c9-7fde0aa973e4 with identifier: VF27943 to the API
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:42:11Z',
 'fuel_type': 'petrol',
 'id': 'ea833b6c-3be3-50c1-98c9-7fde0aa973e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF27943',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 87853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-15',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2006}
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF27943%27 HTTP/1.1" 200 None
2026-03-30 10:57:48 [auto1.de] INFO: Saving data for VF27943: {'auction_closing_time': 1774885331.0, 'created_time': 1773916514.28384, 'last_price_update_time': 1774868268.264999}
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF27943') HTTP/1.1" 204 0
2026-03-30 10:57:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f50f3c7b-fd7a-5219-8b35-ea992b9249cc with identifier: NW01649
2026-03-30 10:57:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f50f3c7b-fd7a-5219-8b35-ea992b9249cc with identifier: NW01649
2026-03-30 10:57:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f50f3c7b-fd7a-5219-8b35-ea992b9249cc with identifier: NW01649 to the API
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:37:39Z',
 'fuel_type': 'hybrid',
 'id': 'f50f3c7b-fd7a-5219-8b35-ea992b9249cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW01649',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 66278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-19',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid Trend 4WD',
 'transmission': 'automatic',
 'trim': 'Trend 4WD',
 'year': 2021}
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01649%27 HTTP/1.1" 200 None
2026-03-30 10:57:48 [auto1.de] INFO: Saving data for NW01649: {'auction_closing_time': 1774885059.0, 'created_time': 1774780314.779653, 'last_price_update_time': 1774868268.659717}
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW01649') HTTP/1.1" 204 0
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: EK20296
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: MC98570
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: TU72063
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU72063%27 HTTP/1.1" 200 None
2026-03-30 10:57:48 [auto1.de] INFO: Scrape type for TU72063: 2
2026-03-30 10:57:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59db689c-e6e9-55bd-a165-7d30f115701d with identifier: TU72063
2026-03-30 10:57:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59db689c-e6e9-55bd-a165-7d30f115701d with scrape type 2
2026-03-30 10:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59db689c-e6e9-55bd-a165-7d30f115701d with scrape type 2
2026-03-30 10:57:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59db689c-e6e9-55bd-a165-7d30f115701d, identifier: TU72063
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: ZX12399
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: SN44411
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN44411%27 HTTP/1.1" 200 None
2026-03-30 10:57:48 [auto1.de] INFO: Scrape type for SN44411: 2
2026-03-30 10:57:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e95ce3b-362f-5b90-a933-cf6685f4498e with identifier: SN44411
2026-03-30 10:57:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e95ce3b-362f-5b90-a933-cf6685f4498e with scrape type 2
2026-03-30 10:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e95ce3b-362f-5b90-a933-cf6685f4498e with scrape type 2
2026-03-30 10:57:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e95ce3b-362f-5b90-a933-cf6685f4498e, identifier: SN44411
2026-03-30 10:57:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59db689c-e6e9-55bd-a165-7d30f115701d with identifier: TU72063
2026-03-30 10:57:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59db689c-e6e9-55bd-a165-7d30f115701d with identifier: TU72063
2026-03-30 10:57:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59db689c-e6e9-55bd-a165-7d30f115701d with identifier: TU72063 to the API
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:37:48Z',
 'fuel_type': 'petrol',
 'id': '59db689c-e6e9-55bd-a165-7d30f115701d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU72063',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 284910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-01-11',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Ghia',
 'transmission': 'manual',
 'trim': 'Ghia',
 'year': 1999}
2026-03-30 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU72063%27 HTTP/1.1" 200 None
2026-03-30 10:57:49 [auto1.de] INFO: Saving data for TU72063: {'auction_closing_time': 1774885068.0, 'created_time': 1774550549.329864, 'last_price_update_time': 1774868269.186783}
2026-03-30 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU72063') HTTP/1.1" 204 0
2026-03-30 10:57:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e95ce3b-362f-5b90-a933-cf6685f4498e with identifier: SN44411
2026-03-30 10:57:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e95ce3b-362f-5b90-a933-cf6685f4498e with identifier: SN44411
2026-03-30 10:57:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e95ce3b-362f-5b90-a933-cf6685f4498e with identifier: SN44411 to the API
2026-03-30 10:57:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:49:54Z',
 'fuel_type': 'petrol',
 'id': '6e95ce3b-362f-5b90-a933-cf6685f4498e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN44411',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 101666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-29',
 'seller_name': None,
 'title': 'Mazda 2 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2006}
2026-03-30 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN44411%27 HTTP/1.1" 200 None
2026-03-30 10:57:49 [auto1.de] INFO: Saving data for SN44411: {'auction_closing_time': 1774885794.0, 'created_time': 1774550555.04241, 'last_price_update_time': 1774868269.871458}
2026-03-30 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN44411') HTTP/1.1" 204 0
2026-03-30 10:57:49 [auto1.de] INFO: Found listing with ID: AF05413
2026-03-30 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF05413%27 HTTP/1.1" 200 None
2026-03-30 10:57:49 [auto1.de] INFO: Scrape type for AF05413: 2
2026-03-30 10:57:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7eb26a3-cc67-544b-bfbb-7dce8e8bc64b with identifier: AF05413
2026-03-30 10:57:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7eb26a3-cc67-544b-bfbb-7dce8e8bc64b with scrape type 2
2026-03-30 10:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7eb26a3-cc67-544b-bfbb-7dce8e8bc64b with scrape type 2
2026-03-30 10:57:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7eb26a3-cc67-544b-bfbb-7dce8e8bc64b, identifier: AF05413
2026-03-30 10:57:49 [auto1.de] INFO: Found listing with ID: BJ40023
2026-03-30 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ40023%27 HTTP/1.1" 200 None
2026-03-30 10:57:50 [auto1.de] INFO: Scrape type for BJ40023: 2
2026-03-30 10:57:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a1836bf-7b84-5dce-9abd-600ad1cd09b8 with identifier: BJ40023
2026-03-30 10:57:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a1836bf-7b84-5dce-9abd-600ad1cd09b8 with scrape type 2
2026-03-30 10:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a1836bf-7b84-5dce-9abd-600ad1cd09b8 with scrape type 2
2026-03-30 10:57:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a1836bf-7b84-5dce-9abd-600ad1cd09b8, identifier: BJ40023
2026-03-30 10:57:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7eb26a3-cc67-544b-bfbb-7dce8e8bc64b with identifier: AF05413
2026-03-30 10:57:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7eb26a3-cc67-544b-bfbb-7dce8e8bc64b with identifier: AF05413
2026-03-30 10:57:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7eb26a3-cc67-544b-bfbb-7dce8e8bc64b with identifier: AF05413 to the API
2026-03-30 10:57:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:42:07Z',
 'fuel_type': 'petrol',
 'id': 'a7eb26a3-cc67-544b-bfbb-7dce8e8bc64b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF05413',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 168073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-10',
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2015}
2026-03-30 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF05413%27 HTTP/1.1" 200 None
2026-03-30 10:57:50 [auto1.de] INFO: Saving data for AF05413: {'auction_closing_time': 1774885327.0, 'created_time': 1773858638.513168, 'last_price_update_time': 1774868270.386411}
2026-03-30 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF05413') HTTP/1.1" 204 0
2026-03-30 10:57:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a1836bf-7b84-5dce-9abd-600ad1cd09b8 with identifier: BJ40023
2026-03-30 10:57:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a1836bf-7b84-5dce-9abd-600ad1cd09b8 with identifier: BJ40023
2026-03-30 10:57:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a1836bf-7b84-5dce-9abd-600ad1cd09b8 with identifier: BJ40023 to the API
2026-03-30 10:57:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:14:57Z',
 'fuel_type': 'petrol',
 'id': '6a1836bf-7b84-5dce-9abd-600ad1cd09b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ40023',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 206491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-19',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-30 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ40023%27 HTTP/1.1" 200 None
2026-03-30 10:57:50 [auto1.de] INFO: Saving data for BJ40023: {'auction_closing_time': 1774883697.0, 'created_time': 1773741255.301452, 'last_price_update_time': 1774868270.670119}
2026-03-30 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ40023') HTTP/1.1" 204 0
2026-03-30 10:57:50 [auto1.de] INFO: Found listing with ID: GC94975
2026-03-30 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC94975%27 HTTP/1.1" 200 None
2026-03-30 10:57:50 [auto1.de] INFO: Scrape type for GC94975: 2
2026-03-30 10:57:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66af9027-17e3-51fa-9183-b7fe3a18ccb7 with identifier: GC94975
2026-03-30 10:57:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66af9027-17e3-51fa-9183-b7fe3a18ccb7 with scrape type 2
2026-03-30 10:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66af9027-17e3-51fa-9183-b7fe3a18ccb7 with scrape type 2
2026-03-30 10:57:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66af9027-17e3-51fa-9183-b7fe3a18ccb7, identifier: GC94975
2026-03-30 10:57:50 [auto1.de] INFO: Found listing with ID: HA10005
2026-03-30 10:57:50 [auto1.de] INFO: Found listing with ID: GM20688
2026-03-30 10:57:50 [auto1.de] INFO: Found listing with ID: CG76921
2026-03-30 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG76921%27 HTTP/1.1" 200 None
2026-03-30 10:57:50 [auto1.de] INFO: Scrape type for CG76921: 2
2026-03-30 10:57:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ef8c0f2-953e-5a56-9490-e11cee54bbd5 with identifier: CG76921
2026-03-30 10:57:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ef8c0f2-953e-5a56-9490-e11cee54bbd5 with scrape type 2
2026-03-30 10:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ef8c0f2-953e-5a56-9490-e11cee54bbd5 with scrape type 2
2026-03-30 10:57:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ef8c0f2-953e-5a56-9490-e11cee54bbd5, identifier: CG76921
2026-03-30 10:57:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66af9027-17e3-51fa-9183-b7fe3a18ccb7 with identifier: GC94975
2026-03-30 10:57:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66af9027-17e3-51fa-9183-b7fe3a18ccb7 with identifier: GC94975
2026-03-30 10:57:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66af9027-17e3-51fa-9183-b7fe3a18ccb7 with identifier: GC94975 to the API
2026-03-30 10:57:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:44:10Z',
 'fuel_type': 'petrol',
 'id': '66af9027-17e3-51fa-9183-b7fe3a18ccb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC94975',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 280616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-19',
 'seller_name': None,
 'title': 'Volvo V50 2.5 T5 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2010}
2026-03-30 10:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC94975%27 HTTP/1.1" 200 None
2026-03-30 10:57:51 [auto1.de] INFO: Saving data for GC94975: {'auction_closing_time': 1774885450.0, 'created_time': 1774636956.915607, 'last_price_update_time': 1774868271.207616}
2026-03-30 10:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC94975') HTTP/1.1" 204 0
2026-03-30 10:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ef8c0f2-953e-5a56-9490-e11cee54bbd5 with identifier: CG76921
2026-03-30 10:57:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ef8c0f2-953e-5a56-9490-e11cee54bbd5 with identifier: CG76921
2026-03-30 10:57:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ef8c0f2-953e-5a56-9490-e11cee54bbd5 with identifier: CG76921 to the API
2026-03-30 10:57:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:24:28Z',
 'fuel_type': 'petrol',
 'id': '3ef8c0f2-953e-5a56-9490-e11cee54bbd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG76921',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 193131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-02',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2010}
2026-03-30 10:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG76921%27 HTTP/1.1" 200 None
2026-03-30 10:57:51 [auto1.de] INFO: Saving data for CG76921: {'auction_closing_time': 1774884268.0, 'created_time': 1774636927.087307, 'last_price_update_time': 1774868271.566402}
2026-03-30 10:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG76921') HTTP/1.1" 204 0
2026-03-30 10:57:51 [auto1.de] INFO: Found listing with ID: JY14465
2026-03-30 10:57:51 [auto1.de] INFO: Found listing with ID: ZR75909
2026-03-30 10:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR75909%27 HTTP/1.1" 200 None
2026-03-30 10:57:51 [auto1.de] INFO: Scrape type for ZR75909: 2
2026-03-30 10:57:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8cbfc7b-9b4e-5741-81b3-fe4230f72468 with identifier: ZR75909
2026-03-30 10:57:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8cbfc7b-9b4e-5741-81b3-fe4230f72468 with scrape type 2
2026-03-30 10:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8cbfc7b-9b4e-5741-81b3-fe4230f72468 with scrape type 2
2026-03-30 10:57:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8cbfc7b-9b4e-5741-81b3-fe4230f72468, identifier: ZR75909
2026-03-30 10:57:51 [auto1.de] INFO: Found listing with ID: CZ25681
2026-03-30 10:57:51 [auto1.de] INFO: Found listing with ID: VR35896
2026-03-30 10:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR35896%27 HTTP/1.1" 200 None
2026-03-30 10:57:51 [auto1.de] INFO: Scrape type for VR35896: 2
2026-03-30 10:57:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49688d18-acd2-5c02-ab4b-7c216349aa1f with identifier: VR35896
2026-03-30 10:57:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49688d18-acd2-5c02-ab4b-7c216349aa1f with scrape type 2
2026-03-30 10:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49688d18-acd2-5c02-ab4b-7c216349aa1f with scrape type 2
2026-03-30 10:57:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49688d18-acd2-5c02-ab4b-7c216349aa1f, identifier: VR35896
2026-03-30 10:57:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8cbfc7b-9b4e-5741-81b3-fe4230f72468 with identifier: ZR75909
2026-03-30 10:57:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8cbfc7b-9b4e-5741-81b3-fe4230f72468 with identifier: ZR75909
2026-03-30 10:57:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8cbfc7b-9b4e-5741-81b3-fe4230f72468 with identifier: ZR75909 to the API
2026-03-30 10:57:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:49:58Z',
 'fuel_type': 'petrol',
 'id': 'b8cbfc7b-9b4e-5741-81b3-fe4230f72468',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR75909',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 57196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-10',
 'seller_name': None,
 'title': 'Ford C-Max 1.6 Ti-VCT Champions Edition',
 'transmission': 'manual',
 'trim': 'Champions Edition',
 'year': 2012}
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR75909%27 HTTP/1.1" 200 None
2026-03-30 10:57:52 [auto1.de] INFO: Saving data for ZR75909: {'auction_closing_time': 1774885798.0, 'created_time': 1774637089.603083, 'last_price_update_time': 1774868272.057478}
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR75909') HTTP/1.1" 204 0
2026-03-30 10:57:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49688d18-acd2-5c02-ab4b-7c216349aa1f with identifier: VR35896
2026-03-30 10:57:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49688d18-acd2-5c02-ab4b-7c216349aa1f with identifier: VR35896
2026-03-30 10:57:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49688d18-acd2-5c02-ab4b-7c216349aa1f with identifier: VR35896 to the API
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:10:20Z',
 'fuel_type': 'diesel',
 'id': '49688d18-acd2-5c02-ab4b-7c216349aa1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR35896',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 111936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-26',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2020}
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR35896%27 HTTP/1.1" 200 None
2026-03-30 10:57:52 [auto1.de] INFO: Saving data for VR35896: {'auction_closing_time': 1774883420.0, 'created_time': 1774780317.494969, 'last_price_update_time': 1774868272.331567}
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR35896') HTTP/1.1" 204 0
2026-03-30 10:57:52 [auto1.de] INFO: Found listing with ID: TT55225
2026-03-30 10:57:52 [auto1.de] INFO: Found listing with ID: EX17549
2026-03-30 10:57:52 [auto1.de] INFO: Found listing with ID: TE08681
2026-03-30 10:57:52 [auto1.de] INFO: Found listing with ID: HB21625
2026-03-30 10:57:52 [auto1.de] INFO: Found listing with ID: YW33550
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW33550%27 HTTP/1.1" 200 None
2026-03-30 10:57:52 [auto1.de] INFO: Scrape type for YW33550: 2
2026-03-30 10:57:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 171ee208-e936-5f33-8d86-fb1f36b81e89 with identifier: YW33550
2026-03-30 10:57:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 171ee208-e936-5f33-8d86-fb1f36b81e89 with scrape type 2
2026-03-30 10:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 171ee208-e936-5f33-8d86-fb1f36b81e89 with scrape type 2
2026-03-30 10:57:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 171ee208-e936-5f33-8d86-fb1f36b81e89, identifier: YW33550
2026-03-30 10:57:52 [auto1.de] INFO: Found listing with ID: JT14161
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT14161%27 HTTP/1.1" 200 None
2026-03-30 10:57:52 [auto1.de] INFO: Scrape type for JT14161: 2
2026-03-30 10:57:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee340f3c-e505-5e60-a56b-6b813dc53f99 with identifier: JT14161
2026-03-30 10:57:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee340f3c-e505-5e60-a56b-6b813dc53f99 with scrape type 2
2026-03-30 10:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee340f3c-e505-5e60-a56b-6b813dc53f99 with scrape type 2
2026-03-30 10:57:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee340f3c-e505-5e60-a56b-6b813dc53f99, identifier: JT14161
2026-03-30 10:57:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 171ee208-e936-5f33-8d86-fb1f36b81e89 with identifier: YW33550
2026-03-30 10:57:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 171ee208-e936-5f33-8d86-fb1f36b81e89 with identifier: YW33550
2026-03-30 10:57:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 171ee208-e936-5f33-8d86-fb1f36b81e89 with identifier: YW33550 to the API
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-30T15:04:07Z',
 'fuel_type': 'diesel',
 'id': '171ee208-e936-5f33-8d86-fb1f36b81e89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW33550',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Carnival',
 'odometer': 412565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-30',
 'seller_name': None,
 'title': 'Kia Carnival 2.2 CRDi VGT Active',
 'transmission': 'manual',
 'trim': 'VGT Active',
 'year': 2012}
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW33550%27 HTTP/1.1" 200 None
2026-03-30 10:57:52 [auto1.de] INFO: Saving data for YW33550: {'auction_closing_time': 1774883047.0, 'created_time': 1774550604.558615, 'last_price_update_time': 1774868272.835909}
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW33550') HTTP/1.1" 204 0
2026-03-30 10:57:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee340f3c-e505-5e60-a56b-6b813dc53f99 with identifier: JT14161
2026-03-30 10:57:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee340f3c-e505-5e60-a56b-6b813dc53f99 with identifier: JT14161
2026-03-30 10:57:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee340f3c-e505-5e60-a56b-6b813dc53f99 with identifier: JT14161 to the API
2026-03-30 10:57:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:22:03Z',
 'fuel_type': 'petrol',
 'id': 'ee340f3c-e505-5e60-a56b-6b813dc53f99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT14161',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 41197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 eTSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-03-30 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT14161%27 HTTP/1.1" 200 None
2026-03-30 10:57:53 [auto1.de] INFO: Saving data for JT14161: {'auction_closing_time': 1774884123.0, 'created_time': 1774780310.769714, 'last_price_update_time': 1774868273.128827}
2026-03-30 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT14161') HTTP/1.1" 204 0
2026-03-30 10:57:53 [auto1.de] INFO: Found listing with ID: VE07121
2026-03-30 10:57:53 [auto1.de] INFO: Found listing with ID: RT89872
2026-03-30 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT89872%27 HTTP/1.1" 200 None
2026-03-30 10:57:53 [auto1.de] INFO: Scrape type for RT89872: 2
2026-03-30 10:57:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 997a9cd7-3c22-5867-8c2d-9de0f5f61a43 with identifier: RT89872
2026-03-30 10:57:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 997a9cd7-3c22-5867-8c2d-9de0f5f61a43 with scrape type 2
2026-03-30 10:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 997a9cd7-3c22-5867-8c2d-9de0f5f61a43 with scrape type 2
2026-03-30 10:57:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 997a9cd7-3c22-5867-8c2d-9de0f5f61a43, identifier: RT89872
2026-03-30 10:57:53 [auto1.de] INFO: Channel: 24h | Page: 75 | totalHits: 9539 | hits on page: 40
2026-03-30 10:57:53 [auto1.de] INFO: Found listing with ID: WF02803
2026-03-30 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF02803%27 HTTP/1.1" 200 None
2026-03-30 10:57:53 [auto1.de] INFO: Scrape type for WF02803: 0
2026-03-30 10:57:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 997a9cd7-3c22-5867-8c2d-9de0f5f61a43 with identifier: RT89872
2026-03-30 10:57:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 997a9cd7-3c22-5867-8c2d-9de0f5f61a43 with identifier: RT89872
2026-03-30 10:57:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 997a9cd7-3c22-5867-8c2d-9de0f5f61a43 with identifier: RT89872 to the API
2026-03-30 10:57:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:34:58Z',
 'fuel_type': 'petrol',
 'id': '997a9cd7-3c22-5867-8c2d-9de0f5f61a43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT89872',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 48410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-16',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2016}
2026-03-30 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT89872%27 HTTP/1.1" 200 None
2026-03-30 10:57:53 [auto1.de] INFO: Saving data for RT89872: {'auction_closing_time': 1774884898.0, 'created_time': 1774780317.836136, 'last_price_update_time': 1774868273.553324}
2026-03-30 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT89872') HTTP/1.1" 204 0
2026-03-30 10:57:53 [auto1.de] INFO: Found listing with ID: VN24673
2026-03-30 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN24673%27 HTTP/1.1" 200 None
2026-03-30 10:57:53 [auto1.de] INFO: Scrape type for VN24673: 2
2026-03-30 10:57:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e32ba46-4499-5bc5-b6af-b3fb205a3b5a with identifier: VN24673
2026-03-30 10:57:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e32ba46-4499-5bc5-b6af-b3fb205a3b5a with scrape type 2
2026-03-30 10:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e32ba46-4499-5bc5-b6af-b3fb205a3b5a with scrape type 2
2026-03-30 10:57:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e32ba46-4499-5bc5-b6af-b3fb205a3b5a, identifier: VN24673
2026-03-30 10:57:53 [auto1.de] INFO: Found listing with ID: RC66900
2026-03-30 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC66900%27 HTTP/1.1" 200 None
2026-03-30 10:57:53 [auto1.de] INFO: Scrape type for RC66900: 2
2026-03-30 10:57:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ee2dbab-ece9-5e33-9072-779fd6c515fe with identifier: RC66900
2026-03-30 10:57:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ee2dbab-ece9-5e33-9072-779fd6c515fe with scrape type 2
2026-03-30 10:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ee2dbab-ece9-5e33-9072-779fd6c515fe with scrape type 2
2026-03-30 10:57:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ee2dbab-ece9-5e33-9072-779fd6c515fe, identifier: RC66900
2026-03-30 10:57:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e32ba46-4499-5bc5-b6af-b3fb205a3b5a with identifier: VN24673
2026-03-30 10:57:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e32ba46-4499-5bc5-b6af-b3fb205a3b5a with identifier: VN24673
2026-03-30 10:57:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e32ba46-4499-5bc5-b6af-b3fb205a3b5a with identifier: VN24673 to the API
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:40Z',
 'fuel_type': 'petrol',
 'id': '0e32ba46-4499-5bc5-b6af-b3fb205a3b5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN24673',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 149021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-03-18',
 'seller_name': None,
 'title': 'Audi A3 1.8 Turbo Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2001}
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN24673%27 HTTP/1.1" 200 None
2026-03-30 10:57:54 [auto1.de] INFO: Saving data for VN24673: {'auction_closing_time': 1774883020.0, 'created_time': 1774550523.046473, 'last_price_update_time': 1774868274.176534}
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN24673') HTTP/1.1" 204 0
2026-03-30 10:57:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ee2dbab-ece9-5e33-9072-779fd6c515fe with identifier: RC66900
2026-03-30 10:57:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ee2dbab-ece9-5e33-9072-779fd6c515fe with identifier: RC66900
2026-03-30 10:57:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ee2dbab-ece9-5e33-9072-779fd6c515fe with identifier: RC66900 to the API
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:10:26Z',
 'fuel_type': 'diesel',
 'id': '4ee2dbab-ece9-5e33-9072-779fd6c515fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC66900',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 272871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-20',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2017}
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC66900%27 HTTP/1.1" 200 None
2026-03-30 10:57:54 [auto1.de] INFO: Saving data for RC66900: {'auction_closing_time': 1774883426.0, 'created_time': 1774550584.765639, 'last_price_update_time': 1774868274.473078}
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC66900') HTTP/1.1" 204 0
2026-03-30 10:57:54 [auto1.de] INFO: Found listing with ID: RL83760
2026-03-30 10:57:54 [auto1.de] INFO: Found listing with ID: HH17921
2026-03-30 10:57:54 [auto1.de] INFO: Found listing with ID: UY63030
2026-03-30 10:57:54 [auto1.de] INFO: Found listing with ID: ZY88037
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY88037%27 HTTP/1.1" 200 None
2026-03-30 10:57:54 [auto1.de] INFO: Scrape type for ZY88037: 2
2026-03-30 10:57:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3bbf779-952f-540f-bf39-4589ddc71fde with identifier: ZY88037
2026-03-30 10:57:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3bbf779-952f-540f-bf39-4589ddc71fde with scrape type 2
2026-03-30 10:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3bbf779-952f-540f-bf39-4589ddc71fde with scrape type 2
2026-03-30 10:57:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3bbf779-952f-540f-bf39-4589ddc71fde, identifier: ZY88037
2026-03-30 10:57:54 [auto1.de] INFO: Found listing with ID: XV56284
2026-03-30 10:57:54 [auto1.de] INFO: Found listing with ID: TR94323
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR94323%27 HTTP/1.1" 200 None
2026-03-30 10:57:54 [auto1.de] INFO: Scrape type for TR94323: 2
2026-03-30 10:57:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc66a8f5-25ae-5d91-bb89-aac4a563639e with identifier: TR94323
2026-03-30 10:57:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc66a8f5-25ae-5d91-bb89-aac4a563639e with scrape type 2
2026-03-30 10:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc66a8f5-25ae-5d91-bb89-aac4a563639e with scrape type 2
2026-03-30 10:57:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc66a8f5-25ae-5d91-bb89-aac4a563639e, identifier: TR94323
2026-03-30 10:57:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3bbf779-952f-540f-bf39-4589ddc71fde with identifier: ZY88037
2026-03-30 10:57:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3bbf779-952f-540f-bf39-4589ddc71fde with identifier: ZY88037
2026-03-30 10:57:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3bbf779-952f-540f-bf39-4589ddc71fde with identifier: ZY88037 to the API
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:06:40Z',
 'fuel_type': 'petrol',
 'id': 'f3bbf779-952f-540f-bf39-4589ddc71fde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY88037',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 236214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-11',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY88037%27 HTTP/1.1" 200 None
2026-03-30 10:57:54 [auto1.de] INFO: Saving data for ZY88037: {'auction_closing_time': 1774883200.0, 'created_time': 1773513822.523555, 'last_price_update_time': 1774868274.960478}
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY88037') HTTP/1.1" 204 0
2026-03-30 10:57:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc66a8f5-25ae-5d91-bb89-aac4a563639e with identifier: TR94323
2026-03-30 10:57:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc66a8f5-25ae-5d91-bb89-aac4a563639e with identifier: TR94323
2026-03-30 10:57:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc66a8f5-25ae-5d91-bb89-aac4a563639e with identifier: TR94323 to the API
2026-03-30 10:57:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:52:16Z',
 'fuel_type': 'diesel',
 'id': 'fc66a8f5-25ae-5d91-bb89-aac4a563639e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR94323',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 209011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-15',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2016}
2026-03-30 10:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR94323%27 HTTP/1.1" 200 None
2026-03-30 10:57:55 [auto1.de] INFO: Saving data for TR94323: {'auction_closing_time': 1774885936.0, 'created_time': 1774378063.197687, 'last_price_update_time': 1774868275.242812}
2026-03-30 10:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR94323') HTTP/1.1" 204 0
2026-03-30 10:57:55 [auto1.de] INFO: Found listing with ID: NC19407
2026-03-30 10:57:55 [auto1.de] INFO: Found listing with ID: MZ37823
2026-03-30 10:57:55 [auto1.de] INFO: Found listing with ID: KG90894
2026-03-30 10:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG90894%27 HTTP/1.1" 200 None
2026-03-30 10:57:55 [auto1.de] INFO: Scrape type for KG90894: 2
2026-03-30 10:57:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2a7b556-2d00-5885-8dff-d1abad71ef7a with identifier: KG90894
2026-03-30 10:57:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2a7b556-2d00-5885-8dff-d1abad71ef7a with scrape type 2
2026-03-30 10:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2a7b556-2d00-5885-8dff-d1abad71ef7a with scrape type 2
2026-03-30 10:57:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2a7b556-2d00-5885-8dff-d1abad71ef7a, identifier: KG90894
2026-03-30 10:57:55 [auto1.de] INFO: Found listing with ID: EJ33834
2026-03-30 10:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ33834%27 HTTP/1.1" 200 None
2026-03-30 10:57:55 [auto1.de] INFO: Scrape type for EJ33834: 2
2026-03-30 10:57:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 413a3914-20fc-5777-99b9-31922ed9518b with identifier: EJ33834
2026-03-30 10:57:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 413a3914-20fc-5777-99b9-31922ed9518b with scrape type 2
2026-03-30 10:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 413a3914-20fc-5777-99b9-31922ed9518b with scrape type 2
2026-03-30 10:57:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 413a3914-20fc-5777-99b9-31922ed9518b, identifier: EJ33834
2026-03-30 10:57:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2a7b556-2d00-5885-8dff-d1abad71ef7a with identifier: KG90894
2026-03-30 10:57:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2a7b556-2d00-5885-8dff-d1abad71ef7a with identifier: KG90894
2026-03-30 10:57:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2a7b556-2d00-5885-8dff-d1abad71ef7a with identifier: KG90894 to the API
2026-03-30 10:57:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:40:29Z',
 'fuel_type': 'petrol',
 'id': 'b2a7b556-2d00-5885-8dff-d1abad71ef7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG90894',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': '300 C',
 'odometer': 161148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-05',
 'seller_name': None,
 'title': 'Chrysler 300 C 3.5 AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2006}
2026-03-30 10:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG90894%27 HTTP/1.1" 200 None
2026-03-30 10:57:55 [auto1.de] INFO: Saving data for KG90894: {'auction_closing_time': 1774885229.0, 'created_time': 1773946298.709831, 'last_price_update_time': 1774868275.75235}
2026-03-30 10:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG90894') HTTP/1.1" 204 0
2026-03-30 10:57:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 413a3914-20fc-5777-99b9-31922ed9518b with identifier: EJ33834
2026-03-30 10:57:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 413a3914-20fc-5777-99b9-31922ed9518b with identifier: EJ33834
2026-03-30 10:57:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 413a3914-20fc-5777-99b9-31922ed9518b with identifier: EJ33834 to the API
2026-03-30 10:57:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:41:27Z',
 'fuel_type': 'diesel',
 'id': '413a3914-20fc-5777-99b9-31922ed9518b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ33834',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 110391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-12',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TDI quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2016}
2026-03-30 10:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ33834%27 HTTP/1.1" 200 None
2026-03-30 10:57:56 [auto1.de] INFO: Saving data for EJ33834: {'auction_closing_time': 1774885287.0, 'created_time': 1773304368.744154, 'last_price_update_time': 1774868276.123668}
2026-03-30 10:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ33834') HTTP/1.1" 204 0
2026-03-30 10:57:56 [auto1.de] INFO: Found listing with ID: AA02702
2026-03-30 10:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA02702%27 HTTP/1.1" 200 None
2026-03-30 10:57:56 [auto1.de] INFO: Scrape type for AA02702: 2
2026-03-30 10:57:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11e9db4f-00b8-5bb1-bf3e-c13743eee6aa with identifier: AA02702
2026-03-30 10:57:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11e9db4f-00b8-5bb1-bf3e-c13743eee6aa with scrape type 2
2026-03-30 10:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11e9db4f-00b8-5bb1-bf3e-c13743eee6aa with scrape type 2
2026-03-30 10:57:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11e9db4f-00b8-5bb1-bf3e-c13743eee6aa, identifier: AA02702
2026-03-30 10:57:56 [auto1.de] INFO: Found listing with ID: KH07650
2026-03-30 10:57:56 [auto1.de] INFO: Found listing with ID: FN39592
2026-03-30 10:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN39592%27 HTTP/1.1" 200 None
2026-03-30 10:57:56 [auto1.de] INFO: Scrape type for FN39592: 2
2026-03-30 10:57:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1761fd98-236d-51fe-a30f-47513867503a with identifier: FN39592
2026-03-30 10:57:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1761fd98-236d-51fe-a30f-47513867503a with scrape type 2
2026-03-30 10:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1761fd98-236d-51fe-a30f-47513867503a with scrape type 2
2026-03-30 10:57:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1761fd98-236d-51fe-a30f-47513867503a, identifier: FN39592
2026-03-30 10:57:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11e9db4f-00b8-5bb1-bf3e-c13743eee6aa with identifier: AA02702
2026-03-30 10:57:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11e9db4f-00b8-5bb1-bf3e-c13743eee6aa with identifier: AA02702
2026-03-30 10:57:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11e9db4f-00b8-5bb1-bf3e-c13743eee6aa with identifier: AA02702 to the API
2026-03-30 10:57:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:37:47Z',
 'fuel_type': 'petrol',
 'id': '11e9db4f-00b8-5bb1-bf3e-c13743eee6aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA02702',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 447278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-12-07',
 'seller_name': None,
 'title': 'Peugeot 206 1.6 XS',
 'transmission': 'manual',
 'trim': 'XS',
 'year': 1999}
2026-03-30 10:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA02702%27 HTTP/1.1" 200 None
2026-03-30 10:57:56 [auto1.de] INFO: Saving data for AA02702: {'auction_closing_time': 1774885067.0, 'created_time': 1773686028.635727, 'last_price_update_time': 1774868276.636686}
2026-03-30 10:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA02702') HTTP/1.1" 204 0
2026-03-30 10:57:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1761fd98-236d-51fe-a30f-47513867503a with identifier: FN39592
2026-03-30 10:57:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1761fd98-236d-51fe-a30f-47513867503a with identifier: FN39592
2026-03-30 10:57:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1761fd98-236d-51fe-a30f-47513867503a with identifier: FN39592 to the API
2026-03-30 10:57:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:23:29Z',
 'fuel_type': 'petrol',
 'id': '1761fd98-236d-51fe-a30f-47513867503a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN39592',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 210292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-31',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Night & Day',
 'transmission': 'manual',
 'trim': 'Night & Day',
 'year': 2010}
2026-03-30 10:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN39592%27 HTTP/1.1" 200 None
2026-03-30 10:57:57 [auto1.de] INFO: Saving data for FN39592: {'auction_closing_time': 1774884209.0, 'created_time': 1774550543.034391, 'last_price_update_time': 1774868277.390926}
2026-03-30 10:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN39592') HTTP/1.1" 204 0
2026-03-30 10:57:57 [auto1.de] INFO: Found listing with ID: WX41278
2026-03-30 10:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41278%27 HTTP/1.1" 200 None
2026-03-30 10:57:57 [auto1.de] INFO: Scrape type for WX41278: 2
2026-03-30 10:57:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efbaa066-2f65-5e30-a06a-501207fe30e0 with identifier: WX41278
2026-03-30 10:57:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efbaa066-2f65-5e30-a06a-501207fe30e0 with scrape type 2
2026-03-30 10:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efbaa066-2f65-5e30-a06a-501207fe30e0 with scrape type 2
2026-03-30 10:57:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efbaa066-2f65-5e30-a06a-501207fe30e0, identifier: WX41278
2026-03-30 10:57:57 [auto1.de] INFO: Found listing with ID: YV56430
2026-03-30 10:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV56430%27 HTTP/1.1" 200 None
2026-03-30 10:57:57 [auto1.de] INFO: Scrape type for YV56430: 2
2026-03-30 10:57:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ad49959-ca0c-5ed7-8206-f178d4ab9ba6 with identifier: YV56430
2026-03-30 10:57:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ad49959-ca0c-5ed7-8206-f178d4ab9ba6 with scrape type 2
2026-03-30 10:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ad49959-ca0c-5ed7-8206-f178d4ab9ba6 with scrape type 2
2026-03-30 10:57:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ad49959-ca0c-5ed7-8206-f178d4ab9ba6, identifier: YV56430
2026-03-30 10:57:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efbaa066-2f65-5e30-a06a-501207fe30e0 with identifier: WX41278
2026-03-30 10:57:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efbaa066-2f65-5e30-a06a-501207fe30e0 with identifier: WX41278
2026-03-30 10:57:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efbaa066-2f65-5e30-a06a-501207fe30e0 with identifier: WX41278 to the API
2026-03-30 10:57:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:05:56Z',
 'fuel_type': 'petrol',
 'id': 'efbaa066-2f65-5e30-a06a-501207fe30e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX41278',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Saxo',
 'odometer': 143593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-09-28',
 'seller_name': None,
 'title': 'Citroen Saxo 1.4 SX',
 'transmission': 'automatic',
 'trim': 'SX',
 'year': 2000}
2026-03-30 10:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41278%27 HTTP/1.1" 200 None
2026-03-30 10:57:57 [auto1.de] INFO: Saving data for WX41278: {'auction_closing_time': 1774883156.0, 'created_time': 1774550594.689694, 'last_price_update_time': 1774868277.912291}
2026-03-30 10:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX41278') HTTP/1.1" 204 0
2026-03-30 10:57:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ad49959-ca0c-5ed7-8206-f178d4ab9ba6 with identifier: YV56430
2026-03-30 10:57:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ad49959-ca0c-5ed7-8206-f178d4ab9ba6 with identifier: YV56430
2026-03-30 10:57:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ad49959-ca0c-5ed7-8206-f178d4ab9ba6 with identifier: YV56430 to the API
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:52:05Z',
 'fuel_type': 'diesel',
 'id': '8ad49959-ca0c-5ed7-8206-f178d4ab9ba6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV56430',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 95521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-21',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI IQ.DRIVE',
 'transmission': 'manual',
 'trim': 'IQ.DRIVE',
 'year': 2019}
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV56430%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Saving data for YV56430: {'auction_closing_time': 1774885925.0, 'created_time': 1774780421.622981, 'last_price_update_time': 1774868278.253639}
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV56430') HTTP/1.1" 204 0
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: FF58085
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF58085%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for FF58085: 2
2026-03-30 10:57:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2937853-fce6-5b63-9812-53652face763 with identifier: FF58085
2026-03-30 10:57:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2937853-fce6-5b63-9812-53652face763 with scrape type 2
2026-03-30 10:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2937853-fce6-5b63-9812-53652face763 with scrape type 2
2026-03-30 10:57:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2937853-fce6-5b63-9812-53652face763, identifier: FF58085
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: VV83737
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV83737%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for VV83737: 2
2026-03-30 10:57:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a5df0a2-e24e-5c0b-a636-aae542bb4d0c with identifier: VV83737
2026-03-30 10:57:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a5df0a2-e24e-5c0b-a636-aae542bb4d0c with scrape type 2
2026-03-30 10:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a5df0a2-e24e-5c0b-a636-aae542bb4d0c with scrape type 2
2026-03-30 10:57:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a5df0a2-e24e-5c0b-a636-aae542bb4d0c, identifier: VV83737
2026-03-30 10:57:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2937853-fce6-5b63-9812-53652face763 with identifier: FF58085
2026-03-30 10:57:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2937853-fce6-5b63-9812-53652face763 with identifier: FF58085
2026-03-30 10:57:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2937853-fce6-5b63-9812-53652face763 with identifier: FF58085 to the API
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:32:25Z',
 'fuel_type': 'petrol',
 'id': 'b2937853-fce6-5b63-9812-53652face763',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF58085',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 40079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2020}
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF58085%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Saving data for FF58085: {'auction_closing_time': 1774884745.0, 'created_time': 1774780352.245183, 'last_price_update_time': 1774868278.759991}
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF58085') HTTP/1.1" 204 0
2026-03-30 10:57:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a5df0a2-e24e-5c0b-a636-aae542bb4d0c with identifier: VV83737
2026-03-30 10:57:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a5df0a2-e24e-5c0b-a636-aae542bb4d0c with identifier: VV83737
2026-03-30 10:57:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a5df0a2-e24e-5c0b-a636-aae542bb4d0c with identifier: VV83737 to the API
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:51:41Z',
 'fuel_type': 'diesel',
 'id': '4a5df0a2-e24e-5c0b-a636-aae542bb4d0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV83737',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 207173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-02-29',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2004}
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV83737%27 HTTP/1.1" 200 None
2026-03-30 10:57:59 [auto1.de] INFO: Saving data for VV83737: {'auction_closing_time': 1774885901.0, 'created_time': 1773775921.08137, 'last_price_update_time': 1774868279.073691}
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV83737') HTTP/1.1" 204 0
2026-03-30 10:57:59 [auto1.de] INFO: Found listing with ID: RC66900
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC66900%27 HTTP/1.1" 200 None
2026-03-30 10:57:59 [auto1.de] INFO: Scrape type for RC66900: 0
2026-03-30 10:57:59 [auto1.de] INFO: Found listing with ID: BS63746
2026-03-30 10:57:59 [auto1.de] INFO: Found listing with ID: BD67330
2026-03-30 10:57:59 [auto1.de] INFO: Found listing with ID: EC15325
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC15325%27 HTTP/1.1" 200 None
2026-03-30 10:57:59 [auto1.de] INFO: Scrape type for EC15325: 2
2026-03-30 10:57:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7ebe7b0-b36d-5ff2-8a30-7aac71918b07 with identifier: EC15325
2026-03-30 10:57:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7ebe7b0-b36d-5ff2-8a30-7aac71918b07 with scrape type 2
2026-03-30 10:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7ebe7b0-b36d-5ff2-8a30-7aac71918b07 with scrape type 2
2026-03-30 10:57:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7ebe7b0-b36d-5ff2-8a30-7aac71918b07, identifier: EC15325
2026-03-30 10:57:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7ebe7b0-b36d-5ff2-8a30-7aac71918b07 with identifier: EC15325
2026-03-30 10:57:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7ebe7b0-b36d-5ff2-8a30-7aac71918b07 with identifier: EC15325
2026-03-30 10:57:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7ebe7b0-b36d-5ff2-8a30-7aac71918b07 with identifier: EC15325 to the API
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:57:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:53:19Z',
 'fuel_type': 'petrol',
 'id': 'c7ebe7b0-b36d-5ff2-8a30-7aac71918b07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC15325',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 231222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-14',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2007}
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC15325%27 HTTP/1.1" 200 None
2026-03-30 10:57:59 [auto1.de] INFO: Saving data for EC15325: {'auction_closing_time': 1774885999.0, 'created_time': 1774377822.055251, 'last_price_update_time': 1774868279.530148}
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC15325') HTTP/1.1" 204 0
2026-03-30 10:57:59 [auto1.de] INFO: Found listing with ID: JC71292
2026-03-30 10:57:59 [auto1.de] INFO: Found listing with ID: XY86775
2026-03-30 10:57:59 [auto1.de] INFO: Found listing with ID: MR97164
2026-03-30 10:57:59 [auto1.de] INFO: Found listing with ID: TL60563
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL60563%27 HTTP/1.1" 200 None
2026-03-30 10:57:59 [auto1.de] INFO: Scrape type for TL60563: 2
2026-03-30 10:57:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99e87bf2-c906-587a-846a-6139d4b91744 with identifier: TL60563
2026-03-30 10:57:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99e87bf2-c906-587a-846a-6139d4b91744 with scrape type 2
2026-03-30 10:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99e87bf2-c906-587a-846a-6139d4b91744 with scrape type 2
2026-03-30 10:57:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99e87bf2-c906-587a-846a-6139d4b91744, identifier: TL60563
2026-03-30 10:57:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99e87bf2-c906-587a-846a-6139d4b91744 with identifier: TL60563
2026-03-30 10:57:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99e87bf2-c906-587a-846a-6139d4b91744 with identifier: TL60563
2026-03-30 10:57:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99e87bf2-c906-587a-846a-6139d4b91744 with identifier: TL60563 to the API
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:47:17Z',
 'fuel_type': 'petrol',
 'id': '99e87bf2-c906-587a-846a-6139d4b91744',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL60563',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 187433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-28',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.4 Start',
 'transmission': 'manual',
 'trim': 'Start',
 'year': 2009}
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL60563%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Saving data for TL60563: {'auction_closing_time': 1774885637.0, 'created_time': 1774637091.298332, 'last_price_update_time': 1774868280.040206}
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL60563') HTTP/1.1" 204 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: GF90377
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: EX05236
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: FY44506
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: RR70760
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: DC02620
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: LF08399
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: XW84981
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW84981%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for XW84981: 2
2026-03-30 10:58:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 731ec55a-3d50-57ae-9a14-4264915628bb with identifier: XW84981
2026-03-30 10:58:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 731ec55a-3d50-57ae-9a14-4264915628bb with scrape type 2
2026-03-30 10:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 731ec55a-3d50-57ae-9a14-4264915628bb with scrape type 2
2026-03-30 10:58:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 731ec55a-3d50-57ae-9a14-4264915628bb, identifier: XW84981
2026-03-30 10:58:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 731ec55a-3d50-57ae-9a14-4264915628bb with identifier: XW84981
2026-03-30 10:58:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 731ec55a-3d50-57ae-9a14-4264915628bb with identifier: XW84981
2026-03-30 10:58:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 731ec55a-3d50-57ae-9a14-4264915628bb with identifier: XW84981 to the API
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:00:55Z',
 'fuel_type': 'diesel',
 'id': '731ec55a-3d50-57ae-9a14-4264915628bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW84981',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 233413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-27',
 'seller_name': None,
 'title': 'Opel Astra 1.9 CDTI Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2007}
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW84981%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Saving data for XW84981: {'auction_closing_time': 1774882855.0, 'created_time': 1774550604.198652, 'last_price_update_time': 1774868280.49656}
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW84981') HTTP/1.1" 204 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: MT41300
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: HB92022
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: XE54390
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE54390%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for XE54390: 2
2026-03-30 10:58:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41d38c57-ef15-5798-9a27-aee8ee156eb0 with identifier: XE54390
2026-03-30 10:58:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41d38c57-ef15-5798-9a27-aee8ee156eb0 with scrape type 2
2026-03-30 10:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41d38c57-ef15-5798-9a27-aee8ee156eb0 with scrape type 2
2026-03-30 10:58:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41d38c57-ef15-5798-9a27-aee8ee156eb0, identifier: XE54390
2026-03-30 10:58:00 [auto1.de] INFO: Channel: 24h | Page: 76 | totalHits: 9541 | hits on page: 40
2026-03-30 10:58:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41d38c57-ef15-5798-9a27-aee8ee156eb0 with identifier: XE54390
2026-03-30 10:58:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41d38c57-ef15-5798-9a27-aee8ee156eb0 with identifier: XE54390
2026-03-30 10:58:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41d38c57-ef15-5798-9a27-aee8ee156eb0 with identifier: XE54390 to the API
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:58:41Z',
 'fuel_type': 'diesel',
 'id': '41d38c57-ef15-5798-9a27-aee8ee156eb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE54390',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 61125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-03',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Rip Curl M',
 'transmission': 'manual',
 'trim': 'Rip Curl M',
 'year': 2021}
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE54390%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Saving data for XE54390: {'auction_closing_time': 1774886321.0, 'created_time': 1774780342.728714, 'last_price_update_time': 1774868281.150112}
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE54390') HTTP/1.1" 204 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: WT31487
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: US93398
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US93398%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for US93398: 2
2026-03-30 10:58:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8249ca84-61f2-58cb-a953-07a073e4957f with identifier: US93398
2026-03-30 10:58:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8249ca84-61f2-58cb-a953-07a073e4957f with scrape type 2
2026-03-30 10:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8249ca84-61f2-58cb-a953-07a073e4957f with scrape type 2
2026-03-30 10:58:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8249ca84-61f2-58cb-a953-07a073e4957f, identifier: US93398
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: SP94156
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: KJ70545
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: NV52830
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: XW55257
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW55257%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for XW55257: 2
2026-03-30 10:58:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: accf0361-0787-58c4-a0c7-aa6e57f4641a with identifier: XW55257
2026-03-30 10:58:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item accf0361-0787-58c4-a0c7-aa6e57f4641a with scrape type 2
2026-03-30 10:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item accf0361-0787-58c4-a0c7-aa6e57f4641a with scrape type 2
2026-03-30 10:58:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: accf0361-0787-58c4-a0c7-aa6e57f4641a, identifier: XW55257
2026-03-30 10:58:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8249ca84-61f2-58cb-a953-07a073e4957f with identifier: US93398
2026-03-30 10:58:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8249ca84-61f2-58cb-a953-07a073e4957f with identifier: US93398
2026-03-30 10:58:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8249ca84-61f2-58cb-a953-07a073e4957f with identifier: US93398 to the API
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:28:38Z',
 'fuel_type': 'petrol',
 'id': '8249ca84-61f2-58cb-a953-07a073e4957f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US93398',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 427105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-11-18',
 'seller_name': None,
 'title': 'Volvo V50 2.5 T5 Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2004}
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US93398%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Saving data for US93398: {'auction_closing_time': 1774884518.0, 'created_time': 1774550548.711299, 'last_price_update_time': 1774868281.693937}
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US93398') HTTP/1.1" 204 0
2026-03-30 10:58:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: accf0361-0787-58c4-a0c7-aa6e57f4641a with identifier: XW55257
2026-03-30 10:58:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: accf0361-0787-58c4-a0c7-aa6e57f4641a with identifier: XW55257
2026-03-30 10:58:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: accf0361-0787-58c4-a0c7-aa6e57f4641a with identifier: XW55257 to the API
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:03:36Z',
 'fuel_type': 'petrol',
 'id': 'accf0361-0787-58c4-a0c7-aa6e57f4641a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW55257',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 18979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1996-09-30',
 'seller_name': None,
 'title': 'Ford Fiesta 1.3 Flair',
 'transmission': 'manual',
 'trim': 'Flair',
 'year': 1996}
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW55257%27 HTTP/1.1" 200 None
2026-03-30 10:58:02 [auto1.de] INFO: Saving data for XW55257: {'auction_closing_time': 1774883016.0, 'created_time': 1773859582.83327, 'last_price_update_time': 1774868282.0184}
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW55257') HTTP/1.1" 204 0
2026-03-30 10:58:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:58:02 [auto1.de] INFO: Found listing with ID: WY12370
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY12370%27 HTTP/1.1" 200 None
2026-03-30 10:58:02 [auto1.de] INFO: Scrape type for WY12370: 2
2026-03-30 10:58:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 850a70d8-3c55-5ea7-b452-fda69f1950a9 with identifier: WY12370
2026-03-30 10:58:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 850a70d8-3c55-5ea7-b452-fda69f1950a9 with scrape type 2
2026-03-30 10:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 850a70d8-3c55-5ea7-b452-fda69f1950a9 with scrape type 2
2026-03-30 10:58:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 850a70d8-3c55-5ea7-b452-fda69f1950a9, identifier: WY12370
2026-03-30 10:58:02 [auto1.de] INFO: Found listing with ID: WM05984
2026-03-30 10:58:02 [auto1.de] INFO: Found listing with ID: TY76082
2026-03-30 10:58:02 [auto1.de] INFO: Found listing with ID: FG48186
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48186%27 HTTP/1.1" 200 None
2026-03-30 10:58:02 [auto1.de] INFO: Scrape type for FG48186: 2
2026-03-30 10:58:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c65683a5-d29c-5b69-9b3a-91a69b5bd89b with identifier: FG48186
2026-03-30 10:58:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c65683a5-d29c-5b69-9b3a-91a69b5bd89b with scrape type 2
2026-03-30 10:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c65683a5-d29c-5b69-9b3a-91a69b5bd89b with scrape type 2
2026-03-30 10:58:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c65683a5-d29c-5b69-9b3a-91a69b5bd89b, identifier: FG48186
2026-03-30 10:58:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 850a70d8-3c55-5ea7-b452-fda69f1950a9 with identifier: WY12370
2026-03-30 10:58:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 850a70d8-3c55-5ea7-b452-fda69f1950a9 with identifier: WY12370
2026-03-30 10:58:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 850a70d8-3c55-5ea7-b452-fda69f1950a9 with identifier: WY12370 to the API
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:26:03Z',
 'fuel_type': 'diesel',
 'id': '850a70d8-3c55-5ea7-b452-fda69f1950a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY12370',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 149881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-29',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2010}
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY12370%27 HTTP/1.1" 200 None
2026-03-30 10:58:02 [auto1.de] INFO: Saving data for WY12370: {'auction_closing_time': 1774884363.0, 'created_time': 1773467217.125431, 'last_price_update_time': 1774868282.513927}
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY12370') HTTP/1.1" 204 0
2026-03-30 10:58:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c65683a5-d29c-5b69-9b3a-91a69b5bd89b with identifier: FG48186
2026-03-30 10:58:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c65683a5-d29c-5b69-9b3a-91a69b5bd89b with identifier: FG48186
2026-03-30 10:58:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c65683a5-d29c-5b69-9b3a-91a69b5bd89b with identifier: FG48186 to the API
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:35:21Z',
 'fuel_type': 'petrol',
 'id': 'c65683a5-d29c-5b69-9b3a-91a69b5bd89b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG48186',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 122701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-06',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Prestige 4x2',
 'transmission': 'manual',
 'trim': 'Prestige 4x2',
 'year': 2014}
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48186%27 HTTP/1.1" 200 None
2026-03-30 10:58:02 [auto1.de] INFO: Saving data for FG48186: {'auction_closing_time': 1774884921.0, 'created_time': 1773773426.276808, 'last_price_update_time': 1774868282.864735}
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG48186') HTTP/1.1" 204 0
2026-03-30 10:58:02 [auto1.de] INFO: Found listing with ID: GT54138
2026-03-30 10:58:02 [auto1.de] INFO: Found listing with ID: UJ19896
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ19896%27 HTTP/1.1" 200 None
2026-03-30 10:58:02 [auto1.de] INFO: Scrape type for UJ19896: 2
2026-03-30 10:58:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63b2b7f6-96a5-56d0-a962-46423cdfae32 with identifier: UJ19896
2026-03-30 10:58:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63b2b7f6-96a5-56d0-a962-46423cdfae32 with scrape type 2
2026-03-30 10:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63b2b7f6-96a5-56d0-a962-46423cdfae32 with scrape type 2
2026-03-30 10:58:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63b2b7f6-96a5-56d0-a962-46423cdfae32, identifier: UJ19896
2026-03-30 10:58:02 [auto1.de] INFO: Found listing with ID: VN17699
2026-03-30 10:58:02 [auto1.de] INFO: Found listing with ID: EC36111
2026-03-30 10:58:02 [auto1.de] INFO: Found listing with ID: WJ67809
2026-03-30 10:58:02 [auto1.de] INFO: Found listing with ID: GB77683
2026-03-30 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB77683%27 HTTP/1.1" 200 None
2026-03-30 10:58:03 [auto1.de] INFO: Scrape type for GB77683: 2
2026-03-30 10:58:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b843591-2833-5691-9655-bd526122f8f2 with identifier: GB77683
2026-03-30 10:58:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b843591-2833-5691-9655-bd526122f8f2 with scrape type 2
2026-03-30 10:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b843591-2833-5691-9655-bd526122f8f2 with scrape type 2
2026-03-30 10:58:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b843591-2833-5691-9655-bd526122f8f2, identifier: GB77683
2026-03-30 10:58:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63b2b7f6-96a5-56d0-a962-46423cdfae32 with identifier: UJ19896
2026-03-30 10:58:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63b2b7f6-96a5-56d0-a962-46423cdfae32 with identifier: UJ19896
2026-03-30 10:58:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63b2b7f6-96a5-56d0-a962-46423cdfae32 with identifier: UJ19896 to the API
2026-03-30 10:58:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:16:04Z',
 'fuel_type': 'petrol',
 'id': '63b2b7f6-96a5-56d0-a962-46423cdfae32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ19896',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Vento',
 'odometer': 321848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1993-04-15',
 'seller_name': None,
 'title': 'Volkswagen Vento 1.8 GL',
 'transmission': 'manual',
 'trim': 'GL',
 'year': 1993}
2026-03-30 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ19896%27 HTTP/1.1" 200 None
2026-03-30 10:58:03 [auto1.de] INFO: Saving data for UJ19896: {'auction_closing_time': 1774883764.0, 'created_time': 1774463607.989343, 'last_price_update_time': 1774868283.436052}
2026-03-30 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ19896') HTTP/1.1" 204 0
2026-03-30 10:58:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b843591-2833-5691-9655-bd526122f8f2 with identifier: GB77683
2026-03-30 10:58:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b843591-2833-5691-9655-bd526122f8f2 with identifier: GB77683
2026-03-30 10:58:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b843591-2833-5691-9655-bd526122f8f2 with identifier: GB77683 to the API
2026-03-30 10:58:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:30:44Z',
 'fuel_type': 'petrol',
 'id': '1b843591-2833-5691-9655-bd526122f8f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB77683',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 128966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-10-19',
 'seller_name': None,
 'title': 'Audi A3 1.6 Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 1998}
2026-03-30 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB77683%27 HTTP/1.1" 200 None
2026-03-30 10:58:03 [auto1.de] INFO: Saving data for GB77683: {'auction_closing_time': 1774884644.0, 'created_time': 1773344087.545874, 'last_price_update_time': 1774868283.711358}
2026-03-30 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB77683') HTTP/1.1" 204 0
2026-03-30 10:58:03 [auto1.de] INFO: Found listing with ID: ZL28977
2026-03-30 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL28977%27 HTTP/1.1" 200 None
2026-03-30 10:58:03 [auto1.de] INFO: Scrape type for ZL28977: 2
2026-03-30 10:58:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22e8954a-1784-5c89-a9cc-959036665613 with identifier: ZL28977
2026-03-30 10:58:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22e8954a-1784-5c89-a9cc-959036665613 with scrape type 2
2026-03-30 10:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22e8954a-1784-5c89-a9cc-959036665613 with scrape type 2
2026-03-30 10:58:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22e8954a-1784-5c89-a9cc-959036665613, identifier: ZL28977
2026-03-30 10:58:03 [auto1.de] INFO: Found listing with ID: WZ39505
2026-03-30 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ39505%27 HTTP/1.1" 200 None
2026-03-30 10:58:03 [auto1.de] INFO: Scrape type for WZ39505: 2
2026-03-30 10:58:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2fe8a46-5aa4-51f5-9eb6-8e8d2ad15817 with identifier: WZ39505
2026-03-30 10:58:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2fe8a46-5aa4-51f5-9eb6-8e8d2ad15817 with scrape type 2
2026-03-30 10:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2fe8a46-5aa4-51f5-9eb6-8e8d2ad15817 with scrape type 2
2026-03-30 10:58:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2fe8a46-5aa4-51f5-9eb6-8e8d2ad15817, identifier: WZ39505
2026-03-30 10:58:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22e8954a-1784-5c89-a9cc-959036665613 with identifier: ZL28977
2026-03-30 10:58:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22e8954a-1784-5c89-a9cc-959036665613 with identifier: ZL28977
2026-03-30 10:58:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22e8954a-1784-5c89-a9cc-959036665613 with identifier: ZL28977 to the API
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:29:49Z',
 'fuel_type': 'diesel',
 'id': '22e8954a-1784-5c89-a9cc-959036665613',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL28977',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 78102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-01',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TDI BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2015}
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL28977%27 HTTP/1.1" 200 None
2026-03-30 10:58:04 [auto1.de] INFO: Saving data for ZL28977: {'auction_closing_time': 1774884589.0, 'created_time': 1774780341.357981, 'last_price_update_time': 1774868284.211862}
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL28977') HTTP/1.1" 204 0
2026-03-30 10:58:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2fe8a46-5aa4-51f5-9eb6-8e8d2ad15817 with identifier: WZ39505
2026-03-30 10:58:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2fe8a46-5aa4-51f5-9eb6-8e8d2ad15817 with identifier: WZ39505
2026-03-30 10:58:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2fe8a46-5aa4-51f5-9eb6-8e8d2ad15817 with identifier: WZ39505 to the API
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:54:40Z',
 'fuel_type': 'petrol',
 'id': 'b2fe8a46-5aa4-51f5-9eb6-8e8d2ad15817',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ39505',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 133734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-02',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2008}
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ39505%27 HTTP/1.1" 200 None
2026-03-30 10:58:04 [auto1.de] INFO: Saving data for WZ39505: {'auction_closing_time': 1774886080.0, 'created_time': 1773469014.33106, 'last_price_update_time': 1774868284.579979}
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ39505') HTTP/1.1" 204 0
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: LN54864
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN54864%27 HTTP/1.1" 200 None
2026-03-30 10:58:04 [auto1.de] INFO: Scrape type for LN54864: 2
2026-03-30 10:58:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a9ef21e-2010-5feb-b9de-40a6a93c7652 with identifier: LN54864
2026-03-30 10:58:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a9ef21e-2010-5feb-b9de-40a6a93c7652 with scrape type 2
2026-03-30 10:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a9ef21e-2010-5feb-b9de-40a6a93c7652 with scrape type 2
2026-03-30 10:58:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a9ef21e-2010-5feb-b9de-40a6a93c7652, identifier: LN54864
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: YL47006
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL47006%27 HTTP/1.1" 200 None
2026-03-30 10:58:04 [auto1.de] INFO: Scrape type for YL47006: 2
2026-03-30 10:58:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa5eb005-b22d-5e53-b43a-af0115e83611 with identifier: YL47006
2026-03-30 10:58:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa5eb005-b22d-5e53-b43a-af0115e83611 with scrape type 2
2026-03-30 10:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa5eb005-b22d-5e53-b43a-af0115e83611 with scrape type 2
2026-03-30 10:58:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa5eb005-b22d-5e53-b43a-af0115e83611, identifier: YL47006
2026-03-30 10:58:04 [scrapy.extensions.logstats] INFO: Crawled 822 pages (at 10 pages/min), scraped 1188 items (at 81 items/min)
2026-03-30 10:58:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:58:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a9ef21e-2010-5feb-b9de-40a6a93c7652 with identifier: LN54864
2026-03-30 10:58:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a9ef21e-2010-5feb-b9de-40a6a93c7652 with identifier: LN54864
2026-03-30 10:58:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a9ef21e-2010-5feb-b9de-40a6a93c7652 with identifier: LN54864 to the API
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:39:48Z',
 'fuel_type': 'petrol',
 'id': '5a9ef21e-2010-5feb-b9de-40a6a93c7652',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN54864',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 210844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-03',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2005}
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN54864%27 HTTP/1.1" 200 None
2026-03-30 10:58:05 [auto1.de] INFO: Saving data for LN54864: {'auction_closing_time': 1774885188.0, 'created_time': 1774637062.769113, 'last_price_update_time': 1774868285.140382}
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN54864') HTTP/1.1" 204 0
2026-03-30 10:58:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa5eb005-b22d-5e53-b43a-af0115e83611 with identifier: YL47006
2026-03-30 10:58:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa5eb005-b22d-5e53-b43a-af0115e83611 with identifier: YL47006
2026-03-30 10:58:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa5eb005-b22d-5e53-b43a-af0115e83611 with identifier: YL47006 to the API
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:45:44Z',
 'fuel_type': 'petrol',
 'id': 'fa5eb005-b22d-5e53-b43a-af0115e83611',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL47006',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 209214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-12',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 FSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2006}
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL47006%27 HTTP/1.1" 200 None
2026-03-30 10:58:05 [auto1.de] INFO: Saving data for YL47006: {'auction_closing_time': 1774885544.0, 'created_time': 1774637042.402727, 'last_price_update_time': 1774868285.944338}
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL47006') HTTP/1.1" 204 0
2026-03-30 10:58:05 [auto1.de] INFO: Found listing with ID: GA07513
2026-03-30 10:58:05 [auto1.de] INFO: Found listing with ID: FE29735
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE29735%27 HTTP/1.1" 200 None
2026-03-30 10:58:05 [auto1.de] INFO: Scrape type for FE29735: 2
2026-03-30 10:58:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0bcab1c-636a-5a2c-a33f-40d40a109e5c with identifier: FE29735
2026-03-30 10:58:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0bcab1c-636a-5a2c-a33f-40d40a109e5c with scrape type 2
2026-03-30 10:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0bcab1c-636a-5a2c-a33f-40d40a109e5c with scrape type 2
2026-03-30 10:58:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0bcab1c-636a-5a2c-a33f-40d40a109e5c, identifier: FE29735
2026-03-30 10:58:06 [auto1.de] INFO: Found listing with ID: BT97276
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97276%27 HTTP/1.1" 200 None
2026-03-30 10:58:06 [auto1.de] INFO: Scrape type for BT97276: 2
2026-03-30 10:58:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e2e2c1e-aff6-5b52-9aad-2c08eb9972f9 with identifier: BT97276
2026-03-30 10:58:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e2e2c1e-aff6-5b52-9aad-2c08eb9972f9 with scrape type 2
2026-03-30 10:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e2e2c1e-aff6-5b52-9aad-2c08eb9972f9 with scrape type 2
2026-03-30 10:58:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e2e2c1e-aff6-5b52-9aad-2c08eb9972f9, identifier: BT97276
2026-03-30 10:58:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0bcab1c-636a-5a2c-a33f-40d40a109e5c with identifier: FE29735
2026-03-30 10:58:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0bcab1c-636a-5a2c-a33f-40d40a109e5c with identifier: FE29735
2026-03-30 10:58:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0bcab1c-636a-5a2c-a33f-40d40a109e5c with identifier: FE29735 to the API
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:11:16Z',
 'fuel_type': 'petrol',
 'id': 'c0bcab1c-636a-5a2c-a33f-40d40a109e5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE29735',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Stream',
 'odometer': 194193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-09-30',
 'seller_name': None,
 'title': 'Honda Stream 1.7 ES',
 'transmission': 'manual',
 'trim': 'ES',
 'year': 2002}
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE29735%27 HTTP/1.1" 200 None
2026-03-30 10:58:06 [auto1.de] INFO: Saving data for FE29735: {'auction_closing_time': 1774883476.0, 'created_time': 1774636968.439187, 'last_price_update_time': 1774868286.430681}
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE29735') HTTP/1.1" 204 0
2026-03-30 10:58:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e2e2c1e-aff6-5b52-9aad-2c08eb9972f9 with identifier: BT97276
2026-03-30 10:58:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e2e2c1e-aff6-5b52-9aad-2c08eb9972f9 with identifier: BT97276
2026-03-30 10:58:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e2e2c1e-aff6-5b52-9aad-2c08eb9972f9 with identifier: BT97276 to the API
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:58:00Z',
 'fuel_type': 'petrol',
 'id': '4e2e2c1e-aff6-5b52-9aad-2c08eb9972f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT97276',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 90840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-18',
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2011}
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97276%27 HTTP/1.1" 200 None
2026-03-30 10:58:06 [auto1.de] INFO: Saving data for BT97276: {'auction_closing_time': 1774886280.0, 'created_time': 1773514021.870677, 'last_price_update_time': 1774868286.799048}
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT97276') HTTP/1.1" 204 0
2026-03-30 10:58:06 [auto1.de] INFO: Found listing with ID: BS02635
2026-03-30 10:58:06 [auto1.de] INFO: Found listing with ID: UB74163
2026-03-30 10:58:06 [auto1.de] INFO: Found listing with ID: TB77068
2026-03-30 10:58:06 [auto1.de] INFO: Found listing with ID: NB51359
2026-03-30 10:58:06 [auto1.de] INFO: Found listing with ID: SP94156
2026-03-30 10:58:06 [auto1.de] INFO: Found listing with ID: KJ70545
2026-03-30 10:58:06 [auto1.de] INFO: Found listing with ID: UJ62660
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ62660%27 HTTP/1.1" 200 None
2026-03-30 10:58:06 [auto1.de] INFO: Scrape type for UJ62660: 2
2026-03-30 10:58:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b662192d-f4e5-561c-b631-4b6338526435 with identifier: UJ62660
2026-03-30 10:58:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b662192d-f4e5-561c-b631-4b6338526435 with scrape type 2
2026-03-30 10:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b662192d-f4e5-561c-b631-4b6338526435 with scrape type 2
2026-03-30 10:58:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b662192d-f4e5-561c-b631-4b6338526435, identifier: UJ62660
2026-03-30 10:58:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b662192d-f4e5-561c-b631-4b6338526435 with identifier: UJ62660
2026-03-30 10:58:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b662192d-f4e5-561c-b631-4b6338526435 with identifier: UJ62660
2026-03-30 10:58:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b662192d-f4e5-561c-b631-4b6338526435 with identifier: UJ62660 to the API
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:40:16Z',
 'fuel_type': 'petrol',
 'id': 'b662192d-f4e5-561c-b631-4b6338526435',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ62660',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vaneo',
 'odometer': 196471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-21',
 'seller_name': None,
 'title': 'Mercedes-Benz Vaneo 1.6',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ62660%27 HTTP/1.1" 200 None
2026-03-30 10:58:07 [auto1.de] INFO: Saving data for UJ62660: {'auction_closing_time': 1774885216.0, 'created_time': 1773945942.047663, 'last_price_update_time': 1774868287.203549}
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ62660') HTTP/1.1" 204 0
2026-03-30 10:58:07 [auto1.de] INFO: Found listing with ID: UY36184
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY36184%27 HTTP/1.1" 200 None
2026-03-30 10:58:07 [auto1.de] INFO: Scrape type for UY36184: 2
2026-03-30 10:58:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8daeb7aa-7514-5fd6-b42c-bce11aa9dc7f with identifier: UY36184
2026-03-30 10:58:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8daeb7aa-7514-5fd6-b42c-bce11aa9dc7f with scrape type 2
2026-03-30 10:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8daeb7aa-7514-5fd6-b42c-bce11aa9dc7f with scrape type 2
2026-03-30 10:58:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8daeb7aa-7514-5fd6-b42c-bce11aa9dc7f, identifier: UY36184
2026-03-30 10:58:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8daeb7aa-7514-5fd6-b42c-bce11aa9dc7f with identifier: UY36184
2026-03-30 10:58:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8daeb7aa-7514-5fd6-b42c-bce11aa9dc7f with identifier: UY36184
2026-03-30 10:58:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8daeb7aa-7514-5fd6-b42c-bce11aa9dc7f with identifier: UY36184 to the API
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:17:33Z',
 'fuel_type': 'petrol',
 'id': '8daeb7aa-7514-5fd6-b42c-bce11aa9dc7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY36184',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 129754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-09-24',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4',
 'transmission': 'manual',
 'trim': '',
 'year': 2001}
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY36184%27 HTTP/1.1" 200 None
2026-03-30 10:58:07 [auto1.de] INFO: Saving data for UY36184: {'auction_closing_time': 1774883853.0, 'created_time': 1773658080.224862, 'last_price_update_time': 1774868287.613297}
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY36184') HTTP/1.1" 204 0
2026-03-30 10:58:07 [auto1.de] INFO: Found listing with ID: JK20630
2026-03-30 10:58:07 [auto1.de] INFO: Found listing with ID: WE06039
2026-03-30 10:58:07 [auto1.de] INFO: Found listing with ID: UR84816
2026-03-30 10:58:07 [auto1.de] INFO: Found listing with ID: UF70247
2026-03-30 10:58:07 [auto1.de] INFO: Found listing with ID: XA86799
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA86799%27 HTTP/1.1" 200 None
2026-03-30 10:58:07 [auto1.de] INFO: Scrape type for XA86799: 2
2026-03-30 10:58:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0240ce5e-e920-579b-9357-e5be0e78e72c with identifier: XA86799
2026-03-30 10:58:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0240ce5e-e920-579b-9357-e5be0e78e72c with scrape type 2
2026-03-30 10:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0240ce5e-e920-579b-9357-e5be0e78e72c with scrape type 2
2026-03-30 10:58:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0240ce5e-e920-579b-9357-e5be0e78e72c, identifier: XA86799
2026-03-30 10:58:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0240ce5e-e920-579b-9357-e5be0e78e72c with identifier: XA86799
2026-03-30 10:58:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0240ce5e-e920-579b-9357-e5be0e78e72c with identifier: XA86799
2026-03-30 10:58:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0240ce5e-e920-579b-9357-e5be0e78e72c with identifier: XA86799 to the API
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:47:54Z',
 'fuel_type': 'diesel',
 'id': '0240ce5e-e920-579b-9357-e5be0e78e72c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA86799',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 148632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-28',
 'seller_name': None,
 'title': 'Mazda 3 1.5 Diesel Nakama',
 'transmission': 'manual',
 'trim': 'Nakama',
 'year': 2016}
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA86799%27 HTTP/1.1" 200 None
2026-03-30 10:58:08 [auto1.de] INFO: Saving data for XA86799: {'auction_closing_time': 1774885674.0, 'created_time': 1773858787.253308, 'last_price_update_time': 1774868288.001982}
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA86799') HTTP/1.1" 204 0
2026-03-30 10:58:08 [auto1.de] INFO: Found listing with ID: SU99742
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU99742%27 HTTP/1.1" 200 None
2026-03-30 10:58:08 [auto1.de] INFO: Scrape type for SU99742: 2
2026-03-30 10:58:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69c4b2a5-4cc4-5207-9b46-d69fcb924f32 with identifier: SU99742
2026-03-30 10:58:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69c4b2a5-4cc4-5207-9b46-d69fcb924f32 with scrape type 2
2026-03-30 10:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69c4b2a5-4cc4-5207-9b46-d69fcb924f32 with scrape type 2
2026-03-30 10:58:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69c4b2a5-4cc4-5207-9b46-d69fcb924f32, identifier: SU99742
2026-03-30 10:58:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69c4b2a5-4cc4-5207-9b46-d69fcb924f32 with identifier: SU99742
2026-03-30 10:58:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69c4b2a5-4cc4-5207-9b46-d69fcb924f32 with identifier: SU99742
2026-03-30 10:58:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69c4b2a5-4cc4-5207-9b46-d69fcb924f32 with identifier: SU99742 to the API
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:42:28Z',
 'fuel_type': 'petrol',
 'id': '69c4b2a5-4cc4-5207-9b46-d69fcb924f32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU99742',
 'listing': 'auction',
 'make': 'Ssangyong',
 'model': 'Korando',
 'odometer': 83798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-09',
 'seller_name': None,
 'title': 'Ssangyong Korando 2.0 Sapphire 4x4',
 'transmission': 'manual',
 'trim': 'Sapphire 4x4',
 'year': 2018}
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU99742%27 HTTP/1.1" 200 None
2026-03-30 10:58:08 [auto1.de] INFO: Saving data for SU99742: {'auction_closing_time': 1774885348.0, 'created_time': 1773776189.462942, 'last_price_update_time': 1774868288.492839}
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU99742') HTTP/1.1" 204 0
2026-03-30 10:58:08 [auto1.de] INFO: Found listing with ID: ZE87532
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE87532%27 HTTP/1.1" 200 None
2026-03-30 10:58:08 [auto1.de] INFO: Scrape type for ZE87532: 2
2026-03-30 10:58:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fd8fd80-0859-5108-94ba-171ff1ce341e with identifier: ZE87532
2026-03-30 10:58:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fd8fd80-0859-5108-94ba-171ff1ce341e with scrape type 2
2026-03-30 10:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fd8fd80-0859-5108-94ba-171ff1ce341e with scrape type 2
2026-03-30 10:58:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fd8fd80-0859-5108-94ba-171ff1ce341e, identifier: ZE87532
2026-03-30 10:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:58:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fd8fd80-0859-5108-94ba-171ff1ce341e with identifier: ZE87532
2026-03-30 10:58:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fd8fd80-0859-5108-94ba-171ff1ce341e with identifier: ZE87532
2026-03-30 10:58:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fd8fd80-0859-5108-94ba-171ff1ce341e with identifier: ZE87532 to the API
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:13:45Z',
 'fuel_type': 'petrol',
 'id': '4fd8fd80-0859-5108-94ba-171ff1ce341e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE87532',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 167361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-24',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Edition+',
 'transmission': 'manual',
 'trim': 'Edition+',
 'year': 2009}
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE87532%27 HTTP/1.1" 200 None
2026-03-30 10:58:08 [auto1.de] INFO: Saving data for ZE87532: {'auction_closing_time': 1774883625.0, 'created_time': 1773830165.174128, 'last_price_update_time': 1774868288.979298}
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE87532') HTTP/1.1" 204 0
2026-03-30 10:58:08 [auto1.de] INFO: Found listing with ID: JY35599
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY35599%27 HTTP/1.1" 200 None
2026-03-30 10:58:09 [auto1.de] INFO: Scrape type for JY35599: 2
2026-03-30 10:58:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ada89e0f-5213-57bd-aefd-6641dacdf237 with identifier: JY35599
2026-03-30 10:58:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ada89e0f-5213-57bd-aefd-6641dacdf237 with scrape type 2
2026-03-30 10:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ada89e0f-5213-57bd-aefd-6641dacdf237 with scrape type 2
2026-03-30 10:58:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ada89e0f-5213-57bd-aefd-6641dacdf237, identifier: JY35599
2026-03-30 10:58:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ada89e0f-5213-57bd-aefd-6641dacdf237 with identifier: JY35599
2026-03-30 10:58:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ada89e0f-5213-57bd-aefd-6641dacdf237 with identifier: JY35599
2026-03-30 10:58:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ada89e0f-5213-57bd-aefd-6641dacdf237 with identifier: JY35599 to the API
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:52:35Z',
 'fuel_type': 'diesel',
 'id': 'ada89e0f-5213-57bd-aefd-6641dacdf237',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY35599',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 75580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-21',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Sound BlueMotion',
 'transmission': 'automatic',
 'trim': 'Sound BlueMotion',
 'year': 2017}
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY35599%27 HTTP/1.1" 200 None
2026-03-30 10:58:09 [auto1.de] INFO: Saving data for JY35599: {'auction_closing_time': 1774885955.0, 'created_time': 1773398185.668254, 'last_price_update_time': 1774868289.409446}
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY35599') HTTP/1.1" 204 0
2026-03-30 10:58:09 [auto1.de] INFO: Found listing with ID: PT45615
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT45615%27 HTTP/1.1" 200 None
2026-03-30 10:58:09 [auto1.de] INFO: Scrape type for PT45615: 2
2026-03-30 10:58:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fedc6e7a-ace9-587b-bce2-cca52e60d26d with identifier: PT45615
2026-03-30 10:58:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fedc6e7a-ace9-587b-bce2-cca52e60d26d with scrape type 2
2026-03-30 10:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fedc6e7a-ace9-587b-bce2-cca52e60d26d with scrape type 2
2026-03-30 10:58:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fedc6e7a-ace9-587b-bce2-cca52e60d26d, identifier: PT45615
2026-03-30 10:58:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fedc6e7a-ace9-587b-bce2-cca52e60d26d with identifier: PT45615
2026-03-30 10:58:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fedc6e7a-ace9-587b-bce2-cca52e60d26d with identifier: PT45615
2026-03-30 10:58:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fedc6e7a-ace9-587b-bce2-cca52e60d26d with identifier: PT45615 to the API
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:06:11Z',
 'fuel_type': 'petrol',
 'id': 'fedc6e7a-ace9-587b-bce2-cca52e60d26d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT45615',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 153206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-08',
 'seller_name': None,
 'title': 'Audi A4 45 TFSI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2021}
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT45615%27 HTTP/1.1" 200 None
2026-03-30 10:58:09 [auto1.de] INFO: Saving data for PT45615: {'auction_closing_time': 1774883171.0, 'created_time': 1774032168.740015, 'last_price_update_time': 1774868289.812823}
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT45615') HTTP/1.1" 204 0
2026-03-30 10:58:09 [auto1.de] INFO: Channel: 24h | Page: 77 | totalHits: 9541 | hits on page: 40
2026-03-30 10:58:09 [auto1.de] INFO: Found listing with ID: ZJ67042
2026-03-30 10:58:09 [auto1.de] INFO: Found listing with ID: JA40486
2026-03-30 10:58:09 [auto1.de] INFO: Found listing with ID: JY67859
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY67859%27 HTTP/1.1" 200 None
2026-03-30 10:58:09 [auto1.de] INFO: Scrape type for JY67859: 2
2026-03-30 10:58:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 821e60c9-393a-59ea-adad-ae374fb086e7 with identifier: JY67859
2026-03-30 10:58:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 821e60c9-393a-59ea-adad-ae374fb086e7 with scrape type 2
2026-03-30 10:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 821e60c9-393a-59ea-adad-ae374fb086e7 with scrape type 2
2026-03-30 10:58:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 821e60c9-393a-59ea-adad-ae374fb086e7, identifier: JY67859
2026-03-30 10:58:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 821e60c9-393a-59ea-adad-ae374fb086e7 with identifier: JY67859
2026-03-30 10:58:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 821e60c9-393a-59ea-adad-ae374fb086e7 with identifier: JY67859
2026-03-30 10:58:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 821e60c9-393a-59ea-adad-ae374fb086e7 with identifier: JY67859 to the API
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:37:12Z',
 'fuel_type': 'diesel',
 'id': '821e60c9-393a-59ea-adad-ae374fb086e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY67859',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 194139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-17',
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2016}
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY67859%27 HTTP/1.1" 200 None
2026-03-30 10:58:10 [auto1.de] INFO: Saving data for JY67859: {'auction_closing_time': 1774885032.0, 'created_time': 1774637076.269851, 'last_price_update_time': 1774868290.236576}
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY67859') HTTP/1.1" 204 0
2026-03-30 10:58:10 [auto1.de] INFO: Found listing with ID: NX61710
2026-03-30 10:58:10 [auto1.de] INFO: Found listing with ID: LG72403
2026-03-30 10:58:10 [auto1.de] INFO: Found listing with ID: KX92622
2026-03-30 10:58:10 [auto1.de] INFO: Found listing with ID: KY89472
2026-03-30 10:58:10 [auto1.de] INFO: Found listing with ID: WM17924
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM17924%27 HTTP/1.1" 200 None
2026-03-30 10:58:10 [auto1.de] INFO: Scrape type for WM17924: 2
2026-03-30 10:58:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0311e399-bbd7-5184-b17a-fa4188f5f81e with identifier: WM17924
2026-03-30 10:58:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0311e399-bbd7-5184-b17a-fa4188f5f81e with scrape type 2
2026-03-30 10:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0311e399-bbd7-5184-b17a-fa4188f5f81e with scrape type 2
2026-03-30 10:58:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0311e399-bbd7-5184-b17a-fa4188f5f81e, identifier: WM17924
2026-03-30 10:58:10 [auto1.de] INFO: Found listing with ID: SG28932
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28932%27 HTTP/1.1" 200 None
2026-03-30 10:58:10 [auto1.de] INFO: Scrape type for SG28932: 2
2026-03-30 10:58:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc623bbd-5635-5c8c-9d56-234d3e321c82 with identifier: SG28932
2026-03-30 10:58:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc623bbd-5635-5c8c-9d56-234d3e321c82 with scrape type 2
2026-03-30 10:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc623bbd-5635-5c8c-9d56-234d3e321c82 with scrape type 2
2026-03-30 10:58:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc623bbd-5635-5c8c-9d56-234d3e321c82, identifier: SG28932
2026-03-30 10:58:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0311e399-bbd7-5184-b17a-fa4188f5f81e with identifier: WM17924
2026-03-30 10:58:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0311e399-bbd7-5184-b17a-fa4188f5f81e with identifier: WM17924
2026-03-30 10:58:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0311e399-bbd7-5184-b17a-fa4188f5f81e with identifier: WM17924 to the API
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:30:28Z',
 'fuel_type': 'diesel',
 'id': '0311e399-bbd7-5184-b17a-fa4188f5f81e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM17924',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 319000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-26',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2004}
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM17924%27 HTTP/1.1" 200 None
2026-03-30 10:58:10 [auto1.de] INFO: Saving data for WM17924: {'auction_closing_time': 1774884628.0, 'created_time': 1774380293.983748, 'last_price_update_time': 1774868290.78881}
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM17924') HTTP/1.1" 204 0
2026-03-30 10:58:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:58:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc623bbd-5635-5c8c-9d56-234d3e321c82 with identifier: SG28932
2026-03-30 10:58:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc623bbd-5635-5c8c-9d56-234d3e321c82 with identifier: SG28932
2026-03-30 10:58:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc623bbd-5635-5c8c-9d56-234d3e321c82 with identifier: SG28932 to the API
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:58:54Z',
 'fuel_type': 'petrol',
 'id': 'cc623bbd-5635-5c8c-9d56-234d3e321c82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG28932',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 129166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-28',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Club up!',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2016}
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28932%27 HTTP/1.1" 200 None
2026-03-30 10:58:11 [auto1.de] INFO: Saving data for SG28932: {'auction_closing_time': 1774886334.0, 'created_time': 1773304980.691587, 'last_price_update_time': 1774868291.205868}
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG28932') HTTP/1.1" 204 0
2026-03-30 10:58:11 [auto1.de] INFO: Found listing with ID: CL13866
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL13866%27 HTTP/1.1" 200 None
2026-03-30 10:58:11 [auto1.de] INFO: Scrape type for CL13866: 2
2026-03-30 10:58:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecaaa344-0280-5485-9e62-77e8897416c7 with identifier: CL13866
2026-03-30 10:58:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecaaa344-0280-5485-9e62-77e8897416c7 with scrape type 2
2026-03-30 10:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecaaa344-0280-5485-9e62-77e8897416c7 with scrape type 2
2026-03-30 10:58:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecaaa344-0280-5485-9e62-77e8897416c7, identifier: CL13866
2026-03-30 10:58:11 [auto1.de] INFO: Found listing with ID: JL52757
2026-03-30 10:58:11 [auto1.de] INFO: Found listing with ID: MG41395
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG41395%27 HTTP/1.1" 200 None
2026-03-30 10:58:11 [auto1.de] INFO: Scrape type for MG41395: 2
2026-03-30 10:58:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99823a67-082e-510e-ba7a-df9eb6f2b73c with identifier: MG41395
2026-03-30 10:58:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99823a67-082e-510e-ba7a-df9eb6f2b73c with scrape type 2
2026-03-30 10:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99823a67-082e-510e-ba7a-df9eb6f2b73c with scrape type 2
2026-03-30 10:58:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99823a67-082e-510e-ba7a-df9eb6f2b73c, identifier: MG41395
2026-03-30 10:58:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecaaa344-0280-5485-9e62-77e8897416c7 with identifier: CL13866
2026-03-30 10:58:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecaaa344-0280-5485-9e62-77e8897416c7 with identifier: CL13866
2026-03-30 10:58:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecaaa344-0280-5485-9e62-77e8897416c7 with identifier: CL13866 to the API
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:26:18Z',
 'fuel_type': 'diesel',
 'id': 'ecaaa344-0280-5485-9e62-77e8897416c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL13866',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T4 Caravelle',
 'odometer': 359719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-07-31',
 'seller_name': None,
 'title': 'Volkswagen T4 Caravelle 2.5 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 1998}
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL13866%27 HTTP/1.1" 200 None
2026-03-30 10:58:11 [auto1.de] INFO: Saving data for CL13866: {'auction_closing_time': 1774884378.0, 'created_time': 1773340720.120195, 'last_price_update_time': 1774868291.748895}
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL13866') HTTP/1.1" 204 0
2026-03-30 10:58:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99823a67-082e-510e-ba7a-df9eb6f2b73c with identifier: MG41395
2026-03-30 10:58:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99823a67-082e-510e-ba7a-df9eb6f2b73c with identifier: MG41395
2026-03-30 10:58:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99823a67-082e-510e-ba7a-df9eb6f2b73c with identifier: MG41395 to the API
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:46:21Z',
 'fuel_type': 'diesel',
 'id': '99823a67-082e-510e-ba7a-df9eb6f2b73c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG41395',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 280961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-30',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.9 TDI United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG41395%27 HTTP/1.1" 200 None
2026-03-30 10:58:12 [auto1.de] INFO: Saving data for MG41395: {'auction_closing_time': 1774885581.0, 'created_time': 1774550575.66647, 'last_price_update_time': 1774868292.016295}
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG41395') HTTP/1.1" 204 0
2026-03-30 10:58:12 [auto1.de] INFO: Found listing with ID: SV54413
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV54413%27 HTTP/1.1" 200 None
2026-03-30 10:58:12 [auto1.de] INFO: Scrape type for SV54413: 2
2026-03-30 10:58:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dd312fa-fbed-5a92-8a8c-864261663642 with identifier: SV54413
2026-03-30 10:58:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dd312fa-fbed-5a92-8a8c-864261663642 with scrape type 2
2026-03-30 10:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dd312fa-fbed-5a92-8a8c-864261663642 with scrape type 2
2026-03-30 10:58:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9dd312fa-fbed-5a92-8a8c-864261663642, identifier: SV54413
2026-03-30 10:58:12 [auto1.de] INFO: Found listing with ID: ND21540
2026-03-30 10:58:12 [auto1.de] INFO: Found listing with ID: DN18269
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN18269%27 HTTP/1.1" 200 None
2026-03-30 10:58:12 [auto1.de] INFO: Scrape type for DN18269: 2
2026-03-30 10:58:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50b7e498-c59d-5c58-988c-8d68195d34cf with identifier: DN18269
2026-03-30 10:58:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50b7e498-c59d-5c58-988c-8d68195d34cf with scrape type 2
2026-03-30 10:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50b7e498-c59d-5c58-988c-8d68195d34cf with scrape type 2
2026-03-30 10:58:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50b7e498-c59d-5c58-988c-8d68195d34cf, identifier: DN18269
2026-03-30 10:58:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9dd312fa-fbed-5a92-8a8c-864261663642 with identifier: SV54413
2026-03-30 10:58:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9dd312fa-fbed-5a92-8a8c-864261663642 with identifier: SV54413
2026-03-30 10:58:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9dd312fa-fbed-5a92-8a8c-864261663642 with identifier: SV54413 to the API
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:46:19Z',
 'fuel_type': 'diesel',
 'id': '9dd312fa-fbed-5a92-8a8c-864261663642',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV54413',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 269096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-22',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2013}
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV54413%27 HTTP/1.1" 200 None
2026-03-30 10:58:12 [auto1.de] INFO: Saving data for SV54413: {'auction_closing_time': 1774885579.0, 'created_time': 1773858669.080181, 'last_price_update_time': 1774868292.541155}
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV54413') HTTP/1.1" 204 0
2026-03-30 10:58:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50b7e498-c59d-5c58-988c-8d68195d34cf with identifier: DN18269
2026-03-30 10:58:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50b7e498-c59d-5c58-988c-8d68195d34cf with identifier: DN18269
2026-03-30 10:58:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50b7e498-c59d-5c58-988c-8d68195d34cf with identifier: DN18269 to the API
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:36:44Z',
 'fuel_type': 'petrol',
 'id': '50b7e498-c59d-5c58-988c-8d68195d34cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN18269',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 198838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-07-30',
 'seller_name': None,
 'title': 'Fiat Doblo 1.2 SX / Active',
 'transmission': 'manual',
 'trim': 'SX / Active',
 'year': 2001}
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN18269%27 HTTP/1.1" 200 None
2026-03-30 10:58:12 [auto1.de] INFO: Saving data for DN18269: {'auction_closing_time': 1774885004.0, 'created_time': 1773223383.44346, 'last_price_update_time': 1774868292.844387}
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN18269') HTTP/1.1" 204 0
2026-03-30 10:58:12 [auto1.de] INFO: Found listing with ID: BY81957
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY81957%27 HTTP/1.1" 200 None
2026-03-30 10:58:12 [auto1.de] INFO: Scrape type for BY81957: 2
2026-03-30 10:58:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6046bece-07cc-5a18-8aa3-b766b43b80e3 with identifier: BY81957
2026-03-30 10:58:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6046bece-07cc-5a18-8aa3-b766b43b80e3 with scrape type 2
2026-03-30 10:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6046bece-07cc-5a18-8aa3-b766b43b80e3 with scrape type 2
2026-03-30 10:58:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6046bece-07cc-5a18-8aa3-b766b43b80e3, identifier: BY81957
2026-03-30 10:58:12 [auto1.de] INFO: Found listing with ID: XG25622
2026-03-30 10:58:12 [auto1.de] INFO: Found listing with ID: WK49951
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK49951%27 HTTP/1.1" 200 None
2026-03-30 10:58:12 [auto1.de] INFO: Scrape type for WK49951: 2
2026-03-30 10:58:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db6c4c6e-39a9-506f-99cb-785425ee5845 with identifier: WK49951
2026-03-30 10:58:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db6c4c6e-39a9-506f-99cb-785425ee5845 with scrape type 2
2026-03-30 10:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db6c4c6e-39a9-506f-99cb-785425ee5845 with scrape type 2
2026-03-30 10:58:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db6c4c6e-39a9-506f-99cb-785425ee5845, identifier: WK49951
2026-03-30 10:58:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6046bece-07cc-5a18-8aa3-b766b43b80e3 with identifier: BY81957
2026-03-30 10:58:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6046bece-07cc-5a18-8aa3-b766b43b80e3 with identifier: BY81957
2026-03-30 10:58:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6046bece-07cc-5a18-8aa3-b766b43b80e3 with identifier: BY81957 to the API
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:00:37Z',
 'fuel_type': 'petrol',
 'id': '6046bece-07cc-5a18-8aa3-b766b43b80e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY81957',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 210641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-29',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Special',
 'transmission': 'manual',
 'trim': 'Special',
 'year': 2010}
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY81957%27 HTTP/1.1" 200 None
2026-03-30 10:58:13 [auto1.de] INFO: Saving data for BY81957: {'auction_closing_time': 1774882837.0, 'created_time': 1773514124.397656, 'last_price_update_time': 1774868293.350668}
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY81957') HTTP/1.1" 204 0
2026-03-30 10:58:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db6c4c6e-39a9-506f-99cb-785425ee5845 with identifier: WK49951
2026-03-30 10:58:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db6c4c6e-39a9-506f-99cb-785425ee5845 with identifier: WK49951
2026-03-30 10:58:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db6c4c6e-39a9-506f-99cb-785425ee5845 with identifier: WK49951 to the API
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:55:06Z',
 'fuel_type': 'petrol',
 'id': 'db6c4c6e-39a9-506f-99cb-785425ee5845',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK49951',
 'listing': 'auction',
 'make': 'Audi',
 'model': '80',
 'odometer': 221941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1994-06-30',
 'seller_name': None,
 'title': 'Audi 80 2.0 Europa',
 'transmission': 'manual',
 'trim': 'Europa',
 'year': 1994}
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK49951%27 HTTP/1.1" 200 None
2026-03-30 10:58:13 [auto1.de] INFO: Saving data for WK49951: {'auction_closing_time': 1774886106.0, 'created_time': 1773467435.756708, 'last_price_update_time': 1774868293.633893}
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK49951') HTTP/1.1" 204 0
2026-03-30 10:58:13 [auto1.de] INFO: Found listing with ID: NJ51378
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ51378%27 HTTP/1.1" 200 None
2026-03-30 10:58:13 [auto1.de] INFO: Scrape type for NJ51378: 2
2026-03-30 10:58:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8f590e7-14ca-5ce5-a5de-c170f49a3e2a with identifier: NJ51378
2026-03-30 10:58:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8f590e7-14ca-5ce5-a5de-c170f49a3e2a with scrape type 2
2026-03-30 10:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8f590e7-14ca-5ce5-a5de-c170f49a3e2a with scrape type 2
2026-03-30 10:58:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8f590e7-14ca-5ce5-a5de-c170f49a3e2a, identifier: NJ51378
2026-03-30 10:58:13 [auto1.de] INFO: Found listing with ID: VX95412
2026-03-30 10:58:13 [auto1.de] INFO: Found listing with ID: AE04688
2026-03-30 10:58:13 [auto1.de] INFO: Found listing with ID: NP40069
2026-03-30 10:58:13 [auto1.de] INFO: Found listing with ID: HG95875
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG95875%27 HTTP/1.1" 200 None
2026-03-30 10:58:13 [auto1.de] INFO: Scrape type for HG95875: 2
2026-03-30 10:58:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef731d2e-d55c-55e5-816e-1d3db61db52a with identifier: HG95875
2026-03-30 10:58:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef731d2e-d55c-55e5-816e-1d3db61db52a with scrape type 2
2026-03-30 10:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef731d2e-d55c-55e5-816e-1d3db61db52a with scrape type 2
2026-03-30 10:58:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef731d2e-d55c-55e5-816e-1d3db61db52a, identifier: HG95875
2026-03-30 10:58:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8f590e7-14ca-5ce5-a5de-c170f49a3e2a with identifier: NJ51378
2026-03-30 10:58:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8f590e7-14ca-5ce5-a5de-c170f49a3e2a with identifier: NJ51378
2026-03-30 10:58:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8f590e7-14ca-5ce5-a5de-c170f49a3e2a with identifier: NJ51378 to the API
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:59:31Z',
 'fuel_type': 'petrol',
 'id': 'f8f590e7-14ca-5ce5-a5de-c170f49a3e2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ51378',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 26806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-28',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ51378%27 HTTP/1.1" 200 None
2026-03-30 10:58:14 [auto1.de] INFO: Saving data for NJ51378: {'auction_closing_time': 1774886371.0, 'created_time': 1774550572.614944, 'last_price_update_time': 1774868294.165432}
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ51378') HTTP/1.1" 204 0
2026-03-30 10:58:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef731d2e-d55c-55e5-816e-1d3db61db52a with identifier: HG95875
2026-03-30 10:58:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef731d2e-d55c-55e5-816e-1d3db61db52a with identifier: HG95875
2026-03-30 10:58:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef731d2e-d55c-55e5-816e-1d3db61db52a with identifier: HG95875 to the API
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:38:08Z',
 'fuel_type': 'diesel',
 'id': 'ef731d2e-d55c-55e5-816e-1d3db61db52a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG95875',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 232954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-07-31',
 'seller_name': None,
 'title': 'Audi A3 2.0 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2003}
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG95875%27 HTTP/1.1" 200 None
2026-03-30 10:58:14 [auto1.de] INFO: Saving data for HG95875: {'auction_closing_time': 1774885088.0, 'created_time': 1773687788.678875, 'last_price_update_time': 1774868294.562813}
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG95875') HTTP/1.1" 204 0
2026-03-30 10:58:14 [auto1.de] INFO: Found listing with ID: KP55119
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP55119%27 HTTP/1.1" 200 None
2026-03-30 10:58:14 [auto1.de] INFO: Scrape type for KP55119: 2
2026-03-30 10:58:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88b94ece-8f38-5faf-a784-29d64f99f29d with identifier: KP55119
2026-03-30 10:58:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88b94ece-8f38-5faf-a784-29d64f99f29d with scrape type 2
2026-03-30 10:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88b94ece-8f38-5faf-a784-29d64f99f29d with scrape type 2
2026-03-30 10:58:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88b94ece-8f38-5faf-a784-29d64f99f29d, identifier: KP55119
2026-03-30 10:58:14 [auto1.de] INFO: Found listing with ID: VW68690
2026-03-30 10:58:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88b94ece-8f38-5faf-a784-29d64f99f29d with identifier: KP55119
2026-03-30 10:58:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88b94ece-8f38-5faf-a784-29d64f99f29d with identifier: KP55119
2026-03-30 10:58:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88b94ece-8f38-5faf-a784-29d64f99f29d with identifier: KP55119 to the API
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:17:25Z',
 'fuel_type': 'petrol',
 'id': '88b94ece-8f38-5faf-a784-29d64f99f29d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP55119',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 227000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-31',
 'seller_name': None,
 'title': 'Ford C-Max 1.8 Black Magic',
 'transmission': 'manual',
 'trim': 'Black Magic',
 'year': 2009}
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP55119%27 HTTP/1.1" 200 None
2026-03-30 10:58:14 [auto1.de] INFO: Saving data for KP55119: {'auction_closing_time': 1774883845.0, 'created_time': 1773774076.843406, 'last_price_update_time': 1774868294.980654}
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP55119') HTTP/1.1" 204 0
2026-03-30 10:58:15 [auto1.de] INFO: Found listing with ID: CF02627
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF02627%27 HTTP/1.1" 200 None
2026-03-30 10:58:15 [auto1.de] INFO: Scrape type for CF02627: 0
2026-03-30 10:58:15 [auto1.de] INFO: Found listing with ID: NV13979
2026-03-30 10:58:15 [auto1.de] INFO: Found listing with ID: DM11182
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM11182%27 HTTP/1.1" 200 None
2026-03-30 10:58:15 [auto1.de] INFO: Scrape type for DM11182: 2
2026-03-30 10:58:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edadcf08-fd5b-5a70-809e-49fc23c4ef79 with identifier: DM11182
2026-03-30 10:58:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edadcf08-fd5b-5a70-809e-49fc23c4ef79 with scrape type 2
2026-03-30 10:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edadcf08-fd5b-5a70-809e-49fc23c4ef79 with scrape type 2
2026-03-30 10:58:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edadcf08-fd5b-5a70-809e-49fc23c4ef79, identifier: DM11182
2026-03-30 10:58:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edadcf08-fd5b-5a70-809e-49fc23c4ef79 with identifier: DM11182
2026-03-30 10:58:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edadcf08-fd5b-5a70-809e-49fc23c4ef79 with identifier: DM11182
2026-03-30 10:58:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edadcf08-fd5b-5a70-809e-49fc23c4ef79 with identifier: DM11182 to the API
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:47:58Z',
 'fuel_type': 'diesel',
 'id': 'edadcf08-fd5b-5a70-809e-49fc23c4ef79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM11182',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 122515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-04',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business Edition BlueMotion',
 'transmission': 'manual',
 'trim': 'Business Edition BlueMotion',
 'year': 2014}
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM11182%27 HTTP/1.1" 200 None
2026-03-30 10:58:15 [auto1.de] INFO: Saving data for DM11182: {'auction_closing_time': 1774885678.0, 'created_time': 1774034480.916487, 'last_price_update_time': 1774868295.425143}
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM11182') HTTP/1.1" 204 0
2026-03-30 10:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:58:15 [auto1.de] INFO: Found listing with ID: EX39495
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX39495%27 HTTP/1.1" 200 None
2026-03-30 10:58:15 [auto1.de] INFO: Scrape type for EX39495: 2
2026-03-30 10:58:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74259a90-4764-5631-94fa-9f8be044f2e1 with identifier: EX39495
2026-03-30 10:58:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74259a90-4764-5631-94fa-9f8be044f2e1 with scrape type 2
2026-03-30 10:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74259a90-4764-5631-94fa-9f8be044f2e1 with scrape type 2
2026-03-30 10:58:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74259a90-4764-5631-94fa-9f8be044f2e1, identifier: EX39495
2026-03-30 10:58:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74259a90-4764-5631-94fa-9f8be044f2e1 with identifier: EX39495
2026-03-30 10:58:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74259a90-4764-5631-94fa-9f8be044f2e1 with identifier: EX39495
2026-03-30 10:58:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74259a90-4764-5631-94fa-9f8be044f2e1 with identifier: EX39495 to the API
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:39:16Z',
 'fuel_type': 'petrol',
 'id': '74259a90-4764-5631-94fa-9f8be044f2e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX39495',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 71116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-30',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 250 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX39495%27 HTTP/1.1" 200 None
2026-03-30 10:58:16 [auto1.de] INFO: Saving data for EX39495: {'auction_closing_time': 1774885156.0, 'created_time': 1773945785.676316, 'last_price_update_time': 1774868296.406394}
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX39495') HTTP/1.1" 204 0
2026-03-30 10:58:16 [auto1.de] INFO: Found listing with ID: SR10535
2026-03-30 10:58:16 [auto1.de] INFO: Found listing with ID: LY60106
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY60106%27 HTTP/1.1" 200 None
2026-03-30 10:58:16 [auto1.de] INFO: Scrape type for LY60106: 2
2026-03-30 10:58:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a12bee83-05a9-5136-aaa1-5ed3cba16af2 with identifier: LY60106
2026-03-30 10:58:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a12bee83-05a9-5136-aaa1-5ed3cba16af2 with scrape type 2
2026-03-30 10:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a12bee83-05a9-5136-aaa1-5ed3cba16af2 with scrape type 2
2026-03-30 10:58:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a12bee83-05a9-5136-aaa1-5ed3cba16af2, identifier: LY60106
2026-03-30 10:58:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a12bee83-05a9-5136-aaa1-5ed3cba16af2 with identifier: LY60106
2026-03-30 10:58:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a12bee83-05a9-5136-aaa1-5ed3cba16af2 with identifier: LY60106
2026-03-30 10:58:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a12bee83-05a9-5136-aaa1-5ed3cba16af2 with identifier: LY60106 to the API
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:16:56Z',
 'fuel_type': 'petrol',
 'id': 'a12bee83-05a9-5136-aaa1-5ed3cba16af2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY60106',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 186175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-27',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY60106%27 HTTP/1.1" 200 None
2026-03-30 10:58:16 [auto1.de] INFO: Saving data for LY60106: {'auction_closing_time': 1774883816.0, 'created_time': 1773859288.243626, 'last_price_update_time': 1774868296.936629}
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LY60106') HTTP/1.1" 204 0
2026-03-30 10:58:16 [auto1.de] INFO: Found listing with ID: GR07934
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR07934%27 HTTP/1.1" 200 None
2026-03-30 10:58:17 [auto1.de] INFO: Scrape type for GR07934: 2
2026-03-30 10:58:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56a130e6-1790-5661-b096-f792f32f0a5c with identifier: GR07934
2026-03-30 10:58:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56a130e6-1790-5661-b096-f792f32f0a5c with scrape type 2
2026-03-30 10:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56a130e6-1790-5661-b096-f792f32f0a5c with scrape type 2
2026-03-30 10:58:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56a130e6-1790-5661-b096-f792f32f0a5c, identifier: GR07934
2026-03-30 10:58:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56a130e6-1790-5661-b096-f792f32f0a5c with identifier: GR07934
2026-03-30 10:58:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56a130e6-1790-5661-b096-f792f32f0a5c with identifier: GR07934
2026-03-30 10:58:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56a130e6-1790-5661-b096-f792f32f0a5c with identifier: GR07934 to the API
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:33:09Z',
 'fuel_type': 'petrol',
 'id': '56a130e6-1790-5661-b096-f792f32f0a5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR07934',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 109336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-03-01',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 1999}
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR07934%27 HTTP/1.1" 200 None
2026-03-30 10:58:17 [auto1.de] INFO: Saving data for GR07934: {'auction_closing_time': 1774884789.0, 'created_time': 1773946388.21688, 'last_price_update_time': 1774868297.568866}
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR07934') HTTP/1.1" 204 0
2026-03-30 10:58:17 [auto1.de] INFO: Channel: 24h | Page: 78 | totalHits: 9544 | hits on page: 40
2026-03-30 10:58:17 [auto1.de] INFO: Found listing with ID: GZ84157
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ84157%27 HTTP/1.1" 200 None
2026-03-30 10:58:17 [auto1.de] INFO: Scrape type for GZ84157: 2
2026-03-30 10:58:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6040ccd-0b52-59fe-aa87-2e2c054d5fdd with identifier: GZ84157
2026-03-30 10:58:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6040ccd-0b52-59fe-aa87-2e2c054d5fdd with scrape type 2
2026-03-30 10:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6040ccd-0b52-59fe-aa87-2e2c054d5fdd with scrape type 2
2026-03-30 10:58:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6040ccd-0b52-59fe-aa87-2e2c054d5fdd, identifier: GZ84157
2026-03-30 10:58:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6040ccd-0b52-59fe-aa87-2e2c054d5fdd with identifier: GZ84157
2026-03-30 10:58:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6040ccd-0b52-59fe-aa87-2e2c054d5fdd with identifier: GZ84157
2026-03-30 10:58:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6040ccd-0b52-59fe-aa87-2e2c054d5fdd with identifier: GZ84157 to the API
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:27:22Z',
 'fuel_type': 'petrol',
 'id': 'b6040ccd-0b52-59fe-aa87-2e2c054d5fdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ84157',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 189594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-26',
 'seller_name': None,
 'title': 'Skoda Fabia 2.0 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2006}
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ84157%27 HTTP/1.1" 200 None
2026-03-30 10:58:17 [auto1.de] INFO: Saving data for GZ84157: {'auction_closing_time': 1774884442.0, 'created_time': 1774637096.804937, 'last_price_update_time': 1774868297.947004}
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ84157') HTTP/1.1" 204 0
2026-03-30 10:58:17 [auto1.de] INFO: Found listing with ID: JM98796
2026-03-30 10:58:17 [auto1.de] INFO: Found listing with ID: VM39350
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM39350%27 HTTP/1.1" 200 None
2026-03-30 10:58:17 [auto1.de] INFO: Scrape type for VM39350: 2
2026-03-30 10:58:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9fb4031-0c14-518a-8eaa-ff203f466792 with identifier: VM39350
2026-03-30 10:58:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9fb4031-0c14-518a-8eaa-ff203f466792 with scrape type 2
2026-03-30 10:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9fb4031-0c14-518a-8eaa-ff203f466792 with scrape type 2
2026-03-30 10:58:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9fb4031-0c14-518a-8eaa-ff203f466792, identifier: VM39350
2026-03-30 10:58:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:58:18 [auto1.de] INFO: Found listing with ID: CM86164
2026-03-30 10:58:18 [auto1.de] INFO: Found listing with ID: AD16750
2026-03-30 10:58:18 [auto1.de] INFO: Found listing with ID: UF75132
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF75132%27 HTTP/1.1" 200 None
2026-03-30 10:58:18 [auto1.de] INFO: Scrape type for UF75132: 2
2026-03-30 10:58:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71eb8b6b-984d-5bd1-97d0-7ef283a0f69f with identifier: UF75132
2026-03-30 10:58:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71eb8b6b-984d-5bd1-97d0-7ef283a0f69f with scrape type 2
2026-03-30 10:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71eb8b6b-984d-5bd1-97d0-7ef283a0f69f with scrape type 2
2026-03-30 10:58:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71eb8b6b-984d-5bd1-97d0-7ef283a0f69f, identifier: UF75132
2026-03-30 10:58:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9fb4031-0c14-518a-8eaa-ff203f466792 with identifier: VM39350
2026-03-30 10:58:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9fb4031-0c14-518a-8eaa-ff203f466792 with identifier: VM39350
2026-03-30 10:58:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9fb4031-0c14-518a-8eaa-ff203f466792 with identifier: VM39350 to the API
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:26:22Z',
 'fuel_type': 'diesel',
 'id': 'f9fb4031-0c14-518a-8eaa-ff203f466792',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM39350',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 267329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-30',
 'seller_name': None,
 'title': 'Ford Galaxy 1.9 TDI Ghia',
 'transmission': 'automatic',
 'trim': 'Ghia',
 'year': 2003}
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM39350%27 HTTP/1.1" 200 None
2026-03-30 10:58:18 [auto1.de] INFO: Saving data for VM39350: {'auction_closing_time': 1774884382.0, 'created_time': 1773659900.49941, 'last_price_update_time': 1774868298.462796}
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VM39350') HTTP/1.1" 204 0
2026-03-30 10:58:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71eb8b6b-984d-5bd1-97d0-7ef283a0f69f with identifier: UF75132
2026-03-30 10:58:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71eb8b6b-984d-5bd1-97d0-7ef283a0f69f with identifier: UF75132
2026-03-30 10:58:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71eb8b6b-984d-5bd1-97d0-7ef283a0f69f with identifier: UF75132 to the API
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:50:10Z',
 'fuel_type': 'petrol',
 'id': '71eb8b6b-984d-5bd1-97d0-7ef283a0f69f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF75132',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 139751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-15',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Ti-VCT Fun X',
 'transmission': 'manual',
 'trim': 'Fun X',
 'year': 2006}
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF75132%27 HTTP/1.1" 200 None
2026-03-30 10:58:18 [auto1.de] INFO: Saving data for UF75132: {'auction_closing_time': 1774885810.0, 'created_time': 1773306398.576015, 'last_price_update_time': 1774868298.871313}
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF75132') HTTP/1.1" 204 0
2026-03-30 10:58:18 [auto1.de] INFO: Found listing with ID: LZ98247
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ98247%27 HTTP/1.1" 200 None
2026-03-30 10:58:18 [auto1.de] INFO: Scrape type for LZ98247: 2
2026-03-30 10:58:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2 with identifier: LZ98247
2026-03-30 10:58:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2 with scrape type 2
2026-03-30 10:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2 with scrape type 2
2026-03-30 10:58:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2, identifier: LZ98247
2026-03-30 10:58:19 [auto1.de] INFO: Found listing with ID: JE79090
2026-03-30 10:58:19 [auto1.de] INFO: Found listing with ID: FR75533
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR75533%27 HTTP/1.1" 200 None
2026-03-30 10:58:19 [auto1.de] INFO: Scrape type for FR75533: 2
2026-03-30 10:58:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e4491c1-43a1-51c8-985e-bad3501861f5 with identifier: FR75533
2026-03-30 10:58:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e4491c1-43a1-51c8-985e-bad3501861f5 with scrape type 2
2026-03-30 10:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e4491c1-43a1-51c8-985e-bad3501861f5 with scrape type 2
2026-03-30 10:58:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e4491c1-43a1-51c8-985e-bad3501861f5, identifier: FR75533
2026-03-30 10:58:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2 with identifier: LZ98247
2026-03-30 10:58:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2 with identifier: LZ98247
2026-03-30 10:58:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2 with identifier: LZ98247 to the API
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:42:43Z',
 'fuel_type': 'diesel',
 'id': '14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ98247',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 304447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-15',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2013}
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ98247%27 HTTP/1.1" 200 None
2026-03-30 10:58:19 [auto1.de] INFO: Saving data for LZ98247: {'auction_closing_time': 1774885363.0, 'created_time': 1774780502.461203, 'last_price_update_time': 1774868299.383577}
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ98247') HTTP/1.1" 204 0
2026-03-30 10:58:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e4491c1-43a1-51c8-985e-bad3501861f5 with identifier: FR75533
2026-03-30 10:58:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e4491c1-43a1-51c8-985e-bad3501861f5 with identifier: FR75533
2026-03-30 10:58:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e4491c1-43a1-51c8-985e-bad3501861f5 with identifier: FR75533 to the API
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:17:30Z',
 'fuel_type': 'diesel',
 'id': '5e4491c1-43a1-51c8-985e-bad3501861f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR75533',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 145792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-02',
 'seller_name': None,
 'title': 'Ford S-Max 2.2 TDCi Titanium S',
 'transmission': 'manual',
 'trim': 'Titanium S',
 'year': 2010}
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR75533%27 HTTP/1.1" 200 None
2026-03-30 10:58:19 [auto1.de] INFO: Saving data for FR75533: {'auction_closing_time': 1774883850.0, 'created_time': 1773859584.884356, 'last_price_update_time': 1774868299.691619}
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR75533') HTTP/1.1" 204 0
2026-03-30 10:58:19 [auto1.de] INFO: Found listing with ID: CZ09643
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ09643%27 HTTP/1.1" 200 None
2026-03-30 10:58:19 [auto1.de] INFO: Scrape type for CZ09643: 2
2026-03-30 10:58:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 100b65d2-7a2c-5e9c-a8f4-e1259ea6c4ed with identifier: CZ09643
2026-03-30 10:58:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 100b65d2-7a2c-5e9c-a8f4-e1259ea6c4ed with scrape type 2
2026-03-30 10:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 100b65d2-7a2c-5e9c-a8f4-e1259ea6c4ed with scrape type 2
2026-03-30 10:58:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 100b65d2-7a2c-5e9c-a8f4-e1259ea6c4ed, identifier: CZ09643
2026-03-30 10:58:19 [auto1.de] INFO: Found listing with ID: RK76188
2026-03-30 10:58:19 [auto1.de] INFO: Found listing with ID: EK64818
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK64818%27 HTTP/1.1" 200 None
2026-03-30 10:58:19 [auto1.de] INFO: Scrape type for EK64818: 2
2026-03-30 10:58:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0069dbb-e730-5952-b580-a3fc1a066838 with identifier: EK64818
2026-03-30 10:58:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0069dbb-e730-5952-b580-a3fc1a066838 with scrape type 2
2026-03-30 10:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0069dbb-e730-5952-b580-a3fc1a066838 with scrape type 2
2026-03-30 10:58:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0069dbb-e730-5952-b580-a3fc1a066838, identifier: EK64818
2026-03-30 10:58:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 100b65d2-7a2c-5e9c-a8f4-e1259ea6c4ed with identifier: CZ09643
2026-03-30 10:58:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 100b65d2-7a2c-5e9c-a8f4-e1259ea6c4ed with identifier: CZ09643
2026-03-30 10:58:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 100b65d2-7a2c-5e9c-a8f4-e1259ea6c4ed with identifier: CZ09643 to the API
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:50:20Z',
 'fuel_type': 'petrol',
 'id': '100b65d2-7a2c-5e9c-a8f4-e1259ea6c4ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ09643',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 152024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-31',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ09643%27 HTTP/1.1" 200 None
2026-03-30 10:58:20 [auto1.de] INFO: Saving data for CZ09643: {'auction_closing_time': 1774885820.0, 'created_time': 1774550464.243105, 'last_price_update_time': 1774868300.260804}
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ09643') HTTP/1.1" 204 0
2026-03-30 10:58:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0069dbb-e730-5952-b580-a3fc1a066838 with identifier: EK64818
2026-03-30 10:58:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0069dbb-e730-5952-b580-a3fc1a066838 with identifier: EK64818
2026-03-30 10:58:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0069dbb-e730-5952-b580-a3fc1a066838 with identifier: EK64818 to the API
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:09:45Z',
 'fuel_type': 'petrol',
 'id': 'f0069dbb-e730-5952-b580-a3fc1a066838',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK64818',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 164156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1995-01-31',
 'seller_name': None,
 'title': 'Audi A4 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 1995}
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK64818%27 HTTP/1.1" 200 None
2026-03-30 10:58:20 [auto1.de] INFO: Saving data for EK64818: {'auction_closing_time': 1774883385.0, 'created_time': 1773304981.598212, 'last_price_update_time': 1774868300.540845}
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK64818') HTTP/1.1" 204 0
2026-03-30 10:58:20 [auto1.de] INFO: Found listing with ID: KU03533
2026-03-30 10:58:20 [auto1.de] INFO: Found listing with ID: TB49409
2026-03-30 10:58:20 [auto1.de] INFO: Found listing with ID: NB42822
2026-03-30 10:58:20 [auto1.de] INFO: Found listing with ID: LV79824
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV79824%27 HTTP/1.1" 200 None
2026-03-30 10:58:20 [auto1.de] INFO: Scrape type for LV79824: 2
2026-03-30 10:58:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9aa10cd-8550-5136-829c-59b7f49e1288 with identifier: LV79824
2026-03-30 10:58:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9aa10cd-8550-5136-829c-59b7f49e1288 with scrape type 2
2026-03-30 10:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9aa10cd-8550-5136-829c-59b7f49e1288 with scrape type 2
2026-03-30 10:58:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9aa10cd-8550-5136-829c-59b7f49e1288, identifier: LV79824
2026-03-30 10:58:20 [auto1.de] INFO: Found listing with ID: TU64777
2026-03-30 10:58:20 [auto1.de] INFO: Found listing with ID: XY93824
2026-03-30 10:58:20 [auto1.de] INFO: Found listing with ID: AT28488
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT28488%27 HTTP/1.1" 200 None
2026-03-30 10:58:20 [auto1.de] INFO: Scrape type for AT28488: 2
2026-03-30 10:58:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c8f6ea9-45e1-56ad-969e-f7c2e51da5ef with identifier: AT28488
2026-03-30 10:58:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c8f6ea9-45e1-56ad-969e-f7c2e51da5ef with scrape type 2
2026-03-30 10:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c8f6ea9-45e1-56ad-969e-f7c2e51da5ef with scrape type 2
2026-03-30 10:58:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c8f6ea9-45e1-56ad-969e-f7c2e51da5ef, identifier: AT28488
2026-03-30 10:58:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9aa10cd-8550-5136-829c-59b7f49e1288 with identifier: LV79824
2026-03-30 10:58:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9aa10cd-8550-5136-829c-59b7f49e1288 with identifier: LV79824
2026-03-30 10:58:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9aa10cd-8550-5136-829c-59b7f49e1288 with identifier: LV79824 to the API
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-30T15:04:58Z',
 'fuel_type': 'petrol',
 'id': 'e9aa10cd-8550-5136-829c-59b7f49e1288',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV79824',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 176736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-29',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV79824%27 HTTP/1.1" 200 None
2026-03-30 10:58:21 [auto1.de] INFO: Saving data for LV79824: {'auction_closing_time': 1774883098.0, 'created_time': 1773513754.442755, 'last_price_update_time': 1774868301.130973}
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV79824') HTTP/1.1" 204 0
2026-03-30 10:58:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c8f6ea9-45e1-56ad-969e-f7c2e51da5ef with identifier: AT28488
2026-03-30 10:58:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c8f6ea9-45e1-56ad-969e-f7c2e51da5ef with identifier: AT28488
2026-03-30 10:58:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c8f6ea9-45e1-56ad-969e-f7c2e51da5ef with identifier: AT28488 to the API
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:00:10Z',
 'fuel_type': 'petrol',
 'id': '2c8f6ea9-45e1-56ad-969e-f7c2e51da5ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT28488',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 227662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-07-06',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2003}
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT28488%27 HTTP/1.1" 200 None
2026-03-30 10:58:21 [auto1.de] INFO: Saving data for AT28488: {'auction_closing_time': 1774882810.0, 'created_time': 1773945106.90588, 'last_price_update_time': 1774868301.507195}
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT28488') HTTP/1.1" 204 0
2026-03-30 10:58:21 [auto1.de] INFO: Found listing with ID: PM35820
2026-03-30 10:58:21 [auto1.de] INFO: Found listing with ID: RE71424
2026-03-30 10:58:21 [auto1.de] INFO: Found listing with ID: TZ64186
2026-03-30 10:58:21 [auto1.de] INFO: Found listing with ID: HE78253
2026-03-30 10:58:21 [auto1.de] INFO: Found listing with ID: WC37981
2026-03-30 10:58:21 [auto1.de] INFO: Found listing with ID: VU91193
2026-03-30 10:58:21 [auto1.de] INFO: Found listing with ID: HA87343
2026-03-30 10:58:21 [auto1.de] INFO: Found listing with ID: TX49680
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX49680%27 HTTP/1.1" 200 None
2026-03-30 10:58:21 [auto1.de] INFO: Scrape type for TX49680: 2
2026-03-30 10:58:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00ed8e81-467e-5d46-a16f-6ccdc256ee81 with identifier: TX49680
2026-03-30 10:58:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00ed8e81-467e-5d46-a16f-6ccdc256ee81 with scrape type 2
2026-03-30 10:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00ed8e81-467e-5d46-a16f-6ccdc256ee81 with scrape type 2
2026-03-30 10:58:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00ed8e81-467e-5d46-a16f-6ccdc256ee81, identifier: TX49680
2026-03-30 10:58:21 [auto1.de] INFO: Found listing with ID: YB70330
2026-03-30 10:58:21 [auto1.de] INFO: Found listing with ID: YW90897
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW90897%27 HTTP/1.1" 200 None
2026-03-30 10:58:21 [auto1.de] INFO: Scrape type for YW90897: 2
2026-03-30 10:58:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 145d86d8-4667-50d9-941d-0c8684d27b54 with identifier: YW90897
2026-03-30 10:58:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 145d86d8-4667-50d9-941d-0c8684d27b54 with scrape type 2
2026-03-30 10:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 145d86d8-4667-50d9-941d-0c8684d27b54 with scrape type 2
2026-03-30 10:58:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 145d86d8-4667-50d9-941d-0c8684d27b54, identifier: YW90897
2026-03-30 10:58:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00ed8e81-467e-5d46-a16f-6ccdc256ee81 with identifier: TX49680
2026-03-30 10:58:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00ed8e81-467e-5d46-a16f-6ccdc256ee81 with identifier: TX49680
2026-03-30 10:58:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00ed8e81-467e-5d46-a16f-6ccdc256ee81 with identifier: TX49680 to the API
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:22:16Z',
 'fuel_type': 'petrol',
 'id': '00ed8e81-467e-5d46-a16f-6ccdc256ee81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX49680',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Logo',
 'odometer': 113882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-09-06',
 'seller_name': None,
 'title': 'Honda Logo 1.3',
 'transmission': 'automatic',
 'trim': '',
 'year': 2001}
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX49680%27 HTTP/1.1" 200 None
2026-03-30 10:58:22 [auto1.de] INFO: Saving data for TX49680: {'auction_closing_time': 1774884136.0, 'created_time': 1774637097.145163, 'last_price_update_time': 1774868302.077357}
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX49680') HTTP/1.1" 204 0
2026-03-30 10:58:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 145d86d8-4667-50d9-941d-0c8684d27b54 with identifier: YW90897
2026-03-30 10:58:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 145d86d8-4667-50d9-941d-0c8684d27b54 with identifier: YW90897
2026-03-30 10:58:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 145d86d8-4667-50d9-941d-0c8684d27b54 with identifier: YW90897 to the API
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:34:06Z',
 'fuel_type': 'diesel',
 'id': '145d86d8-4667-50d9-941d-0c8684d27b54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW90897',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 144247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-02',
 'seller_name': None,
 'title': 'Ford C-Max 1.5 TDCi Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2017}
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW90897%27 HTTP/1.1" 200 None
2026-03-30 10:58:22 [auto1.de] INFO: Saving data for YW90897: {'auction_closing_time': 1774884846.0, 'created_time': 1773774124.575772, 'last_price_update_time': 1774868302.4478}
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW90897') HTTP/1.1" 204 0
2026-03-30 10:58:22 [auto1.de] INFO: Found listing with ID: EE57065
2026-03-30 10:58:22 [auto1.de] INFO: Found listing with ID: BP97760
2026-03-30 10:58:22 [auto1.de] INFO: Found listing with ID: MW79047
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW79047%27 HTTP/1.1" 200 None
2026-03-30 10:58:22 [auto1.de] INFO: Scrape type for MW79047: 2
2026-03-30 10:58:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de92135d-4e25-5cbb-9e93-dcc36ca0c173 with identifier: MW79047
2026-03-30 10:58:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de92135d-4e25-5cbb-9e93-dcc36ca0c173 with scrape type 2
2026-03-30 10:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de92135d-4e25-5cbb-9e93-dcc36ca0c173 with scrape type 2
2026-03-30 10:58:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de92135d-4e25-5cbb-9e93-dcc36ca0c173, identifier: MW79047
2026-03-30 10:58:22 [auto1.de] INFO: Found listing with ID: CJ04557
2026-03-30 10:58:22 [auto1.de] INFO: Found listing with ID: UD27058
2026-03-30 10:58:22 [auto1.de] INFO: Found listing with ID: VV98645
2026-03-30 10:58:22 [auto1.de] INFO: Found listing with ID: JG12226
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG12226%27 HTTP/1.1" 200 None
2026-03-30 10:58:22 [auto1.de] INFO: Scrape type for JG12226: 2
2026-03-30 10:58:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70aa5f86-7d76-51e1-89e6-a51cceef389c with identifier: JG12226
2026-03-30 10:58:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70aa5f86-7d76-51e1-89e6-a51cceef389c with scrape type 2
2026-03-30 10:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70aa5f86-7d76-51e1-89e6-a51cceef389c with scrape type 2
2026-03-30 10:58:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70aa5f86-7d76-51e1-89e6-a51cceef389c, identifier: JG12226
2026-03-30 10:58:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de92135d-4e25-5cbb-9e93-dcc36ca0c173 with identifier: MW79047
2026-03-30 10:58:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de92135d-4e25-5cbb-9e93-dcc36ca0c173 with identifier: MW79047
2026-03-30 10:58:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de92135d-4e25-5cbb-9e93-dcc36ca0c173 with identifier: MW79047 to the API
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:08:49Z',
 'fuel_type': 'petrol',
 'id': 'de92135d-4e25-5cbb-9e93-dcc36ca0c173',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW79047',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 280120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-03-18',
 'seller_name': None,
 'title': 'Audi A6 2.4 V6',
 'transmission': 'manual',
 'trim': '',
 'year': 1999}
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW79047%27 HTTP/1.1" 200 None
2026-03-30 10:58:22 [auto1.de] INFO: Saving data for MW79047: {'auction_closing_time': 1774883329.0, 'created_time': 1773306551.653402, 'last_price_update_time': 1774868302.958348}
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW79047') HTTP/1.1" 204 0
2026-03-30 10:58:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70aa5f86-7d76-51e1-89e6-a51cceef389c with identifier: JG12226
2026-03-30 10:58:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70aa5f86-7d76-51e1-89e6-a51cceef389c with identifier: JG12226
2026-03-30 10:58:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70aa5f86-7d76-51e1-89e6-a51cceef389c with identifier: JG12226 to the API
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:12:56Z',
 'fuel_type': 'diesel',
 'id': '70aa5f86-7d76-51e1-89e6-a51cceef389c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG12226',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 84639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-15',
 'seller_name': None,
 'title': 'Jaguar XF 25d R-Sport AWD',
 'transmission': 'automatic',
 'trim': 'R-Sport AWD',
 'year': 2018}
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG12226%27 HTTP/1.1" 200 None
2026-03-30 10:58:23 [auto1.de] INFO: Saving data for JG12226: {'auction_closing_time': 1774883576.0, 'created_time': 1774780432.299544, 'last_price_update_time': 1774868303.362592}
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG12226') HTTP/1.1" 204 0
2026-03-30 10:58:23 [auto1.de] INFO: Found listing with ID: RP29277
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP29277%27 HTTP/1.1" 200 None
2026-03-30 10:58:23 [auto1.de] INFO: Scrape type for RP29277: 2
2026-03-30 10:58:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 841f404c-c1f6-5fcc-af9f-d8cb7d739b94 with identifier: RP29277
2026-03-30 10:58:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 841f404c-c1f6-5fcc-af9f-d8cb7d739b94 with scrape type 2
2026-03-30 10:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 841f404c-c1f6-5fcc-af9f-d8cb7d739b94 with scrape type 2
2026-03-30 10:58:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 841f404c-c1f6-5fcc-af9f-d8cb7d739b94, identifier: RP29277
2026-03-30 10:58:23 [auto1.de] INFO: Found listing with ID: MH98673
2026-03-30 10:58:23 [auto1.de] INFO: Found listing with ID: UV43425
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV43425%27 HTTP/1.1" 200 None
2026-03-30 10:58:23 [auto1.de] INFO: Scrape type for UV43425: 2
2026-03-30 10:58:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87546774-0f03-5143-ab20-41177e28254e with identifier: UV43425
2026-03-30 10:58:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87546774-0f03-5143-ab20-41177e28254e with scrape type 2
2026-03-30 10:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87546774-0f03-5143-ab20-41177e28254e with scrape type 2
2026-03-30 10:58:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87546774-0f03-5143-ab20-41177e28254e, identifier: UV43425
2026-03-30 10:58:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 841f404c-c1f6-5fcc-af9f-d8cb7d739b94 with identifier: RP29277
2026-03-30 10:58:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 841f404c-c1f6-5fcc-af9f-d8cb7d739b94 with identifier: RP29277
2026-03-30 10:58:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 841f404c-c1f6-5fcc-af9f-d8cb7d739b94 with identifier: RP29277 to the API
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:11:40Z',
 'fuel_type': 'petrol',
 'id': '841f404c-c1f6-5fcc-af9f-d8cb7d739b94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP29277',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 277668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-10',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2006}
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP29277%27 HTTP/1.1" 200 None
2026-03-30 10:58:23 [auto1.de] INFO: Saving data for RP29277: {'auction_closing_time': 1774883500.0, 'created_time': 1773513721.393587, 'last_price_update_time': 1774868303.848786}
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP29277') HTTP/1.1" 204 0
2026-03-30 10:58:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87546774-0f03-5143-ab20-41177e28254e with identifier: UV43425
2026-03-30 10:58:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87546774-0f03-5143-ab20-41177e28254e with identifier: UV43425
2026-03-30 10:58:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87546774-0f03-5143-ab20-41177e28254e with identifier: UV43425 to the API
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-30T15:03:42Z',
 'fuel_type': 'diesel',
 'id': '87546774-0f03-5143-ab20-41177e28254e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV43425',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 170566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-03',
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV43425%27 HTTP/1.1" 200 None
2026-03-30 10:58:24 [auto1.de] INFO: Saving data for UV43425: {'auction_closing_time': 1774883022.0, 'created_time': 1773484480.694818, 'last_price_update_time': 1774868304.112928}
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV43425') HTTP/1.1" 204 0
2026-03-30 10:58:24 [auto1.de] INFO: Found listing with ID: HC04393
2026-03-30 10:58:24 [auto1.de] INFO: Found listing with ID: ZV78302
2026-03-30 10:58:24 [auto1.de] INFO: Found listing with ID: VX94865
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX94865%27 HTTP/1.1" 200 None
2026-03-30 10:58:24 [auto1.de] INFO: Scrape type for VX94865: 2
2026-03-30 10:58:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f9a288b-4c05-5450-8957-b85332c627c5 with identifier: VX94865
2026-03-30 10:58:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f9a288b-4c05-5450-8957-b85332c627c5 with scrape type 2
2026-03-30 10:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f9a288b-4c05-5450-8957-b85332c627c5 with scrape type 2
2026-03-30 10:58:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f9a288b-4c05-5450-8957-b85332c627c5, identifier: VX94865
2026-03-30 10:58:24 [auto1.de] INFO: Found listing with ID: LD99689
2026-03-30 10:58:24 [auto1.de] INFO: Found listing with ID: JM98796
2026-03-30 10:58:24 [auto1.de] INFO: Found listing with ID: VM39350
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM39350%27 HTTP/1.1" 200 None
2026-03-30 10:58:24 [auto1.de] INFO: Scrape type for VM39350: 0
2026-03-30 10:58:24 [auto1.de] INFO: Found listing with ID: LZ98247
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ98247%27 HTTP/1.1" 200 None
2026-03-30 10:58:24 [auto1.de] INFO: Scrape type for LZ98247: 0
2026-03-30 10:58:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f9a288b-4c05-5450-8957-b85332c627c5 with identifier: VX94865
2026-03-30 10:58:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f9a288b-4c05-5450-8957-b85332c627c5 with identifier: VX94865
2026-03-30 10:58:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f9a288b-4c05-5450-8957-b85332c627c5 with identifier: VX94865 to the API
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:45:45Z',
 'fuel_type': 'diesel',
 'id': '2f9a288b-4c05-5450-8957-b85332c627c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX94865',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Grand Sport',
 'odometer': 97181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-16',
 'seller_name': None,
 'title': 'Opel Insignia Grand Sport 2.0 CDTI GSi 4x4',
 'transmission': 'automatic',
 'trim': 'GSi 4x4',
 'year': 2019}
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX94865%27 HTTP/1.1" 200 None
2026-03-30 10:58:24 [auto1.de] INFO: Saving data for VX94865: {'auction_closing_time': 1774885545.0, 'created_time': 1774550712.046786, 'last_price_update_time': 1774868304.606993}
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX94865') HTTP/1.1" 204 0
2026-03-30 10:58:24 [auto1.de] INFO: Found listing with ID: CZ47065
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ47065%27 HTTP/1.1" 200 None
2026-03-30 10:58:24 [auto1.de] INFO: Scrape type for CZ47065: 2
2026-03-30 10:58:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abb7f315-b94f-5574-8e44-d2070eb8cc41 with identifier: CZ47065
2026-03-30 10:58:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abb7f315-b94f-5574-8e44-d2070eb8cc41 with scrape type 2
2026-03-30 10:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abb7f315-b94f-5574-8e44-d2070eb8cc41 with scrape type 2
2026-03-30 10:58:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abb7f315-b94f-5574-8e44-d2070eb8cc41, identifier: CZ47065
2026-03-30 10:58:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abb7f315-b94f-5574-8e44-d2070eb8cc41 with identifier: CZ47065
2026-03-30 10:58:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abb7f315-b94f-5574-8e44-d2070eb8cc41 with identifier: CZ47065
2026-03-30 10:58:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abb7f315-b94f-5574-8e44-d2070eb8cc41 with identifier: CZ47065 to the API
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:55:07Z',
 'fuel_type': 'diesel',
 'id': 'abb7f315-b94f-5574-8e44-d2070eb8cc41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ47065',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 148936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-01',
 'seller_name': None,
 'title': 'Jaguar F-Pace 30d R-Sport AWD',
 'transmission': 'automatic',
 'trim': 'R-Sport AWD',
 'year': 2020}
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ47065%27 HTTP/1.1" 200 None
2026-03-30 10:58:25 [auto1.de] INFO: Saving data for CZ47065: {'auction_closing_time': 1774886107.0, 'created_time': 1774780508.978425, 'last_price_update_time': 1774868305.035632}
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ47065') HTTP/1.1" 204 0
2026-03-30 10:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:58:25 [auto1.de] INFO: Found listing with ID: ES20413
2026-03-30 10:58:25 [auto1.de] INFO: Found listing with ID: XE08723
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE08723%27 HTTP/1.1" 200 None
2026-03-30 10:58:25 [auto1.de] INFO: Scrape type for XE08723: 2
2026-03-30 10:58:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43cad7e5-24bc-52ad-a419-c44ed5ac8a15 with identifier: XE08723
2026-03-30 10:58:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43cad7e5-24bc-52ad-a419-c44ed5ac8a15 with scrape type 2
2026-03-30 10:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43cad7e5-24bc-52ad-a419-c44ed5ac8a15 with scrape type 2
2026-03-30 10:58:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43cad7e5-24bc-52ad-a419-c44ed5ac8a15, identifier: XE08723
2026-03-30 10:58:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43cad7e5-24bc-52ad-a419-c44ed5ac8a15 with identifier: XE08723
2026-03-30 10:58:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43cad7e5-24bc-52ad-a419-c44ed5ac8a15 with identifier: XE08723
2026-03-30 10:58:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43cad7e5-24bc-52ad-a419-c44ed5ac8a15 with identifier: XE08723 to the API
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:15:13Z',
 'fuel_type': 'petrol',
 'id': '43cad7e5-24bc-52ad-a419-c44ed5ac8a15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE08723',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 58428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-06-02',
 'seller_name': None,
 'title': 'Audi A4 2.4 V6',
 'transmission': 'automatic',
 'trim': '',
 'year': 2002}
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE08723%27 HTTP/1.1" 200 None
2026-03-30 10:58:25 [auto1.de] INFO: Saving data for XE08723: {'auction_closing_time': 1774883713.0, 'created_time': 1774550544.546173, 'last_price_update_time': 1774868305.540547}
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE08723') HTTP/1.1" 204 0
2026-03-30 10:58:25 [auto1.de] INFO: Found listing with ID: LZ63004
2026-03-30 10:58:25 [auto1.de] INFO: Found listing with ID: AU50389
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU50389%27 HTTP/1.1" 200 None
2026-03-30 10:58:25 [auto1.de] INFO: Scrape type for AU50389: 2
2026-03-30 10:58:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11368bb7-774b-5ef1-8b00-99ec34f0b388 with identifier: AU50389
2026-03-30 10:58:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11368bb7-774b-5ef1-8b00-99ec34f0b388 with scrape type 2
2026-03-30 10:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11368bb7-774b-5ef1-8b00-99ec34f0b388 with scrape type 2
2026-03-30 10:58:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11368bb7-774b-5ef1-8b00-99ec34f0b388, identifier: AU50389
2026-03-30 10:58:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11368bb7-774b-5ef1-8b00-99ec34f0b388 with identifier: AU50389
2026-03-30 10:58:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11368bb7-774b-5ef1-8b00-99ec34f0b388 with identifier: AU50389
2026-03-30 10:58:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11368bb7-774b-5ef1-8b00-99ec34f0b388 with identifier: AU50389 to the API
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:28:34Z',
 'fuel_type': 'diesel',
 'id': '11368bb7-774b-5ef1-8b00-99ec34f0b388',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU50389',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 192385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-27',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi FT 280 K',
 'transmission': 'manual',
 'trim': 'FT 280 K',
 'year': 2006}
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU50389%27 HTTP/1.1" 200 None
2026-03-30 10:58:25 [auto1.de] INFO: Saving data for AU50389: {'auction_closing_time': 1774884514.0, 'created_time': 1773301832.732149, 'last_price_update_time': 1774868305.962609}
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU50389') HTTP/1.1" 204 0
2026-03-30 10:58:25 [auto1.de] INFO: Found listing with ID: VT21239
2026-03-30 10:58:25 [auto1.de] INFO: Found listing with ID: ME62571
2026-03-30 10:58:25 [auto1.de] INFO: Found listing with ID: NV69214
2026-03-30 10:58:25 [auto1.de] INFO: Found listing with ID: KJ28184
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ28184%27 HTTP/1.1" 200 None
2026-03-30 10:58:25 [auto1.de] INFO: Scrape type for KJ28184: 2
2026-03-30 10:58:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 421a0b7f-d9f3-57e4-acb1-d20744316f7c with identifier: KJ28184
2026-03-30 10:58:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 421a0b7f-d9f3-57e4-acb1-d20744316f7c with scrape type 2
2026-03-30 10:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 421a0b7f-d9f3-57e4-acb1-d20744316f7c with scrape type 2
2026-03-30 10:58:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 421a0b7f-d9f3-57e4-acb1-d20744316f7c, identifier: KJ28184
2026-03-30 10:58:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 421a0b7f-d9f3-57e4-acb1-d20744316f7c with identifier: KJ28184
2026-03-30 10:58:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 421a0b7f-d9f3-57e4-acb1-d20744316f7c with identifier: KJ28184
2026-03-30 10:58:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 421a0b7f-d9f3-57e4-acb1-d20744316f7c with identifier: KJ28184 to the API
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:45:39Z',
 'fuel_type': 'petrol',
 'id': '421a0b7f-d9f3-57e4-acb1-d20744316f7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ28184',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 125147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-20',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI BlueMotion',
 'year': 2017}
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ28184%27 HTTP/1.1" 200 None
2026-03-30 10:58:26 [auto1.de] INFO: Saving data for KJ28184: {'auction_closing_time': 1774885539.0, 'created_time': 1774780501.671115, 'last_price_update_time': 1774868306.41899}
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ28184') HTTP/1.1" 204 0
2026-03-30 10:58:26 [auto1.de] INFO: Channel: 24h | Page: 79 | totalHits: 9544 | hits on page: 40
2026-03-30 10:58:26 [auto1.de] INFO: Found listing with ID: KF75867
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF75867%27 HTTP/1.1" 200 None
2026-03-30 10:58:26 [auto1.de] INFO: Scrape type for KF75867: 2
2026-03-30 10:58:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f900c00a-792e-5af9-8a03-be98aea612d9 with identifier: KF75867
2026-03-30 10:58:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f900c00a-792e-5af9-8a03-be98aea612d9 with scrape type 2
2026-03-30 10:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f900c00a-792e-5af9-8a03-be98aea612d9 with scrape type 2
2026-03-30 10:58:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f900c00a-792e-5af9-8a03-be98aea612d9, identifier: KF75867
2026-03-30 10:58:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f900c00a-792e-5af9-8a03-be98aea612d9 with identifier: KF75867
2026-03-30 10:58:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f900c00a-792e-5af9-8a03-be98aea612d9 with identifier: KF75867
2026-03-30 10:58:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f900c00a-792e-5af9-8a03-be98aea612d9 with identifier: KF75867 to the API
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:18:48Z',
 'fuel_type': 'hybrid',
 'id': 'f900c00a-792e-5af9-8a03-be98aea612d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF75867',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 26778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-09',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2022}
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF75867%27 HTTP/1.1" 200 None
2026-03-30 10:58:26 [auto1.de] INFO: Saving data for KF75867: {'auction_closing_time': 1774883928.0, 'created_time': 1774780423.845276, 'last_price_update_time': 1774868306.808463}
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF75867') HTTP/1.1" 204 0
2026-03-30 10:58:26 [auto1.de] INFO: Found listing with ID: PM99817
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM99817%27 HTTP/1.1" 200 None
2026-03-30 10:58:26 [auto1.de] INFO: Scrape type for PM99817: 2
2026-03-30 10:58:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffd45caf-e9a8-5465-8ffd-b0c818370c45 with identifier: PM99817
2026-03-30 10:58:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffd45caf-e9a8-5465-8ffd-b0c818370c45 with scrape type 2
2026-03-30 10:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffd45caf-e9a8-5465-8ffd-b0c818370c45 with scrape type 2
2026-03-30 10:58:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffd45caf-e9a8-5465-8ffd-b0c818370c45, identifier: PM99817
2026-03-30 10:58:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:58:26 [auto1.de] INFO: Found listing with ID: UT98357
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT98357%27 HTTP/1.1" 200 None
2026-03-30 10:58:26 [auto1.de] INFO: Scrape type for UT98357: 2
2026-03-30 10:58:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fd02a1c-831e-5939-9288-cc03839c06bd with identifier: UT98357
2026-03-30 10:58:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fd02a1c-831e-5939-9288-cc03839c06bd with scrape type 2
2026-03-30 10:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fd02a1c-831e-5939-9288-cc03839c06bd with scrape type 2
2026-03-30 10:58:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fd02a1c-831e-5939-9288-cc03839c06bd, identifier: UT98357
2026-03-30 10:58:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffd45caf-e9a8-5465-8ffd-b0c818370c45 with identifier: PM99817
2026-03-30 10:58:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffd45caf-e9a8-5465-8ffd-b0c818370c45 with identifier: PM99817
2026-03-30 10:58:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffd45caf-e9a8-5465-8ffd-b0c818370c45 with identifier: PM99817 to the API
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:12:09Z',
 'fuel_type': 'diesel',
 'id': 'ffd45caf-e9a8-5465-8ffd-b0c818370c45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM99817',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 151152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-01',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Edition 30 4Motion',
 'transmission': 'manual',
 'trim': 'Edition 30 4Motion',
 'year': 2016}
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM99817%27 HTTP/1.1" 200 None
2026-03-30 10:58:27 [auto1.de] INFO: Saving data for PM99817: {'auction_closing_time': 1774883529.0, 'created_time': 1774379144.983357, 'last_price_update_time': 1774868307.343242}
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM99817') HTTP/1.1" 204 0
2026-03-30 10:58:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fd02a1c-831e-5939-9288-cc03839c06bd with identifier: UT98357
2026-03-30 10:58:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fd02a1c-831e-5939-9288-cc03839c06bd with identifier: UT98357
2026-03-30 10:58:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fd02a1c-831e-5939-9288-cc03839c06bd with identifier: UT98357 to the API
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:09:37Z',
 'fuel_type': 'diesel',
 'id': '4fd02a1c-831e-5939-9288-cc03839c06bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT98357',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 160046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-10',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TDI quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2017}
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT98357%27 HTTP/1.1" 200 None
2026-03-30 10:58:27 [auto1.de] INFO: Saving data for UT98357: {'auction_closing_time': 1774883377.0, 'created_time': 1774550622.332565, 'last_price_update_time': 1774868307.71884}
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT98357') HTTP/1.1" 204 0
2026-03-30 10:58:27 [auto1.de] INFO: Found listing with ID: HS17931
2026-03-30 10:58:27 [auto1.de] INFO: Found listing with ID: DP06637
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP06637%27 HTTP/1.1" 200 None
2026-03-30 10:58:27 [auto1.de] INFO: Scrape type for DP06637: 2
2026-03-30 10:58:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2d041df-8fbe-5c99-94b9-c304c66f5666 with identifier: DP06637
2026-03-30 10:58:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2d041df-8fbe-5c99-94b9-c304c66f5666 with scrape type 2
2026-03-30 10:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2d041df-8fbe-5c99-94b9-c304c66f5666 with scrape type 2
2026-03-30 10:58:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2d041df-8fbe-5c99-94b9-c304c66f5666, identifier: DP06637
2026-03-30 10:58:27 [auto1.de] INFO: Found listing with ID: HY43469
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY43469%27 HTTP/1.1" 200 None
2026-03-30 10:58:27 [auto1.de] INFO: Scrape type for HY43469: 2
2026-03-30 10:58:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13e0d71f-ddb9-578e-bb24-9bf71ef0958a with identifier: HY43469
2026-03-30 10:58:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13e0d71f-ddb9-578e-bb24-9bf71ef0958a with scrape type 2
2026-03-30 10:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13e0d71f-ddb9-578e-bb24-9bf71ef0958a with scrape type 2
2026-03-30 10:58:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13e0d71f-ddb9-578e-bb24-9bf71ef0958a, identifier: HY43469
2026-03-30 10:58:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2d041df-8fbe-5c99-94b9-c304c66f5666 with identifier: DP06637
2026-03-30 10:58:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2d041df-8fbe-5c99-94b9-c304c66f5666 with identifier: DP06637
2026-03-30 10:58:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2d041df-8fbe-5c99-94b9-c304c66f5666 with identifier: DP06637 to the API
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-30T15:36:06Z',
 'fuel_type': 'petrol',
 'id': 'f2d041df-8fbe-5c99-94b9-c304c66f5666',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP06637',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 202367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-10-31',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 230 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 2000}
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP06637%27 HTTP/1.1" 200 None
2026-03-30 10:58:28 [auto1.de] INFO: Saving data for DP06637: {'auction_closing_time': 1774884966.0, 'created_time': 1773341837.397122, 'last_price_update_time': 1774868308.236864}
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP06637') HTTP/1.1" 204 0
2026-03-30 10:58:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13e0d71f-ddb9-578e-bb24-9bf71ef0958a with identifier: HY43469
2026-03-30 10:58:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13e0d71f-ddb9-578e-bb24-9bf71ef0958a with identifier: HY43469
2026-03-30 10:58:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13e0d71f-ddb9-578e-bb24-9bf71ef0958a with identifier: HY43469 to the API
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:19:31Z',
 'fuel_type': 'petrol',
 'id': '13e0d71f-ddb9-578e-bb24-9bf71ef0958a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY43469',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 70905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-29',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.5 TGDI Mild-Hybrid GT Line",
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2021}
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY43469%27 HTTP/1.1" 200 None
2026-03-30 10:58:28 [auto1.de] INFO: Saving data for HY43469: {'auction_closing_time': 1774883971.0, 'created_time': 1774002406.967266, 'last_price_update_time': 1774868308.533567}
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY43469') HTTP/1.1" 204 0
2026-03-30 10:58:28 [auto1.de] INFO: Found listing with ID: NG65344
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG65344%27 HTTP/1.1" 200 None
2026-03-30 10:58:28 [auto1.de] INFO: Scrape type for NG65344: 2
2026-03-30 10:58:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5065ac6f-e6a2-5aa8-80f9-d986f059e27a with identifier: NG65344
2026-03-30 10:58:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5065ac6f-e6a2-5aa8-80f9-d986f059e27a with scrape type 2
2026-03-30 10:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5065ac6f-e6a2-5aa8-80f9-d986f059e27a with scrape type 2
2026-03-30 10:58:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5065ac6f-e6a2-5aa8-80f9-d986f059e27a, identifier: NG65344
2026-03-30 10:58:28 [auto1.de] INFO: Found listing with ID: JA01983
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA01983%27 HTTP/1.1" 200 None
2026-03-30 10:58:28 [auto1.de] INFO: Scrape type for JA01983: 2
2026-03-30 10:58:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ae6cf48-26d8-51e5-b0fc-d3cae369d8a1 with identifier: JA01983
2026-03-30 10:58:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ae6cf48-26d8-51e5-b0fc-d3cae369d8a1 with scrape type 2
2026-03-30 10:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ae6cf48-26d8-51e5-b0fc-d3cae369d8a1 with scrape type 2
2026-03-30 10:58:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ae6cf48-26d8-51e5-b0fc-d3cae369d8a1, identifier: JA01983
2026-03-30 10:58:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5065ac6f-e6a2-5aa8-80f9-d986f059e27a with identifier: NG65344
2026-03-30 10:58:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5065ac6f-e6a2-5aa8-80f9-d986f059e27a with identifier: NG65344
2026-03-30 10:58:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5065ac6f-e6a2-5aa8-80f9-d986f059e27a with identifier: NG65344 to the API
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:57:09Z',
 'fuel_type': 'diesel',
 'id': '5065ac6f-e6a2-5aa8-80f9-d986f059e27a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG65344',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 243392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-02-17',
 'seller_name': None,
 'title': 'Volkswagen Sharan 1.9 TDI Cruise',
 'transmission': 'manual',
 'trim': 'Cruise',
 'year': 2002}
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG65344%27 HTTP/1.1" 200 None
2026-03-30 10:58:29 [auto1.de] INFO: Saving data for NG65344: {'auction_closing_time': 1774886229.0, 'created_time': 1774550670.395776, 'last_price_update_time': 1774868309.056097}
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG65344') HTTP/1.1" 204 0
2026-03-30 10:58:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ae6cf48-26d8-51e5-b0fc-d3cae369d8a1 with identifier: JA01983
2026-03-30 10:58:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ae6cf48-26d8-51e5-b0fc-d3cae369d8a1 with identifier: JA01983
2026-03-30 10:58:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ae6cf48-26d8-51e5-b0fc-d3cae369d8a1 with identifier: JA01983 to the API
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:47:23Z',
 'fuel_type': 'diesel',
 'id': '2ae6cf48-26d8-51e5-b0fc-d3cae369d8a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA01983',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 82631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-24',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.5 TDCi Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2016}
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA01983%27 HTTP/1.1" 200 None
2026-03-30 10:58:29 [auto1.de] INFO: Saving data for JA01983: {'auction_closing_time': 1774885643.0, 'created_time': 1773513877.814238, 'last_price_update_time': 1774868309.37056}
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA01983') HTTP/1.1" 204 0
2026-03-30 10:58:29 [auto1.de] INFO: Found listing with ID: JC50514
2026-03-30 10:58:29 [auto1.de] INFO: Found listing with ID: XT30705
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT30705%27 HTTP/1.1" 200 None
2026-03-30 10:58:29 [auto1.de] INFO: Scrape type for XT30705: 2
2026-03-30 10:58:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c810f55c-d60a-542b-9479-9aa50c13b5be with identifier: XT30705
2026-03-30 10:58:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c810f55c-d60a-542b-9479-9aa50c13b5be with scrape type 2
2026-03-30 10:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c810f55c-d60a-542b-9479-9aa50c13b5be with scrape type 2
2026-03-30 10:58:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c810f55c-d60a-542b-9479-9aa50c13b5be, identifier: XT30705
2026-03-30 10:58:29 [auto1.de] INFO: Found listing with ID: UJ23150
2026-03-30 10:58:29 [auto1.de] INFO: Found listing with ID: AH44309
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH44309%27 HTTP/1.1" 200 None
2026-03-30 10:58:29 [auto1.de] INFO: Scrape type for AH44309: 2
2026-03-30 10:58:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9deb495-daca-5c9b-a1c5-c49f02bd8835 with identifier: AH44309
2026-03-30 10:58:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9deb495-daca-5c9b-a1c5-c49f02bd8835 with scrape type 2
2026-03-30 10:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9deb495-daca-5c9b-a1c5-c49f02bd8835 with scrape type 2
2026-03-30 10:58:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9deb495-daca-5c9b-a1c5-c49f02bd8835, identifier: AH44309
2026-03-30 10:58:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c810f55c-d60a-542b-9479-9aa50c13b5be with identifier: XT30705
2026-03-30 10:58:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c810f55c-d60a-542b-9479-9aa50c13b5be with identifier: XT30705
2026-03-30 10:58:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c810f55c-d60a-542b-9479-9aa50c13b5be with identifier: XT30705 to the API
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:43:45Z',
 'fuel_type': 'petrol',
 'id': 'c810f55c-d60a-542b-9479-9aa50c13b5be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT30705',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 165035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-04-30',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2001}
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT30705%27 HTTP/1.1" 200 None
2026-03-30 10:58:29 [auto1.de] INFO: Saving data for XT30705: {'auction_closing_time': 1774885425.0, 'created_time': 1774780517.997327, 'last_price_update_time': 1774868309.973944}
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT30705') HTTP/1.1" 204 0
2026-03-30 10:58:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9deb495-daca-5c9b-a1c5-c49f02bd8835 with identifier: AH44309
2026-03-30 10:58:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9deb495-daca-5c9b-a1c5-c49f02bd8835 with identifier: AH44309
2026-03-30 10:58:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9deb495-daca-5c9b-a1c5-c49f02bd8835 with identifier: AH44309 to the API
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:35:27Z',
 'fuel_type': 'hybrid',
 'id': 'f9deb495-daca-5c9b-a1c5-c49f02bd8835',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH44309',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 12775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-04',
 'seller_name': None,
 'title': 'Peugeot 508 1.6 Hybrid 225 Allure',
 'transmission': 'automatic',
 'trim': '225 Allure',
 'year': 2023}
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH44309%27 HTTP/1.1" 200 None
2026-03-30 10:58:30 [auto1.de] INFO: Saving data for AH44309: {'auction_closing_time': 1774884927.0, 'created_time': 1774780419.859856, 'last_price_update_time': 1774868310.278841}
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH44309') HTTP/1.1" 204 0
2026-03-30 10:58:30 [auto1.de] INFO: Found listing with ID: AD00479
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD00479%27 HTTP/1.1" 200 None
2026-03-30 10:58:30 [auto1.de] INFO: Scrape type for AD00479: 2
2026-03-30 10:58:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1a432d1-522b-51ea-872e-74caaf6ff9b9 with identifier: AD00479
2026-03-30 10:58:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1a432d1-522b-51ea-872e-74caaf6ff9b9 with scrape type 2
2026-03-30 10:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1a432d1-522b-51ea-872e-74caaf6ff9b9 with scrape type 2
2026-03-30 10:58:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1a432d1-522b-51ea-872e-74caaf6ff9b9, identifier: AD00479
2026-03-30 10:58:30 [auto1.de] INFO: Found listing with ID: YK45245
2026-03-30 10:58:30 [auto1.de] INFO: Found listing with ID: DB08314
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB08314%27 HTTP/1.1" 200 None
2026-03-30 10:58:30 [auto1.de] INFO: Scrape type for DB08314: 2
2026-03-30 10:58:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb36d921-9e76-5b3c-8b21-e9f63a4f5486 with identifier: DB08314
2026-03-30 10:58:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb36d921-9e76-5b3c-8b21-e9f63a4f5486 with scrape type 2
2026-03-30 10:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb36d921-9e76-5b3c-8b21-e9f63a4f5486 with scrape type 2
2026-03-30 10:58:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb36d921-9e76-5b3c-8b21-e9f63a4f5486, identifier: DB08314
2026-03-30 10:58:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1a432d1-522b-51ea-872e-74caaf6ff9b9 with identifier: AD00479
2026-03-30 10:58:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1a432d1-522b-51ea-872e-74caaf6ff9b9 with identifier: AD00479
2026-03-30 10:58:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1a432d1-522b-51ea-872e-74caaf6ff9b9 with identifier: AD00479 to the API
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:30:06Z',
 'fuel_type': 'petrol',
 'id': 'f1a432d1-522b-51ea-872e-74caaf6ff9b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD00479',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 190135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-10-29',
 'seller_name': None,
 'title': 'Honda Civic 1.4 S 3',
 'transmission': 'automatic',
 'trim': 'S 3',
 'year': 2000}
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD00479%27 HTTP/1.1" 200 None
2026-03-30 10:58:30 [auto1.de] INFO: Saving data for AD00479: {'auction_closing_time': 1774884606.0, 'created_time': 1773916859.225084, 'last_price_update_time': 1774868310.85477}
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD00479') HTTP/1.1" 204 0
2026-03-30 10:58:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb36d921-9e76-5b3c-8b21-e9f63a4f5486 with identifier: DB08314
2026-03-30 10:58:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb36d921-9e76-5b3c-8b21-e9f63a4f5486 with identifier: DB08314
2026-03-30 10:58:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb36d921-9e76-5b3c-8b21-e9f63a4f5486 with identifier: DB08314 to the API
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:52:04Z',
 'fuel_type': 'diesel',
 'id': 'fb36d921-9e76-5b3c-8b21-e9f63a4f5486',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB08314',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 108206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-24',
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB08314%27 HTTP/1.1" 200 None
2026-03-30 10:58:31 [auto1.de] INFO: Saving data for DB08314: {'auction_closing_time': 1774885924.0, 'created_time': 1774550528.827117, 'last_price_update_time': 1774868311.531795}
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB08314') HTTP/1.1" 204 0
2026-03-30 10:58:31 [auto1.de] INFO: Found listing with ID: CL69426
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL69426%27 HTTP/1.1" 200 None
2026-03-30 10:58:31 [auto1.de] INFO: Scrape type for CL69426: 2
2026-03-30 10:58:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de6361aa-de97-59ec-a51e-1b0457cf00df with identifier: CL69426
2026-03-30 10:58:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de6361aa-de97-59ec-a51e-1b0457cf00df with scrape type 2
2026-03-30 10:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de6361aa-de97-59ec-a51e-1b0457cf00df with scrape type 2
2026-03-30 10:58:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de6361aa-de97-59ec-a51e-1b0457cf00df, identifier: CL69426
2026-03-30 10:58:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de6361aa-de97-59ec-a51e-1b0457cf00df with identifier: CL69426
2026-03-30 10:58:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de6361aa-de97-59ec-a51e-1b0457cf00df with identifier: CL69426
2026-03-30 10:58:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de6361aa-de97-59ec-a51e-1b0457cf00df with identifier: CL69426 to the API
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:02:43Z',
 'fuel_type': 'petrol',
 'id': 'de6361aa-de97-59ec-a51e-1b0457cf00df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL69426',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 308378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-30',
 'seller_name': None,
 'title': 'Ford C-Max 2.0 Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2006}
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL69426%27 HTTP/1.1" 200 None
2026-03-30 10:58:31 [auto1.de] INFO: Saving data for CL69426: {'auction_closing_time': 1774882963.0, 'created_time': 1773830167.159323, 'last_price_update_time': 1774868311.955156}
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL69426') HTTP/1.1" 204 0
2026-03-30 10:58:31 [auto1.de] INFO: Found listing with ID: TS98691
2026-03-30 10:58:31 [auto1.de] INFO: Found listing with ID: KH18492
2026-03-30 10:58:31 [auto1.de] INFO: Found listing with ID: WJ52801
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ52801%27 HTTP/1.1" 200 None
2026-03-30 10:58:31 [auto1.de] INFO: Scrape type for WJ52801: 2
2026-03-30 10:58:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3b9c9d7-686c-57a0-9a75-dd0674fbbd5b with identifier: WJ52801
2026-03-30 10:58:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3b9c9d7-686c-57a0-9a75-dd0674fbbd5b with scrape type 2
2026-03-30 10:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3b9c9d7-686c-57a0-9a75-dd0674fbbd5b with scrape type 2
2026-03-30 10:58:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3b9c9d7-686c-57a0-9a75-dd0674fbbd5b, identifier: WJ52801
2026-03-30 10:58:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3b9c9d7-686c-57a0-9a75-dd0674fbbd5b with identifier: WJ52801
2026-03-30 10:58:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3b9c9d7-686c-57a0-9a75-dd0674fbbd5b with identifier: WJ52801
2026-03-30 10:58:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3b9c9d7-686c-57a0-9a75-dd0674fbbd5b with identifier: WJ52801 to the API
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:59:43Z',
 'fuel_type': 'diesel',
 'id': 'a3b9c9d7-686c-57a0-9a75-dd0674fbbd5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ52801',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 78998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-29',
 'seller_name': None,
 'title': 'Citroen C4 1.6 Blue-HDi Business Class',
 'transmission': 'manual',
 'trim': 'Business Class',
 'year': 2016}
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ52801%27 HTTP/1.1" 200 None
2026-03-30 10:58:32 [auto1.de] INFO: Saving data for WJ52801: {'auction_closing_time': 1774886383.0, 'created_time': 1773772612.170292, 'last_price_update_time': 1774868312.471772}
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ52801') HTTP/1.1" 204 0
2026-03-30 10:58:32 [auto1.de] INFO: Found listing with ID: TC78124
2026-03-30 10:58:32 [auto1.de] INFO: Found listing with ID: PY29315
2026-03-30 10:58:32 [auto1.de] INFO: Found listing with ID: WW76911
2026-03-30 10:58:32 [auto1.de] INFO: Found listing with ID: EE66446
2026-03-30 10:58:32 [auto1.de] INFO: Found listing with ID: SR43778
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR43778%27 HTTP/1.1" 200 None
2026-03-30 10:58:32 [auto1.de] INFO: Scrape type for SR43778: 2
2026-03-30 10:58:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9e2f685-9b13-525f-bcf5-dfe8727dbc16 with identifier: SR43778
2026-03-30 10:58:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9e2f685-9b13-525f-bcf5-dfe8727dbc16 with scrape type 2
2026-03-30 10:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9e2f685-9b13-525f-bcf5-dfe8727dbc16 with scrape type 2
2026-03-30 10:58:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9e2f685-9b13-525f-bcf5-dfe8727dbc16, identifier: SR43778
2026-03-30 10:58:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9e2f685-9b13-525f-bcf5-dfe8727dbc16 with identifier: SR43778
2026-03-30 10:58:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9e2f685-9b13-525f-bcf5-dfe8727dbc16 with identifier: SR43778
2026-03-30 10:58:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9e2f685-9b13-525f-bcf5-dfe8727dbc16 with identifier: SR43778 to the API
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-30T15:04:27Z',
 'fuel_type': 'hybrid',
 'id': 'a9e2f685-9b13-525f-bcf5-dfe8727dbc16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR43778',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 27606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-26',
 'seller_name': None,
 'title': 'Kia Niro 1.6 Plug-in Hybrid Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2020}
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR43778%27 HTTP/1.1" 200 None
2026-03-30 10:58:32 [auto1.de] INFO: Saving data for SR43778: {'auction_closing_time': 1774883067.0, 'created_time': 1774780521.852392, 'last_price_update_time': 1774868312.883743}
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR43778') HTTP/1.1" 204 0
2026-03-30 10:58:32 [auto1.de] INFO: Found listing with ID: GV67741
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV67741%27 HTTP/1.1" 200 None
2026-03-30 10:58:32 [auto1.de] INFO: Scrape type for GV67741: 2
2026-03-30 10:58:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1cd6a54-cc4b-5e97-bd8e-833db888b48b with identifier: GV67741
2026-03-30 10:58:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1cd6a54-cc4b-5e97-bd8e-833db888b48b with scrape type 2
2026-03-30 10:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1cd6a54-cc4b-5e97-bd8e-833db888b48b with scrape type 2
2026-03-30 10:58:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1cd6a54-cc4b-5e97-bd8e-833db888b48b, identifier: GV67741
2026-03-30 10:58:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1cd6a54-cc4b-5e97-bd8e-833db888b48b with identifier: GV67741
2026-03-30 10:58:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1cd6a54-cc4b-5e97-bd8e-833db888b48b with identifier: GV67741
2026-03-30 10:58:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1cd6a54-cc4b-5e97-bd8e-833db888b48b with identifier: GV67741 to the API
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:13:09Z',
 'fuel_type': 'diesel',
 'id': 'd1cd6a54-cc4b-5e97-bd8e-833db888b48b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV67741',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 132816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-21',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Startline',
 'transmission': 'automatic',
 'trim': 'Startline',
 'year': 2015}
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV67741%27 HTTP/1.1" 200 None
2026-03-30 10:58:33 [auto1.de] INFO: Saving data for GV67741: {'auction_closing_time': 1774883589.0, 'created_time': 1773428926.223739, 'last_price_update_time': 1774868313.287595}
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV67741') HTTP/1.1" 204 0
2026-03-30 10:58:33 [auto1.de] INFO: Found listing with ID: VY63466
2026-03-30 10:58:33 [auto1.de] INFO: Found listing with ID: PF70516
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF70516%27 HTTP/1.1" 200 None
2026-03-30 10:58:33 [auto1.de] INFO: Scrape type for PF70516: 2
2026-03-30 10:58:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72d61982-0975-50cb-82d8-7e25615e03d4 with identifier: PF70516
2026-03-30 10:58:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72d61982-0975-50cb-82d8-7e25615e03d4 with scrape type 2
2026-03-30 10:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72d61982-0975-50cb-82d8-7e25615e03d4 with scrape type 2
2026-03-30 10:58:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72d61982-0975-50cb-82d8-7e25615e03d4, identifier: PF70516
2026-03-30 10:58:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72d61982-0975-50cb-82d8-7e25615e03d4 with identifier: PF70516
2026-03-30 10:58:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72d61982-0975-50cb-82d8-7e25615e03d4 with identifier: PF70516
2026-03-30 10:58:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72d61982-0975-50cb-82d8-7e25615e03d4 with identifier: PF70516 to the API
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:11:26Z',
 'fuel_type': 'petrol',
 'id': '72d61982-0975-50cb-82d8-7e25615e03d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF70516',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 114056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-01-31',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2001}
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF70516%27 HTTP/1.1" 200 None
2026-03-30 10:58:33 [auto1.de] INFO: Saving data for PF70516: {'auction_closing_time': 1774883486.0, 'created_time': 1773741192.945392, 'last_price_update_time': 1774868313.69462}
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF70516') HTTP/1.1" 204 0
2026-03-30 10:58:33 [auto1.de] INFO: Found listing with ID: MB34428
2026-03-30 10:58:33 [auto1.de] INFO: Found listing with ID: YY88868
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY88868%27 HTTP/1.1" 200 None
2026-03-30 10:58:33 [auto1.de] INFO: Scrape type for YY88868: 2
2026-03-30 10:58:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09046a87-0ba8-5534-beea-2f93029da939 with identifier: YY88868
2026-03-30 10:58:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09046a87-0ba8-5534-beea-2f93029da939 with scrape type 2
2026-03-30 10:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09046a87-0ba8-5534-beea-2f93029da939 with scrape type 2
2026-03-30 10:58:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09046a87-0ba8-5534-beea-2f93029da939, identifier: YY88868
2026-03-30 10:58:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09046a87-0ba8-5534-beea-2f93029da939 with identifier: YY88868
2026-03-30 10:58:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09046a87-0ba8-5534-beea-2f93029da939 with identifier: YY88868
2026-03-30 10:58:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09046a87-0ba8-5534-beea-2f93029da939 with identifier: YY88868 to the API
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:53:47Z',
 'fuel_type': 'petrol',
 'id': '09046a87-0ba8-5534-beea-2f93029da939',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY88868',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Stilo',
 'odometer': 193729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-27',
 'seller_name': None,
 'title': 'Fiat Stilo 1.6 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2006}
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY88868%27 HTTP/1.1" 200 None
2026-03-30 10:58:34 [auto1.de] INFO: Saving data for YY88868: {'auction_closing_time': 1774886027.0, 'created_time': 1773662198.428188, 'last_price_update_time': 1774868314.241669}
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY88868') HTTP/1.1" 204 0
2026-03-30 10:58:34 [auto1.de] INFO: Found listing with ID: WL17880
2026-03-30 10:58:34 [auto1.de] INFO: Found listing with ID: PA05830
2026-03-30 10:58:34 [auto1.de] INFO: Found listing with ID: NY52199
2026-03-30 10:58:34 [auto1.de] INFO: Found listing with ID: CL67465
2026-03-30 10:58:34 [auto1.de] INFO: Found listing with ID: AX54291
2026-03-30 10:58:34 [auto1.de] INFO: Found listing with ID: EU26057
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU26057%27 HTTP/1.1" 200 None
2026-03-30 10:58:34 [auto1.de] INFO: Scrape type for EU26057: 2
2026-03-30 10:58:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69f87d73-1d35-565f-81ce-67c8f54b02e2 with identifier: EU26057
2026-03-30 10:58:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69f87d73-1d35-565f-81ce-67c8f54b02e2 with scrape type 2
2026-03-30 10:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69f87d73-1d35-565f-81ce-67c8f54b02e2 with scrape type 2
2026-03-30 10:58:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69f87d73-1d35-565f-81ce-67c8f54b02e2, identifier: EU26057
2026-03-30 10:58:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69f87d73-1d35-565f-81ce-67c8f54b02e2 with identifier: EU26057
2026-03-30 10:58:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69f87d73-1d35-565f-81ce-67c8f54b02e2 with identifier: EU26057
2026-03-30 10:58:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69f87d73-1d35-565f-81ce-67c8f54b02e2 with identifier: EU26057 to the API
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:39:04Z',
 'fuel_type': 'petrol',
 'id': '69f87d73-1d35-565f-81ce-67c8f54b02e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU26057',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 312549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-28',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Special',
 'transmission': 'manual',
 'trim': 'Special',
 'year': 2011}
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU26057%27 HTTP/1.1" 200 None
2026-03-30 10:58:35 [auto1.de] INFO: Saving data for EU26057: {'auction_closing_time': 1774885144.0, 'created_time': 1774550559.368631, 'last_price_update_time': 1774868315.406523}
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU26057') HTTP/1.1" 204 0
2026-03-30 10:58:35 [auto1.de] INFO: Found listing with ID: KN25796
2026-03-30 10:58:35 [auto1.de] INFO: Found listing with ID: NN77195
2026-03-30 10:58:35 [auto1.de] INFO: Found listing with ID: RZ45087
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ45087%27 HTTP/1.1" 200 None
2026-03-30 10:58:35 [auto1.de] INFO: Scrape type for RZ45087: 2
2026-03-30 10:58:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bec239c2-cd84-5e0c-ab05-be98b999594f with identifier: RZ45087
2026-03-30 10:58:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bec239c2-cd84-5e0c-ab05-be98b999594f with scrape type 2
2026-03-30 10:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bec239c2-cd84-5e0c-ab05-be98b999594f with scrape type 2
2026-03-30 10:58:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bec239c2-cd84-5e0c-ab05-be98b999594f, identifier: RZ45087
2026-03-30 10:58:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bec239c2-cd84-5e0c-ab05-be98b999594f with identifier: RZ45087
2026-03-30 10:58:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bec239c2-cd84-5e0c-ab05-be98b999594f with identifier: RZ45087
2026-03-30 10:58:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bec239c2-cd84-5e0c-ab05-be98b999594f with identifier: RZ45087 to the API
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:18:03Z',
 'fuel_type': 'petrol',
 'id': 'bec239c2-cd84-5e0c-ab05-be98b999594f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ45087',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 117433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-22',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2017}
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ45087%27 HTTP/1.1" 200 None
2026-03-30 10:58:35 [auto1.de] INFO: Saving data for RZ45087: {'auction_closing_time': 1774883883.0, 'created_time': 1774377605.583812, 'last_price_update_time': 1774868315.846691}
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ45087') HTTP/1.1" 204 0
2026-03-30 10:58:35 [auto1.de] INFO: Found listing with ID: HW35113
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW35113%27 HTTP/1.1" 200 None
2026-03-30 10:58:36 [auto1.de] INFO: Scrape type for HW35113: 2
2026-03-30 10:58:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d415c5c8-eb7c-51e7-b308-966a9a7f06e3 with identifier: HW35113
2026-03-30 10:58:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d415c5c8-eb7c-51e7-b308-966a9a7f06e3 with scrape type 2
2026-03-30 10:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d415c5c8-eb7c-51e7-b308-966a9a7f06e3 with scrape type 2
2026-03-30 10:58:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d415c5c8-eb7c-51e7-b308-966a9a7f06e3, identifier: HW35113
2026-03-30 10:58:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d415c5c8-eb7c-51e7-b308-966a9a7f06e3 with identifier: HW35113
2026-03-30 10:58:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d415c5c8-eb7c-51e7-b308-966a9a7f06e3 with identifier: HW35113
2026-03-30 10:58:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d415c5c8-eb7c-51e7-b308-966a9a7f06e3 with identifier: HW35113 to the API
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:45:30Z',
 'fuel_type': 'diesel',
 'id': 'd415c5c8-eb7c-51e7-b308-966a9a7f06e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW35113',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 109503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-22',
 'seller_name': None,
 'title': 'BMW 3er 320d Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2017}
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW35113%27 HTTP/1.1" 200 None
2026-03-30 10:58:36 [auto1.de] INFO: Saving data for HW35113: {'auction_closing_time': 1774885530.0, 'created_time': 1774780426.064653, 'last_price_update_time': 1774868316.411543}
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW35113') HTTP/1.1" 204 0
2026-03-30 10:58:36 [auto1.de] INFO: Found listing with ID: TP80753
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP80753%27 HTTP/1.1" 200 None
2026-03-30 10:58:36 [auto1.de] INFO: Scrape type for TP80753: 2
2026-03-30 10:58:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 268465e1-c221-567d-8f9f-60e789f24a24 with identifier: TP80753
2026-03-30 10:58:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 268465e1-c221-567d-8f9f-60e789f24a24 with scrape type 2
2026-03-30 10:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 268465e1-c221-567d-8f9f-60e789f24a24 with scrape type 2
2026-03-30 10:58:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 268465e1-c221-567d-8f9f-60e789f24a24, identifier: TP80753
2026-03-30 10:58:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 268465e1-c221-567d-8f9f-60e789f24a24 with identifier: TP80753
2026-03-30 10:58:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 268465e1-c221-567d-8f9f-60e789f24a24 with identifier: TP80753
2026-03-30 10:58:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 268465e1-c221-567d-8f9f-60e789f24a24 with identifier: TP80753 to the API
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:14:19Z',
 'fuel_type': 'diesel',
 'id': '268465e1-c221-567d-8f9f-60e789f24a24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP80753',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 96932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-20',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2020}
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP80753%27 HTTP/1.1" 200 None
2026-03-30 10:58:36 [auto1.de] INFO: Saving data for TP80753: {'auction_closing_time': 1774883659.0, 'created_time': 1774780429.131801, 'last_price_update_time': 1774868316.796103}
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP80753') HTTP/1.1" 204 0
2026-03-30 10:58:36 [auto1.de] INFO: Found listing with ID: NF53472
2026-03-30 10:58:36 [auto1.de] INFO: Found listing with ID: WB48893
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB48893%27 HTTP/1.1" 200 None
2026-03-30 10:58:36 [auto1.de] INFO: Scrape type for WB48893: 2
2026-03-30 10:58:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff8ff5a9-151d-5dc6-98dd-c09243bfcdc0 with identifier: WB48893
2026-03-30 10:58:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff8ff5a9-151d-5dc6-98dd-c09243bfcdc0 with scrape type 2
2026-03-30 10:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff8ff5a9-151d-5dc6-98dd-c09243bfcdc0 with scrape type 2
2026-03-30 10:58:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff8ff5a9-151d-5dc6-98dd-c09243bfcdc0, identifier: WB48893
2026-03-30 10:58:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff8ff5a9-151d-5dc6-98dd-c09243bfcdc0 with identifier: WB48893
2026-03-30 10:58:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff8ff5a9-151d-5dc6-98dd-c09243bfcdc0 with identifier: WB48893
2026-03-30 10:58:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff8ff5a9-151d-5dc6-98dd-c09243bfcdc0 with identifier: WB48893 to the API
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:04:00Z',
 'fuel_type': 'diesel',
 'id': 'ff8ff5a9-151d-5dc6-98dd-c09243bfcdc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB48893',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 94850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-02',
 'seller_name': None,
 'title': 'Renault Kadjar 1.6 dCi Energy Crossborder',
 'transmission': 'manual',
 'trim': 'Crossborder',
 'year': 2017}
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB48893%27 HTTP/1.1" 200 None
2026-03-30 10:58:37 [auto1.de] INFO: Saving data for WB48893: {'auction_closing_time': 1774883040.0, 'created_time': 1773858697.974287, 'last_price_update_time': 1774868317.258593}
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB48893') HTTP/1.1" 204 0
2026-03-30 10:58:37 [auto1.de] INFO: Found listing with ID: HC78210
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC78210%27 HTTP/1.1" 200 None
2026-03-30 10:58:37 [auto1.de] INFO: Scrape type for HC78210: 2
2026-03-30 10:58:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e58451d-cbd2-5917-adc0-6a23154e18f2 with identifier: HC78210
2026-03-30 10:58:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e58451d-cbd2-5917-adc0-6a23154e18f2 with scrape type 2
2026-03-30 10:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e58451d-cbd2-5917-adc0-6a23154e18f2 with scrape type 2
2026-03-30 10:58:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e58451d-cbd2-5917-adc0-6a23154e18f2, identifier: HC78210
2026-03-30 10:58:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e58451d-cbd2-5917-adc0-6a23154e18f2 with identifier: HC78210
2026-03-30 10:58:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e58451d-cbd2-5917-adc0-6a23154e18f2 with identifier: HC78210
2026-03-30 10:58:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e58451d-cbd2-5917-adc0-6a23154e18f2 with identifier: HC78210 to the API
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:59:39Z',
 'fuel_type': 'diesel',
 'id': '0e58451d-cbd2-5917-adc0-6a23154e18f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC78210',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 340648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-11',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2005}
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC78210%27 HTTP/1.1" 200 None
2026-03-30 10:58:37 [auto1.de] INFO: Saving data for HC78210: {'auction_closing_time': 1774886379.0, 'created_time': 1773858675.951025, 'last_price_update_time': 1774868317.672893}
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC78210') HTTP/1.1" 204 0
2026-03-30 10:58:37 [auto1.de] INFO: Found listing with ID: WX30683
2026-03-30 10:58:37 [auto1.de] INFO: Found listing with ID: YK03536
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK03536%27 HTTP/1.1" 200 None
2026-03-30 10:58:37 [auto1.de] INFO: Scrape type for YK03536: 2
2026-03-30 10:58:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b95dc9c-4ce4-5fd4-9999-4eb8973bc99c with identifier: YK03536
2026-03-30 10:58:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b95dc9c-4ce4-5fd4-9999-4eb8973bc99c with scrape type 2
2026-03-30 10:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b95dc9c-4ce4-5fd4-9999-4eb8973bc99c with scrape type 2
2026-03-30 10:58:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b95dc9c-4ce4-5fd4-9999-4eb8973bc99c, identifier: YK03536
2026-03-30 10:58:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b95dc9c-4ce4-5fd4-9999-4eb8973bc99c with identifier: YK03536
2026-03-30 10:58:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b95dc9c-4ce4-5fd4-9999-4eb8973bc99c with identifier: YK03536
2026-03-30 10:58:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b95dc9c-4ce4-5fd4-9999-4eb8973bc99c with identifier: YK03536 to the API
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:50:12Z',
 'fuel_type': 'diesel',
 'id': '8b95dc9c-4ce4-5fd4-9999-4eb8973bc99c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK03536',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 139086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-08',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK03536%27 HTTP/1.1" 200 None
2026-03-30 10:58:38 [auto1.de] INFO: Saving data for YK03536: {'auction_closing_time': 1774885812.0, 'created_time': 1774550741.20991, 'last_price_update_time': 1774868318.07443}
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK03536') HTTP/1.1" 204 0
2026-03-30 10:58:38 [auto1.de] INFO: Found listing with ID: HZ13557
2026-03-30 10:58:38 [auto1.de] INFO: Found listing with ID: TU13190
2026-03-30 10:58:38 [auto1.de] INFO: Found listing with ID: CP72119
2026-03-30 10:58:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:58:38 [auto1.de] INFO: Channel: 24h | Page: 80 | totalHits: 9546 | hits on page: 40
2026-03-30 10:58:38 [auto1.de] INFO: Found listing with ID: TU13190
2026-03-30 10:58:38 [auto1.de] INFO: Found listing with ID: CP72119
2026-03-30 10:58:38 [auto1.de] INFO: Found listing with ID: VG12821
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG12821%27 HTTP/1.1" 200 None
2026-03-30 10:58:38 [auto1.de] INFO: Scrape type for VG12821: 2
2026-03-30 10:58:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e91d896-b4ca-51ce-8544-a58f4ee2c2e9 with identifier: VG12821
2026-03-30 10:58:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e91d896-b4ca-51ce-8544-a58f4ee2c2e9 with scrape type 2
2026-03-30 10:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e91d896-b4ca-51ce-8544-a58f4ee2c2e9 with scrape type 2
2026-03-30 10:58:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e91d896-b4ca-51ce-8544-a58f4ee2c2e9, identifier: VG12821
2026-03-30 10:58:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e91d896-b4ca-51ce-8544-a58f4ee2c2e9 with identifier: VG12821
2026-03-30 10:58:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e91d896-b4ca-51ce-8544-a58f4ee2c2e9 with identifier: VG12821
2026-03-30 10:58:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e91d896-b4ca-51ce-8544-a58f4ee2c2e9 with identifier: VG12821 to the API
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:43:55Z',
 'fuel_type': 'petrol',
 'id': '7e91d896-b4ca-51ce-8544-a58f4ee2c2e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG12821',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 162978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-27',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2009}
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG12821%27 HTTP/1.1" 200 None
2026-03-30 10:58:39 [auto1.de] INFO: Saving data for VG12821: {'auction_closing_time': 1774885435.0, 'created_time': 1773946262.707518, 'last_price_update_time': 1774868319.408275}
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG12821') HTTP/1.1" 204 0
2026-03-30 10:58:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:58:39 [auto1.de] INFO: Found listing with ID: NW56335
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW56335%27 HTTP/1.1" 200 None
2026-03-30 10:58:39 [auto1.de] INFO: Scrape type for NW56335: 2
2026-03-30 10:58:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b7aedec-807a-52c4-b0b3-17ad070f905d with identifier: NW56335
2026-03-30 10:58:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b7aedec-807a-52c4-b0b3-17ad070f905d with scrape type 2
2026-03-30 10:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b7aedec-807a-52c4-b0b3-17ad070f905d with scrape type 2
2026-03-30 10:58:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b7aedec-807a-52c4-b0b3-17ad070f905d, identifier: NW56335
2026-03-30 10:58:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b7aedec-807a-52c4-b0b3-17ad070f905d with identifier: NW56335
2026-03-30 10:58:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b7aedec-807a-52c4-b0b3-17ad070f905d with identifier: NW56335
2026-03-30 10:58:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b7aedec-807a-52c4-b0b3-17ad070f905d with identifier: NW56335 to the API
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:50:02Z',
 'fuel_type': 'petrol',
 'id': '0b7aedec-807a-52c4-b0b3-17ad070f905d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW56335',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 268188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-10-14',
 'seller_name': None,
 'title': 'Audi A3 1.6 Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2003}
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW56335%27 HTTP/1.1" 200 None
2026-03-30 10:58:39 [auto1.de] INFO: Saving data for NW56335: {'auction_closing_time': 1774885802.0, 'created_time': 1774636912.956246, 'last_price_update_time': 1774868319.934012}
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW56335') HTTP/1.1" 204 0
2026-03-30 10:58:39 [auto1.de] INFO: Found listing with ID: EL19889
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL19889%27 HTTP/1.1" 200 None
2026-03-30 10:58:39 [auto1.de] INFO: Scrape type for EL19889: 2
2026-03-30 10:58:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b42bd7b3-afd2-5c3c-8ba6-1e0a5f2a1eb8 with identifier: EL19889
2026-03-30 10:58:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b42bd7b3-afd2-5c3c-8ba6-1e0a5f2a1eb8 with scrape type 2
2026-03-30 10:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b42bd7b3-afd2-5c3c-8ba6-1e0a5f2a1eb8 with scrape type 2
2026-03-30 10:58:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b42bd7b3-afd2-5c3c-8ba6-1e0a5f2a1eb8, identifier: EL19889
2026-03-30 10:58:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b42bd7b3-afd2-5c3c-8ba6-1e0a5f2a1eb8 with identifier: EL19889
2026-03-30 10:58:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b42bd7b3-afd2-5c3c-8ba6-1e0a5f2a1eb8 with identifier: EL19889
2026-03-30 10:58:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b42bd7b3-afd2-5c3c-8ba6-1e0a5f2a1eb8 with identifier: EL19889 to the API
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:29:35Z',
 'fuel_type': 'petrol',
 'id': 'b42bd7b3-afd2-5c3c-8ba6-1e0a5f2a1eb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL19889',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 116424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-26',
 'seller_name': None,
 'title': 'Ford B-Max 1.6 Ti-VCT Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2015}
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL19889%27 HTTP/1.1" 200 None
2026-03-30 10:58:40 [auto1.de] INFO: Saving data for EL19889: {'auction_closing_time': 1774884575.0, 'created_time': 1774463548.75596, 'last_price_update_time': 1774868320.357164}
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL19889') HTTP/1.1" 204 0
2026-03-30 10:58:40 [auto1.de] INFO: Found listing with ID: EJ19003
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ19003%27 HTTP/1.1" 200 None
2026-03-30 10:58:40 [auto1.de] INFO: Scrape type for EJ19003: 2
2026-03-30 10:58:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8447068-8851-5943-8d43-4895b043108a with identifier: EJ19003
2026-03-30 10:58:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8447068-8851-5943-8d43-4895b043108a with scrape type 2
2026-03-30 10:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8447068-8851-5943-8d43-4895b043108a with scrape type 2
2026-03-30 10:58:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8447068-8851-5943-8d43-4895b043108a, identifier: EJ19003
2026-03-30 10:58:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8447068-8851-5943-8d43-4895b043108a with identifier: EJ19003
2026-03-30 10:58:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8447068-8851-5943-8d43-4895b043108a with identifier: EJ19003
2026-03-30 10:58:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8447068-8851-5943-8d43-4895b043108a with identifier: EJ19003 to the API
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:01:27Z',
 'fuel_type': 'diesel',
 'id': 'd8447068-8851-5943-8d43-4895b043108a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ19003',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 112617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-01',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ19003%27 HTTP/1.1" 200 None
2026-03-30 10:58:40 [auto1.de] INFO: Saving data for EJ19003: {'auction_closing_time': 1774882887.0, 'created_time': 1774550623.447128, 'last_price_update_time': 1774868320.767338}
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ19003') HTTP/1.1" 204 0
2026-03-30 10:58:40 [auto1.de] INFO: Found listing with ID: XC49831
2026-03-30 10:58:40 [auto1.de] INFO: Found listing with ID: JG80760
2026-03-30 10:58:40 [auto1.de] INFO: Found listing with ID: TV16338
2026-03-30 10:58:40 [auto1.de] INFO: Found listing with ID: AS89586
2026-03-30 10:58:40 [auto1.de] INFO: Found listing with ID: XL04777
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL04777%27 HTTP/1.1" 200 None
2026-03-30 10:58:40 [auto1.de] INFO: Scrape type for XL04777: 2
2026-03-30 10:58:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e8ae712-bf0d-5c03-b93b-3f587d1df8e6 with identifier: XL04777
2026-03-30 10:58:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e8ae712-bf0d-5c03-b93b-3f587d1df8e6 with scrape type 2
2026-03-30 10:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e8ae712-bf0d-5c03-b93b-3f587d1df8e6 with scrape type 2
2026-03-30 10:58:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e8ae712-bf0d-5c03-b93b-3f587d1df8e6, identifier: XL04777
2026-03-30 10:58:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e8ae712-bf0d-5c03-b93b-3f587d1df8e6 with identifier: XL04777
2026-03-30 10:58:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e8ae712-bf0d-5c03-b93b-3f587d1df8e6 with identifier: XL04777
2026-03-30 10:58:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e8ae712-bf0d-5c03-b93b-3f587d1df8e6 with identifier: XL04777 to the API
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:58:49Z',
 'fuel_type': 'petrol',
 'id': '3e8ae712-bf0d-5c03-b93b-3f587d1df8e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL04777',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 55998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-04',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2006}
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL04777%27 HTTP/1.1" 200 None
2026-03-30 10:58:41 [auto1.de] INFO: Saving data for XL04777: {'auction_closing_time': 1774886329.0, 'created_time': 1773776365.334516, 'last_price_update_time': 1774868321.192416}
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL04777') HTTP/1.1" 204 0
2026-03-30 10:58:41 [auto1.de] INFO: Found listing with ID: ZB59540
2026-03-30 10:58:41 [auto1.de] INFO: Found listing with ID: EZ65040
2026-03-30 10:58:41 [auto1.de] INFO: Found listing with ID: KR07785
2026-03-30 10:58:41 [auto1.de] INFO: Found listing with ID: CW58984
2026-03-30 10:58:41 [auto1.de] INFO: Found listing with ID: ZF51547
2026-03-30 10:58:41 [auto1.de] INFO: Found listing with ID: LE60252
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE60252%27 HTTP/1.1" 200 None
2026-03-30 10:58:41 [auto1.de] INFO: Scrape type for LE60252: 2
2026-03-30 10:58:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbd6ae08-11a8-52f8-813d-191547934172 with identifier: LE60252
2026-03-30 10:58:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbd6ae08-11a8-52f8-813d-191547934172 with scrape type 2
2026-03-30 10:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbd6ae08-11a8-52f8-813d-191547934172 with scrape type 2
2026-03-30 10:58:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbd6ae08-11a8-52f8-813d-191547934172, identifier: LE60252
2026-03-30 10:58:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbd6ae08-11a8-52f8-813d-191547934172 with identifier: LE60252
2026-03-30 10:58:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbd6ae08-11a8-52f8-813d-191547934172 with identifier: LE60252
2026-03-30 10:58:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbd6ae08-11a8-52f8-813d-191547934172 with identifier: LE60252 to the API
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:19:24Z',
 'fuel_type': 'diesel',
 'id': 'cbd6ae08-11a8-52f8-813d-191547934172',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE60252',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Espace',
 'odometer': 213493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-20',
 'seller_name': None,
 'title': 'Renault Grand Espace 2.0 dCi Espace Navitech',
 'transmission': 'manual',
 'trim': 'Espace Navitech',
 'year': 2008}
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE60252%27 HTTP/1.1" 200 None
2026-03-30 10:58:41 [auto1.de] INFO: Saving data for LE60252: {'auction_closing_time': 1774883964.0, 'created_time': 1774636914.479164, 'last_price_update_time': 1774868321.616485}
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE60252') HTTP/1.1" 204 0
2026-03-30 10:58:41 [auto1.de] INFO: Found listing with ID: BL18853
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL18853%27 HTTP/1.1" 200 None
2026-03-30 10:58:41 [auto1.de] INFO: Scrape type for BL18853: 2
2026-03-30 10:58:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1a30fa9-7643-5096-b0c6-435ac471eb04 with identifier: BL18853
2026-03-30 10:58:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1a30fa9-7643-5096-b0c6-435ac471eb04 with scrape type 2
2026-03-30 10:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1a30fa9-7643-5096-b0c6-435ac471eb04 with scrape type 2
2026-03-30 10:58:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1a30fa9-7643-5096-b0c6-435ac471eb04, identifier: BL18853
2026-03-30 10:58:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1a30fa9-7643-5096-b0c6-435ac471eb04 with identifier: BL18853
2026-03-30 10:58:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1a30fa9-7643-5096-b0c6-435ac471eb04 with identifier: BL18853
2026-03-30 10:58:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1a30fa9-7643-5096-b0c6-435ac471eb04 with identifier: BL18853 to the API
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:50:50Z',
 'fuel_type': 'petrol',
 'id': 'd1a30fa9-7643-5096-b0c6-435ac471eb04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL18853',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 86717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-10',
 'seller_name': None,
 'title': 'Ford Mondeo 1.5 EcoBoost Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2019}
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL18853%27 HTTP/1.1" 200 None
2026-03-30 10:58:42 [auto1.de] INFO: Saving data for BL18853: {'auction_closing_time': 1774885850.0, 'created_time': 1774550472.168717, 'last_price_update_time': 1774868322.103817}
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL18853') HTTP/1.1" 204 0
2026-03-30 10:58:42 [auto1.de] INFO: Found listing with ID: GX07003
2026-03-30 10:58:42 [auto1.de] INFO: Found listing with ID: DW68241
2026-03-30 10:58:42 [auto1.de] INFO: Found listing with ID: AE08285
2026-03-30 10:58:42 [auto1.de] INFO: Found listing with ID: BV75755
2026-03-30 10:58:42 [auto1.de] INFO: Found listing with ID: XE49281
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE49281%27 HTTP/1.1" 200 None
2026-03-30 10:58:42 [auto1.de] INFO: Scrape type for XE49281: 2
2026-03-30 10:58:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b85a9ece-9d39-5bfc-bd72-ca3431056ff3 with identifier: XE49281
2026-03-30 10:58:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b85a9ece-9d39-5bfc-bd72-ca3431056ff3 with scrape type 2
2026-03-30 10:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b85a9ece-9d39-5bfc-bd72-ca3431056ff3 with scrape type 2
2026-03-30 10:58:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b85a9ece-9d39-5bfc-bd72-ca3431056ff3, identifier: XE49281
2026-03-30 10:58:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b85a9ece-9d39-5bfc-bd72-ca3431056ff3 with identifier: XE49281
2026-03-30 10:58:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b85a9ece-9d39-5bfc-bd72-ca3431056ff3 with identifier: XE49281
2026-03-30 10:58:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b85a9ece-9d39-5bfc-bd72-ca3431056ff3 with identifier: XE49281 to the API
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:44:59Z',
 'fuel_type': 'diesel',
 'id': 'b85a9ece-9d39-5bfc-bd72-ca3431056ff3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE49281',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 44342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-26',
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi L2H1 3,5t',
 'transmission': 'manual',
 'trim': 'L2H1 3,5t',
 'year': 2020}
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE49281%27 HTTP/1.1" 200 None
2026-03-30 10:58:42 [auto1.de] INFO: Saving data for XE49281: {'auction_closing_time': 1774885499.0, 'created_time': 1774780521.466579, 'last_price_update_time': 1774868322.486727}
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE49281') HTTP/1.1" 204 0
2026-03-30 10:58:42 [auto1.de] INFO: Found listing with ID: SY67219
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY67219%27 HTTP/1.1" 200 None
2026-03-30 10:58:42 [auto1.de] INFO: Scrape type for SY67219: 2
2026-03-30 10:58:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ce11c96-b28f-5e73-b479-cb81c82abb79 with identifier: SY67219
2026-03-30 10:58:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ce11c96-b28f-5e73-b479-cb81c82abb79 with scrape type 2
2026-03-30 10:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ce11c96-b28f-5e73-b479-cb81c82abb79 with scrape type 2
2026-03-30 10:58:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ce11c96-b28f-5e73-b479-cb81c82abb79, identifier: SY67219
2026-03-30 10:58:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ce11c96-b28f-5e73-b479-cb81c82abb79 with identifier: SY67219
2026-03-30 10:58:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ce11c96-b28f-5e73-b479-cb81c82abb79 with identifier: SY67219
2026-03-30 10:58:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ce11c96-b28f-5e73-b479-cb81c82abb79 with identifier: SY67219 to the API
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:45:19Z',
 'fuel_type': 'petrol',
 'id': '2ce11c96-b28f-5e73-b479-cb81c82abb79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY67219',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 178491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-03-28',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 2.0 4Motion',
 'transmission': 'manual',
 'trim': '4Motion',
 'year': 2001}
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY67219%27 HTTP/1.1" 200 None
2026-03-30 10:58:42 [auto1.de] INFO: Saving data for SY67219: {'auction_closing_time': 1774885519.0, 'created_time': 1774550566.13147, 'last_price_update_time': 1774868322.918923}
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY67219') HTTP/1.1" 204 0
2026-03-30 10:58:42 [auto1.de] INFO: Found listing with ID: WE35343
2026-03-30 10:58:42 [auto1.de] INFO: Found listing with ID: NL19475
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL19475%27 HTTP/1.1" 200 None
2026-03-30 10:58:42 [auto1.de] INFO: Scrape type for NL19475: 2
2026-03-30 10:58:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da6da2ab-01b3-592c-85e2-401521134a28 with identifier: NL19475
2026-03-30 10:58:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da6da2ab-01b3-592c-85e2-401521134a28 with scrape type 2
2026-03-30 10:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da6da2ab-01b3-592c-85e2-401521134a28 with scrape type 2
2026-03-30 10:58:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da6da2ab-01b3-592c-85e2-401521134a28, identifier: NL19475
2026-03-30 10:58:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da6da2ab-01b3-592c-85e2-401521134a28 with identifier: NL19475
2026-03-30 10:58:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da6da2ab-01b3-592c-85e2-401521134a28 with identifier: NL19475
2026-03-30 10:58:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da6da2ab-01b3-592c-85e2-401521134a28 with identifier: NL19475 to the API
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:46:06Z',
 'fuel_type': 'diesel',
 'id': 'da6da2ab-01b3-592c-85e2-401521134a28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL19475',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Signum',
 'odometer': 200149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-07-07',
 'seller_name': None,
 'title': 'Opel Signum 2.2 DTI Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2004}
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL19475%27 HTTP/1.1" 200 None
2026-03-30 10:58:43 [auto1.de] INFO: Saving data for NL19475: {'auction_closing_time': 1774885566.0, 'created_time': 1773467545.083386, 'last_price_update_time': 1774868323.331509}
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL19475') HTTP/1.1" 204 0
2026-03-30 10:58:43 [auto1.de] INFO: Found listing with ID: WJ46196
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ46196%27 HTTP/1.1" 200 None
2026-03-30 10:58:43 [auto1.de] INFO: Scrape type for WJ46196: 2
2026-03-30 10:58:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a844eca4-76c1-5769-a5c3-f77c52aaee81 with identifier: WJ46196
2026-03-30 10:58:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a844eca4-76c1-5769-a5c3-f77c52aaee81 with scrape type 2
2026-03-30 10:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a844eca4-76c1-5769-a5c3-f77c52aaee81 with scrape type 2
2026-03-30 10:58:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a844eca4-76c1-5769-a5c3-f77c52aaee81, identifier: WJ46196
2026-03-30 10:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:58:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a844eca4-76c1-5769-a5c3-f77c52aaee81 with identifier: WJ46196
2026-03-30 10:58:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a844eca4-76c1-5769-a5c3-f77c52aaee81 with identifier: WJ46196
2026-03-30 10:58:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a844eca4-76c1-5769-a5c3-f77c52aaee81 with identifier: WJ46196 to the API
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:35:38Z',
 'fuel_type': 'petrol',
 'id': 'a844eca4-76c1-5769-a5c3-f77c52aaee81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ46196',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 182936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-26',
 'seller_name': None,
 'title': 'Renault Megane 2.0 Privilege',
 'transmission': 'manual',
 'trim': 'Privilege',
 'year': 2006}
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ46196%27 HTTP/1.1" 200 None
2026-03-30 10:58:43 [auto1.de] INFO: Saving data for WJ46196: {'auction_closing_time': 1774884938.0, 'created_time': 1774637106.621521, 'last_price_update_time': 1774868323.731017}
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ46196') HTTP/1.1" 204 0
2026-03-30 10:58:43 [auto1.de] INFO: Found listing with ID: GZ46196
2026-03-30 10:58:43 [auto1.de] INFO: Found listing with ID: UW13006
2026-03-30 10:58:43 [auto1.de] INFO: Found listing with ID: AT70381
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT70381%27 HTTP/1.1" 200 None
2026-03-30 10:58:43 [auto1.de] INFO: Scrape type for AT70381: 2
2026-03-30 10:58:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c73758b9-d2f9-51b9-8d51-e37ed1cab1b9 with identifier: AT70381
2026-03-30 10:58:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c73758b9-d2f9-51b9-8d51-e37ed1cab1b9 with scrape type 2
2026-03-30 10:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c73758b9-d2f9-51b9-8d51-e37ed1cab1b9 with scrape type 2
2026-03-30 10:58:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c73758b9-d2f9-51b9-8d51-e37ed1cab1b9, identifier: AT70381
2026-03-30 10:58:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c73758b9-d2f9-51b9-8d51-e37ed1cab1b9 with identifier: AT70381
2026-03-30 10:58:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c73758b9-d2f9-51b9-8d51-e37ed1cab1b9 with identifier: AT70381
2026-03-30 10:58:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c73758b9-d2f9-51b9-8d51-e37ed1cab1b9 with identifier: AT70381 to the API
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:53:36Z',
 'fuel_type': 'petrol',
 'id': 'c73758b9-d2f9-51b9-8d51-e37ed1cab1b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT70381',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 162401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-23',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2007}
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT70381%27 HTTP/1.1" 200 None
2026-03-30 10:58:44 [auto1.de] INFO: Saving data for AT70381: {'auction_closing_time': 1774886016.0, 'created_time': 1774550543.362009, 'last_price_update_time': 1774868324.222717}
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT70381') HTTP/1.1" 204 0
2026-03-30 10:58:44 [auto1.de] INFO: Found listing with ID: VN12200
2026-03-30 10:58:44 [auto1.de] INFO: Found listing with ID: HE00957
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE00957%27 HTTP/1.1" 200 None
2026-03-30 10:58:44 [auto1.de] INFO: Scrape type for HE00957: 2
2026-03-30 10:58:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bdb2d0b-6c34-5026-9321-3fbf35e373b1 with identifier: HE00957
2026-03-30 10:58:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bdb2d0b-6c34-5026-9321-3fbf35e373b1 with scrape type 2
2026-03-30 10:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bdb2d0b-6c34-5026-9321-3fbf35e373b1 with scrape type 2
2026-03-30 10:58:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bdb2d0b-6c34-5026-9321-3fbf35e373b1, identifier: HE00957
2026-03-30 10:58:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bdb2d0b-6c34-5026-9321-3fbf35e373b1 with identifier: HE00957
2026-03-30 10:58:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bdb2d0b-6c34-5026-9321-3fbf35e373b1 with identifier: HE00957
2026-03-30 10:58:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bdb2d0b-6c34-5026-9321-3fbf35e373b1 with identifier: HE00957 to the API
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:32:36Z',
 'fuel_type': 'petrol',
 'id': '3bdb2d0b-6c34-5026-9321-3fbf35e373b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE00957',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 54500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-17',
 'seller_name': None,
 'title': 'BMW 3er 330i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE00957%27 HTTP/1.1" 200 None
2026-03-30 10:58:44 [auto1.de] INFO: Saving data for HE00957: {'auction_closing_time': 1774884756.0, 'created_time': 1774780526.649121, 'last_price_update_time': 1774868324.775612}
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE00957') HTTP/1.1" 204 0
2026-03-30 10:58:44 [auto1.de] INFO: Channel: 24h | Page: 81 | totalHits: 9547 | hits on page: 40
2026-03-30 10:58:44 [auto1.de] INFO: Found listing with ID: MS26334
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS26334%27 HTTP/1.1" 200 None
2026-03-30 10:58:44 [auto1.de] INFO: Scrape type for MS26334: 2
2026-03-30 10:58:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec9733f1-ab87-542f-af6c-ea17376963f8 with identifier: MS26334
2026-03-30 10:58:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec9733f1-ab87-542f-af6c-ea17376963f8 with scrape type 2
2026-03-30 10:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec9733f1-ab87-542f-af6c-ea17376963f8 with scrape type 2
2026-03-30 10:58:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec9733f1-ab87-542f-af6c-ea17376963f8, identifier: MS26334
2026-03-30 10:58:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec9733f1-ab87-542f-af6c-ea17376963f8 with identifier: MS26334
2026-03-30 10:58:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec9733f1-ab87-542f-af6c-ea17376963f8 with identifier: MS26334
2026-03-30 10:58:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec9733f1-ab87-542f-af6c-ea17376963f8 with identifier: MS26334 to the API
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:44:50Z',
 'fuel_type': 'diesel',
 'id': 'ec9733f1-ab87-542f-af6c-ea17376963f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS26334',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 193700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-21',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 280 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS26334%27 HTTP/1.1" 200 None
2026-03-30 10:58:45 [auto1.de] INFO: Saving data for MS26334: {'auction_closing_time': 1774885490.0, 'created_time': 1773400385.45689, 'last_price_update_time': 1774868325.196711}
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS26334') HTTP/1.1" 204 0
2026-03-30 10:58:45 [auto1.de] INFO: Found listing with ID: UA53606
2026-03-30 10:58:45 [auto1.de] INFO: Found listing with ID: LS75303
2026-03-30 10:58:45 [auto1.de] INFO: Found listing with ID: VH02312
2026-03-30 10:58:45 [auto1.de] INFO: Found listing with ID: PN52671
2026-03-30 10:58:45 [auto1.de] INFO: Found listing with ID: NN25217
2026-03-30 10:58:45 [auto1.de] INFO: Found listing with ID: SR95486
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR95486%27 HTTP/1.1" 200 None
2026-03-30 10:58:45 [auto1.de] INFO: Scrape type for SR95486: 2
2026-03-30 10:58:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcf47c34-dd44-51d8-8fac-68e45addd0ea with identifier: SR95486
2026-03-30 10:58:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcf47c34-dd44-51d8-8fac-68e45addd0ea with scrape type 2
2026-03-30 10:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcf47c34-dd44-51d8-8fac-68e45addd0ea with scrape type 2
2026-03-30 10:58:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dcf47c34-dd44-51d8-8fac-68e45addd0ea, identifier: SR95486
2026-03-30 10:58:45 [auto1.de] INFO: Found listing with ID: ST83220
2026-03-30 10:58:45 [auto1.de] INFO: Found listing with ID: PJ99813
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ99813%27 HTTP/1.1" 200 None
2026-03-30 10:58:45 [auto1.de] INFO: Scrape type for PJ99813: 2
2026-03-30 10:58:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ee7351c-8143-5899-8dff-12216368bdcd with identifier: PJ99813
2026-03-30 10:58:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ee7351c-8143-5899-8dff-12216368bdcd with scrape type 2
2026-03-30 10:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ee7351c-8143-5899-8dff-12216368bdcd with scrape type 2
2026-03-30 10:58:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ee7351c-8143-5899-8dff-12216368bdcd, identifier: PJ99813
2026-03-30 10:58:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dcf47c34-dd44-51d8-8fac-68e45addd0ea with identifier: SR95486
2026-03-30 10:58:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dcf47c34-dd44-51d8-8fac-68e45addd0ea with identifier: SR95486
2026-03-30 10:58:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dcf47c34-dd44-51d8-8fac-68e45addd0ea with identifier: SR95486 to the API
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:23:50Z',
 'fuel_type': 'petrol',
 'id': 'dcf47c34-dd44-51d8-8fac-68e45addd0ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR95486',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 74218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-29',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2018}
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR95486%27 HTTP/1.1" 200 None
2026-03-30 10:58:45 [auto1.de] INFO: Saving data for SR95486: {'auction_closing_time': 1774884230.0, 'created_time': 1774550549.008847, 'last_price_update_time': 1774868325.725335}
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR95486') HTTP/1.1" 204 0
2026-03-30 10:58:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:58:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ee7351c-8143-5899-8dff-12216368bdcd with identifier: PJ99813
2026-03-30 10:58:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ee7351c-8143-5899-8dff-12216368bdcd with identifier: PJ99813
2026-03-30 10:58:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ee7351c-8143-5899-8dff-12216368bdcd with identifier: PJ99813 to the API
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:16:59Z',
 'fuel_type': 'petrol',
 'id': '4ee7351c-8143-5899-8dff-12216368bdcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ99813',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 158847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-23',
 'seller_name': None,
 'title': 'Ford S-Max 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ99813%27 HTTP/1.1" 200 None
2026-03-30 10:58:46 [auto1.de] INFO: Saving data for PJ99813: {'auction_closing_time': 1774883819.0, 'created_time': 1774291626.657574, 'last_price_update_time': 1774868326.101056}
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ99813') HTTP/1.1" 204 0
2026-03-30 10:58:46 [auto1.de] INFO: Found listing with ID: NL19683
2026-03-30 10:58:46 [auto1.de] INFO: Found listing with ID: SV33608
2026-03-30 10:58:46 [auto1.de] INFO: Found listing with ID: JW05859
2026-03-30 10:58:46 [auto1.de] INFO: Found listing with ID: WL45010
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL45010%27 HTTP/1.1" 200 None
2026-03-30 10:58:46 [auto1.de] INFO: Scrape type for WL45010: 2
2026-03-30 10:58:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42117a82-ed35-52dd-9e84-86d59a76b485 with identifier: WL45010
2026-03-30 10:58:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42117a82-ed35-52dd-9e84-86d59a76b485 with scrape type 2
2026-03-30 10:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42117a82-ed35-52dd-9e84-86d59a76b485 with scrape type 2
2026-03-30 10:58:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42117a82-ed35-52dd-9e84-86d59a76b485, identifier: WL45010
2026-03-30 10:58:46 [auto1.de] INFO: Found listing with ID: WP80129
2026-03-30 10:58:46 [auto1.de] INFO: Found listing with ID: TJ95012
2026-03-30 10:58:46 [auto1.de] INFO: Found listing with ID: BB55573
2026-03-30 10:58:46 [auto1.de] INFO: Found listing with ID: AE82588
2026-03-30 10:58:46 [auto1.de] INFO: Found listing with ID: UA53606
2026-03-30 10:58:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42117a82-ed35-52dd-9e84-86d59a76b485 with identifier: WL45010
2026-03-30 10:58:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42117a82-ed35-52dd-9e84-86d59a76b485 with identifier: WL45010
2026-03-30 10:58:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42117a82-ed35-52dd-9e84-86d59a76b485 with identifier: WL45010 to the API
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:03:57Z',
 'fuel_type': 'diesel',
 'id': '42117a82-ed35-52dd-9e84-86d59a76b485',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL45010',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 73528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-03',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Generation Six 4Motion',
 'transmission': 'automatic',
 'trim': 'Generation Six 4Motion',
 'year': 2021}
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL45010%27 HTTP/1.1" 200 None
2026-03-30 10:58:46 [auto1.de] INFO: Saving data for WL45010: {'auction_closing_time': 1774883037.0, 'created_time': 1774780524.935651, 'last_price_update_time': 1774868326.554897}
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL45010') HTTP/1.1" 204 0
2026-03-30 10:58:46 [auto1.de] INFO: Found listing with ID: YG26489
2026-03-30 10:58:46 [auto1.de] INFO: Found listing with ID: VJ55974
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ55974%27 HTTP/1.1" 200 None
2026-03-30 10:58:46 [auto1.de] INFO: Scrape type for VJ55974: 2
2026-03-30 10:58:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b574565d-9664-5c19-a9df-4a837432dbf2 with identifier: VJ55974
2026-03-30 10:58:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b574565d-9664-5c19-a9df-4a837432dbf2 with scrape type 2
2026-03-30 10:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b574565d-9664-5c19-a9df-4a837432dbf2 with scrape type 2
2026-03-30 10:58:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b574565d-9664-5c19-a9df-4a837432dbf2, identifier: VJ55974
2026-03-30 10:58:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b574565d-9664-5c19-a9df-4a837432dbf2 with identifier: VJ55974
2026-03-30 10:58:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b574565d-9664-5c19-a9df-4a837432dbf2 with identifier: VJ55974
2026-03-30 10:58:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b574565d-9664-5c19-a9df-4a837432dbf2 with identifier: VJ55974 to the API
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 605,
 'expiration_date': '2026-03-30T15:12:50Z',
 'fuel_type': 'petrol',
 'id': 'b574565d-9664-5c19-a9df-4a837432dbf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ55974',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS 7 Sportback',
 'odometer': 138826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-28',
 'seller_name': None,
 'title': 'Audi RS 7 Sportback 4.0 V8 TFSI quattro Performance',
 'transmission': 'automatic',
 'trim': 'quattro Performance',
 'year': 2016}
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ55974%27 HTTP/1.1" 200 None
2026-03-30 10:58:47 [auto1.de] INFO: Saving data for VJ55974: {'auction_closing_time': 1774883570.0, 'created_time': 1774465645.73011, 'last_price_update_time': 1774868327.029384}
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ55974') HTTP/1.1" 204 0
2026-03-30 10:58:47 [auto1.de] INFO: Found listing with ID: YP11119
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP11119%27 HTTP/1.1" 200 None
2026-03-30 10:58:47 [auto1.de] INFO: Scrape type for YP11119: 2
2026-03-30 10:58:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d09345dd-fdf8-5f8a-af35-35108c66daf5 with identifier: YP11119
2026-03-30 10:58:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d09345dd-fdf8-5f8a-af35-35108c66daf5 with scrape type 2
2026-03-30 10:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d09345dd-fdf8-5f8a-af35-35108c66daf5 with scrape type 2
2026-03-30 10:58:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d09345dd-fdf8-5f8a-af35-35108c66daf5, identifier: YP11119
2026-03-30 10:58:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d09345dd-fdf8-5f8a-af35-35108c66daf5 with identifier: YP11119
2026-03-30 10:58:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d09345dd-fdf8-5f8a-af35-35108c66daf5 with identifier: YP11119
2026-03-30 10:58:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d09345dd-fdf8-5f8a-af35-35108c66daf5 with identifier: YP11119 to the API
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:13:54Z',
 'fuel_type': 'petrol',
 'id': 'd09345dd-fdf8-5f8a-af35-35108c66daf5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP11119',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 22410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-25',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2023}
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP11119%27 HTTP/1.1" 200 None
2026-03-30 10:58:47 [auto1.de] INFO: Saving data for YP11119: {'auction_closing_time': 1774883634.0, 'created_time': 1773305516.83726, 'last_price_update_time': 1774868327.558789}
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP11119') HTTP/1.1" 204 0
2026-03-30 10:58:47 [auto1.de] INFO: Found listing with ID: GE22934
2026-03-30 10:58:47 [auto1.de] INFO: Found listing with ID: MC32966
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC32966%27 HTTP/1.1" 200 None
2026-03-30 10:58:47 [auto1.de] INFO: Scrape type for MC32966: 2
2026-03-30 10:58:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79fd9d41-4f58-5d5a-8ef9-461911454ca4 with identifier: MC32966
2026-03-30 10:58:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79fd9d41-4f58-5d5a-8ef9-461911454ca4 with scrape type 2
2026-03-30 10:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79fd9d41-4f58-5d5a-8ef9-461911454ca4 with scrape type 2
2026-03-30 10:58:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79fd9d41-4f58-5d5a-8ef9-461911454ca4, identifier: MC32966
2026-03-30 10:58:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79fd9d41-4f58-5d5a-8ef9-461911454ca4 with identifier: MC32966
2026-03-30 10:58:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79fd9d41-4f58-5d5a-8ef9-461911454ca4 with identifier: MC32966
2026-03-30 10:58:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79fd9d41-4f58-5d5a-8ef9-461911454ca4 with identifier: MC32966 to the API
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:50:54Z',
 'fuel_type': 'petrol',
 'id': '79fd9d41-4f58-5d5a-8ef9-461911454ca4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC32966',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 28365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-15',
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2015}
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC32966%27 HTTP/1.1" 200 None
2026-03-30 10:58:47 [auto1.de] INFO: Saving data for MC32966: {'auction_closing_time': 1774885854.0, 'created_time': 1774378030.814829, 'last_price_update_time': 1774868327.966611}
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC32966') HTTP/1.1" 204 0
2026-03-30 10:58:47 [auto1.de] INFO: Found listing with ID: FB20654
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20654%27 HTTP/1.1" 200 None
2026-03-30 10:58:48 [auto1.de] INFO: Scrape type for FB20654: 2
2026-03-30 10:58:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71d58109-f69d-5130-96b6-33955d3f04d3 with identifier: FB20654
2026-03-30 10:58:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71d58109-f69d-5130-96b6-33955d3f04d3 with scrape type 2
2026-03-30 10:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71d58109-f69d-5130-96b6-33955d3f04d3 with scrape type 2
2026-03-30 10:58:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71d58109-f69d-5130-96b6-33955d3f04d3, identifier: FB20654
2026-03-30 10:58:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71d58109-f69d-5130-96b6-33955d3f04d3 with identifier: FB20654
2026-03-30 10:58:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71d58109-f69d-5130-96b6-33955d3f04d3 with identifier: FB20654
2026-03-30 10:58:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71d58109-f69d-5130-96b6-33955d3f04d3 with identifier: FB20654 to the API
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:38:52Z',
 'fuel_type': 'diesel',
 'id': '71d58109-f69d-5130-96b6-33955d3f04d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB20654',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 150603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-14',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 R-Design 2WD',
 'transmission': 'automatic',
 'trim': 'R-Design 2WD',
 'year': 2019}
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20654%27 HTTP/1.1" 200 None
2026-03-30 10:58:48 [auto1.de] INFO: Saving data for FB20654: {'auction_closing_time': 1774885132.0, 'created_time': 1773859333.542529, 'last_price_update_time': 1774868328.360111}
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB20654') HTTP/1.1" 204 0
2026-03-30 10:58:48 [auto1.de] INFO: Found listing with ID: GM09493
2026-03-30 10:58:48 [auto1.de] INFO: Found listing with ID: UZ05424
2026-03-30 10:58:48 [auto1.de] INFO: Found listing with ID: AY40999
2026-03-30 10:58:48 [auto1.de] INFO: Found listing with ID: FA50226
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA50226%27 HTTP/1.1" 200 None
2026-03-30 10:58:48 [auto1.de] INFO: Scrape type for FA50226: 2
2026-03-30 10:58:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9acd5550-28cc-5e65-8d13-5e112ed7ef4e with identifier: FA50226
2026-03-30 10:58:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9acd5550-28cc-5e65-8d13-5e112ed7ef4e with scrape type 2
2026-03-30 10:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9acd5550-28cc-5e65-8d13-5e112ed7ef4e with scrape type 2
2026-03-30 10:58:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9acd5550-28cc-5e65-8d13-5e112ed7ef4e, identifier: FA50226
2026-03-30 10:58:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9acd5550-28cc-5e65-8d13-5e112ed7ef4e with identifier: FA50226
2026-03-30 10:58:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9acd5550-28cc-5e65-8d13-5e112ed7ef4e with identifier: FA50226
2026-03-30 10:58:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9acd5550-28cc-5e65-8d13-5e112ed7ef4e with identifier: FA50226 to the API
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:12:36Z',
 'fuel_type': 'diesel',
 'id': '9acd5550-28cc-5e65-8d13-5e112ed7ef4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA50226',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 125239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-19',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA50226%27 HTTP/1.1" 200 None
2026-03-30 10:58:48 [auto1.de] INFO: Saving data for FA50226: {'auction_closing_time': 1774883556.0, 'created_time': 1773138873.010044, 'last_price_update_time': 1774868328.747138}
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA50226') HTTP/1.1" 204 0
2026-03-30 10:58:48 [auto1.de] INFO: Found listing with ID: SY89352
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY89352%27 HTTP/1.1" 200 None
2026-03-30 10:58:48 [auto1.de] INFO: Scrape type for SY89352: 2
2026-03-30 10:58:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b94de415-2c77-5c58-9ea3-b444f0671c7e with identifier: SY89352
2026-03-30 10:58:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b94de415-2c77-5c58-9ea3-b444f0671c7e with scrape type 2
2026-03-30 10:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b94de415-2c77-5c58-9ea3-b444f0671c7e with scrape type 2
2026-03-30 10:58:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b94de415-2c77-5c58-9ea3-b444f0671c7e, identifier: SY89352
2026-03-30 10:58:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b94de415-2c77-5c58-9ea3-b444f0671c7e with identifier: SY89352
2026-03-30 10:58:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b94de415-2c77-5c58-9ea3-b444f0671c7e with identifier: SY89352
2026-03-30 10:58:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b94de415-2c77-5c58-9ea3-b444f0671c7e with identifier: SY89352 to the API
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 285,
 'expiration_date': '2026-03-30T15:08:37Z',
 'fuel_type': 'petrol',
 'id': 'b94de415-2c77-5c58-9ea3-b444f0671c7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY89352',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 67151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-27',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 3.6 V6 Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2018}
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY89352%27 HTTP/1.1" 200 None
2026-03-30 10:58:49 [auto1.de] INFO: Saving data for SY89352: {'auction_closing_time': 1774883317.0, 'created_time': 1774465065.840053, 'last_price_update_time': 1774868329.157859}
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY89352') HTTP/1.1" 204 0
2026-03-30 10:58:49 [auto1.de] INFO: Found listing with ID: YE79096
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE79096%27 HTTP/1.1" 200 None
2026-03-30 10:58:49 [auto1.de] INFO: Scrape type for YE79096: 2
2026-03-30 10:58:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e53a1fd5-8e51-5347-932b-e5d28f2c116e with identifier: YE79096
2026-03-30 10:58:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53a1fd5-8e51-5347-932b-e5d28f2c116e with scrape type 2
2026-03-30 10:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e53a1fd5-8e51-5347-932b-e5d28f2c116e with scrape type 2
2026-03-30 10:58:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e53a1fd5-8e51-5347-932b-e5d28f2c116e, identifier: YE79096
2026-03-30 10:58:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e53a1fd5-8e51-5347-932b-e5d28f2c116e with identifier: YE79096
2026-03-30 10:58:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e53a1fd5-8e51-5347-932b-e5d28f2c116e with identifier: YE79096
2026-03-30 10:58:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e53a1fd5-8e51-5347-932b-e5d28f2c116e with identifier: YE79096 to the API
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-30T15:32:11Z',
 'fuel_type': 'petrol',
 'id': 'e53a1fd5-8e51-5347-932b-e5d28f2c116e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE79096',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 57234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-03',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid Prestige 4WD',
 'transmission': 'automatic',
 'trim': 'Prestige 4WD',
 'year': 2021}
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE79096%27 HTTP/1.1" 200 None
2026-03-30 10:58:49 [auto1.de] INFO: Saving data for YE79096: {'auction_closing_time': 1774884731.0, 'created_time': 1774780541.110761, 'last_price_update_time': 1774868329.573645}
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE79096') HTTP/1.1" 204 0
2026-03-30 10:58:49 [auto1.de] INFO: Found listing with ID: XG44569
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG44569%27 HTTP/1.1" 200 None
2026-03-30 10:58:49 [auto1.de] INFO: Scrape type for XG44569: 2
2026-03-30 10:58:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d49ae8df-2838-57f3-9484-6d8f908fb32a with identifier: XG44569
2026-03-30 10:58:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d49ae8df-2838-57f3-9484-6d8f908fb32a with scrape type 2
2026-03-30 10:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d49ae8df-2838-57f3-9484-6d8f908fb32a with scrape type 2
2026-03-30 10:58:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d49ae8df-2838-57f3-9484-6d8f908fb32a, identifier: XG44569
2026-03-30 10:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:58:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d49ae8df-2838-57f3-9484-6d8f908fb32a with identifier: XG44569
2026-03-30 10:58:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d49ae8df-2838-57f3-9484-6d8f908fb32a with identifier: XG44569
2026-03-30 10:58:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d49ae8df-2838-57f3-9484-6d8f908fb32a with identifier: XG44569 to the API
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:00:06Z',
 'fuel_type': 'diesel',
 'id': 'd49ae8df-2838-57f3-9484-6d8f908fb32a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG44569',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 112445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-13',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG44569%27 HTTP/1.1" 200 None
2026-03-30 10:58:50 [auto1.de] INFO: Saving data for XG44569: {'auction_closing_time': 1774882806.0, 'created_time': 1773223531.899252, 'last_price_update_time': 1774868330.030527}
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG44569') HTTP/1.1" 204 0
2026-03-30 10:58:50 [auto1.de] INFO: Found listing with ID: XZ28453
2026-03-30 10:58:50 [auto1.de] INFO: Found listing with ID: EE17704
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE17704%27 HTTP/1.1" 200 None
2026-03-30 10:58:50 [auto1.de] INFO: Scrape type for EE17704: 2
2026-03-30 10:58:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cd33d38-b0c9-58a9-aca6-99b0e303cbb8 with identifier: EE17704
2026-03-30 10:58:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cd33d38-b0c9-58a9-aca6-99b0e303cbb8 with scrape type 2
2026-03-30 10:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cd33d38-b0c9-58a9-aca6-99b0e303cbb8 with scrape type 2
2026-03-30 10:58:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cd33d38-b0c9-58a9-aca6-99b0e303cbb8, identifier: EE17704
2026-03-30 10:58:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cd33d38-b0c9-58a9-aca6-99b0e303cbb8 with identifier: EE17704
2026-03-30 10:58:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cd33d38-b0c9-58a9-aca6-99b0e303cbb8 with identifier: EE17704
2026-03-30 10:58:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cd33d38-b0c9-58a9-aca6-99b0e303cbb8 with identifier: EE17704 to the API
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:40:21Z',
 'fuel_type': 'diesel',
 'id': '6cd33d38-b0c9-58a9-aca6-99b0e303cbb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE17704',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 210355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-24',
 'seller_name': None,
 'title': 'Audi A6 40 TDI Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE17704%27 HTTP/1.1" 200 None
2026-03-30 10:58:50 [auto1.de] INFO: Saving data for EE17704: {'auction_closing_time': 1774885221.0, 'created_time': 1772729605.258163, 'last_price_update_time': 1774868330.516763}
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE17704') HTTP/1.1" 204 0
2026-03-30 10:58:50 [auto1.de] INFO: Found listing with ID: TU83885
2026-03-30 10:58:50 [auto1.de] INFO: Found listing with ID: ZU14307
2026-03-30 10:58:50 [auto1.de] INFO: Found listing with ID: WT63610
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT63610%27 HTTP/1.1" 200 None
2026-03-30 10:58:50 [auto1.de] INFO: Scrape type for WT63610: 2
2026-03-30 10:58:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5d9b6a6-a7de-5a1c-8191-9e95bf3515d0 with identifier: WT63610
2026-03-30 10:58:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5d9b6a6-a7de-5a1c-8191-9e95bf3515d0 with scrape type 2
2026-03-30 10:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5d9b6a6-a7de-5a1c-8191-9e95bf3515d0 with scrape type 2
2026-03-30 10:58:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5d9b6a6-a7de-5a1c-8191-9e95bf3515d0, identifier: WT63610
2026-03-30 10:58:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5d9b6a6-a7de-5a1c-8191-9e95bf3515d0 with identifier: WT63610
2026-03-30 10:58:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5d9b6a6-a7de-5a1c-8191-9e95bf3515d0 with identifier: WT63610
2026-03-30 10:58:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5d9b6a6-a7de-5a1c-8191-9e95bf3515d0 with identifier: WT63610 to the API
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:08:54Z',
 'fuel_type': 'diesel',
 'id': 'f5d9b6a6-a7de-5a1c-8191-9e95bf3515d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT63610',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 90756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-19',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 220 d lang 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'lang 4Matic Avantgarde',
 'year': 2019}
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT63610%27 HTTP/1.1" 200 None
2026-03-30 10:58:50 [auto1.de] INFO: Saving data for WT63610: {'auction_closing_time': 1774883334.0, 'created_time': 1773513081.813215, 'last_price_update_time': 1774868330.944813}
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT63610') HTTP/1.1" 204 0
2026-03-30 10:58:50 [auto1.de] INFO: Channel: 24h | Page: 82 | totalHits: 9547 | hits on page: 40
2026-03-30 10:58:50 [auto1.de] INFO: Found listing with ID: GD86800
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD86800%27 HTTP/1.1" 200 None
2026-03-30 10:58:50 [auto1.de] INFO: Scrape type for GD86800: 2
2026-03-30 10:58:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d6a93c4-d3ce-5204-a4e4-c8c2fb650af5 with identifier: GD86800
2026-03-30 10:58:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d6a93c4-d3ce-5204-a4e4-c8c2fb650af5 with scrape type 2
2026-03-30 10:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d6a93c4-d3ce-5204-a4e4-c8c2fb650af5 with scrape type 2
2026-03-30 10:58:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d6a93c4-d3ce-5204-a4e4-c8c2fb650af5, identifier: GD86800
2026-03-30 10:58:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d6a93c4-d3ce-5204-a4e4-c8c2fb650af5 with identifier: GD86800
2026-03-30 10:58:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d6a93c4-d3ce-5204-a4e4-c8c2fb650af5 with identifier: GD86800
2026-03-30 10:58:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d6a93c4-d3ce-5204-a4e4-c8c2fb650af5 with identifier: GD86800 to the API
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:56:18Z',
 'fuel_type': 'petrol',
 'id': '8d6a93c4-d3ce-5204-a4e4-c8c2fb650af5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD86800',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 218118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-05',
 'seller_name': None,
 'title': 'Porsche Cayenne 3.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD86800%27 HTTP/1.1" 200 None
2026-03-30 10:58:51 [auto1.de] INFO: Saving data for GD86800: {'auction_closing_time': 1774886178.0, 'created_time': 1774465547.853721, 'last_price_update_time': 1774868331.362502}
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD86800') HTTP/1.1" 204 0
2026-03-30 10:58:51 [auto1.de] INFO: Found listing with ID: HP87515
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87515%27 HTTP/1.1" 200 None
2026-03-30 10:58:51 [auto1.de] INFO: Scrape type for HP87515: 2
2026-03-30 10:58:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 992ee0be-59e8-50bb-9541-d2ccd2376609 with identifier: HP87515
2026-03-30 10:58:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 992ee0be-59e8-50bb-9541-d2ccd2376609 with scrape type 2
2026-03-30 10:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 992ee0be-59e8-50bb-9541-d2ccd2376609 with scrape type 2
2026-03-30 10:58:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 992ee0be-59e8-50bb-9541-d2ccd2376609, identifier: HP87515
2026-03-30 10:58:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:58:51 [auto1.de] INFO: Found listing with ID: MT90206
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90206%27 HTTP/1.1" 200 None
2026-03-30 10:58:51 [auto1.de] INFO: Scrape type for MT90206: 2
2026-03-30 10:58:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7369f652-5f50-5b9b-8042-7b7451870f39 with identifier: MT90206
2026-03-30 10:58:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7369f652-5f50-5b9b-8042-7b7451870f39 with scrape type 2
2026-03-30 10:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7369f652-5f50-5b9b-8042-7b7451870f39 with scrape type 2
2026-03-30 10:58:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7369f652-5f50-5b9b-8042-7b7451870f39, identifier: MT90206
2026-03-30 10:58:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 992ee0be-59e8-50bb-9541-d2ccd2376609 with identifier: HP87515
2026-03-30 10:58:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 992ee0be-59e8-50bb-9541-d2ccd2376609 with identifier: HP87515
2026-03-30 10:58:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 992ee0be-59e8-50bb-9541-d2ccd2376609 with identifier: HP87515 to the API
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:05:30Z',
 'fuel_type': 'petrol',
 'id': '992ee0be-59e8-50bb-9541-d2ccd2376609',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP87515',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 111206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-30',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 Classic blue 2WD',
 'transmission': 'manual',
 'trim': 'Classic blue 2WD',
 'year': 2016}
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87515%27 HTTP/1.1" 200 None
2026-03-30 10:58:51 [auto1.de] INFO: Saving data for HP87515: {'auction_closing_time': 1774883130.0, 'created_time': 1773741513.543857, 'last_price_update_time': 1774868331.897034}
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP87515') HTTP/1.1" 204 0
2026-03-30 10:58:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7369f652-5f50-5b9b-8042-7b7451870f39 with identifier: MT90206
2026-03-30 10:58:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7369f652-5f50-5b9b-8042-7b7451870f39 with identifier: MT90206
2026-03-30 10:58:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7369f652-5f50-5b9b-8042-7b7451870f39 with identifier: MT90206 to the API
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 144,
 'expiration_date': '2026-03-30T15:01:17Z',
 'fuel_type': 'diesel',
 'id': '7369f652-5f50-5b9b-8042-7b7451870f39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT90206',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Scudo',
 'odometer': 55058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-07',
 'seller_name': None,
 'title': 'Fiat Scudo 2.0 M-Jet L2',
 'transmission': 'manual',
 'trim': 'L2',
 'year': 2023}
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90206%27 HTTP/1.1" 200 None
2026-03-30 10:58:52 [auto1.de] INFO: Saving data for MT90206: {'auction_closing_time': 1774882877.0, 'created_time': 1773137847.182756, 'last_price_update_time': 1774868332.200561}
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT90206') HTTP/1.1" 204 0
2026-03-30 10:58:52 [auto1.de] INFO: Found listing with ID: VE03726
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE03726%27 HTTP/1.1" 200 None
2026-03-30 10:58:52 [auto1.de] INFO: Scrape type for VE03726: 2
2026-03-30 10:58:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5592bb11-65bc-56d7-90ee-c425543032ae with identifier: VE03726
2026-03-30 10:58:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5592bb11-65bc-56d7-90ee-c425543032ae with scrape type 2
2026-03-30 10:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5592bb11-65bc-56d7-90ee-c425543032ae with scrape type 2
2026-03-30 10:58:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5592bb11-65bc-56d7-90ee-c425543032ae, identifier: VE03726
2026-03-30 10:58:52 [auto1.de] INFO: Found listing with ID: EH26353
2026-03-30 10:58:52 [auto1.de] INFO: Found listing with ID: TU83793
2026-03-30 10:58:52 [auto1.de] INFO: Found listing with ID: FL70928
2026-03-30 10:58:52 [auto1.de] INFO: Found listing with ID: PY62114
2026-03-30 10:58:52 [auto1.de] INFO: Found listing with ID: ZU61192
2026-03-30 10:58:52 [auto1.de] INFO: Found listing with ID: KS19016
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS19016%27 HTTP/1.1" 200 None
2026-03-30 10:58:52 [auto1.de] INFO: Scrape type for KS19016: 2
2026-03-30 10:58:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24daad38-f276-5436-b887-0fb6b6de25ed with identifier: KS19016
2026-03-30 10:58:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24daad38-f276-5436-b887-0fb6b6de25ed with scrape type 2
2026-03-30 10:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24daad38-f276-5436-b887-0fb6b6de25ed with scrape type 2
2026-03-30 10:58:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24daad38-f276-5436-b887-0fb6b6de25ed, identifier: KS19016
2026-03-30 10:58:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5592bb11-65bc-56d7-90ee-c425543032ae with identifier: VE03726
2026-03-30 10:58:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5592bb11-65bc-56d7-90ee-c425543032ae with identifier: VE03726
2026-03-30 10:58:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5592bb11-65bc-56d7-90ee-c425543032ae with identifier: VE03726 to the API
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:36:42Z',
 'fuel_type': 'petrol',
 'id': '5592bb11-65bc-56d7-90ee-c425543032ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE03726',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 19108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-05-25',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2025}
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE03726%27 HTTP/1.1" 200 None
2026-03-30 10:58:52 [auto1.de] INFO: Saving data for VE03726: {'auction_closing_time': 1774885002.0, 'created_time': 1773133077.958781, 'last_price_update_time': 1774868332.745674}
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE03726') HTTP/1.1" 204 0
2026-03-30 10:58:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24daad38-f276-5436-b887-0fb6b6de25ed with identifier: KS19016
2026-03-30 10:58:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24daad38-f276-5436-b887-0fb6b6de25ed with identifier: KS19016
2026-03-30 10:58:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24daad38-f276-5436-b887-0fb6b6de25ed with identifier: KS19016 to the API
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:59:20Z',
 'fuel_type': 'petrol',
 'id': '24daad38-f276-5436-b887-0fb6b6de25ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS19016',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 162562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-05',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Joy',
 'transmission': 'manual',
 'trim': 'Joy',
 'year': 2016}
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS19016%27 HTTP/1.1" 200 None
2026-03-30 10:58:53 [auto1.de] INFO: Saving data for KS19016: {'auction_closing_time': 1774886360.0, 'created_time': 1773830334.113158, 'last_price_update_time': 1774868333.228171}
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS19016') HTTP/1.1" 204 0
2026-03-30 10:58:53 [auto1.de] INFO: Found listing with ID: JC07133
2026-03-30 10:58:53 [auto1.de] INFO: Found listing with ID: NG98905
2026-03-30 10:58:53 [auto1.de] INFO: Found listing with ID: SJ83553
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ83553%27 HTTP/1.1" 200 None
2026-03-30 10:58:53 [auto1.de] INFO: Scrape type for SJ83553: 2
2026-03-30 10:58:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67ab7b47-8ac7-5cb5-804b-3de22d77c3df with identifier: SJ83553
2026-03-30 10:58:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67ab7b47-8ac7-5cb5-804b-3de22d77c3df with scrape type 2
2026-03-30 10:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67ab7b47-8ac7-5cb5-804b-3de22d77c3df with scrape type 2
2026-03-30 10:58:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67ab7b47-8ac7-5cb5-804b-3de22d77c3df, identifier: SJ83553
2026-03-30 10:58:53 [auto1.de] INFO: Found listing with ID: SH98568
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH98568%27 HTTP/1.1" 200 None
2026-03-30 10:58:53 [auto1.de] INFO: Scrape type for SH98568: 2
2026-03-30 10:58:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca7d78e5-36e3-5059-ae6c-902f911d7424 with identifier: SH98568
2026-03-30 10:58:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca7d78e5-36e3-5059-ae6c-902f911d7424 with scrape type 2
2026-03-30 10:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca7d78e5-36e3-5059-ae6c-902f911d7424 with scrape type 2
2026-03-30 10:58:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca7d78e5-36e3-5059-ae6c-902f911d7424, identifier: SH98568
2026-03-30 10:58:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67ab7b47-8ac7-5cb5-804b-3de22d77c3df with identifier: SJ83553
2026-03-30 10:58:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67ab7b47-8ac7-5cb5-804b-3de22d77c3df with identifier: SJ83553
2026-03-30 10:58:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67ab7b47-8ac7-5cb5-804b-3de22d77c3df with identifier: SJ83553 to the API
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:50:37Z',
 'fuel_type': 'petrol',
 'id': '67ab7b47-8ac7-5cb5-804b-3de22d77c3df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ83553',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 97718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-20',
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Vision',
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2019}
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ83553%27 HTTP/1.1" 200 None
2026-03-30 10:58:53 [auto1.de] INFO: Saving data for SJ83553: {'auction_closing_time': 1774885837.0, 'created_time': 1773226917.29037, 'last_price_update_time': 1774868333.838145}
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ83553') HTTP/1.1" 204 0
2026-03-30 10:58:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca7d78e5-36e3-5059-ae6c-902f911d7424 with identifier: SH98568
2026-03-30 10:58:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca7d78e5-36e3-5059-ae6c-902f911d7424 with identifier: SH98568
2026-03-30 10:58:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca7d78e5-36e3-5059-ae6c-902f911d7424 with identifier: SH98568 to the API
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 530,
 'expiration_date': '2026-03-30T15:03:19Z',
 'fuel_type': 'petrol',
 'id': 'ca7d78e5-36e3-5059-ae6c-902f911d7424',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH98568',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X7',
 'odometer': 104021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-13',
 'seller_name': None,
 'title': 'BMW X7 M50i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH98568%27 HTTP/1.1" 200 None
2026-03-30 10:58:54 [auto1.de] INFO: Saving data for SH98568: {'auction_closing_time': 1774882999.0, 'created_time': 1773398567.318759, 'last_price_update_time': 1774868334.139715}
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SH98568') HTTP/1.1" 204 0
2026-03-30 10:58:54 [auto1.de] INFO: Found listing with ID: VC98877
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC98877%27 HTTP/1.1" 200 None
2026-03-30 10:58:54 [auto1.de] INFO: Scrape type for VC98877: 2
2026-03-30 10:58:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31f4eef5-8e48-5cde-bb05-a1defc6334ac with identifier: VC98877
2026-03-30 10:58:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31f4eef5-8e48-5cde-bb05-a1defc6334ac with scrape type 2
2026-03-30 10:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31f4eef5-8e48-5cde-bb05-a1defc6334ac with scrape type 2
2026-03-30 10:58:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31f4eef5-8e48-5cde-bb05-a1defc6334ac, identifier: VC98877
2026-03-30 10:58:54 [auto1.de] INFO: Found listing with ID: UB19219
2026-03-30 10:58:54 [auto1.de] INFO: Found listing with ID: UT35325
2026-03-30 10:58:54 [auto1.de] INFO: Found listing with ID: FU56159
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU56159%27 HTTP/1.1" 200 None
2026-03-30 10:58:54 [auto1.de] INFO: Scrape type for FU56159: 0
2026-03-30 10:58:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31f4eef5-8e48-5cde-bb05-a1defc6334ac with identifier: VC98877
2026-03-30 10:58:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31f4eef5-8e48-5cde-bb05-a1defc6334ac with identifier: VC98877
2026-03-30 10:58:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31f4eef5-8e48-5cde-bb05-a1defc6334ac with identifier: VC98877 to the API
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 238,
 'expiration_date': '2026-03-30T15:58:29Z',
 'fuel_type': 'diesel',
 'id': '31f4eef5-8e48-5cde-bb05-a1defc6334ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC98877',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 62171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-28',
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi EcoBlue Vignale 4x4',
 'transmission': 'automatic',
 'trim': 'Vignale 4x4',
 'year': 2019}
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC98877%27 HTTP/1.1" 200 None
2026-03-30 10:58:54 [auto1.de] INFO: Saving data for VC98877: {'auction_closing_time': 1774886309.0, 'created_time': 1773304292.090149, 'last_price_update_time': 1774868334.61706}
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC98877') HTTP/1.1" 204 0
2026-03-30 10:58:54 [auto1.de] INFO: Found listing with ID: GL55365
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL55365%27 HTTP/1.1" 200 None
2026-03-30 10:58:54 [auto1.de] INFO: Scrape type for GL55365: 2
2026-03-30 10:58:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f813d7c8-36cf-5bc5-8929-a768a199bb5a with identifier: GL55365
2026-03-30 10:58:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f813d7c8-36cf-5bc5-8929-a768a199bb5a with scrape type 2
2026-03-30 10:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f813d7c8-36cf-5bc5-8929-a768a199bb5a with scrape type 2
2026-03-30 10:58:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f813d7c8-36cf-5bc5-8929-a768a199bb5a, identifier: GL55365
2026-03-30 10:58:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f813d7c8-36cf-5bc5-8929-a768a199bb5a with identifier: GL55365
2026-03-30 10:58:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f813d7c8-36cf-5bc5-8929-a768a199bb5a with identifier: GL55365
2026-03-30 10:58:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f813d7c8-36cf-5bc5-8929-a768a199bb5a with identifier: GL55365 to the API
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:07:16Z',
 'fuel_type': 'petrol',
 'id': 'f813d7c8-36cf-5bc5-8929-a768a199bb5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL55365',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'IS-Serie',
 'odometer': 160757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-05-30',
 'seller_name': None,
 'title': 'Lexus IS-Serie IS 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2001}
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL55365%27 HTTP/1.1" 200 None
2026-03-30 10:58:55 [auto1.de] INFO: Saving data for GL55365: {'auction_closing_time': 1774883236.0, 'created_time': 1773132564.471648, 'last_price_update_time': 1774868335.037956}
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL55365') HTTP/1.1" 204 0
2026-03-30 10:58:55 [auto1.de] INFO: Found listing with ID: JR52924
2026-03-30 10:58:55 [auto1.de] INFO: Found listing with ID: MU38011
2026-03-30 10:58:55 [auto1.de] INFO: Found listing with ID: GM39396
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM39396%27 HTTP/1.1" 200 None
2026-03-30 10:58:55 [auto1.de] INFO: Scrape type for GM39396: 2
2026-03-30 10:58:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dd81f71-c04e-52c0-a8de-8168391a9d77 with identifier: GM39396
2026-03-30 10:58:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dd81f71-c04e-52c0-a8de-8168391a9d77 with scrape type 2
2026-03-30 10:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dd81f71-c04e-52c0-a8de-8168391a9d77 with scrape type 2
2026-03-30 10:58:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2dd81f71-c04e-52c0-a8de-8168391a9d77, identifier: GM39396
2026-03-30 10:58:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2dd81f71-c04e-52c0-a8de-8168391a9d77 with identifier: GM39396
2026-03-30 10:58:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2dd81f71-c04e-52c0-a8de-8168391a9d77 with identifier: GM39396
2026-03-30 10:58:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2dd81f71-c04e-52c0-a8de-8168391a9d77 with identifier: GM39396 to the API
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:35:55Z',
 'fuel_type': 'diesel',
 'id': '2dd81f71-c04e-52c0-a8de-8168391a9d77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM39396',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Life',
 'odometer': 111781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-17',
 'seller_name': None,
 'title': 'Opel Zafira Life 2.0 CDTI L Tourer L3',
 'transmission': 'automatic',
 'trim': 'L Tourer L3',
 'year': 2020}
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM39396%27 HTTP/1.1" 200 None
2026-03-30 10:58:55 [auto1.de] INFO: Saving data for GM39396: {'auction_closing_time': 1774884955.0, 'created_time': 1773229481.64429, 'last_price_update_time': 1774868335.45577}
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM39396') HTTP/1.1" 204 0
2026-03-30 10:58:55 [auto1.de] INFO: Found listing with ID: KM60144
2026-03-30 10:58:55 [auto1.de] INFO: Found listing with ID: YU84960
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU84960%27 HTTP/1.1" 200 None
2026-03-30 10:58:55 [auto1.de] INFO: Scrape type for YU84960: 2
2026-03-30 10:58:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c85bd486-6eca-5f3d-bd48-344382cca67e with identifier: YU84960
2026-03-30 10:58:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c85bd486-6eca-5f3d-bd48-344382cca67e with scrape type 2
2026-03-30 10:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c85bd486-6eca-5f3d-bd48-344382cca67e with scrape type 2
2026-03-30 10:58:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c85bd486-6eca-5f3d-bd48-344382cca67e, identifier: YU84960
2026-03-30 10:58:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c85bd486-6eca-5f3d-bd48-344382cca67e with identifier: YU84960
2026-03-30 10:58:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c85bd486-6eca-5f3d-bd48-344382cca67e with identifier: YU84960
2026-03-30 10:58:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c85bd486-6eca-5f3d-bd48-344382cca67e with identifier: YU84960 to the API
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:50:06Z',
 'fuel_type': 'diesel',
 'id': 'c85bd486-6eca-5f3d-bd48-344382cca67e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU84960',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 121182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-26',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.5 dCi BOSE Edition',
 'transmission': 'automatic',
 'trim': 'BOSE Edition',
 'year': 2014}
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU84960%27 HTTP/1.1" 200 None
2026-03-30 10:58:55 [auto1.de] INFO: Saving data for YU84960: {'auction_closing_time': 1774885806.0, 'created_time': 1773307909.355575, 'last_price_update_time': 1774868335.945523}
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU84960') HTTP/1.1" 204 0
2026-03-30 10:58:55 [auto1.de] INFO: Found listing with ID: KP76789
2026-03-30 10:58:55 [auto1.de] INFO: Found listing with ID: WJ57335
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ57335%27 HTTP/1.1" 200 None
2026-03-30 10:58:55 [auto1.de] INFO: Scrape type for WJ57335: 2
2026-03-30 10:58:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b933d39-d6dd-5350-8cb3-2ab68ec55a36 with identifier: WJ57335
2026-03-30 10:58:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b933d39-d6dd-5350-8cb3-2ab68ec55a36 with scrape type 2
2026-03-30 10:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b933d39-d6dd-5350-8cb3-2ab68ec55a36 with scrape type 2
2026-03-30 10:58:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b933d39-d6dd-5350-8cb3-2ab68ec55a36, identifier: WJ57335
2026-03-30 10:58:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b933d39-d6dd-5350-8cb3-2ab68ec55a36 with identifier: WJ57335
2026-03-30 10:58:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b933d39-d6dd-5350-8cb3-2ab68ec55a36 with identifier: WJ57335
2026-03-30 10:58:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b933d39-d6dd-5350-8cb3-2ab68ec55a36 with identifier: WJ57335 to the API
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:01Z',
 'fuel_type': 'diesel',
 'id': '1b933d39-d6dd-5350-8cb3-2ab68ec55a36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ57335',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 231046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-05',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2017}
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ57335%27 HTTP/1.1" 200 None
2026-03-30 10:58:56 [auto1.de] INFO: Saving data for WJ57335: {'auction_closing_time': 1774884001.0, 'created_time': 1772543141.804452, 'last_price_update_time': 1774868336.353055}
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ57335') HTTP/1.1" 204 0
2026-03-30 10:58:56 [auto1.de] INFO: Found listing with ID: KM84276
2026-03-30 10:58:56 [auto1.de] INFO: Found listing with ID: HK49782
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK49782%27 HTTP/1.1" 200 None
2026-03-30 10:58:56 [auto1.de] INFO: Scrape type for HK49782: 2
2026-03-30 10:58:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 842f715b-c653-56d6-b615-cb453eac5fdd with identifier: HK49782
2026-03-30 10:58:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 842f715b-c653-56d6-b615-cb453eac5fdd with scrape type 2
2026-03-30 10:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 842f715b-c653-56d6-b615-cb453eac5fdd with scrape type 2
2026-03-30 10:58:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 842f715b-c653-56d6-b615-cb453eac5fdd, identifier: HK49782
2026-03-30 10:58:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 842f715b-c653-56d6-b615-cb453eac5fdd with identifier: HK49782
2026-03-30 10:58:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 842f715b-c653-56d6-b615-cb453eac5fdd with identifier: HK49782
2026-03-30 10:58:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 842f715b-c653-56d6-b615-cb453eac5fdd with identifier: HK49782 to the API
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:27:58Z',
 'fuel_type': 'petrol',
 'id': '842f715b-c653-56d6-b615-cb453eac5fdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK49782',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 74160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-12',
 'seller_name': None,
 'title': 'BMW 5er 525i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK49782%27 HTTP/1.1" 200 None
2026-03-30 10:58:56 [auto1.de] INFO: Saving data for HK49782: {'auction_closing_time': 1774884478.0, 'created_time': 1773344080.428709, 'last_price_update_time': 1774868336.748451}
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK49782') HTTP/1.1" 204 0
2026-03-30 10:58:56 [auto1.de] INFO: Found listing with ID: JT65336
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT65336%27 HTTP/1.1" 200 None
2026-03-30 10:58:56 [auto1.de] INFO: Scrape type for JT65336: 2
2026-03-30 10:58:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60a2ee00-9b33-5bee-9ed6-63b6175bf234 with identifier: JT65336
2026-03-30 10:58:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60a2ee00-9b33-5bee-9ed6-63b6175bf234 with scrape type 2
2026-03-30 10:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60a2ee00-9b33-5bee-9ed6-63b6175bf234 with scrape type 2
2026-03-30 10:58:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60a2ee00-9b33-5bee-9ed6-63b6175bf234, identifier: JT65336
2026-03-30 10:58:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60a2ee00-9b33-5bee-9ed6-63b6175bf234 with identifier: JT65336
2026-03-30 10:58:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60a2ee00-9b33-5bee-9ed6-63b6175bf234 with identifier: JT65336
2026-03-30 10:58:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60a2ee00-9b33-5bee-9ed6-63b6175bf234 with identifier: JT65336 to the API
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:02:39Z',
 'fuel_type': 'diesel',
 'id': '60a2ee00-9b33-5bee-9ed6-63b6175bf234',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT65336',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 180706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-21',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI United BlueMotion',
 'transmission': 'manual',
 'trim': 'United BlueMotion',
 'year': 2009}
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT65336%27 HTTP/1.1" 200 None
2026-03-30 10:58:57 [auto1.de] INFO: Saving data for JT65336: {'auction_closing_time': 1774882959.0, 'created_time': 1773741502.894159, 'last_price_update_time': 1774868337.20497}
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT65336') HTTP/1.1" 204 0
2026-03-30 10:58:57 [auto1.de] INFO: Found listing with ID: UM76387
2026-03-30 10:58:57 [auto1.de] INFO: Found listing with ID: BR88683
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR88683%27 HTTP/1.1" 200 None
2026-03-30 10:58:57 [auto1.de] INFO: Scrape type for BR88683: 2
2026-03-30 10:58:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1dcd530-2946-50bf-af58-3f14db6b599d with identifier: BR88683
2026-03-30 10:58:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1dcd530-2946-50bf-af58-3f14db6b599d with scrape type 2
2026-03-30 10:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1dcd530-2946-50bf-af58-3f14db6b599d with scrape type 2
2026-03-30 10:58:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1dcd530-2946-50bf-af58-3f14db6b599d, identifier: BR88683
2026-03-30 10:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:58:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1dcd530-2946-50bf-af58-3f14db6b599d with identifier: BR88683
2026-03-30 10:58:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1dcd530-2946-50bf-af58-3f14db6b599d with identifier: BR88683
2026-03-30 10:58:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1dcd530-2946-50bf-af58-3f14db6b599d with identifier: BR88683 to the API
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 349,
 'expiration_date': '2026-03-30T15:10:41Z',
 'fuel_type': 'diesel',
 'id': 'f1dcd530-2946-50bf-af58-3f14db6b599d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR88683',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 125090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-23',
 'seller_name': None,
 'title': 'Audi A6 Allroad 55 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR88683%27 HTTP/1.1" 200 None
2026-03-30 10:58:57 [auto1.de] INFO: Saving data for BR88683: {'auction_closing_time': 1774883441.0, 'created_time': 1773226292.049471, 'last_price_update_time': 1774868337.656571}
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR88683') HTTP/1.1" 204 0
2026-03-30 10:58:57 [auto1.de] INFO: Found listing with ID: PY66131
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY66131%27 HTTP/1.1" 200 None
2026-03-30 10:58:57 [auto1.de] INFO: Scrape type for PY66131: 2
2026-03-30 10:58:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cceb328-bdf5-5998-9122-703414400433 with identifier: PY66131
2026-03-30 10:58:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cceb328-bdf5-5998-9122-703414400433 with scrape type 2
2026-03-30 10:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cceb328-bdf5-5998-9122-703414400433 with scrape type 2
2026-03-30 10:58:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3cceb328-bdf5-5998-9122-703414400433, identifier: PY66131
2026-03-30 10:58:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3cceb328-bdf5-5998-9122-703414400433 with identifier: PY66131
2026-03-30 10:58:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3cceb328-bdf5-5998-9122-703414400433 with identifier: PY66131
2026-03-30 10:58:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3cceb328-bdf5-5998-9122-703414400433 with identifier: PY66131 to the API
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:01:16Z',
 'fuel_type': 'petrol',
 'id': '3cceb328-bdf5-5998-9122-703414400433',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY66131',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 162837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-19',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2013}
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY66131%27 HTTP/1.1" 200 None
2026-03-30 10:58:58 [auto1.de] INFO: Saving data for PY66131: {'auction_closing_time': 1774882876.0, 'created_time': 1773303026.616629, 'last_price_update_time': 1774868338.140747}
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY66131') HTTP/1.1" 204 0
2026-03-30 10:58:58 [auto1.de] INFO: Found listing with ID: AL04579
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL04579%27 HTTP/1.1" 200 None
2026-03-30 10:58:58 [auto1.de] INFO: Scrape type for AL04579: 2
2026-03-30 10:58:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abbbd8bb-1578-5c93-b4c3-af4a27a0a03c with identifier: AL04579
2026-03-30 10:58:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abbbd8bb-1578-5c93-b4c3-af4a27a0a03c with scrape type 2
2026-03-30 10:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abbbd8bb-1578-5c93-b4c3-af4a27a0a03c with scrape type 2
2026-03-30 10:58:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abbbd8bb-1578-5c93-b4c3-af4a27a0a03c, identifier: AL04579
2026-03-30 10:58:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abbbd8bb-1578-5c93-b4c3-af4a27a0a03c with identifier: AL04579
2026-03-30 10:58:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abbbd8bb-1578-5c93-b4c3-af4a27a0a03c with identifier: AL04579
2026-03-30 10:58:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abbbd8bb-1578-5c93-b4c3-af4a27a0a03c with identifier: AL04579 to the API
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:20:21Z',
 'fuel_type': 'diesel',
 'id': 'abbbd8bb-1578-5c93-b4c3-af4a27a0a03c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL04579',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 147428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-16',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2017}
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL04579%27 HTTP/1.1" 200 None
2026-03-30 10:58:58 [auto1.de] INFO: Saving data for AL04579: {'auction_closing_time': 1774884021.0, 'created_time': 1773304581.267532, 'last_price_update_time': 1774868338.571454}
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL04579') HTTP/1.1" 204 0
2026-03-30 10:58:58 [auto1.de] INFO: Channel: 24h | Page: 83 | totalHits: 9548 | hits on page: 40
2026-03-30 10:58:58 [auto1.de] INFO: Found listing with ID: WX96485
2026-03-30 10:58:58 [auto1.de] INFO: Found listing with ID: NH10753
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH10753%27 HTTP/1.1" 200 None
2026-03-30 10:58:58 [auto1.de] INFO: Scrape type for NH10753: 2
2026-03-30 10:58:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be with identifier: NH10753
2026-03-30 10:58:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be with scrape type 2
2026-03-30 10:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be with scrape type 2
2026-03-30 10:58:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be, identifier: NH10753
2026-03-30 10:58:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be with identifier: NH10753
2026-03-30 10:58:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be with identifier: NH10753
2026-03-30 10:58:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be with identifier: NH10753 to the API
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:12:05Z',
 'fuel_type': 'diesel',
 'id': 'dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH10753',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 173501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-07',
 'seller_name': None,
 'title': 'Audi A6 50 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH10753%27 HTTP/1.1" 200 None
2026-03-30 10:58:59 [auto1.de] INFO: Saving data for NH10753: {'auction_closing_time': 1774883525.0, 'created_time': 1774780551.837278, 'last_price_update_time': 1774868339.12017}
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH10753') HTTP/1.1" 204 0
2026-03-30 10:58:59 [auto1.de] INFO: Found listing with ID: JE28257
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE28257%27 HTTP/1.1" 200 None
2026-03-30 10:58:59 [auto1.de] INFO: Scrape type for JE28257: 2
2026-03-30 10:58:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4063b49-853d-5a20-acfa-de130931ca1c with identifier: JE28257
2026-03-30 10:58:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4063b49-853d-5a20-acfa-de130931ca1c with scrape type 2
2026-03-30 10:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4063b49-853d-5a20-acfa-de130931ca1c with scrape type 2
2026-03-30 10:58:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4063b49-853d-5a20-acfa-de130931ca1c, identifier: JE28257
2026-03-30 10:58:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:58:59 [auto1.de] INFO: Found listing with ID: CA14151
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA14151%27 HTTP/1.1" 200 None
2026-03-30 10:58:59 [auto1.de] INFO: Scrape type for CA14151: 2
2026-03-30 10:58:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60936903-5396-5d54-a62c-b4abe434b4dd with identifier: CA14151
2026-03-30 10:58:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60936903-5396-5d54-a62c-b4abe434b4dd with scrape type 2
2026-03-30 10:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60936903-5396-5d54-a62c-b4abe434b4dd with scrape type 2
2026-03-30 10:58:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60936903-5396-5d54-a62c-b4abe434b4dd, identifier: CA14151
2026-03-30 10:58:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4063b49-853d-5a20-acfa-de130931ca1c with identifier: JE28257
2026-03-30 10:58:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4063b49-853d-5a20-acfa-de130931ca1c with identifier: JE28257
2026-03-30 10:58:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4063b49-853d-5a20-acfa-de130931ca1c with identifier: JE28257 to the API
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:20:31Z',
 'fuel_type': 'petrol',
 'id': 'a4063b49-853d-5a20-acfa-de130931ca1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE28257',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 104145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.0 eTSI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2021}
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE28257%27 HTTP/1.1" 200 None
2026-03-30 10:58:59 [auto1.de] INFO: Saving data for JE28257: {'auction_closing_time': 1774884031.0, 'created_time': 1774466697.433898, 'last_price_update_time': 1774868339.638721}
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE28257') HTTP/1.1" 204 0
2026-03-30 10:58:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60936903-5396-5d54-a62c-b4abe434b4dd with identifier: CA14151
2026-03-30 10:58:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60936903-5396-5d54-a62c-b4abe434b4dd with identifier: CA14151
2026-03-30 10:58:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60936903-5396-5d54-a62c-b4abe434b4dd with identifier: CA14151 to the API
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:36:24Z',
 'fuel_type': 'petrol',
 'id': '60936903-5396-5d54-a62c-b4abe434b4dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA14151',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 31590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-16',
 'seller_name': None,
 'title': 'Seat Arona 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2021}
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA14151%27 HTTP/1.1" 200 None
2026-03-30 10:58:59 [auto1.de] INFO: Saving data for CA14151: {'auction_closing_time': 1774884984.0, 'created_time': 1773304595.022845, 'last_price_update_time': 1774868339.947322}
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA14151') HTTP/1.1" 204 0
2026-03-30 10:58:59 [auto1.de] INFO: Found listing with ID: TK71200
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK71200%27 HTTP/1.1" 200 None
2026-03-30 10:58:59 [auto1.de] INFO: Scrape type for TK71200: 2
2026-03-30 10:58:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdb78a93-930f-5462-9818-2f31aab4cbe5 with identifier: TK71200
2026-03-30 10:58:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdb78a93-930f-5462-9818-2f31aab4cbe5 with scrape type 2
2026-03-30 10:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdb78a93-930f-5462-9818-2f31aab4cbe5 with scrape type 2
2026-03-30 10:59:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdb78a93-930f-5462-9818-2f31aab4cbe5, identifier: TK71200
2026-03-30 10:59:00 [auto1.de] INFO: Found listing with ID: BY37084
2026-03-30 10:59:00 [auto1.de] INFO: Found listing with ID: EF04397
2026-03-30 10:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF04397%27 HTTP/1.1" 200 None
2026-03-30 10:59:00 [auto1.de] INFO: Scrape type for EF04397: 2
2026-03-30 10:59:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8a2653b-9fd2-5570-8c74-56076c8f2c3e with identifier: EF04397
2026-03-30 10:59:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8a2653b-9fd2-5570-8c74-56076c8f2c3e with scrape type 2
2026-03-30 10:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8a2653b-9fd2-5570-8c74-56076c8f2c3e with scrape type 2
2026-03-30 10:59:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8a2653b-9fd2-5570-8c74-56076c8f2c3e, identifier: EF04397
2026-03-30 10:59:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdb78a93-930f-5462-9818-2f31aab4cbe5 with identifier: TK71200
2026-03-30 10:59:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdb78a93-930f-5462-9818-2f31aab4cbe5 with identifier: TK71200
2026-03-30 10:59:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdb78a93-930f-5462-9818-2f31aab4cbe5 with identifier: TK71200 to the API
2026-03-30 10:59:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:11:07Z',
 'fuel_type': 'diesel',
 'id': 'cdb78a93-930f-5462-9818-2f31aab4cbe5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK71200',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 97654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-28',
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 CRDi Mild-Hybrid Premium 4WD',
 'transmission': 'automatic',
 'trim': 'Premium 4WD',
 'year': 2020}
2026-03-30 10:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK71200%27 HTTP/1.1" 200 None
2026-03-30 10:59:00 [auto1.de] INFO: Saving data for TK71200: {'auction_closing_time': 1774883467.0, 'created_time': 1773226578.090019, 'last_price_update_time': 1774868340.917132}
2026-03-30 10:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK71200') HTTP/1.1" 204 0
2026-03-30 10:59:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8a2653b-9fd2-5570-8c74-56076c8f2c3e with identifier: EF04397
2026-03-30 10:59:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8a2653b-9fd2-5570-8c74-56076c8f2c3e with identifier: EF04397
2026-03-30 10:59:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8a2653b-9fd2-5570-8c74-56076c8f2c3e with identifier: EF04397 to the API
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:56:05Z',
 'fuel_type': 'diesel',
 'id': 'd8a2653b-9fd2-5570-8c74-56076c8f2c3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF04397',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Verso',
 'odometer': 172007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-25',
 'seller_name': None,
 'title': 'Toyota Verso 1.6 D-4D Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2014}
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF04397%27 HTTP/1.1" 200 None
2026-03-30 10:59:01 [auto1.de] INFO: Saving data for EF04397: {'auction_closing_time': 1774886165.0, 'created_time': 1773344852.300675, 'last_price_update_time': 1774868341.213051}
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF04397') HTTP/1.1" 204 0
2026-03-30 10:59:01 [auto1.de] INFO: Found listing with ID: EZ46252
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ46252%27 HTTP/1.1" 200 None
2026-03-30 10:59:01 [auto1.de] INFO: Scrape type for EZ46252: 2
2026-03-30 10:59:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db1a6439-9dd5-5cef-b656-881472626fae with identifier: EZ46252
2026-03-30 10:59:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db1a6439-9dd5-5cef-b656-881472626fae with scrape type 2
2026-03-30 10:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db1a6439-9dd5-5cef-b656-881472626fae with scrape type 2
2026-03-30 10:59:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db1a6439-9dd5-5cef-b656-881472626fae, identifier: EZ46252
2026-03-30 10:59:01 [auto1.de] INFO: Found listing with ID: UA30528
2026-03-30 10:59:01 [auto1.de] INFO: Found listing with ID: PP86111
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP86111%27 HTTP/1.1" 200 None
2026-03-30 10:59:01 [auto1.de] INFO: Scrape type for PP86111: 2
2026-03-30 10:59:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ab55785-6495-55aa-bde6-fe91eb74615e with identifier: PP86111
2026-03-30 10:59:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ab55785-6495-55aa-bde6-fe91eb74615e with scrape type 2
2026-03-30 10:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ab55785-6495-55aa-bde6-fe91eb74615e with scrape type 2
2026-03-30 10:59:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ab55785-6495-55aa-bde6-fe91eb74615e, identifier: PP86111
2026-03-30 10:59:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db1a6439-9dd5-5cef-b656-881472626fae with identifier: EZ46252
2026-03-30 10:59:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db1a6439-9dd5-5cef-b656-881472626fae with identifier: EZ46252
2026-03-30 10:59:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db1a6439-9dd5-5cef-b656-881472626fae with identifier: EZ46252 to the API
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:36:57Z',
 'fuel_type': 'diesel',
 'id': 'db1a6439-9dd5-5cef-b656-881472626fae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ46252',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce Verso',
 'odometer': 150456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-19',
 'seller_name': None,
 'title': 'Toyota ProAce Verso 2.0 D-4D L1 Executive',
 'transmission': 'automatic',
 'trim': 'L1 Executive',
 'year': 2017}
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ46252%27 HTTP/1.1" 200 None
2026-03-30 10:59:01 [auto1.de] INFO: Saving data for EZ46252: {'auction_closing_time': 1774885017.0, 'created_time': 1773227402.069294, 'last_price_update_time': 1774868341.753525}
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ46252') HTTP/1.1" 204 0
2026-03-30 10:59:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ab55785-6495-55aa-bde6-fe91eb74615e with identifier: PP86111
2026-03-30 10:59:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ab55785-6495-55aa-bde6-fe91eb74615e with identifier: PP86111
2026-03-30 10:59:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ab55785-6495-55aa-bde6-fe91eb74615e with identifier: PP86111 to the API
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 341,
 'expiration_date': '2026-03-30T15:28:23Z',
 'fuel_type': 'diesel',
 'id': '9ab55785-6495-55aa-bde6-fe91eb74615e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP86111',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S5',
 'odometer': 37959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-16',
 'seller_name': None,
 'title': 'Audi S5 3.0 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2022}
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP86111%27 HTTP/1.1" 200 None
2026-03-30 10:59:02 [auto1.de] INFO: Saving data for PP86111: {'auction_closing_time': 1774884503.0, 'created_time': 1774378044.095621, 'last_price_update_time': 1774868342.053609}
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP86111') HTTP/1.1" 204 0
2026-03-30 10:59:02 [auto1.de] INFO: Found listing with ID: AK88220
2026-03-30 10:59:02 [auto1.de] INFO: Found listing with ID: DN40523
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN40523%27 HTTP/1.1" 200 None
2026-03-30 10:59:02 [auto1.de] INFO: Scrape type for DN40523: 2
2026-03-30 10:59:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70fe76a0-a763-5b4a-9037-497d77e5508e with identifier: DN40523
2026-03-30 10:59:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70fe76a0-a763-5b4a-9037-497d77e5508e with scrape type 2
2026-03-30 10:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70fe76a0-a763-5b4a-9037-497d77e5508e with scrape type 2
2026-03-30 10:59:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70fe76a0-a763-5b4a-9037-497d77e5508e, identifier: DN40523
2026-03-30 10:59:02 [auto1.de] INFO: Found listing with ID: GC63965
2026-03-30 10:59:02 [auto1.de] INFO: Found listing with ID: AF40281
2026-03-30 10:59:02 [auto1.de] INFO: Found listing with ID: AU99703
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU99703%27 HTTP/1.1" 200 None
2026-03-30 10:59:02 [auto1.de] INFO: Scrape type for AU99703: 2
2026-03-30 10:59:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1236c9c-5744-5503-bb3b-74015f186529 with identifier: AU99703
2026-03-30 10:59:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1236c9c-5744-5503-bb3b-74015f186529 with scrape type 2
2026-03-30 10:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1236c9c-5744-5503-bb3b-74015f186529 with scrape type 2
2026-03-30 10:59:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1236c9c-5744-5503-bb3b-74015f186529, identifier: AU99703
2026-03-30 10:59:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70fe76a0-a763-5b4a-9037-497d77e5508e with identifier: DN40523
2026-03-30 10:59:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70fe76a0-a763-5b4a-9037-497d77e5508e with identifier: DN40523
2026-03-30 10:59:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70fe76a0-a763-5b4a-9037-497d77e5508e with identifier: DN40523 to the API
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:39:30Z',
 'fuel_type': 'petrol',
 'id': '70fe76a0-a763-5b4a-9037-497d77e5508e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN40523',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 38827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-25',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2019}
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN40523%27 HTTP/1.1" 200 None
2026-03-30 10:59:02 [auto1.de] INFO: Saving data for DN40523: {'auction_closing_time': 1774885170.0, 'created_time': 1773229029.88382, 'last_price_update_time': 1774868342.566062}
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN40523') HTTP/1.1" 204 0
2026-03-30 10:59:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1236c9c-5744-5503-bb3b-74015f186529 with identifier: AU99703
2026-03-30 10:59:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1236c9c-5744-5503-bb3b-74015f186529 with identifier: AU99703
2026-03-30 10:59:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1236c9c-5744-5503-bb3b-74015f186529 with identifier: AU99703 to the API
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:06Z',
 'fuel_type': 'diesel',
 'id': 'b1236c9c-5744-5503-bb3b-74015f186529',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU99703',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 202455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-29',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU99703%27 HTTP/1.1" 200 None
2026-03-30 10:59:02 [auto1.de] INFO: Saving data for AU99703: {'auction_closing_time': 1774885626.0, 'created_time': 1774031831.509064, 'last_price_update_time': 1774868342.956232}
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU99703') HTTP/1.1" 204 0
2026-03-30 10:59:02 [auto1.de] INFO: Found listing with ID: XJ45397
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ45397%27 HTTP/1.1" 200 None
2026-03-30 10:59:02 [auto1.de] INFO: Scrape type for XJ45397: 2
2026-03-30 10:59:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 178fb53f-3b70-5e02-8390-b3f1b535883b with identifier: XJ45397
2026-03-30 10:59:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 178fb53f-3b70-5e02-8390-b3f1b535883b with scrape type 2
2026-03-30 10:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 178fb53f-3b70-5e02-8390-b3f1b535883b with scrape type 2
2026-03-30 10:59:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 178fb53f-3b70-5e02-8390-b3f1b535883b, identifier: XJ45397
2026-03-30 10:59:03 [auto1.de] INFO: Found listing with ID: UJ07162
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ07162%27 HTTP/1.1" 200 None
2026-03-30 10:59:03 [auto1.de] INFO: Scrape type for UJ07162: 2
2026-03-30 10:59:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c1ac5af-4b92-53f4-a51c-9afa8ad2af85 with identifier: UJ07162
2026-03-30 10:59:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c1ac5af-4b92-53f4-a51c-9afa8ad2af85 with scrape type 2
2026-03-30 10:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c1ac5af-4b92-53f4-a51c-9afa8ad2af85 with scrape type 2
2026-03-30 10:59:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c1ac5af-4b92-53f4-a51c-9afa8ad2af85, identifier: UJ07162
2026-03-30 10:59:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 178fb53f-3b70-5e02-8390-b3f1b535883b with identifier: XJ45397
2026-03-30 10:59:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 178fb53f-3b70-5e02-8390-b3f1b535883b with identifier: XJ45397
2026-03-30 10:59:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 178fb53f-3b70-5e02-8390-b3f1b535883b with identifier: XJ45397 to the API
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:58:10Z',
 'fuel_type': 'petrol',
 'id': '178fb53f-3b70-5e02-8390-b3f1b535883b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ45397',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 161198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-23',
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2013}
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ45397%27 HTTP/1.1" 200 None
2026-03-30 10:59:03 [auto1.de] INFO: Saving data for XJ45397: {'auction_closing_time': 1774886290.0, 'created_time': 1773228044.054939, 'last_price_update_time': 1774868343.458885}
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ45397') HTTP/1.1" 204 0
2026-03-30 10:59:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c1ac5af-4b92-53f4-a51c-9afa8ad2af85 with identifier: UJ07162
2026-03-30 10:59:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c1ac5af-4b92-53f4-a51c-9afa8ad2af85 with identifier: UJ07162
2026-03-30 10:59:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c1ac5af-4b92-53f4-a51c-9afa8ad2af85 with identifier: UJ07162 to the API
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-30T15:58:02Z',
 'fuel_type': 'petrol',
 'id': '4c1ac5af-4b92-53f4-a51c-9afa8ad2af85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ07162',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 69109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-27',
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2020}
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ07162%27 HTTP/1.1" 200 None
2026-03-30 10:59:03 [auto1.de] INFO: Saving data for UJ07162: {'auction_closing_time': 1774886282.0, 'created_time': 1773342702.751157, 'last_price_update_time': 1774868343.866818}
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ07162') HTTP/1.1" 204 0
2026-03-30 10:59:03 [auto1.de] INFO: Found listing with ID: UP49415
2026-03-30 10:59:03 [auto1.de] INFO: Found listing with ID: TZ55203
2026-03-30 10:59:03 [auto1.de] INFO: Found listing with ID: XW83383
2026-03-30 10:59:03 [auto1.de] INFO: Found listing with ID: NR32079
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR32079%27 HTTP/1.1" 200 None
2026-03-30 10:59:03 [auto1.de] INFO: Scrape type for NR32079: 2
2026-03-30 10:59:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32d8a16f-569c-52f2-be1a-2cfe68c14d46 with identifier: NR32079
2026-03-30 10:59:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32d8a16f-569c-52f2-be1a-2cfe68c14d46 with scrape type 2
2026-03-30 10:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32d8a16f-569c-52f2-be1a-2cfe68c14d46 with scrape type 2
2026-03-30 10:59:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32d8a16f-569c-52f2-be1a-2cfe68c14d46, identifier: NR32079
2026-03-30 10:59:04 [auto1.de] INFO: Found listing with ID: YV92261
2026-03-30 10:59:04 [auto1.de] INFO: Found listing with ID: YG24433
2026-03-30 10:59:04 [auto1.de] INFO: Found listing with ID: RK19274
2026-03-30 10:59:04 [auto1.de] INFO: Found listing with ID: XP45109
2026-03-30 10:59:04 [auto1.de] INFO: Found listing with ID: UB06797
2026-03-30 10:59:04 [auto1.de] INFO: Found listing with ID: HL50945
2026-03-30 10:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL50945%27 HTTP/1.1" 200 None
2026-03-30 10:59:04 [auto1.de] INFO: Scrape type for HL50945: 2
2026-03-30 10:59:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c723fe53-500c-574f-ac8c-0e53210181df with identifier: HL50945
2026-03-30 10:59:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c723fe53-500c-574f-ac8c-0e53210181df with scrape type 2
2026-03-30 10:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c723fe53-500c-574f-ac8c-0e53210181df with scrape type 2
2026-03-30 10:59:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c723fe53-500c-574f-ac8c-0e53210181df, identifier: HL50945
2026-03-30 10:59:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32d8a16f-569c-52f2-be1a-2cfe68c14d46 with identifier: NR32079
2026-03-30 10:59:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32d8a16f-569c-52f2-be1a-2cfe68c14d46 with identifier: NR32079
2026-03-30 10:59:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32d8a16f-569c-52f2-be1a-2cfe68c14d46 with identifier: NR32079 to the API
2026-03-30 10:59:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:55:40Z',
 'fuel_type': 'petrol',
 'id': '32d8a16f-569c-52f2-be1a-2cfe68c14d46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR32079',
 'listing': 'auction',
 'make': 'Infiniti',
 'model': 'Q30',
 'odometer': 61135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-22',
 'seller_name': None,
 'title': 'Infiniti Q30 2.0 Turbo Sport AWD',
 'transmission': 'automatic',
 'trim': 'Sport AWD',
 'year': 2017}
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR32079%27 HTTP/1.1" 200 None
2026-03-30 10:59:05 [auto1.de] INFO: Saving data for NR32079: {'auction_closing_time': 1774886140.0, 'created_time': 1774550506.409733, 'last_price_update_time': 1774868345.409709}
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR32079') HTTP/1.1" 204 0
2026-03-30 10:59:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c723fe53-500c-574f-ac8c-0e53210181df with identifier: HL50945
2026-03-30 10:59:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c723fe53-500c-574f-ac8c-0e53210181df with identifier: HL50945
2026-03-30 10:59:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c723fe53-500c-574f-ac8c-0e53210181df with identifier: HL50945 to the API
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:33:54Z',
 'fuel_type': 'diesel',
 'id': 'c723fe53-500c-574f-ac8c-0e53210181df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL50945',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 250565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-12',
 'seller_name': None,
 'title': 'Seat Leon 1.9 TDI Comfort Limited',
 'transmission': 'manual',
 'trim': 'Comfort Limited',
 'year': 2007}
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL50945%27 HTTP/1.1" 200 None
2026-03-30 10:59:05 [auto1.de] INFO: Saving data for HL50945: {'auction_closing_time': 1774884834.0, 'created_time': 1773741559.388115, 'last_price_update_time': 1774868345.804689}
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL50945') HTTP/1.1" 204 0
2026-03-30 10:59:05 [auto1.de] INFO: Found listing with ID: ST09245
2026-03-30 10:59:05 [auto1.de] INFO: Found listing with ID: DN59974
2026-03-30 10:59:05 [auto1.de] INFO: Found listing with ID: TM91896
2026-03-30 10:59:05 [auto1.de] INFO: Found listing with ID: TH47484
2026-03-30 10:59:05 [auto1.de] INFO: Found listing with ID: PD79431
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD79431%27 HTTP/1.1" 200 None
2026-03-30 10:59:05 [auto1.de] INFO: Scrape type for PD79431: 2
2026-03-30 10:59:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 129768fb-0d4c-5772-8e69-f8a39615cf4d with identifier: PD79431
2026-03-30 10:59:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 129768fb-0d4c-5772-8e69-f8a39615cf4d with scrape type 2
2026-03-30 10:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 129768fb-0d4c-5772-8e69-f8a39615cf4d with scrape type 2
2026-03-30 10:59:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 129768fb-0d4c-5772-8e69-f8a39615cf4d, identifier: PD79431
2026-03-30 10:59:05 [scrapy.extensions.logstats] INFO: Crawled 829 pages (at 7 pages/min), scraped 1316 items (at 128 items/min)
2026-03-30 10:59:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 10:59:05 [auto1.de] INFO: Found listing with ID: BM44177
2026-03-30 10:59:05 [auto1.de] INFO: Found listing with ID: JE28257
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE28257%27 HTTP/1.1" 200 None
2026-03-30 10:59:05 [auto1.de] INFO: Scrape type for JE28257: 0
2026-03-30 10:59:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 129768fb-0d4c-5772-8e69-f8a39615cf4d with identifier: PD79431
2026-03-30 10:59:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 129768fb-0d4c-5772-8e69-f8a39615cf4d with identifier: PD79431
2026-03-30 10:59:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 129768fb-0d4c-5772-8e69-f8a39615cf4d with identifier: PD79431 to the API
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:24:36Z',
 'fuel_type': 'diesel',
 'id': '129768fb-0d4c-5772-8e69-f8a39615cf4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD79431',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 304967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-01',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2013}
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD79431%27 HTTP/1.1" 200 None
2026-03-30 10:59:06 [auto1.de] INFO: Saving data for PD79431: {'auction_closing_time': 1774884276.0, 'created_time': 1773136852.979523, 'last_price_update_time': 1774868346.225291}
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD79431') HTTP/1.1" 204 0
2026-03-30 10:59:06 [auto1.de] INFO: Found listing with ID: GZ01520
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ01520%27 HTTP/1.1" 200 None
2026-03-30 10:59:06 [auto1.de] INFO: Scrape type for GZ01520: 2
2026-03-30 10:59:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41ec7453-e521-5e7c-b712-f7112f9dcb91 with identifier: GZ01520
2026-03-30 10:59:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41ec7453-e521-5e7c-b712-f7112f9dcb91 with scrape type 2
2026-03-30 10:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41ec7453-e521-5e7c-b712-f7112f9dcb91 with scrape type 2
2026-03-30 10:59:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41ec7453-e521-5e7c-b712-f7112f9dcb91, identifier: GZ01520
2026-03-30 10:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41ec7453-e521-5e7c-b712-f7112f9dcb91 with identifier: GZ01520
2026-03-30 10:59:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41ec7453-e521-5e7c-b712-f7112f9dcb91 with identifier: GZ01520
2026-03-30 10:59:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41ec7453-e521-5e7c-b712-f7112f9dcb91 with identifier: GZ01520 to the API
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 435,
 'expiration_date': '2026-03-30T15:50:57Z',
 'fuel_type': 'diesel',
 'id': '41ec7453-e521-5e7c-b712-f7112f9dcb91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ01520',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ7',
 'odometer': 142760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-01',
 'seller_name': None,
 'title': 'Audi SQ7 4.0 V8 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ01520%27 HTTP/1.1" 200 None
2026-03-30 10:59:06 [auto1.de] INFO: Saving data for GZ01520: {'auction_closing_time': 1774885857.0, 'created_time': 1774465467.656539, 'last_price_update_time': 1774868346.634947}
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ01520') HTTP/1.1" 204 0
2026-03-30 10:59:06 [auto1.de] INFO: Found listing with ID: TK97766
2026-03-30 10:59:06 [auto1.de] INFO: Found listing with ID: RS30445
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS30445%27 HTTP/1.1" 200 None
2026-03-30 10:59:06 [auto1.de] INFO: Scrape type for RS30445: 2
2026-03-30 10:59:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aad27732-66bf-55b6-85c1-679ddc0d5dcf with identifier: RS30445
2026-03-30 10:59:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aad27732-66bf-55b6-85c1-679ddc0d5dcf with scrape type 2
2026-03-30 10:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aad27732-66bf-55b6-85c1-679ddc0d5dcf with scrape type 2
2026-03-30 10:59:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aad27732-66bf-55b6-85c1-679ddc0d5dcf, identifier: RS30445
2026-03-30 10:59:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aad27732-66bf-55b6-85c1-679ddc0d5dcf with identifier: RS30445
2026-03-30 10:59:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aad27732-66bf-55b6-85c1-679ddc0d5dcf with identifier: RS30445
2026-03-30 10:59:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aad27732-66bf-55b6-85c1-679ddc0d5dcf with identifier: RS30445 to the API
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-30T15:26:36Z',
 'fuel_type': 'petrol',
 'id': 'aad27732-66bf-55b6-85c1-679ddc0d5dcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS30445',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 40042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-14',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 35 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2021}
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS30445%27 HTTP/1.1" 200 None
2026-03-30 10:59:07 [auto1.de] INFO: Saving data for RS30445: {'auction_closing_time': 1774884396.0, 'created_time': 1773307340.322549, 'last_price_update_time': 1774868347.387041}
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS30445') HTTP/1.1" 204 0
2026-03-30 10:59:07 [auto1.de] INFO: Found listing with ID: VN22748
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN22748%27 HTTP/1.1" 200 None
2026-03-30 10:59:07 [auto1.de] INFO: Scrape type for VN22748: 2
2026-03-30 10:59:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c02fcef-b0e4-50d0-90f2-49f596c70c58 with identifier: VN22748
2026-03-30 10:59:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c02fcef-b0e4-50d0-90f2-49f596c70c58 with scrape type 2
2026-03-30 10:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c02fcef-b0e4-50d0-90f2-49f596c70c58 with scrape type 2
2026-03-30 10:59:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c02fcef-b0e4-50d0-90f2-49f596c70c58, identifier: VN22748
2026-03-30 10:59:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c02fcef-b0e4-50d0-90f2-49f596c70c58 with identifier: VN22748
2026-03-30 10:59:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c02fcef-b0e4-50d0-90f2-49f596c70c58 with identifier: VN22748
2026-03-30 10:59:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c02fcef-b0e4-50d0-90f2-49f596c70c58 with identifier: VN22748 to the API
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:20:17Z',
 'fuel_type': 'petrol',
 'id': '3c02fcef-b0e4-50d0-90f2-49f596c70c58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN22748',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 72489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-09',
 'seller_name': None,
 'title': 'Porsche Macan S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN22748%27 HTTP/1.1" 200 None
2026-03-30 10:59:07 [auto1.de] INFO: Saving data for VN22748: {'auction_closing_time': 1774884017.0, 'created_time': 1773225725.136457, 'last_price_update_time': 1774868347.828449}
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN22748') HTTP/1.1" 204 0
2026-03-30 10:59:07 [auto1.de] INFO: Channel: 24h | Page: 84 | totalHits: 9549 | hits on page: 40
2026-03-30 10:59:07 [auto1.de] INFO: Found listing with ID: BK28670
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK28670%27 HTTP/1.1" 200 None
2026-03-30 10:59:07 [auto1.de] INFO: Scrape type for BK28670: 2
2026-03-30 10:59:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8438f47-b298-591c-894c-861e7924548f with identifier: BK28670
2026-03-30 10:59:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8438f47-b298-591c-894c-861e7924548f with scrape type 2
2026-03-30 10:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8438f47-b298-591c-894c-861e7924548f with scrape type 2
2026-03-30 10:59:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8438f47-b298-591c-894c-861e7924548f, identifier: BK28670
2026-03-30 10:59:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8438f47-b298-591c-894c-861e7924548f with identifier: BK28670
2026-03-30 10:59:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8438f47-b298-591c-894c-861e7924548f with identifier: BK28670
2026-03-30 10:59:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8438f47-b298-591c-894c-861e7924548f with identifier: BK28670 to the API
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 381,
 'expiration_date': '2026-03-30T15:27:32Z',
 'fuel_type': 'petrol',
 'id': 'b8438f47-b298-591c-894c-861e7924548f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK28670',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 164952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-11',
 'seller_name': None,
 'title': 'Porsche Macan GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK28670%27 HTTP/1.1" 200 None
2026-03-30 10:59:08 [auto1.de] INFO: Saving data for BK28670: {'auction_closing_time': 1774884452.0, 'created_time': 1774378003.300909, 'last_price_update_time': 1774868348.353055}
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK28670') HTTP/1.1" 204 0
2026-03-30 10:59:08 [auto1.de] INFO: Found listing with ID: HS83117
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS83117%27 HTTP/1.1" 200 None
2026-03-30 10:59:08 [auto1.de] INFO: Scrape type for HS83117: 0
2026-03-30 10:59:08 [auto1.de] INFO: Found listing with ID: RW76455
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW76455%27 HTTP/1.1" 200 None
2026-03-30 10:59:08 [auto1.de] INFO: Scrape type for RW76455: 2
2026-03-30 10:59:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04c92a5f-7935-5023-b523-054134cd48cd with identifier: RW76455
2026-03-30 10:59:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04c92a5f-7935-5023-b523-054134cd48cd with scrape type 2
2026-03-30 10:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04c92a5f-7935-5023-b523-054134cd48cd with scrape type 2
2026-03-30 10:59:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04c92a5f-7935-5023-b523-054134cd48cd, identifier: RW76455
2026-03-30 10:59:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:08 [auto1.de] INFO: Found listing with ID: AK90767
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK90767%27 HTTP/1.1" 200 None
2026-03-30 10:59:08 [auto1.de] INFO: Scrape type for AK90767: 2
2026-03-30 10:59:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff2e5450-4a4c-5fe5-93f5-1817776adb88 with identifier: AK90767
2026-03-30 10:59:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff2e5450-4a4c-5fe5-93f5-1817776adb88 with scrape type 2
2026-03-30 10:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff2e5450-4a4c-5fe5-93f5-1817776adb88 with scrape type 2
2026-03-30 10:59:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff2e5450-4a4c-5fe5-93f5-1817776adb88, identifier: AK90767
2026-03-30 10:59:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04c92a5f-7935-5023-b523-054134cd48cd with identifier: RW76455
2026-03-30 10:59:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04c92a5f-7935-5023-b523-054134cd48cd with identifier: RW76455
2026-03-30 10:59:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04c92a5f-7935-5023-b523-054134cd48cd with identifier: RW76455 to the API
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:06:17Z',
 'fuel_type': 'petrol',
 'id': '04c92a5f-7935-5023-b523-054134cd48cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW76455',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 131878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-02',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 43 AMG T 4Matic',
 'transmission': 'automatic',
 'trim': 'T 4Matic',
 'year': 2017}
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW76455%27 HTTP/1.1" 200 None
2026-03-30 10:59:08 [auto1.de] INFO: Saving data for RW76455: {'auction_closing_time': 1774883177.0, 'created_time': 1773136603.936512, 'last_price_update_time': 1774868348.977778}
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW76455') HTTP/1.1" 204 0
2026-03-30 10:59:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff2e5450-4a4c-5fe5-93f5-1817776adb88 with identifier: AK90767
2026-03-30 10:59:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff2e5450-4a4c-5fe5-93f5-1817776adb88 with identifier: AK90767
2026-03-30 10:59:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff2e5450-4a4c-5fe5-93f5-1817776adb88 with identifier: AK90767 to the API
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:18:41Z',
 'fuel_type': 'petrol',
 'id': 'ff2e5450-4a4c-5fe5-93f5-1817776adb88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK90767',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 78485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-03',
 'seller_name': None,
 'title': 'Porsche Cayenne 3.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK90767%27 HTTP/1.1" 200 None
2026-03-30 10:59:09 [auto1.de] INFO: Saving data for AK90767: {'auction_closing_time': 1774883921.0, 'created_time': 1774465470.040961, 'last_price_update_time': 1774868349.308307}
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK90767') HTTP/1.1" 204 0
2026-03-30 10:59:09 [auto1.de] INFO: Found listing with ID: RC29911
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC29911%27 HTTP/1.1" 200 None
2026-03-30 10:59:09 [auto1.de] INFO: Scrape type for RC29911: 2
2026-03-30 10:59:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27009e62-6619-5e99-8279-38f5697c366a with identifier: RC29911
2026-03-30 10:59:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27009e62-6619-5e99-8279-38f5697c366a with scrape type 2
2026-03-30 10:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27009e62-6619-5e99-8279-38f5697c366a with scrape type 2
2026-03-30 10:59:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27009e62-6619-5e99-8279-38f5697c366a, identifier: RC29911
2026-03-30 10:59:09 [auto1.de] INFO: Found listing with ID: TB02108
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB02108%27 HTTP/1.1" 200 None
2026-03-30 10:59:09 [auto1.de] INFO: Scrape type for TB02108: 2
2026-03-30 10:59:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00483fdf-43b0-5ce3-b8ea-980f79cc7726 with identifier: TB02108
2026-03-30 10:59:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00483fdf-43b0-5ce3-b8ea-980f79cc7726 with scrape type 2
2026-03-30 10:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00483fdf-43b0-5ce3-b8ea-980f79cc7726 with scrape type 2
2026-03-30 10:59:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00483fdf-43b0-5ce3-b8ea-980f79cc7726, identifier: TB02108
2026-03-30 10:59:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27009e62-6619-5e99-8279-38f5697c366a with identifier: RC29911
2026-03-30 10:59:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27009e62-6619-5e99-8279-38f5697c366a with identifier: RC29911
2026-03-30 10:59:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27009e62-6619-5e99-8279-38f5697c366a with identifier: RC29911 to the API
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:39:24Z',
 'fuel_type': 'diesel',
 'id': '27009e62-6619-5e99-8279-38f5697c366a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC29911',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 122558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-09',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC29911%27 HTTP/1.1" 200 None
2026-03-30 10:59:09 [auto1.de] INFO: Saving data for RC29911: {'auction_closing_time': 1774885164.0, 'created_time': 1774780554.108635, 'last_price_update_time': 1774868349.91671}
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC29911') HTTP/1.1" 204 0
2026-03-30 10:59:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00483fdf-43b0-5ce3-b8ea-980f79cc7726 with identifier: TB02108
2026-03-30 10:59:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00483fdf-43b0-5ce3-b8ea-980f79cc7726 with identifier: TB02108
2026-03-30 10:59:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00483fdf-43b0-5ce3-b8ea-980f79cc7726 with identifier: TB02108 to the API
2026-03-30 10:59:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:41:02Z',
 'fuel_type': 'diesel',
 'id': '00483fdf-43b0-5ce3-b8ea-980f79cc7726',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB02108',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 110427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-08',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L2 Tourneo Titanium X',
 'transmission': 'manual',
 'trim': '320 L2 Tourneo Titanium X',
 'year': 2019}
2026-03-30 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB02108%27 HTTP/1.1" 200 None
2026-03-30 10:59:10 [auto1.de] INFO: Saving data for TB02108: {'auction_closing_time': 1774885262.0, 'created_time': 1774291953.351933, 'last_price_update_time': 1774868350.972915}
2026-03-30 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB02108') HTTP/1.1" 204 0
2026-03-30 10:59:10 [auto1.de] INFO: Found listing with ID: VL48750
2026-03-30 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL48750%27 HTTP/1.1" 200 None
2026-03-30 10:59:11 [auto1.de] INFO: Scrape type for VL48750: 2
2026-03-30 10:59:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12353123-ac97-552b-8ef8-a740ad95ff07 with identifier: VL48750
2026-03-30 10:59:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12353123-ac97-552b-8ef8-a740ad95ff07 with scrape type 2
2026-03-30 10:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12353123-ac97-552b-8ef8-a740ad95ff07 with scrape type 2
2026-03-30 10:59:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12353123-ac97-552b-8ef8-a740ad95ff07, identifier: VL48750
2026-03-30 10:59:11 [auto1.de] INFO: Found listing with ID: YC23372
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC23372%27 HTTP/1.1" 200 None
2026-03-30 10:59:11 [auto1.de] INFO: Scrape type for YC23372: 2
2026-03-30 10:59:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47e1a34a-9f1b-5c15-9fcb-d62cb843c071 with identifier: YC23372
2026-03-30 10:59:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47e1a34a-9f1b-5c15-9fcb-d62cb843c071 with scrape type 2
2026-03-30 10:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47e1a34a-9f1b-5c15-9fcb-d62cb843c071 with scrape type 2
2026-03-30 10:59:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47e1a34a-9f1b-5c15-9fcb-d62cb843c071, identifier: YC23372
2026-03-30 10:59:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12353123-ac97-552b-8ef8-a740ad95ff07 with identifier: VL48750
2026-03-30 10:59:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12353123-ac97-552b-8ef8-a740ad95ff07 with identifier: VL48750
2026-03-30 10:59:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12353123-ac97-552b-8ef8-a740ad95ff07 with identifier: VL48750 to the API
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:11:49Z',
 'fuel_type': 'diesel',
 'id': '12353123-ac97-552b-8ef8-a740ad95ff07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL48750',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 260617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-19',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business Edition BlueMotion',
 'transmission': 'manual',
 'trim': 'Business Edition BlueMotion',
 'year': 2014}
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL48750%27 HTTP/1.1" 200 None
2026-03-30 10:59:11 [auto1.de] INFO: Saving data for VL48750: {'auction_closing_time': 1774883509.0, 'created_time': 1773229061.772808, 'last_price_update_time': 1774868351.656359}
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL48750') HTTP/1.1" 204 0
2026-03-30 10:59:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47e1a34a-9f1b-5c15-9fcb-d62cb843c071 with identifier: YC23372
2026-03-30 10:59:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47e1a34a-9f1b-5c15-9fcb-d62cb843c071 with identifier: YC23372
2026-03-30 10:59:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47e1a34a-9f1b-5c15-9fcb-d62cb843c071 with identifier: YC23372 to the API
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-30T15:40:59Z',
 'fuel_type': 'petrol',
 'id': '47e1a34a-9f1b-5c15-9fcb-d62cb843c071',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC23372',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 53447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-07',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 43 AMG Mild-Hybrid 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2023}
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC23372%27 HTTP/1.1" 200 None
2026-03-30 10:59:11 [auto1.de] INFO: Saving data for YC23372: {'auction_closing_time': 1774885259.0, 'created_time': 1774464859.971545, 'last_price_update_time': 1774868351.971115}
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC23372') HTTP/1.1" 204 0
2026-03-30 10:59:11 [auto1.de] INFO: Found listing with ID: CZ70893
2026-03-30 10:59:11 [auto1.de] INFO: Found listing with ID: HC32133
2026-03-30 10:59:11 [auto1.de] INFO: Found listing with ID: WC25701
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC25701%27 HTTP/1.1" 200 None
2026-03-30 10:59:12 [auto1.de] INFO: Scrape type for WC25701: 2
2026-03-30 10:59:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51b87b72-a6a0-55bc-9521-d6aa3e99d4da with identifier: WC25701
2026-03-30 10:59:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51b87b72-a6a0-55bc-9521-d6aa3e99d4da with scrape type 2
2026-03-30 10:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51b87b72-a6a0-55bc-9521-d6aa3e99d4da with scrape type 2
2026-03-30 10:59:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51b87b72-a6a0-55bc-9521-d6aa3e99d4da, identifier: WC25701
2026-03-30 10:59:12 [auto1.de] INFO: Found listing with ID: GB27698
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27698%27 HTTP/1.1" 200 None
2026-03-30 10:59:12 [auto1.de] INFO: Scrape type for GB27698: 2
2026-03-30 10:59:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a486434-9d28-530a-90cf-4bd728b83ed0 with identifier: GB27698
2026-03-30 10:59:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a486434-9d28-530a-90cf-4bd728b83ed0 with scrape type 2
2026-03-30 10:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a486434-9d28-530a-90cf-4bd728b83ed0 with scrape type 2
2026-03-30 10:59:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a486434-9d28-530a-90cf-4bd728b83ed0, identifier: GB27698
2026-03-30 10:59:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51b87b72-a6a0-55bc-9521-d6aa3e99d4da with identifier: WC25701
2026-03-30 10:59:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51b87b72-a6a0-55bc-9521-d6aa3e99d4da with identifier: WC25701
2026-03-30 10:59:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51b87b72-a6a0-55bc-9521-d6aa3e99d4da with identifier: WC25701 to the API
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:43:34Z',
 'fuel_type': 'diesel',
 'id': '51b87b72-a6a0-55bc-9521-d6aa3e99d4da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC25701',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 95598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-14',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2016}
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC25701%27 HTTP/1.1" 200 None
2026-03-30 10:59:12 [auto1.de] INFO: Saving data for WC25701: {'auction_closing_time': 1774885414.0, 'created_time': 1773138513.906347, 'last_price_update_time': 1774868352.486312}
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC25701') HTTP/1.1" 204 0
2026-03-30 10:59:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a486434-9d28-530a-90cf-4bd728b83ed0 with identifier: GB27698
2026-03-30 10:59:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a486434-9d28-530a-90cf-4bd728b83ed0 with identifier: GB27698
2026-03-30 10:59:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a486434-9d28-530a-90cf-4bd728b83ed0 with identifier: GB27698 to the API
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:50:32Z',
 'fuel_type': 'diesel',
 'id': '4a486434-9d28-530a-90cf-4bd728b83ed0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB27698',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Kombi',
 'odometer': 41142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-03',
 'seller_name': None,
 'title': 'Volkswagen T6 Kombi 2.0 TDI EcoProfi lang FWD',
 'transmission': 'automatic',
 'trim': 'EcoProfi lang FWD',
 'year': 2021}
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27698%27 HTTP/1.1" 200 None
2026-03-30 10:59:12 [auto1.de] INFO: Saving data for GB27698: {'auction_closing_time': 1774885832.0, 'created_time': 1773341977.374827, 'last_price_update_time': 1774868352.92666}
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB27698') HTTP/1.1" 204 0
2026-03-30 10:59:12 [auto1.de] INFO: Found listing with ID: RS41901
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS41901%27 HTTP/1.1" 200 None
2026-03-30 10:59:12 [auto1.de] INFO: Scrape type for RS41901: 2
2026-03-30 10:59:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5df2e86e-169c-5177-8259-fd5bc1315a2b with identifier: RS41901
2026-03-30 10:59:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5df2e86e-169c-5177-8259-fd5bc1315a2b with scrape type 2
2026-03-30 10:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5df2e86e-169c-5177-8259-fd5bc1315a2b with scrape type 2
2026-03-30 10:59:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5df2e86e-169c-5177-8259-fd5bc1315a2b, identifier: RS41901
2026-03-30 10:59:13 [auto1.de] INFO: Found listing with ID: LN26385
2026-03-30 10:59:13 [auto1.de] INFO: Found listing with ID: WA11944
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA11944%27 HTTP/1.1" 200 None
2026-03-30 10:59:13 [auto1.de] INFO: Scrape type for WA11944: 2
2026-03-30 10:59:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70e47495-d3e1-5b0e-abcf-a45d1adecd79 with identifier: WA11944
2026-03-30 10:59:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e47495-d3e1-5b0e-abcf-a45d1adecd79 with scrape type 2
2026-03-30 10:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70e47495-d3e1-5b0e-abcf-a45d1adecd79 with scrape type 2
2026-03-30 10:59:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70e47495-d3e1-5b0e-abcf-a45d1adecd79, identifier: WA11944
2026-03-30 10:59:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5df2e86e-169c-5177-8259-fd5bc1315a2b with identifier: RS41901
2026-03-30 10:59:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5df2e86e-169c-5177-8259-fd5bc1315a2b with identifier: RS41901
2026-03-30 10:59:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5df2e86e-169c-5177-8259-fd5bc1315a2b with identifier: RS41901 to the API
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 350,
 'expiration_date': '2026-03-30T15:45:11Z',
 'fuel_type': 'petrol',
 'id': '5df2e86e-169c-5177-8259-fd5bc1315a2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS41901',
 'listing': 'auction',
 'make': 'Porsche',
 'model': '718 Boxster',
 'odometer': 46352,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-17',
 'seller_name': None,
 'title': 'Porsche 718 Boxster S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS41901%27 HTTP/1.1" 200 None
2026-03-30 10:59:13 [auto1.de] INFO: Saving data for RS41901: {'auction_closing_time': 1774885511.0, 'created_time': 1774378009.470574, 'last_price_update_time': 1774868353.501433}
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS41901') HTTP/1.1" 204 0
2026-03-30 10:59:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70e47495-d3e1-5b0e-abcf-a45d1adecd79 with identifier: WA11944
2026-03-30 10:59:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70e47495-d3e1-5b0e-abcf-a45d1adecd79 with identifier: WA11944
2026-03-30 10:59:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70e47495-d3e1-5b0e-abcf-a45d1adecd79 with identifier: WA11944 to the API
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:47:30Z',
 'fuel_type': 'diesel',
 'id': '70e47495-d3e1-5b0e-abcf-a45d1adecd79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA11944',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 130045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-20',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2017}
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA11944%27 HTTP/1.1" 200 None
2026-03-30 10:59:13 [auto1.de] INFO: Saving data for WA11944: {'auction_closing_time': 1774885650.0, 'created_time': 1773227275.478985, 'last_price_update_time': 1774868353.820848}
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA11944') HTTP/1.1" 204 0
2026-03-30 10:59:13 [auto1.de] INFO: Found listing with ID: YC02535
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC02535%27 HTTP/1.1" 200 None
2026-03-30 10:59:13 [auto1.de] INFO: Scrape type for YC02535: 2
2026-03-30 10:59:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97726a30-28e2-5d84-9da2-5bd149cbdbc0 with identifier: YC02535
2026-03-30 10:59:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97726a30-28e2-5d84-9da2-5bd149cbdbc0 with scrape type 2
2026-03-30 10:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97726a30-28e2-5d84-9da2-5bd149cbdbc0 with scrape type 2
2026-03-30 10:59:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97726a30-28e2-5d84-9da2-5bd149cbdbc0, identifier: YC02535
2026-03-30 10:59:13 [auto1.de] INFO: Found listing with ID: VA77092
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA77092%27 HTTP/1.1" 200 None
2026-03-30 10:59:13 [auto1.de] INFO: Scrape type for VA77092: 2
2026-03-30 10:59:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c183823e-83eb-59c9-9237-b550c28219a6 with identifier: VA77092
2026-03-30 10:59:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c183823e-83eb-59c9-9237-b550c28219a6 with scrape type 2
2026-03-30 10:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c183823e-83eb-59c9-9237-b550c28219a6 with scrape type 2
2026-03-30 10:59:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c183823e-83eb-59c9-9237-b550c28219a6, identifier: VA77092
2026-03-30 10:59:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97726a30-28e2-5d84-9da2-5bd149cbdbc0 with identifier: YC02535
2026-03-30 10:59:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97726a30-28e2-5d84-9da2-5bd149cbdbc0 with identifier: YC02535
2026-03-30 10:59:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97726a30-28e2-5d84-9da2-5bd149cbdbc0 with identifier: YC02535 to the API
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:21:09Z',
 'fuel_type': 'diesel',
 'id': '97726a30-28e2-5d84-9da2-5bd149cbdbc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC02535',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 74410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-24',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2016}
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC02535%27 HTTP/1.1" 200 None
2026-03-30 10:59:14 [auto1.de] INFO: Saving data for YC02535: {'auction_closing_time': 1774884069.0, 'created_time': 1773303466.753191, 'last_price_update_time': 1774868354.331884}
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC02535') HTTP/1.1" 204 0
2026-03-30 10:59:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c183823e-83eb-59c9-9237-b550c28219a6 with identifier: VA77092
2026-03-30 10:59:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c183823e-83eb-59c9-9237-b550c28219a6 with identifier: VA77092
2026-03-30 10:59:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c183823e-83eb-59c9-9237-b550c28219a6 with identifier: VA77092 to the API
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 525,
 'expiration_date': '2026-03-30T15:41:11Z',
 'fuel_type': 'petrol',
 'id': 'c183823e-83eb-59c9-9237-b550c28219a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA77092',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover',
 'odometer': 78490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-02',
 'seller_name': None,
 'title': 'Land Rover Range Rover 5.0 V8 Kompressor Autobiography',
 'transmission': 'automatic',
 'trim': 'Autobiography',
 'year': 2018}
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA77092%27 HTTP/1.1" 200 None
2026-03-30 10:59:14 [auto1.de] INFO: Saving data for VA77092: {'auction_closing_time': 1774885271.0, 'created_time': 1774465413.116247, 'last_price_update_time': 1774868354.611292}
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA77092') HTTP/1.1" 204 0
2026-03-30 10:59:14 [auto1.de] INFO: Found listing with ID: CW57830
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW57830%27 HTTP/1.1" 200 None
2026-03-30 10:59:14 [auto1.de] INFO: Scrape type for CW57830: 2
2026-03-30 10:59:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b35f96e5-5799-5631-b461-1088215b4928 with identifier: CW57830
2026-03-30 10:59:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b35f96e5-5799-5631-b461-1088215b4928 with scrape type 2
2026-03-30 10:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b35f96e5-5799-5631-b461-1088215b4928 with scrape type 2
2026-03-30 10:59:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b35f96e5-5799-5631-b461-1088215b4928, identifier: CW57830
2026-03-30 10:59:14 [auto1.de] INFO: Found listing with ID: SR72775
2026-03-30 10:59:14 [auto1.de] INFO: Found listing with ID: JZ29670
2026-03-30 10:59:14 [auto1.de] INFO: Found listing with ID: LW90225
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW90225%27 HTTP/1.1" 200 None
2026-03-30 10:59:14 [auto1.de] INFO: Scrape type for LW90225: 2
2026-03-30 10:59:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4db9f3e6-28ca-5789-b94e-baa1365522f0 with identifier: LW90225
2026-03-30 10:59:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4db9f3e6-28ca-5789-b94e-baa1365522f0 with scrape type 2
2026-03-30 10:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4db9f3e6-28ca-5789-b94e-baa1365522f0 with scrape type 2
2026-03-30 10:59:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4db9f3e6-28ca-5789-b94e-baa1365522f0, identifier: LW90225
2026-03-30 10:59:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b35f96e5-5799-5631-b461-1088215b4928 with identifier: CW57830
2026-03-30 10:59:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b35f96e5-5799-5631-b461-1088215b4928 with identifier: CW57830
2026-03-30 10:59:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b35f96e5-5799-5631-b461-1088215b4928 with identifier: CW57830 to the API
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:24:32Z',
 'fuel_type': 'diesel',
 'id': 'b35f96e5-5799-5631-b461-1088215b4928',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW57830',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 157571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-13',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW57830%27 HTTP/1.1" 200 None
2026-03-30 10:59:15 [auto1.de] INFO: Saving data for CW57830: {'auction_closing_time': 1774884272.0, 'created_time': 1773304704.963808, 'last_price_update_time': 1774868355.181351}
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW57830') HTTP/1.1" 204 0
2026-03-30 10:59:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4db9f3e6-28ca-5789-b94e-baa1365522f0 with identifier: LW90225
2026-03-30 10:59:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4db9f3e6-28ca-5789-b94e-baa1365522f0 with identifier: LW90225
2026-03-30 10:59:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4db9f3e6-28ca-5789-b94e-baa1365522f0 with identifier: LW90225 to the API
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:56:34Z',
 'fuel_type': 'diesel',
 'id': '4db9f3e6-28ca-5789-b94e-baa1365522f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW90225',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 180483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-08',
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2015}
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW90225%27 HTTP/1.1" 200 None
2026-03-30 10:59:15 [auto1.de] INFO: Saving data for LW90225: {'auction_closing_time': 1774886194.0, 'created_time': 1773230000.780706, 'last_price_update_time': 1774868355.456321}
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW90225') HTTP/1.1" 204 0
2026-03-30 10:59:15 [auto1.de] INFO: Found listing with ID: XB95476
2026-03-30 10:59:15 [auto1.de] INFO: Found listing with ID: HK91051
2026-03-30 10:59:15 [auto1.de] INFO: Found listing with ID: TW01944
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW01944%27 HTTP/1.1" 200 None
2026-03-30 10:59:15 [auto1.de] INFO: Scrape type for TW01944: 2
2026-03-30 10:59:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84fb66c5-e426-5269-adf5-0b07651470df with identifier: TW01944
2026-03-30 10:59:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84fb66c5-e426-5269-adf5-0b07651470df with scrape type 2
2026-03-30 10:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84fb66c5-e426-5269-adf5-0b07651470df with scrape type 2
2026-03-30 10:59:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84fb66c5-e426-5269-adf5-0b07651470df, identifier: TW01944
2026-03-30 10:59:15 [auto1.de] INFO: Found listing with ID: LJ23138
2026-03-30 10:59:15 [auto1.de] INFO: Found listing with ID: ZA27483
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA27483%27 HTTP/1.1" 200 None
2026-03-30 10:59:15 [auto1.de] INFO: Scrape type for ZA27483: 2
2026-03-30 10:59:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f82144a3-7d52-5b21-9917-ad8fe8418b67 with identifier: ZA27483
2026-03-30 10:59:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f82144a3-7d52-5b21-9917-ad8fe8418b67 with scrape type 2
2026-03-30 10:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f82144a3-7d52-5b21-9917-ad8fe8418b67 with scrape type 2
2026-03-30 10:59:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f82144a3-7d52-5b21-9917-ad8fe8418b67, identifier: ZA27483
2026-03-30 10:59:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84fb66c5-e426-5269-adf5-0b07651470df with identifier: TW01944
2026-03-30 10:59:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84fb66c5-e426-5269-adf5-0b07651470df with identifier: TW01944
2026-03-30 10:59:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84fb66c5-e426-5269-adf5-0b07651470df with identifier: TW01944 to the API
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:35:52Z',
 'fuel_type': 'diesel',
 'id': '84fb66c5-e426-5269-adf5-0b07651470df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW01944',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 183706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-23',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW01944%27 HTTP/1.1" 200 None
2026-03-30 10:59:15 [auto1.de] INFO: Saving data for TW01944: {'auction_closing_time': 1774884952.0, 'created_time': 1773136385.76575, 'last_price_update_time': 1774868355.985526}
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW01944') HTTP/1.1" 204 0
2026-03-30 10:59:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f82144a3-7d52-5b21-9917-ad8fe8418b67 with identifier: ZA27483
2026-03-30 10:59:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f82144a3-7d52-5b21-9917-ad8fe8418b67 with identifier: ZA27483
2026-03-30 10:59:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f82144a3-7d52-5b21-9917-ad8fe8418b67 with identifier: ZA27483 to the API
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:17:04Z',
 'fuel_type': 'petrol',
 'id': 'f82144a3-7d52-5b21-9917-ad8fe8418b67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA27483',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 50250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-11',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA27483%27 HTTP/1.1" 200 None
2026-03-30 10:59:16 [auto1.de] INFO: Saving data for ZA27483: {'auction_closing_time': 1774883824.0, 'created_time': 1773340807.798658, 'last_price_update_time': 1774868356.367168}
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA27483') HTTP/1.1" 204 0
2026-03-30 10:59:16 [auto1.de] INFO: Found listing with ID: RN71628
2026-03-30 10:59:16 [auto1.de] INFO: Found listing with ID: HT70874
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT70874%27 HTTP/1.1" 200 None
2026-03-30 10:59:16 [auto1.de] INFO: Scrape type for HT70874: 2
2026-03-30 10:59:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53d341a3-e0fa-55be-8fcb-1ac7a11d3ebb with identifier: HT70874
2026-03-30 10:59:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53d341a3-e0fa-55be-8fcb-1ac7a11d3ebb with scrape type 2
2026-03-30 10:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53d341a3-e0fa-55be-8fcb-1ac7a11d3ebb with scrape type 2
2026-03-30 10:59:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53d341a3-e0fa-55be-8fcb-1ac7a11d3ebb, identifier: HT70874
2026-03-30 10:59:16 [auto1.de] INFO: Found listing with ID: VZ47534
2026-03-30 10:59:16 [auto1.de] INFO: Found listing with ID: HY14352
2026-03-30 10:59:16 [auto1.de] INFO: Found listing with ID: XM73112
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM73112%27 HTTP/1.1" 200 None
2026-03-30 10:59:16 [auto1.de] INFO: Scrape type for XM73112: 2
2026-03-30 10:59:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49616f7e-77a2-504a-8b4c-4bcd789989e2 with identifier: XM73112
2026-03-30 10:59:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49616f7e-77a2-504a-8b4c-4bcd789989e2 with scrape type 2
2026-03-30 10:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49616f7e-77a2-504a-8b4c-4bcd789989e2 with scrape type 2
2026-03-30 10:59:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49616f7e-77a2-504a-8b4c-4bcd789989e2, identifier: XM73112
2026-03-30 10:59:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53d341a3-e0fa-55be-8fcb-1ac7a11d3ebb with identifier: HT70874
2026-03-30 10:59:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53d341a3-e0fa-55be-8fcb-1ac7a11d3ebb with identifier: HT70874
2026-03-30 10:59:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53d341a3-e0fa-55be-8fcb-1ac7a11d3ebb with identifier: HT70874 to the API
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:17:06Z',
 'fuel_type': 'petrol',
 'id': '53d341a3-e0fa-55be-8fcb-1ac7a11d3ebb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT70874',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 122003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-27',
 'seller_name': None,
 'title': 'BMW 1er 118i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2017}
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT70874%27 HTTP/1.1" 200 None
2026-03-30 10:59:16 [auto1.de] INFO: Saving data for HT70874: {'auction_closing_time': 1774883826.0, 'created_time': 1773132012.51701, 'last_price_update_time': 1774868356.932028}
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT70874') HTTP/1.1" 204 0
2026-03-30 10:59:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49616f7e-77a2-504a-8b4c-4bcd789989e2 with identifier: XM73112
2026-03-30 10:59:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49616f7e-77a2-504a-8b4c-4bcd789989e2 with identifier: XM73112
2026-03-30 10:59:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49616f7e-77a2-504a-8b4c-4bcd789989e2 with identifier: XM73112 to the API
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:25:11Z',
 'fuel_type': 'diesel',
 'id': '49616f7e-77a2-504a-8b4c-4bcd789989e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM73112',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 57886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-09',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 d Mild-Hybrid T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2022}
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM73112%27 HTTP/1.1" 200 None
2026-03-30 10:59:17 [auto1.de] INFO: Saving data for XM73112: {'auction_closing_time': 1774884311.0, 'created_time': 1774378038.153195, 'last_price_update_time': 1774868357.229176}
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM73112') HTTP/1.1" 204 0
2026-03-30 10:59:17 [auto1.de] INFO: Found listing with ID: UV60068
2026-03-30 10:59:17 [auto1.de] INFO: Found listing with ID: YW93482
2026-03-30 10:59:17 [auto1.de] INFO: Found listing with ID: CJ85818
2026-03-30 10:59:17 [auto1.de] INFO: Found listing with ID: KF64937
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF64937%27 HTTP/1.1" 200 None
2026-03-30 10:59:17 [auto1.de] INFO: Scrape type for KF64937: 2
2026-03-30 10:59:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0c6ebc-3f12-5971-a90e-87ceb166ad59 with identifier: KF64937
2026-03-30 10:59:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0c6ebc-3f12-5971-a90e-87ceb166ad59 with scrape type 2
2026-03-30 10:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b0c6ebc-3f12-5971-a90e-87ceb166ad59 with scrape type 2
2026-03-30 10:59:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b0c6ebc-3f12-5971-a90e-87ceb166ad59, identifier: KF64937
2026-03-30 10:59:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:17 [auto1.de] INFO: Found listing with ID: JD41613
2026-03-30 10:59:17 [auto1.de] INFO: Found listing with ID: EA70059
2026-03-30 10:59:17 [auto1.de] INFO: Found listing with ID: VY06306
2026-03-30 10:59:17 [auto1.de] INFO: Found listing with ID: RP66782
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP66782%27 HTTP/1.1" 200 None
2026-03-30 10:59:17 [auto1.de] INFO: Scrape type for RP66782: 2
2026-03-30 10:59:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2924ab11-323c-5f0d-adea-34e1cb94fce0 with identifier: RP66782
2026-03-30 10:59:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2924ab11-323c-5f0d-adea-34e1cb94fce0 with scrape type 2
2026-03-30 10:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2924ab11-323c-5f0d-adea-34e1cb94fce0 with scrape type 2
2026-03-30 10:59:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2924ab11-323c-5f0d-adea-34e1cb94fce0, identifier: RP66782
2026-03-30 10:59:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b0c6ebc-3f12-5971-a90e-87ceb166ad59 with identifier: KF64937
2026-03-30 10:59:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b0c6ebc-3f12-5971-a90e-87ceb166ad59 with identifier: KF64937
2026-03-30 10:59:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b0c6ebc-3f12-5971-a90e-87ceb166ad59 with identifier: KF64937 to the API
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:11:46Z',
 'fuel_type': 'diesel',
 'id': '3b0c6ebc-3f12-5971-a90e-87ceb166ad59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF64937',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 111148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-25',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF64937%27 HTTP/1.1" 200 None
2026-03-30 10:59:17 [auto1.de] INFO: Saving data for KF64937: {'auction_closing_time': 1774883506.0, 'created_time': 1773226720.255274, 'last_price_update_time': 1774868357.78388}
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF64937') HTTP/1.1" 204 0
2026-03-30 10:59:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2924ab11-323c-5f0d-adea-34e1cb94fce0 with identifier: RP66782
2026-03-30 10:59:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2924ab11-323c-5f0d-adea-34e1cb94fce0 with identifier: RP66782
2026-03-30 10:59:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2924ab11-323c-5f0d-adea-34e1cb94fce0 with identifier: RP66782 to the API
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:10:49Z',
 'fuel_type': 'petrol',
 'id': '2924ab11-323c-5f0d-adea-34e1cb94fce0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP66782',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 131591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-07',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP66782%27 HTTP/1.1" 200 None
2026-03-30 10:59:18 [auto1.de] INFO: Saving data for RP66782: {'auction_closing_time': 1774883449.0, 'created_time': 1773343694.994787, 'last_price_update_time': 1774868358.191487}
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP66782') HTTP/1.1" 204 0
2026-03-30 10:59:18 [auto1.de] INFO: Found listing with ID: CM64848
2026-03-30 10:59:18 [auto1.de] INFO: Found listing with ID: MW29670
2026-03-30 10:59:18 [auto1.de] INFO: Found listing with ID: RC86966
2026-03-30 10:59:18 [auto1.de] INFO: Found listing with ID: XW48128
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW48128%27 HTTP/1.1" 200 None
2026-03-30 10:59:18 [auto1.de] INFO: Scrape type for XW48128: 2
2026-03-30 10:59:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54948df8-0462-5578-8152-550b90091500 with identifier: XW48128
2026-03-30 10:59:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54948df8-0462-5578-8152-550b90091500 with scrape type 2
2026-03-30 10:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54948df8-0462-5578-8152-550b90091500 with scrape type 2
2026-03-30 10:59:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54948df8-0462-5578-8152-550b90091500, identifier: XW48128
2026-03-30 10:59:18 [auto1.de] INFO: Found listing with ID: HS83117
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS83117%27 HTTP/1.1" 200 None
2026-03-30 10:59:18 [auto1.de] INFO: Scrape type for HS83117: 0
2026-03-30 10:59:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54948df8-0462-5578-8152-550b90091500 with identifier: XW48128
2026-03-30 10:59:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54948df8-0462-5578-8152-550b90091500 with identifier: XW48128
2026-03-30 10:59:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54948df8-0462-5578-8152-550b90091500 with identifier: XW48128 to the API
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:16:49Z',
 'fuel_type': 'petrol',
 'id': '54948df8-0462-5578-8152-550b90091500',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW48128',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 158463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-17',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Sports-Line',
 'transmission': 'automatic',
 'trim': 'Sports-Line',
 'year': 2016}
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW48128%27 HTTP/1.1" 200 None
2026-03-30 10:59:18 [auto1.de] INFO: Saving data for XW48128: {'auction_closing_time': 1774883809.0, 'created_time': 1773307964.489466, 'last_price_update_time': 1774868358.623884}
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW48128') HTTP/1.1" 204 0
2026-03-30 10:59:18 [auto1.de] INFO: Found listing with ID: KL19595
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19595%27 HTTP/1.1" 200 None
2026-03-30 10:59:18 [auto1.de] INFO: Scrape type for KL19595: 2
2026-03-30 10:59:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0444739-9834-5160-9ca8-8b37164649af with identifier: KL19595
2026-03-30 10:59:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0444739-9834-5160-9ca8-8b37164649af with scrape type 2
2026-03-30 10:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0444739-9834-5160-9ca8-8b37164649af with scrape type 2
2026-03-30 10:59:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0444739-9834-5160-9ca8-8b37164649af, identifier: KL19595
2026-03-30 10:59:18 [auto1.de] INFO: Channel: 24h | Page: 85 | totalHits: 9549 | hits on page: 40
2026-03-30 10:59:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0444739-9834-5160-9ca8-8b37164649af with identifier: KL19595
2026-03-30 10:59:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0444739-9834-5160-9ca8-8b37164649af with identifier: KL19595
2026-03-30 10:59:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0444739-9834-5160-9ca8-8b37164649af with identifier: KL19595 to the API
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 510,
 'expiration_date': '2026-03-30T15:05:57Z',
 'fuel_type': 'petrol',
 'id': 'c0444739-9834-5160-9ca8-8b37164649af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL19595',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 108515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-22',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 63 AMG S 4Matic',
 'transmission': 'automatic',
 'trim': 'S 4Matic',
 'year': 2021}
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19595%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Saving data for KL19595: {'auction_closing_time': 1774883157.0, 'created_time': 1774464677.199688, 'last_price_update_time': 1774868359.016284}
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL19595') HTTP/1.1" 204 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: LT87510
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT87510%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for LT87510: 2
2026-03-30 10:59:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b5ecb3c-8029-518f-9a06-4bf7bfd2014b with identifier: LT87510
2026-03-30 10:59:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b5ecb3c-8029-518f-9a06-4bf7bfd2014b with scrape type 2
2026-03-30 10:59:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b5ecb3c-8029-518f-9a06-4bf7bfd2014b with scrape type 2
2026-03-30 10:59:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b5ecb3c-8029-518f-9a06-4bf7bfd2014b, identifier: LT87510
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: EN74445
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN74445%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for EN74445: 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: EZ47162
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: XY85959
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: YB72786
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: NC06801
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC06801%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for NC06801: 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: YL95361
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL95361%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for YL95361: 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: DZ61875
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ61875%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for DZ61875: 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: TX80950
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: RM28884
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: WJ79239
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: FD80734
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: HA68744
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: PV13799
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: NT54414
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: SF55933
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF55933%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for SF55933: 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: RY86630
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY86630%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for RY86630: 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: CU91826
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU91826%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for CU91826: 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: RE98096
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: JR00588
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: YY17846
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY17846%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for YY17846: 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: RU42318
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: BZ91725
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: CG73719
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG73719%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for CG73719: 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: CK06472
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: AS80209
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: XK62781
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK62781%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for XK62781: 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: NB79280
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB79280%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for NB79280: 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: AP67523
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: YF68653
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF68653%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for YF68653: 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: TF22102
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF22102%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for TF22102: 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: SJ86823
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: FG94497
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG94497%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for FG94497: 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: HE99483
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE99483%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for HE99483: 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: JL43427
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: LF77567
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF77567%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for LF77567: 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: DX27890
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: VJ93938
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ93938%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for VJ93938: 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: AX13429
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX13429%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for AX13429: 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: SD17030
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD17030%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for SD17030: 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: AN60754
2026-03-30 10:59:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b5ecb3c-8029-518f-9a06-4bf7bfd2014b with identifier: LT87510
2026-03-30 10:59:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b5ecb3c-8029-518f-9a06-4bf7bfd2014b with identifier: LT87510
2026-03-30 10:59:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b5ecb3c-8029-518f-9a06-4bf7bfd2014b with identifier: LT87510 to the API
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:33:05Z',
 'fuel_type': 'diesel',
 'id': '1b5ecb3c-8029-518f-9a06-4bf7bfd2014b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT87510',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 158516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-28',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Soleil',
 'transmission': 'manual',
 'trim': 'Soleil',
 'year': 2020}
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT87510%27 HTTP/1.1" 200 None
2026-03-30 10:59:20 [auto1.de] INFO: Saving data for LT87510: {'auction_closing_time': 1774884785.0, 'created_time': 1773302687.610415, 'last_price_update_time': 1774868360.4529}
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT87510') HTTP/1.1" 204 0
2026-03-30 10:59:20 [auto1.de] INFO: Found listing with ID: WS77403
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS77403%27 HTTP/1.1" 200 None
2026-03-30 10:59:20 [auto1.de] INFO: Scrape type for WS77403: 2
2026-03-30 10:59:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4de303b2-f95d-55b9-b8ae-f733230eca7f with identifier: WS77403
2026-03-30 10:59:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4de303b2-f95d-55b9-b8ae-f733230eca7f with scrape type 2
2026-03-30 10:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4de303b2-f95d-55b9-b8ae-f733230eca7f with scrape type 2
2026-03-30 10:59:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4de303b2-f95d-55b9-b8ae-f733230eca7f, identifier: WS77403
2026-03-30 10:59:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4de303b2-f95d-55b9-b8ae-f733230eca7f with identifier: WS77403
2026-03-30 10:59:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4de303b2-f95d-55b9-b8ae-f733230eca7f with identifier: WS77403
2026-03-30 10:59:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4de303b2-f95d-55b9-b8ae-f733230eca7f with identifier: WS77403 to the API
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:57:08Z',
 'fuel_type': 'petrol',
 'id': '4de303b2-f95d-55b9-b8ae-f733230eca7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS77403',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 190808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-10',
 'seller_name': None,
 'title': 'Fiat 500 0.9 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2011}
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS77403%27 HTTP/1.1" 200 None
2026-03-30 10:59:20 [auto1.de] INFO: Saving data for WS77403: {'auction_closing_time': 1774886228.0, 'created_time': 1773917590.653556, 'last_price_update_time': 1774868360.965434}
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS77403') HTTP/1.1" 204 0
2026-03-30 10:59:20 [auto1.de] INFO: Found listing with ID: TY40136
2026-03-30 10:59:20 [auto1.de] INFO: Found listing with ID: YV77496
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV77496%27 HTTP/1.1" 200 None
2026-03-30 10:59:21 [auto1.de] INFO: Scrape type for YV77496: 0
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: NJ52204
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ52204%27 HTTP/1.1" 200 None
2026-03-30 10:59:21 [auto1.de] INFO: Scrape type for NJ52204: 0
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: SP96872
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: UP55946
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55946%27 HTTP/1.1" 200 None
2026-03-30 10:59:21 [auto1.de] INFO: Scrape type for UP55946: 0
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: BG00548
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: FN44778
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: YN38539
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN38539%27 HTTP/1.1" 200 None
2026-03-30 10:59:21 [auto1.de] INFO: Scrape type for YN38539: 0
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: CG08693
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG08693%27 HTTP/1.1" 200 None
2026-03-30 10:59:21 [auto1.de] INFO: Scrape type for CG08693: 0
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: ZE88330
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: LG10256
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG10256%27 HTTP/1.1" 200 None
2026-03-30 10:59:21 [auto1.de] INFO: Scrape type for LG10256: 0
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: KK73289
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK73289%27 HTTP/1.1" 200 None
2026-03-30 10:59:21 [auto1.de] INFO: Scrape type for KK73289: 0
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: LS49952
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS49952%27 HTTP/1.1" 200 None
2026-03-30 10:59:21 [auto1.de] INFO: Scrape type for LS49952: 0
2026-03-30 10:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:22 [auto1.de] INFO: Channel: 24h | Page: 86 | totalHits: 9552 | hits on page: 40
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: AX13429
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX13429%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for AX13429: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: SD17030
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD17030%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for SD17030: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: AN60754
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: JF12446
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF12446%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for JF12446: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: NH81971
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81971%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for NH81971: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: PU44230
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU44230%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for PU44230: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: MA20018
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA20018%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for MA20018: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: ER86835
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER86835%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for ER86835: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: SU19428
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU19428%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for SU19428: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: UW74525
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW74525%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for UW74525: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: CP06642
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06642%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for CP06642: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: EH70293
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: NR97756
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: YX40073
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX40073%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for YX40073: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: LC05735
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC05735%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for LC05735: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: VH46900
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH46900%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for VH46900: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: FM78793
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78793%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for FM78793: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: AW14620
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW14620%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for AW14620: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: ZN75041
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN75041%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for ZN75041: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: JX06129
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: XV57552
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: UW93361
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW93361%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for UW93361: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: YY00897
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY00897%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for YY00897: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: DE21080
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE21080%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for DE21080: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: ZP65093
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP65093%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for ZP65093: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: JN49232
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN49232%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for JN49232: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: WX35600
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: MH82983
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: DF56561
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: WV35399
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: ZT07846
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT07846%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for ZT07846: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: WG75781
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG75781%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for WG75781: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: MM39918
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: ZR25455
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR25455%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for ZR25455: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: AF95202
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: YJ88627
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: LT54057
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT54057%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for LT54057: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: XV17111
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: VY54552
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY54552%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for VY54552: 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: DV01319
2026-03-30 10:59:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:23 [auto1.de] INFO: Channel: 24h | Page: 87 | totalHits: 9552 | hits on page: 40
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: EW76820
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: JK52723
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: HW71141
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW71141%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for HW71141: 0
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: GJ78269
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ78269%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for GJ78269: 0
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: GR38931
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: FS91363
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: AZ86702
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: EM69554
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM69554%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for EM69554: 0
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: ZR39968
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: EU39655
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU39655%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for EU39655: 0
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: RV72867
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV72867%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for RV72867: 0
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: TX59054
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX59054%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for TX59054: 0
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: XT69734
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT69734%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for XT69734: 0
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: PL85371
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: TZ11746
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ11746%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for TZ11746: 0
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: XF01324
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF01324%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for XF01324: 0
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: UP89204
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP89204%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for UP89204: 0
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: SL35659
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: GJ17165
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: ZK08136
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK08136%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for ZK08136: 0
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: VF37611
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: ZU15284
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: VS05622
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS05622%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for VS05622: 0
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: CU27746
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU27746%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for CU27746: 0
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: UN73859
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN73859%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for UN73859: 0
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: VH01397
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: VG22194
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG22194%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for VG22194: 0
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: UR30493
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: FD54213
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: JY95314
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: JT90882
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT90882%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for JT90882: 0
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: ZR98160
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: AM33807
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: MG97845
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: AJ18698
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ18698%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for AJ18698: 0
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: UM62946
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: EN76399
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: CL40632
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: AG68218
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68218%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for AG68218: 0
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: YZ27957
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ27957%27 HTTP/1.1" 200 None
2026-03-30 10:59:24 [auto1.de] INFO: Scrape type for YZ27957: 0
2026-03-30 10:59:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:25 [auto1.de] INFO: Channel: 24h | Page: 88 | totalHits: 9552 | hits on page: 40
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: GA63896
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA63896%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for GA63896: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: YP19468
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP19468%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for YP19468: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: TW27373
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: PR12496
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: PY00065
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: NZ51315
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ51315%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for NZ51315: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: HZ75916
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: VH44928
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH44928%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for VH44928: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: WC28645
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28645%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for WC28645: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: DD41075
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: LN11604
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11604%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for LN11604: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: VL75204
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: XR19518
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR19518%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for XR19518: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: JY40414
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: KG80613
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: RB81159
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: FE98948
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE98948%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for FE98948: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: GT84792
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT84792%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for GT84792: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: GS84935
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS84935%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for GS84935: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: KM43405
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: UK22592
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK22592%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for UK22592: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: FU28651
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU28651%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for FU28651: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: JM01437
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: GY36946
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY36946%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for GY36946: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: PV67596
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV67596%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for PV67596: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: ET29931
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET29931%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for ET29931: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: YF03838
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: CL60178
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: BP04527
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP04527%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for BP04527: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: AH10770
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: PW13353
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW13353%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for PW13353: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: GE40777
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: JG07802
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG07802%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for JG07802: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: TA43023
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: RC29433
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC29433%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for RC29433: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: LP47085
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: VD46825
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: YE68062
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE68062%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for YE68062: 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: MP83511
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: FV18032
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV18032%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for FV18032: 0
2026-03-30 10:59:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:26 [auto1.de] INFO: Channel: 24h | Page: 89 | totalHits: 9552 | hits on page: 40
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: AK95286
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: JG50197
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: XH92207
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: JA02220
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA02220%27 HTTP/1.1" 200 None
2026-03-30 10:59:26 [auto1.de] INFO: Scrape type for JA02220: 0
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: AX71998
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: JN21638
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN21638%27 HTTP/1.1" 200 None
2026-03-30 10:59:26 [auto1.de] INFO: Scrape type for JN21638: 0
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: MN72943
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: PH87632
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: MA84823
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA84823%27 HTTP/1.1" 200 None
2026-03-30 10:59:26 [auto1.de] INFO: Scrape type for MA84823: 0
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: NT47334
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: DK51297
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: AV07522
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30127%27 HTTP/1.1" 200 None
2026-03-30 10:59:26 [auto1.de] INFO: Scrape type for MN30127: 0
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: ZA25327
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: YE47766
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: AY52280
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY52280%27 HTTP/1.1" 200 None
2026-03-30 10:59:26 [auto1.de] INFO: Scrape type for AY52280: 0
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: ST92465
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: EY37424
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY37424%27 HTTP/1.1" 200 None
2026-03-30 10:59:26 [auto1.de] INFO: Scrape type for EY37424: 0
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: MT94431
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT94431%27 HTTP/1.1" 200 None
2026-03-30 10:59:26 [auto1.de] INFO: Scrape type for MT94431: 0
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: ZF33601
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: BP69387
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: PF83814
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: PS96844
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS96844%27 HTTP/1.1" 200 None
2026-03-30 10:59:26 [auto1.de] INFO: Scrape type for PS96844: 0
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: DH90644
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH90644%27 HTTP/1.1" 200 None
2026-03-30 10:59:26 [auto1.de] INFO: Scrape type for DH90644: 0
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: UX35771
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: LC73868
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: JX17903
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX17903%27 HTTP/1.1" 200 None
2026-03-30 10:59:26 [auto1.de] INFO: Scrape type for JX17903: 0
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: YE89715
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: NX25429
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX25429%27 HTTP/1.1" 200 None
2026-03-30 10:59:26 [auto1.de] INFO: Scrape type for NX25429: 0
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: FB30616
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB30616%27 HTTP/1.1" 200 None
2026-03-30 10:59:26 [auto1.de] INFO: Scrape type for FB30616: 0
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: PZ87651
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: WR49956
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: EU48519
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: EM09444
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM09444%27 HTTP/1.1" 200 None
2026-03-30 10:59:26 [auto1.de] INFO: Scrape type for EM09444: 0
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: HS59554
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: VU90894
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: AL66084
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: WF31027
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: KJ73179
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ73179%27 HTTP/1.1" 200 None
2026-03-30 10:59:26 [auto1.de] INFO: Scrape type for KJ73179: 0
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: VM07579
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM07579%27 HTTP/1.1" 200 None
2026-03-30 10:59:26 [auto1.de] INFO: Scrape type for VM07579: 0
2026-03-30 10:59:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:28 [auto1.de] INFO: Channel: 24h | Page: 90 | totalHits: 9552 | hits on page: 40
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: XH18940
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH18940%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for XH18940: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: UZ89172
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ89172%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for UZ89172: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: EF06925
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF06925%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for EF06925: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: KR46332
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: UE56505
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE56505%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for UE56505: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: YS85982
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: KC50337
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: TR93945
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR93945%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for TR93945: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: EP14807
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: XG49869
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: ZW53829
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: UF10359
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF10359%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for UF10359: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: CE58616
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: KS98119
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: HW05295
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: BN60503
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN60503%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for BN60503: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: BG41279
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG41279%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for BG41279: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: DK12229
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: ND89828
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND89828%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for ND89828: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: YB47390
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: VX00455
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: VW07399
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: SZ67140
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: CK62820
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62820%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for CK62820: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: HT40242
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: FC82221
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC82221%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for FC82221: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: MF60875
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF60875%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for MF60875: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: KT60854
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60854%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for KT60854: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: AC96507
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: YS65782
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: MG42603
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG42603%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for MG42603: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: FK12887
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK12887%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for FK12887: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: ZU40023
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: CH93645
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH93645%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for CH93645: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: PE55813
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: JP33538
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP33538%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for JP33538: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: YT05280
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT05280%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for YT05280: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: RF07068
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF07068%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for RF07068: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: MU49508
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU49508%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for MU49508: 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: KD86114
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD86114%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for KD86114: 0
2026-03-30 10:59:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:29 [auto1.de] INFO: Channel: 24h | Page: 91 | totalHits: 9552 | hits on page: 40
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: AY96814
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: EF75873
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF75873%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for EF75873: 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: HZ55109
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ55109%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for HZ55109: 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: UR98067
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98067%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for UR98067: 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: PT29857
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: CX74060
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX74060%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for CX74060: 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: LA18154
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA18154%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for LA18154: 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: WA25791
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: LN99770
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: NK17990
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: CY43451
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: ZX96561
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: LX79709
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: KC50640
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: VR60747
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: SZ06147
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: CW95568
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW95568%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for CW95568: 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: NV70278
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: ZL59344
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: GD26044
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD26044%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for GD26044: 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: EE96817
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE96817%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for EE96817: 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: NH06338
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH06338%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for NH06338: 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: DS59005
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: MF86039
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF86039%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for MF86039: 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: JV48558
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: SJ64604
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ64604%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for SJ64604: 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: LH54346
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: DT57257
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT57257%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for DT57257: 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: VT63649
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT63649%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for VT63649: 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: JX79740
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX79740%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for JX79740: 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: FR69109
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR69109%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for FR69109: 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: BS19118
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS19118%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for BS19118: 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: JX21647
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: VU30885
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: MM90627
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: UP11609
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP11609%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for UP11609: 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: SL92984
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL92984%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for SL92984: 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: GH39731
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH39731%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for GH39731: 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: JG03809
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: NV30450
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV30450%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for NV30450: 0
2026-03-30 10:59:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:31 [auto1.de] INFO: Channel: 24h | Page: 92 | totalHits: 9552 | hits on page: 40
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: SN42334
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN42334%27 HTTP/1.1" 200 None
2026-03-30 10:59:31 [auto1.de] INFO: Scrape type for SN42334: 0
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: ZW50012
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW50012%27 HTTP/1.1" 200 None
2026-03-30 10:59:31 [auto1.de] INFO: Scrape type for ZW50012: 0
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: YV85598
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: LE50284
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: AB49133
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49133%27 HTTP/1.1" 200 None
2026-03-30 10:59:31 [auto1.de] INFO: Scrape type for AB49133: 0
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: FN52751
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: KB67170
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB67170%27 HTTP/1.1" 200 None
2026-03-30 10:59:31 [auto1.de] INFO: Scrape type for KB67170: 0
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: SC23766
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: CL73395
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: ZU96971
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: KF93262
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF93262%27 HTTP/1.1" 200 None
2026-03-30 10:59:31 [auto1.de] INFO: Scrape type for KF93262: 0
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: BP80209
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP80209%27 HTTP/1.1" 200 None
2026-03-30 10:59:31 [auto1.de] INFO: Scrape type for BP80209: 0
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: FR18143
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR18143%27 HTTP/1.1" 200 None
2026-03-30 10:59:31 [auto1.de] INFO: Scrape type for FR18143: 0
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: FP56300
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: WF13702
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF13702%27 HTTP/1.1" 200 None
2026-03-30 10:59:31 [auto1.de] INFO: Scrape type for WF13702: 0
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: DU56840
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: HJ42862
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: HH06006
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH06006%27 HTTP/1.1" 200 None
2026-03-30 10:59:31 [auto1.de] INFO: Scrape type for HH06006: 0
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: LU46217
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU46217%27 HTTP/1.1" 200 None
2026-03-30 10:59:31 [auto1.de] INFO: Scrape type for LU46217: 0
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: NC63257
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: HA49497
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: GN25688
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: DC32299
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC32299%27 HTTP/1.1" 200 None
2026-03-30 10:59:31 [auto1.de] INFO: Scrape type for DC32299: 0
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: SD24294
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: JY97697
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: ZM10504
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM10504%27 HTTP/1.1" 200 None
2026-03-30 10:59:31 [auto1.de] INFO: Scrape type for ZM10504: 0
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: NA60022
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA60022%27 HTTP/1.1" 200 None
2026-03-30 10:59:31 [auto1.de] INFO: Scrape type for NA60022: 0
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: CH24864
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH24864%27 HTTP/1.1" 200 None
2026-03-30 10:59:31 [auto1.de] INFO: Scrape type for CH24864: 0
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: GX79735
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: ZY33636
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: HJ92241
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: FL18278
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: TE81012
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: CG37224
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: BE55111
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: VN71215
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: LV65947
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: FY57331
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: GS42870
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: MT54263
2026-03-30 10:59:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:32 [auto1.de] INFO: Channel: 24h | Page: 93 | totalHits: 9552 | hits on page: 40
2026-03-30 10:59:32 [auto1.de] INFO: Found listing with ID: AK26500
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK26500%27 HTTP/1.1" 200 None
2026-03-30 10:59:32 [auto1.de] INFO: Scrape type for AK26500: 0
2026-03-30 10:59:32 [auto1.de] INFO: Found listing with ID: ZZ49081
2026-03-30 10:59:32 [auto1.de] INFO: Found listing with ID: JL32962
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL32962%27 HTTP/1.1" 200 None
2026-03-30 10:59:32 [auto1.de] INFO: Scrape type for JL32962: 0
2026-03-30 10:59:32 [auto1.de] INFO: Found listing with ID: GY35476
2026-03-30 10:59:32 [auto1.de] INFO: Found listing with ID: UN88738
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN88738%27 HTTP/1.1" 200 None
2026-03-30 10:59:32 [auto1.de] INFO: Scrape type for UN88738: 0
2026-03-30 10:59:32 [auto1.de] INFO: Found listing with ID: TV18525
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18525%27 HTTP/1.1" 200 None
2026-03-30 10:59:32 [auto1.de] INFO: Scrape type for TV18525: 0
2026-03-30 10:59:32 [auto1.de] INFO: Found listing with ID: GB49809
2026-03-30 10:59:32 [auto1.de] INFO: Found listing with ID: LT85175
2026-03-30 10:59:32 [auto1.de] INFO: Found listing with ID: ZL07582
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL07582%27 HTTP/1.1" 200 None
2026-03-30 10:59:32 [auto1.de] INFO: Scrape type for ZL07582: 0
2026-03-30 10:59:32 [auto1.de] INFO: Found listing with ID: MU81714
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU81714%27 HTTP/1.1" 200 None
2026-03-30 10:59:32 [auto1.de] INFO: Scrape type for MU81714: 0
2026-03-30 10:59:32 [auto1.de] INFO: Found listing with ID: PW12377
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW12377%27 HTTP/1.1" 200 None
2026-03-30 10:59:33 [auto1.de] INFO: Scrape type for PW12377: 0
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: RD52099
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD52099%27 HTTP/1.1" 200 None
2026-03-30 10:59:33 [auto1.de] INFO: Scrape type for RD52099: 0
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: LX33649
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: CX30934
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX30934%27 HTTP/1.1" 200 None
2026-03-30 10:59:33 [auto1.de] INFO: Scrape type for CX30934: 0
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: KT37105
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT37105%27 HTTP/1.1" 200 None
2026-03-30 10:59:33 [auto1.de] INFO: Scrape type for KT37105: 0
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: NT69326
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: MP45750
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: BS14329
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: HW62804
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: BS91998
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: WW27591
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: SS07399
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS07399%27 HTTP/1.1" 200 None
2026-03-30 10:59:33 [auto1.de] INFO: Scrape type for SS07399: 0
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: ZM46839
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: PL16151
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: GT44390
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: NK02034
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: RR54011
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR54011%27 HTTP/1.1" 200 None
2026-03-30 10:59:33 [auto1.de] INFO: Scrape type for RR54011: 0
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: PN39432
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: XB31619
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL12737%27 HTTP/1.1" 200 None
2026-03-30 10:59:33 [auto1.de] INFO: Scrape type for JL12737: 0
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: YA55481
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: KP96972
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP96972%27 HTTP/1.1" 200 None
2026-03-30 10:59:33 [auto1.de] INFO: Scrape type for KP96972: 0
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: YW59624
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW59624%27 HTTP/1.1" 200 None
2026-03-30 10:59:33 [auto1.de] INFO: Scrape type for YW59624: 0
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: NX68514
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68514%27 HTTP/1.1" 200 None
2026-03-30 10:59:33 [auto1.de] INFO: Scrape type for NX68514: 0
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: GX41654
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: LW18163
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: AM69365
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM69365%27 HTTP/1.1" 200 None
2026-03-30 10:59:33 [auto1.de] INFO: Scrape type for AM69365: 0
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: VV46079
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46079%27 HTTP/1.1" 200 None
2026-03-30 10:59:33 [auto1.de] INFO: Scrape type for VV46079: 0
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: DW75956
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW75956%27 HTTP/1.1" 200 None
2026-03-30 10:59:33 [auto1.de] INFO: Scrape type for DW75956: 0
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: EP30050
2026-03-30 10:59:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:34 [auto1.de] INFO: Channel: 24h | Page: 94 | totalHits: 9552 | hits on page: 40
2026-03-30 10:59:34 [auto1.de] INFO: Found listing with ID: DJ56711
2026-03-30 10:59:34 [auto1.de] INFO: Found listing with ID: TG96584
2026-03-30 10:59:34 [auto1.de] INFO: Found listing with ID: DS69815
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS69815%27 HTTP/1.1" 200 None
2026-03-30 10:59:34 [auto1.de] INFO: Scrape type for DS69815: 0
2026-03-30 10:59:34 [auto1.de] INFO: Found listing with ID: AR05539
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR05539%27 HTTP/1.1" 200 None
2026-03-30 10:59:34 [auto1.de] INFO: Scrape type for AR05539: 0
2026-03-30 10:59:34 [auto1.de] INFO: Found listing with ID: XB74234
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB74234%27 HTTP/1.1" 200 None
2026-03-30 10:59:34 [auto1.de] INFO: Scrape type for XB74234: 0
2026-03-30 10:59:34 [auto1.de] INFO: Found listing with ID: RC23376
2026-03-30 10:59:34 [auto1.de] INFO: Found listing with ID: TF63689
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF63689%27 HTTP/1.1" 200 None
2026-03-30 10:59:34 [auto1.de] INFO: Scrape type for TF63689: 0
2026-03-30 10:59:34 [auto1.de] INFO: Found listing with ID: FR19321
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR19321%27 HTTP/1.1" 200 None
2026-03-30 10:59:34 [auto1.de] INFO: Scrape type for FR19321: 0
2026-03-30 10:59:34 [auto1.de] INFO: Found listing with ID: GS08469
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS08469%27 HTTP/1.1" 200 None
2026-03-30 10:59:34 [auto1.de] INFO: Scrape type for GS08469: 0
2026-03-30 10:59:34 [auto1.de] INFO: Found listing with ID: VG72840
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG72840%27 HTTP/1.1" 200 None
2026-03-30 10:59:34 [auto1.de] INFO: Scrape type for VG72840: 0
2026-03-30 10:59:34 [auto1.de] INFO: Found listing with ID: BD16858
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD16858%27 HTTP/1.1" 200 None
2026-03-30 10:59:34 [auto1.de] INFO: Scrape type for BD16858: 0
2026-03-30 10:59:34 [auto1.de] INFO: Found listing with ID: BM86036
2026-03-30 10:59:34 [auto1.de] INFO: Found listing with ID: KG33917
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG33917%27 HTTP/1.1" 200 None
2026-03-30 10:59:35 [auto1.de] INFO: Scrape type for KG33917: 0
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: YD12579
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD12579%27 HTTP/1.1" 200 None
2026-03-30 10:59:35 [auto1.de] INFO: Scrape type for YD12579: 0
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: NU91903
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU91903%27 HTTP/1.1" 200 None
2026-03-30 10:59:35 [auto1.de] INFO: Scrape type for NU91903: 0
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: KH12936
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH12936%27 HTTP/1.1" 200 None
2026-03-30 10:59:35 [auto1.de] INFO: Scrape type for KH12936: 0
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: FA63852
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE44691%27 HTTP/1.1" 200 None
2026-03-30 10:59:35 [auto1.de] INFO: Scrape type for BE44691: 0
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: FL79995
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: ZK29983
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK29983%27 HTTP/1.1" 200 None
2026-03-30 10:59:35 [auto1.de] INFO: Scrape type for ZK29983: 0
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: AR18568
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR18568%27 HTTP/1.1" 200 None
2026-03-30 10:59:35 [auto1.de] INFO: Scrape type for AR18568: 0
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: FC63717
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC63717%27 HTTP/1.1" 200 None
2026-03-30 10:59:35 [auto1.de] INFO: Scrape type for FC63717: 0
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: RD35466
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: PM92730
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: YF63409
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF63409%27 HTTP/1.1" 200 None
2026-03-30 10:59:35 [auto1.de] INFO: Scrape type for YF63409: 0
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: TS01373
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: FH64312
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: ST88871
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: KH96137
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: VX41895
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: GV12841
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: JJ82398
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ82398%27 HTTP/1.1" 200 None
2026-03-30 10:59:35 [auto1.de] INFO: Scrape type for JJ82398: 0
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: BE37865
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: HN51683
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: JF69032
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF69032%27 HTTP/1.1" 200 None
2026-03-30 10:59:35 [auto1.de] INFO: Scrape type for JF69032: 0
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: KT58980
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT58980%27 HTTP/1.1" 200 None
2026-03-30 10:59:35 [auto1.de] INFO: Scrape type for KT58980: 0
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: ML63417
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: FP71706
2026-03-30 10:59:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:36 [auto1.de] INFO: Channel: 24h | Page: 95 | totalHits: 9553 | hits on page: 40
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: FP71706
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: UP80660
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP80660%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for UP80660: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: VV17039
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV17039%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for VV17039: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: RU02977
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: TU49821
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU49821%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for TU49821: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: RW26653
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: AZ23740
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK94674%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for BK94674: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: JE51939
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE51939%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for JE51939: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: MN42254
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL44277%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for JL44277: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: GF81751
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: AS86297
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS86297%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for AS86297: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: GS01911
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: CR11100
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR11100%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for CR11100: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: UV04147
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: WN56158
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN56158%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for WN56158: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: JN93492
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: KC39120
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC39120%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for KC39120: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: LM88961
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM88961%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for LM88961: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: AJ08614
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW22525%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for HW22525: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: HM10464
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10464%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for HM10464: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: AN54197
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN54197%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for AN54197: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: TN59671
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN59671%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for TN59671: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: JB75617
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB75617%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for JB75617: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: DJ54071
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ54071%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for DJ54071: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: DB44844
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB44844%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for DB44844: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: UY73943
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY73943%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for UY73943: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: GC63268
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC63268%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for GC63268: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: RB81391
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81391%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for RB81391: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: KJ86247
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: AF22062
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: XS27718
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: VB40940
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB40940%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for VB40940: 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: FH59067
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: YJ30839
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: PC09054
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09054%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for PC09054: 0
2026-03-30 10:59:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:37 [auto1.de] INFO: Channel: 24h | Page: 96 | totalHits: 9553 | hits on page: 40
2026-03-30 10:59:37 [auto1.de] INFO: Found listing with ID: YS06113
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS06113%27 HTTP/1.1" 200 None
2026-03-30 10:59:37 [auto1.de] INFO: Scrape type for YS06113: 0
2026-03-30 10:59:37 [auto1.de] INFO: Found listing with ID: BD68188
2026-03-30 10:59:37 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-30 10:59:37 [auto1.de] INFO: Found listing with ID: MU83359
2026-03-30 10:59:37 [auto1.de] INFO: Found listing with ID: VX34650
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX34650%27 HTTP/1.1" 200 None
2026-03-30 10:59:37 [auto1.de] INFO: Scrape type for VX34650: 0
2026-03-30 10:59:37 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK39912%27 HTTP/1.1" 200 None
2026-03-30 10:59:38 [auto1.de] INFO: Scrape type for ZK39912: 0
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: FA27220
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN58886%27 HTTP/1.1" 200 None
2026-03-30 10:59:38 [auto1.de] INFO: Scrape type for UN58886: 0
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: JN76212
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN76212%27 HTTP/1.1" 200 None
2026-03-30 10:59:38 [auto1.de] INFO: Scrape type for JN76212: 0
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ50846%27 HTTP/1.1" 200 None
2026-03-30 10:59:38 [auto1.de] INFO: Scrape type for FZ50846: 0
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: TD63054
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: NR54362
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: BA55761
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: WP48993
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: TF08287
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF08287%27 HTTP/1.1" 200 None
2026-03-30 10:59:38 [auto1.de] INFO: Scrape type for TF08287: 0
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU29288%27 HTTP/1.1" 200 None
2026-03-30 10:59:38 [auto1.de] INFO: Scrape type for TU29288: 0
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: BU40538
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: LS95970
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: GJ26621
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: KT21278
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: AG77275
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG77275%27 HTTP/1.1" 200 None
2026-03-30 10:59:38 [auto1.de] INFO: Scrape type for AG77275: 0
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG37810%27 HTTP/1.1" 200 None
2026-03-30 10:59:38 [auto1.de] INFO: Scrape type for MG37810: 0
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: ZZ75608
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: LM03290
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM03290%27 HTTP/1.1" 200 None
2026-03-30 10:59:38 [auto1.de] INFO: Scrape type for LM03290: 0
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: BY58400
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY58400%27 HTTP/1.1" 200 None
2026-03-30 10:59:38 [auto1.de] INFO: Scrape type for BY58400: 0
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: DJ32425
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ32425%27 HTTP/1.1" 200 None
2026-03-30 10:59:38 [auto1.de] INFO: Scrape type for DJ32425: 0
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: PC86421
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: NB76223
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: WT11127
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: DV41377
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41377%27 HTTP/1.1" 200 None
2026-03-30 10:59:38 [auto1.de] INFO: Scrape type for DV41377: 0
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: BZ42521
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: BP32495
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP32495%27 HTTP/1.1" 200 None
2026-03-30 10:59:38 [auto1.de] INFO: Scrape type for BP32495: 0
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: UV10868
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: NY81856
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: ZM52655
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM52655%27 HTTP/1.1" 200 None
2026-03-30 10:59:38 [auto1.de] INFO: Scrape type for ZM52655: 0
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: SY55546
2026-03-30 10:59:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:39 [auto1.de] INFO: Channel: 24h | Page: 97 | totalHits: 9553 | hits on page: 40
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: ZZ74816
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: PA10723
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: HT55268
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT55268%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for HT55268: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: DG23161
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG23161%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for DG23161: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: JH84206
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH84206%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for JH84206: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: RP43844
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: GP28928
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP28928%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for GP28928: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: BB33034
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB33034%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for BB33034: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: YD55328
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: RB85475
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB85475%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for RB85475: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: UT27249
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: AF35013
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF35013%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for AF35013: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: WG27498
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: JV22464
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV22464%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for JV22464: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: GY48177
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY48177%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for GY48177: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: XM82116
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM82116%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for XM82116: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: SL47086
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL47086%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for SL47086: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: SZ74678
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ74678%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for SZ74678: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: SV18867
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV18867%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for SV18867: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: JR97371
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR97371%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for JR97371: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: VS79881
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS79881%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for VS79881: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: JT14864
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT14864%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for JT14864: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: EJ65167
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ65167%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for EJ65167: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: ZZ71304
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: JC14398
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: HC88789
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: LS56228
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: LN76006
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: PH65688
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH65688%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for PH65688: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: JM14062
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: CU86908
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM99769%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for JM99769: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41784%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for MF41784: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: XR81453
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR81453%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for XR81453: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: ZE36621
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06812%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for SC06812: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: RY72669
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY72669%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for RY72669: 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-30 10:59:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:40 [auto1.de] INFO: Channel: 24h | Page: 98 | totalHits: 9554 | hits on page: 40
2026-03-30 10:59:40 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-30 10:59:40 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-30 10:59:40 [auto1.de] INFO: Found listing with ID: MY28321
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY28321%27 HTTP/1.1" 200 None
2026-03-30 10:59:40 [auto1.de] INFO: Scrape type for MY28321: 0
2026-03-30 10:59:40 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-30 10:59:40 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK00341%27 HTTP/1.1" 200 None
2026-03-30 10:59:40 [auto1.de] INFO: Scrape type for FK00341: 0
2026-03-30 10:59:40 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT72401%27 HTTP/1.1" 200 None
2026-03-30 10:59:40 [auto1.de] INFO: Scrape type for LT72401: 0
2026-03-30 10:59:40 [auto1.de] INFO: Found listing with ID: LE46493
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE46493%27 HTTP/1.1" 200 None
2026-03-30 10:59:40 [auto1.de] INFO: Scrape type for LE46493: 0
2026-03-30 10:59:40 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX26895%27 HTTP/1.1" 200 None
2026-03-30 10:59:40 [auto1.de] INFO: Scrape type for MX26895: 2
2026-03-30 10:59:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f5927c0-898e-5593-b49f-51055df7b7c2 with identifier: MX26895
2026-03-30 10:59:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f5927c0-898e-5593-b49f-51055df7b7c2 with scrape type 2
2026-03-30 10:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f5927c0-898e-5593-b49f-51055df7b7c2 with scrape type 2
2026-03-30 10:59:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f5927c0-898e-5593-b49f-51055df7b7c2, identifier: MX26895
2026-03-30 10:59:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f5927c0-898e-5593-b49f-51055df7b7c2 with identifier: MX26895
2026-03-30 10:59:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f5927c0-898e-5593-b49f-51055df7b7c2 with identifier: MX26895
2026-03-30 10:59:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f5927c0-898e-5593-b49f-51055df7b7c2 with identifier: MX26895 to the API
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:32:10Z',
 'fuel_type': 'petrol',
 'id': '7f5927c0-898e-5593-b49f-51055df7b7c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX26895',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 38040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-07',
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Perfect',
 'transmission': 'manual',
 'trim': 'Perfect',
 'year': 2018}
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX26895%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Saving data for MX26895: {'auction_closing_time': 1774884730.0, 'created_time': 1774596636.931782, 'last_price_update_time': 1774868381.410723}
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX26895') HTTP/1.1" 204 0
2026-03-30 10:59:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: EG31023
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: CS81826
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS81826%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for CS81826: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: WB93098
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: SB37681
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB37681%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for SB37681: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: LJ65077
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ65077%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for LJ65077: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: PE27175
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: EY45109
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD80009%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for PD80009: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: HJ62454
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ62454%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for HJ62454: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN78852%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for BN78852: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: KL70058
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: SP41663
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41663%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for SP41663: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: TN86054
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: EF82631
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF82631%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for EF82631: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: LZ26330
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: PL48246
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL48246%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for PL48246: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: DJ80434
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: CS56497
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: LS72141
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS72141%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for LS72141: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: ZZ01082
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: ZB97674
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: MB83489
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: TD26953
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: GE94001
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE94001%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for GE94001: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: BZ96817
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ96817%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for BZ96817: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: TM98978
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: DV51967
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ33462%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for UJ33462: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ40099%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for EJ40099: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: CM83282
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM83282%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for CM83282: 2
2026-03-30 10:59:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 293678e2-a396-5cd4-bdb2-d1c75c6781fc with identifier: CM83282
2026-03-30 10:59:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293678e2-a396-5cd4-bdb2-d1c75c6781fc with scrape type 2
2026-03-30 10:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 293678e2-a396-5cd4-bdb2-d1c75c6781fc with scrape type 2
2026-03-30 10:59:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 293678e2-a396-5cd4-bdb2-d1c75c6781fc, identifier: CM83282
2026-03-30 10:59:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 293678e2-a396-5cd4-bdb2-d1c75c6781fc with identifier: CM83282
2026-03-30 10:59:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 293678e2-a396-5cd4-bdb2-d1c75c6781fc with identifier: CM83282
2026-03-30 10:59:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 293678e2-a396-5cd4-bdb2-d1c75c6781fc with identifier: CM83282 to the API
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:22:24Z',
 'fuel_type': 'petrol',
 'id': '293678e2-a396-5cd4-bdb2-d1c75c6781fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM83282',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 154492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-08-25',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Kompressor T Classic',
 'transmission': 'automatic',
 'trim': 'T Classic',
 'year': 2002}
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM83282%27 HTTP/1.1" 200 None
2026-03-30 10:59:42 [auto1.de] INFO: Saving data for CM83282: {'auction_closing_time': 1774884144.0, 'created_time': 1773301389.161036, 'last_price_update_time': 1774868382.179796}
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM83282') HTTP/1.1" 204 0
2026-03-30 10:59:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:43 [auto1.de] INFO: Channel: 24h | Page: 99 | totalHits: 9554 | hits on page: 40
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: CV29491
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV29491%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for CV29491: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: HA98993
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: BS44912
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: AC85459
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: BN23533
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: NU76337
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: RS52465
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52465%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for RS52465: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: SA82708
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: GJ72633
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72633%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for GJ72633: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: XW85438
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW85438%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for XW85438: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: WE78461
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE78461%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for WE78461: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: BB70854
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB70854%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for BB70854: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: PC67993
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: GS38799
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: JA25299
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: HA43942
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA43942%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for HA43942: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: FN85650
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: ZC13254
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ88373%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for AJ88373: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: WW51915
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: VP85116
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP85116%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for VP85116: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: CU54451
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: ZM17001
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM17001%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for ZM17001: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: DU31630
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU31630%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for DU31630: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: WX50182
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX50182%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for WX50182: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: FV09122
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: DF17432
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF17432%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for DF17432: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: KF91285
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF91285%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for KF91285: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: SE25361
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE25361%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for SE25361: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: SA80165
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: CD93100
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD93100%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for CD93100: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: WA68072
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68072%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for WA68072: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN46705%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for EN46705: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: HD36706
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: XY49734
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: LC33794
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33794%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for LC33794: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: JV32404
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV32404%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for JV32404: 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: NN32284
2026-03-30 10:59:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:44 [auto1.de] INFO: Channel: 24h | Page: 100 | totalHits: 9554 | hits on page: 40
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: LV55209
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55209%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for LV55209: 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: RU43264
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: LD01626
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: HP02844
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP02844%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for HP02844: 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: JY04435
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY04435%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for JY04435: 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: CP54704
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: VF70690
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: MM33078
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: FG21922
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: JB35967
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: SE90361
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: TA32254
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA32254%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for TA32254: 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: RD63050
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD63050%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for RD63050: 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: RM28655
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM28655%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for RM28655: 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: FK33509
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK33509%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for FK33509: 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: KC35382
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC35382%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for KC35382: 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: ZS56665
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: CF89653
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: EV72489
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: WX73478
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX73478%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for WX73478: 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: DH40869
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH40869%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for DH40869: 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: YM40569
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: WG70910
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG70910%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for WG70910: 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: WB04317
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: CK29715
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK29715%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for CK29715: 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT17427%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for WT17427: 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: ET31330
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: LB57303
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB57303%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for LB57303: 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: DX86501
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX86501%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for DX86501: 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: VY38504
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY38504%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for VY38504: 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: TB88794
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB88794%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for TB88794: 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: SJ63454
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH21308%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for JH21308: 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: XY94981
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY94981%27 HTTP/1.1" 200 None
2026-03-30 10:59:45 [auto1.de] INFO: Scrape type for XY94981: 0
2026-03-30 10:59:45 [auto1.de] INFO: Found listing with ID: LD78025
2026-03-30 10:59:45 [auto1.de] INFO: Found listing with ID: BB54670
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB54670%27 HTTP/1.1" 200 None
2026-03-30 10:59:45 [auto1.de] INFO: Scrape type for BB54670: 0
2026-03-30 10:59:45 [auto1.de] INFO: Found listing with ID: FA01437
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA01437%27 HTTP/1.1" 200 None
2026-03-30 10:59:45 [auto1.de] INFO: Scrape type for FA01437: 0
2026-03-30 10:59:45 [auto1.de] INFO: Found listing with ID: SA69574
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA69574%27 HTTP/1.1" 200 None
2026-03-30 10:59:45 [auto1.de] INFO: Scrape type for SA69574: 0
2026-03-30 10:59:45 [auto1.de] INFO: Found listing with ID: AR19685
2026-03-30 10:59:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:46 [auto1.de] INFO: Channel: 24h | Page: 101 | totalHits: 9554 | hits on page: 40
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: DB25597
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB25597%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for DB25597: 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: HD83134
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: JH65606
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH65606%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for JH65606: 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: YZ38333
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ38333%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for YZ38333: 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: ZN44804
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: NG28413
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: SP19687
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: DR66726
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR66726%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for DR66726: 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: JM73266
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: VG84958
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG84958%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for VG84958: 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: GG14507
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG14507%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for GG14507: 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: LB09285
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: WG00954
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG00954%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for WG00954: 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: JT97344
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT97344%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for JT97344: 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: YK88723
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK88723%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for YK88723: 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: ME09470
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL40040%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for WL40040: 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: EH25554
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH25554%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for EH25554: 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: CM50859
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF89419%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for TF89419: 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: WW45885
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54596%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for HJ54596: 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF15442%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for LF15442: 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: MR23018
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR23018%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for MR23018: 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP18010%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for HP18010: 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: JL88490
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: NV31897
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: BU23510
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: HP87000
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87000%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for HP87000: 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: RE53759
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: PH48180
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: VW42745
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: SK99321
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK99321%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for SK99321: 2
2026-03-30 10:59:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5d6bc21-c8bc-5975-8fdd-379adbd8b706 with identifier: SK99321
2026-03-30 10:59:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5d6bc21-c8bc-5975-8fdd-379adbd8b706 with scrape type 2
2026-03-30 10:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5d6bc21-c8bc-5975-8fdd-379adbd8b706 with scrape type 2
2026-03-30 10:59:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5d6bc21-c8bc-5975-8fdd-379adbd8b706, identifier: SK99321
2026-03-30 10:59:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5d6bc21-c8bc-5975-8fdd-379adbd8b706 with identifier: SK99321
2026-03-30 10:59:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5d6bc21-c8bc-5975-8fdd-379adbd8b706 with identifier: SK99321
2026-03-30 10:59:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5d6bc21-c8bc-5975-8fdd-379adbd8b706 with identifier: SK99321 to the API
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:04:14Z',
 'fuel_type': 'diesel',
 'id': 'e5d6bc21-c8bc-5975-8fdd-379adbd8b706',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK99321',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 375931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-19',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 3.0 CDI lang Trend',
 'transmission': 'automatic',
 'trim': 'lang Trend',
 'year': 2007}
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK99321%27 HTTP/1.1" 200 None
2026-03-30 10:59:47 [auto1.de] INFO: Saving data for SK99321: {'auction_closing_time': 1774883054.0, 'created_time': 1773916765.89427, 'last_price_update_time': 1774868387.158908}
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK99321') HTTP/1.1" 204 0
2026-03-30 10:59:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:47 [auto1.de] INFO: Found listing with ID: HZ35615
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35615%27 HTTP/1.1" 200 None
2026-03-30 10:59:47 [auto1.de] INFO: Scrape type for HZ35615: 0
2026-03-30 10:59:47 [auto1.de] INFO: Found listing with ID: ZT89563
2026-03-30 10:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:48 [auto1.de] INFO: Channel: 24h | Page: 102 | totalHits: 9554 | hits on page: 40
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: YJ99770
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: HJ11294
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ11294%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for HJ11294: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: ER42295
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER42295%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for ER42295: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: PW77910
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: PU00921
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: MR37276
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: UY72197
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: SL53901
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL53901%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for SL53901: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: VY10648
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: BF26414
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: HF07638
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: DC59357
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC59357%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for DC59357: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: DW94281
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW94281%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for DW94281: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: PH88741
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: FY91836
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: VD47640
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD47640%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for VD47640: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: VK44645
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: UV26569
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV26569%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for UV26569: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: VP46416
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: LD15809
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD15809%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for LD15809: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: CF53394
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: KV36004
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV36004%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for KV36004: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: TW15848
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: MV55154
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: WZ38880
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: CZ73559
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: TH75068
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH75068%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for TH75068: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: JZ25562
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ25562%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for JZ25562: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: DV41165
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: GA31373
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: AK64805
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: JZ96778
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ96778%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for JZ96778: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: KE98572
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE98572%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for KE98572: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: ZF74811
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF74811%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for ZF74811: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: EX84018
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX84018%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for EX84018: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: JD70113
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD70113%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for JD70113: 0
2026-03-30 10:59:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:49 [auto1.de] INFO: Channel: 24h | Page: 103 | totalHits: 9554 | hits on page: 40
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: CF84548
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF84548%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for CF84548: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: SX95086
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX95086%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for SX95086: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: JC98855
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: HE96933
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE96933%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for HE96933: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: WE09519
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE09519%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for WE09519: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: AL93555
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL93555%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for AL93555: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: TC06569
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: LP44310
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: BP97465
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: TH33543
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: XT71149
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT71149%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for XT71149: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: NS14523
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS14523%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for NS14523: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: NU38157
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU38157%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for NU38157: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: TD06456
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD06456%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for TD06456: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: CL90320
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV77194%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for JV77194: 2
2026-03-30 10:59:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 466b1101-b58d-541b-a86a-2c83fdd7efd2 with identifier: JV77194
2026-03-30 10:59:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 466b1101-b58d-541b-a86a-2c83fdd7efd2 with scrape type 2
2026-03-30 10:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 466b1101-b58d-541b-a86a-2c83fdd7efd2 with scrape type 2
2026-03-30 10:59:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 466b1101-b58d-541b-a86a-2c83fdd7efd2, identifier: JV77194
2026-03-30 10:59:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 466b1101-b58d-541b-a86a-2c83fdd7efd2 with identifier: JV77194
2026-03-30 10:59:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 466b1101-b58d-541b-a86a-2c83fdd7efd2 with identifier: JV77194
2026-03-30 10:59:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 466b1101-b58d-541b-a86a-2c83fdd7efd2 with identifier: JV77194 to the API
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:52:16Z',
 'fuel_type': 'diesel',
 'id': '466b1101-b58d-541b-a86a-2c83fdd7efd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV77194',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 184714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-02',
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2013}
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV77194%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Saving data for JV77194: {'auction_closing_time': 1774885936.0, 'created_time': 1773429144.839416, 'last_price_update_time': 1774868390.075927}
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV77194') HTTP/1.1" 204 0
2026-03-30 10:59:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: DG73044
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG73044%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for DG73044: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: LS65332
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: AB72988
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB72988%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for AB72988: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: LJ53831
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ53831%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for LJ53831: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: ND38532
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: US43373
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: BA31495
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31495%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for BA31495: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: ZL30949
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30949%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for ZL30949: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: AE93045
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE93045%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for AE93045: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: PL79897
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: XN26589
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26589%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for XN26589: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: UL11203
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11203%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for UL11203: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: BZ78567
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ78567%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for BZ78567: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: SA82608
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82608%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for SA82608: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: ZC62608
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC62608%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for ZC62608: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: WG96363
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG96363%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for WG96363: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: VV98956
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: PS52652
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS52652%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for PS52652: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: XP82440
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: CP99772
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP99772%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for CP99772: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: HY33546
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: PF77212
2026-03-30 10:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:51 [auto1.de] INFO: Channel: 24h | Page: 104 | totalHits: 9555 | hits on page: 40
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: PF77212
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: BJ29098
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: WZ92700
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: FM08350
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: MU77879
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU77879%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for MU77879: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: VJ44121
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ44121%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for VJ44121: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: NN28121
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: SY16661
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY16661%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for SY16661: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: FD93722
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: PA80529
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: DW77262
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77262%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for DW77262: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: RD35105
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: BA65327
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN95277%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for VN95277: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: PW56805
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW56805%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for PW56805: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: ZV21910
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: FZ49091
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ49091%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for FZ49091: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: SJ72681
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: KS48100
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: GF62239
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF62239%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for GF62239: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: TA56984
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: XB91859
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB91859%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for XB91859: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: ZC04825
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: UL81757
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL81757%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for UL81757: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: HL01818
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01818%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for HL01818: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: CS17953
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: HV61627
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV61627%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for HV61627: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: BH53134
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: BV55429
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV55429%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for BV55429: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: EC33073
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33073%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for EC33073: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: EL73218
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL73218%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for EL73218: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: VJ38627
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: WK71622
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: VJ57461
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57461%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for VJ57461: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: ZW06761
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW06761%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for ZW06761: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: ZE48308
2026-03-30 10:59:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:52 [auto1.de] INFO: Channel: 24h | Page: 105 | totalHits: 9555 | hits on page: 40
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: XP46424
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: KZ61703
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: XC13487
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC13487%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for XC13487: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: TY49191
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: BY55773
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: KB43733
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB43733%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for KB43733: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: JL05117
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL05117%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for JL05117: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: AZ14861
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ14861%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for AZ14861: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: UH00039
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: AZ92098
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ92098%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for AZ92098: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: LU22691
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU22691%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for LU22691: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: JP14233
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP14233%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for JP14233: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: GA28860
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: KS23837
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS23837%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for KS23837: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: RF22787
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: GA19207
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA19207%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for GA19207: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: HG25993
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: UF45337
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: JH35819
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: HM43288
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: PR95726
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: CR29385
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR29385%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for CR29385: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: LB66833
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: HF53882
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF53882%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for HF53882: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: BZ12111
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: SS89253
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89253%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for SS89253: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: MG70959
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: WN72573
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN72573%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for WN72573: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: GA77532
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA77532%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for GA77532: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: ZF28924
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: HV14674
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV14674%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for HV14674: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: DJ14237
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: AE42693
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE42693%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for AE42693: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: DN26053
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN26053%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for DN26053: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: EV58982
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: VN01043
2026-03-30 10:59:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:54 [auto1.de] INFO: Channel: 24h | Page: 106 | totalHits: 9555 | hits on page: 40
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: PC60624
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60624%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for PC60624: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: PN56757
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: PJ54145
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: NY21217
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: CH75769
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: KH16310
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH16310%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for KH16310: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: NJ46216
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ46216%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for NJ46216: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: UH34905
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH34905%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for UH34905: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: ZV61779
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: KE72170
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE72170%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for KE72170: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN13363%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for AN13363: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: YM02183
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: VB62953
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB62953%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for VB62953: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: LC91854
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91854%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for LC91854: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: TZ67975
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: WS48624
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48624%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for WS48624: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: AE20511
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: WV15803
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: PF14640
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: HM75653
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: YY45695
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY45695%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for YY45695: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY85938%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for SY85938: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88975%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for ZM88975: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: DF94308
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: UB45914
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45914%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for UB45914: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: EB91533
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB91533%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for EB91533: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: NW86422
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW86422%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for NW86422: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: WN92632
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN92632%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for WN92632: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: NT28876
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: UH43382
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH43382%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for UH43382: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ18760%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for LJ18760: 2
2026-03-30 10:59:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faf327d3-7715-5496-9bd5-cef1eef3ec2f with identifier: LJ18760
2026-03-30 10:59:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faf327d3-7715-5496-9bd5-cef1eef3ec2f with scrape type 2
2026-03-30 10:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faf327d3-7715-5496-9bd5-cef1eef3ec2f with scrape type 2
2026-03-30 10:59:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: faf327d3-7715-5496-9bd5-cef1eef3ec2f, identifier: LJ18760
2026-03-30 10:59:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: faf327d3-7715-5496-9bd5-cef1eef3ec2f with identifier: LJ18760
2026-03-30 10:59:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: faf327d3-7715-5496-9bd5-cef1eef3ec2f with identifier: LJ18760
2026-03-30 10:59:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: faf327d3-7715-5496-9bd5-cef1eef3ec2f with identifier: LJ18760 to the API
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:56Z',
 'fuel_type': 'petrol',
 'id': 'faf327d3-7715-5496-9bd5-cef1eef3ec2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ18760',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 50564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-08',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid Trend 2WD',
 'transmission': 'automatic',
 'trim': 'Trend 2WD',
 'year': 2023}
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ18760%27 HTTP/1.1" 200 None
2026-03-30 10:59:55 [auto1.de] INFO: Saving data for LJ18760: {'auction_closing_time': 1774883816.0, 'created_time': 1774596634.790609, 'last_price_update_time': 1774868395.110526}
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ18760') HTTP/1.1" 204 0
2026-03-30 10:59:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: EU98596
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98596%27 HTTP/1.1" 200 None
2026-03-30 10:59:55 [auto1.de] INFO: Scrape type for EU98596: 0
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH81029%27 HTTP/1.1" 200 None
2026-03-30 10:59:55 [auto1.de] INFO: Scrape type for YH81029: 0
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: TT83472
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: BY26961
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY26961%27 HTTP/1.1" 200 None
2026-03-30 10:59:55 [auto1.de] INFO: Scrape type for BY26961: 0
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: WE65713
2026-03-30 10:59:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:56 [auto1.de] INFO: Channel: 24h | Page: 107 | totalHits: 9555 | hits on page: 40
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: CX50338
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: RR77511
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR77511%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for RR77511: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: FD81187
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD81187%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for FD81187: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: HM36828
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: AR04951
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: HW87137
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW87137%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for HW87137: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: RD48040
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: MT08770
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT08770%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for MT08770: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: CD05825
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: JM39243
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM39243%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for JM39243: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: TD54604
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD54604%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for TD54604: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: VH61709
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61709%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for VH61709: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: UM10671
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: LN75673
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: SG95649
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG95649%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for SG95649: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: JV89856
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: CD09262
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD09262%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for CD09262: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: GX08405
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: BL21282
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: VU47138
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: DT85879
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT85879%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for DT85879: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: GT07597
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: RG01801
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG01801%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for RG01801: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: KU58060
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: SH55749
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: AZ40865
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: YA93761
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA93761%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for YA93761: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: JS20731
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS20731%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for JS20731: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: BC03765
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: SP41921
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: AB35938
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: GS69685
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS69685%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for GS69685: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: TD57805
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: ZJ78917
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ78917%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for ZJ78917: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: SD97689
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97689%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for SD97689: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA75258%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for GA75258: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: XB58662
2026-03-30 10:59:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:04 [scrapy.extensions.logstats] INFO: Crawled 853 pages (at 24 pages/min), scraped 1350 items (at 34 items/min)
2026-03-30 11:00:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:27 [auto1.de] INFO: Channel: 24h | Page: 108 | totalHits: 9557 | hits on page: 40
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA75258%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for GA75258: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: XB58662
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28437%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for SG28437: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP57699%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for JP57699: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB22457%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for LB22457: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51921%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for AA51921: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: TE89273
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE89273%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for TE89273: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: ZT71502
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT71502%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for ZT71502: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: HT62005
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT62005%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for HT62005: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: DL77544
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: HB66964
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB66964%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for HB66964: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU00556%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for LU00556: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: CU90865
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: CF43434
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: GB26744
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: BE47693
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: TL23560
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: RC68587
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC68587%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for RC68587: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: KH74255
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: NU04580
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: KA82816
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: NX86319
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX86319%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for NX86319: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: VZ25719
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: NM84530
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM84530%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for NM84530: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: BJ97003
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: KY27003
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY27003%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for KY27003: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: WZ51755
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ51755%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for WZ51755: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: XV87595
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV87595%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for XV87595: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: TU42295
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU42295%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for TU42295: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: ZX84007
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX84007%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for ZX84007: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: KR20197
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR20197%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for KR20197: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV50908%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for FV50908: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC55438%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for CC55438: 2
2026-03-30 11:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46770eb6-9132-56e6-876b-f993d53b14dd with identifier: CC55438
2026-03-30 11:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46770eb6-9132-56e6-876b-f993d53b14dd with scrape type 2
2026-03-30 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46770eb6-9132-56e6-876b-f993d53b14dd with scrape type 2
2026-03-30 11:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46770eb6-9132-56e6-876b-f993d53b14dd, identifier: CC55438
2026-03-30 11:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46770eb6-9132-56e6-876b-f993d53b14dd with identifier: CC55438
2026-03-30 11:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46770eb6-9132-56e6-876b-f993d53b14dd with identifier: CC55438
2026-03-30 11:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46770eb6-9132-56e6-876b-f993d53b14dd with identifier: CC55438 to the API
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:19:58Z',
 'fuel_type': 'diesel',
 'id': '46770eb6-9132-56e6-876b-f993d53b14dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC55438',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 118261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-10',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 3.0 CRD Overland',
 'transmission': 'automatic',
 'trim': 'Overland',
 'year': 2016}
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC55438%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Saving data for CC55438: {'auction_closing_time': 1774883998.0, 'created_time': 1773302092.419733, 'last_price_update_time': 1774868429.755481}
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC55438') HTTP/1.1" 204 0
2026-03-30 11:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:30 [auto1.de] INFO: Channel: 24h | Page: 109 | totalHits: 9557 | hits on page: 40
2026-03-30 11:00:30 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47170%27 HTTP/1.1" 200 None
2026-03-30 11:00:30 [auto1.de] INFO: Scrape type for NT47170: 0
2026-03-30 11:00:30 [auto1.de] INFO: Found listing with ID: LP76245
2026-03-30 11:00:30 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC87676%27 HTTP/1.1" 200 None
2026-03-30 11:00:30 [auto1.de] INFO: Scrape type for SC87676: 0
2026-03-30 11:00:30 [auto1.de] INFO: Found listing with ID: EC33750
2026-03-30 11:00:30 [auto1.de] INFO: Found listing with ID: MH70992
2026-03-30 11:00:30 [auto1.de] INFO: Found listing with ID: WP14042
2026-03-30 11:00:30 [auto1.de] INFO: Found listing with ID: HN44091
2026-03-30 11:00:30 [auto1.de] INFO: Found listing with ID: AB27737
2026-03-30 11:00:30 [auto1.de] INFO: Found listing with ID: AB91647
2026-03-30 11:00:30 [auto1.de] INFO: Found listing with ID: RN81514
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN81514%27 HTTP/1.1" 200 None
2026-03-30 11:00:30 [auto1.de] INFO: Scrape type for RN81514: 0
2026-03-30 11:00:30 [auto1.de] INFO: Found listing with ID: JC28332
2026-03-30 11:00:30 [auto1.de] INFO: Found listing with ID: GY96570
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY96570%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for GY96570: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX68266%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for DX68266: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: HM57840
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: FY99153
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY99153%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for FY99153: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: UC60552
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC60552%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for UC60552: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: MF52928
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: AM15816
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: MM43491
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM43491%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for MM43491: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: AX08023
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: SA10285
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA10285%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for SA10285: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: PG24864
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24864%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for PG24864: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: VH75951
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: NV16003
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: XZ81913
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN00007%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for FN00007: 2
2026-03-30 11:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c592b64-a120-5bf8-a3f5-8bb368b63cdd with identifier: FN00007
2026-03-30 11:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c592b64-a120-5bf8-a3f5-8bb368b63cdd with scrape type 2
2026-03-30 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c592b64-a120-5bf8-a3f5-8bb368b63cdd with scrape type 2
2026-03-30 11:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c592b64-a120-5bf8-a3f5-8bb368b63cdd, identifier: FN00007
2026-03-30 11:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c592b64-a120-5bf8-a3f5-8bb368b63cdd with identifier: FN00007
2026-03-30 11:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c592b64-a120-5bf8-a3f5-8bb368b63cdd with identifier: FN00007
2026-03-30 11:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c592b64-a120-5bf8-a3f5-8bb368b63cdd with identifier: FN00007 to the API
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:45:59Z',
 'fuel_type': 'petrol',
 'id': '4c592b64-a120-5bf8-a3f5-8bb368b63cdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN00007',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 99371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-29',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Competizione',
 'transmission': 'manual',
 'trim': 'Competizione',
 'year': 2013}
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN00007%27 HTTP/1.1" 200 None
2026-03-30 11:00:32 [auto1.de] INFO: Saving data for FN00007: {'auction_closing_time': 1774885559.0, 'created_time': 1774596643.906591, 'last_price_update_time': 1774868432.319774}
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN00007') HTTP/1.1" 204 0
2026-03-30 11:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:32 [auto1.de] INFO: Found listing with ID: VJ41763
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ41763%27 HTTP/1.1" 200 None
2026-03-30 11:00:32 [auto1.de] INFO: Scrape type for VJ41763: 0
2026-03-30 11:00:32 [auto1.de] INFO: Found listing with ID: KE01132
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01132%27 HTTP/1.1" 200 None
2026-03-30 11:00:32 [auto1.de] INFO: Scrape type for KE01132: 0
2026-03-30 11:00:32 [auto1.de] INFO: Found listing with ID: BN05463
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN05463%27 HTTP/1.1" 200 None
2026-03-30 11:00:32 [auto1.de] INFO: Scrape type for BN05463: 0
2026-03-30 11:00:32 [auto1.de] INFO: Found listing with ID: ZP35673
2026-03-30 11:00:32 [auto1.de] INFO: Found listing with ID: KU33020
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU33020%27 HTTP/1.1" 200 None
2026-03-30 11:00:32 [auto1.de] INFO: Scrape type for KU33020: 0
2026-03-30 11:00:32 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-30 11:00:32 [auto1.de] INFO: Found listing with ID: NZ97529
2026-03-30 11:00:32 [auto1.de] INFO: Found listing with ID: LY63644
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY63644%27 HTTP/1.1" 200 None
2026-03-30 11:00:32 [auto1.de] INFO: Scrape type for LY63644: 0
2026-03-30 11:00:32 [auto1.de] INFO: Found listing with ID: ES42650
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES42650%27 HTTP/1.1" 200 None
2026-03-30 11:00:32 [auto1.de] INFO: Scrape type for ES42650: 0
2026-03-30 11:00:32 [auto1.de] INFO: Found listing with ID: DE98094
2026-03-30 11:00:32 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-30 11:00:32 [auto1.de] INFO: Found listing with ID: SC90935
2026-03-30 11:00:32 [auto1.de] INFO: Found listing with ID: UE61705
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE61705%27 HTTP/1.1" 200 None
2026-03-30 11:00:32 [auto1.de] INFO: Scrape type for UE61705: 0
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:34 [auto1.de] INFO: Channel: 24h | Page: 110 | totalHits: 9557 | hits on page: 40
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: LH20515
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH20515%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [auto1.de] INFO: Scrape type for LH20515: 0
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: ZE90376
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: ED89448
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED89448%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [auto1.de] INFO: Scrape type for ED89448: 0
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: XR74072
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR74072%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [auto1.de] INFO: Scrape type for XR74072: 2
2026-03-30 11:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90000786-ff54-5003-9562-f8ca4daaf791 with identifier: XR74072
2026-03-30 11:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90000786-ff54-5003-9562-f8ca4daaf791 with scrape type 2
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90000786-ff54-5003-9562-f8ca4daaf791 with scrape type 2
2026-03-30 11:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90000786-ff54-5003-9562-f8ca4daaf791, identifier: XR74072
2026-03-30 11:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90000786-ff54-5003-9562-f8ca4daaf791 with identifier: XR74072
2026-03-30 11:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90000786-ff54-5003-9562-f8ca4daaf791 with identifier: XR74072
2026-03-30 11:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90000786-ff54-5003-9562-f8ca4daaf791 with identifier: XR74072 to the API
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:42:53Z',
 'fuel_type': 'petrol',
 'id': '90000786-ff54-5003-9562-f8ca4daaf791',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR74072',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 193477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-08',
 'seller_name': None,
 'title': 'Skoda Fabia 1.6 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR74072%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Saving data for XR74072: {'auction_closing_time': 1774885373.0, 'created_time': 1773400675.632472, 'last_price_update_time': 1774868435.108667}
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR74072') HTTP/1.1" 204 0
2026-03-30 11:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: NK09609
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: SF00681
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF00681%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for SF00681: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA81936%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for SA81936: 2
2026-03-30 11:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6543a61-abaf-57bc-85f3-6e55a931f1c1 with identifier: SA81936
2026-03-30 11:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6543a61-abaf-57bc-85f3-6e55a931f1c1 with scrape type 2
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6543a61-abaf-57bc-85f3-6e55a931f1c1 with scrape type 2
2026-03-30 11:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6543a61-abaf-57bc-85f3-6e55a931f1c1, identifier: SA81936
2026-03-30 11:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6543a61-abaf-57bc-85f3-6e55a931f1c1 with identifier: SA81936
2026-03-30 11:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6543a61-abaf-57bc-85f3-6e55a931f1c1 with identifier: SA81936
2026-03-30 11:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6543a61-abaf-57bc-85f3-6e55a931f1c1 with identifier: SA81936 to the API
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:22:48Z',
 'fuel_type': 'diesel',
 'id': 'c6543a61-abaf-57bc-85f3-6e55a931f1c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA81936',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 189681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-28',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline 4Motion BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline 4Motion BlueMotion',
 'year': 2013}
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA81936%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Saving data for SA81936: {'auction_closing_time': 1774884168.0, 'created_time': 1773945848.929467, 'last_price_update_time': 1774868435.658504}
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA81936') HTTP/1.1" 204 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: ZE41577
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE41577%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for ZE41577: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: JE00015
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE00015%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for JE00015: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: UL75790
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: ZS46633
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS46633%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for ZS46633: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: UM95943
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM95943%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for UM95943: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: FC97863
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: US49854
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: BE14691
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ32972%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for NZ32972: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: UD14847
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD14847%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for UD14847: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: MR34714
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: CE15038
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: ZB74366
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB74366%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for ZB74366: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: JS64432
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS64432%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for JS64432: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: KF39713
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39713%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for KF39713: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: RG49246
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: GY11970
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY11970%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for GY11970: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: XR26970
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR26970%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for XR26970: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: BD66077
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD66077%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for BD66077: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: AG64287
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG64287%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for AG64287: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: LR49989
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: FK95510
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK95510%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for FK95510: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: VU33733
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU33733%27 HTTP/1.1" 200 None
2026-03-30 11:00:36 [auto1.de] INFO: Scrape type for VU33733: 0
2026-03-30 11:00:36 [auto1.de] INFO: Found listing with ID: MY48468
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48468%27 HTTP/1.1" 200 None
2026-03-30 11:00:36 [auto1.de] INFO: Scrape type for MY48468: 0
2026-03-30 11:00:36 [auto1.de] INFO: Found listing with ID: ET94101
2026-03-30 11:00:36 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF57036%27 HTTP/1.1" 200 None
2026-03-30 11:00:36 [auto1.de] INFO: Scrape type for BF57036: 0
2026-03-30 11:00:36 [auto1.de] INFO: Found listing with ID: XT91998
2026-03-30 11:00:36 [auto1.de] INFO: Found listing with ID: MF75644
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF75644%27 HTTP/1.1" 200 None
2026-03-30 11:00:36 [auto1.de] INFO: Scrape type for MF75644: 0
2026-03-30 11:00:36 [auto1.de] INFO: Found listing with ID: DL95738
2026-03-30 11:00:36 [auto1.de] INFO: Found listing with ID: BS37801
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS37801%27 HTTP/1.1" 200 None
2026-03-30 11:00:36 [auto1.de] INFO: Scrape type for BS37801: 0
2026-03-30 11:00:36 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-30 11:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:44 [auto1.de] INFO: Channel: 24h | Page: 111 | totalHits: 9557 | hits on page: 40
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: SZ97715
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: WA46959
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: BJ34801
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: YV03143
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: UC57196
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC57196%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.de] INFO: Scrape type for UC57196: 0
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: VJ57746
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: GG93130
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG93130%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.de] INFO: Scrape type for GG93130: 0
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: TU08005
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU08005%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.de] INFO: Scrape type for TU08005: 0
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: ML06015
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML06015%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.de] INFO: Scrape type for ML06015: 0
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: NR35268
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35268%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.de] INFO: Scrape type for NR35268: 0
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: BG37163
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: AZ42176
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: MK66887
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: VH61695
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: UC31654
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC31654%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.de] INFO: Scrape type for UC31654: 0
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: TV18739
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18739%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.de] INFO: Scrape type for TV18739: 0
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: NZ89642
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: CD76809
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD76809%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.de] INFO: Scrape type for CD76809: 0
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: YK98725
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: JM79272
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: EE77460
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE77460%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.de] INFO: Scrape type for EE77460: 0
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: KF96010
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: KS26285
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS26285%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.de] INFO: Scrape type for KS26285: 0
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: EG39650
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39650%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.de] INFO: Scrape type for EG39650: 0
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: KH46132
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH46132%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.de] INFO: Scrape type for KH46132: 0
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: XF55006
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF55006%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.de] INFO: Scrape type for XF55006: 0
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: GJ42738
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ42738%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.de] INFO: Scrape type for GJ42738: 0
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF88464%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.de] INFO: Scrape type for AF88464: 0
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89104%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.de] INFO: Scrape type for HA89104: 0
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: PP83297
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: UA99950
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27996%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.de] INFO: Scrape type for DM27996: 0
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: EL92267
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: JN95479
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: AA46272
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA46272%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.de] INFO: Scrape type for AA46272: 0
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: RK12981
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: ES37621
2026-03-30 11:00:44 [auto1.de] INFO: Found listing with ID: ZT53548
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT53548%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.de] INFO: Scrape type for ZT53548: 0
2026-03-30 11:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:04 [scrapy.extensions.logstats] INFO: Crawled 857 pages (at 4 pages/min), scraped 1354 items (at 4 items/min)
2026-03-30 11:01:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:19 [auto1.de] INFO: Channel: 24h | Page: 112 | totalHits: 9558 | hits on page: 40
2026-03-30 11:01:19 [auto1.de] INFO: Found listing with ID: ZT53548
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT53548%27 HTTP/1.1" 200 None
2026-03-30 11:01:19 [auto1.de] INFO: Scrape type for ZT53548: 0
2026-03-30 11:01:19 [auto1.de] INFO: Found listing with ID: HC77687
2026-03-30 11:01:19 [auto1.de] INFO: Found listing with ID: FV67492
2026-03-30 11:01:19 [auto1.de] INFO: Found listing with ID: AM78577
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM78577%27 HTTP/1.1" 200 None
2026-03-30 11:01:19 [auto1.de] INFO: Scrape type for AM78577: 0
2026-03-30 11:01:19 [auto1.de] INFO: Found listing with ID: VC64340
2026-03-30 11:01:19 [auto1.de] INFO: Found listing with ID: XG77480
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG77480%27 HTTP/1.1" 200 None
2026-03-30 11:01:19 [auto1.de] INFO: Scrape type for XG77480: 0
2026-03-30 11:01:19 [auto1.de] INFO: Found listing with ID: FR92717
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR92717%27 HTTP/1.1" 200 None
2026-03-30 11:01:19 [auto1.de] INFO: Scrape type for FR92717: 0
2026-03-30 11:01:19 [auto1.de] INFO: Found listing with ID: DT94754
2026-03-30 11:01:19 [auto1.de] INFO: Found listing with ID: RL19832
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL19832%27 HTTP/1.1" 200 None
2026-03-30 11:01:19 [auto1.de] INFO: Scrape type for RL19832: 0
2026-03-30 11:01:19 [auto1.de] INFO: Found listing with ID: TX63688
2026-03-30 11:01:19 [auto1.de] INFO: Found listing with ID: MR65343
2026-03-30 11:01:19 [auto1.de] INFO: Found listing with ID: PW12132
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW12132%27 HTTP/1.1" 200 None
2026-03-30 11:01:19 [auto1.de] INFO: Scrape type for PW12132: 0
2026-03-30 11:01:19 [auto1.de] INFO: Found listing with ID: DB36710
2026-03-30 11:01:19 [auto1.de] INFO: Found listing with ID: FB02841
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02841%27 HTTP/1.1" 200 None
2026-03-30 11:01:19 [auto1.de] INFO: Scrape type for FB02841: 0
2026-03-30 11:01:19 [auto1.de] INFO: Found listing with ID: HK50070
2026-03-30 11:01:19 [auto1.de] INFO: Found listing with ID: NT04254
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT04254%27 HTTP/1.1" 200 None
2026-03-30 11:01:20 [auto1.de] INFO: Scrape type for NT04254: 0
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: CD56647
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: CL62984
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL62984%27 HTTP/1.1" 200 None
2026-03-30 11:01:20 [auto1.de] INFO: Scrape type for CL62984: 0
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: GV91786
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91786%27 HTTP/1.1" 200 None
2026-03-30 11:01:20 [auto1.de] INFO: Scrape type for GV91786: 0
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: KP48554
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: JV68921
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68921%27 HTTP/1.1" 200 None
2026-03-30 11:01:20 [auto1.de] INFO: Scrape type for JV68921: 0
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH02109%27 HTTP/1.1" 200 None
2026-03-30 11:01:20 [auto1.de] INFO: Scrape type for GH02109: 0
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: AY74749
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: FP33840
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP33840%27 HTTP/1.1" 200 None
2026-03-30 11:01:20 [auto1.de] INFO: Scrape type for FP33840: 0
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: FE12352
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE12352%27 HTTP/1.1" 200 None
2026-03-30 11:01:20 [auto1.de] INFO: Scrape type for FE12352: 0
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: CM74095
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM74095%27 HTTP/1.1" 200 None
2026-03-30 11:01:20 [auto1.de] INFO: Scrape type for CM74095: 0
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: LM10122
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10122%27 HTTP/1.1" 200 None
2026-03-30 11:01:20 [auto1.de] INFO: Scrape type for LM10122: 0
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: SD32112
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE40568%27 HTTP/1.1" 200 None
2026-03-30 11:01:20 [auto1.de] INFO: Scrape type for ZE40568: 0
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: AU35390
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: EA74334
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: VU50436
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU50436%27 HTTP/1.1" 200 None
2026-03-30 11:01:20 [auto1.de] INFO: Scrape type for VU50436: 0
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: FC83292
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC83292%27 HTTP/1.1" 200 None
2026-03-30 11:01:20 [auto1.de] INFO: Scrape type for FC83292: 0
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG45518%27 HTTP/1.1" 200 None
2026-03-30 11:01:20 [auto1.de] INFO: Scrape type for HG45518: 0
2026-03-30 11:01:20 [auto1.de] INFO: Found listing with ID: YH59538
2026-03-30 11:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:52 [auto1.de] INFO: Channel: 24h | Page: 113 | totalHits: 9558 | hits on page: 40
2026-03-30 11:01:52 [auto1.de] INFO: Found listing with ID: GN89832
2026-03-30 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN89832%27 HTTP/1.1" 200 None
2026-03-30 11:01:52 [auto1.de] INFO: Scrape type for GN89832: 0
2026-03-30 11:01:52 [auto1.de] INFO: Found listing with ID: GJ82118
2026-03-30 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ82118%27 HTTP/1.1" 200 None
2026-03-30 11:01:52 [auto1.de] INFO: Scrape type for GJ82118: 0
2026-03-30 11:01:52 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-30 11:01:52 [auto1.de] INFO: Found listing with ID: HB62696
2026-03-30 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB62696%27 HTTP/1.1" 200 None
2026-03-30 11:01:52 [auto1.de] INFO: Scrape type for HB62696: 0
2026-03-30 11:01:52 [auto1.de] INFO: Found listing with ID: BF27156
2026-03-30 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF27156%27 HTTP/1.1" 200 None
2026-03-30 11:01:52 [auto1.de] INFO: Scrape type for BF27156: 0
2026-03-30 11:01:52 [auto1.de] INFO: Found listing with ID: UP66494
2026-03-30 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP66494%27 HTTP/1.1" 200 None
2026-03-30 11:01:52 [auto1.de] INFO: Scrape type for UP66494: 0
2026-03-30 11:01:52 [auto1.de] INFO: Found listing with ID: RE17232
2026-03-30 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17232%27 HTTP/1.1" 200 None
2026-03-30 11:01:52 [auto1.de] INFO: Scrape type for RE17232: 0
2026-03-30 11:01:52 [auto1.de] INFO: Found listing with ID: FK87284
2026-03-30 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87284%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for FK87284: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: KE52706
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE52706%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for KE52706: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: RA54991
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: ED74506
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: DR38241
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR38241%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for DR38241: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: MJ60689
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: BP78735
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP78735%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for BP78735: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: YP61369
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP61369%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for YP61369: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: VX13516
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX13516%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for VX13516: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: NC36065
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC36065%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for NC36065: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: DV91076
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV91076%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for DV91076: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: JN34969
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34969%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for JN34969: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: DP29257
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: KK19800
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK19800%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for KK19800: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: XZ94866
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ94866%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for XZ94866: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: ET79003
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET79003%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for ET79003: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: EW47494
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW47494%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for EW47494: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL85665%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for VL85665: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: NP37775
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: LM85706
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85706%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for LM85706: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: PN64599
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: WY09596
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY09596%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for WY09596: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA05422%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for LA05422: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: KN80130
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN80130%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for KN80130: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: KX50860
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX50860%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for KX50860: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: NM50493
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM50493%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for NM50493: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF79085%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for RF79085: 0
2026-03-30 11:01:53 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE25239%27 HTTP/1.1" 200 None
2026-03-30 11:01:53 [auto1.de] INFO: Scrape type for BE25239: 0
2026-03-30 11:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:04 [scrapy.extensions.logstats] INFO: Crawled 859 pages (at 2 pages/min), scraped 1354 items (at 0 items/min)
2026-03-30 11:02:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:03:04 [scrapy.extensions.logstats] INFO: Crawled 859 pages (at 0 pages/min), scraped 1354 items (at 0 items/min)
2026-03-30 11:03:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:04:03 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.915(s), this was the 1st time calling it.
2026-03-30 11:04:03 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.484023672952385 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:04:04 [scrapy.extensions.logstats] INFO: Crawled 859 pages (at 0 pages/min), scraped 1354 items (at 0 items/min)
2026-03-30 11:04:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:04:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:10 [auto1.de] INFO: Channel: 24h | Page: 114 | totalHits: 9568 | hits on page: 40
2026-03-30 11:04:10 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-30 11:04:10 [auto1.de] INFO: Found listing with ID: WY09596
2026-03-30 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY09596%27 HTTP/1.1" 200 None
2026-03-30 11:04:11 [auto1.de] INFO: Scrape type for WY09596: 0
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA05422%27 HTTP/1.1" 200 None
2026-03-30 11:04:11 [auto1.de] INFO: Scrape type for LA05422: 0
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: KN80130
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN80130%27 HTTP/1.1" 200 None
2026-03-30 11:04:11 [auto1.de] INFO: Scrape type for KN80130: 0
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: KX50860
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX50860%27 HTTP/1.1" 200 None
2026-03-30 11:04:11 [auto1.de] INFO: Scrape type for KX50860: 0
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: NM50493
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM50493%27 HTTP/1.1" 200 None
2026-03-30 11:04:11 [auto1.de] INFO: Scrape type for NM50493: 0
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF79085%27 HTTP/1.1" 200 None
2026-03-30 11:04:11 [auto1.de] INFO: Scrape type for RF79085: 0
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE25239%27 HTTP/1.1" 200 None
2026-03-30 11:04:11 [auto1.de] INFO: Scrape type for BE25239: 0
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: FT64336
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: VE16712
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: JG35367
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: JM07569
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: LK12001
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12001%27 HTTP/1.1" 200 None
2026-03-30 11:04:11 [auto1.de] INFO: Scrape type for LK12001: 0
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: GU30537
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: UR98494
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: GH47357
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH47357%27 HTTP/1.1" 200 None
2026-03-30 11:04:11 [auto1.de] INFO: Scrape type for GH47357: 0
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: XJ52823
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: RU25678
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU25678%27 HTTP/1.1" 200 None
2026-03-30 11:04:11 [auto1.de] INFO: Scrape type for RU25678: 0
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: CC57472
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: YY13521
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: GV09290
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV09290%27 HTTP/1.1" 200 None
2026-03-30 11:04:11 [auto1.de] INFO: Scrape type for GV09290: 0
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: ZM88762
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88762%27 HTTP/1.1" 200 None
2026-03-30 11:04:11 [auto1.de] INFO: Scrape type for ZM88762: 0
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: BU00695
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: ER31380
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: GH30720
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: YS02767
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS02767%27 HTTP/1.1" 200 None
2026-03-30 11:04:11 [auto1.de] INFO: Scrape type for YS02767: 0
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: KL90594
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL90594%27 HTTP/1.1" 200 None
2026-03-30 11:04:11 [auto1.de] INFO: Scrape type for KL90594: 0
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: WF16745
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: JZ68133
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ68133%27 HTTP/1.1" 200 None
2026-03-30 11:04:11 [auto1.de] INFO: Scrape type for JZ68133: 0
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: YW15548
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW15548%27 HTTP/1.1" 200 None
2026-03-30 11:04:11 [auto1.de] INFO: Scrape type for YW15548: 0
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: SR15436
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: SW57264
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: UC84662
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: DF45808
2026-03-30 11:04:11 [auto1.de] INFO: Found listing with ID: KW12270
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW12270%27 HTTP/1.1" 200 None
2026-03-30 11:04:11 [auto1.de] INFO: Scrape type for KW12270: 0
2026-03-30 11:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:12 [auto1.de] INFO: Channel: 24h | Page: 115 | totalHits: 9568 | hits on page: 40
2026-03-30 11:04:12 [auto1.de] INFO: Found listing with ID: DX01657
2026-03-30 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01657%27 HTTP/1.1" 200 None
2026-03-30 11:04:12 [auto1.de] INFO: Scrape type for DX01657: 0
2026-03-30 11:04:12 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-30 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP43977%27 HTTP/1.1" 200 None
2026-03-30 11:04:12 [auto1.de] INFO: Scrape type for CP43977: 2
2026-03-30 11:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3abc42d-c754-5492-9a97-637e58f44563 with identifier: CP43977
2026-03-30 11:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3abc42d-c754-5492-9a97-637e58f44563 with scrape type 2
2026-03-30 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3abc42d-c754-5492-9a97-637e58f44563 with scrape type 2
2026-03-30 11:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3abc42d-c754-5492-9a97-637e58f44563, identifier: CP43977
2026-03-30 11:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3abc42d-c754-5492-9a97-637e58f44563 with identifier: CP43977
2026-03-30 11:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3abc42d-c754-5492-9a97-637e58f44563 with identifier: CP43977
2026-03-30 11:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3abc42d-c754-5492-9a97-637e58f44563 with identifier: CP43977 to the API
2026-03-30 11:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:40:41Z',
 'fuel_type': 'diesel',
 'id': 'f3abc42d-c754-5492-9a97-637e58f44563',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP43977',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 230472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-30',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2014}
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP43977%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Saving data for CP43977: {'auction_closing_time': 1774885241.0, 'created_time': 1774596638.895696, 'last_price_update_time': 1774868653.0718}
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP43977') HTTP/1.1" 204 0
2026-03-30 11:04:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: FT91695
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: PH27110
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP90284%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for DP90284: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: LZ58710
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: DT77440
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT77440%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for DT77440: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: SJ26339
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: KM87247
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM87247%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for KM87247: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: ME45713
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME45713%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for ME45713: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: RM44288
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: SN99491
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: WK97473
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: VG38985
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: KR04535
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR04535%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for KR04535: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: UZ90391
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90391%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for UZ90391: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: YN10477
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN10477%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for YN10477: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: KV78740
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV78740%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for KV78740: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: ZN20301
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20301%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for ZN20301: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: RT10354
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT10354%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for RT10354: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: WP28886
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP28886%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for WP28886: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: FL12267
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: AB87355
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB87355%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for AB87355: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: PY92753
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: RZ52630
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28576%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for ZD28576: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: EC78476
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC78476%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for EC78476: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: FB31140
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB31140%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for FB31140: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: BA95413
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA95413%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for BA95413: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: FU53159
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: JX37368
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: XL62342
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL62342%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for XL62342: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: RE63795
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE63795%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for RE63795: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: MZ72792
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72792%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for MZ72792: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: HU57590
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU57590%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for HU57590: 0
2026-03-30 11:04:13 [auto1.de] INFO: Found listing with ID: WV94095
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV94095%27 HTTP/1.1" 200 None
2026-03-30 11:04:13 [auto1.de] INFO: Scrape type for WV94095: 0
2026-03-30 11:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:21 [auto1.de] INFO: Channel: 24h | Page: 116 | totalHits: 9568 | hits on page: 40
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: PD00543
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD00543%27 HTTP/1.1" 200 None
2026-03-30 11:04:21 [auto1.de] INFO: Scrape type for PD00543: 0
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: HB06049
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB06049%27 HTTP/1.1" 200 None
2026-03-30 11:04:21 [auto1.de] INFO: Scrape type for HB06049: 0
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: BJ60837
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ60837%27 HTTP/1.1" 200 None
2026-03-30 11:04:21 [auto1.de] INFO: Scrape type for BJ60837: 0
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: VL06718
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06718%27 HTTP/1.1" 200 None
2026-03-30 11:04:21 [auto1.de] INFO: Scrape type for VL06718: 0
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: YP91741
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: DU27539
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU27539%27 HTTP/1.1" 200 None
2026-03-30 11:04:21 [auto1.de] INFO: Scrape type for DU27539: 0
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: LJ93781
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ93781%27 HTTP/1.1" 200 None
2026-03-30 11:04:21 [auto1.de] INFO: Scrape type for LJ93781: 0
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: DF63833
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: BP81340
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: RN03307
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN03307%27 HTTP/1.1" 200 None
2026-03-30 11:04:21 [auto1.de] INFO: Scrape type for RN03307: 0
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: FU39624
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: PA37640
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: UR77035
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77035%27 HTTP/1.1" 200 None
2026-03-30 11:04:21 [auto1.de] INFO: Scrape type for UR77035: 0
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: SW83321
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: EM22494
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: UD59606
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: NN66597
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN66597%27 HTTP/1.1" 200 None
2026-03-30 11:04:21 [auto1.de] INFO: Scrape type for NN66597: 0
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: MV18053
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: MU50288
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: YN95759
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN95759%27 HTTP/1.1" 200 None
2026-03-30 11:04:21 [auto1.de] INFO: Scrape type for YN95759: 0
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: KA22944
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: HB13325
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB13325%27 HTTP/1.1" 200 None
2026-03-30 11:04:21 [auto1.de] INFO: Scrape type for HB13325: 0
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: PV27021
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: JR17780
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17780%27 HTTP/1.1" 200 None
2026-03-30 11:04:21 [auto1.de] INFO: Scrape type for JR17780: 0
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: EZ35619
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: VG14564
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG14564%27 HTTP/1.1" 200 None
2026-03-30 11:04:21 [auto1.de] INFO: Scrape type for VG14564: 0
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: FU04810
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU04810%27 HTTP/1.1" 200 None
2026-03-30 11:04:21 [auto1.de] INFO: Scrape type for FU04810: 0
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: HB67029
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: GM08795
2026-03-30 11:04:21 [auto1.de] INFO: Found listing with ID: GV91046
2026-03-30 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91046%27 HTTP/1.1" 200 None
2026-03-30 11:04:22 [auto1.de] INFO: Scrape type for GV91046: 0
2026-03-30 11:04:22 [auto1.de] INFO: Found listing with ID: WY54008
2026-03-30 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY54008%27 HTTP/1.1" 200 None
2026-03-30 11:04:22 [auto1.de] INFO: Scrape type for WY54008: 0
2026-03-30 11:04:22 [auto1.de] INFO: Found listing with ID: PK38056
2026-03-30 11:04:22 [auto1.de] INFO: Found listing with ID: ED00109
2026-03-30 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED00109%27 HTTP/1.1" 200 None
2026-03-30 11:04:22 [auto1.de] INFO: Scrape type for ED00109: 0
2026-03-30 11:04:22 [auto1.de] INFO: Found listing with ID: SB60272
2026-03-30 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB60272%27 HTTP/1.1" 200 None
2026-03-30 11:04:22 [auto1.de] INFO: Scrape type for SB60272: 0
2026-03-30 11:04:22 [auto1.de] INFO: Found listing with ID: LR95574
2026-03-30 11:04:22 [auto1.de] INFO: Found listing with ID: RZ48384
2026-03-30 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ48384%27 HTTP/1.1" 200 None
2026-03-30 11:04:22 [auto1.de] INFO: Scrape type for RZ48384: 0
2026-03-30 11:04:22 [auto1.de] INFO: Found listing with ID: FG07323
2026-03-30 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG07323%27 HTTP/1.1" 200 None
2026-03-30 11:04:22 [auto1.de] INFO: Scrape type for FG07323: 0
2026-03-30 11:04:22 [auto1.de] INFO: Found listing with ID: GA42145
2026-03-30 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA42145%27 HTTP/1.1" 200 None
2026-03-30 11:04:22 [auto1.de] INFO: Scrape type for GA42145: 0
2026-03-30 11:04:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:40 [auto1.de] INFO: Channel: 24h | Page: 117 | totalHits: 9570 | hits on page: 40
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: FG07323
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG07323%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for FG07323: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: GA42145
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA42145%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for GA42145: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: NZ25875
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: YU93919
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: YR11157
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: TN32015
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN32015%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for TN32015: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: XB39806
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: XY68410
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY68410%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for XY68410: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: LG85121
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: TE25882
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: DA23811
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA23811%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for DA23811: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: TD17986
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD17986%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for TD17986: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: DZ79939
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ79939%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [auto1.de] INFO: Scrape type for DZ79939: 0
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: LR74805
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: AS21942
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS21942%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [auto1.de] INFO: Scrape type for AS21942: 0
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: MX03618
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: DC30039
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: XS38036
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS38036%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [auto1.de] INFO: Scrape type for XS38036: 0
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: RV99753
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV99753%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [auto1.de] INFO: Scrape type for RV99753: 0
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: MP20467
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: DT00101
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00101%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [auto1.de] INFO: Scrape type for DT00101: 0
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: UK63954
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: VM82441
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: MB94614
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB94614%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [auto1.de] INFO: Scrape type for MB94614: 0
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: CF62011
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: KC92334
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: WF80406
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: HS55483
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55483%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [auto1.de] INFO: Scrape type for HS55483: 0
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: FK07510
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: CR26855
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26855%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [auto1.de] INFO: Scrape type for CR26855: 0
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: BR02307
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02307%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [auto1.de] INFO: Scrape type for BR02307: 0
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: VP02166
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP02166%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [auto1.de] INFO: Scrape type for VP02166: 0
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: SV15826
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: DF30572
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF30572%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [auto1.de] INFO: Scrape type for DF30572: 0
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: FK97856
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK97856%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [auto1.de] INFO: Scrape type for FK97856: 0
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: PJ17742
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ17742%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [auto1.de] INFO: Scrape type for PJ17742: 0
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS09713%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [auto1.de] INFO: Scrape type for RS09713: 0
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE35464%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [auto1.de] INFO: Scrape type for HE35464: 0
2026-03-30 11:04:41 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB89503%27 HTTP/1.1" 200 None
2026-03-30 11:04:41 [auto1.de] INFO: Scrape type for RB89503: 0
2026-03-30 11:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:00 [auto1.de] INFO: Channel: 24h | Page: 118 | totalHits: 9573 | hits on page: 40
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS09713%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for RS09713: 0
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE35464%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for HE35464: 0
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB89503%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for RB89503: 0
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: JN99222
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN99222%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for JN99222: 0
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: ST87748
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: EY26571
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: LN30435
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: WP86079
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: DF02739
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF02739%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for DF02739: 0
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: GH93549
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH93549%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for GH93549: 0
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: VE57105
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: CL06528
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL06528%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for CL06528: 0
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: DL97595
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: CC99000
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: UB25361
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: VK94352
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK94352%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for VK94352: 0
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: YS81277
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81277%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for YS81277: 0
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: UC38867
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC38867%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for UC38867: 0
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: TN63570
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: HH61225
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH61225%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for HH61225: 0
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: FH53485
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF83806%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for VF83806: 0
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: JB33429
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: CK59033
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: TG33672
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG33672%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for TG33672: 0
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: DT42363
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR64586%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for NR64586: 0
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: GE96921
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: FW30112
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW30112%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for FW30112: 0
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: GC11605
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC11605%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for GC11605: 0
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: FM53272
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM53272%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for FM53272: 0
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: DW78199
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: UN96808
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: HB72145
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB72145%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for HB72145: 0
2026-03-30 11:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:01 [auto1.de] INFO: Channel: 24h | Page: 119 | totalHits: 9573 | hits on page: 40
2026-03-30 11:05:01 [auto1.de] INFO: Found listing with ID: DM95893
2026-03-30 11:05:01 [auto1.de] INFO: Found listing with ID: UL70410
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL70410%27 HTTP/1.1" 200 None
2026-03-30 11:05:01 [auto1.de] INFO: Scrape type for UL70410: 0
2026-03-30 11:05:01 [auto1.de] INFO: Found listing with ID: JS73501
2026-03-30 11:05:01 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-30 11:05:01 [auto1.de] INFO: Found listing with ID: DE41778
2026-03-30 11:05:01 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL41666%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for UL41666: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: RL23601
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL23601%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for RL23601: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: GB33155
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: UZ81937
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ81937%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for UZ81937: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: EB33579
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB33579%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for EB33579: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: AZ05535
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ05535%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for AZ05535: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: DW36097
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW36097%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for DW36097: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: MA42451
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: AU85949
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: MC22222
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC22222%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for MC22222: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: UB34830
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB34830%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for UB34830: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: YF48046
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF48046%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for YF48046: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH94786%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for FH94786: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH13363%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for DH13363: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: CH56246
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: MR96643
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: KV57112
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: KX26949
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX26949%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for KX26949: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: ZR08367
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: RN18911
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN18911%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for RN18911: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: WJ71458
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: DD89889
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD89889%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for DD89889: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: SX77194
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: VW82123
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW82123%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for VW82123: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: JJ95706
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ95706%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for JJ95706: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: CS76015
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: UH40808
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: XU52502
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: UA36533
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA36533%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for UA36533: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: CT74985
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT74985%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for CT74985: 0
2026-03-30 11:05:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:03 [auto1.de] INFO: Channel: 24h | Page: 120 | totalHits: 9572 | hits on page: 40
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: SG56142
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG56142%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.de] INFO: Scrape type for SG56142: 0
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: TB82704
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB82704%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.de] INFO: Scrape type for TB82704: 0
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: YJ71992
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ71992%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.de] INFO: Scrape type for YJ71992: 0
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: YJ51408
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: XN70423
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN70423%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.de] INFO: Scrape type for XN70423: 0
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: VG55778
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG55778%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.de] INFO: Scrape type for VG55778: 0
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: EX27277
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC56914%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.de] INFO: Scrape type for JC56914: 0
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: VX50427
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: UA25868
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: PA09921
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA09921%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.de] INFO: Scrape type for PA09921: 0
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: MZ60723
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: AD73380
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD73380%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.de] INFO: Scrape type for AD73380: 0
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD21016%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.de] INFO: Scrape type for LD21016: 0
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: GB19657
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: EJ57142
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ57142%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.de] INFO: Scrape type for EJ57142: 0
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: JJ39643
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: ZC19539
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC19539%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.de] INFO: Scrape type for ZC19539: 0
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: FG50189
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG50189%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.de] INFO: Scrape type for FG50189: 0
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: WB12349
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: BJ31953
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: ZA19141
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA19141%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.de] INFO: Scrape type for ZA19141: 0
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: BU60385
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU60385%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.de] INFO: Scrape type for BU60385: 0
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: PY88606
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88606%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.de] INFO: Scrape type for PY88606: 0
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: DF93652
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: VM51620
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM51620%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for VM51620: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: MK35059
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK35059%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for MK35059: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: WJ04835
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ04835%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for WJ04835: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: TX40951
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40951%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for TX40951: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: MA41049
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA41049%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for MA41049: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: GP15297
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP15297%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for GP15297: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: BU16541
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU16541%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for BU16541: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: EA67695
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA67695%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for EA67695: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: AV25336
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV25336%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for AV25336: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: BG86685
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG86685%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for BG86685: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: ER78775
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER78775%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for ER78775: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: TL76772
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: EC81606
2026-03-30 11:05:04 [scrapy.extensions.logstats] INFO: Crawled 866 pages (at 7 pages/min), scraped 1355 items (at 1 items/min)
2026-03-30 11:05:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:05:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:05 [auto1.de] INFO: Channel: 24h | Page: 121 | totalHits: 9572 | hits on page: 40
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: LT09542
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT09542%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.de] INFO: Scrape type for LT09542: 0
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: TM25044
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM25044%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.de] INFO: Scrape type for TM25044: 0
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA66980%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.de] INFO: Scrape type for LA66980: 0
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: ZN73895
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: MW91844
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: WA89012
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: ZW55395
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW55395%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.de] INFO: Scrape type for ZW55395: 0
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: VA54301
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY61993%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.de] INFO: Scrape type for VY61993: 0
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: SM09271
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU33695%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.de] INFO: Scrape type for MU33695: 0
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: DX42832
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: LV04533
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV04533%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.de] INFO: Scrape type for LV04533: 0
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: ND90067
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54097%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.de] INFO: Scrape type for HJ54097: 2
2026-03-30 11:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: feb9fca7-2a53-576c-8be8-d54e3e6a1ac0 with identifier: HJ54097
2026-03-30 11:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item feb9fca7-2a53-576c-8be8-d54e3e6a1ac0 with scrape type 2
2026-03-30 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item feb9fca7-2a53-576c-8be8-d54e3e6a1ac0 with scrape type 2
2026-03-30 11:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: feb9fca7-2a53-576c-8be8-d54e3e6a1ac0, identifier: HJ54097
2026-03-30 11:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: feb9fca7-2a53-576c-8be8-d54e3e6a1ac0 with identifier: HJ54097
2026-03-30 11:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: feb9fca7-2a53-576c-8be8-d54e3e6a1ac0 with identifier: HJ54097
2026-03-30 11:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: feb9fca7-2a53-576c-8be8-d54e3e6a1ac0 with identifier: HJ54097 to the API
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:02:16Z',
 'fuel_type': 'diesel',
 'id': 'feb9fca7-2a53-576c-8be8-d54e3e6a1ac0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ54097',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 135026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54097%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Saving data for HJ54097: {'auction_closing_time': 1774882936.0, 'created_time': 1774596634.348199, 'last_price_update_time': 1774868706.359379}
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ54097') HTTP/1.1" 204 0
2026-03-30 11:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10430%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for HA10430: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: RY91957
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY91957%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for RY91957: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: MF56816
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: DX24804
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX24804%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for DX24804: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: KG08192
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG08192%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for KG08192: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: PY46067
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: GL07101
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL07101%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for GL07101: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: YM55237
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: GY23917
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: TE32041
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE32041%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for TE32041: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX34455%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for HX34455: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: NL36228
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: YG72803
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG72803%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for YG72803: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00306%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for HX00306: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR62221%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for AR62221: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: BY14877
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY14877%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for BY14877: 0
2026-03-30 11:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:08 [auto1.de] INFO: Channel: 24h | Page: 122 | totalHits: 9572 | hits on page: 40
2026-03-30 11:05:08 [auto1.de] INFO: Found listing with ID: RA44966
2026-03-30 11:05:08 [auto1.de] INFO: Found listing with ID: CY90259
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY90259%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.de] INFO: Scrape type for CY90259: 0
2026-03-30 11:05:08 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-30 11:05:08 [auto1.de] INFO: Found listing with ID: ML64265
2026-03-30 11:05:08 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-30 11:05:08 [auto1.de] INFO: Found listing with ID: BZ09697
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ09697%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.de] INFO: Scrape type for BZ09697: 0
2026-03-30 11:05:08 [auto1.de] INFO: Found listing with ID: ZU18943
2026-03-30 11:05:08 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-30 11:05:08 [auto1.de] INFO: Found listing with ID: AV93240
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV93240%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.de] INFO: Scrape type for AV93240: 0
2026-03-30 11:05:08 [auto1.de] INFO: Found listing with ID: GC82813
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC82813%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.de] INFO: Scrape type for GC82813: 0
2026-03-30 11:05:08 [auto1.de] INFO: Found listing with ID: PL23541
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL23541%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.de] INFO: Scrape type for PL23541: 0
2026-03-30 11:05:08 [auto1.de] INFO: Found listing with ID: AB26225
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB26225%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.de] INFO: Scrape type for AB26225: 0
2026-03-30 11:05:08 [auto1.de] INFO: Found listing with ID: ND33880
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND33880%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.de] INFO: Scrape type for ND33880: 0
2026-03-30 11:05:08 [auto1.de] INFO: Found listing with ID: GE28071
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE28071%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.de] INFO: Scrape type for GE28071: 0
2026-03-30 11:05:08 [auto1.de] INFO: Found listing with ID: JJ68009
2026-03-30 11:05:08 [auto1.de] INFO: Found listing with ID: CR61198
2026-03-30 11:05:08 [auto1.de] INFO: Found listing with ID: FX62858
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX62858%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.de] INFO: Scrape type for FX62858: 0
2026-03-30 11:05:08 [auto1.de] INFO: Found listing with ID: SC70285
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC70285%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.de] INFO: Scrape type for SC70285: 0
2026-03-30 11:05:08 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX34768%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.de] INFO: Scrape type for BX34768: 2
2026-03-30 11:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17183509-0640-5e2d-ad31-9488c283422e with identifier: BX34768
2026-03-30 11:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17183509-0640-5e2d-ad31-9488c283422e with scrape type 2
2026-03-30 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17183509-0640-5e2d-ad31-9488c283422e with scrape type 2
2026-03-30 11:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17183509-0640-5e2d-ad31-9488c283422e, identifier: BX34768
2026-03-30 11:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17183509-0640-5e2d-ad31-9488c283422e with identifier: BX34768
2026-03-30 11:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17183509-0640-5e2d-ad31-9488c283422e with identifier: BX34768
2026-03-30 11:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17183509-0640-5e2d-ad31-9488c283422e with identifier: BX34768 to the API
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:53:40Z',
 'fuel_type': 'petrol',
 'id': '17183509-0640-5e2d-ad31-9488c283422e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX34768',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 16740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-14',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2018}
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX34768%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.de] INFO: Saving data for BX34768: {'auction_closing_time': 1774886020.0, 'created_time': 1774349465.328535, 'last_price_update_time': 1774868709.295211}
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX34768') HTTP/1.1" 204 0
2026-03-30 11:05:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: CF74386
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF74386%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.de] INFO: Scrape type for CF74386: 0
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: XB46016
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB46016%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.de] INFO: Scrape type for XB46016: 0
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: UZ04747
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: CG17958
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG17958%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.de] INFO: Scrape type for CG17958: 0
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: EH96711
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: FG09102
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG09102%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.de] INFO: Scrape type for FG09102: 0
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: YF25460
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF25460%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.de] INFO: Scrape type for YF25460: 0
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: DE62797
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: BN55276
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: XK87583
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK87583%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.de] INFO: Scrape type for XK87583: 0
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: KE90255
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90255%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.de] INFO: Scrape type for KE90255: 0
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: YD46257
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD46257%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.de] INFO: Scrape type for YD46257: 0
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: KJ55573
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ55573%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.de] INFO: Scrape type for KJ55573: 0
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: GJ72052
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72052%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.de] INFO: Scrape type for GJ72052: 0
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: UT25770
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT25770%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.de] INFO: Scrape type for UT25770: 0
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: RP89370
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP89370%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.de] INFO: Scrape type for RP89370: 0
2026-03-30 11:05:09 [auto1.de] INFO: Found listing with ID: JT51313
2026-03-30 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:11 [auto1.de] INFO: Channel: 24h | Page: 123 | totalHits: 9572 | hits on page: 40
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: TA14554
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA14554%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for TA14554: 0
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG30420%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for PG30420: 0
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: FX76120
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX76120%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for FX76120: 0
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: DB28845
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB28845%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for DB28845: 0
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: DG61616
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: AN15165
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: NF88064
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: UF84610
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF84610%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for UF84610: 0
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: VA07254
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA07254%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for VA07254: 0
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: DZ63876
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: VE65204
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: JV66840
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: PV33295
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: VW15579
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: MH20468
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: BP69075
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: BH45132
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: NW39371
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW39371%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for NW39371: 0
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: JN58244
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: CY45921
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: ZE28536
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: XX04518
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR95231%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for BR95231: 0
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY42207%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for BY42207: 0
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT60095%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for WT60095: 0
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT20326%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for ZT20326: 0
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: SV25975
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC65519%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for NC65519: 0
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: HZ20287
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ20287%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for HZ20287: 0
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD11027%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for MD11027: 0
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: FU20206
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU20206%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for FU20206: 0
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: VE80218
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE80218%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for VE80218: 0
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: LT47109
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT47109%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for LT47109: 0
2026-03-30 11:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:04 [scrapy.extensions.logstats] INFO: Crawled 869 pages (at 3 pages/min), scraped 1357 items (at 2 items/min)
2026-03-30 11:06:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:07:04 [scrapy.extensions.logstats] INFO: Crawled 869 pages (at 0 pages/min), scraped 1357 items (at 0 items/min)
2026-03-30 11:07:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:07:21 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.085(s), this was the 1st time calling it.
2026-03-30 11:07:21 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.550823017764466 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:07:50 [auto1.de] INFO: Channel: 24h | Page: 124 | totalHits: 9596 | hits on page: 40
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: BH45132
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: NW39371
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW39371%27 HTTP/1.1" 200 None
2026-03-30 11:07:50 [auto1.de] INFO: Scrape type for NW39371: 0
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: JN58244
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: CY45921
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: ZE28536
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: XX04518
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR95231%27 HTTP/1.1" 200 None
2026-03-30 11:07:50 [auto1.de] INFO: Scrape type for BR95231: 0
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY42207%27 HTTP/1.1" 200 None
2026-03-30 11:07:50 [auto1.de] INFO: Scrape type for BY42207: 0
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT60095%27 HTTP/1.1" 200 None
2026-03-30 11:07:50 [auto1.de] INFO: Scrape type for WT60095: 0
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT20326%27 HTTP/1.1" 200 None
2026-03-30 11:07:50 [auto1.de] INFO: Scrape type for ZT20326: 0
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: SV25975
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC65519%27 HTTP/1.1" 200 None
2026-03-30 11:07:50 [auto1.de] INFO: Scrape type for NC65519: 0
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: HZ20287
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ20287%27 HTTP/1.1" 200 None
2026-03-30 11:07:50 [auto1.de] INFO: Scrape type for HZ20287: 0
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD11027%27 HTTP/1.1" 200 None
2026-03-30 11:07:50 [auto1.de] INFO: Scrape type for MD11027: 0
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: FU20206
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU20206%27 HTTP/1.1" 200 None
2026-03-30 11:07:50 [auto1.de] INFO: Scrape type for FU20206: 0
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: VE80218
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE80218%27 HTTP/1.1" 200 None
2026-03-30 11:07:50 [auto1.de] INFO: Scrape type for VE80218: 0
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: LT47109
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT47109%27 HTTP/1.1" 200 None
2026-03-30 11:07:50 [auto1.de] INFO: Scrape type for LT47109: 0
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: LT13241
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: HR62368
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR62368%27 HTTP/1.1" 200 None
2026-03-30 11:07:50 [auto1.de] INFO: Scrape type for HR62368: 0
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: XD11713
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD11713%27 HTTP/1.1" 200 None
2026-03-30 11:07:50 [auto1.de] INFO: Scrape type for XD11713: 0
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: RH04581
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH04581%27 HTTP/1.1" 200 None
2026-03-30 11:07:50 [auto1.de] INFO: Scrape type for RH04581: 0
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: VV47802
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: YH04834
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: RK32817
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: UH90150
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT27360%27 HTTP/1.1" 200 None
2026-03-30 11:07:50 [auto1.de] INFO: Scrape type for RT27360: 0
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: NW35011
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW35011%27 HTTP/1.1" 200 None
2026-03-30 11:07:50 [auto1.de] INFO: Scrape type for NW35011: 0
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: GF78107
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF78107%27 HTTP/1.1" 200 None
2026-03-30 11:07:50 [auto1.de] INFO: Scrape type for GF78107: 0
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: UD88757
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: JP43917
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: CA34642
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA34642%27 HTTP/1.1" 200 None
2026-03-30 11:07:50 [auto1.de] INFO: Scrape type for CA34642: 0
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: YH72749
2026-03-30 11:07:50 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP50374%27 HTTP/1.1" 200 None
2026-03-30 11:07:50 [auto1.de] INFO: Scrape type for RP50374: 0
2026-03-30 11:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:07:58 [auto1.de] INFO: Channel: 24h | Page: 125 | totalHits: 9597 | hits on page: 40
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP50374%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for RP50374: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: KE92828
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: JW84966
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW84966%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for JW84966: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG74532%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for CG74532: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD86365%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for SD86365: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: SM47095
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM47095%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for SM47095: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: RG31591
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG31591%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for RG31591: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: SZ48596
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ48596%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for SZ48596: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: AD81240
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: AS96658
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: YE46941
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE46941%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for YE46941: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: ST98775
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: WM09546
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM09546%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for WM09546: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: MJ25721
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: BR11811
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR11811%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for BR11811: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: KT65416
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: DS71504
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS71504%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for DS71504: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: WG41390
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG41390%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for WG41390: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: GJ62462
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ62462%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for GJ62462: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: SC00063
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC00063%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for SC00063: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: DF96715
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY64526%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for FY64526: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: JY05464
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: WE79254
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE79254%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for WE79254: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: MT28952
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT28952%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for MT28952: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: KX24751
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: AE68185
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: XC67226
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: YT05119
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: NK84600
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK84600%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for NK84600: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: YT16808
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16808%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for YT16808: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: TY75534
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY75534%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for TY75534: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: AW88722
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW88722%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for AW88722: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: WD16900
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: CD75324
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD75324%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for CD75324: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: AP34925
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP34925%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for AP34925: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: ZJ19484
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ19484%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for ZJ19484: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB95370%27 HTTP/1.1" 200 None
2026-03-30 11:07:58 [auto1.de] INFO: Scrape type for JB95370: 0
2026-03-30 11:07:58 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-30 11:07:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:07:59 [auto1.de] INFO: Channel: 24h | Page: 126 | totalHits: 9598 | hits on page: 40
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: BD99191
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP95404%27 HTTP/1.1" 200 None
2026-03-30 11:07:59 [auto1.de] INFO: Scrape type for HP95404: 0
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY62714%27 HTTP/1.1" 200 None
2026-03-30 11:07:59 [auto1.de] INFO: Scrape type for ZY62714: 0
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN87800%27 HTTP/1.1" 200 None
2026-03-30 11:07:59 [auto1.de] INFO: Scrape type for CN87800: 0
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN68043%27 HTTP/1.1" 200 None
2026-03-30 11:07:59 [auto1.de] INFO: Scrape type for GN68043: 0
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: MA61541
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: FU85370
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: CR83846
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR83846%27 HTTP/1.1" 200 None
2026-03-30 11:07:59 [auto1.de] INFO: Scrape type for CR83846: 0
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: EW37787
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: XU38066
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG64056%27 HTTP/1.1" 200 None
2026-03-30 11:07:59 [auto1.de] INFO: Scrape type for HG64056: 0
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH99848%27 HTTP/1.1" 200 None
2026-03-30 11:07:59 [auto1.de] INFO: Scrape type for UH99848: 0
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: NP05566
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP05566%27 HTTP/1.1" 200 None
2026-03-30 11:07:59 [auto1.de] INFO: Scrape type for NP05566: 0
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: WW82569
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: RL83292
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83292%27 HTTP/1.1" 200 None
2026-03-30 11:07:59 [auto1.de] INFO: Scrape type for RL83292: 0
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP93113%27 HTTP/1.1" 200 None
2026-03-30 11:07:59 [auto1.de] INFO: Scrape type for MP93113: 0
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: WZ32773
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: GR33012
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: VX99653
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX99653%27 HTTP/1.1" 200 None
2026-03-30 11:07:59 [auto1.de] INFO: Scrape type for VX99653: 0
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: MH03365
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: AM60777
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: SR08314
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR08314%27 HTTP/1.1" 200 None
2026-03-30 11:07:59 [auto1.de] INFO: Scrape type for SR08314: 0
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: ZR44160
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: GP99988
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: ZR92554
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: UK52286
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: XD42848
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: BB98458
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB98458%27 HTTP/1.1" 200 None
2026-03-30 11:07:59 [auto1.de] INFO: Scrape type for BB98458: 0
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: ZV84359
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV84359%27 HTTP/1.1" 200 None
2026-03-30 11:07:59 [auto1.de] INFO: Scrape type for ZV84359: 0
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: PY88123
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88123%27 HTTP/1.1" 200 None
2026-03-30 11:07:59 [auto1.de] INFO: Scrape type for PY88123: 0
2026-03-30 11:07:59 [auto1.de] INFO: Found listing with ID: FA96638
2026-03-30 11:07:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:01 [auto1.de] INFO: Channel: 24h | Page: 127 | totalHits: 9598 | hits on page: 40
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: XR52886
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: MZ39955
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: DF95353
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF95353%27 HTTP/1.1" 200 None
2026-03-30 11:08:01 [auto1.de] INFO: Scrape type for DF95353: 0
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: TE07006
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: GM35887
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM35887%27 HTTP/1.1" 200 None
2026-03-30 11:08:01 [auto1.de] INFO: Scrape type for GM35887: 0
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: FE62159
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: AB88110
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB88110%27 HTTP/1.1" 200 None
2026-03-30 11:08:01 [auto1.de] INFO: Scrape type for AB88110: 0
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: MC12469
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: KC26030
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC26030%27 HTTP/1.1" 200 None
2026-03-30 11:08:01 [auto1.de] INFO: Scrape type for KC26030: 0
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: TB37654
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: ZK01329
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: HR10791
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10791%27 HTTP/1.1" 200 None
2026-03-30 11:08:01 [auto1.de] INFO: Scrape type for HR10791: 0
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: SS30943
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: RH02243
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: BB15265
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: PM23375
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM23375%27 HTTP/1.1" 200 None
2026-03-30 11:08:01 [auto1.de] INFO: Scrape type for PM23375: 0
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: BW77657
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW77657%27 HTTP/1.1" 200 None
2026-03-30 11:08:01 [auto1.de] INFO: Scrape type for BW77657: 0
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: DY95504
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: PH96915
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK83819%27 HTTP/1.1" 200 None
2026-03-30 11:08:01 [auto1.de] INFO: Scrape type for NK83819: 0
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: EM07898
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: ZE29906
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE29906%27 HTTP/1.1" 200 None
2026-03-30 11:08:01 [auto1.de] INFO: Scrape type for ZE29906: 0
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09458%27 HTTP/1.1" 200 None
2026-03-30 11:08:01 [auto1.de] INFO: Scrape type for LL09458: 0
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ59930%27 HTTP/1.1" 200 None
2026-03-30 11:08:01 [auto1.de] INFO: Scrape type for ZZ59930: 0
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: YT52370
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: KR50591
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: AU82814
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU82814%27 HTTP/1.1" 200 None
2026-03-30 11:08:01 [auto1.de] INFO: Scrape type for AU82814: 0
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: HH56316
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH56316%27 HTTP/1.1" 200 None
2026-03-30 11:08:01 [auto1.de] INFO: Scrape type for HH56316: 0
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: LX86336
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX86336%27 HTTP/1.1" 200 None
2026-03-30 11:08:01 [auto1.de] INFO: Scrape type for LX86336: 0
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: XY67519
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67519%27 HTTP/1.1" 200 None
2026-03-30 11:08:01 [auto1.de] INFO: Scrape type for XY67519: 0
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: CD13721
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: VT42792
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT42792%27 HTTP/1.1" 200 None
2026-03-30 11:08:01 [auto1.de] INFO: Scrape type for VT42792: 0
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: WF02810
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: FX25662
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX25662%27 HTTP/1.1" 200 None
2026-03-30 11:08:01 [auto1.de] INFO: Scrape type for FX25662: 0
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: TL84937
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: RX80548
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80548%27 HTTP/1.1" 200 None
2026-03-30 11:08:01 [auto1.de] INFO: Scrape type for RX80548: 0
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: PG24274
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: XF83287
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF83287%27 HTTP/1.1" 200 None
2026-03-30 11:08:01 [auto1.de] INFO: Scrape type for XF83287: 0
2026-03-30 11:08:01 [auto1.de] INFO: Found listing with ID: HJ88633
2026-03-30 11:08:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:04 [scrapy.extensions.logstats] INFO: Crawled 873 pages (at 4 pages/min), scraped 1357 items (at 0 items/min)
2026-03-30 11:08:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:08 [auto1.de] INFO: Channel: 24h | Page: 128 | totalHits: 9598 | hits on page: 40
2026-03-30 11:08:08 [auto1.de] INFO: Found listing with ID: WX91762
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX91762%27 HTTP/1.1" 200 None
2026-03-30 11:08:08 [auto1.de] INFO: Scrape type for WX91762: 0
2026-03-30 11:08:08 [auto1.de] INFO: Found listing with ID: NY75597
2026-03-30 11:08:08 [auto1.de] INFO: Found listing with ID: YT57989
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT57989%27 HTTP/1.1" 200 None
2026-03-30 11:08:08 [auto1.de] INFO: Scrape type for YT57989: 0
2026-03-30 11:08:08 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS13151%27 HTTP/1.1" 200 None
2026-03-30 11:08:08 [auto1.de] INFO: Scrape type for JS13151: 0
2026-03-30 11:08:08 [auto1.de] INFO: Found listing with ID: GU59921
2026-03-30 11:08:08 [auto1.de] INFO: Found listing with ID: PP10507
2026-03-30 11:08:08 [auto1.de] INFO: Found listing with ID: NF38330
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF38330%27 HTTP/1.1" 200 None
2026-03-30 11:08:08 [auto1.de] INFO: Scrape type for NF38330: 0
2026-03-30 11:08:08 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-30 11:08:08 [auto1.de] INFO: Found listing with ID: WN67073
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN67073%27 HTTP/1.1" 200 None
2026-03-30 11:08:08 [auto1.de] INFO: Scrape type for WN67073: 0
2026-03-30 11:08:08 [auto1.de] INFO: Found listing with ID: ZS47676
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47676%27 HTTP/1.1" 200 None
2026-03-30 11:08:08 [auto1.de] INFO: Scrape type for ZS47676: 0
2026-03-30 11:08:08 [auto1.de] INFO: Found listing with ID: CM15300
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM15300%27 HTTP/1.1" 200 None
2026-03-30 11:08:08 [auto1.de] INFO: Scrape type for CM15300: 0
2026-03-30 11:08:08 [auto1.de] INFO: Found listing with ID: BN76417
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN76417%27 HTTP/1.1" 200 None
2026-03-30 11:08:08 [auto1.de] INFO: Scrape type for BN76417: 0
2026-03-30 11:08:08 [auto1.de] INFO: Found listing with ID: EC93517
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC93517%27 HTTP/1.1" 200 None
2026-03-30 11:08:08 [auto1.de] INFO: Scrape type for EC93517: 0
2026-03-30 11:08:08 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-30 11:08:08 [auto1.de] INFO: Found listing with ID: GJ75374
2026-03-30 11:08:08 [auto1.de] INFO: Found listing with ID: YN35790
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN35790%27 HTTP/1.1" 200 None
2026-03-30 11:08:08 [auto1.de] INFO: Scrape type for YN35790: 0
2026-03-30 11:08:08 [auto1.de] INFO: Found listing with ID: AW08292
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW08292%27 HTTP/1.1" 200 None
2026-03-30 11:08:08 [auto1.de] INFO: Scrape type for AW08292: 0
2026-03-30 11:08:08 [auto1.de] INFO: Found listing with ID: ND34621
2026-03-30 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND34621%27 HTTP/1.1" 200 None
2026-03-30 11:08:09 [auto1.de] INFO: Scrape type for ND34621: 0
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: ME06173
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: EV97888
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: LT29180
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT29180%27 HTTP/1.1" 200 None
2026-03-30 11:08:09 [auto1.de] INFO: Scrape type for LT29180: 0
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: BT97147
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97147%27 HTTP/1.1" 200 None
2026-03-30 11:08:09 [auto1.de] INFO: Scrape type for BT97147: 0
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: PL64975
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: JF36424
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: EY95124
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY95124%27 HTTP/1.1" 200 None
2026-03-30 11:08:09 [auto1.de] INFO: Scrape type for EY95124: 0
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: TF71705
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF71705%27 HTTP/1.1" 200 None
2026-03-30 11:08:09 [auto1.de] INFO: Scrape type for TF71705: 0
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: VC63070
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC63070%27 HTTP/1.1" 200 None
2026-03-30 11:08:09 [auto1.de] INFO: Scrape type for VC63070: 0
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: BG10671
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: WT86563
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT86563%27 HTTP/1.1" 200 None
2026-03-30 11:08:09 [auto1.de] INFO: Scrape type for WT86563: 0
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: AN46464
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS47170%27 HTTP/1.1" 200 None
2026-03-30 11:08:09 [auto1.de] INFO: Scrape type for PS47170: 0
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: ZY58366
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: UT75774
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: HP37567
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: AN41414
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: YR25980
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: DP30062
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP30062%27 HTTP/1.1" 200 None
2026-03-30 11:08:09 [auto1.de] INFO: Scrape type for DP30062: 0
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: YJ47814
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47814%27 HTTP/1.1" 200 None
2026-03-30 11:08:09 [auto1.de] INFO: Scrape type for YJ47814: 0
2026-03-30 11:08:09 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM03411%27 HTTP/1.1" 200 None
2026-03-30 11:08:09 [auto1.de] INFO: Scrape type for RM03411: 0
2026-03-30 11:08:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:10 [auto1.de] INFO: Channel: 24h | Page: 129 | totalHits: 9598 | hits on page: 40
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: CD69180
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: AG08443
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG08443%27 HTTP/1.1" 200 None
2026-03-30 11:08:10 [auto1.de] INFO: Scrape type for AG08443: 0
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: VX90434
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: MM42204
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: LL25204
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: KX12116
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX12116%27 HTTP/1.1" 200 None
2026-03-30 11:08:10 [auto1.de] INFO: Scrape type for KX12116: 0
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: XZ76786
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ76786%27 HTTP/1.1" 200 None
2026-03-30 11:08:10 [auto1.de] INFO: Scrape type for XZ76786: 0
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: AJ16531
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ16531%27 HTTP/1.1" 200 None
2026-03-30 11:08:10 [auto1.de] INFO: Scrape type for AJ16531: 0
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: TD56842
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD56842%27 HTTP/1.1" 200 None
2026-03-30 11:08:10 [auto1.de] INFO: Scrape type for TD56842: 0
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR99013%27 HTTP/1.1" 200 None
2026-03-30 11:08:10 [auto1.de] INFO: Scrape type for KR99013: 0
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: AE08080
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: YT23493
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: UB50562
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: WW12135
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: VB93359
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB93359%27 HTTP/1.1" 200 None
2026-03-30 11:08:10 [auto1.de] INFO: Scrape type for VB93359: 0
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: RK12906
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12906%27 HTTP/1.1" 200 None
2026-03-30 11:08:10 [auto1.de] INFO: Scrape type for RK12906: 0
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: HD30169
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: DE84104
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: BR24647
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC90555%27 HTTP/1.1" 200 None
2026-03-30 11:08:10 [auto1.de] INFO: Scrape type for DC90555: 0
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: AL45510
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL45510%27 HTTP/1.1" 200 None
2026-03-30 11:08:10 [auto1.de] INFO: Scrape type for AL45510: 0
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ61824%27 HTTP/1.1" 200 None
2026-03-30 11:08:10 [auto1.de] INFO: Scrape type for GJ61824: 0
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: WZ86962
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: EF47074
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: MD55722
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: XG02124
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG02124%27 HTTP/1.1" 200 None
2026-03-30 11:08:10 [auto1.de] INFO: Scrape type for XG02124: 0
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: AK65785
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK65785%27 HTTP/1.1" 200 None
2026-03-30 11:08:10 [auto1.de] INFO: Scrape type for AK65785: 0
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: FF73158
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: AW17852
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW17852%27 HTTP/1.1" 200 None
2026-03-30 11:08:10 [auto1.de] INFO: Scrape type for AW17852: 0
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ79893%27 HTTP/1.1" 200 None
2026-03-30 11:08:10 [auto1.de] INFO: Scrape type for ZZ79893: 0
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: AY57435
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY57435%27 HTTP/1.1" 200 None
2026-03-30 11:08:10 [auto1.de] INFO: Scrape type for AY57435: 0
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: DY67323
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: NJ66077
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: EG34201
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG34201%27 HTTP/1.1" 200 None
2026-03-30 11:08:10 [auto1.de] INFO: Scrape type for EG34201: 0
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: UK09737
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: AV13612
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: MT21792
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: YH76604
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH76604%27 HTTP/1.1" 200 None
2026-03-30 11:08:10 [auto1.de] INFO: Scrape type for YH76604: 0
2026-03-30 11:08:10 [auto1.de] INFO: Found listing with ID: ZD30774
2026-03-30 11:08:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:11 [auto1.de] INFO: Channel: 24h | Page: 130 | totalHits: 9599 | hits on page: 40
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: ZD30774
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: FY04572
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: VX98591
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX98591%27 HTTP/1.1" 200 None
2026-03-30 11:08:11 [auto1.de] INFO: Scrape type for VX98591: 0
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: BD44201
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD44201%27 HTTP/1.1" 200 None
2026-03-30 11:08:11 [auto1.de] INFO: Scrape type for BD44201: 0
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: NG07529
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG07529%27 HTTP/1.1" 200 None
2026-03-30 11:08:11 [auto1.de] INFO: Scrape type for NG07529: 0
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: JY21775
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: NG90770
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: LR76257
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR76257%27 HTTP/1.1" 200 None
2026-03-30 11:08:11 [auto1.de] INFO: Scrape type for LR76257: 0
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: RK40199
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: YY97857
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY97857%27 HTTP/1.1" 200 None
2026-03-30 11:08:11 [auto1.de] INFO: Scrape type for YY97857: 0
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: NX23620
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: DC50657
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC50657%27 HTTP/1.1" 200 None
2026-03-30 11:08:11 [auto1.de] INFO: Scrape type for DC50657: 0
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: DS47068
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS47068%27 HTTP/1.1" 200 None
2026-03-30 11:08:11 [auto1.de] INFO: Scrape type for DS47068: 0
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: XU56450
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: BT35414
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: BC73225
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: LC77842
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77842%27 HTTP/1.1" 200 None
2026-03-30 11:08:11 [auto1.de] INFO: Scrape type for LC77842: 0
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: UX10113
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX10113%27 HTTP/1.1" 200 None
2026-03-30 11:08:11 [auto1.de] INFO: Scrape type for UX10113: 0
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: HL62100
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: DP87789
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: BJ94385
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: YF78558
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF78558%27 HTTP/1.1" 200 None
2026-03-30 11:08:11 [auto1.de] INFO: Scrape type for YF78558: 0
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: TE35535
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE35535%27 HTTP/1.1" 200 None
2026-03-30 11:08:11 [auto1.de] INFO: Scrape type for TE35535: 0
2026-03-30 11:08:11 [auto1.de] INFO: Found listing with ID: SA59196
2026-03-30 11:08:12 [auto1.de] INFO: Found listing with ID: MS73974
2026-03-30 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS73974%27 HTTP/1.1" 200 None
2026-03-30 11:08:12 [auto1.de] INFO: Scrape type for MS73974: 0
2026-03-30 11:08:12 [auto1.de] INFO: Found listing with ID: AH38821
2026-03-30 11:08:12 [auto1.de] INFO: Found listing with ID: WZ27429
2026-03-30 11:08:12 [auto1.de] INFO: Found listing with ID: XE26333
2026-03-30 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE26333%27 HTTP/1.1" 200 None
2026-03-30 11:08:12 [auto1.de] INFO: Scrape type for XE26333: 0
2026-03-30 11:08:12 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-30 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68666%27 HTTP/1.1" 200 None
2026-03-30 11:08:12 [auto1.de] INFO: Scrape type for NX68666: 0
2026-03-30 11:08:12 [auto1.de] INFO: Found listing with ID: RK13717
2026-03-30 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK13717%27 HTTP/1.1" 200 None
2026-03-30 11:08:12 [auto1.de] INFO: Scrape type for RK13717: 0
2026-03-30 11:08:12 [auto1.de] INFO: Found listing with ID: YF83541
2026-03-30 11:08:12 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-30 11:08:12 [auto1.de] INFO: Found listing with ID: EL91395
2026-03-30 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91395%27 HTTP/1.1" 200 None
2026-03-30 11:08:12 [auto1.de] INFO: Scrape type for EL91395: 0
2026-03-30 11:08:12 [auto1.de] INFO: Found listing with ID: EB01944
2026-03-30 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB01944%27 HTTP/1.1" 200 None
2026-03-30 11:08:12 [auto1.de] INFO: Scrape type for EB01944: 0
2026-03-30 11:08:12 [auto1.de] INFO: Found listing with ID: KN65444
2026-03-30 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN65444%27 HTTP/1.1" 200 None
2026-03-30 11:08:12 [auto1.de] INFO: Scrape type for KN65444: 0
2026-03-30 11:08:12 [auto1.de] INFO: Found listing with ID: SX08499
2026-03-30 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX08499%27 HTTP/1.1" 200 None
2026-03-30 11:08:12 [auto1.de] INFO: Scrape type for SX08499: 0
2026-03-30 11:08:12 [auto1.de] INFO: Found listing with ID: BK25487
2026-03-30 11:08:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:22 [auto1.de] INFO: Channel: 24h | Page: 131 | totalHits: 9599 | hits on page: 40
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: EA13854
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: TU73668
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU73668%27 HTTP/1.1" 200 None
2026-03-30 11:08:22 [auto1.de] INFO: Scrape type for TU73668: 0
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: KM66171
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM66171%27 HTTP/1.1" 200 None
2026-03-30 11:08:22 [auto1.de] INFO: Scrape type for KM66171: 0
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: TR96368
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR96368%27 HTTP/1.1" 200 None
2026-03-30 11:08:22 [auto1.de] INFO: Scrape type for TR96368: 0
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: PT08625
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT08625%27 HTTP/1.1" 200 None
2026-03-30 11:08:22 [auto1.de] INFO: Scrape type for PT08625: 0
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: HM95018
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM95018%27 HTTP/1.1" 200 None
2026-03-30 11:08:22 [auto1.de] INFO: Scrape type for HM95018: 0
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: NJ99986
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ99986%27 HTTP/1.1" 200 None
2026-03-30 11:08:22 [auto1.de] INFO: Scrape type for NJ99986: 0
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: JR56038
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR56038%27 HTTP/1.1" 200 None
2026-03-30 11:08:22 [auto1.de] INFO: Scrape type for JR56038: 0
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: KF98082
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: BK49064
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: ZR39643
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39643%27 HTTP/1.1" 200 None
2026-03-30 11:08:22 [auto1.de] INFO: Scrape type for ZR39643: 0
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: HE33973
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: PJ34004
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34004%27 HTTP/1.1" 200 None
2026-03-30 11:08:22 [auto1.de] INFO: Scrape type for PJ34004: 0
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: HA65377
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: AR72060
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL65692%27 HTTP/1.1" 200 None
2026-03-30 11:08:22 [auto1.de] INFO: Scrape type for JL65692: 0
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: MX37752
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX37752%27 HTTP/1.1" 200 None
2026-03-30 11:08:22 [auto1.de] INFO: Scrape type for MX37752: 0
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: BG36952
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: AG47249
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG47249%27 HTTP/1.1" 200 None
2026-03-30 11:08:22 [auto1.de] INFO: Scrape type for AG47249: 0
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: NB80689
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: LK79875
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK79875%27 HTTP/1.1" 200 None
2026-03-30 11:08:22 [auto1.de] INFO: Scrape type for LK79875: 0
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: CG37659
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: LK34875
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK34875%27 HTTP/1.1" 200 None
2026-03-30 11:08:22 [auto1.de] INFO: Scrape type for LK34875: 0
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: LU05399
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB46013%27 HTTP/1.1" 200 None
2026-03-30 11:08:22 [auto1.de] INFO: Scrape type for DB46013: 0
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: ZM12960
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: EY55649
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY55649%27 HTTP/1.1" 200 None
2026-03-30 11:08:22 [auto1.de] INFO: Scrape type for EY55649: 0
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: NH13691
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: MG81975
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: ER51376
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51376%27 HTTP/1.1" 200 None
2026-03-30 11:08:22 [auto1.de] INFO: Scrape type for ER51376: 0
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: XB43693
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB43693%27 HTTP/1.1" 200 None
2026-03-30 11:08:22 [auto1.de] INFO: Scrape type for XB43693: 0
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: HU88385
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: EU79634
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU79634%27 HTTP/1.1" 200 None
2026-03-30 11:08:22 [auto1.de] INFO: Scrape type for EU79634: 0
2026-03-30 11:08:22 [auto1.de] INFO: Found listing with ID: HS53864
2026-03-30 11:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS53864%27 HTTP/1.1" 200 None
2026-03-30 11:08:23 [auto1.de] INFO: Scrape type for HS53864: 0
2026-03-30 11:08:23 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-30 11:08:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:35 [auto1.de] INFO: Channel: 24h | Page: 132 | totalHits: 9600 | hits on page: 40
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: XW28946
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW28946%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for XW28946: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: RR35143
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR35143%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for RR35143: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: HX49915
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: KJ96980
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96980%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for KJ96980: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: SA39123
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA39123%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for SA39123: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: DM70837
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: SK20956
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK20956%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for SK20956: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: GE03555
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE03555%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for GE03555: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: KE50897
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: AB40080
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB40080%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for AB40080: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: AM64478
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: BL07705
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: LM98964
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM98964%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for LM98964: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: CF85526
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY37454%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for PY37454: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: BJ98180
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ98180%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for BJ98180: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: GX91022
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: YJ19270
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: YL76472
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47160%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for YJ47160: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: HG88982
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: PN22226
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN22226%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for PN22226: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: UA56207
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: RZ53370
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ53370%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for RZ53370: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: MR73293
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR73293%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for MR73293: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: GU43225
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU43225%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for GU43225: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: UG40068
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG40068%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for UG40068: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: DL54594
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: ED43113
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: JS31219
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS31219%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for JS31219: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: WM19192
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM19192%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for WM19192: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: BW09320
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: TF26076
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF26076%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for TF26076: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: NR99017
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR99017%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.de] INFO: Scrape type for NR99017: 0
2026-03-30 11:08:35 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB50510%27 HTTP/1.1" 200 None
2026-03-30 11:08:36 [auto1.de] INFO: Scrape type for HB50510: 0
2026-03-30 11:08:36 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-30 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG26326%27 HTTP/1.1" 200 None
2026-03-30 11:08:36 [auto1.de] INFO: Scrape type for VG26326: 0
2026-03-30 11:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:40 [auto1.de] INFO: Channel: 24h | Page: 133 | totalHits: 9601 | hits on page: 40
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG26326%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for VG26326: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: EP13980
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE19276%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for EE19276: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: BC97155
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC97155%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for BC97155: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: VG31593
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG31593%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for VG31593: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78869%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for WG78869: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: GP19513
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: UM92745
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM92745%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for UM92745: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: VT68593
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT68593%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for VT68593: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: DE37083
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08912%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for YA08912: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: VB96558
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: ZT19745
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT19745%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for ZT19745: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: TL65156
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL65156%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for TL65156: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: JF43262
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF43262%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for JF43262: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: EX72807
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX72807%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for EX72807: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: KN67174
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN67174%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for KN67174: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: DG34308
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: SM13407
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB59587%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for GB59587: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: NE62435
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE62435%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for NE62435: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: KZ71348
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: CK84470
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK84470%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for CK84470: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: WP12836
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP12836%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for WP12836: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM56481%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for FM56481: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: GP54397
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: DE22331
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: AH65179
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65179%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for AH65179: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: UA60360
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA60360%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for UA60360: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: US78573
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: XZ96543
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: PW80627
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW80627%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for PW80627: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: JB50627
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB50627%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for JB50627: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: NL93445
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: TR13409
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST57334%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for ST57334: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: HR10562
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10562%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for HR10562: 0
2026-03-30 11:08:40 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF39323%27 HTTP/1.1" 200 None
2026-03-30 11:08:40 [auto1.de] INFO: Scrape type for SF39323: 0
2026-03-30 11:08:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:04 [scrapy.extensions.logstats] INFO: Crawled 879 pages (at 6 pages/min), scraped 1357 items (at 0 items/min)
2026-03-30 11:09:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:10:04 [scrapy.extensions.logstats] INFO: Crawled 879 pages (at 0 pages/min), scraped 1357 items (at 0 items/min)
2026-03-30 11:10:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:10:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.179(s), this was the 1st time calling it.
2026-03-30 11:10:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.91938598569301 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:59 [auto1.de] INFO: Channel: 24h | Page: 134 | totalHits: 9622 | hits on page: 40
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: SM13407
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB59587%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for GB59587: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: NE62435
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE62435%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for NE62435: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: KZ71348
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: CK84470
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK84470%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for CK84470: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: WP12836
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP12836%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for WP12836: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM56481%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for FM56481: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: GP54397
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: DE22331
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: AH65179
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65179%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for AH65179: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: UA60360
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA60360%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for UA60360: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: US78573
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: XZ96543
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: PW80627
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW80627%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for PW80627: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: JB50627
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB50627%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for JB50627: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: NL93445
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: TR13409
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST57334%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for ST57334: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: HR10562
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10562%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for HR10562: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF39323%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for SF39323: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: ZS55646
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: VK62428
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: MD70157
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: UT32036
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF29194%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for UF29194: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: RN12872
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN12872%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for RN12872: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: NP24686
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP24686%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for NP24686: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: XM14327
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR67134%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for NR67134: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: WM90118
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM90118%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for WM90118: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: CD45301
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD45301%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for CD45301: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: AA40394
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA40394%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for AA40394: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: WD77905
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD77905%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for WD77905: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: ND67175
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: JJ90967
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK58457%27 HTTP/1.1" 200 None
2026-03-30 11:10:59 [auto1.de] INFO: Scrape type for CK58457: 0
2026-03-30 11:10:59 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-30 11:10:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:04 [scrapy.extensions.logstats] INFO: Crawled 880 pages (at 1 pages/min), scraped 1357 items (at 0 items/min)
2026-03-30 11:11:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:11:11 [auto1.de] INFO: Channel: 24h | Page: 135 | totalHits: 9624 | hits on page: 40
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK58457%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for CK58457: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: AM35234
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM35234%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for AM35234: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: XN62659
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN62659%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for XN62659: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY07773%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for NY07773: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: HW81308
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW81308%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for HW81308: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64995%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for FT64995: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: XD50788
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: TX03008
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX03008%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for TX03008: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: WX30438
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: MC27977
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC27977%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for MC27977: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: ED91782
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: FE71372
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: RJ76690
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ76690%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for RJ76690: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: AU22690
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU22690%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for AU22690: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: SS51493
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: DN57570
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN57570%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for DN57570: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: BK33721
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK33721%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for BK33721: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC81369%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for CC81369: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: HJ55484
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ55484%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for HJ55484: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: ZN05925
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: JJ29192
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: ZT00838
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00838%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for ZT00838: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: KU56526
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD33755%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for PD33755: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: HJ04828
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: WD73510
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: RP88862
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP88862%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for RP88862: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: PH25486
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: GC03067
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC03067%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for GC03067: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: PB35846
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: HY60596
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: LW48006
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW48006%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for LW48006: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: UR03591
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR03591%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for UR03591: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: EY00431
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: HE80125
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE80125%27 HTTP/1.1" 200 None
2026-03-30 11:11:11 [auto1.de] INFO: Scrape type for HE80125: 0
2026-03-30 11:11:11 [auto1.de] INFO: Found listing with ID: BM76815
2026-03-30 11:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:11:13 [auto1.de] INFO: Channel: 24h | Page: 136 | totalHits: 9624 | hits on page: 40
2026-03-30 11:11:13 [auto1.de] INFO: Found listing with ID: MK68330
2026-03-30 11:11:13 [auto1.de] INFO: Found listing with ID: HB08106
2026-03-30 11:11:13 [auto1.de] INFO: Found listing with ID: VL45063
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL45063%27 HTTP/1.1" 200 None
2026-03-30 11:11:14 [auto1.de] INFO: Scrape type for VL45063: 0
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: MU86214
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU86214%27 HTTP/1.1" 200 None
2026-03-30 11:11:14 [auto1.de] INFO: Scrape type for MU86214: 0
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: ZU40216
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: FX88340
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX88340%27 HTTP/1.1" 200 None
2026-03-30 11:11:14 [auto1.de] INFO: Scrape type for FX88340: 0
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: VE61397
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: JD23896
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: GW97412
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: SZ45065
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45065%27 HTTP/1.1" 200 None
2026-03-30 11:11:14 [auto1.de] INFO: Scrape type for SZ45065: 0
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: CA54240
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: DF33717
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF33717%27 HTTP/1.1" 200 None
2026-03-30 11:11:14 [auto1.de] INFO: Scrape type for DF33717: 0
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: RJ96114
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ96114%27 HTTP/1.1" 200 None
2026-03-30 11:11:14 [auto1.de] INFO: Scrape type for RJ96114: 0
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: XR18256
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR18256%27 HTTP/1.1" 200 None
2026-03-30 11:11:14 [auto1.de] INFO: Scrape type for XR18256: 0
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: UV08426
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: PA19754
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA19754%27 HTTP/1.1" 200 None
2026-03-30 11:11:14 [auto1.de] INFO: Scrape type for PA19754: 0
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: SS28030
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: VU97666
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: MP68485
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP68485%27 HTTP/1.1" 200 None
2026-03-30 11:11:14 [auto1.de] INFO: Scrape type for MP68485: 0
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: ZU43350
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: WV10952
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: RW04069
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: SS51107
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27590%27 HTTP/1.1" 200 None
2026-03-30 11:11:14 [auto1.de] INFO: Scrape type for PE27590: 0
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: CS04042
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: FH89031
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ53185%27 HTTP/1.1" 200 None
2026-03-30 11:11:14 [auto1.de] INFO: Scrape type for BZ53185: 0
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: ZK43120
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: LW69749
2026-03-30 11:11:14 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-30 11:11:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:04 [scrapy.extensions.logstats] INFO: Crawled 882 pages (at 2 pages/min), scraped 1357 items (at 0 items/min)
2026-03-30 11:12:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:13:04 [scrapy.extensions.logstats] INFO: Crawled 882 pages (at 0 pages/min), scraped 1357 items (at 0 items/min)
2026-03-30 11:13:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:13:24 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.258(s), this was the 1st time calling it.
2026-03-30 11:13:24 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.136742655545911 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:13:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:34 [auto1.de] INFO: Channel: 24h | Page: 137 | totalHits: 9644 | hits on page: 40
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: ZU43350
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: WV10952
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: RW04069
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: SS51107
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-30 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27590%27 HTTP/1.1" 200 None
2026-03-30 11:13:34 [auto1.de] INFO: Scrape type for PE27590: 0
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: CS04042
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: FH89031
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-30 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ53185%27 HTTP/1.1" 200 None
2026-03-30 11:13:34 [auto1.de] INFO: Scrape type for BZ53185: 0
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: ZK43120
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: LW69749
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: EU51889
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-30 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR34750%27 HTTP/1.1" 200 None
2026-03-30 11:13:34 [auto1.de] INFO: Scrape type for KR34750: 0
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: WK90635
2026-03-30 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK90635%27 HTTP/1.1" 200 None
2026-03-30 11:13:34 [auto1.de] INFO: Scrape type for WK90635: 0
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: FC40686
2026-03-30 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC40686%27 HTTP/1.1" 200 None
2026-03-30 11:13:34 [auto1.de] INFO: Scrape type for FC40686: 0
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: SD83034
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: EG76856
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: US02373
2026-03-30 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02373%27 HTTP/1.1" 200 None
2026-03-30 11:13:34 [auto1.de] INFO: Scrape type for US02373: 0
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: DR94699
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: SY84491
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: CT65842
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: TP63692
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: XY67074
2026-03-30 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67074%27 HTTP/1.1" 200 None
2026-03-30 11:13:34 [auto1.de] INFO: Scrape type for XY67074: 0
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: ZW22458
2026-03-30 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW22458%27 HTTP/1.1" 200 None
2026-03-30 11:13:34 [auto1.de] INFO: Scrape type for ZW22458: 0
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: TA01752
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: XT00440
2026-03-30 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT00440%27 HTTP/1.1" 200 None
2026-03-30 11:13:34 [auto1.de] INFO: Scrape type for XT00440: 0
2026-03-30 11:13:34 [auto1.de] INFO: Found listing with ID: DP85983
2026-03-30 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP85983%27 HTTP/1.1" 200 None
2026-03-30 11:13:35 [auto1.de] INFO: Scrape type for DP85983: 0
2026-03-30 11:13:35 [auto1.de] INFO: Found listing with ID: EK13927
2026-03-30 11:13:35 [auto1.de] INFO: Found listing with ID: GH07682
2026-03-30 11:13:35 [auto1.de] INFO: Found listing with ID: CR38354
2026-03-30 11:13:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:39 [auto1.de] INFO: Channel: 24h | Page: 138 | totalHits: 9644 | hits on page: 40
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: CG27437
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG27437%27 HTTP/1.1" 200 None
2026-03-30 11:13:39 [auto1.de] INFO: Scrape type for CG27437: 0
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: KA95549
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA95549%27 HTTP/1.1" 200 None
2026-03-30 11:13:39 [auto1.de] INFO: Scrape type for KA95549: 0
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: WB32004
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: DL51973
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL51973%27 HTTP/1.1" 200 None
2026-03-30 11:13:39 [auto1.de] INFO: Scrape type for DL51973: 0
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: WC28097
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: FW13122
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW13122%27 HTTP/1.1" 200 None
2026-03-30 11:13:39 [auto1.de] INFO: Scrape type for FW13122: 0
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: YY97428
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: SW23111
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW23111%27 HTTP/1.1" 200 None
2026-03-30 11:13:39 [auto1.de] INFO: Scrape type for SW23111: 0
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE91712%27 HTTP/1.1" 200 None
2026-03-30 11:13:39 [auto1.de] INFO: Scrape type for UE91712: 0
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: EM80186
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: BC27569
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC27569%27 HTTP/1.1" 200 None
2026-03-30 11:13:39 [auto1.de] INFO: Scrape type for BC27569: 0
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: VJ30367
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ30367%27 HTTP/1.1" 200 None
2026-03-30 11:13:39 [auto1.de] INFO: Scrape type for VJ30367: 0
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: RM91715
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM91715%27 HTTP/1.1" 200 None
2026-03-30 11:13:39 [auto1.de] INFO: Scrape type for RM91715: 0
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: DB09685
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: HT11802
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: JT94626
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT94626%27 HTTP/1.1" 200 None
2026-03-30 11:13:39 [auto1.de] INFO: Scrape type for JT94626: 0
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: SY11611
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: HX36326
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: KS86006
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS86006%27 HTTP/1.1" 200 None
2026-03-30 11:13:39 [auto1.de] INFO: Scrape type for KS86006: 0
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: ZW76685
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: ZT22955
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-30 11:13:39 [auto1.de] INFO: Found listing with ID: UZ08427
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ08427%27 HTTP/1.1" 200 None
2026-03-30 11:13:39 [auto1.de] INFO: Scrape type for UZ08427: 2
2026-03-30 11:13:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60d5584a-3b51-5607-b3a2-191fc05a1394 with identifier: UZ08427
2026-03-30 11:13:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60d5584a-3b51-5607-b3a2-191fc05a1394 with scrape type 2
2026-03-30 11:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60d5584a-3b51-5607-b3a2-191fc05a1394 with scrape type 2
2026-03-30 11:13:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60d5584a-3b51-5607-b3a2-191fc05a1394, identifier: UZ08427
2026-03-30 11:13:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60d5584a-3b51-5607-b3a2-191fc05a1394 with identifier: UZ08427
2026-03-30 11:13:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60d5584a-3b51-5607-b3a2-191fc05a1394 with identifier: UZ08427
2026-03-30 11:13:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60d5584a-3b51-5607-b3a2-191fc05a1394 with identifier: UZ08427 to the API
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:30:53Z',
 'fuel_type': 'diesel',
 'id': '60d5584a-3b51-5607-b3a2-191fc05a1394',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ08427',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 187727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-24',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ08427%27 HTTP/1.1" 200 None
2026-03-30 11:13:40 [auto1.de] INFO: Saving data for UZ08427: {'auction_closing_time': 1774884653.0, 'created_time': 1773662188.403387, 'last_price_update_time': 1774869220.240853}
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ08427') HTTP/1.1" 204 0
2026-03-30 11:13:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:40 [auto1.de] INFO: Found listing with ID: MH82914
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82914%27 HTTP/1.1" 200 None
2026-03-30 11:13:40 [auto1.de] INFO: Scrape type for MH82914: 0
2026-03-30 11:13:40 [auto1.de] INFO: Found listing with ID: BC06699
2026-03-30 11:13:40 [auto1.de] INFO: Found listing with ID: YG74367
2026-03-30 11:13:40 [auto1.de] INFO: Found listing with ID: BX62437
2026-03-30 11:13:40 [auto1.de] INFO: Found listing with ID: XX92411
2026-03-30 11:13:40 [auto1.de] INFO: Found listing with ID: BF60599
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF60599%27 HTTP/1.1" 200 None
2026-03-30 11:13:40 [auto1.de] INFO: Scrape type for BF60599: 0
2026-03-30 11:13:40 [auto1.de] INFO: Found listing with ID: TW39351
2026-03-30 11:13:40 [auto1.de] INFO: Found listing with ID: YG83893
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG83893%27 HTTP/1.1" 200 None
2026-03-30 11:13:40 [auto1.de] INFO: Scrape type for YG83893: 0
2026-03-30 11:13:40 [auto1.de] INFO: Found listing with ID: VN06555
2026-03-30 11:13:40 [auto1.de] INFO: Found listing with ID: WJ12441
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ12441%27 HTTP/1.1" 200 None
2026-03-30 11:13:40 [auto1.de] INFO: Scrape type for WJ12441: 0
2026-03-30 11:13:40 [auto1.de] INFO: Found listing with ID: MY48051
2026-03-30 11:13:40 [auto1.de] INFO: Found listing with ID: EA07160
2026-03-30 11:13:40 [auto1.de] INFO: Found listing with ID: UC14298
2026-03-30 11:13:40 [auto1.de] INFO: Found listing with ID: NS82829
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS82829%27 HTTP/1.1" 200 None
2026-03-30 11:13:40 [auto1.de] INFO: Scrape type for NS82829: 0
2026-03-30 11:13:40 [auto1.de] INFO: Found listing with ID: FJ78048
2026-03-30 11:13:40 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-30 11:14:04 [scrapy.extensions.logstats] INFO: Crawled 884 pages (at 2 pages/min), scraped 1358 items (at 1 items/min)
2026-03-30 11:14:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:17 [auto1.de] INFO: Channel: 24h | Page: 139 | totalHits: 9647 | hits on page: 40
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: NS82829
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS82829%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for NS82829: 0
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: FJ78048
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: EN23227
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN23227%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for EN23227: 0
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: DN49518
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN49518%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for DN49518: 0
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: US46384
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US46384%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for US46384: 0
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: BZ42354
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: JB03726
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: EL79145
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: UA59883
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: PU11267
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: XB85584
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85584%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for XB85584: 0
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: RA04600
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA04600%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for RA04600: 0
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN16879%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for BN16879: 0
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: AM22108
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: JG55591
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG55591%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for JG55591: 0
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: FU95957
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: PJ55553
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ55553%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for PJ55553: 0
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: YH66607
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH66607%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for YH66607: 0
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: AG88480
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: WR53064
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR53064%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for WR53064: 0
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: AV40802
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: EU33293
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: DY72609
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: MC56654
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC56654%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for MC56654: 0
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: VU29174
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU29174%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for VU29174: 0
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: SN95717
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN95717%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for SN95717: 0
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: BD12559
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD12559%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for BD12559: 0
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: BB14997
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: DK43665
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK43665%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for DK43665: 0
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: FF39586
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: RG61391
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: CY56514
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY56514%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for CY56514: 0
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: UY95441
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY95441%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for UY95441: 0
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: SC10304
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC10304%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for SC10304: 0
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: XA15787
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: XG58500
2026-03-30 11:14:17 [auto1.de] INFO: Found listing with ID: US51436
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US51436%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [auto1.de] INFO: Scrape type for US51436: 0
2026-03-30 11:14:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:18 [auto1.de] INFO: Channel: 24h | Page: 140 | totalHits: 9647 | hits on page: 40
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: XX83628
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX83628%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for XX83628: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: HZ88582
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ88582%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for HZ88582: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: PG49368
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: PA77354
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: UT59305
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: EJ47615
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13341%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for DU13341: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: EB22696
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB22696%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for EB22696: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY82930%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for TY82930: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC35007%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for NC35007: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT04304%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for YT04304: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: YB02361
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: SW44796
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW44796%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for SW44796: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: BB73401
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB73401%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for BB73401: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: PG96137
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: WP48150
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48150%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for WP48150: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: GE16975
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16975%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for GE16975: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: XM92815
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM92815%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for XM92815: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: XL13857
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: TJ39363
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: KP27245
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP27245%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for KP27245: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: PN86617
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: MG32866
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: NY45710
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: CH25051
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH25051%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for CH25051: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: BA43321
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: RX49945
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: VL21879
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL21879%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for VL21879: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: BK83629
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: EW06930
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: LH67751
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: TS61714
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: FJ40863
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ40863%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for FJ40863: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: UX44500
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX44500%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for UX44500: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM46431%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for YM46431: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: BC55610
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC55610%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for BC55610: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH78241%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for YH78241: 0
2026-03-30 11:14:18 [auto1.de] INFO: Found listing with ID: DY93616
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY93616%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.de] INFO: Scrape type for DY93616: 0
2026-03-30 11:14:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:35 [auto1.de] INFO: Channel: 24h | Page: 141 | totalHits: 9647 | hits on page: 40
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: EH98635
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH98635%27 HTTP/1.1" 200 None
2026-03-30 11:14:35 [auto1.de] INFO: Scrape type for EH98635: 0
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: XH00472
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH00472%27 HTTP/1.1" 200 None
2026-03-30 11:14:35 [auto1.de] INFO: Scrape type for XH00472: 0
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: VH36335
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH36335%27 HTTP/1.1" 200 None
2026-03-30 11:14:35 [auto1.de] INFO: Scrape type for VH36335: 0
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: NC31400
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC31400%27 HTTP/1.1" 200 None
2026-03-30 11:14:35 [auto1.de] INFO: Scrape type for NC31400: 0
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: YR31209
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR31209%27 HTTP/1.1" 200 None
2026-03-30 11:14:35 [auto1.de] INFO: Scrape type for YR31209: 0
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK07133%27 HTTP/1.1" 200 None
2026-03-30 11:14:35 [auto1.de] INFO: Scrape type for CK07133: 0
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: ZK30866
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK30866%27 HTTP/1.1" 200 None
2026-03-30 11:14:35 [auto1.de] INFO: Scrape type for ZK30866: 0
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: AH65486
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: GB85775
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB85775%27 HTTP/1.1" 200 None
2026-03-30 11:14:35 [auto1.de] INFO: Scrape type for GB85775: 0
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: AY33433
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: SB04104
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: CN56098
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN56098%27 HTTP/1.1" 200 None
2026-03-30 11:14:35 [auto1.de] INFO: Scrape type for CN56098: 0
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: SA06109
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA06109%27 HTTP/1.1" 200 None
2026-03-30 11:14:35 [auto1.de] INFO: Scrape type for SA06109: 0
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: TC39197
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: MH69826
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: VA96509
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA96509%27 HTTP/1.1" 200 None
2026-03-30 11:14:35 [auto1.de] INFO: Scrape type for VA96509: 0
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: EU27466
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: LV46830
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV46830%27 HTTP/1.1" 200 None
2026-03-30 11:14:35 [auto1.de] INFO: Scrape type for LV46830: 0
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: PX02497
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX02497%27 HTTP/1.1" 200 None
2026-03-30 11:14:35 [auto1.de] INFO: Scrape type for PX02497: 0
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: HU76899
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU76899%27 HTTP/1.1" 200 None
2026-03-30 11:14:35 [auto1.de] INFO: Scrape type for HU76899: 0
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: GG35295
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG35295%27 HTTP/1.1" 200 None
2026-03-30 11:14:35 [auto1.de] INFO: Scrape type for GG35295: 0
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: BC43890
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU24928%27 HTTP/1.1" 200 None
2026-03-30 11:14:35 [auto1.de] INFO: Scrape type for AU24928: 0
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-30 11:14:35 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB74696%27 HTTP/1.1" 200 None
2026-03-30 11:14:35 [auto1.de] INFO: Scrape type for NB74696: 2
2026-03-30 11:14:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd with identifier: NB74696
2026-03-30 11:14:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd with scrape type 2
2026-03-30 11:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd with scrape type 2
2026-03-30 11:14:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd, identifier: NB74696
2026-03-30 11:14:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd with identifier: NB74696
2026-03-30 11:14:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd with identifier: NB74696
2026-03-30 11:14:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd with identifier: NB74696 to the API
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:55:32Z',
 'fuel_type': 'petrol',
 'id': '96c7d80f-7dff-543d-8ffb-1ac5b324f0bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB74696',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 158883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-12',
 'seller_name': None,
 'title': 'Dacia Sandero 1.6 Stepway II',
 'transmission': 'manual',
 'trim': 'Stepway II',
 'year': 2012}
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB74696%27 HTTP/1.1" 200 None
2026-03-30 11:14:36 [auto1.de] INFO: Saving data for NB74696: {'auction_closing_time': 1774886132.0, 'created_time': 1773427849.428619, 'last_price_update_time': 1774869276.433987}
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB74696') HTTP/1.1" 204 0
2026-03-30 11:14:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:36 [auto1.de] INFO: Found listing with ID: ZY67532
2026-03-30 11:14:36 [auto1.de] INFO: Found listing with ID: XM85964
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM85964%27 HTTP/1.1" 200 None
2026-03-30 11:14:36 [auto1.de] INFO: Scrape type for XM85964: 0
2026-03-30 11:14:36 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV07676%27 HTTP/1.1" 200 None
2026-03-30 11:14:36 [auto1.de] INFO: Scrape type for EV07676: 0
2026-03-30 11:14:36 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-30 11:14:36 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT79830%27 HTTP/1.1" 200 None
2026-03-30 11:14:36 [auto1.de] INFO: Scrape type for TT79830: 0
2026-03-30 11:14:36 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ76765%27 HTTP/1.1" 200 None
2026-03-30 11:14:36 [auto1.de] INFO: Scrape type for BJ76765: 0
2026-03-30 11:14:36 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-30 11:14:36 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-30 11:14:36 [auto1.de] INFO: Found listing with ID: EB23649
2026-03-30 11:14:36 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-30 11:14:36 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-30 11:15:04 [scrapy.extensions.logstats] INFO: Crawled 887 pages (at 3 pages/min), scraped 1359 items (at 1 items/min)
2026-03-30 11:15:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:16:04 [scrapy.extensions.logstats] INFO: Crawled 887 pages (at 0 pages/min), scraped 1359 items (at 0 items/min)
2026-03-30 11:16:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:16:47 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.667(s), this was the 1st time calling it.
2026-03-30 11:16:47 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.558896253932834 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:16:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:16:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:59 [auto1.de] INFO: Channel: 24h | Page: 142 | totalHits: 9666 | hits on page: 40
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: HU76899
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU76899%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for HU76899: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: GG35295
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG35295%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for GG35295: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: BC43890
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU24928%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for AU24928: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB74696%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for NB74696: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: ZY67532
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: XM85964
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM85964%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for XM85964: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV07676%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for EV07676: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT79830%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for TT79830: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ76765%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for BJ76765: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: EB23649
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: DW20402
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW20402%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for DW20402: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: RU04475
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: CM46932
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: YU99321
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ05854%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for RJ05854: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ09190%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for LZ09190: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: AU06034
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06034%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for AU06034: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: BS30478
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: GR11096
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: BU34226
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU34226%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for BU34226: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: LM64010
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM64010%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for LM64010: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: BP69696
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: VS98384
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: CH30601
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: LW30512
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: UZ43090
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: DB30141
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB30141%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for DB30141: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: KG01306
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG01306%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for KG01306: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: GB27132
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: GW76676
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW76676%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for GW76676: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: JR98479
2026-03-30 11:16:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:04 [scrapy.extensions.logstats] INFO: Crawled 888 pages (at 1 pages/min), scraped 1359 items (at 0 items/min)
2026-03-30 11:17:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:12 [auto1.de] INFO: Channel: 24h | Page: 143 | totalHits: 9666 | hits on page: 40
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: ZD70727
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: RW15562
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: NZ56847
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ56847%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for NZ56847: 0
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: RX78889
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: AV32823
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: FB42809
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: VS80969
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS80969%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for VS80969: 0
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: DD28346
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: MT59111
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE37655%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for GE37655: 0
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: HV33102
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: LS36397
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS36397%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for LS36397: 0
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF67152%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for PF67152: 0
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: NV00892
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: YT58518
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT58518%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for YT58518: 0
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: RN98053
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN98053%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for RN98053: 0
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: CT73600
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT73600%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for CT73600: 0
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: CV84531
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: XR25495
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR25495%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for XR25495: 0
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: GX89038
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX89038%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for GX89038: 0
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: CK72791
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72791%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for CK72791: 0
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: MB36683
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB36683%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for MB36683: 0
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: AK97582
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK97582%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for AK97582: 0
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW79987%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for KW79987: 0
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: BX09216
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX09216%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for BX09216: 0
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: UF17826
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: RY42515
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY42515%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for RY42515: 0
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: CM72901
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM72901%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for CM72901: 0
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: ZS44353
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: KA83953
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: ZY07029
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: SC48990
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC48990%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for SC48990: 0
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: EV39961
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV39961%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for EV39961: 0
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: XA52388
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: XD89320
2026-03-30 11:17:12 [auto1.de] INFO: Found listing with ID: ZF45936
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF45936%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.de] INFO: Scrape type for ZF45936: 0
2026-03-30 11:17:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:20 [auto1.de] INFO: Channel: 24h | Page: 144 | totalHits: 9666 | hits on page: 40
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: NB97805
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: GK14526
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK14526%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for GK14526: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW62166%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for MW62166: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: AA38517
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: BZ60217
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: SC45462
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC45462%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for SC45462: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: TP70009
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP70009%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for TP70009: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: DJ74169
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74169%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for DJ74169: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: LN58071
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: VY10701
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10701%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for VY10701: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: AD28287
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD28287%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for AD28287: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: AF42457
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF42457%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for AF42457: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: DZ52896
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ52896%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for DZ52896: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: BD46064
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: JP54184
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY25163%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for FY25163: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: NL59823
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59823%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for NL59823: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY44699%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for PY44699: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: SC26693
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC26693%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for SC26693: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: FB84476
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: AW80903
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: TN14580
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN14580%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for TN14580: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: NG89372
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: MC98877
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: VN54723
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: NG94369
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG94369%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for NG94369: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: WY91699
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY91699%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for WY91699: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: HG94589
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG94589%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for HG94589: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: VZ83010
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: GB74339
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB74339%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for GB74339: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: AR53020
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR53020%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for AR53020: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: NH53597
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM89812%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for LM89812: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: MC93517
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA88457%27 HTTP/1.1" 200 None
2026-03-30 11:17:20 [auto1.de] INFO: Scrape type for PA88457: 0
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: EP96455
2026-03-30 11:17:20 [auto1.de] INFO: Found listing with ID: NE52715
2026-03-30 11:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE52715%27 HTTP/1.1" 200 None
2026-03-30 11:17:21 [auto1.de] INFO: Scrape type for NE52715: 0
2026-03-30 11:17:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:04 [scrapy.extensions.logstats] INFO: Crawled 890 pages (at 2 pages/min), scraped 1359 items (at 0 items/min)
2026-03-30 11:18:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:18:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:26 [auto1.de] INFO: Channel: 24h | Page: 145 | totalHits: 9674 | hits on page: 40
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: NH53597
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM89812%27 HTTP/1.1" 200 None
2026-03-30 11:18:26 [auto1.de] INFO: Scrape type for LM89812: 0
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: MC93517
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA88457%27 HTTP/1.1" 200 None
2026-03-30 11:18:26 [auto1.de] INFO: Scrape type for PA88457: 0
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: EP96455
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: NE52715
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE52715%27 HTTP/1.1" 200 None
2026-03-30 11:18:26 [auto1.de] INFO: Scrape type for NE52715: 0
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: LD06025
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD06025%27 HTTP/1.1" 200 None
2026-03-30 11:18:26 [auto1.de] INFO: Scrape type for LD06025: 0
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN51512%27 HTTP/1.1" 200 None
2026-03-30 11:18:26 [auto1.de] INFO: Scrape type for XN51512: 0
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: XU64075
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU64075%27 HTTP/1.1" 200 None
2026-03-30 11:18:26 [auto1.de] INFO: Scrape type for XU64075: 0
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: BB27376
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB27376%27 HTTP/1.1" 200 None
2026-03-30 11:18:26 [auto1.de] INFO: Scrape type for BB27376: 0
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: TL87064
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL87064%27 HTTP/1.1" 200 None
2026-03-30 11:18:26 [auto1.de] INFO: Scrape type for TL87064: 0
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: BE80399
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: YZ86105
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ86105%27 HTTP/1.1" 200 None
2026-03-30 11:18:26 [auto1.de] INFO: Scrape type for YZ86105: 0
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: BK59777
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK59777%27 HTTP/1.1" 200 None
2026-03-30 11:18:26 [auto1.de] INFO: Scrape type for BK59777: 0
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: BC65369
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: VS51325
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: HP91359
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP91359%27 HTTP/1.1" 200 None
2026-03-30 11:18:26 [auto1.de] INFO: Scrape type for HP91359: 0
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: AR55742
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR55742%27 HTTP/1.1" 200 None
2026-03-30 11:18:26 [auto1.de] INFO: Scrape type for AR55742: 0
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: SM38981
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: HF06660
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF06660%27 HTTP/1.1" 200 None
2026-03-30 11:18:26 [auto1.de] INFO: Scrape type for HF06660: 0
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: CM37211
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: AM68343
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: VF41212
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF41212%27 HTTP/1.1" 200 None
2026-03-30 11:18:26 [auto1.de] INFO: Scrape type for VF41212: 0
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: PS74193
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: ZK10618
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: WD52714
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: JE50334
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: YA26169
2026-03-30 11:18:26 [auto1.de] INFO: Found listing with ID: WY19584
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY19584%27 HTTP/1.1" 200 None
2026-03-30 11:18:27 [auto1.de] INFO: Scrape type for WY19584: 0
2026-03-30 11:18:27 [auto1.de] INFO: Found listing with ID: CT00605
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT00605%27 HTTP/1.1" 200 None
2026-03-30 11:18:27 [auto1.de] INFO: Scrape type for CT00605: 0
2026-03-30 11:18:27 [auto1.de] INFO: Found listing with ID: NX98723
2026-03-30 11:18:27 [auto1.de] INFO: Found listing with ID: XN16480
2026-03-30 11:18:27 [auto1.de] INFO: Found listing with ID: WG93130
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG93130%27 HTTP/1.1" 200 None
2026-03-30 11:18:27 [auto1.de] INFO: Scrape type for WG93130: 0
2026-03-30 11:18:27 [auto1.de] INFO: Found listing with ID: VY28868
2026-03-30 11:18:27 [auto1.de] INFO: Found listing with ID: DE97424
2026-03-30 11:18:27 [auto1.de] INFO: Found listing with ID: CD67065
2026-03-30 11:18:27 [auto1.de] INFO: Found listing with ID: WE44185
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE44185%27 HTTP/1.1" 200 None
2026-03-30 11:18:27 [auto1.de] INFO: Scrape type for WE44185: 0
2026-03-30 11:18:27 [auto1.de] INFO: Found listing with ID: EN50331
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN50331%27 HTTP/1.1" 200 None
2026-03-30 11:18:27 [auto1.de] INFO: Scrape type for EN50331: 0
2026-03-30 11:18:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:29 [auto1.de] INFO: Channel: 24h | Page: 146 | totalHits: 9674 | hits on page: 40
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: PZ11168
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ11168%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.de] INFO: Scrape type for PZ11168: 0
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: NF30454
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF30454%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.de] INFO: Scrape type for NF30454: 0
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: SL27608
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL27608%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.de] INFO: Scrape type for SL27608: 0
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: ZG00412
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG00412%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.de] INFO: Scrape type for ZG00412: 0
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: JA27410
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA27410%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.de] INFO: Scrape type for JA27410: 0
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: EH58090
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: BW78905
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: UZ37067
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ37067%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.de] INFO: Scrape type for UZ37067: 0
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: SS59240
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR34423%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.de] INFO: Scrape type for VR34423: 0
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: LK46158
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: UK70882
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK70882%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.de] INFO: Scrape type for UK70882: 0
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: DN02562
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: FP27450
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: UZ18000
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ18000%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.de] INFO: Scrape type for UZ18000: 0
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: TV01596
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: MU97238
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: SU94182
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: NA32054
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: YT16103
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: VN46305
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN46305%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.de] INFO: Scrape type for VN46305: 0
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: JK31212
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK31212%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.de] INFO: Scrape type for JK31212: 0
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: BJ70582
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ16115%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.de] INFO: Scrape type for TJ16115: 0
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: SP10059
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP10059%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.de] INFO: Scrape type for SP10059: 0
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: DW51780
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: SM03586
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM03586%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.de] INFO: Scrape type for SM03586: 0
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: SK51641
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK51641%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.de] INFO: Scrape type for SK51641: 0
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM08692%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.de] INFO: Scrape type for ZM08692: 0
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY29921%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.de] INFO: Scrape type for MY29921: 0
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN13511%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.de] INFO: Scrape type for UN13511: 0
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: RC44114
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61504%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.de] INFO: Scrape type for GD61504: 0
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: AE57502
2026-03-30 11:18:29 [auto1.de] INFO: Found listing with ID: HC05500
2026-03-30 11:18:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:04 [scrapy.extensions.logstats] INFO: Crawled 892 pages (at 2 pages/min), scraped 1359 items (at 0 items/min)
2026-03-30 11:19:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:20:04 [scrapy.extensions.logstats] INFO: Crawled 892 pages (at 0 pages/min), scraped 1359 items (at 0 items/min)
2026-03-30 11:20:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:20:40 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.069(s), this was the 1st time calling it.
2026-03-30 11:20:40 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.8600767009042425 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:20:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:20:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:46 [auto1.de] INFO: Channel: 24h | Page: 147 | totalHits: 9683 | hits on page: 40
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: SK51641
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK51641%27 HTTP/1.1" 200 None
2026-03-30 11:20:46 [auto1.de] INFO: Scrape type for SK51641: 0
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM08692%27 HTTP/1.1" 200 None
2026-03-30 11:20:46 [auto1.de] INFO: Scrape type for ZM08692: 0
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY29921%27 HTTP/1.1" 200 None
2026-03-30 11:20:46 [auto1.de] INFO: Scrape type for MY29921: 0
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN13511%27 HTTP/1.1" 200 None
2026-03-30 11:20:46 [auto1.de] INFO: Scrape type for UN13511: 0
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: RC44114
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61504%27 HTTP/1.1" 200 None
2026-03-30 11:20:46 [auto1.de] INFO: Scrape type for GD61504: 0
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: AE57502
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: HC05500
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: VR75394
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR75394%27 HTTP/1.1" 200 None
2026-03-30 11:20:46 [auto1.de] INFO: Scrape type for VR75394: 0
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: RC86111
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC86111%27 HTTP/1.1" 200 None
2026-03-30 11:20:46 [auto1.de] INFO: Scrape type for RC86111: 0
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: KE06488
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: SU61840
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: XJ26035
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ26035%27 HTTP/1.1" 200 None
2026-03-30 11:20:46 [auto1.de] INFO: Scrape type for XJ26035: 0
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: GH26905
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH26905%27 HTTP/1.1" 200 None
2026-03-30 11:20:46 [auto1.de] INFO: Scrape type for GH26905: 0
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: BY91581
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: GP45415
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP45415%27 HTTP/1.1" 200 None
2026-03-30 11:20:46 [auto1.de] INFO: Scrape type for GP45415: 0
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: CV30078
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: GK55952
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: LR33805
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: RD90808
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: FE22716
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE22716%27 HTTP/1.1" 200 None
2026-03-30 11:20:46 [auto1.de] INFO: Scrape type for FE22716: 0
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: YN77653
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN77653%27 HTTP/1.1" 200 None
2026-03-30 11:20:46 [auto1.de] INFO: Scrape type for YN77653: 0
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: CS57817
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS57817%27 HTTP/1.1" 200 None
2026-03-30 11:20:46 [auto1.de] INFO: Scrape type for CS57817: 0
2026-03-30 11:20:46 [auto1.de] INFO: Found listing with ID: ZU59417
2026-03-30 11:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU59417%27 HTTP/1.1" 200 None
2026-03-30 11:20:47 [auto1.de] INFO: Scrape type for ZU59417: 0
2026-03-30 11:20:47 [auto1.de] INFO: Found listing with ID: DK64287
2026-03-30 11:20:47 [auto1.de] INFO: Found listing with ID: GY49475
2026-03-30 11:20:47 [auto1.de] INFO: Found listing with ID: PN07086
2026-03-30 11:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN07086%27 HTTP/1.1" 200 None
2026-03-30 11:20:47 [auto1.de] INFO: Scrape type for PN07086: 0
2026-03-30 11:20:47 [auto1.de] INFO: Found listing with ID: YT00833
2026-03-30 11:20:47 [auto1.de] INFO: Found listing with ID: DD95746
2026-03-30 11:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD95746%27 HTTP/1.1" 200 None
2026-03-30 11:20:47 [auto1.de] INFO: Scrape type for DD95746: 0
2026-03-30 11:20:47 [auto1.de] INFO: Found listing with ID: CG01662
2026-03-30 11:20:47 [auto1.de] INFO: Found listing with ID: ZK33939
2026-03-30 11:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK33939%27 HTTP/1.1" 200 None
2026-03-30 11:20:47 [auto1.de] INFO: Scrape type for ZK33939: 0
2026-03-30 11:20:47 [auto1.de] INFO: Found listing with ID: SA17140
2026-03-30 11:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA17140%27 HTTP/1.1" 200 None
2026-03-30 11:20:47 [auto1.de] INFO: Scrape type for SA17140: 0
2026-03-30 11:20:47 [auto1.de] INFO: Found listing with ID: TZ90006
2026-03-30 11:20:47 [auto1.de] INFO: Found listing with ID: EA89472
2026-03-30 11:20:47 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-30 11:20:47 [auto1.de] INFO: Found listing with ID: RV27706
2026-03-30 11:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV27706%27 HTTP/1.1" 200 None
2026-03-30 11:20:47 [auto1.de] INFO: Scrape type for RV27706: 0
2026-03-30 11:20:47 [auto1.de] INFO: Found listing with ID: HE21190
2026-03-30 11:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE21190%27 HTTP/1.1" 200 None
2026-03-30 11:20:47 [auto1.de] INFO: Scrape type for HE21190: 0
2026-03-30 11:20:47 [auto1.de] INFO: Found listing with ID: WY51014
2026-03-30 11:20:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:58 [auto1.de] INFO: Channel: 24h | Page: 148 | totalHits: 9684 | hits on page: 40
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: WY51014
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: US71241
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US71241%27 HTTP/1.1" 200 None
2026-03-30 11:20:58 [auto1.de] INFO: Scrape type for US71241: 0
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: CR70146
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: ZF08436
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: PV05136
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: MY97637
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY97637%27 HTTP/1.1" 200 None
2026-03-30 11:20:58 [auto1.de] INFO: Scrape type for MY97637: 0
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: PN60983
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY49162%27 HTTP/1.1" 200 None
2026-03-30 11:20:58 [auto1.de] INFO: Scrape type for YY49162: 0
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: VU36521
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: LN53329
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: EZ09435
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR21224%27 HTTP/1.1" 200 None
2026-03-30 11:20:58 [auto1.de] INFO: Scrape type for JR21224: 0
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: GW17934
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: JT99615
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT99615%27 HTTP/1.1" 200 None
2026-03-30 11:20:58 [auto1.de] INFO: Scrape type for JT99615: 0
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: HG38928
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG38928%27 HTTP/1.1" 200 None
2026-03-30 11:20:58 [auto1.de] INFO: Scrape type for HG38928: 0
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: DF59303
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF59303%27 HTTP/1.1" 200 None
2026-03-30 11:20:58 [auto1.de] INFO: Scrape type for DF59303: 0
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: LK78678
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: UE69699
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: HY74574
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: HD50866
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: SN40806
2026-03-30 11:20:58 [auto1.de] INFO: Found listing with ID: HM04457
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04457%27 HTTP/1.1" 200 None
2026-03-30 11:20:59 [auto1.de] INFO: Scrape type for HM04457: 0
2026-03-30 11:20:59 [auto1.de] INFO: Found listing with ID: VW56389
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW56389%27 HTTP/1.1" 200 None
2026-03-30 11:20:59 [auto1.de] INFO: Scrape type for VW56389: 0
2026-03-30 11:20:59 [auto1.de] INFO: Found listing with ID: WZ14073
2026-03-30 11:20:59 [auto1.de] INFO: Found listing with ID: EN90928
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN90928%27 HTTP/1.1" 200 None
2026-03-30 11:20:59 [auto1.de] INFO: Scrape type for EN90928: 0
2026-03-30 11:20:59 [auto1.de] INFO: Found listing with ID: JY33610
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY33610%27 HTTP/1.1" 200 None
2026-03-30 11:20:59 [auto1.de] INFO: Scrape type for JY33610: 0
2026-03-30 11:20:59 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-30 11:20:59 [auto1.de] INFO: Found listing with ID: MU35402
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU35402%27 HTTP/1.1" 200 None
2026-03-30 11:20:59 [auto1.de] INFO: Scrape type for MU35402: 0
2026-03-30 11:20:59 [auto1.de] INFO: Found listing with ID: BC48090
2026-03-30 11:20:59 [auto1.de] INFO: Found listing with ID: KG29776
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG29776%27 HTTP/1.1" 200 None
2026-03-30 11:20:59 [auto1.de] INFO: Scrape type for KG29776: 0
2026-03-30 11:20:59 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB29698%27 HTTP/1.1" 200 None
2026-03-30 11:20:59 [auto1.de] INFO: Scrape type for RB29698: 0
2026-03-30 11:20:59 [auto1.de] INFO: Found listing with ID: YV87591
2026-03-30 11:20:59 [auto1.de] INFO: Found listing with ID: LH09734
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH09734%27 HTTP/1.1" 200 None
2026-03-30 11:20:59 [auto1.de] INFO: Scrape type for LH09734: 0
2026-03-30 11:20:59 [auto1.de] INFO: Found listing with ID: VU37583
2026-03-30 11:20:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:00 [auto1.de] INFO: Channel: 24h | Page: 149 | totalHits: 9684 | hits on page: 40
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: VS89065
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: ZV83127
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV83127%27 HTTP/1.1" 200 None
2026-03-30 11:21:00 [auto1.de] INFO: Scrape type for ZV83127: 0
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ89661%27 HTTP/1.1" 200 None
2026-03-30 11:21:00 [auto1.de] INFO: Scrape type for CZ89661: 0
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: KK06519
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: NT80809
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: CK79873
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK79873%27 HTTP/1.1" 200 None
2026-03-30 11:21:00 [auto1.de] INFO: Scrape type for CK79873: 0
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: YA77478
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77478%27 HTTP/1.1" 200 None
2026-03-30 11:21:00 [auto1.de] INFO: Scrape type for YA77478: 0
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: XL73598
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL73598%27 HTTP/1.1" 200 None
2026-03-30 11:21:00 [auto1.de] INFO: Scrape type for XL73598: 0
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: UU18213
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU18213%27 HTTP/1.1" 200 None
2026-03-30 11:21:00 [auto1.de] INFO: Scrape type for UU18213: 0
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: MW99572
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW99572%27 HTTP/1.1" 200 None
2026-03-30 11:21:00 [auto1.de] INFO: Scrape type for MW99572: 0
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ94843%27 HTTP/1.1" 200 None
2026-03-30 11:21:00 [auto1.de] INFO: Scrape type for HJ94843: 0
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: MK79183
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: NF12247
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: ZY56723
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY56723%27 HTTP/1.1" 200 None
2026-03-30 11:21:00 [auto1.de] INFO: Scrape type for ZY56723: 0
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: BW33957
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW33957%27 HTTP/1.1" 200 None
2026-03-30 11:21:00 [auto1.de] INFO: Scrape type for BW33957: 0
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: TW44182
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: RK85869
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: RJ71204
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: ZH34670
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: BE15343
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU42459%27 HTTP/1.1" 200 None
2026-03-30 11:21:00 [auto1.de] INFO: Scrape type for ZU42459: 0
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: CA27289
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA27289%27 HTTP/1.1" 200 None
2026-03-30 11:21:00 [auto1.de] INFO: Scrape type for CA27289: 0
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: ZF67159
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF67159%27 HTTP/1.1" 200 None
2026-03-30 11:21:00 [auto1.de] INFO: Scrape type for ZF67159: 0
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: YD60070
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD60070%27 HTTP/1.1" 200 None
2026-03-30 11:21:00 [auto1.de] INFO: Scrape type for YD60070: 0
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: CW80278
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW80278%27 HTTP/1.1" 200 None
2026-03-30 11:21:00 [auto1.de] INFO: Scrape type for CW80278: 0
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: WD35847
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: ZY80421
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: LW43520
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW43520%27 HTTP/1.1" 200 None
2026-03-30 11:21:00 [auto1.de] INFO: Scrape type for LW43520: 0
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP47747%27 HTTP/1.1" 200 None
2026-03-30 11:21:00 [auto1.de] INFO: Scrape type for WP47747: 0
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: EN88282
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: JD54519
2026-03-30 11:21:00 [auto1.de] INFO: Found listing with ID: XD58993
2026-03-30 11:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD58993%27 HTTP/1.1" 200 None
2026-03-30 11:21:01 [auto1.de] INFO: Scrape type for XD58993: 0
2026-03-30 11:21:01 [auto1.de] INFO: Found listing with ID: XK33490
2026-03-30 11:21:01 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-30 11:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR99181%27 HTTP/1.1" 200 None
2026-03-30 11:21:01 [auto1.de] INFO: Scrape type for WR99181: 0
2026-03-30 11:21:01 [auto1.de] INFO: Found listing with ID: MS83797
2026-03-30 11:21:01 [auto1.de] INFO: Found listing with ID: KS42383
2026-03-30 11:21:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:04 [scrapy.extensions.logstats] INFO: Crawled 895 pages (at 3 pages/min), scraped 1359 items (at 0 items/min)
2026-03-30 11:21:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:21:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:07 [auto1.de] INFO: Channel: 24h | Page: 150 | totalHits: 9684 | hits on page: 40
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: ME12043
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME12043%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for ME12043: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: YB86536
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: SD97280
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97280%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for SD97280: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: LG84508
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: BP02747
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP02747%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for BP02747: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT37883%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for BT37883: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: ST29936
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST29936%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for ST29936: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: RX04560
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX04560%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for RX04560: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: FV26342
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV26342%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for FV26342: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: AJ43779
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: VW79588
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW79588%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for VW79588: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: YZ54178
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: DX03120
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX03120%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for DX03120: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: NR35132
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: GS49465
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS49465%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for GS49465: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: UV59464
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV59464%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for UV59464: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: UW12612
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: NS17757
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: KE42269
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: LT68556
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: AC77037
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: RF69391
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: PA20304
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: NS53664
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS53664%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for NS53664: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: TU97792
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU97792%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for TU97792: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: HF35410
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF35410%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for HF35410: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: HZ51579
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ51579%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for HZ51579: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: LL99453
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: MA44978
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA44978%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for MA44978: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: GY67479
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY67479%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for GY67479: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: VG52113
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG52113%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for VG52113: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: YT13980
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: SM28331
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: GV20028
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: VJ08081
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ08081%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for VJ08081: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: CX62190
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX62190%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for CX62190: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73698%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for WK73698: 0
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-30 11:21:07 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE06888%27 HTTP/1.1" 200 None
2026-03-30 11:21:07 [auto1.de] INFO: Scrape type for RE06888: 0
2026-03-30 11:21:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:15 [auto1.de] INFO: Channel: 24h | Page: 151 | totalHits: 9685 | hits on page: 40
2026-03-30 11:21:15 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-30 11:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE06888%27 HTTP/1.1" 200 None
2026-03-30 11:21:15 [auto1.de] INFO: Scrape type for RE06888: 0
2026-03-30 11:21:15 [auto1.de] INFO: Found listing with ID: XJ33844
2026-03-30 11:21:15 [auto1.de] INFO: Found listing with ID: EE83038
2026-03-30 11:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83038%27 HTTP/1.1" 200 None
2026-03-30 11:21:15 [auto1.de] INFO: Scrape type for EE83038: 0
2026-03-30 11:21:15 [auto1.de] INFO: Found listing with ID: MM36361
2026-03-30 11:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM36361%27 HTTP/1.1" 200 None
2026-03-30 11:21:15 [auto1.de] INFO: Scrape type for MM36361: 0
2026-03-30 11:21:15 [auto1.de] INFO: Found listing with ID: HE92439
2026-03-30 11:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE92439%27 HTTP/1.1" 200 None
2026-03-30 11:21:15 [auto1.de] INFO: Scrape type for HE92439: 0
2026-03-30 11:21:15 [auto1.de] INFO: Found listing with ID: SH26484
2026-03-30 11:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH26484%27 HTTP/1.1" 200 None
2026-03-30 11:21:15 [auto1.de] INFO: Scrape type for SH26484: 0
2026-03-30 11:21:15 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-30 11:21:15 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-30 11:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX72393%27 HTTP/1.1" 200 None
2026-03-30 11:21:15 [auto1.de] INFO: Scrape type for NX72393: 0
2026-03-30 11:21:15 [auto1.de] INFO: Found listing with ID: BK52975
2026-03-30 11:21:15 [auto1.de] INFO: Found listing with ID: VP25295
2026-03-30 11:21:15 [auto1.de] INFO: Found listing with ID: VH62706
2026-03-30 11:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH62706%27 HTTP/1.1" 200 None
2026-03-30 11:21:16 [auto1.de] INFO: Scrape type for VH62706: 0
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: NZ04570
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ04570%27 HTTP/1.1" 200 None
2026-03-30 11:21:16 [auto1.de] INFO: Scrape type for NZ04570: 0
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: BN48826
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN48826%27 HTTP/1.1" 200 None
2026-03-30 11:21:16 [auto1.de] INFO: Scrape type for BN48826: 0
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: FC29722
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC29722%27 HTTP/1.1" 200 None
2026-03-30 11:21:16 [auto1.de] INFO: Scrape type for FC29722: 0
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: DE77804
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: EB96923
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB96923%27 HTTP/1.1" 200 None
2026-03-30 11:21:16 [auto1.de] INFO: Scrape type for EB96923: 0
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: XK03693
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK03693%27 HTTP/1.1" 200 None
2026-03-30 11:21:16 [auto1.de] INFO: Scrape type for XK03693: 0
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: RG76834
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: WL56832
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL56832%27 HTTP/1.1" 200 None
2026-03-30 11:21:16 [auto1.de] INFO: Scrape type for WL56832: 0
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: MN63665
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: AG34789
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG34789%27 HTTP/1.1" 200 None
2026-03-30 11:21:16 [auto1.de] INFO: Scrape type for AG34789: 0
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: KC01296
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: JL94841
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: KP87344
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP87344%27 HTTP/1.1" 200 None
2026-03-30 11:21:16 [auto1.de] INFO: Scrape type for KP87344: 0
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: WH84573
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: SA01659
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA01659%27 HTTP/1.1" 200 None
2026-03-30 11:21:16 [auto1.de] INFO: Scrape type for SA01659: 0
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: MR61415
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR61415%27 HTTP/1.1" 200 None
2026-03-30 11:21:16 [auto1.de] INFO: Scrape type for MR61415: 0
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: MV77064
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: HZ18082
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: MS57219
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS57219%27 HTTP/1.1" 200 None
2026-03-30 11:21:16 [auto1.de] INFO: Scrape type for MS57219: 0
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: UC78580
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20328%27 HTTP/1.1" 200 None
2026-03-30 11:21:16 [auto1.de] INFO: Scrape type for BB20328: 0
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: KV22200
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: MX99530
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: HD39951
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD39951%27 HTTP/1.1" 200 None
2026-03-30 11:21:16 [auto1.de] INFO: Scrape type for HD39951: 0
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM51025%27 HTTP/1.1" 200 None
2026-03-30 11:21:16 [auto1.de] INFO: Scrape type for JM51025: 0
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: LK29782
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK29782%27 HTTP/1.1" 200 None
2026-03-30 11:21:16 [auto1.de] INFO: Scrape type for LK29782: 0
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: SH34786
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: MV46979
2026-03-30 11:21:16 [auto1.de] INFO: Found listing with ID: TN55927
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55927%27 HTTP/1.1" 200 None
2026-03-30 11:21:16 [auto1.de] INFO: Scrape type for TN55927: 0
2026-03-30 11:21:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:17 [auto1.de] INFO: Channel: 24h | Page: 152 | totalHits: 9685 | hits on page: 40
2026-03-30 11:21:17 [auto1.de] INFO: Found listing with ID: YB52644
2026-03-30 11:21:17 [auto1.de] INFO: Found listing with ID: UG24808
2026-03-30 11:21:17 [auto1.de] INFO: Found listing with ID: WN48846
2026-03-30 11:21:17 [auto1.de] INFO: Found listing with ID: EW54456
2026-03-30 11:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW54456%27 HTTP/1.1" 200 None
2026-03-30 11:21:17 [auto1.de] INFO: Scrape type for EW54456: 2
2026-03-30 11:21:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6160e90-c6a5-5203-af51-5018a4498b33 with identifier: EW54456
2026-03-30 11:21:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6160e90-c6a5-5203-af51-5018a4498b33 with scrape type 2
2026-03-30 11:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6160e90-c6a5-5203-af51-5018a4498b33 with scrape type 2
2026-03-30 11:21:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6160e90-c6a5-5203-af51-5018a4498b33, identifier: EW54456
2026-03-30 11:21:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6160e90-c6a5-5203-af51-5018a4498b33 with identifier: EW54456
2026-03-30 11:21:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6160e90-c6a5-5203-af51-5018a4498b33 with identifier: EW54456
2026-03-30 11:21:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6160e90-c6a5-5203-af51-5018a4498b33 with identifier: EW54456 to the API
2026-03-30 11:21:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:21:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:21:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:08:28Z',
 'fuel_type': 'diesel',
 'id': 'a6160e90-c6a5-5203-af51-5018a4498b33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW54456',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 66825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-24',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid T 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic Avantgarde',
 'year': 2023}
2026-03-30 11:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW54456%27 HTTP/1.1" 200 None
2026-03-30 11:21:17 [auto1.de] INFO: Saving data for EW54456: {'auction_closing_time': 1774883308.0, 'created_time': 1773341498.245972, 'last_price_update_time': 1774869677.842567}
2026-03-30 11:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW54456') HTTP/1.1" 204 0
2026-03-30 11:21:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:17 [auto1.de] INFO: Found listing with ID: WA42384
2026-03-30 11:21:17 [auto1.de] INFO: Found listing with ID: EV99140
2026-03-30 11:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV99140%27 HTTP/1.1" 200 None
2026-03-30 11:21:17 [auto1.de] INFO: Scrape type for EV99140: 0
2026-03-30 11:21:17 [auto1.de] INFO: Found listing with ID: GK51404
2026-03-30 11:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK51404%27 HTTP/1.1" 200 None
2026-03-30 11:21:17 [auto1.de] INFO: Scrape type for GK51404: 0
2026-03-30 11:21:17 [auto1.de] INFO: Found listing with ID: GR91976
2026-03-30 11:21:17 [auto1.de] INFO: Found listing with ID: GM15631
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM15631%27 HTTP/1.1" 200 None
2026-03-30 11:21:18 [auto1.de] INFO: Scrape type for GM15631: 0
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: WD28635
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: EW11176
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW11176%27 HTTP/1.1" 200 None
2026-03-30 11:21:18 [auto1.de] INFO: Scrape type for EW11176: 0
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: BM78825
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG67731%27 HTTP/1.1" 200 None
2026-03-30 11:21:18 [auto1.de] INFO: Scrape type for SG67731: 0
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: VY52691
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY52691%27 HTTP/1.1" 200 None
2026-03-30 11:21:18 [auto1.de] INFO: Scrape type for VY52691: 0
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: PC09309
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09309%27 HTTP/1.1" 200 None
2026-03-30 11:21:18 [auto1.de] INFO: Scrape type for PC09309: 0
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: FM78984
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: LG80642
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG80642%27 HTTP/1.1" 200 None
2026-03-30 11:21:18 [auto1.de] INFO: Scrape type for LG80642: 0
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: XK79004
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK79004%27 HTTP/1.1" 200 None
2026-03-30 11:21:18 [auto1.de] INFO: Scrape type for XK79004: 0
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: NN62521
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: MN24694
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN24694%27 HTTP/1.1" 200 None
2026-03-30 11:21:18 [auto1.de] INFO: Scrape type for MN24694: 0
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: TL40939
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: RW72462
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW72462%27 HTTP/1.1" 200 None
2026-03-30 11:21:18 [auto1.de] INFO: Scrape type for RW72462: 0
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: DA12198
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: MC04391
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC04391%27 HTTP/1.1" 200 None
2026-03-30 11:21:18 [auto1.de] INFO: Scrape type for MC04391: 0
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: BG03972
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: HY48346
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: YL44466
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: KF79768
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: KE01468
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01468%27 HTTP/1.1" 200 None
2026-03-30 11:21:18 [auto1.de] INFO: Scrape type for KE01468: 0
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: AW33862
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW33862%27 HTTP/1.1" 200 None
2026-03-30 11:21:18 [auto1.de] INFO: Scrape type for AW33862: 0
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: PS82171
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82171%27 HTTP/1.1" 200 None
2026-03-30 11:21:18 [auto1.de] INFO: Scrape type for PS82171: 0
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: CX46071
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: YS99143
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS99143%27 HTTP/1.1" 200 None
2026-03-30 11:21:18 [auto1.de] INFO: Scrape type for YS99143: 0
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: WB36208
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB36208%27 HTTP/1.1" 200 None
2026-03-30 11:21:18 [auto1.de] INFO: Scrape type for WB36208: 0
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: WS03851
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS03851%27 HTTP/1.1" 200 None
2026-03-30 11:21:18 [auto1.de] INFO: Scrape type for WS03851: 0
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: LD03873
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD03873%27 HTTP/1.1" 200 None
2026-03-30 11:21:18 [auto1.de] INFO: Scrape type for LD03873: 0
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: AA01467
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA01467%27 HTTP/1.1" 200 None
2026-03-30 11:21:18 [auto1.de] INFO: Scrape type for AA01467: 0
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: JB91178
2026-03-30 11:21:18 [auto1.de] INFO: Found listing with ID: SZ50241
2026-03-30 11:21:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:20 [auto1.de] INFO: Channel: 24h | Page: 153 | totalHits: 9686 | hits on page: 40
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: SZ50241
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: TG47191
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: XT20233
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20233%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [auto1.de] INFO: Scrape type for XT20233: 0
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: RW82332
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: ZV10923
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: TK34912
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK34912%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [auto1.de] INFO: Scrape type for TK34912: 0
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: FJ71547
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71547%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [auto1.de] INFO: Scrape type for FJ71547: 0
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: YN11150
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: KF63031
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF63031%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [auto1.de] INFO: Scrape type for KF63031: 0
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: LV55380
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: HZ95747
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: EU22008
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU22008%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [auto1.de] INFO: Scrape type for EU22008: 0
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: RJ73659
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: KF55313
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF55313%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [auto1.de] INFO: Scrape type for KF55313: 0
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: FZ03157
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: BS97689
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: HD43211
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: UW00779
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW00779%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [auto1.de] INFO: Scrape type for UW00779: 0
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: KZ71563
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: BD76424
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: LK80095
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: CE41516
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE41516%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [auto1.de] INFO: Scrape type for CE41516: 0
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: SL45023
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: YR75545
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT47484%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [auto1.de] INFO: Scrape type for JT47484: 0
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: PW82194
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW82194%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [auto1.de] INFO: Scrape type for PW82194: 0
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: CM30450
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: HA14963
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: HT39177
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT39177%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [auto1.de] INFO: Scrape type for HT39177: 0
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: VE54720
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE54720%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [auto1.de] INFO: Scrape type for VE54720: 0
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: XA88514
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA88514%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [auto1.de] INFO: Scrape type for XA88514: 0
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: HB57575
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: BP38143
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: GX32204
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: UA25928
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: GT24864
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: UB19206
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19206%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [auto1.de] INFO: Scrape type for UB19206: 0
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK41748%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [auto1.de] INFO: Scrape type for GK41748: 0
2026-03-30 11:21:20 [auto1.de] INFO: Found listing with ID: YA52648
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA52648%27 HTTP/1.1" 200 None
2026-03-30 11:21:20 [auto1.de] INFO: Scrape type for YA52648: 0
2026-03-30 11:21:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:32 [auto1.de] INFO: Channel: 24h | Page: 154 | totalHits: 9688 | hits on page: 40
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK41748%27 HTTP/1.1" 200 None
2026-03-30 11:21:32 [auto1.de] INFO: Scrape type for GK41748: 0
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: YA52648
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA52648%27 HTTP/1.1" 200 None
2026-03-30 11:21:32 [auto1.de] INFO: Scrape type for YA52648: 0
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: GG65874
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP35448%27 HTTP/1.1" 200 None
2026-03-30 11:21:32 [auto1.de] INFO: Scrape type for FP35448: 0
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: UF58190
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU23189%27 HTTP/1.1" 200 None
2026-03-30 11:21:33 [auto1.de] INFO: Scrape type for JU23189: 0
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: RV42869
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: ZA93244
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: AL15511
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: WM92203
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: TB15164
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: PC18756
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC18756%27 HTTP/1.1" 200 None
2026-03-30 11:21:33 [auto1.de] INFO: Scrape type for PC18756: 0
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: CN06101
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: NK87306
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: PS82435
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: YT48598
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT48598%27 HTTP/1.1" 200 None
2026-03-30 11:21:33 [auto1.de] INFO: Scrape type for YT48598: 0
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: FC76019
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC76019%27 HTTP/1.1" 200 None
2026-03-30 11:21:33 [auto1.de] INFO: Scrape type for FC76019: 0
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: KG20268
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: DG36538
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: UZ90215
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: CK93777
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK93777%27 HTTP/1.1" 200 None
2026-03-30 11:21:33 [auto1.de] INFO: Scrape type for CK93777: 0
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: TX61544
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX61544%27 HTTP/1.1" 200 None
2026-03-30 11:21:33 [auto1.de] INFO: Scrape type for TX61544: 0
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: ET07412
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET07412%27 HTTP/1.1" 200 None
2026-03-30 11:21:33 [auto1.de] INFO: Scrape type for ET07412: 0
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: BL84965
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL84965%27 HTTP/1.1" 200 None
2026-03-30 11:21:33 [auto1.de] INFO: Scrape type for BL84965: 0
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: XC17243
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC17243%27 HTTP/1.1" 200 None
2026-03-30 11:21:33 [auto1.de] INFO: Scrape type for XC17243: 0
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: HU93536
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: ZT89022
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT89022%27 HTTP/1.1" 200 None
2026-03-30 11:21:33 [auto1.de] INFO: Scrape type for ZT89022: 0
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: MA73958
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA73958%27 HTTP/1.1" 200 None
2026-03-30 11:21:33 [auto1.de] INFO: Scrape type for MA73958: 0
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: GF09029
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: JC65588
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC65588%27 HTTP/1.1" 200 None
2026-03-30 11:21:33 [auto1.de] INFO: Scrape type for JC65588: 0
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: AE03495
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: ZH21180
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH21180%27 HTTP/1.1" 200 None
2026-03-30 11:21:33 [auto1.de] INFO: Scrape type for ZH21180: 0
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: PZ10151
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT21646%27 HTTP/1.1" 200 None
2026-03-30 11:21:33 [auto1.de] INFO: Scrape type for LT21646: 0
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: UW39505
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW39505%27 HTTP/1.1" 200 None
2026-03-30 11:21:33 [auto1.de] INFO: Scrape type for UW39505: 0
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: FL94183
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL94183%27 HTTP/1.1" 200 None
2026-03-30 11:21:33 [auto1.de] INFO: Scrape type for FL94183: 0
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: MD20057
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD20057%27 HTTP/1.1" 200 None
2026-03-30 11:21:33 [auto1.de] INFO: Scrape type for MD20057: 0
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: BP24575
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: EC25925
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC25925%27 HTTP/1.1" 200 None
2026-03-30 11:21:33 [auto1.de] INFO: Scrape type for EC25925: 0
2026-03-30 11:21:33 [auto1.de] INFO: Found listing with ID: DE69910
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE69910%27 HTTP/1.1" 200 None
2026-03-30 11:21:33 [auto1.de] INFO: Scrape type for DE69910: 0
2026-03-30 11:21:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:40 [auto1.de] INFO: Channel: 24h | Page: 155 | totalHits: 9688 | hits on page: 40
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT60185%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for NT60185: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: NT27020
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27020%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for NT27020: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: EU24195
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU24195%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for EU24195: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: VY22593
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: MS65923
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS65923%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for MS65923: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: LG87332
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: LW42175
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW42175%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for LW42175: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: PE09652
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE09652%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for PE09652: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: RT01969
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT01969%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for RT01969: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: SX60280
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX60280%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for SX60280: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: TU96815
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU96815%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for TU96815: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: SW77788
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: ZV29308
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV29308%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for ZV29308: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: DE42625
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42625%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for DE42625: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: XT42199
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: HF86895
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF86895%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for HF86895: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: RC01446
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC01446%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for RC01446: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: SA50642
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA50642%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for SA50642: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: RM72626
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: XS43563
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: HR57506
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR57506%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for HR57506: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: PD67762
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD67762%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for PD67762: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: JA64656
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: GM47642
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM47642%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for GM47642: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: TT29598
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT29598%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for TT29598: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: VB65040
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: XA78994
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA78994%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for XA78994: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: XM87462
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM87462%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for XM87462: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: UH95210
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: DR69108
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: GT81151
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR47170%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for GR47170: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: FE02336
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: XJ41164
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ41164%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for XJ41164: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP25717%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for BP25717: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: WY50378
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50378%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for WY50378: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU26768%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for ZU26768: 0
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-30 11:21:40 [auto1.de] INFO: Found listing with ID: EV16310
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV16310%27 HTTP/1.1" 200 None
2026-03-30 11:21:40 [auto1.de] INFO: Scrape type for EV16310: 0
2026-03-30 11:21:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:41 [auto1.de] INFO: Channel: 24h | Page: 156 | totalHits: 9688 | hits on page: 40
2026-03-30 11:21:41 [auto1.de] INFO: Found listing with ID: DD29565
2026-03-30 11:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD29565%27 HTTP/1.1" 200 None
2026-03-30 11:21:41 [auto1.de] INFO: Scrape type for DD29565: 0
2026-03-30 11:21:41 [auto1.de] INFO: Found listing with ID: CH51511
2026-03-30 11:21:41 [auto1.de] INFO: Found listing with ID: WE11389
2026-03-30 11:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE11389%27 HTTP/1.1" 200 None
2026-03-30 11:21:41 [auto1.de] INFO: Scrape type for WE11389: 0
2026-03-30 11:21:41 [auto1.de] INFO: Found listing with ID: YK99785
2026-03-30 11:21:41 [auto1.de] INFO: Found listing with ID: FG55582
2026-03-30 11:21:41 [auto1.de] INFO: Found listing with ID: CK35752
2026-03-30 11:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK35752%27 HTTP/1.1" 200 None
2026-03-30 11:21:41 [auto1.de] INFO: Scrape type for CK35752: 0
2026-03-30 11:21:41 [auto1.de] INFO: Found listing with ID: MW86631
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW86631%27 HTTP/1.1" 200 None
2026-03-30 11:21:42 [auto1.de] INFO: Scrape type for MW86631: 0
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: YT53234
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT53234%27 HTTP/1.1" 200 None
2026-03-30 11:21:42 [auto1.de] INFO: Scrape type for YT53234: 0
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: GE71981
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: PK93112
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK93112%27 HTTP/1.1" 200 None
2026-03-30 11:21:42 [auto1.de] INFO: Scrape type for PK93112: 0
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: GR34047
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: PF97511
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97511%27 HTTP/1.1" 200 None
2026-03-30 11:21:42 [auto1.de] INFO: Scrape type for PF97511: 0
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: WS02654
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02654%27 HTTP/1.1" 200 None
2026-03-30 11:21:42 [auto1.de] INFO: Scrape type for WS02654: 0
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: FR65686
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: RX17782
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: SN13100
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: KB32538
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: DD70281
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD70281%27 HTTP/1.1" 200 None
2026-03-30 11:21:42 [auto1.de] INFO: Scrape type for DD70281: 0
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: SV05588
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: PE91450
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE91450%27 HTTP/1.1" 200 None
2026-03-30 11:21:42 [auto1.de] INFO: Scrape type for PE91450: 0
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: VS10261
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS10261%27 HTTP/1.1" 200 None
2026-03-30 11:21:42 [auto1.de] INFO: Scrape type for VS10261: 0
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: MW87907
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: VR85495
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: NG44703
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG44703%27 HTTP/1.1" 200 None
2026-03-30 11:21:42 [auto1.de] INFO: Scrape type for NG44703: 0
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: RT05555
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: XW64157
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: MS75707
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS75707%27 HTTP/1.1" 200 None
2026-03-30 11:21:42 [auto1.de] INFO: Scrape type for MS75707: 0
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: TH77412
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH77412%27 HTTP/1.1" 200 None
2026-03-30 11:21:42 [auto1.de] INFO: Scrape type for TH77412: 0
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: HC69827
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: SZ55877
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ55877%27 HTTP/1.1" 200 None
2026-03-30 11:21:42 [auto1.de] INFO: Scrape type for SZ55877: 0
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: CH79941
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH79941%27 HTTP/1.1" 200 None
2026-03-30 11:21:42 [auto1.de] INFO: Scrape type for CH79941: 0
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: TH50819
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: VV79476
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: XY47977
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: BX70846
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX70846%27 HTTP/1.1" 200 None
2026-03-30 11:21:42 [auto1.de] INFO: Scrape type for BX70846: 0
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: ZZ62402
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ62402%27 HTTP/1.1" 200 None
2026-03-30 11:21:42 [auto1.de] INFO: Scrape type for ZZ62402: 0
2026-03-30 11:21:42 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-30 11:21:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:58 [auto1.de] INFO: Channel: 24h | Page: 157 | totalHits: 9689 | hits on page: 40
2026-03-30 11:21:58 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-30 11:21:58 [auto1.de] INFO: Found listing with ID: AK43100
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK43100%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for AK43100: 0
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: SD59172
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD59172%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for SD59172: 0
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: SR59541
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR59541%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for SR59541: 0
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: AG24612
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: GJ71722
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71722%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for GJ71722: 0
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW31978%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for MW31978: 0
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM31367%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for WM31367: 0
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: BK73701
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: NY67891
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY67891%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for NY67891: 0
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: HV44481
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV44481%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for HV44481: 0
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: SU06279
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU06279%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for SU06279: 0
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: HW53715
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW53715%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for HW53715: 0
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: CR35436
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR35436%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for CR35436: 0
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: TA42625
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: NV55096
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: JC63536
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: AJ13004
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: HR44152
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR44152%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for HR44152: 0
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: JE47018
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: HY59950
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: KU99299
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV89057%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for CV89057: 0
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: XF30370
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: YS01662
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS01662%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for YS01662: 0
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: EV46611
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: HA91024
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: AA30425
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA30425%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for AA30425: 0
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB14083%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for AB14083: 0
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL45560%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for DL45560: 0
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: SM63646
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: GC28656
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC28656%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for GC28656: 0
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK17459%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for JK17459: 0
2026-03-30 11:21:59 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT10840%27 HTTP/1.1" 200 None
2026-03-30 11:21:59 [auto1.de] INFO: Scrape type for KT10840: 0
2026-03-30 11:21:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:04 [scrapy.extensions.logstats] INFO: Crawled 903 pages (at 8 pages/min), scraped 1360 items (at 1 items/min)
2026-03-30 11:22:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:22:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:20 [auto1.de] INFO: Channel: 24h | Page: 158 | totalHits: 9689 | hits on page: 40
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: KC24735
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: BV81502
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV81502%27 HTTP/1.1" 200 None
2026-03-30 11:22:20 [auto1.de] INFO: Scrape type for BV81502: 0
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: LX71576
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: HR13595
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR13595%27 HTTP/1.1" 200 None
2026-03-30 11:22:20 [auto1.de] INFO: Scrape type for HR13595: 0
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: AK58988
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK58988%27 HTTP/1.1" 200 None
2026-03-30 11:22:20 [auto1.de] INFO: Scrape type for AK58988: 0
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: ZN63350
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN63350%27 HTTP/1.1" 200 None
2026-03-30 11:22:20 [auto1.de] INFO: Scrape type for ZN63350: 0
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: PE88968
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: TE39343
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE39343%27 HTTP/1.1" 200 None
2026-03-30 11:22:20 [auto1.de] INFO: Scrape type for TE39343: 0
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: PP85770
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP85770%27 HTTP/1.1" 200 None
2026-03-30 11:22:20 [auto1.de] INFO: Scrape type for PP85770: 0
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: FG79588
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: FC75041
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC75041%27 HTTP/1.1" 200 None
2026-03-30 11:22:20 [auto1.de] INFO: Scrape type for FC75041: 0
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: AA02117
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: ZE79625
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: KP81674
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP81674%27 HTTP/1.1" 200 None
2026-03-30 11:22:20 [auto1.de] INFO: Scrape type for KP81674: 0
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: PK47596
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: FT31566
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: VY07286
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY07286%27 HTTP/1.1" 200 None
2026-03-30 11:22:20 [auto1.de] INFO: Scrape type for VY07286: 0
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: AH71943
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH71943%27 HTTP/1.1" 200 None
2026-03-30 11:22:20 [auto1.de] INFO: Scrape type for AH71943: 0
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: HK24290
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: TG58212
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: JN51648
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: LW56593
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: AN45666
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: KK98414
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: MG63340
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG63340%27 HTTP/1.1" 200 None
2026-03-30 11:22:20 [auto1.de] INFO: Scrape type for MG63340: 0
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: WL72774
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: JN06918
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN06918%27 HTTP/1.1" 200 None
2026-03-30 11:22:20 [auto1.de] INFO: Scrape type for JN06918: 0
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: MX37955
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: UY19816
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: UE11202
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE11202%27 HTTP/1.1" 200 None
2026-03-30 11:22:20 [auto1.de] INFO: Scrape type for UE11202: 0
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: AR60138
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: AH29152
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: LP86406
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: HU16718
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU16718%27 HTTP/1.1" 200 None
2026-03-30 11:22:20 [auto1.de] INFO: Scrape type for HU16718: 0
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: HZ19691
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ19691%27 HTTP/1.1" 200 None
2026-03-30 11:22:20 [auto1.de] INFO: Scrape type for HZ19691: 0
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89530%27 HTTP/1.1" 200 None
2026-03-30 11:22:20 [auto1.de] INFO: Scrape type for VS89530: 0
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: ZJ39351
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ39351%27 HTTP/1.1" 200 None
2026-03-30 11:22:20 [auto1.de] INFO: Scrape type for ZJ39351: 0
2026-03-30 11:22:20 [auto1.de] INFO: Found listing with ID: RR18814
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR18814%27 HTTP/1.1" 200 None
2026-03-30 11:22:20 [auto1.de] INFO: Scrape type for RR18814: 0
2026-03-30 11:22:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:24 [auto1.de] INFO: Channel: 24h | Page: 159 | totalHits: 9689 | hits on page: 40
2026-03-30 11:22:24 [auto1.de] INFO: Found listing with ID: LC91411
2026-03-30 11:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91411%27 HTTP/1.1" 200 None
2026-03-30 11:22:24 [auto1.de] INFO: Scrape type for LC91411: 0
2026-03-30 11:22:24 [auto1.de] INFO: Found listing with ID: MD93182
2026-03-30 11:22:24 [auto1.de] INFO: Found listing with ID: WY11895
2026-03-30 11:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY11895%27 HTTP/1.1" 200 None
2026-03-30 11:22:24 [auto1.de] INFO: Scrape type for WY11895: 0
2026-03-30 11:22:24 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-30 11:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71041%27 HTTP/1.1" 200 None
2026-03-30 11:22:24 [auto1.de] INFO: Scrape type for FJ71041: 0
2026-03-30 11:22:24 [auto1.de] INFO: Found listing with ID: DT28740
2026-03-30 11:22:24 [auto1.de] INFO: Found listing with ID: VE70317
2026-03-30 11:22:24 [auto1.de] INFO: Found listing with ID: FZ44442
2026-03-30 11:22:24 [auto1.de] INFO: Found listing with ID: NY19608
2026-03-30 11:22:24 [auto1.de] INFO: Found listing with ID: SR18060
2026-03-30 11:22:24 [auto1.de] INFO: Found listing with ID: NA53807
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA53807%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [auto1.de] INFO: Scrape type for NA53807: 0
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: UW78098
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW78098%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [auto1.de] INFO: Scrape type for UW78098: 0
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: AY55181
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: VL50005
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: AE84214
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE84214%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [auto1.de] INFO: Scrape type for AE84214: 0
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: ZM65960
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: XU28434
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU28434%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [auto1.de] INFO: Scrape type for XU28434: 0
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: KD94440
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD94440%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [auto1.de] INFO: Scrape type for KD94440: 0
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: DX51383
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: KL26301
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL26301%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [auto1.de] INFO: Scrape type for KL26301: 0
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: TL66452
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: XR62561
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: WK26503
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: UK28152
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: CV55682
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV55682%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [auto1.de] INFO: Scrape type for CV55682: 0
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: MR72377
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72377%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [auto1.de] INFO: Scrape type for MR72377: 0
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: SX94588
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: RZ91984
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ91984%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [auto1.de] INFO: Scrape type for RZ91984: 0
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF92976%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [auto1.de] INFO: Scrape type for FF92976: 0
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: BV74864
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV74864%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [auto1.de] INFO: Scrape type for BV74864: 0
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: DB64139
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: JU32018
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU32018%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [auto1.de] INFO: Scrape type for JU32018: 0
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: RS77004
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS77004%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [auto1.de] INFO: Scrape type for RS77004: 0
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: FJ91980
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ91980%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [auto1.de] INFO: Scrape type for FJ91980: 0
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: YJ68996
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: TV33488
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV33488%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [auto1.de] INFO: Scrape type for TV33488: 0
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: BN30919
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN30919%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [auto1.de] INFO: Scrape type for BN30919: 0
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: GS36326
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36326%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [auto1.de] INFO: Scrape type for GS36326: 0
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-30 11:22:25 [auto1.de] INFO: Found listing with ID: CW72943
2026-03-30 11:22:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:37 [auto1.de] INFO: Channel: 24h | Page: 160 | totalHits: 9691 | hits on page: 40
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: CW72943
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: DF38507
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF38507%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.de] INFO: Scrape type for DF38507: 0
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: HP10978
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: BR64184
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: NX47984
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: GA25019
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: FD55088
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD55088%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.de] INFO: Scrape type for FD55088: 0
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: CW96119
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW96119%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.de] INFO: Scrape type for CW96119: 0
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: SJ47682
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ47682%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.de] INFO: Scrape type for SJ47682: 0
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: ZD02189
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD02189%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.de] INFO: Scrape type for ZD02189: 0
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: YH89346
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: BN50743
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN50743%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.de] INFO: Scrape type for BN50743: 0
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: CG28709
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG28709%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.de] INFO: Scrape type for CG28709: 0
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: XX76692
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX76692%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.de] INFO: Scrape type for XX76692: 0
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: JT24059
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT24059%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.de] INFO: Scrape type for JT24059: 0
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: DV89701
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: JJ41202
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ41202%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.de] INFO: Scrape type for JJ41202: 0
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: CS13699
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: RP08748
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP08748%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.de] INFO: Scrape type for RP08748: 0
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: VH78915
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78915%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.de] INFO: Scrape type for VH78915: 0
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: SM94434
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU29418%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.de] INFO: Scrape type for AU29418: 0
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: WC13471
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC13471%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.de] INFO: Scrape type for WC13471: 0
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: TK51417
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK51417%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.de] INFO: Scrape type for TK51417: 0
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: AL51386
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL51386%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.de] INFO: Scrape type for AL51386: 0
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: WJ35504
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: ER72643
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: CL03732
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: BR96483
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR96483%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.de] INFO: Scrape type for BR96483: 0
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: WG78527
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78527%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.de] INFO: Scrape type for WG78527: 0
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: PX80115
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: YW76305
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: FT78842
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: XE32981
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: RJ10234
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: JD98482
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD98482%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.de] INFO: Scrape type for JD98482: 0
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: GU49323
2026-03-30 11:22:37 [auto1.de] INFO: Found listing with ID: PU73268
2026-03-30 11:22:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:39 [auto1.de] INFO: Channel: 24h | Page: 161 | totalHits: 9691 | hits on page: 40
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: LL88784
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL88784%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for LL88784: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: NW77024
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW77024%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for NW77024: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: VZ53815
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: FC74080
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: VE44500
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE44500%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for VE44500: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: NZ91667
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: VJ43142
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: HH54065
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: NR72053
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR72053%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for NR72053: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: HK68029
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK68029%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for HK68029: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: AY94594
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: GZ30709
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ30709%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for GZ30709: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: WP61796
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP61796%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for WP61796: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: NC82982
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC82982%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for NC82982: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: PV97095
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV97095%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for PV97095: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: VZ19342
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ19342%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for VZ19342: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: GE56014
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB73740%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for WB73740: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: GH57189
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH57189%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for GH57189: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU27688%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for AU27688: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: KY92219
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY92219%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for KY92219: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: EN93789
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN93789%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for EN93789: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: AT78165
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: DW77915
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: ZB00511
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK20534%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for HK20534: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: VC01658
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC01658%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for VC01658: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: RS80830
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: UA00536
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA00536%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for UA00536: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: LK12622
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: ZR01639
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: BB78660
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB78660%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for BB78660: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: YA95886
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA95886%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for YA95886: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: TL72332
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72332%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for TL72332: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: VN50855
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: LC37503
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC37503%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for LC37503: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: HR89143
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR89143%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for HR89143: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: WC31038
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC31038%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for WC31038: 0
2026-03-30 11:22:39 [auto1.de] INFO: Found listing with ID: PY52590
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY52590%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.de] INFO: Scrape type for PY52590: 0
2026-03-30 11:22:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:41 [auto1.de] INFO: Channel: 24h | Page: 162 | totalHits: 9692 | hits on page: 40
2026-03-30 11:22:41 [auto1.de] INFO: Found listing with ID: PY52590
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY52590%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [auto1.de] INFO: Scrape type for PY52590: 0
2026-03-30 11:22:41 [auto1.de] INFO: Found listing with ID: ZN20945
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20945%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [auto1.de] INFO: Scrape type for ZN20945: 0
2026-03-30 11:22:41 [auto1.de] INFO: Found listing with ID: WW16724
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW16724%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [auto1.de] INFO: Scrape type for WW16724: 0
2026-03-30 11:22:41 [auto1.de] INFO: Found listing with ID: ZT78140
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT78140%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [auto1.de] INFO: Scrape type for ZT78140: 0
2026-03-30 11:22:41 [auto1.de] INFO: Found listing with ID: DW68578
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW68578%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for DW68578: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: AB73354
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB73354%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for AB73354: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: JU52980
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: CM78973
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: JT86021
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT86021%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for JT86021: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: EX22671
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: MY70814
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY70814%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for MY70814: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: PJ38214
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ38214%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for PJ38214: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK50983%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for LK50983: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: HV45616
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: TJ20795
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: PP25437
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: SE52893
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE52893%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for SE52893: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: XE19125
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: TT40648
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: TL90122
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL90122%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for TL90122: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92301%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for BD92301: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: GW69862
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX48260%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for TX48260: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: ZG14470
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14470%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for ZG14470: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: KZ61437
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61437%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for KZ61437: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: WZ19127
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ19127%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for WZ19127: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: ZC43990
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: WV70498
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH16330%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for PH16330: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: KM72305
2026-03-30 11:22:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:04 [scrapy.extensions.logstats] INFO: Crawled 908 pages (at 5 pages/min), scraped 1360 items (at 0 items/min)
2026-03-30 11:23:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:24:04 [scrapy.extensions.logstats] INFO: Crawled 908 pages (at 0 pages/min), scraped 1360 items (at 0 items/min)
2026-03-30 11:24:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:24:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.290(s), this was the 1st time calling it.
2026-03-30 11:24:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.213573446181966 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:24:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:25:04 [scrapy.extensions.logstats] INFO: Crawled 908 pages (at 0 pages/min), scraped 1360 items (at 0 items/min)
2026-03-30 11:25:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:16 [auto1.de] INFO: Channel: 24h | Page: 163 | totalHits: 9714 | hits on page: 40
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: TT40648
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: TL90122
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL90122%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [auto1.de] INFO: Scrape type for TL90122: 0
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92301%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [auto1.de] INFO: Scrape type for BD92301: 0
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: GW69862
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX48260%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [auto1.de] INFO: Scrape type for TX48260: 0
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: ZG14470
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14470%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [auto1.de] INFO: Scrape type for ZG14470: 0
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: KZ61437
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61437%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [auto1.de] INFO: Scrape type for KZ61437: 0
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: WZ19127
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ19127%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [auto1.de] INFO: Scrape type for WZ19127: 0
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: ZC43990
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: WV70498
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH16330%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [auto1.de] INFO: Scrape type for PH16330: 0
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: KM72305
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: KL19137
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19137%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [auto1.de] INFO: Scrape type for KL19137: 0
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: CT44889
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT44889%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [auto1.de] INFO: Scrape type for CT44889: 0
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: AV62833
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV62833%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [auto1.de] INFO: Scrape type for AV62833: 0
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: RZ33260
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: PA63751
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA63751%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [auto1.de] INFO: Scrape type for PA63751: 0
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: FX17488
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: LC63229
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC63229%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [auto1.de] INFO: Scrape type for LC63229: 0
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: DW05211
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: AA98436
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: PU94869
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: AM41961
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: RS45157
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: TW05581
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: WC63339
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63339%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [auto1.de] INFO: Scrape type for WC63339: 0
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: SN72199
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN72199%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [auto1.de] INFO: Scrape type for SN72199: 0
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: YJ03455
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ03455%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [auto1.de] INFO: Scrape type for YJ03455: 0
2026-03-30 11:25:16 [auto1.de] INFO: Found listing with ID: VL43028
2026-03-30 11:25:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:28 [auto1.de] INFO: Channel: 24h | Page: 164 | totalHits: 9715 | hits on page: 40
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: VL43028
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: XU86679
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: YY60165
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: PZ40966
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ40966%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for PZ40966: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: MV46012
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46012%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for MV46012: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: MX17219
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX17219%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for MX17219: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: EJ74150
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ74150%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for EJ74150: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: EL67777
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: HL95475
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: KD58874
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD58874%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for KD58874: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: HZ32658
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ32658%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for HZ32658: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: FF11378
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF11378%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for FF11378: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: LN92590
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: RB75427
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: WF56073
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF56073%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for WF56073: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: NG52240
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG52240%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for NG52240: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: HJ09616
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: WF31302
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF31302%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for WF31302: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: SN47860
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN47860%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for SN47860: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: SG53147
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG53147%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for SG53147: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: UR24224
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: SG45396
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: VW19119
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW19119%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for VW19119: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: YB86869
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86869%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for YB86869: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: GP68218
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP68218%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for GP68218: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: TP00598
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP00598%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for TP00598: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: XB50161
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB50161%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for XB50161: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: LD63476
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63476%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for LD63476: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: EJ80862
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80862%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for EJ80862: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: SV23538
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: HL19525
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL19525%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for HL19525: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: NF34057
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF34057%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for NF34057: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: MD44435
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD44435%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for MD44435: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: ZV33449
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV33449%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for ZV33449: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: WY73016
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY73016%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for WY73016: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ62576%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.de] INFO: Scrape type for XJ62576: 0
2026-03-30 11:25:28 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-30 11:25:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:40 [auto1.de] INFO: Channel: 24h | Page: 165 | totalHits: 9717 | hits on page: 40
2026-03-30 11:25:40 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ62576%27 HTTP/1.1" 200 None
2026-03-30 11:25:40 [auto1.de] INFO: Scrape type for XJ62576: 0
2026-03-30 11:25:40 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-30 11:25:40 [auto1.de] INFO: Found listing with ID: AE64290
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE64290%27 HTTP/1.1" 200 None
2026-03-30 11:25:40 [auto1.de] INFO: Scrape type for AE64290: 0
2026-03-30 11:25:40 [auto1.de] INFO: Found listing with ID: BS22515
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS22515%27 HTTP/1.1" 200 None
2026-03-30 11:25:40 [auto1.de] INFO: Scrape type for BS22515: 0
2026-03-30 11:25:40 [auto1.de] INFO: Found listing with ID: FJ78766
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78766%27 HTTP/1.1" 200 None
2026-03-30 11:25:40 [auto1.de] INFO: Scrape type for FJ78766: 0
2026-03-30 11:25:40 [auto1.de] INFO: Found listing with ID: DE54360
2026-03-30 11:25:40 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-30 11:25:40 [auto1.de] INFO: Found listing with ID: GK43362
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK43362%27 HTTP/1.1" 200 None
2026-03-30 11:25:40 [auto1.de] INFO: Scrape type for GK43362: 0
2026-03-30 11:25:40 [auto1.de] INFO: Found listing with ID: HA43424
2026-03-30 11:25:40 [auto1.de] INFO: Found listing with ID: WS02487
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02487%27 HTTP/1.1" 200 None
2026-03-30 11:25:40 [auto1.de] INFO: Scrape type for WS02487: 0
2026-03-30 11:25:40 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL88078%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.de] INFO: Scrape type for NL88078: 0
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: ZC46474
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: EZ85797
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ85797%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.de] INFO: Scrape type for EZ85797: 0
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: CE85756
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: AK86210
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: ET35150
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET35150%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.de] INFO: Scrape type for ET35150: 0
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: NV33173
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV33173%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.de] INFO: Scrape type for NV33173: 0
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA55190%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.de] INFO: Scrape type for SA55190: 0
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: XJ24379
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: CW19006
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW19006%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.de] INFO: Scrape type for CW19006: 0
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: WZ35506
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: XV42513
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: GD49252
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: JA72326
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: NV88353
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: CV81199
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: CL87720
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: KU16473
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU16473%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.de] INFO: Scrape type for KU16473: 0
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: EZ94089
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ94089%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.de] INFO: Scrape type for EZ94089: 0
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: HC04240
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: CK46360
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: PF96299
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF96299%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.de] INFO: Scrape type for PF96299: 0
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: BX05285
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX05285%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.de] INFO: Scrape type for BX05285: 0
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: XF94363
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: WN39495
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: SD16829
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: CS93004
2026-03-30 11:25:41 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-30 11:25:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:49 [auto1.de] INFO: Channel: 24h | Page: 166 | totalHits: 9718 | hits on page: 40
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX81073%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.de] INFO: Scrape type for JX81073: 0
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: JX40120
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX40120%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.de] INFO: Scrape type for JX40120: 0
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL78300%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.de] INFO: Scrape type for PL78300: 0
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: LK64393
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: KD34962
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD34962%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.de] INFO: Scrape type for KD34962: 0
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: VN30485
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: WE98596
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: AJ62547
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: ES44709
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES44709%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.de] INFO: Scrape type for ES44709: 0
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: AW80803
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: PT90816
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT90816%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.de] INFO: Scrape type for PT90816: 0
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: GM59339
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59339%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.de] INFO: Scrape type for GM59339: 0
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: GU66110
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: BH52991
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: AL23415
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: VS72441
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS72441%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.de] INFO: Scrape type for VS72441: 0
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: YE69852
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE69852%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.de] INFO: Scrape type for YE69852: 0
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: KY72629
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: JE81559
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE81559%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.de] INFO: Scrape type for JE81559: 0
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: ME89657
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: AM19734
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM19734%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.de] INFO: Scrape type for AM19734: 0
2026-03-30 11:25:49 [auto1.de] INFO: Found listing with ID: ND35935
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND35935%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.de] INFO: Scrape type for ND35935: 2
2026-03-30 11:25:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cce2bcd0-b987-5a99-9176-b8215ece91e0 with identifier: ND35935
2026-03-30 11:25:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cce2bcd0-b987-5a99-9176-b8215ece91e0 with scrape type 2
2026-03-30 11:25:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cce2bcd0-b987-5a99-9176-b8215ece91e0 with scrape type 2
2026-03-30 11:25:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cce2bcd0-b987-5a99-9176-b8215ece91e0, identifier: ND35935
2026-03-30 11:25:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cce2bcd0-b987-5a99-9176-b8215ece91e0 with identifier: ND35935
2026-03-30 11:25:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cce2bcd0-b987-5a99-9176-b8215ece91e0 with identifier: ND35935
2026-03-30 11:25:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cce2bcd0-b987-5a99-9176-b8215ece91e0 with identifier: ND35935 to the API
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:42:05Z',
 'fuel_type': 'diesel',
 'id': 'cce2bcd0-b987-5a99-9176-b8215ece91e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND35935',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 107273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-09',
 'seller_name': None,
 'title': 'Jaguar XF 3.0 D V6 S Portfolio',
 'transmission': 'automatic',
 'trim': 'S Portfolio',
 'year': 2010}
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND35935%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Saving data for ND35935: {'auction_closing_time': 1774885325.0, 'created_time': 1772545135.017775, 'last_price_update_time': 1774869950.241032}
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND35935') HTTP/1.1" 204 0
2026-03-30 11:25:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: ZM99082
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: GJ05712
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: TT27495
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: HU29731
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU29731%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for HU29731: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: UZ52700
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ52700%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for UZ52700: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: MA76308
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA76308%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for MA76308: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: FJ59032
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: PS82659
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82659%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for PS82659: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: BD50097
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: NH67676
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH67676%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for NH67676: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: EC14916
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: CD03678
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: XU55815
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: XC25059
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC25059%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for XC25059: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-30 11:25:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:52 [auto1.de] INFO: Channel: 24h | Page: 167 | totalHits: 9719 | hits on page: 40
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: FG98454
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: TX40216
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40216%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for TX40216: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: AD30182
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD30182%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for AD30182: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: LX22574
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX22574%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for LX22574: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: DJ81890
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ81890%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for DJ81890: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: FP02134
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: TJ52961
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52961%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for TJ52961: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: NC46979
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: UE87725
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV52918%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for LV52918: 2
2026-03-30 11:25:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2baa4285-e073-519c-a5e2-270229ff350c with identifier: LV52918
2026-03-30 11:25:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2baa4285-e073-519c-a5e2-270229ff350c with scrape type 2
2026-03-30 11:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2baa4285-e073-519c-a5e2-270229ff350c with scrape type 2
2026-03-30 11:25:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2baa4285-e073-519c-a5e2-270229ff350c, identifier: LV52918
2026-03-30 11:25:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2baa4285-e073-519c-a5e2-270229ff350c with identifier: LV52918
2026-03-30 11:25:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2baa4285-e073-519c-a5e2-270229ff350c with identifier: LV52918
2026-03-30 11:25:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2baa4285-e073-519c-a5e2-270229ff350c with identifier: LV52918 to the API
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:22:59Z',
 'fuel_type': 'petrol',
 'id': '2baa4285-e073-519c-a5e2-270229ff350c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV52918',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 174982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-21',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Joy',
 'transmission': 'automatic',
 'trim': 'Joy',
 'year': 2016}
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV52918%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.de] INFO: Saving data for LV52918: {'auction_closing_time': 1774884179.0, 'created_time': 1773136024.566533, 'last_price_update_time': 1774869953.516201}
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV52918') HTTP/1.1" 204 0
2026-03-30 11:25:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: PW08848
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW08848%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.de] INFO: Scrape type for PW08848: 0
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL92844%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.de] INFO: Scrape type for YL92844: 0
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: UC42370
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: WV16405
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: CK27476
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK27476%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.de] INFO: Scrape type for CK27476: 0
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: AN68791
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN68791%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.de] INFO: Scrape type for AN68791: 0
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: BT49963
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: SA68147
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: SP68179
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP68179%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.de] INFO: Scrape type for SP68179: 0
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: NT27416
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27416%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.de] INFO: Scrape type for NT27416: 0
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: TY58494
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY58494%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.de] INFO: Scrape type for TY58494: 0
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: UM48488
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM48488%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.de] INFO: Scrape type for UM48488: 2
2026-03-30 11:25:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79273a23-7734-5ce5-82b7-37bfab0638e7 with identifier: UM48488
2026-03-30 11:25:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79273a23-7734-5ce5-82b7-37bfab0638e7 with scrape type 2
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79273a23-7734-5ce5-82b7-37bfab0638e7 with scrape type 2
2026-03-30 11:25:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79273a23-7734-5ce5-82b7-37bfab0638e7, identifier: UM48488
2026-03-30 11:25:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79273a23-7734-5ce5-82b7-37bfab0638e7 with identifier: UM48488
2026-03-30 11:25:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79273a23-7734-5ce5-82b7-37bfab0638e7 with identifier: UM48488
2026-03-30 11:25:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79273a23-7734-5ce5-82b7-37bfab0638e7 with identifier: UM48488 to the API
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:49:10Z',
 'fuel_type': 'diesel',
 'id': '79273a23-7734-5ce5-82b7-37bfab0638e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM48488',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 154940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-20',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang 4Matic BlueTEC Edition',
 'transmission': 'automatic',
 'trim': 'lang 4Matic BlueTEC Edition',
 'year': 2015}
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM48488%27 HTTP/1.1" 200 None
2026-03-30 11:25:54 [auto1.de] INFO: Saving data for UM48488: {'auction_closing_time': 1774885750.0, 'created_time': 1773466812.337144, 'last_price_update_time': 1774869954.216262}
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM48488') HTTP/1.1" 204 0
2026-03-30 11:25:54 [auto1.de] INFO: Found listing with ID: PR32105
2026-03-30 11:25:54 [auto1.de] INFO: Found listing with ID: EU37880
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU37880%27 HTTP/1.1" 200 None
2026-03-30 11:25:54 [auto1.de] INFO: Scrape type for EU37880: 0
2026-03-30 11:25:54 [auto1.de] INFO: Found listing with ID: CD36674
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36674%27 HTTP/1.1" 200 None
2026-03-30 11:25:54 [auto1.de] INFO: Scrape type for CD36674: 0
2026-03-30 11:25:54 [auto1.de] INFO: Found listing with ID: WC33817
2026-03-30 11:25:54 [auto1.de] INFO: Found listing with ID: FX08537
2026-03-30 11:25:54 [auto1.de] INFO: Found listing with ID: MP89368
2026-03-30 11:25:54 [auto1.de] INFO: Found listing with ID: PB35717
2026-03-30 11:25:54 [auto1.de] INFO: Found listing with ID: PV26171
2026-03-30 11:25:54 [auto1.de] INFO: Found listing with ID: NW62126
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW62126%27 HTTP/1.1" 200 None
2026-03-30 11:25:54 [auto1.de] INFO: Scrape type for NW62126: 0
2026-03-30 11:25:54 [auto1.de] INFO: Found listing with ID: RW84791
2026-03-30 11:25:54 [auto1.de] INFO: Found listing with ID: SK54405
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK54405%27 HTTP/1.1" 200 None
2026-03-30 11:25:54 [auto1.de] INFO: Scrape type for SK54405: 0
2026-03-30 11:25:54 [auto1.de] INFO: Found listing with ID: VB58565
2026-03-30 11:25:54 [auto1.de] INFO: Found listing with ID: EK27182
2026-03-30 11:25:54 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35044%27 HTTP/1.1" 200 None
2026-03-30 11:25:54 [auto1.de] INFO: Scrape type for JG35044: 0
2026-03-30 11:25:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:57 [auto1.de] INFO: Channel: 24h | Page: 168 | totalHits: 9719 | hits on page: 40
2026-03-30 11:25:57 [auto1.de] INFO: Found listing with ID: BW05751
2026-03-30 11:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW05751%27 HTTP/1.1" 200 None
2026-03-30 11:25:57 [auto1.de] INFO: Scrape type for BW05751: 0
2026-03-30 11:25:57 [auto1.de] INFO: Found listing with ID: ZJ06184
2026-03-30 11:25:57 [auto1.de] INFO: Found listing with ID: MS67551
2026-03-30 11:25:57 [auto1.de] INFO: Found listing with ID: MT90802
2026-03-30 11:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90802%27 HTTP/1.1" 200 None
2026-03-30 11:25:57 [auto1.de] INFO: Scrape type for MT90802: 0
2026-03-30 11:25:57 [auto1.de] INFO: Found listing with ID: ZW20696
2026-03-30 11:25:57 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-30 11:25:57 [auto1.de] INFO: Found listing with ID: ZV40367
2026-03-30 11:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV40367%27 HTTP/1.1" 200 None
2026-03-30 11:25:57 [auto1.de] INFO: Scrape type for ZV40367: 0
2026-03-30 11:25:57 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-30 11:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG94093%27 HTTP/1.1" 200 None
2026-03-30 11:25:57 [auto1.de] INFO: Scrape type for XG94093: 0
2026-03-30 11:25:57 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-30 11:25:57 [auto1.de] INFO: Found listing with ID: RP15707
2026-03-30 11:25:57 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-30 11:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY58997%27 HTTP/1.1" 200 None
2026-03-30 11:25:57 [auto1.de] INFO: Scrape type for UY58997: 0
2026-03-30 11:25:57 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-30 11:25:57 [auto1.de] INFO: Found listing with ID: CR33136
2026-03-30 11:25:57 [auto1.de] INFO: Found listing with ID: SY19126
2026-03-30 11:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY19126%27 HTTP/1.1" 200 None
2026-03-30 11:25:57 [auto1.de] INFO: Scrape type for SY19126: 0
2026-03-30 11:25:57 [auto1.de] INFO: Found listing with ID: CE31107
2026-03-30 11:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE31107%27 HTTP/1.1" 200 None
2026-03-30 11:25:57 [auto1.de] INFO: Scrape type for CE31107: 0
2026-03-30 11:25:57 [auto1.de] INFO: Found listing with ID: BN03285
2026-03-30 11:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN03285%27 HTTP/1.1" 200 None
2026-03-30 11:25:58 [auto1.de] INFO: Scrape type for BN03285: 0
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: TH26087
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: EB29224
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: UD17125
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: SZ04450
2026-03-30 11:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ04450%27 HTTP/1.1" 200 None
2026-03-30 11:25:58 [auto1.de] INFO: Scrape type for SZ04450: 0
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: KT29520
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: KG96622
2026-03-30 11:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG96622%27 HTTP/1.1" 200 None
2026-03-30 11:25:58 [auto1.de] INFO: Scrape type for KG96622: 0
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: MM04684
2026-03-30 11:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04684%27 HTTP/1.1" 200 None
2026-03-30 11:25:58 [auto1.de] INFO: Scrape type for MM04684: 0
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: EZ36931
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: FN92851
2026-03-30 11:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN92851%27 HTTP/1.1" 200 None
2026-03-30 11:25:58 [auto1.de] INFO: Scrape type for FN92851: 0
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: HF47887
2026-03-30 11:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47887%27 HTTP/1.1" 200 None
2026-03-30 11:25:58 [auto1.de] INFO: Scrape type for HF47887: 0
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: JZ27200
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: RD90003
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: EN47046
2026-03-30 11:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN47046%27 HTTP/1.1" 200 None
2026-03-30 11:25:58 [auto1.de] INFO: Scrape type for EN47046: 0
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: NS17316
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: UA79270
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-30 11:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH62859%27 HTTP/1.1" 200 None
2026-03-30 11:25:58 [auto1.de] INFO: Scrape type for EH62859: 0
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: LS63557
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: CK62580
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: WP78953
2026-03-30 11:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP78953%27 HTTP/1.1" 200 None
2026-03-30 11:25:58 [auto1.de] INFO: Scrape type for WP78953: 0
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: HT34266
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: GA34239
2026-03-30 11:25:58 [auto1.de] INFO: Found listing with ID: AS18464
2026-03-30 11:25:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:02 [auto1.de] INFO: Channel: 24h | Page: 169 | totalHits: 9719 | hits on page: 40
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: PR50786
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR50786%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [auto1.de] INFO: Scrape type for PR50786: 0
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: ZU57618
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU57618%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [auto1.de] INFO: Scrape type for ZU57618: 0
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: ZJ71499
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ71499%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [auto1.de] INFO: Scrape type for ZJ71499: 0
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: RG74932
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG74932%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [auto1.de] INFO: Scrape type for RG74932: 0
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: WE68456
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: MD24708
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: JH37191
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: LX45168
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX45168%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [auto1.de] INFO: Scrape type for LX45168: 0
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: BX95848
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX95848%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [auto1.de] INFO: Scrape type for BX95848: 0
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: CF55359
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF55359%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [auto1.de] INFO: Scrape type for CF55359: 0
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: DZ36531
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ36531%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [auto1.de] INFO: Scrape type for DZ36531: 0
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: MV67104
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV67104%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [auto1.de] INFO: Scrape type for MV67104: 0
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: GK88230
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK88230%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [auto1.de] INFO: Scrape type for GK88230: 0
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: XM77164
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM77164%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [auto1.de] INFO: Scrape type for XM77164: 0
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: UU73518
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU73518%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [auto1.de] INFO: Scrape type for UU73518: 0
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: UU35907
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU35907%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [auto1.de] INFO: Scrape type for UU35907: 0
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: SB93381
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: ZL38204
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL38204%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [auto1.de] INFO: Scrape type for ZL38204: 0
2026-03-30 11:26:02 [auto1.de] INFO: Found listing with ID: HD14897
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD14897%27 HTTP/1.1" 200 None
2026-03-30 11:26:03 [auto1.de] INFO: Scrape type for HD14897: 0
2026-03-30 11:26:03 [auto1.de] INFO: Found listing with ID: ZY13516
2026-03-30 11:26:03 [auto1.de] INFO: Found listing with ID: AG38936
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG38936%27 HTTP/1.1" 200 None
2026-03-30 11:26:03 [auto1.de] INFO: Scrape type for AG38936: 0
2026-03-30 11:26:03 [auto1.de] INFO: Found listing with ID: CJ15757
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ15757%27 HTTP/1.1" 200 None
2026-03-30 11:26:03 [auto1.de] INFO: Scrape type for CJ15757: 0
2026-03-30 11:26:03 [auto1.de] INFO: Found listing with ID: DZ93039
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ93039%27 HTTP/1.1" 200 None
2026-03-30 11:26:03 [auto1.de] INFO: Scrape type for DZ93039: 2
2026-03-30 11:26:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e76f8261-06ba-568c-81f1-805c9644ba47 with identifier: DZ93039
2026-03-30 11:26:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e76f8261-06ba-568c-81f1-805c9644ba47 with scrape type 2
2026-03-30 11:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e76f8261-06ba-568c-81f1-805c9644ba47 with scrape type 2
2026-03-30 11:26:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e76f8261-06ba-568c-81f1-805c9644ba47, identifier: DZ93039
2026-03-30 11:26:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e76f8261-06ba-568c-81f1-805c9644ba47 with identifier: DZ93039
2026-03-30 11:26:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e76f8261-06ba-568c-81f1-805c9644ba47 with identifier: DZ93039
2026-03-30 11:26:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e76f8261-06ba-568c-81f1-805c9644ba47 with identifier: DZ93039 to the API
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:25:31Z',
 'fuel_type': 'petrol',
 'id': 'e76f8261-06ba-568c-81f1-805c9644ba47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ93039',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 106535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2017}
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ93039%27 HTTP/1.1" 200 None
2026-03-30 11:26:03 [auto1.de] INFO: Saving data for DZ93039: {'auction_closing_time': 1774884331.0, 'created_time': 1773427172.994331, 'last_price_update_time': 1774869963.673818}
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ93039') HTTP/1.1" 204 0
2026-03-30 11:26:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:03 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91085%27 HTTP/1.1" 200 None
2026-03-30 11:26:03 [auto1.de] INFO: Scrape type for XT91085: 2
2026-03-30 11:26:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7138564-95f6-5414-b8e4-0075656b9eb8 with identifier: XT91085
2026-03-30 11:26:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7138564-95f6-5414-b8e4-0075656b9eb8 with scrape type 2
2026-03-30 11:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7138564-95f6-5414-b8e4-0075656b9eb8 with scrape type 2
2026-03-30 11:26:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7138564-95f6-5414-b8e4-0075656b9eb8, identifier: XT91085
2026-03-30 11:26:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7138564-95f6-5414-b8e4-0075656b9eb8 with identifier: XT91085
2026-03-30 11:26:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7138564-95f6-5414-b8e4-0075656b9eb8 with identifier: XT91085
2026-03-30 11:26:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7138564-95f6-5414-b8e4-0075656b9eb8 with identifier: XT91085 to the API
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:28:01Z',
 'fuel_type': 'petrol',
 'id': 'e7138564-95f6-5414-b8e4-0075656b9eb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT91085',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 175770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-29',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91085%27 HTTP/1.1" 200 None
2026-03-30 11:26:04 [auto1.de] INFO: Saving data for XT91085: {'auction_closing_time': 1774884481.0, 'created_time': 1774465294.798232, 'last_price_update_time': 1774869964.441963}
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT91085') HTTP/1.1" 204 0
2026-03-30 11:26:04 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-30 11:26:04 [auto1.de] INFO: Found listing with ID: DF58718
2026-03-30 11:26:04 [auto1.de] INFO: Found listing with ID: ZE67546
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE67546%27 HTTP/1.1" 200 None
2026-03-30 11:26:04 [auto1.de] INFO: Scrape type for ZE67546: 0
2026-03-30 11:26:04 [auto1.de] INFO: Found listing with ID: GC08315
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC08315%27 HTTP/1.1" 200 None
2026-03-30 11:26:04 [auto1.de] INFO: Scrape type for GC08315: 0
2026-03-30 11:26:04 [auto1.de] INFO: Found listing with ID: VW18097
2026-03-30 11:26:04 [auto1.de] INFO: Found listing with ID: ND71699
2026-03-30 11:26:04 [auto1.de] INFO: Found listing with ID: MJ66272
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ66272%27 HTTP/1.1" 200 None
2026-03-30 11:26:04 [auto1.de] INFO: Scrape type for MJ66272: 0
2026-03-30 11:26:04 [auto1.de] INFO: Found listing with ID: PT06802
2026-03-30 11:26:04 [auto1.de] INFO: Found listing with ID: DN96798
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN96798%27 HTTP/1.1" 200 None
2026-03-30 11:26:04 [auto1.de] INFO: Scrape type for DN96798: 0
2026-03-30 11:26:04 [auto1.de] INFO: Found listing with ID: XC89129
2026-03-30 11:26:04 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-30 11:26:04 [auto1.de] INFO: Found listing with ID: ZX08266
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX08266%27 HTTP/1.1" 200 None
2026-03-30 11:26:04 [auto1.de] INFO: Scrape type for ZX08266: 0
2026-03-30 11:26:04 [auto1.de] INFO: Found listing with ID: DA14400
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA14400%27 HTTP/1.1" 200 None
2026-03-30 11:26:04 [auto1.de] INFO: Scrape type for DA14400: 0
2026-03-30 11:26:04 [auto1.de] INFO: Found listing with ID: YR51740
2026-03-30 11:26:04 [auto1.de] INFO: Found listing with ID: XF58855
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF58855%27 HTTP/1.1" 200 None
2026-03-30 11:26:04 [auto1.de] INFO: Scrape type for XF58855: 0
2026-03-30 11:26:04 [scrapy.extensions.logstats] INFO: Crawled 915 pages (at 7 pages/min), scraped 1365 items (at 5 items/min)
2026-03-30 11:26:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:26:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:12 [auto1.de] INFO: Channel: 24h | Page: 170 | totalHits: 9718 | hits on page: 40
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: BW69940
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW69940%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for BW69940: 0
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: DK33698
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: HK34206
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: BX53792
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: PN31203
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN31203%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for PN31203: 0
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: FS76993
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: AR87592
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: JT26189
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT26189%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for JT26189: 0
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: YW88691
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW88691%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for YW88691: 0
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: RS40485
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: FS96919
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: BF85943
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF85943%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for BF85943: 0
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: GL29302
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL29302%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for GL29302: 0
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: MK56575
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: LM46602
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM46602%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for LM46602: 0
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: YH44518
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44518%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for YH44518: 0
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: SD35692
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: HA16942
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA16942%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for HA16942: 0
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: EE67524
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE67524%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for EE67524: 0
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: VY57936
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY57936%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for VY57936: 0
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: AJ85569
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ85569%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for AJ85569: 0
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: NG69344
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: UM69189
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM69189%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for UM69189: 0
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: GL61675
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61675%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for GL61675: 0
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: FL30108
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL30108%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for FL30108: 0
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: XV26734
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: VH78642
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78642%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for VH78642: 0
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: NG74955
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG74955%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for NG74955: 0
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: CW59742
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW59742%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for CW59742: 0
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: ZW88785
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: BW06132
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06132%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for BW06132: 0
2026-03-30 11:26:12 [auto1.de] INFO: Found listing with ID: FP32439
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP32439%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Scrape type for FP32439: 2
2026-03-30 11:26:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: debf0902-9082-59c4-a4e9-e2a3aeb5e69c with identifier: FP32439
2026-03-30 11:26:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item debf0902-9082-59c4-a4e9-e2a3aeb5e69c with scrape type 2
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item debf0902-9082-59c4-a4e9-e2a3aeb5e69c with scrape type 2
2026-03-30 11:26:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: debf0902-9082-59c4-a4e9-e2a3aeb5e69c, identifier: FP32439
2026-03-30 11:26:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: debf0902-9082-59c4-a4e9-e2a3aeb5e69c with identifier: FP32439
2026-03-30 11:26:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: debf0902-9082-59c4-a4e9-e2a3aeb5e69c with identifier: FP32439
2026-03-30 11:26:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: debf0902-9082-59c4-a4e9-e2a3aeb5e69c with identifier: FP32439 to the API
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:01:05Z',
 'fuel_type': 'petrol',
 'id': 'debf0902-9082-59c4-a4e9-e2a3aeb5e69c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP32439',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 157910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-10',
 'seller_name': None,
 'title': 'Audi A6 2.8 V6 FSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP32439%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [auto1.de] INFO: Saving data for FP32439: {'auction_closing_time': 1774882865.0, 'created_time': 1773946201.413967, 'last_price_update_time': 1774869972.957754}
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP32439') HTTP/1.1" 204 0
2026-03-30 11:26:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:13 [auto1.de] INFO: Found listing with ID: KM78395
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM78395%27 HTTP/1.1" 200 None
2026-03-30 11:26:13 [auto1.de] INFO: Scrape type for KM78395: 0
2026-03-30 11:26:13 [auto1.de] INFO: Found listing with ID: KY67779
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY67779%27 HTTP/1.1" 200 None
2026-03-30 11:26:13 [auto1.de] INFO: Scrape type for KY67779: 0
2026-03-30 11:26:13 [auto1.de] INFO: Found listing with ID: WJ94391
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ94391%27 HTTP/1.1" 200 None
2026-03-30 11:26:13 [auto1.de] INFO: Scrape type for WJ94391: 0
2026-03-30 11:26:13 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC26510%27 HTTP/1.1" 200 None
2026-03-30 11:26:13 [auto1.de] INFO: Scrape type for TC26510: 0
2026-03-30 11:26:13 [auto1.de] INFO: Found listing with ID: GR86063
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR86063%27 HTTP/1.1" 200 None
2026-03-30 11:26:13 [auto1.de] INFO: Scrape type for GR86063: 0
2026-03-30 11:26:13 [auto1.de] INFO: Found listing with ID: TV11727
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV11727%27 HTTP/1.1" 200 None
2026-03-30 11:26:13 [auto1.de] INFO: Scrape type for TV11727: 0
2026-03-30 11:26:13 [auto1.de] INFO: Found listing with ID: LW85167
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW85167%27 HTTP/1.1" 200 None
2026-03-30 11:26:13 [auto1.de] INFO: Scrape type for LW85167: 0
2026-03-30 11:26:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:14 [auto1.de] INFO: Channel: 24h | Page: 171 | totalHits: 9719 | hits on page: 40
2026-03-30 11:26:14 [auto1.de] INFO: Found listing with ID: LW85167
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW85167%27 HTTP/1.1" 200 None
2026-03-30 11:26:14 [auto1.de] INFO: Scrape type for LW85167: 0
2026-03-30 11:26:14 [auto1.de] INFO: Found listing with ID: EP74565
2026-03-30 11:26:14 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL85877%27 HTTP/1.1" 200 None
2026-03-30 11:26:14 [auto1.de] INFO: Scrape type for JL85877: 0
2026-03-30 11:26:14 [auto1.de] INFO: Found listing with ID: AC95378
2026-03-30 11:26:14 [auto1.de] INFO: Found listing with ID: UH78050
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH78050%27 HTTP/1.1" 200 None
2026-03-30 11:26:14 [auto1.de] INFO: Scrape type for UH78050: 0
2026-03-30 11:26:14 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-30 11:26:14 [auto1.de] INFO: Found listing with ID: UG80172
2026-03-30 11:26:14 [auto1.de] INFO: Found listing with ID: LN38152
2026-03-30 11:26:14 [auto1.de] INFO: Found listing with ID: CW13893
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW13893%27 HTTP/1.1" 200 None
2026-03-30 11:26:14 [auto1.de] INFO: Scrape type for CW13893: 0
2026-03-30 11:26:14 [auto1.de] INFO: Found listing with ID: TJ09014
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ09014%27 HTTP/1.1" 200 None
2026-03-30 11:26:14 [auto1.de] INFO: Scrape type for TJ09014: 0
2026-03-30 11:26:14 [auto1.de] INFO: Found listing with ID: YS72291
2026-03-30 11:26:14 [auto1.de] INFO: Found listing with ID: DR31322
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR31322%27 HTTP/1.1" 200 None
2026-03-30 11:26:14 [auto1.de] INFO: Scrape type for DR31322: 2
2026-03-30 11:26:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d9511f1-ad34-57b8-9122-15f87e2aa853 with identifier: DR31322
2026-03-30 11:26:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d9511f1-ad34-57b8-9122-15f87e2aa853 with scrape type 2
2026-03-30 11:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d9511f1-ad34-57b8-9122-15f87e2aa853 with scrape type 2
2026-03-30 11:26:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d9511f1-ad34-57b8-9122-15f87e2aa853, identifier: DR31322
2026-03-30 11:26:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d9511f1-ad34-57b8-9122-15f87e2aa853 with identifier: DR31322
2026-03-30 11:26:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d9511f1-ad34-57b8-9122-15f87e2aa853 with identifier: DR31322
2026-03-30 11:26:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d9511f1-ad34-57b8-9122-15f87e2aa853 with identifier: DR31322 to the API
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:16:48Z',
 'fuel_type': 'diesel',
 'id': '0d9511f1-ad34-57b8-9122-15f87e2aa853',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR31322',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 130690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-03',
 'seller_name': None,
 'title': 'Jaguar XF 30d Portfolio',
 'transmission': 'automatic',
 'trim': 'Portfolio',
 'year': 2017}
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR31322%27 HTTP/1.1" 200 None
2026-03-30 11:26:14 [auto1.de] INFO: Saving data for DR31322: {'auction_closing_time': 1774883808.0, 'created_time': 1773223753.060816, 'last_price_update_time': 1774869974.843301}
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR31322') HTTP/1.1" 204 0
2026-03-30 11:26:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:14 [auto1.de] INFO: Found listing with ID: AL26903
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL26903%27 HTTP/1.1" 200 None
2026-03-30 11:26:14 [auto1.de] INFO: Scrape type for AL26903: 0
2026-03-30 11:26:14 [auto1.de] INFO: Found listing with ID: KU21621
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU21621%27 HTTP/1.1" 200 None
2026-03-30 11:26:14 [auto1.de] INFO: Scrape type for KU21621: 0
2026-03-30 11:26:14 [auto1.de] INFO: Found listing with ID: TA25367
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA25367%27 HTTP/1.1" 200 None
2026-03-30 11:26:15 [auto1.de] INFO: Scrape type for TA25367: 0
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: HL58412
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL58412%27 HTTP/1.1" 200 None
2026-03-30 11:26:15 [auto1.de] INFO: Scrape type for HL58412: 0
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: SR77795
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR77795%27 HTTP/1.1" 200 None
2026-03-30 11:26:15 [auto1.de] INFO: Scrape type for SR77795: 0
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: ML19559
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML19559%27 HTTP/1.1" 200 None
2026-03-30 11:26:15 [auto1.de] INFO: Scrape type for ML19559: 0
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: AD35771
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD35771%27 HTTP/1.1" 200 None
2026-03-30 11:26:15 [auto1.de] INFO: Scrape type for AD35771: 0
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF52264%27 HTTP/1.1" 200 None
2026-03-30 11:26:15 [auto1.de] INFO: Scrape type for TF52264: 0
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: PN78353
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN78353%27 HTTP/1.1" 200 None
2026-03-30 11:26:15 [auto1.de] INFO: Scrape type for PN78353: 0
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: HY91019
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: PD62787
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: PW70056
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW70056%27 HTTP/1.1" 200 None
2026-03-30 11:26:15 [auto1.de] INFO: Scrape type for PW70056: 0
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: ZY28796
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: EL68687
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: RB37125
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: SM91292
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM91292%27 HTTP/1.1" 200 None
2026-03-30 11:26:15 [auto1.de] INFO: Scrape type for SM91292: 0
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: SB28206
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: FZ71323
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ71323%27 HTTP/1.1" 200 None
2026-03-30 11:26:15 [auto1.de] INFO: Scrape type for FZ71323: 0
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: GN24423
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: UA59851
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: MG33600
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: AH37368
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH37368%27 HTTP/1.1" 200 None
2026-03-30 11:26:15 [auto1.de] INFO: Scrape type for AH37368: 0
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: AN78451
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: EF84485
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF84485%27 HTTP/1.1" 200 None
2026-03-30 11:26:15 [auto1.de] INFO: Scrape type for EF84485: 0
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: TT68659
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT68659%27 HTTP/1.1" 200 None
2026-03-30 11:26:15 [auto1.de] INFO: Scrape type for TT68659: 0
2026-03-30 11:26:15 [auto1.de] INFO: Found listing with ID: EG87318
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG87318%27 HTTP/1.1" 200 None
2026-03-30 11:26:15 [auto1.de] INFO: Scrape type for EG87318: 0
2026-03-30 11:26:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:16 [auto1.de] INFO: Channel: 24h | Page: 172 | totalHits: 9719 | hits on page: 40
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: UW23884
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: MD27320
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: HF48601
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF48601%27 HTTP/1.1" 200 None
2026-03-30 11:26:16 [auto1.de] INFO: Scrape type for HF48601: 0
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: WC45623
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC45623%27 HTTP/1.1" 200 None
2026-03-30 11:26:16 [auto1.de] INFO: Scrape type for WC45623: 0
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: EG77695
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG77695%27 HTTP/1.1" 200 None
2026-03-30 11:26:16 [auto1.de] INFO: Scrape type for EG77695: 0
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: CA65942
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: EX93586
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: UY74953
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: KP12697
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: UB26055
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: NV85283
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: VL71663
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: JP54532
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: BA73417
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA73417%27 HTTP/1.1" 200 None
2026-03-30 11:26:16 [auto1.de] INFO: Scrape type for BA73417: 0
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: VH26233
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH26233%27 HTTP/1.1" 200 None
2026-03-30 11:26:16 [auto1.de] INFO: Scrape type for VH26233: 0
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: DW23670
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW23670%27 HTTP/1.1" 200 None
2026-03-30 11:26:16 [auto1.de] INFO: Scrape type for DW23670: 0
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: GU60494
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: DJ93554
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: WA19353
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA19353%27 HTTP/1.1" 200 None
2026-03-30 11:26:16 [auto1.de] INFO: Scrape type for WA19353: 0
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: MX70218
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: UY13477
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY13477%27 HTTP/1.1" 200 None
2026-03-30 11:26:16 [auto1.de] INFO: Scrape type for UY13477: 0
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26192%27 HTTP/1.1" 200 None
2026-03-30 11:26:16 [auto1.de] INFO: Scrape type for XN26192: 0
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: GM59511
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59511%27 HTTP/1.1" 200 None
2026-03-30 11:26:16 [auto1.de] INFO: Scrape type for GM59511: 0
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: RR46383
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR46383%27 HTTP/1.1" 200 None
2026-03-30 11:26:16 [auto1.de] INFO: Scrape type for RR46383: 0
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: BL86865
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL86865%27 HTTP/1.1" 200 None
2026-03-30 11:26:16 [auto1.de] INFO: Scrape type for BL86865: 0
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: ZL15649
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL15649%27 HTTP/1.1" 200 None
2026-03-30 11:26:16 [auto1.de] INFO: Scrape type for ZL15649: 0
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: TR74961
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR74961%27 HTTP/1.1" 200 None
2026-03-30 11:26:16 [auto1.de] INFO: Scrape type for TR74961: 0
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: EP31898
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: EE83336
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: GE21325
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: CB52035
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB52035%27 HTTP/1.1" 200 None
2026-03-30 11:26:16 [auto1.de] INFO: Scrape type for CB52035: 0
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: XS82974
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: AE81199
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: XD56030
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD56030%27 HTTP/1.1" 200 None
2026-03-30 11:26:16 [auto1.de] INFO: Scrape type for XD56030: 0
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: EN73396
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN73396%27 HTTP/1.1" 200 None
2026-03-30 11:26:16 [auto1.de] INFO: Scrape type for EN73396: 0
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: MJ31328
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: SR51449
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR51449%27 HTTP/1.1" 200 None
2026-03-30 11:26:16 [auto1.de] INFO: Scrape type for SR51449: 0
2026-03-30 11:26:16 [auto1.de] INFO: Found listing with ID: BR53906
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR53906%27 HTTP/1.1" 200 None
2026-03-30 11:26:17 [auto1.de] INFO: Scrape type for BR53906: 0
2026-03-30 11:26:17 [auto1.de] INFO: Found listing with ID: CC89680
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89680%27 HTTP/1.1" 200 None
2026-03-30 11:26:17 [auto1.de] INFO: Scrape type for CC89680: 0
2026-03-30 11:26:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:18 [auto1.de] INFO: Channel: 24h | Page: 173 | totalHits: 9719 | hits on page: 40
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: DT53290
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: UP12343
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP12343%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.de] INFO: Scrape type for UP12343: 0
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: FJ72456
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: HJ28276
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: XV53612
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: ZP66388
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: YH44643
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: YF42870
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF42870%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.de] INFO: Scrape type for YF42870: 0
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: YJ21750
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: JP08522
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: FJ98191
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ98191%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.de] INFO: Scrape type for FJ98191: 0
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: PT78073
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: MX02891
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX02891%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.de] INFO: Scrape type for MX02891: 0
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: JJ72083
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: SG10067
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG10067%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.de] INFO: Scrape type for SG10067: 0
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: KB55712
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB55712%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.de] INFO: Scrape type for KB55712: 0
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: JN55022
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN55022%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.de] INFO: Scrape type for JN55022: 0
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: MM29891
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: EM77424
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM77424%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.de] INFO: Scrape type for EM77424: 0
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: CX18884
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: YC44419
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: VJ82092
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: WZ42381
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: DG24182
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG24182%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.de] INFO: Scrape type for DG24182: 0
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: CV73879
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV73879%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.de] INFO: Scrape type for CV73879: 0
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: WL17910
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL17910%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.de] INFO: Scrape type for WL17910: 0
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: CH69099
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH69099%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.de] INFO: Scrape type for CH69099: 0
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: CD36219
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: MC57954
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: PM25348
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM25348%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.de] INFO: Scrape type for PM25348: 0
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: HS03842
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS03842%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.de] INFO: Scrape type for HS03842: 0
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: BS26605
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS26605%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.de] INFO: Scrape type for BS26605: 0
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: MV92494
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: JS09258
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS09258%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.de] INFO: Scrape type for JS09258: 0
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: GD60404
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD60404%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.de] INFO: Scrape type for GD60404: 0
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: TJ67594
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ67594%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.de] INFO: Scrape type for TJ67594: 0
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL45864%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.de] INFO: Scrape type for TL45864: 0
2026-03-30 11:26:18 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-30 11:26:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:26 [auto1.de] INFO: Channel: 24h | Page: 174 | totalHits: 9721 | hits on page: 40
2026-03-30 11:26:26 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-30 11:26:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL45864%27 HTTP/1.1" 200 None
2026-03-30 11:26:26 [auto1.de] INFO: Scrape type for TL45864: 0
2026-03-30 11:26:26 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-30 11:26:26 [auto1.de] INFO: Found listing with ID: VT43931
2026-03-30 11:26:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT43931%27 HTTP/1.1" 200 None
2026-03-30 11:26:26 [auto1.de] INFO: Scrape type for VT43931: 0
2026-03-30 11:26:26 [auto1.de] INFO: Found listing with ID: RP65815
2026-03-30 11:26:26 [auto1.de] INFO: Found listing with ID: CF09149
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF09149%27 HTTP/1.1" 200 None
2026-03-30 11:26:27 [auto1.de] INFO: Scrape type for CF09149: 0
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: MJ41620
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: HV65540
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: GV28684
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV28684%27 HTTP/1.1" 200 None
2026-03-30 11:26:27 [auto1.de] INFO: Scrape type for GV28684: 2
2026-03-30 11:26:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08482148-24a4-5327-8081-6c8b545dbe33 with identifier: GV28684
2026-03-30 11:26:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08482148-24a4-5327-8081-6c8b545dbe33 with scrape type 2
2026-03-30 11:26:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08482148-24a4-5327-8081-6c8b545dbe33 with scrape type 2
2026-03-30 11:26:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08482148-24a4-5327-8081-6c8b545dbe33, identifier: GV28684
2026-03-30 11:26:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08482148-24a4-5327-8081-6c8b545dbe33 with identifier: GV28684
2026-03-30 11:26:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08482148-24a4-5327-8081-6c8b545dbe33 with identifier: GV28684
2026-03-30 11:26:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08482148-24a4-5327-8081-6c8b545dbe33 with identifier: GV28684 to the API
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:28:10Z',
 'fuel_type': 'petrol',
 'id': '08482148-24a4-5327-8081-6c8b545dbe33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV28684',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 28854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-30',
 'seller_name': None,
 'title': 'Hyundai i30 1.0 T-GDI Mild-Hybrid Select',
 'transmission': 'automatic',
 'trim': 'Select',
 'year': 2021}
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV28684%27 HTTP/1.1" 200 None
2026-03-30 11:26:27 [auto1.de] INFO: Saving data for GV28684: {'auction_closing_time': 1774884490.0, 'created_time': 1773303239.766047, 'last_price_update_time': 1774869987.546567}
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV28684') HTTP/1.1" 204 0
2026-03-30 11:26:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: TS05974
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: YS13064
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS13064%27 HTTP/1.1" 200 None
2026-03-30 11:26:27 [auto1.de] INFO: Scrape type for YS13064: 0
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: ME33936
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: CU80256
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: NH86896
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU47356%27 HTTP/1.1" 200 None
2026-03-30 11:26:27 [auto1.de] INFO: Scrape type for MU47356: 0
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: CB80286
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: RH59786
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: VJ59637
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ59637%27 HTTP/1.1" 200 None
2026-03-30 11:26:27 [auto1.de] INFO: Scrape type for VJ59637: 0
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: UU53643
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU53643%27 HTTP/1.1" 200 None
2026-03-30 11:26:27 [auto1.de] INFO: Scrape type for UU53643: 0
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: LG97713
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: RX21744
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: HN24396
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: PS84197
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: KD49468
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: VL16221
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL16221%27 HTTP/1.1" 200 None
2026-03-30 11:26:27 [auto1.de] INFO: Scrape type for VL16221: 0
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF02392%27 HTTP/1.1" 200 None
2026-03-30 11:26:27 [auto1.de] INFO: Scrape type for MF02392: 0
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: AH95980
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH95980%27 HTTP/1.1" 200 None
2026-03-30 11:26:27 [auto1.de] INFO: Scrape type for AH95980: 0
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: MV56275
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: UD17279
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: AG53647
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: MR73613
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: SZ56060
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ56060%27 HTTP/1.1" 200 None
2026-03-30 11:26:27 [auto1.de] INFO: Scrape type for SZ56060: 0
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: TE18178
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: NX28269
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX28269%27 HTTP/1.1" 200 None
2026-03-30 11:26:27 [auto1.de] INFO: Scrape type for NX28269: 0
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: YD00860
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD00860%27 HTTP/1.1" 200 None
2026-03-30 11:26:27 [auto1.de] INFO: Scrape type for YD00860: 0
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: DH44526
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH44526%27 HTTP/1.1" 200 None
2026-03-30 11:26:27 [auto1.de] INFO: Scrape type for DH44526: 0
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: PC60688
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60688%27 HTTP/1.1" 200 None
2026-03-30 11:26:27 [auto1.de] INFO: Scrape type for PC60688: 0
2026-03-30 11:26:27 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-30 11:26:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:29 [auto1.de] INFO: Channel: 24h | Page: 175 | totalHits: 9722 | hits on page: 40
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: TA92521
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: GZ76571
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: LA13205
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM62598%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [auto1.de] INFO: Scrape type for XM62598: 0
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: RN25126
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: JK60563
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: MG28857
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG28857%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [auto1.de] INFO: Scrape type for MG28857: 0
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: TA95211
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: UN86111
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: CP73203
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: KJ44451
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: LR06917
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR06917%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [auto1.de] INFO: Scrape type for LR06917: 0
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: YZ29676
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: GP13767
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: UE57150
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE57150%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [auto1.de] INFO: Scrape type for UE57150: 0
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: SX22441
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: FZ80305
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: FH83727
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: XR36805
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: VL79730
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL79730%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [auto1.de] INFO: Scrape type for VL79730: 0
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: JX01740
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX01740%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [auto1.de] INFO: Scrape type for JX01740: 0
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: RU51432
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: CY50821
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY50821%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [auto1.de] INFO: Scrape type for CY50821: 0
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: BB82459
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: MV29238
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: BD98070
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD98070%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [auto1.de] INFO: Scrape type for BD98070: 0
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: NA20314
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: AP93832
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: LF39104
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: CG78657
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: VC16092
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: TR76591
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: EE47451
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: AD50420
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD50420%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [auto1.de] INFO: Scrape type for AD50420: 0
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: PH00076
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00076%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [auto1.de] INFO: Scrape type for PH00076: 0
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: RD80564
2026-03-30 11:26:29 [auto1.de] INFO: Found listing with ID: UH10138
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH10138%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [auto1.de] INFO: Scrape type for UH10138: 0
2026-03-30 11:26:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:40 [auto1.de] INFO: Channel: 24h | Page: 176 | totalHits: 9723 | hits on page: 40
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: UH10138
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH10138%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.de] INFO: Scrape type for UH10138: 0
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: XY17081
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: YP68247
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: BE83152
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: JM75105
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: GD70369
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: LN93862
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN93862%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.de] INFO: Scrape type for LN93862: 0
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: ZF91540
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF91540%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.de] INFO: Scrape type for ZF91540: 0
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: SZ38457
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: VW39086
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE85774%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.de] INFO: Scrape type for DE85774: 0
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: DG70282
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: ET59047
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET59047%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.de] INFO: Scrape type for ET59047: 0
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: BR76788
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR76788%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.de] INFO: Scrape type for BR76788: 0
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: XV50981
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: PA85998
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA85998%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.de] INFO: Scrape type for PA85998: 0
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: KN98252
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: ZL76152
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL76152%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.de] INFO: Scrape type for ZL76152: 0
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: SV32169
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: XC54847
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: VT76935
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT76935%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.de] INFO: Scrape type for VT76935: 0
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: SE32009
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE32009%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.de] INFO: Scrape type for SE32009: 0
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: AP07103
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP07103%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.de] INFO: Scrape type for AP07103: 0
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: JH64089
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH64089%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.de] INFO: Scrape type for JH64089: 0
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: BE16908
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE16908%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.de] INFO: Scrape type for BE16908: 0
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: GY26864
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY26864%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.de] INFO: Scrape type for GY26864: 0
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: ZM37202
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM37202%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.de] INFO: Scrape type for ZM37202: 0
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: MX47183
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX47183%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.de] INFO: Scrape type for MX47183: 0
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: HT61440
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT61440%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.de] INFO: Scrape type for HT61440: 0
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: RN43410
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: DG85302
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: RE30080
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: VW61170
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: FZ98450
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: TM90896
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: CS78773
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS78773%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.de] INFO: Scrape type for CS78773: 0
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: RX47602
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: PF23160
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF23160%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.de] INFO: Scrape type for PF23160: 0
2026-03-30 11:26:40 [auto1.de] INFO: Found listing with ID: XY25128
2026-03-30 11:26:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:42 [auto1.de] INFO: Channel: 24h | Page: 177 | totalHits: 9723 | hits on page: 40
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: XC20802
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: ZX93034
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: NY15812
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY15812%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for NY15812: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: UW48203
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW48203%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for UW48203: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: YC00325
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00325%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for YC00325: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: LZ76677
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: EB92999
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB92999%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for EB92999: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: XF65798
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: TE58420
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE58420%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for TE58420: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: HV21869
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV21869%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for HV21869: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: TV91582
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: YJ27680
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ27680%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for YJ27680: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: PG63962
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG63962%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for PG63962: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53261%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for KL53261: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: EY23363
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY23363%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for EY23363: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: LC77518
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77518%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for LC77518: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: WK06356
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK06356%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for WK06356: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: LU56386
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU56386%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for LU56386: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: AH07700
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH07700%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for AH07700: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: DU69800
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU69800%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for DU69800: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: YS77012
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: VB21266
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: CX98688
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: AU40553
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: JP48264
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: BP72129
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: BZ75769
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: RM05292
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: HV92794
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: XP56939
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: KG22409
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: YG65181
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG65181%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for YG65181: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18754%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for BW18754: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: WY87564
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY87564%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for WY87564: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: AF84640
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF84640%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for AF84640: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: GJ83963
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: GP94559
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP94559%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for GP94559: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: YV66765
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: JH89792
2026-03-30 11:26:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:54 [auto1.de] INFO: Channel: 24h | Page: 178 | totalHits: 9724 | hits on page: 40
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: JH89792
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: ZW99084
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: ZT23330
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: GZ21000
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ21000%27 HTTP/1.1" 200 None
2026-03-30 11:26:54 [auto1.de] INFO: Scrape type for GZ21000: 0
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: YM28187
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM28187%27 HTTP/1.1" 200 None
2026-03-30 11:26:54 [auto1.de] INFO: Scrape type for YM28187: 0
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: RT17633
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: NY57954
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: MZ83474
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: WP02035
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP02035%27 HTTP/1.1" 200 None
2026-03-30 11:26:54 [auto1.de] INFO: Scrape type for WP02035: 0
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14818%27 HTTP/1.1" 200 None
2026-03-30 11:26:54 [auto1.de] INFO: Scrape type for VX14818: 0
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: ZE75344
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE75344%27 HTTP/1.1" 200 None
2026-03-30 11:26:54 [auto1.de] INFO: Scrape type for ZE75344: 0
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: GA26329
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA26329%27 HTTP/1.1" 200 None
2026-03-30 11:26:54 [auto1.de] INFO: Scrape type for GA26329: 0
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: AY81223
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY81223%27 HTTP/1.1" 200 None
2026-03-30 11:26:54 [auto1.de] INFO: Scrape type for AY81223: 0
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: BR02529
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: PA30689
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: UA03321
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: FW15462
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW15462%27 HTTP/1.1" 200 None
2026-03-30 11:26:54 [auto1.de] INFO: Scrape type for FW15462: 0
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: PG58570
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: AH97983
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH97983%27 HTTP/1.1" 200 None
2026-03-30 11:26:54 [auto1.de] INFO: Scrape type for AH97983: 0
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: CE50485
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: DW82351
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW82351%27 HTTP/1.1" 200 None
2026-03-30 11:26:54 [auto1.de] INFO: Scrape type for DW82351: 0
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: SM20101
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: RW33443
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW33443%27 HTTP/1.1" 200 None
2026-03-30 11:26:54 [auto1.de] INFO: Scrape type for RW33443: 0
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: ZK16564
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK16564%27 HTTP/1.1" 200 None
2026-03-30 11:26:54 [auto1.de] INFO: Scrape type for ZK16564: 0
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: NP64585
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP64585%27 HTTP/1.1" 200 None
2026-03-30 11:26:54 [auto1.de] INFO: Scrape type for NP64585: 0
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: AF24484
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: ZE45367
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: ST81436
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: GD52714
2026-03-30 11:26:54 [auto1.de] INFO: Found listing with ID: AK41294
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK41294%27 HTTP/1.1" 200 None
2026-03-30 11:26:55 [auto1.de] INFO: Scrape type for AK41294: 0
2026-03-30 11:26:55 [auto1.de] INFO: Found listing with ID: EJ25575
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ25575%27 HTTP/1.1" 200 None
2026-03-30 11:26:55 [auto1.de] INFO: Scrape type for EJ25575: 0
2026-03-30 11:26:55 [auto1.de] INFO: Found listing with ID: ZX31727
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX31727%27 HTTP/1.1" 200 None
2026-03-30 11:26:55 [auto1.de] INFO: Scrape type for ZX31727: 0
2026-03-30 11:26:55 [auto1.de] INFO: Found listing with ID: SA71883
2026-03-30 11:26:55 [auto1.de] INFO: Found listing with ID: EG01443
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG01443%27 HTTP/1.1" 200 None
2026-03-30 11:26:55 [auto1.de] INFO: Scrape type for EG01443: 0
2026-03-30 11:26:55 [auto1.de] INFO: Found listing with ID: XE86723
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE86723%27 HTTP/1.1" 200 None
2026-03-30 11:26:55 [auto1.de] INFO: Scrape type for XE86723: 0
2026-03-30 11:26:55 [auto1.de] INFO: Found listing with ID: ZU04688
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU04688%27 HTTP/1.1" 200 None
2026-03-30 11:26:55 [auto1.de] INFO: Scrape type for ZU04688: 0
2026-03-30 11:26:55 [auto1.de] INFO: Found listing with ID: RT49707
2026-03-30 11:26:55 [auto1.de] INFO: Found listing with ID: KG76209
2026-03-30 11:26:55 [auto1.de] INFO: Found listing with ID: JA06342
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA06342%27 HTTP/1.1" 200 None
2026-03-30 11:26:55 [auto1.de] INFO: Scrape type for JA06342: 0
2026-03-30 11:26:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:57 [auto1.de] INFO: Channel: 24h | Page: 179 | totalHits: 9724 | hits on page: 40
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: BF09730
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF09730%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for BF09730: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: RC79950
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: ED78349
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: YK39735
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: YF85970
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: SA20211
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK53222%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for GK53222: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: ZY22077
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY22077%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for ZY22077: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: NB64458
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB64458%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for NB64458: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: PR91039
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR91039%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for PR91039: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: LZ35604
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: NU80618
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: BV47016
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV47016%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for BV47016: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: AX34994
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: YC50370
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC50370%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for YC50370: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: KL53394
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: HT24863
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT24863%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for HT24863: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: MZ26894
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ26894%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for MZ26894: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: RC04315
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC04315%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for RC04315: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: XF59932
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF59932%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for XF59932: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: UH91436
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: DV57223
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: XS21978
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS21978%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for XS21978: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: JG70236
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG70236%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for JG70236: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: JV29717
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: XT97786
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: YL01247
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: BS14183
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14183%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for BS14183: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: BT69693
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT69693%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for BT69693: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: FL51955
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL51955%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for FL51955: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM68518%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for CM68518: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: PL91584
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: CY07264
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY07264%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for CY07264: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: CP03676
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP03676%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for CP03676: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: ZJ17739
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ17739%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.de] INFO: Scrape type for ZJ17739: 0
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: DB13775
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: CR52623
2026-03-30 11:26:57 [auto1.de] INFO: Found listing with ID: BS79013
2026-03-30 11:26:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:58 [auto1.de] INFO: Channel: 24h | Page: 180 | totalHits: 9724 | hits on page: 40
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: JD13909
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD13909%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.de] INFO: Scrape type for JD13909: 0
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: PP77608
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: LZ21667
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: TF11415
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF11415%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.de] INFO: Scrape type for TF11415: 0
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: CU14126
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: SJ57500
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: JS62021
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS62021%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.de] INFO: Scrape type for JS62021: 0
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: SP90277
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: KR15708
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR15708%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.de] INFO: Scrape type for KR15708: 0
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG31115%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.de] INFO: Scrape type for LG31115: 0
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: UX71045
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX71045%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.de] INFO: Scrape type for UX71045: 0
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: NS47503
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS47503%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.de] INFO: Scrape type for NS47503: 0
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: MS43037
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS43037%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.de] INFO: Scrape type for MS43037: 0
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: DE35783
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE35783%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.de] INFO: Scrape type for DE35783: 0
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: VX06445
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: RH48062
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: CV42130
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: KS04135
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: WS30363
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS30363%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.de] INFO: Scrape type for WS30363: 0
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69443%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.de] INFO: Scrape type for HB69443: 0
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: ZY94421
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: BU63404
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: VE85293
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: HU97464
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU97464%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.de] INFO: Scrape type for HU97464: 0
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: HT41484
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: FS23827
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: XS31792
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: FW07623
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: EB16360
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB16360%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.de] INFO: Scrape type for EB16360: 0
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: MH67874
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67874%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.de] INFO: Scrape type for MH67874: 0
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: TP43988
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: TS65125
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: ZV59345
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: DZ95000
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: SC05662
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC05662%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.de] INFO: Scrape type for SC05662: 0
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: FY91638
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91638%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.de] INFO: Scrape type for FY91638: 0
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: MH02928
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL31894%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.de] INFO: Scrape type for KL31894: 0
2026-03-30 11:26:58 [auto1.de] INFO: Found listing with ID: LF03511
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF03511%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.de] INFO: Scrape type for LF03511: 0
2026-03-30 11:26:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:02 [auto1.de] INFO: Channel: 24h | Page: 181 | totalHits: 9724 | hits on page: 40
2026-03-30 11:27:02 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-30 11:27:02 [auto1.de] INFO: Found listing with ID: LJ25483
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25483%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.de] INFO: Scrape type for LJ25483: 0
2026-03-30 11:27:02 [auto1.de] INFO: Found listing with ID: CS21396
2026-03-30 11:27:02 [auto1.de] INFO: Found listing with ID: RC37998
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC37998%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.de] INFO: Scrape type for RC37998: 0
2026-03-30 11:27:02 [auto1.de] INFO: Found listing with ID: RV91936
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV91936%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.de] INFO: Scrape type for RV91936: 0
2026-03-30 11:27:02 [auto1.de] INFO: Found listing with ID: XT54020
2026-03-30 11:27:02 [auto1.de] INFO: Found listing with ID: XX95177
2026-03-30 11:27:02 [auto1.de] INFO: Found listing with ID: HA98136
2026-03-30 11:27:02 [auto1.de] INFO: Found listing with ID: BV72825
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV72825%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.de] INFO: Scrape type for BV72825: 2
2026-03-30 11:27:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2184530-3e2f-58a2-b1d5-b0d8dc8452e3 with identifier: BV72825
2026-03-30 11:27:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2184530-3e2f-58a2-b1d5-b0d8dc8452e3 with scrape type 2
2026-03-30 11:27:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2184530-3e2f-58a2-b1d5-b0d8dc8452e3 with scrape type 2
2026-03-30 11:27:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2184530-3e2f-58a2-b1d5-b0d8dc8452e3, identifier: BV72825
2026-03-30 11:27:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2184530-3e2f-58a2-b1d5-b0d8dc8452e3 with identifier: BV72825
2026-03-30 11:27:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2184530-3e2f-58a2-b1d5-b0d8dc8452e3 with identifier: BV72825
2026-03-30 11:27:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2184530-3e2f-58a2-b1d5-b0d8dc8452e3 with identifier: BV72825 to the API
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:21:07Z',
 'fuel_type': 'petrol',
 'id': 'd2184530-3e2f-58a2-b1d5-b0d8dc8452e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV72825',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 162325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-16',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 250 CGI T BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Elegance',
 'year': 2010}
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV72825%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [auto1.de] INFO: Saving data for BV72825: {'auction_closing_time': 1774884067.0, 'created_time': 1774348997.25977, 'last_price_update_time': 1774870023.138213}
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV72825') HTTP/1.1" 204 0
2026-03-30 11:27:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: FY17492
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY17492%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [auto1.de] INFO: Scrape type for FY17492: 0
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: KA91193
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: CF22867
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: GU64592
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU64592%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [auto1.de] INFO: Scrape type for GU64592: 0
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: UH14154
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: RX78682
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78682%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [auto1.de] INFO: Scrape type for RX78682: 0
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: SV69696
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69696%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [auto1.de] INFO: Scrape type for SV69696: 0
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: SV37503
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV37503%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [auto1.de] INFO: Scrape type for SV37503: 0
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: XJ83535
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: NN79660
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: UP35116
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP35116%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [auto1.de] INFO: Scrape type for UP35116: 0
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: BA36034
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA36034%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [auto1.de] INFO: Scrape type for BA36034: 0
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: FB02409
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: MB08927
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: AU13367
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: FK58652
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: RV14336
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: GT54130
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54130%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [auto1.de] INFO: Scrape type for GT54130: 0
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: HS09512
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: YZ03964
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: GY64031
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: BM71162
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: ZD80559
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD80559%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [auto1.de] INFO: Scrape type for ZD80559: 0
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX38798%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [auto1.de] INFO: Scrape type for BX38798: 0
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: KS78216
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: ZD36450
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD36450%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [auto1.de] INFO: Scrape type for ZD36450: 0
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU72034%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [auto1.de] INFO: Scrape type for EU72034: 0
2026-03-30 11:27:03 [auto1.de] INFO: Found listing with ID: DJ74321
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74321%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [auto1.de] INFO: Scrape type for DJ74321: 0
2026-03-30 11:27:04 [scrapy.extensions.logstats] INFO: Crawled 927 pages (at 12 pages/min), scraped 1369 items (at 4 items/min)
2026-03-30 11:27:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:27:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:38 [auto1.de] INFO: Channel: 24h | Page: 182 | totalHits: 9727 | hits on page: 40
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU72034%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for EU72034: 0
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: DJ74321
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74321%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for DJ74321: 0
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: AY25775
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF32306%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for YF32306: 0
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: PK18306
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK18306%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for PK18306: 0
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: UK63230
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: XP68837
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: NX37466
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: PK39186
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK39186%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for PK39186: 0
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: RG82987
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG82987%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for RG82987: 0
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: WH66881
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH66881%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for WH66881: 0
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: XN11461
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: EL53532
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: LA48706
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: ND02727
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND02727%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for ND02727: 0
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: PS90319
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: WJ18132
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ18132%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for WJ18132: 0
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: RJ18784
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: HW74456
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: BA02242
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: JR30174
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR30174%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for JR30174: 0
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: YT31718
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: YJ23133
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ23133%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for YJ23133: 0
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: SX51992
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX51992%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for SX51992: 0
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: CZ08846
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: XP57282
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: XU09743
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU09743%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for XU09743: 0
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: MR02811
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: SS68419
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS68419%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for SS68419: 0
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: KT07926
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT07926%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for KT07926: 0
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC50567%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for MC50567: 0
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: SG68469
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: WZ46352
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ46352%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for WZ46352: 0
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: JG67628
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG67628%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for JG67628: 0
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: CU12004
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: TD91904
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD91904%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for TD91904: 0
2026-03-30 11:27:38 [auto1.de] INFO: Found listing with ID: NY75190
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75190%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.de] INFO: Scrape type for NY75190: 0
2026-03-30 11:27:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:47 [auto1.de] INFO: Channel: 24h | Page: 183 | totalHits: 9727 | hits on page: 40
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: VX83538
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: KW63428
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK39186%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.de] INFO: Scrape type for JK39186: 0
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: FP97739
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP97739%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.de] INFO: Scrape type for FP97739: 0
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: MB29022
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB09525%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.de] INFO: Scrape type for FB09525: 0
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: KX42000
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX42000%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.de] INFO: Scrape type for KX42000: 0
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: HG82543
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG82543%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.de] INFO: Scrape type for HG82543: 0
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: LM29335
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: KY48204
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY48204%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.de] INFO: Scrape type for KY48204: 0
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: TS36559
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: YH85992
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH85992%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.de] INFO: Scrape type for YH85992: 0
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: UY59901
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY59901%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.de] INFO: Scrape type for UY59901: 0
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: HL48230
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL48230%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.de] INFO: Scrape type for HL48230: 0
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: PS42902
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS42902%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.de] INFO: Scrape type for PS42902: 0
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: GG07111
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG07111%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.de] INFO: Scrape type for GG07111: 0
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: TJ52471
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52471%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.de] INFO: Scrape type for TJ52471: 0
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: LB47051
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB47051%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.de] INFO: Scrape type for LB47051: 0
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: NR01003
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR01003%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.de] INFO: Scrape type for NR01003: 0
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: JG35901
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: BB05749
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB05749%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.de] INFO: Scrape type for BB05749: 0
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: MM26865
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: DG62846
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: KZ05104
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: AU38078
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU38078%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.de] INFO: Scrape type for AU38078: 0
2026-03-30 11:27:47 [auto1.de] INFO: Found listing with ID: BV96040
2026-03-30 11:27:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96040%27 HTTP/1.1" 200 None
2026-03-30 11:27:48 [auto1.de] INFO: Scrape type for BV96040: 0
2026-03-30 11:27:48 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-30 11:27:48 [auto1.de] INFO: Found listing with ID: KX86126
2026-03-30 11:27:48 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-30 11:27:48 [auto1.de] INFO: Found listing with ID: BS47149
2026-03-30 11:27:48 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-30 11:27:48 [auto1.de] INFO: Found listing with ID: ND74491
2026-03-30 11:27:48 [auto1.de] INFO: Found listing with ID: KM26302
2026-03-30 11:27:48 [auto1.de] INFO: Found listing with ID: MF11383
2026-03-30 11:27:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF11383%27 HTTP/1.1" 200 None
2026-03-30 11:27:48 [auto1.de] INFO: Scrape type for MF11383: 0
2026-03-30 11:27:48 [auto1.de] INFO: Found listing with ID: FK93583
2026-03-30 11:27:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93583%27 HTTP/1.1" 200 None
2026-03-30 11:27:48 [auto1.de] INFO: Scrape type for FK93583: 0
2026-03-30 11:27:48 [auto1.de] INFO: Found listing with ID: CA11296
2026-03-30 11:27:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA11296%27 HTTP/1.1" 200 None
2026-03-30 11:27:48 [auto1.de] INFO: Scrape type for CA11296: 0
2026-03-30 11:27:48 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-30 11:27:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT64251%27 HTTP/1.1" 200 None
2026-03-30 11:27:48 [auto1.de] INFO: Scrape type for HT64251: 0
2026-03-30 11:27:48 [auto1.de] INFO: Found listing with ID: FB70760
2026-03-30 11:27:48 [auto1.de] INFO: Found listing with ID: TV20692
2026-03-30 11:27:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:55 [auto1.de] INFO: Channel: 24h | Page: 184 | totalHits: 9727 | hits on page: 40
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: LV55762
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: SK36887
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: RC52895
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC52895%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.de] INFO: Scrape type for RC52895: 0
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: LT46739
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT46739%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.de] INFO: Scrape type for LT46739: 0
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: KH49369
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV64840%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.de] INFO: Scrape type for CV64840: 0
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: WR45011
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR45011%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.de] INFO: Scrape type for WR45011: 0
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: AS68475
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: YR50974
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: FY57679
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: YK97708
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK97708%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.de] INFO: Scrape type for YK97708: 0
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: EL15513
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: AU97741
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97741%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.de] INFO: Scrape type for AU97741: 0
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: HX44464
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX44464%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.de] INFO: Scrape type for HX44464: 0
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: BB57132
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: XE57640
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE57640%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.de] INFO: Scrape type for XE57640: 0
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: TT11512
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT11512%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.de] INFO: Scrape type for TT11512: 0
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: TG41026
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: WD55568
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD55568%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.de] INFO: Scrape type for WD55568: 0
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: DR63212
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: EH89058
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH89058%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.de] INFO: Scrape type for EH89058: 0
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR59987%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.de] INFO: Scrape type for KR59987: 0
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: YU70640
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU70640%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.de] INFO: Scrape type for YU70640: 0
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-30 11:27:55 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59954%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.de] INFO: Scrape type for XA59954: 2
2026-03-30 11:27:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e96fbded-52a2-5b96-91fc-d7b6b502471b with identifier: XA59954
2026-03-30 11:27:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e96fbded-52a2-5b96-91fc-d7b6b502471b with scrape type 2
2026-03-30 11:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e96fbded-52a2-5b96-91fc-d7b6b502471b with scrape type 2
2026-03-30 11:27:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e96fbded-52a2-5b96-91fc-d7b6b502471b, identifier: XA59954
2026-03-30 11:27:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e96fbded-52a2-5b96-91fc-d7b6b502471b with identifier: XA59954
2026-03-30 11:27:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e96fbded-52a2-5b96-91fc-d7b6b502471b with identifier: XA59954
2026-03-30 11:27:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e96fbded-52a2-5b96-91fc-d7b6b502471b with identifier: XA59954 to the API
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:47:37Z',
 'fuel_type': 'petrol',
 'id': 'e96fbded-52a2-5b96-91fc-d7b6b502471b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA59954',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 201006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-17',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59954%27 HTTP/1.1" 200 None
2026-03-30 11:27:56 [auto1.de] INFO: Saving data for XA59954: {'auction_closing_time': 1774885657.0, 'created_time': 1774001889.108418, 'last_price_update_time': 1774870076.276013}
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA59954') HTTP/1.1" 204 0
2026-03-30 11:27:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:56 [auto1.de] INFO: Found listing with ID: BS68722
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68722%27 HTTP/1.1" 200 None
2026-03-30 11:27:56 [auto1.de] INFO: Scrape type for BS68722: 0
2026-03-30 11:27:56 [auto1.de] INFO: Found listing with ID: UC15982
2026-03-30 11:27:56 [auto1.de] INFO: Found listing with ID: WV53584
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV53584%27 HTTP/1.1" 200 None
2026-03-30 11:27:56 [auto1.de] INFO: Scrape type for WV53584: 0
2026-03-30 11:27:56 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX82785%27 HTTP/1.1" 200 None
2026-03-30 11:27:56 [auto1.de] INFO: Scrape type for HX82785: 0
2026-03-30 11:27:56 [auto1.de] INFO: Found listing with ID: ZL89302
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89302%27 HTTP/1.1" 200 None
2026-03-30 11:27:56 [auto1.de] INFO: Scrape type for ZL89302: 0
2026-03-30 11:27:56 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-30 11:27:56 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-30 11:27:56 [auto1.de] INFO: Found listing with ID: KP94641
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP94641%27 HTTP/1.1" 200 None
2026-03-30 11:27:56 [auto1.de] INFO: Scrape type for KP94641: 0
2026-03-30 11:27:56 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ54274%27 HTTP/1.1" 200 None
2026-03-30 11:27:56 [auto1.de] INFO: Scrape type for TJ54274: 0
2026-03-30 11:27:56 [auto1.de] INFO: Found listing with ID: FK64701
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK64701%27 HTTP/1.1" 200 None
2026-03-30 11:27:56 [auto1.de] INFO: Scrape type for FK64701: 0
2026-03-30 11:27:56 [auto1.de] INFO: Found listing with ID: US02416
2026-03-30 11:27:56 [auto1.de] INFO: Found listing with ID: KD99837
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD99837%27 HTTP/1.1" 200 None
2026-03-30 11:27:56 [auto1.de] INFO: Scrape type for KD99837: 0
2026-03-30 11:27:56 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP65975%27 HTTP/1.1" 200 None
2026-03-30 11:27:56 [auto1.de] INFO: Scrape type for BP65975: 0
2026-03-30 11:28:04 [scrapy.extensions.logstats] INFO: Crawled 930 pages (at 3 pages/min), scraped 1370 items (at 1 items/min)
2026-03-30 11:28:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:29:04 [scrapy.extensions.logstats] INFO: Crawled 930 pages (at 0 pages/min), scraped 1370 items (at 0 items/min)
2026-03-30 11:29:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:30:04 [scrapy.extensions.logstats] INFO: Crawled 930 pages (at 0 pages/min), scraped 1370 items (at 0 items/min)
2026-03-30 11:30:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:30:05 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.563(s), this was the 1st time calling it.
2026-03-30 11:30:05 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.36441808919738 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:30:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:30:45 [scrapy.core.engine] DEBUG: Crawled (401) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:45 [auto1.de] WARNING: Received 401 for https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07 (token age: 3625.1s). Queued for retry (1 pending).
2026-03-30 11:30:45 [auto1.de] INFO: Initiating token refresh...
2026-03-30 11:30:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:01 [auto1.de] INFO: Token refreshed successfully. Replaying 1 pending requests.
2026-03-30 11:31:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:04 [scrapy.extensions.logstats] INFO: Crawled 932 pages (at 2 pages/min), scraped 1370 items (at 0 items/min)
2026-03-30 11:31:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:12 [auto1.de] INFO: Channel: 24h | Page: 185 | totalHits: 9747 | hits on page: 40
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: EH89058
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH89058%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for EH89058: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR59987%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for KR59987: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: YU70640
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU70640%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for YU70640: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59954%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for XA59954: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: BS68722
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68722%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for BS68722: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: UC15982
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: WV53584
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV53584%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for WV53584: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX82785%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for HX82785: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: ZL89302
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89302%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for ZL89302: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: KP94641
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP94641%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for KP94641: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ54274%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for TJ54274: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: FK64701
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK64701%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for FK64701: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: US02416
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: KD99837
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD99837%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for KD99837: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP65975%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for BP65975: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: GN84809
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN84809%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for GN84809: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: VR69124
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR69124%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for VR69124: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: BJ13428
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: JT79226
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT79226%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for JT79226: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: SP71400
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP71400%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for SP71400: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: GT92909
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT92909%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for GT92909: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: WE95129
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: TB03124
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB03124%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for TB03124: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: FC27244
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC27244%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for FC27244: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: ZS85358
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: CR76399
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR76399%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for CR76399: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: ZN04335
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN04335%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for ZN04335: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: EY70159
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY70159%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for EY70159: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: SR63884
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63884%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for SR63884: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: YT62931
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: UL19330
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL19330%27 HTTP/1.1" 200 None
2026-03-30 11:31:12 [auto1.de] INFO: Scrape type for UL19330: 0
2026-03-30 11:31:12 [auto1.de] INFO: Found listing with ID: EM38204
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM38204%27 HTTP/1.1" 200 None
2026-03-30 11:31:13 [auto1.de] INFO: Scrape type for EM38204: 0
2026-03-30 11:31:13 [auto1.de] INFO: Found listing with ID: WV85362
2026-03-30 11:31:13 [auto1.de] INFO: Found listing with ID: ZA74558
2026-03-30 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74558%27 HTTP/1.1" 200 None
2026-03-30 11:31:13 [auto1.de] INFO: Scrape type for ZA74558: 0
2026-03-30 11:31:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:17 [auto1.de] INFO: Channel: 24h | Page: 186 | totalHits: 9747 | hits on page: 40
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: LN73181
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: DH60406
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH60406%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for DH60406: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: LV98525
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV98525%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for LV98525: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: DR68264
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: MP23640
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: FP07382
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: FF90181
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF90181%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for FF90181: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: KK20650
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK20650%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for KK20650: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: WT94690
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT94690%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for WT94690: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: ZT51756
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT51756%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for ZT51756: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: JF78286
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF78286%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for JF78286: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: AJ08508
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08508%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for AJ08508: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: PS26933
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS26933%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for PS26933: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW09174%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for JW09174: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: VG01076
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG01076%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for VG01076: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: XL45586
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL45586%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for XL45586: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: AV64816
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU78971%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for LU78971: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: FX01006
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42572%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for DE42572: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: NS04983
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS04983%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for NS04983: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: MH95503
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: MM23773
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM23773%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for MM23773: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: JH92340
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH92340%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for JH92340: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: FY22177
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY22177%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for FY22177: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: ZS84546
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS84546%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for ZS84546: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: JL01177
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL01177%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for JL01177: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: PP80168
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP80168%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for PP80168: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: RC80403
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC80403%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for RC80403: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: NG76002
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG76002%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for NG76002: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD72910%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for BD72910: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: MV27472
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV27472%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for MV27472: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: AJ71122
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ71122%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for AJ71122: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: EY62389
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: GB27977
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27977%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for GB27977: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: CN74001
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: XR73410
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR73410%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for XR73410: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: DM13382
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM13382%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.de] INFO: Scrape type for DM13382: 0
2026-03-30 11:31:17 [auto1.de] INFO: Found listing with ID: FX39792
2026-03-30 11:31:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:19 [auto1.de] INFO: Channel: 24h | Page: 187 | totalHits: 9747 | hits on page: 40
2026-03-30 11:31:19 [auto1.de] INFO: Found listing with ID: NY59732
2026-03-30 11:31:19 [auto1.de] INFO: Found listing with ID: PR32906
2026-03-30 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32906%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for PR32906: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: BG13835
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG13835%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for BG13835: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: GR89322
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: BJ03907
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03907%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for BJ03907: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: BE52525
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE52525%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for BE52525: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: ZD84444
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD84444%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for ZD84444: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: KX79678
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX79678%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for KX79678: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: AS79616
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS79616%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for AS79616: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: ZP29614
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: AR51863
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: KY24056
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY24056%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for KY24056: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: RK05347
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK05347%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for RK05347: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: CY25945
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: EU14663
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU14663%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for EU14663: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: MK09620
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK09620%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for MK09620: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: FD07804
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD07804%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for FD07804: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: XC86778
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86778%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for XC86778: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ94450%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for CZ94450: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: FK93420
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93420%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for FK93420: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: GH39417
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS96565%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for BS96565: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: TP67168
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP67168%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for TP67168: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: AU39005
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: AL71232
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL71232%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for AL71232: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: EU93663
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: AZ37362
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: CP06535
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: DJ60943
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: YH93335
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH93335%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for YH93335: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: EE47026
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: YA08526
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08526%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for YA08526: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: YD94034
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: VC89740
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: EJ97789
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: YM60092
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60092%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for YM60092: 0
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: ML30380
2026-03-30 11:31:20 [auto1.de] INFO: Found listing with ID: GL23432
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL23432%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.de] INFO: Scrape type for GL23432: 0
2026-03-30 11:31:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:37 [auto1.de] INFO: Channel: 24h | Page: 188 | totalHits: 9749 | hits on page: 40
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: ML30380
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: GL23432
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL23432%27 HTTP/1.1" 200 None
2026-03-30 11:31:37 [auto1.de] INFO: Scrape type for GL23432: 0
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA99169%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for HA99169: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: GU28360
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU28360%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for GU28360: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: NY39865
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY39865%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for NY39865: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: YM89123
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM89123%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for YM89123: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: AG84988
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: RA07752
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: JE20553
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE20553%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for JE20553: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: HE95833
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE95833%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for HE95833: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: UY21095
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: VU06993
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: PJ72661
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ72661%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for PJ72661: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: ME01390
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: FC58368
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC58368%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for FC58368: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: BH40486
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH40486%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for BH40486: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: EU55937
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU55937%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for EU55937: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: TR16166
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR16166%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for TR16166: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: TL72428
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72428%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for TL72428: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: NK37699
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: HG88240
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: CT75216
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT75216%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for CT75216: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: CN22561
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN22561%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for CN22561: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: RB67874
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: JR29139
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: KV75239
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV75239%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for KV75239: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: WN20430
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN20430%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for WN20430: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: ZH54779
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH54779%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for ZH54779: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: NV84142
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84142%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for NV84142: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: UA34873
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: CE75609
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: CP55762
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP55762%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for CP55762: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: CF39305
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: MX54402
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE30876%27 HTTP/1.1" 200 None
2026-03-30 11:31:38 [auto1.de] INFO: Scrape type for UE30876: 0
2026-03-30 11:31:38 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-30 11:31:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:42 [auto1.de] INFO: Channel: 24h | Page: 189 | totalHits: 9749 | hits on page: 40
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: HW68760
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: EY98011
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY98011%27 HTTP/1.1" 200 None
2026-03-30 11:31:42 [auto1.de] INFO: Scrape type for EY98011: 0
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: MS39817
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: MK93259
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK93259%27 HTTP/1.1" 200 None
2026-03-30 11:31:42 [auto1.de] INFO: Scrape type for MK93259: 0
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: LZ51858
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: AH85059
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: NS09930
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS09930%27 HTTP/1.1" 200 None
2026-03-30 11:31:42 [auto1.de] INFO: Scrape type for NS09930: 0
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: JT09686
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT09686%27 HTTP/1.1" 200 None
2026-03-30 11:31:42 [auto1.de] INFO: Scrape type for JT09686: 0
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: TD61700
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: YM15583
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: CB40051
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB40051%27 HTTP/1.1" 200 None
2026-03-30 11:31:42 [auto1.de] INFO: Scrape type for CB40051: 0
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: NY21344
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21344%27 HTTP/1.1" 200 None
2026-03-30 11:31:42 [auto1.de] INFO: Scrape type for NY21344: 0
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: HB70808
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB70808%27 HTTP/1.1" 200 None
2026-03-30 11:31:42 [auto1.de] INFO: Scrape type for HB70808: 0
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: AD93379
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: XR43208
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR43208%27 HTTP/1.1" 200 None
2026-03-30 11:31:42 [auto1.de] INFO: Scrape type for XR43208: 0
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: MP24640
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: VN62534
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: LA11075
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA11075%27 HTTP/1.1" 200 None
2026-03-30 11:31:42 [auto1.de] INFO: Scrape type for LA11075: 0
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: BR25220
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: CG81314
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: BX54451
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX54451%27 HTTP/1.1" 200 None
2026-03-30 11:31:42 [auto1.de] INFO: Scrape type for BX54451: 0
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: KN66940
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: UK08756
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: CR88792
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: CZ66164
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: FU68975
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: UB65858
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: KU93910
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU93910%27 HTTP/1.1" 200 None
2026-03-30 11:31:42 [auto1.de] INFO: Scrape type for KU93910: 0
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: ZK53162
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: BK24126
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK24126%27 HTTP/1.1" 200 None
2026-03-30 11:31:42 [auto1.de] INFO: Scrape type for BK24126: 0
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: EC39473
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC39473%27 HTTP/1.1" 200 None
2026-03-30 11:31:42 [auto1.de] INFO: Scrape type for EC39473: 0
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: EJ80176
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: YK25344
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK25344%27 HTTP/1.1" 200 None
2026-03-30 11:31:42 [auto1.de] INFO: Scrape type for YK25344: 0
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: AN36712
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: UG59761
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG59761%27 HTTP/1.1" 200 None
2026-03-30 11:31:42 [auto1.de] INFO: Scrape type for UG59761: 0
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: SW09087
2026-03-30 11:31:42 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR07443%27 HTTP/1.1" 200 None
2026-03-30 11:31:42 [auto1.de] INFO: Scrape type for YR07443: 0
2026-03-30 11:31:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:52 [auto1.de] INFO: Channel: 24h | Page: 190 | totalHits: 9752 | hits on page: 40
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: UG59761
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG59761%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.de] INFO: Scrape type for UG59761: 0
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: SW09087
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR07443%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.de] INFO: Scrape type for YR07443: 0
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: ND18169
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND18169%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.de] INFO: Scrape type for ND18169: 0
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: KX34445
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: VL67140
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: AN93893
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN93893%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.de] INFO: Scrape type for AN93893: 0
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: FT81385
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: MX59150
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: MU36572
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU36572%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.de] INFO: Scrape type for MU36572: 0
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: SE09507
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: EE74949
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE74949%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.de] INFO: Scrape type for EE74949: 0
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: XU92987
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU92987%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.de] INFO: Scrape type for XU92987: 0
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: CP27370
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: YT56915
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT56915%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.de] INFO: Scrape type for YT56915: 0
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: AP20693
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP20693%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.de] INFO: Scrape type for AP20693: 0
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: BH54290
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: UK49641
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: HZ93598
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: ZK07522
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK07522%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.de] INFO: Scrape type for ZK07522: 0
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: DL82245
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: VX05177
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX05177%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.de] INFO: Scrape type for VX05177: 0
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: UG67799
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: WT01639
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: CW65482
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: WF94997
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: JL91815
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL91815%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.de] INFO: Scrape type for JL91815: 0
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: US61717
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: SG08144
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08144%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.de] INFO: Scrape type for SG08144: 0
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: YF55621
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: MU16772
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: UJ63993
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ63993%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.de] INFO: Scrape type for UJ63993: 0
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: XP10598
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP10598%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.de] INFO: Scrape type for XP10598: 0
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: JV63052
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: UE48673
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27093%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.de] INFO: Scrape type for PJ27093: 0
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-30 11:31:52 [auto1.de] INFO: Found listing with ID: SG14649
2026-03-30 11:31:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:04 [scrapy.extensions.logstats] INFO: Crawled 938 pages (at 6 pages/min), scraped 1370 items (at 0 items/min)
2026-03-30 11:32:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:25 [auto1.de] INFO: Channel: 24h | Page: 191 | totalHits: 9755 | hits on page: 40
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27093%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [auto1.de] INFO: Scrape type for PJ27093: 0
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: SG14649
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: FM49388
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM49388%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [auto1.de] INFO: Scrape type for FM49388: 0
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: JE71066
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: EK35927
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: JX17185
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: DV40482
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: DA76775
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA76775%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [auto1.de] INFO: Scrape type for DA76775: 0
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: HW43883
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: HT48359
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT48359%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [auto1.de] INFO: Scrape type for HT48359: 0
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: BH17233
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: ZC42699
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: ET45765
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET45765%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [auto1.de] INFO: Scrape type for ET45765: 0
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: HU37680
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: TB42941
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: XG24427
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: RZ86023
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ86023%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [auto1.de] INFO: Scrape type for RZ86023: 0
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: RX80532
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80532%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [auto1.de] INFO: Scrape type for RX80532: 0
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: ZU82600
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: AE19293
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: DM49539
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: VK80269
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: SB35470
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB35470%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [auto1.de] INFO: Scrape type for SB35470: 0
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD09657%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [auto1.de] INFO: Scrape type for YD09657: 0
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF21072%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [auto1.de] INFO: Scrape type for UF21072: 0
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06043%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [auto1.de] INFO: Scrape type for VN06043: 0
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: XS48010
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS48010%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [auto1.de] INFO: Scrape type for XS48010: 0
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD74109%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [auto1.de] INFO: Scrape type for FD74109: 0
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: WY85656
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: BP61239
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: CC98998
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC98998%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [auto1.de] INFO: Scrape type for CC98998: 0
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: XK50877
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK50877%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [auto1.de] INFO: Scrape type for XK50877: 0
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: DS59487
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: TK89149
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK89149%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [auto1.de] INFO: Scrape type for TK89149: 0
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA61960%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [auto1.de] INFO: Scrape type for TA61960: 0
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: BZ01431
2026-03-30 11:32:25 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV41920%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [auto1.de] INFO: Scrape type for FV41920: 0
2026-03-30 11:32:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:04 [scrapy.extensions.logstats] INFO: Crawled 939 pages (at 1 pages/min), scraped 1370 items (at 0 items/min)
2026-03-30 11:33:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:34:04 [scrapy.extensions.logstats] INFO: Crawled 939 pages (at 0 pages/min), scraped 1370 items (at 0 items/min)
2026-03-30 11:34:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:34:36 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.639(s), this was the 1st time calling it.
2026-03-30 11:34:36 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.011153057871068 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:34:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:44 [auto1.de] INFO: Channel: 24h | Page: 192 | totalHits: 9771 | hits on page: 40
2026-03-30 11:34:44 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-30 11:34:44 [auto1.de] INFO: Found listing with ID: SB35470
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB35470%27 HTTP/1.1" 200 None
2026-03-30 11:34:44 [auto1.de] INFO: Scrape type for SB35470: 0
2026-03-30 11:34:44 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD09657%27 HTTP/1.1" 200 None
2026-03-30 11:34:44 [auto1.de] INFO: Scrape type for YD09657: 0
2026-03-30 11:34:44 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF21072%27 HTTP/1.1" 200 None
2026-03-30 11:34:44 [auto1.de] INFO: Scrape type for UF21072: 0
2026-03-30 11:34:44 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06043%27 HTTP/1.1" 200 None
2026-03-30 11:34:44 [auto1.de] INFO: Scrape type for VN06043: 0
2026-03-30 11:34:44 [auto1.de] INFO: Found listing with ID: XS48010
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS48010%27 HTTP/1.1" 200 None
2026-03-30 11:34:44 [auto1.de] INFO: Scrape type for XS48010: 0
2026-03-30 11:34:44 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD74109%27 HTTP/1.1" 200 None
2026-03-30 11:34:44 [auto1.de] INFO: Scrape type for FD74109: 0
2026-03-30 11:34:44 [auto1.de] INFO: Found listing with ID: WY85656
2026-03-30 11:34:44 [auto1.de] INFO: Found listing with ID: BP61239
2026-03-30 11:34:44 [auto1.de] INFO: Found listing with ID: CC98998
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC98998%27 HTTP/1.1" 200 None
2026-03-30 11:34:44 [auto1.de] INFO: Scrape type for CC98998: 0
2026-03-30 11:34:44 [auto1.de] INFO: Found listing with ID: XK50877
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK50877%27 HTTP/1.1" 200 None
2026-03-30 11:34:44 [auto1.de] INFO: Scrape type for XK50877: 0
2026-03-30 11:34:44 [auto1.de] INFO: Found listing with ID: DS59487
2026-03-30 11:34:44 [auto1.de] INFO: Found listing with ID: TK89149
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK89149%27 HTTP/1.1" 200 None
2026-03-30 11:34:44 [auto1.de] INFO: Scrape type for TK89149: 0
2026-03-30 11:34:44 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA61960%27 HTTP/1.1" 200 None
2026-03-30 11:34:44 [auto1.de] INFO: Scrape type for TA61960: 0
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: BZ01431
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV41920%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.de] INFO: Scrape type for FV41920: 0
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: HE00518
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: LH51780
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH51780%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.de] INFO: Scrape type for LH51780: 0
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: UX47002
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX47002%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.de] INFO: Scrape type for UX47002: 0
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: TM66386
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM66386%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.de] INFO: Scrape type for TM66386: 0
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: XP96351
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP96351%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.de] INFO: Scrape type for XP96351: 0
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: AV69297
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: WL10604
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL10604%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.de] INFO: Scrape type for WL10604: 0
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: MV92547
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92547%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.de] INFO: Scrape type for MV92547: 0
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU77482%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.de] INFO: Scrape type for JU77482: 0
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: LA57205
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: YP93259
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP93259%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.de] INFO: Scrape type for YP93259: 0
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: PX47030
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX47030%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.de] INFO: Scrape type for PX47030: 0
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: SZ10404
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ10404%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.de] INFO: Scrape type for SZ10404: 0
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP37345%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.de] INFO: Scrape type for YP37345: 0
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: MS46414
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: FM24732
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: KW72669
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW72669%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.de] INFO: Scrape type for KW72669: 0
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: WE30814
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: EB43981
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: KR84974
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: DD09602
2026-03-30 11:34:45 [auto1.de] INFO: Found listing with ID: SB14031
2026-03-30 11:34:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:46 [auto1.de] INFO: Channel: 24h | Page: 193 | totalHits: 9771 | hits on page: 40
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: MP44977
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP44977%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.de] INFO: Scrape type for MP44977: 0
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR33954%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.de] INFO: Scrape type for AR33954: 0
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: CE68759
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE68759%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.de] INFO: Scrape type for CE68759: 0
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: NC07171
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: XC86569
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: LJ68235
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ68235%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.de] INFO: Scrape type for LJ68235: 0
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: AW26108
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26108%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.de] INFO: Scrape type for AW26108: 0
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: HW02228
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: EE70879
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE70879%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.de] INFO: Scrape type for EE70879: 0
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: ST04128
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC74122%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.de] INFO: Scrape type for EC74122: 0
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: WW55400
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW55400%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.de] INFO: Scrape type for WW55400: 0
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: UB61823
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: VR66334
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR66334%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.de] INFO: Scrape type for VR66334: 0
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: KX24569
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24569%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.de] INFO: Scrape type for KX24569: 0
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: KW68340
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: EJ12041
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ12041%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.de] INFO: Scrape type for EJ12041: 0
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM50806%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.de] INFO: Scrape type for WM50806: 0
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: WV19329
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV19329%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.de] INFO: Scrape type for WV19329: 0
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX41680%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.de] INFO: Scrape type for NX41680: 0
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB86141%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.de] INFO: Scrape type for JB86141: 0
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: EU38402
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU38402%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.de] INFO: Scrape type for EU38402: 0
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: KA83154
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83154%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.de] INFO: Scrape type for KA83154: 0
2026-03-30 11:34:46 [auto1.de] INFO: Found listing with ID: AX24898
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX24898%27 HTTP/1.1" 200 None
2026-03-30 11:34:47 [auto1.de] INFO: Scrape type for AX24898: 0
2026-03-30 11:34:47 [auto1.de] INFO: Found listing with ID: GD44773
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD44773%27 HTTP/1.1" 200 None
2026-03-30 11:34:47 [auto1.de] INFO: Scrape type for GD44773: 0
2026-03-30 11:34:47 [auto1.de] INFO: Found listing with ID: DW69161
2026-03-30 11:34:47 [auto1.de] INFO: Found listing with ID: UE92744
2026-03-30 11:34:47 [auto1.de] INFO: Found listing with ID: VH92759
2026-03-30 11:34:47 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-30 11:34:47 [auto1.de] INFO: Found listing with ID: CV00012
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV00012%27 HTTP/1.1" 200 None
2026-03-30 11:34:47 [auto1.de] INFO: Scrape type for CV00012: 0
2026-03-30 11:34:47 [auto1.de] INFO: Found listing with ID: BX45513
2026-03-30 11:34:47 [auto1.de] INFO: Found listing with ID: SX50197
2026-03-30 11:34:47 [auto1.de] INFO: Found listing with ID: WD76267
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD76267%27 HTTP/1.1" 200 None
2026-03-30 11:34:47 [auto1.de] INFO: Scrape type for WD76267: 0
2026-03-30 11:34:47 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-30 11:34:47 [auto1.de] INFO: Found listing with ID: WF46634
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF46634%27 HTTP/1.1" 200 None
2026-03-30 11:34:47 [auto1.de] INFO: Scrape type for WF46634: 0
2026-03-30 11:34:47 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK74159%27 HTTP/1.1" 200 None
2026-03-30 11:34:47 [auto1.de] INFO: Scrape type for MK74159: 0
2026-03-30 11:34:47 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-30 11:34:47 [auto1.de] INFO: Found listing with ID: JY20186
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20186%27 HTTP/1.1" 200 None
2026-03-30 11:34:47 [auto1.de] INFO: Scrape type for JY20186: 0
2026-03-30 11:34:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:04 [scrapy.extensions.logstats] INFO: Crawled 941 pages (at 2 pages/min), scraped 1370 items (at 0 items/min)
2026-03-30 11:35:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:36:04 [scrapy.extensions.logstats] INFO: Crawled 941 pages (at 0 pages/min), scraped 1370 items (at 0 items/min)
2026-03-30 11:36:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:36:57 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.477(s), this was the 1st time calling it.
2026-03-30 11:36:57 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.882406631721103 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:37:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:37:03 [auto1.de] INFO: Channel: 24h | Page: 194 | totalHits: 9783 | hits on page: 40
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: UE92744
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: VH92759
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: CV00012
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV00012%27 HTTP/1.1" 200 None
2026-03-30 11:37:03 [auto1.de] INFO: Scrape type for CV00012: 0
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: BX45513
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: SX50197
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: WD76267
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD76267%27 HTTP/1.1" 200 None
2026-03-30 11:37:03 [auto1.de] INFO: Scrape type for WD76267: 0
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: WF46634
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF46634%27 HTTP/1.1" 200 None
2026-03-30 11:37:03 [auto1.de] INFO: Scrape type for WF46634: 0
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK74159%27 HTTP/1.1" 200 None
2026-03-30 11:37:03 [auto1.de] INFO: Scrape type for MK74159: 0
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: JY20186
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20186%27 HTTP/1.1" 200 None
2026-03-30 11:37:03 [auto1.de] INFO: Scrape type for JY20186: 0
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: XF93739
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: BV96832
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96832%27 HTTP/1.1" 200 None
2026-03-30 11:37:03 [auto1.de] INFO: Scrape type for BV96832: 0
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: FB48782
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: MT56584
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: XJ30357
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: FA59135
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA59135%27 HTTP/1.1" 200 None
2026-03-30 11:37:03 [auto1.de] INFO: Scrape type for FA59135: 0
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: JY20975
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: GJ77265
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ77265%27 HTTP/1.1" 200 None
2026-03-30 11:37:03 [auto1.de] INFO: Scrape type for GJ77265: 0
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: JG82377
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG82377%27 HTTP/1.1" 200 None
2026-03-30 11:37:03 [auto1.de] INFO: Scrape type for JG82377: 0
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: YE81869
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE81869%27 HTTP/1.1" 200 None
2026-03-30 11:37:03 [auto1.de] INFO: Scrape type for YE81869: 0
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: VA13792
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: SP67485
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: BY18365
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18365%27 HTTP/1.1" 200 None
2026-03-30 11:37:03 [auto1.de] INFO: Scrape type for BY18365: 0
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: CM58161
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: BC52904
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: PS45422
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS45422%27 HTTP/1.1" 200 None
2026-03-30 11:37:03 [auto1.de] INFO: Scrape type for PS45422: 0
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: FX80624
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX80624%27 HTTP/1.1" 200 None
2026-03-30 11:37:03 [auto1.de] INFO: Scrape type for FX80624: 0
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: GX75432
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX75432%27 HTTP/1.1" 200 None
2026-03-30 11:37:03 [auto1.de] INFO: Scrape type for GX75432: 0
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: WC63279
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63279%27 HTTP/1.1" 200 None
2026-03-30 11:37:03 [auto1.de] INFO: Scrape type for WC63279: 0
2026-03-30 11:37:03 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-30 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU33144%27 HTTP/1.1" 200 None
2026-03-30 11:37:04 [auto1.de] INFO: Scrape type for TU33144: 0
2026-03-30 11:37:04 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-30 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA96721%27 HTTP/1.1" 200 None
2026-03-30 11:37:04 [auto1.de] INFO: Scrape type for YA96721: 0
2026-03-30 11:37:04 [auto1.de] INFO: Found listing with ID: EJ52813
2026-03-30 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ52813%27 HTTP/1.1" 200 None
2026-03-30 11:37:04 [auto1.de] INFO: Scrape type for EJ52813: 0
2026-03-30 11:37:04 [auto1.de] INFO: Found listing with ID: BX52940
2026-03-30 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52940%27 HTTP/1.1" 200 None
2026-03-30 11:37:04 [auto1.de] INFO: Scrape type for BX52940: 0
2026-03-30 11:37:04 [auto1.de] INFO: Found listing with ID: CE80644
2026-03-30 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE80644%27 HTTP/1.1" 200 None
2026-03-30 11:37:04 [auto1.de] INFO: Scrape type for CE80644: 0
2026-03-30 11:37:04 [auto1.de] INFO: Found listing with ID: YC54043
2026-03-30 11:37:04 [auto1.de] INFO: Found listing with ID: JU59461
2026-03-30 11:37:04 [auto1.de] INFO: Found listing with ID: YF47459
2026-03-30 11:37:04 [auto1.de] INFO: Found listing with ID: SX52884
2026-03-30 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX52884%27 HTTP/1.1" 200 None
2026-03-30 11:37:04 [auto1.de] INFO: Scrape type for SX52884: 0
2026-03-30 11:37:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:37:04 [scrapy.extensions.logstats] INFO: Crawled 942 pages (at 1 pages/min), scraped 1370 items (at 0 items/min)
2026-03-30 11:37:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:37:08 [auto1.de] INFO: Channel: 24h | Page: 195 | totalHits: 9783 | hits on page: 40
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: TS98939
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: HX55522
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: GM45973
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM45973%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for GM45973: 0
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: RV05301
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV05301%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for RV05301: 0
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: YY76457
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: HH54610
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH54610%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for HH54610: 0
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: NV91199
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: JM16548
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: ZY60733
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY60733%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for ZY60733: 0
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: BL02906
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL02906%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for BL02906: 0
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: MU06358
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU06358%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for MU06358: 0
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: RZ49473
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: GE87881
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE87881%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for GE87881: 0
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: GK32978
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK32978%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for GK32978: 0
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: WW79477
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW79477%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for WW79477: 0
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: SZ94185
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: WN68055
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: LC93569
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC93569%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for LC93569: 0
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: GH74073
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH74073%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for GH74073: 0
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: PX99081
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: ZW60338
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: MX11435
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: VW88901
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW88901%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for VW88901: 0
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: DK10933
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10933%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for DK10933: 0
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: XJ84301
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ84301%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for XJ84301: 0
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: YJ21289
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: GC49390
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC49390%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for GC49390: 0
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: GY78752
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: EN65963
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: VU36237
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: ZY38898
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY38898%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for ZY38898: 0
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: WF79557
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF79557%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for WF79557: 0
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: HL77152
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: UZ43781
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: TT07076
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT07076%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for TT07076: 0
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: JF87432
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: UW42720
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW42720%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for UW42720: 0
2026-03-30 11:37:08 [auto1.de] INFO: Found listing with ID: JS34798
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS34798%27 HTTP/1.1" 200 None
2026-03-30 11:37:08 [auto1.de] INFO: Scrape type for JS34798: 0
2026-03-30 11:37:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:37:41 [auto1.de] INFO: Channel: 24h | Page: 196 | totalHits: 9786 | hits on page: 40
2026-03-30 11:37:41 [auto1.de] INFO: Found listing with ID: JF87432
2026-03-30 11:37:41 [auto1.de] INFO: Found listing with ID: UW42720
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW42720%27 HTTP/1.1" 200 None
2026-03-30 11:37:41 [auto1.de] INFO: Scrape type for UW42720: 0
2026-03-30 11:37:41 [auto1.de] INFO: Found listing with ID: JS34798
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS34798%27 HTTP/1.1" 200 None
2026-03-30 11:37:41 [auto1.de] INFO: Scrape type for JS34798: 0
2026-03-30 11:37:41 [auto1.de] INFO: Found listing with ID: UU98141
2026-03-30 11:37:41 [auto1.de] INFO: Found listing with ID: DY76053
2026-03-30 11:37:41 [auto1.de] INFO: Found listing with ID: CA65369
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65369%27 HTTP/1.1" 200 None
2026-03-30 11:37:41 [auto1.de] INFO: Scrape type for CA65369: 0
2026-03-30 11:37:41 [auto1.de] INFO: Found listing with ID: SD28198
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD28198%27 HTTP/1.1" 200 None
2026-03-30 11:37:41 [auto1.de] INFO: Scrape type for SD28198: 0
2026-03-30 11:37:41 [auto1.de] INFO: Found listing with ID: US56502
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US56502%27 HTTP/1.1" 200 None
2026-03-30 11:37:41 [auto1.de] INFO: Scrape type for US56502: 0
2026-03-30 11:37:41 [auto1.de] INFO: Found listing with ID: TX40728
2026-03-30 11:37:41 [auto1.de] INFO: Found listing with ID: NV48270
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV48270%27 HTTP/1.1" 200 None
2026-03-30 11:37:41 [auto1.de] INFO: Scrape type for NV48270: 0
2026-03-30 11:37:41 [auto1.de] INFO: Found listing with ID: MX86281
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX86281%27 HTTP/1.1" 200 None
2026-03-30 11:37:41 [auto1.de] INFO: Scrape type for MX86281: 0
2026-03-30 11:37:41 [auto1.de] INFO: Found listing with ID: EB09552
2026-03-30 11:37:41 [auto1.de] INFO: Found listing with ID: UJ83217
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ83217%27 HTTP/1.1" 200 None
2026-03-30 11:37:41 [auto1.de] INFO: Scrape type for UJ83217: 0
2026-03-30 11:37:41 [auto1.de] INFO: Found listing with ID: MN47186
2026-03-30 11:37:41 [auto1.de] INFO: Found listing with ID: HW30650
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW30650%27 HTTP/1.1" 200 None
2026-03-30 11:37:41 [auto1.de] INFO: Scrape type for HW30650: 0
2026-03-30 11:37:41 [auto1.de] INFO: Found listing with ID: GJ36407
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ36407%27 HTTP/1.1" 200 None
2026-03-30 11:37:41 [auto1.de] INFO: Scrape type for GJ36407: 0
2026-03-30 11:37:41 [auto1.de] INFO: Found listing with ID: RC78323
2026-03-30 11:37:41 [auto1.de] INFO: Found listing with ID: ME64315
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME64315%27 HTTP/1.1" 200 None
2026-03-30 11:37:41 [auto1.de] INFO: Scrape type for ME64315: 2
2026-03-30 11:37:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7697bc61-fa0a-540d-a685-a5e42a561ae9 with identifier: ME64315
2026-03-30 11:37:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7697bc61-fa0a-540d-a685-a5e42a561ae9 with scrape type 2
2026-03-30 11:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7697bc61-fa0a-540d-a685-a5e42a561ae9 with scrape type 2
2026-03-30 11:37:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7697bc61-fa0a-540d-a685-a5e42a561ae9, identifier: ME64315
2026-03-30 11:37:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7697bc61-fa0a-540d-a685-a5e42a561ae9 with identifier: ME64315
2026-03-30 11:37:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7697bc61-fa0a-540d-a685-a5e42a561ae9 with identifier: ME64315
2026-03-30 11:37:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7697bc61-fa0a-540d-a685-a5e42a561ae9 with identifier: ME64315 to the API
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:18:37Z',
 'fuel_type': 'diesel',
 'id': '7697bc61-fa0a-540d-a685-a5e42a561ae9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME64315',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 266282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-02',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Cup BlueMotion',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion',
 'year': 2014}
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME64315%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.de] INFO: Saving data for ME64315: {'auction_closing_time': 1774883917.0, 'created_time': 1773307791.268957, 'last_price_update_time': 1774870662.339972}
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME64315') HTTP/1.1" 204 0
2026-03-30 11:37:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: WX41369
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41369%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.de] INFO: Scrape type for WX41369: 0
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: LF76340
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: AY49158
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: YF72599
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF72599%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.de] INFO: Scrape type for YF72599: 0
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: PS95073
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: DK89074
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK89074%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.de] INFO: Scrape type for DK89074: 0
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: ZA79718
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA79718%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.de] INFO: Scrape type for ZA79718: 0
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: KV18846
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: YT47398
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: ZA60248
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: SX72009
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: SY50059
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY50059%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.de] INFO: Scrape type for SY50059: 0
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: FF62684
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF62684%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.de] INFO: Scrape type for FF62684: 0
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: MN48285
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN48285%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.de] INFO: Scrape type for MN48285: 0
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: VG18386
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: PP24406
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP24406%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.de] INFO: Scrape type for PP24406: 0
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: FM50450
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM50450%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.de] INFO: Scrape type for FM50450: 0
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: MZ72093
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72093%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.de] INFO: Scrape type for MZ72093: 0
2026-03-30 11:37:42 [auto1.de] INFO: Found listing with ID: BB52240
2026-03-30 11:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:37:44 [auto1.de] INFO: Channel: 24h | Page: 197 | totalHits: 9786 | hits on page: 40
2026-03-30 11:37:44 [auto1.de] INFO: Found listing with ID: TB77095
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77095%27 HTTP/1.1" 200 None
2026-03-30 11:37:44 [auto1.de] INFO: Scrape type for TB77095: 0
2026-03-30 11:37:44 [auto1.de] INFO: Found listing with ID: RK52419
2026-03-30 11:37:44 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB40017%27 HTTP/1.1" 200 None
2026-03-30 11:37:44 [auto1.de] INFO: Scrape type for YB40017: 0
2026-03-30 11:37:44 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-30 11:37:44 [auto1.de] INFO: Found listing with ID: HD93241
2026-03-30 11:37:44 [auto1.de] INFO: Found listing with ID: DP80486
2026-03-30 11:37:44 [auto1.de] INFO: Found listing with ID: HL71363
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71363%27 HTTP/1.1" 200 None
2026-03-30 11:37:44 [auto1.de] INFO: Scrape type for HL71363: 0
2026-03-30 11:37:44 [auto1.de] INFO: Found listing with ID: ZS15843
2026-03-30 11:37:44 [auto1.de] INFO: Found listing with ID: US92808
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US92808%27 HTTP/1.1" 200 None
2026-03-30 11:37:44 [auto1.de] INFO: Scrape type for US92808: 0
2026-03-30 11:37:44 [auto1.de] INFO: Found listing with ID: FZ89308
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ89308%27 HTTP/1.1" 200 None
2026-03-30 11:37:44 [auto1.de] INFO: Scrape type for FZ89308: 0
2026-03-30 11:37:44 [auto1.de] INFO: Found listing with ID: HL98851
2026-03-30 11:37:44 [auto1.de] INFO: Found listing with ID: ZG82631
2026-03-30 11:37:44 [auto1.de] INFO: Found listing with ID: WR57027
2026-03-30 11:37:44 [auto1.de] INFO: Found listing with ID: SG17640
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG17640%27 HTTP/1.1" 200 None
2026-03-30 11:37:45 [auto1.de] INFO: Scrape type for SG17640: 0
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: GT14298
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: JZ53783
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: KV33048
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: JC18235
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC18235%27 HTTP/1.1" 200 None
2026-03-30 11:37:45 [auto1.de] INFO: Scrape type for JC18235: 0
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: WW27642
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW27642%27 HTTP/1.1" 200 None
2026-03-30 11:37:45 [auto1.de] INFO: Scrape type for WW27642: 0
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52276%27 HTTP/1.1" 200 None
2026-03-30 11:37:45 [auto1.de] INFO: Scrape type for RS52276: 0
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP12091%27 HTTP/1.1" 200 None
2026-03-30 11:37:45 [auto1.de] INFO: Scrape type for HP12091: 0
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: EY51453
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY51453%27 HTTP/1.1" 200 None
2026-03-30 11:37:45 [auto1.de] INFO: Scrape type for EY51453: 0
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: SM51050
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM51050%27 HTTP/1.1" 200 None
2026-03-30 11:37:45 [auto1.de] INFO: Scrape type for SM51050: 0
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: JB80015
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: ZW18782
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: JX09791
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02075%27 HTTP/1.1" 200 None
2026-03-30 11:37:45 [auto1.de] INFO: Scrape type for SJ02075: 0
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: DR32988
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: HU68423
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: CT22641
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV37620%27 HTTP/1.1" 200 None
2026-03-30 11:37:45 [auto1.de] INFO: Scrape type for JV37620: 0
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: RH01499
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: JX92669
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: KJ60236
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ60236%27 HTTP/1.1" 200 None
2026-03-30 11:37:45 [auto1.de] INFO: Scrape type for KJ60236: 0
2026-03-30 11:37:45 [auto1.de] INFO: Found listing with ID: UE90964
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE90964%27 HTTP/1.1" 200 None
2026-03-30 11:37:45 [auto1.de] INFO: Scrape type for UE90964: 0
2026-03-30 11:37:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:37:52 [auto1.de] INFO: Channel: 24h | Page: 198 | totalHits: 9786 | hits on page: 40
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: NT88605
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT88605%27 HTTP/1.1" 200 None
2026-03-30 11:37:52 [auto1.de] INFO: Scrape type for NT88605: 0
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: VL46030
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: FY09014
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: AF99280
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: JG45711
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG45711%27 HTTP/1.1" 200 None
2026-03-30 11:37:52 [auto1.de] INFO: Scrape type for JG45711: 0
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: LH30739
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH30739%27 HTTP/1.1" 200 None
2026-03-30 11:37:52 [auto1.de] INFO: Scrape type for LH30739: 0
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: WS48459
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48459%27 HTTP/1.1" 200 None
2026-03-30 11:37:52 [auto1.de] INFO: Scrape type for WS48459: 0
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN32134%27 HTTP/1.1" 200 None
2026-03-30 11:37:52 [auto1.de] INFO: Scrape type for XN32134: 0
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL69510%27 HTTP/1.1" 200 None
2026-03-30 11:37:52 [auto1.de] INFO: Scrape type for TL69510: 0
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: GX96959
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: DP54088
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP54088%27 HTTP/1.1" 200 None
2026-03-30 11:37:52 [auto1.de] INFO: Scrape type for DP54088: 0
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY09817%27 HTTP/1.1" 200 None
2026-03-30 11:37:52 [auto1.de] INFO: Scrape type for NY09817: 0
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: NM81365
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: PC42452
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42452%27 HTTP/1.1" 200 None
2026-03-30 11:37:52 [auto1.de] INFO: Scrape type for PC42452: 0
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC38320%27 HTTP/1.1" 200 None
2026-03-30 11:37:52 [auto1.de] INFO: Scrape type for EC38320: 0
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: YH26863
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH26863%27 HTTP/1.1" 200 None
2026-03-30 11:37:52 [auto1.de] INFO: Scrape type for YH26863: 0
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: BX11616
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: ER69054
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER69054%27 HTTP/1.1" 200 None
2026-03-30 11:37:52 [auto1.de] INFO: Scrape type for ER69054: 0
2026-03-30 11:37:52 [auto1.de] INFO: Found listing with ID: TA30893
2026-03-30 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA30893%27 HTTP/1.1" 200 None
2026-03-30 11:37:53 [auto1.de] INFO: Scrape type for TA30893: 0
2026-03-30 11:37:53 [auto1.de] INFO: Found listing with ID: DH72575
2026-03-30 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH72575%27 HTTP/1.1" 200 None
2026-03-30 11:37:53 [auto1.de] INFO: Scrape type for DH72575: 0
2026-03-30 11:37:53 [auto1.de] INFO: Found listing with ID: NV84583
2026-03-30 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84583%27 HTTP/1.1" 200 None
2026-03-30 11:37:53 [auto1.de] INFO: Scrape type for NV84583: 0
2026-03-30 11:37:53 [auto1.de] INFO: Found listing with ID: UP40831
2026-03-30 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP40831%27 HTTP/1.1" 200 None
2026-03-30 11:37:53 [auto1.de] INFO: Scrape type for UP40831: 0
2026-03-30 11:37:53 [auto1.de] INFO: Found listing with ID: RP99262
2026-03-30 11:37:53 [auto1.de] INFO: Found listing with ID: SW40365
2026-03-30 11:37:53 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-30 11:37:53 [auto1.de] INFO: Found listing with ID: YW50653
2026-03-30 11:37:53 [auto1.de] INFO: Found listing with ID: UY98084
2026-03-30 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY98084%27 HTTP/1.1" 200 None
2026-03-30 11:37:53 [auto1.de] INFO: Scrape type for UY98084: 0
2026-03-30 11:37:53 [auto1.de] INFO: Found listing with ID: KZ47858
2026-03-30 11:37:53 [auto1.de] INFO: Found listing with ID: NE13487
2026-03-30 11:37:53 [auto1.de] INFO: Found listing with ID: BR43966
2026-03-30 11:37:53 [auto1.de] INFO: Found listing with ID: FX67630
2026-03-30 11:37:53 [auto1.de] INFO: Found listing with ID: YU15721
2026-03-30 11:37:53 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-30 11:37:53 [auto1.de] INFO: Found listing with ID: FY46967
2026-03-30 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY46967%27 HTTP/1.1" 200 None
2026-03-30 11:37:53 [auto1.de] INFO: Scrape type for FY46967: 0
2026-03-30 11:37:53 [auto1.de] INFO: Found listing with ID: WB38942
2026-03-30 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB38942%27 HTTP/1.1" 200 None
2026-03-30 11:37:53 [auto1.de] INFO: Scrape type for WB38942: 0
2026-03-30 11:37:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:37:54 [auto1.de] INFO: Channel: 24h | Page: 199 | totalHits: 9786 | hits on page: 40
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: MX01041
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: LL59024
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: GZ29273
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: BC20634
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: TN04984
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: XS50752
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50752%27 HTTP/1.1" 200 None
2026-03-30 11:37:54 [auto1.de] INFO: Scrape type for XS50752: 0
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: LR98326
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR98326%27 HTTP/1.1" 200 None
2026-03-30 11:37:54 [auto1.de] INFO: Scrape type for LR98326: 0
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: JL37437
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: FH05972
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU96107%27 HTTP/1.1" 200 None
2026-03-30 11:37:54 [auto1.de] INFO: Scrape type for DU96107: 0
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: WD34588
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD34588%27 HTTP/1.1" 200 None
2026-03-30 11:37:54 [auto1.de] INFO: Scrape type for WD34588: 0
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL89727%27 HTTP/1.1" 200 None
2026-03-30 11:37:54 [auto1.de] INFO: Scrape type for PL89727: 0
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: RA28686
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA28686%27 HTTP/1.1" 200 None
2026-03-30 11:37:54 [auto1.de] INFO: Scrape type for RA28686: 0
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW90276%27 HTTP/1.1" 200 None
2026-03-30 11:37:54 [auto1.de] INFO: Scrape type for DW90276: 0
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: LG94407
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: UA17642
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA17642%27 HTTP/1.1" 200 None
2026-03-30 11:37:54 [auto1.de] INFO: Scrape type for UA17642: 0
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: YM57013
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM57013%27 HTTP/1.1" 200 None
2026-03-30 11:37:54 [auto1.de] INFO: Scrape type for YM57013: 0
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: JN34556
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: TH04951
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH04951%27 HTTP/1.1" 200 None
2026-03-30 11:37:54 [auto1.de] INFO: Scrape type for TH04951: 0
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: UB28690
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: TF57163
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF57163%27 HTTP/1.1" 200 None
2026-03-30 11:37:54 [auto1.de] INFO: Scrape type for TF57163: 0
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: WR98876
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: LB03108
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: DR68072
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68072%27 HTTP/1.1" 200 None
2026-03-30 11:37:54 [auto1.de] INFO: Scrape type for DR68072: 0
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: GL61912
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: GA13082
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA13082%27 HTTP/1.1" 200 None
2026-03-30 11:37:54 [auto1.de] INFO: Scrape type for GA13082: 0
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: BF61357
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF61357%27 HTTP/1.1" 200 None
2026-03-30 11:37:54 [auto1.de] INFO: Scrape type for BF61357: 0
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: PC78051
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: MH34813
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH34813%27 HTTP/1.1" 200 None
2026-03-30 11:37:54 [auto1.de] INFO: Scrape type for MH34813: 0
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: WF57615
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX15527%27 HTTP/1.1" 200 None
2026-03-30 11:37:54 [auto1.de] INFO: Scrape type for GX15527: 0
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: XY70185
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY70185%27 HTTP/1.1" 200 None
2026-03-30 11:37:54 [auto1.de] INFO: Scrape type for XY70185: 0
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: MY99054
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY99054%27 HTTP/1.1" 200 None
2026-03-30 11:37:54 [auto1.de] INFO: Scrape type for MY99054: 0
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: KG12536
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: KV18345
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: BY51393
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: LP67164
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP67164%27 HTTP/1.1" 200 None
2026-03-30 11:37:54 [auto1.de] INFO: Scrape type for LP67164: 0
2026-03-30 11:37:54 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-30 11:37:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:01 [auto1.de] INFO: Channel: 24h | Page: 200 | totalHits: 9787 | hits on page: 40
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: EU36809
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: VH67229
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH67229%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for VH67229: 0
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: ZF64276
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF64276%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for ZF64276: 0
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: LK89545
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF45027%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for MF45027: 0
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: BU39152
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU39152%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for BU39152: 0
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: NE15652
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: WT06361
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: TY20606
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: GA31653
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: MZ37789
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: NV13181
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13181%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for NV13181: 0
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: VB50178
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: NE19972
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: CP50790
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: WU91677
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: YF79248
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: NF91917
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF91917%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for NF91917: 0
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: WS69855
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS69855%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for WS69855: 0
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: BU76386
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU76386%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for BU76386: 0
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: SG14297
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: JD76793
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD76793%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for JD76793: 0
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: TW80485
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW80485%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for TW80485: 0
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: TZ00942
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ00942%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for TZ00942: 0
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: NK53054
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: TB49418
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49418%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for TB49418: 0
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: TY10898
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY10898%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for TY10898: 0
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: KT36384
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT36384%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for KT36384: 0
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: ZV64166
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV64166%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for ZV64166: 0
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: EP38579
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP38579%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for EP38579: 0
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: XX81034
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: KG05559
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: ZJ64916
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ64916%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for ZJ64916: 0
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: MA12811
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE21884%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for AE21884: 0
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: WT92712
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT92712%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for WT92712: 0
2026-03-30 11:38:01 [auto1.de] INFO: Found listing with ID: BU81814
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU81814%27 HTTP/1.1" 200 None
2026-03-30 11:38:01 [auto1.de] INFO: Scrape type for BU81814: 0
2026-03-30 11:38:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:04 [scrapy.extensions.logstats] INFO: Crawled 948 pages (at 6 pages/min), scraped 1371 items (at 1 items/min)
2026-03-30 11:38:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:10 [auto1.de] INFO: Channel: 24h | Page: 201 | totalHits: 9790 | hits on page: 40
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE21884%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for AE21884: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: WT92712
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT92712%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for WT92712: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: BU81814
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU81814%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for BU81814: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: XY91338
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: FU12915
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU12915%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for FU12915: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: WJ73657
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ73657%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for WJ73657: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: JU65331
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU65331%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for JU65331: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: HP00850
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP00850%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for HP00850: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: DK81331
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81331%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for DK81331: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: ZL30155
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30155%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for ZL30155: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: BH43917
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: ZG14891
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14891%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for ZG14891: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: RZ09497
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ09497%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for RZ09497: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG89012%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for GG89012: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: LF01905
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF01905%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for LF01905: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: TE97467
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: SY47772
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: KG98772
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: VK49169
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: UJ17280
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ17280%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for UJ17280: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: EN92666
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44839%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for TW44839: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: HX15626
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX15626%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for HX15626: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: YX12921
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX12921%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for YX12921: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: LK21356
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK21356%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for LK21356: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: RL20580
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL20580%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for RL20580: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: AX39550
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX39550%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for AX39550: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: CG53828
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG53828%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for CG53828: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: GK27432
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: VK36740
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: WL85831
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF33157%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for RF33157: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: LJ39551
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: JT67031
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT67031%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for JT67031: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: MA51695
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA51695%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for MA51695: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: TX92076
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: FV21429
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: CR82363
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: VL78522
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL78522%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for VL78522: 0
2026-03-30 11:38:10 [auto1.de] INFO: Found listing with ID: FU90427
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU90427%27 HTTP/1.1" 200 None
2026-03-30 11:38:10 [auto1.de] INFO: Scrape type for FU90427: 0
2026-03-30 11:38:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:12 [auto1.de] INFO: Channel: 24h | Page: 202 | totalHits: 9790 | hits on page: 40
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: CY33039
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH91647%27 HTTP/1.1" 200 None
2026-03-30 11:38:12 [auto1.de] INFO: Scrape type for TH91647: 0
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: KA00227
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ75768%27 HTTP/1.1" 200 None
2026-03-30 11:38:12 [auto1.de] INFO: Scrape type for LJ75768: 0
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: KL68094
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: SZ45535
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: SJ79213
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ79213%27 HTTP/1.1" 200 None
2026-03-30 11:38:12 [auto1.de] INFO: Scrape type for SJ79213: 0
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: MH37188
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH37188%27 HTTP/1.1" 200 None
2026-03-30 11:38:12 [auto1.de] INFO: Scrape type for MH37188: 0
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: BM31151
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: GM12066
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM12066%27 HTTP/1.1" 200 None
2026-03-30 11:38:12 [auto1.de] INFO: Scrape type for GM12066: 0
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK31638%27 HTTP/1.1" 200 None
2026-03-30 11:38:12 [auto1.de] INFO: Scrape type for DK31638: 0
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: PM88586
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: PC91683
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC91683%27 HTTP/1.1" 200 None
2026-03-30 11:38:12 [auto1.de] INFO: Scrape type for PC91683: 0
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: GG98787
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: BS00370
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS00370%27 HTTP/1.1" 200 None
2026-03-30 11:38:12 [auto1.de] INFO: Scrape type for BS00370: 0
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: XG51341
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG51341%27 HTTP/1.1" 200 None
2026-03-30 11:38:12 [auto1.de] INFO: Scrape type for XG51341: 0
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: HD47083
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD47083%27 HTTP/1.1" 200 None
2026-03-30 11:38:12 [auto1.de] INFO: Scrape type for HD47083: 0
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: BE24372
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: GN50102
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN50102%27 HTTP/1.1" 200 None
2026-03-30 11:38:12 [auto1.de] INFO: Scrape type for GN50102: 0
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: ZN65231
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: FB58638
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: XW56933
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW56933%27 HTTP/1.1" 200 None
2026-03-30 11:38:12 [auto1.de] INFO: Scrape type for XW56933: 0
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: FK36654
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: CT53994
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53994%27 HTTP/1.1" 200 None
2026-03-30 11:38:12 [auto1.de] INFO: Scrape type for CT53994: 0
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: TT67137
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: MA63217
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA63217%27 HTTP/1.1" 200 None
2026-03-30 11:38:12 [auto1.de] INFO: Scrape type for MA63217: 0
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: CD81555
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: FS32666
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: FT28462
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: UK53846
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: YW34309
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: UC14078
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: UT49919
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: LW05271
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW05271%27 HTTP/1.1" 200 None
2026-03-30 11:38:12 [auto1.de] INFO: Scrape type for LW05271: 0
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: DE59201
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE59201%27 HTTP/1.1" 200 None
2026-03-30 11:38:12 [auto1.de] INFO: Scrape type for DE59201: 0
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: BJ86438
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-30 11:38:12 [auto1.de] INFO: Found listing with ID: XK18770
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK18770%27 HTTP/1.1" 200 None
2026-03-30 11:38:12 [auto1.de] INFO: Scrape type for XK18770: 0
2026-03-30 11:38:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:16 [auto1.de] INFO: Channel: 24h | Page: 203 | totalHits: 9790 | hits on page: 40
2026-03-30 11:38:16 [auto1.de] INFO: Found listing with ID: NP46589
2026-03-30 11:38:16 [auto1.de] INFO: Found listing with ID: BM05172
2026-03-30 11:38:16 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21062%27 HTTP/1.1" 200 None
2026-03-30 11:38:16 [auto1.de] INFO: Scrape type for RX21062: 0
2026-03-30 11:38:16 [auto1.de] INFO: Found listing with ID: UD63369
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD63369%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for UD63369: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: PJ50890
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: ZY31624
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: ND25281
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND25281%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for ND25281: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: XP95900
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP95900%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for XP95900: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: HZ16106
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ16106%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for HZ16106: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: LE21956
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE21956%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for LE21956: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: SD67792
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD67792%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for SD67792: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: BV38151
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: JZ77542
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: SC73852
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC73852%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for SC73852: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: AU06987
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06987%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for AU06987: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: RC48761
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: SL60481
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL60481%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for SL60481: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: SX98211
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX98211%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for SX98211: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU55800%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for YU55800: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: LX11356
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: VE41795
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41795%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for VE41795: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV56207%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for PV56207: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: LD57431
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: NH92244
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH92244%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for NH92244: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: HX92939
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: FN16508
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: PB97430
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB97430%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for PB97430: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: MZ98399
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: YY43681
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY43681%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for YY43681: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: DW00961
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW00961%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for DW00961: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: AJ27375
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: BD43064
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD43064%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for BD43064: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: MJ13308
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ13308%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for MJ13308: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: YB62347
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB62347%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for YB62347: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: NE25486
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: AW92068
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW92068%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for AW92068: 0
2026-03-30 11:38:17 [auto1.de] INFO: Found listing with ID: VS70073
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS70073%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [auto1.de] INFO: Scrape type for VS70073: 2
2026-03-30 11:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47cf8992-6ada-55eb-b88a-a95df9279cda with identifier: VS70073
2026-03-30 11:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47cf8992-6ada-55eb-b88a-a95df9279cda with scrape type 2
2026-03-30 11:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47cf8992-6ada-55eb-b88a-a95df9279cda with scrape type 2
2026-03-30 11:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47cf8992-6ada-55eb-b88a-a95df9279cda, identifier: VS70073
2026-03-30 11:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47cf8992-6ada-55eb-b88a-a95df9279cda with identifier: VS70073
2026-03-30 11:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47cf8992-6ada-55eb-b88a-a95df9279cda with identifier: VS70073
2026-03-30 11:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47cf8992-6ada-55eb-b88a-a95df9279cda with identifier: VS70073 to the API
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:46:04Z',
 'fuel_type': 'diesel',
 'id': '47cf8992-6ada-55eb-b88a-a95df9279cda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS70073',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce Verso',
 'odometer': 45588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-31',
 'seller_name': None,
 'title': 'Toyota ProAce Verso 2.0 D-4D L2 Executive',
 'transmission': 'automatic',
 'trim': 'L2 Executive',
 'year': 2021}
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS70073%27 HTTP/1.1" 200 None
2026-03-30 11:38:18 [auto1.de] INFO: Saving data for VS70073: {'auction_closing_time': 1774885564.0, 'created_time': 1772729327.876622, 'last_price_update_time': 1774870698.238719}
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS70073') HTTP/1.1" 204 0
2026-03-30 11:38:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:18 [auto1.de] INFO: Found listing with ID: MA53170
2026-03-30 11:38:18 [auto1.de] INFO: Found listing with ID: MF48816
2026-03-30 11:38:18 [auto1.de] INFO: Found listing with ID: TB30393
2026-03-30 11:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:19 [auto1.de] INFO: Channel: 24h | Page: 204 | totalHits: 9790 | hits on page: 40
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: WP04220
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP04220%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [auto1.de] INFO: Scrape type for WP04220: 0
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: EW17525
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: FZ02715
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02715%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [auto1.de] INFO: Scrape type for FZ02715: 0
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: ZJ20078
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20078%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [auto1.de] INFO: Scrape type for ZJ20078: 0
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: VC80296
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: KY02769
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY02769%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [auto1.de] INFO: Scrape type for KY02769: 0
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: UX30716
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX30716%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [auto1.de] INFO: Scrape type for UX30716: 0
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: CZ36938
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: CD08059
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: JL21750
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: KY11260
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: WB37074
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB37074%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [auto1.de] INFO: Scrape type for WB37074: 0
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: PU90892
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: RK60330
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: HU72855
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: NK67833
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF95451%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [auto1.de] INFO: Scrape type for JF95451: 0
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: WN12652
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: VF27254
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: PZ82865
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: DB26331
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB26331%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [auto1.de] INFO: Scrape type for DB26331: 0
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: ZS04919
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS04919%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [auto1.de] INFO: Scrape type for ZS04919: 0
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: VW20064
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW20064%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [auto1.de] INFO: Scrape type for VW20064: 0
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: LT58589
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: TK27520
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK27520%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [auto1.de] INFO: Scrape type for TK27520: 0
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: LK66468
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK66468%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [auto1.de] INFO: Scrape type for LK66468: 0
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: NH12576
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: XA54655
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: JR60766
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR60766%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [auto1.de] INFO: Scrape type for JR60766: 0
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: YV09971
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV09971%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [auto1.de] INFO: Scrape type for YV09971: 0
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: HY06483
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: DZ38540
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: PW95662
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW95662%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [auto1.de] INFO: Scrape type for PW95662: 0
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: GZ43118
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: PY30704
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: BU32595
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: KF40481
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF40481%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [auto1.de] INFO: Scrape type for KF40481: 0
2026-03-30 11:38:19 [auto1.de] INFO: Found listing with ID: GH53408
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH53408%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [auto1.de] INFO: Scrape type for GH53408: 0
2026-03-30 11:38:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:21 [auto1.de] INFO: Channel: 24h | Page: 205 | totalHits: 9790 | hits on page: 40
2026-03-30 11:38:21 [auto1.de] INFO: Found listing with ID: EG14085
2026-03-30 11:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG14085%27 HTTP/1.1" 200 None
2026-03-30 11:38:21 [auto1.de] INFO: Scrape type for EG14085: 0
2026-03-30 11:38:21 [auto1.de] INFO: Found listing with ID: XP52765
2026-03-30 11:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP52765%27 HTTP/1.1" 200 None
2026-03-30 11:38:21 [auto1.de] INFO: Scrape type for XP52765: 0
2026-03-30 11:38:21 [auto1.de] INFO: Found listing with ID: NJ08644
2026-03-30 11:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ08644%27 HTTP/1.1" 200 None
2026-03-30 11:38:22 [auto1.de] INFO: Scrape type for NJ08644: 0
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: UM78498
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM78498%27 HTTP/1.1" 200 None
2026-03-30 11:38:22 [auto1.de] INFO: Scrape type for UM78498: 0
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: WM97258
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM97258%27 HTTP/1.1" 200 None
2026-03-30 11:38:22 [auto1.de] INFO: Scrape type for WM97258: 0
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: XR01056
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: GY83216
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: CM40362
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM40362%27 HTTP/1.1" 200 None
2026-03-30 11:38:22 [auto1.de] INFO: Scrape type for CM40362: 0
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: XY63966
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: GH14315
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: NM34350
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM34350%27 HTTP/1.1" 200 None
2026-03-30 11:38:22 [auto1.de] INFO: Scrape type for NM34350: 0
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR95104%27 HTTP/1.1" 200 None
2026-03-30 11:38:22 [auto1.de] INFO: Scrape type for RR95104: 0
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: MX66491
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: ZY67116
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ52783%27 HTTP/1.1" 200 None
2026-03-30 11:38:22 [auto1.de] INFO: Scrape type for CJ52783: 0
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: XG36075
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG36075%27 HTTP/1.1" 200 None
2026-03-30 11:38:22 [auto1.de] INFO: Scrape type for XG36075: 0
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: MJ16162
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: WY50003
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: MM33465
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: JK50656
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: ZE17013
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: YT60499
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT60499%27 HTTP/1.1" 200 None
2026-03-30 11:38:22 [auto1.de] INFO: Scrape type for YT60499: 0
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: VN69903
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: XS25100
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: YJ00075
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: DK81412
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81412%27 HTTP/1.1" 200 None
2026-03-30 11:38:22 [auto1.de] INFO: Scrape type for DK81412: 0
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: ZB59934
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: ZU85888
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU85888%27 HTTP/1.1" 200 None
2026-03-30 11:38:22 [auto1.de] INFO: Scrape type for ZU85888: 0
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: SK08799
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK08799%27 HTTP/1.1" 200 None
2026-03-30 11:38:22 [auto1.de] INFO: Scrape type for SK08799: 0
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: LN23623
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: MK32752
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK32752%27 HTTP/1.1" 200 None
2026-03-30 11:38:22 [auto1.de] INFO: Scrape type for MK32752: 0
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS74184%27 HTTP/1.1" 200 None
2026-03-30 11:38:22 [auto1.de] INFO: Scrape type for YS74184: 0
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: GT57416
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT57416%27 HTTP/1.1" 200 None
2026-03-30 11:38:22 [auto1.de] INFO: Scrape type for GT57416: 0
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: NE31655
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: VS20151
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS20151%27 HTTP/1.1" 200 None
2026-03-30 11:38:22 [auto1.de] INFO: Scrape type for VS20151: 0
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA97502%27 HTTP/1.1" 200 None
2026-03-30 11:38:22 [auto1.de] INFO: Scrape type for PA97502: 0
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: XJ97474
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: CM27166
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: DX01361
2026-03-30 11:38:22 [auto1.de] INFO: Found listing with ID: EW02544
2026-03-30 11:38:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:31 [auto1.de] INFO: Channel: 24h | Page: 206 | totalHits: 9789 | hits on page: 40
2026-03-30 11:38:31 [auto1.de] INFO: Found listing with ID: JR87294
2026-03-30 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR87294%27 HTTP/1.1" 200 None
2026-03-30 11:38:31 [auto1.de] INFO: Scrape type for JR87294: 0
2026-03-30 11:38:31 [auto1.de] INFO: Found listing with ID: JV68869
2026-03-30 11:38:31 [auto1.de] INFO: Found listing with ID: RX10948
2026-03-30 11:38:31 [auto1.de] INFO: Found listing with ID: XN65057
2026-03-30 11:38:31 [auto1.de] INFO: Found listing with ID: ST89847
2026-03-30 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST89847%27 HTTP/1.1" 200 None
2026-03-30 11:38:31 [auto1.de] INFO: Scrape type for ST89847: 0
2026-03-30 11:38:31 [auto1.de] INFO: Found listing with ID: XV15906
2026-03-30 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV15906%27 HTTP/1.1" 200 None
2026-03-30 11:38:31 [auto1.de] INFO: Scrape type for XV15906: 0
2026-03-30 11:38:31 [auto1.de] INFO: Found listing with ID: RB77182
2026-03-30 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB77182%27 HTTP/1.1" 200 None
2026-03-30 11:38:31 [auto1.de] INFO: Scrape type for RB77182: 0
2026-03-30 11:38:31 [auto1.de] INFO: Found listing with ID: FV46397
2026-03-30 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV46397%27 HTTP/1.1" 200 None
2026-03-30 11:38:31 [auto1.de] INFO: Scrape type for FV46397: 2
2026-03-30 11:38:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 328c70d1-6864-50cc-a61a-6c1db0f98b78 with identifier: FV46397
2026-03-30 11:38:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 328c70d1-6864-50cc-a61a-6c1db0f98b78 with scrape type 2
2026-03-30 11:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 328c70d1-6864-50cc-a61a-6c1db0f98b78 with scrape type 2
2026-03-30 11:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 328c70d1-6864-50cc-a61a-6c1db0f98b78, identifier: FV46397
2026-03-30 11:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 328c70d1-6864-50cc-a61a-6c1db0f98b78 with identifier: FV46397
2026-03-30 11:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 328c70d1-6864-50cc-a61a-6c1db0f98b78 with identifier: FV46397
2026-03-30 11:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 328c70d1-6864-50cc-a61a-6c1db0f98b78 with identifier: FV46397 to the API
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:39:41Z',
 'fuel_type': 'petrol',
 'id': '328c70d1-6864-50cc-a61a-6c1db0f98b78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV46397',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 99311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-30',
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2012}
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV46397%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [auto1.de] INFO: Saving data for FV46397: {'auction_closing_time': 1774885181.0, 'created_time': 1773137679.091028, 'last_price_update_time': 1774870712.43754}
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV46397') HTTP/1.1" 204 0
2026-03-30 11:38:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: ZL98433
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: LL60682
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL60682%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [auto1.de] INFO: Scrape type for LL60682: 0
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: YV35353
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: HA44433
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA44433%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [auto1.de] INFO: Scrape type for HA44433: 0
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: BX01003
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX01003%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [auto1.de] INFO: Scrape type for BX01003: 0
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: XS93446
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: PC35903
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: CC89371
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89371%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [auto1.de] INFO: Scrape type for CC89371: 0
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: KY06770
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: VR25014
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: AJ83009
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: GH20850
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: JZ38471
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: LK17231
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK17231%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [auto1.de] INFO: Scrape type for LK17231: 0
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: PB00515
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB00515%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [auto1.de] INFO: Scrape type for PB00515: 0
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: JR17394
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: LL09257
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09257%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [auto1.de] INFO: Scrape type for LL09257: 0
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: EX67189
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX67189%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [auto1.de] INFO: Scrape type for EX67189: 0
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: ML83071
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML83071%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [auto1.de] INFO: Scrape type for ML83071: 0
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: KS94316
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS94316%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [auto1.de] INFO: Scrape type for KS94316: 0
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: SC92751
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC92751%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [auto1.de] INFO: Scrape type for SC92751: 0
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: XS14457
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: TP96640
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP96640%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [auto1.de] INFO: Scrape type for TP96640: 0
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX44757%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [auto1.de] INFO: Scrape type for EX44757: 0
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: XR15758
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR15758%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [auto1.de] INFO: Scrape type for XR15758: 0
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: WA46177
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: ND29954
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: GW15546
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: CG07330
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG07330%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [auto1.de] INFO: Scrape type for CG07330: 0
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: YL63918
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL63918%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [auto1.de] INFO: Scrape type for YL63918: 0
2026-03-30 11:38:32 [auto1.de] INFO: Found listing with ID: US86443
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US86443%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [auto1.de] INFO: Scrape type for US86443: 0
2026-03-30 11:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:44 [auto1.de] INFO: Channel: 24h | Page: 207 | totalHits: 9790 | hits on page: 40
2026-03-30 11:38:44 [auto1.de] INFO: Found listing with ID: US86443
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US86443%27 HTTP/1.1" 200 None
2026-03-30 11:38:44 [auto1.de] INFO: Scrape type for US86443: 0
2026-03-30 11:38:44 [auto1.de] INFO: Found listing with ID: BX36135
2026-03-30 11:38:44 [auto1.de] INFO: Found listing with ID: MF63690
2026-03-30 11:38:44 [auto1.de] INFO: Found listing with ID: HV40211
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV40211%27 HTTP/1.1" 200 None
2026-03-30 11:38:44 [auto1.de] INFO: Scrape type for HV40211: 0
2026-03-30 11:38:44 [auto1.de] INFO: Found listing with ID: DP55195
2026-03-30 11:38:44 [auto1.de] INFO: Found listing with ID: DS08913
2026-03-30 11:38:44 [auto1.de] INFO: Found listing with ID: ZG52180
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG52180%27 HTTP/1.1" 200 None
2026-03-30 11:38:44 [auto1.de] INFO: Scrape type for ZG52180: 0
2026-03-30 11:38:44 [auto1.de] INFO: Found listing with ID: VS42918
2026-03-30 11:38:44 [auto1.de] INFO: Found listing with ID: JY24308
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY24308%27 HTTP/1.1" 200 None
2026-03-30 11:38:44 [auto1.de] INFO: Scrape type for JY24308: 0
2026-03-30 11:38:44 [auto1.de] INFO: Found listing with ID: DV65946
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV65946%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.de] INFO: Scrape type for DV65946: 0
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: RJ15430
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ15430%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.de] INFO: Scrape type for RJ15430: 0
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: FM97642
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: VJ26450
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ26450%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.de] INFO: Scrape type for VJ26450: 0
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: DN11419
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN11419%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.de] INFO: Scrape type for DN11419: 0
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: UL11229
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11229%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.de] INFO: Scrape type for UL11229: 0
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: ZP95286
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: UD91634
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD91634%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.de] INFO: Scrape type for UD91634: 0
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: WC38783
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC38783%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.de] INFO: Scrape type for WC38783: 0
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: HF93741
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF93741%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.de] INFO: Scrape type for HF93741: 0
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: KB62018
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62018%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.de] INFO: Scrape type for KB62018: 0
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: MF41479
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: KC37462
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: NA89904
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA89904%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.de] INFO: Scrape type for NA89904: 0
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: VN00313
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN00313%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.de] INFO: Scrape type for VN00313: 0
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: XD31530
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68555%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.de] INFO: Scrape type for AG68555: 0
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: GV24790
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV24790%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.de] INFO: Scrape type for GV24790: 0
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: UC48235
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC48235%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.de] INFO: Scrape type for UC48235: 0
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: VJ90236
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: JN13946
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN13946%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.de] INFO: Scrape type for JN13946: 0
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: PP43066
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: UE28952
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE28952%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.de] INFO: Scrape type for UE28952: 0
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: GA58010
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA58010%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.de] INFO: Scrape type for GA58010: 0
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: UT93934
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: GU48092
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: AE12757
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE12757%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.de] INFO: Scrape type for AE12757: 0
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: GZ31172
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: MS86460
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: PZ27483
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ27483%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.de] INFO: Scrape type for PZ27483: 0
2026-03-30 11:38:45 [auto1.de] INFO: Found listing with ID: GN70453
2026-03-30 11:38:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:46 [auto1.de] INFO: Channel: 24h | Page: 208 | totalHits: 9790 | hits on page: 40
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: DJ97721
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ97721%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.de] INFO: Scrape type for DJ97721: 0
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: KD53590
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: XD68871
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD68871%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.de] INFO: Scrape type for XD68871: 0
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: ZE72511
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE72511%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.de] INFO: Scrape type for ZE72511: 0
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: WE09551
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: WP84657
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: VE41412
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41412%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.de] INFO: Scrape type for VE41412: 0
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: UZ82929
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: FH31570
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH31570%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.de] INFO: Scrape type for FH31570: 0
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: VH71903
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: MP71410
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP71410%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.de] INFO: Scrape type for MP71410: 0
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: AU97195
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: LG36185
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: EU98670
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: VH64157
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: SV69616
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69616%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.de] INFO: Scrape type for SV69616: 0
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: ZH41953
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: GS82653
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: EN87643
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: EB81332
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB81332%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.de] INFO: Scrape type for EB81332: 0
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: DY27021
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: VB56822
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB56822%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.de] INFO: Scrape type for VB56822: 0
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: HM56533
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: DD20559
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD20559%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.de] INFO: Scrape type for DD20559: 0
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: LL85069
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: EG81564
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: SG31546
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG31546%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.de] INFO: Scrape type for SG31546: 0
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: HM11779
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM11779%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.de] INFO: Scrape type for HM11779: 0
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: CU93791
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU93791%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.de] INFO: Scrape type for CU93791: 0
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: RV94916
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: NZ68458
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ68458%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.de] INFO: Scrape type for NZ68458: 0
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: JZ63393
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: CU11315
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU11315%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.de] INFO: Scrape type for CU11315: 0
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: BS60844
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: XX23158
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: KW68536
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68536%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.de] INFO: Scrape type for KW68536: 0
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: GW98108
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: CD13649
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13649%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.de] INFO: Scrape type for CD13649: 0
2026-03-30 11:38:46 [auto1.de] INFO: Found listing with ID: XJ99289
2026-03-30 11:38:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:54 [auto1.de] INFO: Channel: 24h | Page: 209 | totalHits: 9790 | hits on page: 40
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: VP61348
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: BP82527
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP82527%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.de] INFO: Scrape type for BP82527: 0
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: CY66130
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: KH87635
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: FX32627
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32627%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.de] INFO: Scrape type for FX32627: 0
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: VM53714
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: NZ21452
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: FN51585
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: ER89217
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER89217%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.de] INFO: Scrape type for ER89217: 0
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: AE67956
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: XM89515
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM89515%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.de] INFO: Scrape type for XM89515: 0
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: PB15916
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: BX10295
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX10295%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.de] INFO: Scrape type for BX10295: 0
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: DA58180
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: KV56224
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV56224%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.de] INFO: Scrape type for KV56224: 0
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: SR34905
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: YM11561
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM11561%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.de] INFO: Scrape type for YM11561: 0
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: RR41525
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR41525%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.de] INFO: Scrape type for RR41525: 0
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: XR30933
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: XB63753
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63753%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.de] INFO: Scrape type for XB63753: 0
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: ZF73856
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: MK56565
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: BZ79041
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: ME72354
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: GS86907
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS86907%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.de] INFO: Scrape type for GS86907: 0
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY78817%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.de] INFO: Scrape type for VY78817: 0
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: FN01227
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: LK83365
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK83365%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.de] INFO: Scrape type for LK83365: 0
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: YS84502
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS84502%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.de] INFO: Scrape type for YS84502: 0
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: SS31762
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: VR01853
2026-03-30 11:38:54 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-30 11:38:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:04 [scrapy.extensions.logstats] INFO: Crawled 957 pages (at 9 pages/min), scraped 1373 items (at 2 items/min)
2026-03-30 11:39:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:40:04 [scrapy.extensions.logstats] INFO: Crawled 957 pages (at 0 pages/min), scraped 1373 items (at 0 items/min)
2026-03-30 11:40:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:41:04 [scrapy.extensions.logstats] INFO: Crawled 957 pages (at 0 pages/min), scraped 1373 items (at 0 items/min)
2026-03-30 11:41:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:41:05 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.766(s), this was the 1st time calling it.
2026-03-30 11:41:05 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.169054942813978 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:41:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:41:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:11 [auto1.de] INFO: Channel: 24h | Page: 210 | totalHits: 9809 | hits on page: 40
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: ZF73856
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: MK56565
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: BZ79041
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: ME72354
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: GS86907
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS86907%27 HTTP/1.1" 200 None
2026-03-30 11:41:11 [auto1.de] INFO: Scrape type for GS86907: 0
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY78817%27 HTTP/1.1" 200 None
2026-03-30 11:41:11 [auto1.de] INFO: Scrape type for VY78817: 0
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: FN01227
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: LK83365
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK83365%27 HTTP/1.1" 200 None
2026-03-30 11:41:11 [auto1.de] INFO: Scrape type for LK83365: 0
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: YS84502
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS84502%27 HTTP/1.1" 200 None
2026-03-30 11:41:11 [auto1.de] INFO: Scrape type for YS84502: 0
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: SS31762
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: VR01853
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM33145%27 HTTP/1.1" 200 None
2026-03-30 11:41:11 [auto1.de] INFO: Scrape type for CM33145: 0
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB90216%27 HTTP/1.1" 200 None
2026-03-30 11:41:11 [auto1.de] INFO: Scrape type for XB90216: 0
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: HH06694
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: GH08686
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: EV68047
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: GR02584
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: MT67219
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: CZ44674
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ44674%27 HTTP/1.1" 200 None
2026-03-30 11:41:11 [auto1.de] INFO: Scrape type for CZ44674: 0
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: HP53076
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP53076%27 HTTP/1.1" 200 None
2026-03-30 11:41:11 [auto1.de] INFO: Scrape type for HP53076: 0
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: NL93561
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: VV90195
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: NV40301
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV40301%27 HTTP/1.1" 200 None
2026-03-30 11:41:11 [auto1.de] INFO: Scrape type for NV40301: 0
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV99123%27 HTTP/1.1" 200 None
2026-03-30 11:41:11 [auto1.de] INFO: Scrape type for HV99123: 0
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: HK09580
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-30 11:41:11 [auto1.de] INFO: Found listing with ID: SG08680
2026-03-30 11:41:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:04 [scrapy.extensions.logstats] INFO: Crawled 958 pages (at 1 pages/min), scraped 1373 items (at 0 items/min)
2026-03-30 11:42:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:43:04 [scrapy.extensions.logstats] INFO: Crawled 958 pages (at 0 pages/min), scraped 1373 items (at 0 items/min)
2026-03-30 11:43:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:43:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.874(s), this was the 1st time calling it.
2026-03-30 11:43:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.167988186723477 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:43:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:43:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:43 [auto1.de] INFO: Channel: 24h | Page: 211 | totalHits: 9836 | hits on page: 40
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: YS84502
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS84502%27 HTTP/1.1" 200 None
2026-03-30 11:43:43 [auto1.de] INFO: Scrape type for YS84502: 0
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: SS31762
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: VR01853
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM33145%27 HTTP/1.1" 200 None
2026-03-30 11:43:43 [auto1.de] INFO: Scrape type for CM33145: 0
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB90216%27 HTTP/1.1" 200 None
2026-03-30 11:43:43 [auto1.de] INFO: Scrape type for XB90216: 0
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: HH06694
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: GH08686
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: EV68047
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: GR02584
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: MT67219
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: CZ44674
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ44674%27 HTTP/1.1" 200 None
2026-03-30 11:43:43 [auto1.de] INFO: Scrape type for CZ44674: 0
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: HP53076
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP53076%27 HTTP/1.1" 200 None
2026-03-30 11:43:43 [auto1.de] INFO: Scrape type for HP53076: 0
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: NL93561
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: VV90195
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: NV40301
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV40301%27 HTTP/1.1" 200 None
2026-03-30 11:43:43 [auto1.de] INFO: Scrape type for NV40301: 0
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV99123%27 HTTP/1.1" 200 None
2026-03-30 11:43:43 [auto1.de] INFO: Scrape type for HV99123: 0
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: HK09580
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: SG08680
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE10872%27 HTTP/1.1" 200 None
2026-03-30 11:43:43 [auto1.de] INFO: Scrape type for ZE10872: 0
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: XP92221
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: HG24809
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: TN09859
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN09859%27 HTTP/1.1" 200 None
2026-03-30 11:43:43 [auto1.de] INFO: Scrape type for TN09859: 0
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: BH21613
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: AB05978
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: GN37925
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: LL82276
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: AY38359
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY38359%27 HTTP/1.1" 200 None
2026-03-30 11:43:43 [auto1.de] INFO: Scrape type for AY38359: 0
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: ZF02079
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF02079%27 HTTP/1.1" 200 None
2026-03-30 11:43:43 [auto1.de] INFO: Scrape type for ZF02079: 0
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: BX27927
2026-03-30 11:43:43 [auto1.de] INFO: Found listing with ID: BX19940
2026-03-30 11:43:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:44:04 [scrapy.extensions.logstats] INFO: Crawled 959 pages (at 1 pages/min), scraped 1373 items (at 0 items/min)
2026-03-30 11:44:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:44:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:44:07 [auto1.de] INFO: Channel: 24h | Page: 212 | totalHits: 9842 | hits on page: 40
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: LL82276
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: AY38359
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY38359%27 HTTP/1.1" 200 None
2026-03-30 11:44:07 [auto1.de] INFO: Scrape type for AY38359: 0
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: ZF02079
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF02079%27 HTTP/1.1" 200 None
2026-03-30 11:44:07 [auto1.de] INFO: Scrape type for ZF02079: 0
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: BX27927
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: BX19940
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: FZ40219
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ40219%27 HTTP/1.1" 200 None
2026-03-30 11:44:07 [auto1.de] INFO: Scrape type for FZ40219: 0
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: WS31989
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: SG38319
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: AY73359
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY73359%27 HTTP/1.1" 200 None
2026-03-30 11:44:07 [auto1.de] INFO: Scrape type for AY73359: 0
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: MD58686
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: DZ84842
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: LR15690
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: SB81454
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: AR79819
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: FV65723
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: FW41048
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW41048%27 HTTP/1.1" 200 None
2026-03-30 11:44:07 [auto1.de] INFO: Scrape type for FW41048: 0
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: PR96123
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: JS15071
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS15071%27 HTTP/1.1" 200 None
2026-03-30 11:44:07 [auto1.de] INFO: Scrape type for JS15071: 0
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: CZ58938
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ58938%27 HTTP/1.1" 200 None
2026-03-30 11:44:07 [auto1.de] INFO: Scrape type for CZ58938: 0
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: KS57096
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: SN98432
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN98432%27 HTTP/1.1" 200 None
2026-03-30 11:44:07 [auto1.de] INFO: Scrape type for SN98432: 0
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: XT08525
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT08525%27 HTTP/1.1" 200 None
2026-03-30 11:44:07 [auto1.de] INFO: Scrape type for XT08525: 0
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: FL14438
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL14438%27 HTTP/1.1" 200 None
2026-03-30 11:44:07 [auto1.de] INFO: Scrape type for FL14438: 0
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: GE53934
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: MA47632
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA47632%27 HTTP/1.1" 200 None
2026-03-30 11:44:07 [auto1.de] INFO: Scrape type for MA47632: 0
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: GL59385
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL59385%27 HTTP/1.1" 200 None
2026-03-30 11:44:07 [auto1.de] INFO: Scrape type for GL59385: 0
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: MZ82429
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: UB05903
2026-03-30 11:44:07 [auto1.de] INFO: Found listing with ID: HX75388
2026-03-30 11:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX75388%27 HTTP/1.1" 200 None
2026-03-30 11:44:08 [auto1.de] INFO: Scrape type for HX75388: 0
2026-03-30 11:44:08 [auto1.de] INFO: Found listing with ID: LU16486
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU16486%27 HTTP/1.1" 200 None
2026-03-30 11:44:08 [auto1.de] INFO: Scrape type for LU16486: 0
2026-03-30 11:44:08 [auto1.de] INFO: Found listing with ID: AP13896
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP13896%27 HTTP/1.1" 200 None
2026-03-30 11:44:08 [auto1.de] INFO: Scrape type for AP13896: 0
2026-03-30 11:44:08 [auto1.de] INFO: Found listing with ID: AP92874
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP92874%27 HTTP/1.1" 200 None
2026-03-30 11:44:08 [auto1.de] INFO: Scrape type for AP92874: 0
2026-03-30 11:44:08 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05570%27 HTTP/1.1" 200 None
2026-03-30 11:44:08 [auto1.de] INFO: Scrape type for AB05570: 0
2026-03-30 11:44:08 [auto1.de] INFO: Found listing with ID: GX10720
2026-03-30 11:44:08 [auto1.de] INFO: Found listing with ID: KA14077
2026-03-30 11:44:08 [auto1.de] INFO: Found listing with ID: XP03484
2026-03-30 11:44:08 [auto1.de] INFO: Found listing with ID: CL18387
2026-03-30 11:44:08 [auto1.de] INFO: Found listing with ID: KJ75418
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ75418%27 HTTP/1.1" 200 None
2026-03-30 11:44:08 [auto1.de] INFO: Scrape type for KJ75418: 0
2026-03-30 11:44:08 [auto1.de] INFO: Found listing with ID: PN41265
2026-03-30 11:44:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:44:16 [auto1.de] INFO: Channel: 24h | Page: 213 | totalHits: 9843 | hits on page: 40
2026-03-30 11:44:16 [auto1.de] INFO: Found listing with ID: PN41265
2026-03-30 11:44:16 [auto1.de] INFO: Found listing with ID: TV60687
2026-03-30 11:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV60687%27 HTTP/1.1" 200 None
2026-03-30 11:44:16 [auto1.de] INFO: Scrape type for TV60687: 0
2026-03-30 11:44:16 [auto1.de] INFO: Found listing with ID: EP39271
2026-03-30 11:44:16 [auto1.de] INFO: Found listing with ID: WD47381
2026-03-30 11:44:16 [auto1.de] INFO: Found listing with ID: PT15230
2026-03-30 11:44:16 [auto1.de] INFO: Found listing with ID: KE73798
2026-03-30 11:44:16 [auto1.de] INFO: Found listing with ID: RH12349
2026-03-30 11:44:16 [auto1.de] INFO: Found listing with ID: CA50565
2026-03-30 11:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA50565%27 HTTP/1.1" 200 None
2026-03-30 11:44:16 [auto1.de] INFO: Scrape type for CA50565: 0
2026-03-30 11:44:16 [auto1.de] INFO: Found listing with ID: PR23658
2026-03-30 11:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23658%27 HTTP/1.1" 200 None
2026-03-30 11:44:16 [auto1.de] INFO: Scrape type for PR23658: 0
2026-03-30 11:44:16 [auto1.de] INFO: Found listing with ID: SX40224
2026-03-30 11:44:16 [auto1.de] INFO: Found listing with ID: SK86846
2026-03-30 11:44:16 [auto1.de] INFO: Found listing with ID: XN42361
2026-03-30 11:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN42361%27 HTTP/1.1" 200 None
2026-03-30 11:44:16 [auto1.de] INFO: Scrape type for XN42361: 0
2026-03-30 11:44:16 [auto1.de] INFO: Found listing with ID: GE73392
2026-03-30 11:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE73392%27 HTTP/1.1" 200 None
2026-03-30 11:44:16 [auto1.de] INFO: Scrape type for GE73392: 0
2026-03-30 11:44:16 [auto1.de] INFO: Found listing with ID: LX68947
2026-03-30 11:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX68947%27 HTTP/1.1" 200 None
2026-03-30 11:44:16 [auto1.de] INFO: Scrape type for LX68947: 0
2026-03-30 11:44:16 [auto1.de] INFO: Found listing with ID: PF90530
2026-03-30 11:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF90530%27 HTTP/1.1" 200 None
2026-03-30 11:44:17 [auto1.de] INFO: Scrape type for PF90530: 0
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: XB16241
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: VN58705
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: JY30583
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: ZW26780
2026-03-30 11:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW26780%27 HTTP/1.1" 200 None
2026-03-30 11:44:17 [auto1.de] INFO: Scrape type for ZW26780: 0
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: DC45431
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: FS06029
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: VX06464
2026-03-30 11:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06464%27 HTTP/1.1" 200 None
2026-03-30 11:44:17 [auto1.de] INFO: Scrape type for VX06464: 0
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: WL45042
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: TE62268
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: DV26733
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: JA93486
2026-03-30 11:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA93486%27 HTTP/1.1" 200 None
2026-03-30 11:44:17 [auto1.de] INFO: Scrape type for JA93486: 0
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: DB69488
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: UC09176
2026-03-30 11:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC09176%27 HTTP/1.1" 200 None
2026-03-30 11:44:17 [auto1.de] INFO: Scrape type for UC09176: 0
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: WJ52581
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: GJ53227
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: MH48828
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: VY02082
2026-03-30 11:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY02082%27 HTTP/1.1" 200 None
2026-03-30 11:44:17 [auto1.de] INFO: Scrape type for VY02082: 0
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: HR12459
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: MU28825
2026-03-30 11:44:17 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-30 11:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE09566%27 HTTP/1.1" 200 None
2026-03-30 11:44:17 [auto1.de] INFO: Scrape type for DE09566: 0
2026-03-30 11:44:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:45:04 [scrapy.extensions.logstats] INFO: Crawled 961 pages (at 2 pages/min), scraped 1373 items (at 0 items/min)
2026-03-30 11:45:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:45:24 [auto1.de] INFO: Channel: 24h | Page: 214 | totalHits: 9861 | hits on page: 40
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: WL45042
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: TE62268
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: DV26733
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: JA93486
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA93486%27 HTTP/1.1" 200 None
2026-03-30 11:45:24 [auto1.de] INFO: Scrape type for JA93486: 0
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: DB69488
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: UC09176
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC09176%27 HTTP/1.1" 200 None
2026-03-30 11:45:24 [auto1.de] INFO: Scrape type for UC09176: 0
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: WJ52581
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: GJ53227
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: MH48828
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: VY02082
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY02082%27 HTTP/1.1" 200 None
2026-03-30 11:45:24 [auto1.de] INFO: Scrape type for VY02082: 0
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: HR12459
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: MU28825
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE09566%27 HTTP/1.1" 200 None
2026-03-30 11:45:24 [auto1.de] INFO: Scrape type for DE09566: 0
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: PH00058
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: KU48054
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: HD78649
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD78649%27 HTTP/1.1" 200 None
2026-03-30 11:45:24 [auto1.de] INFO: Scrape type for HD78649: 0
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: UG82717
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG82717%27 HTTP/1.1" 200 None
2026-03-30 11:45:24 [auto1.de] INFO: Scrape type for UG82717: 0
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: KA69017
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA69017%27 HTTP/1.1" 200 None
2026-03-30 11:45:24 [auto1.de] INFO: Scrape type for KA69017: 0
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: KR60146
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR60146%27 HTTP/1.1" 200 None
2026-03-30 11:45:24 [auto1.de] INFO: Scrape type for KR60146: 0
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: JH22526
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH22526%27 HTTP/1.1" 200 None
2026-03-30 11:45:24 [auto1.de] INFO: Scrape type for JH22526: 0
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: VW78119
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: WC14239
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: DG34410
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: UP16968
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: AT56964
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT56964%27 HTTP/1.1" 200 None
2026-03-30 11:45:24 [auto1.de] INFO: Scrape type for AT56964: 0
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: UG36008
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG36008%27 HTTP/1.1" 200 None
2026-03-30 11:45:24 [auto1.de] INFO: Scrape type for UG36008: 0
2026-03-30 11:45:24 [auto1.de] INFO: Found listing with ID: TM50766
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM50766%27 HTTP/1.1" 200 None
2026-03-30 11:45:25 [auto1.de] INFO: Scrape type for TM50766: 0
2026-03-30 11:45:25 [auto1.de] INFO: Found listing with ID: XH60803
2026-03-30 11:45:25 [auto1.de] INFO: Found listing with ID: YH55403
2026-03-30 11:45:25 [auto1.de] INFO: Found listing with ID: ED54075
2026-03-30 11:45:25 [auto1.de] INFO: Found listing with ID: XB63697
2026-03-30 11:45:25 [auto1.de] INFO: Found listing with ID: TG50792
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG50792%27 HTTP/1.1" 200 None
2026-03-30 11:45:25 [auto1.de] INFO: Scrape type for TG50792: 0
2026-03-30 11:45:25 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN67479%27 HTTP/1.1" 200 None
2026-03-30 11:45:25 [auto1.de] INFO: Scrape type for CN67479: 0
2026-03-30 11:45:25 [auto1.de] INFO: Found listing with ID: KV45181
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV45181%27 HTTP/1.1" 200 None
2026-03-30 11:45:25 [auto1.de] INFO: Scrape type for KV45181: 0
2026-03-30 11:45:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:45:28 [auto1.de] INFO: Channel: 24h | Page: 215 | totalHits: 9865 | hits on page: 40
2026-03-30 11:45:28 [auto1.de] INFO: Found listing with ID: XB63697
2026-03-30 11:45:28 [auto1.de] INFO: Found listing with ID: TG50792
2026-03-30 11:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG50792%27 HTTP/1.1" 200 None
2026-03-30 11:45:28 [auto1.de] INFO: Scrape type for TG50792: 0
2026-03-30 11:45:28 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-30 11:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN67479%27 HTTP/1.1" 200 None
2026-03-30 11:45:28 [auto1.de] INFO: Scrape type for CN67479: 0
2026-03-30 11:45:28 [auto1.de] INFO: Found listing with ID: KV45181
2026-03-30 11:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV45181%27 HTTP/1.1" 200 None
2026-03-30 11:45:28 [auto1.de] INFO: Scrape type for KV45181: 0
2026-03-30 11:45:28 [auto1.de] INFO: Found listing with ID: LG62730
2026-03-30 11:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG62730%27 HTTP/1.1" 200 None
2026-03-30 11:45:28 [auto1.de] INFO: Scrape type for LG62730: 0
2026-03-30 11:45:28 [auto1.de] INFO: Found listing with ID: TK47054
2026-03-30 11:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK47054%27 HTTP/1.1" 200 None
2026-03-30 11:45:28 [auto1.de] INFO: Scrape type for TK47054: 0
2026-03-30 11:45:28 [auto1.de] INFO: Found listing with ID: XS50717
2026-03-30 11:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50717%27 HTTP/1.1" 200 None
2026-03-30 11:45:28 [auto1.de] INFO: Scrape type for XS50717: 0
2026-03-30 11:45:28 [auto1.de] INFO: Found listing with ID: LM30127
2026-03-30 11:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM30127%27 HTTP/1.1" 200 None
2026-03-30 11:45:29 [auto1.de] INFO: Scrape type for LM30127: 0
2026-03-30 11:45:29 [auto1.de] INFO: Found listing with ID: PE74408
2026-03-30 11:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE74408%27 HTTP/1.1" 200 None
2026-03-30 11:45:29 [auto1.de] INFO: Scrape type for PE74408: 0
2026-03-30 11:45:29 [auto1.de] INFO: Found listing with ID: AA34634
2026-03-30 11:45:29 [auto1.de] INFO: Found listing with ID: TR13972
2026-03-30 11:45:29 [auto1.de] INFO: Found listing with ID: TB72166
2026-03-30 11:45:29 [auto1.de] INFO: Found listing with ID: VX15000
2026-03-30 11:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX15000%27 HTTP/1.1" 200 None
2026-03-30 11:45:29 [auto1.de] INFO: Scrape type for VX15000: 0
2026-03-30 11:45:29 [auto1.de] INFO: Found listing with ID: RW09760
2026-03-30 11:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW09760%27 HTTP/1.1" 200 None
2026-03-30 11:45:29 [auto1.de] INFO: Scrape type for RW09760: 2
2026-03-30 11:45:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b84e8fa5-03a4-5a74-9875-2ecdf36d688c with identifier: RW09760
2026-03-30 11:45:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b84e8fa5-03a4-5a74-9875-2ecdf36d688c with scrape type 2
2026-03-30 11:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b84e8fa5-03a4-5a74-9875-2ecdf36d688c with scrape type 2
2026-03-30 11:45:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b84e8fa5-03a4-5a74-9875-2ecdf36d688c, identifier: RW09760
2026-03-30 11:45:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b84e8fa5-03a4-5a74-9875-2ecdf36d688c with identifier: RW09760
2026-03-30 11:45:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b84e8fa5-03a4-5a74-9875-2ecdf36d688c with identifier: RW09760
2026-03-30 11:45:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b84e8fa5-03a4-5a74-9875-2ecdf36d688c with identifier: RW09760 to the API
2026-03-30 11:45:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:45:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 114,
 'expiration_date': '2026-03-30T15:57:51Z',
 'fuel_type': 'petrol',
 'id': 'b84e8fa5-03a4-5a74-9875-2ecdf36d688c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW09760',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 46229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-08',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.5 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW09760%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Saving data for RW09760: {'auction_closing_time': 1774886271.0, 'created_time': 1774510235.452364, 'last_price_update_time': 1774871130.105892}
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW09760') HTTP/1.1" 204 0
2026-03-30 11:45:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: AH76263
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: GK82878
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: JE63209
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: XF69711
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: FW17566
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: BU80975
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: WK73067
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73067%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for WK73067: 0
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: BB37977
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: LG14715
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: CC75051
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC75051%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for CC75051: 0
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: DP00162
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: BF92726
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: MK34658
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: XR27730
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: YV93929
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: YZ02891
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: TR29242
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR29242%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for TR29242: 0
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: BN99160
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN99160%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for BN99160: 0
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: ZK28238
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK28238%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for ZK28238: 0
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: EH74831
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH74831%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for EH74831: 0
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: XE05980
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE05980%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for XE05980: 0
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: KY14800
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: NM28513
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM28513%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for NM28513: 0
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB05774%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for NB05774: 0
2026-03-30 11:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:45:31 [auto1.de] INFO: Channel: 24h | Page: 216 | totalHits: 9866 | hits on page: 40
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB05774%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for NB05774: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: XL60244
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: ND58698
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND58698%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for ND58698: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: LV90463
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: TE33138
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: XB85812
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: FZ45055
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: YM60509
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60509%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for YM60509: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: SX16558
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: HA69467
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA69467%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for HA69467: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: EA13561
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13561%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for EA13561: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: XK59182
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK59182%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for XK59182: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: GT00768
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT00768%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for GT00768: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: AZ50044
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: UL30875
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL30875%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for UL30875: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: DX61886
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX61886%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for DX61886: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: SG91001
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG91001%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for SG91001: 2
2026-03-30 11:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4982cc3c-2250-5b45-942a-009b56c67ceb with identifier: SG91001
2026-03-30 11:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4982cc3c-2250-5b45-942a-009b56c67ceb with scrape type 2
2026-03-30 11:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4982cc3c-2250-5b45-942a-009b56c67ceb with scrape type 2
2026-03-30 11:45:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4982cc3c-2250-5b45-942a-009b56c67ceb, identifier: SG91001
2026-03-30 11:45:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4982cc3c-2250-5b45-942a-009b56c67ceb with identifier: SG91001
2026-03-30 11:45:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4982cc3c-2250-5b45-942a-009b56c67ceb with identifier: SG91001
2026-03-30 11:45:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4982cc3c-2250-5b45-942a-009b56c67ceb with identifier: SG91001 to the API
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:45:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:29:10Z',
 'fuel_type': 'petrol',
 'id': '4982cc3c-2250-5b45-942a-009b56c67ceb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG91001',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 173645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-18',
 'seller_name': None,
 'title': 'Renault Megane 1.4 TCe BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2013}
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG91001%27 HTTP/1.1" 200 None
2026-03-30 11:45:32 [auto1.de] INFO: Saving data for SG91001: {'auction_closing_time': 1774884550.0, 'created_time': 1774348903.964932, 'last_price_update_time': 1774871132.062505}
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG91001') HTTP/1.1" 204 0
2026-03-30 11:45:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: CF91602
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: MR38870
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR38870%27 HTTP/1.1" 200 None
2026-03-30 11:45:32 [auto1.de] INFO: Scrape type for MR38870: 0
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: CS24568
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: ZN01973
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN01973%27 HTTP/1.1" 200 None
2026-03-30 11:45:32 [auto1.de] INFO: Scrape type for ZN01973: 0
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: YS21206
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS21206%27 HTTP/1.1" 200 None
2026-03-30 11:45:32 [auto1.de] INFO: Scrape type for YS21206: 0
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: YY92615
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: LD79531
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD79531%27 HTTP/1.1" 200 None
2026-03-30 11:45:32 [auto1.de] INFO: Scrape type for LD79531: 0
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: NW97614
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: YT11339
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: VY67119
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67119%27 HTTP/1.1" 200 None
2026-03-30 11:45:32 [auto1.de] INFO: Scrape type for VY67119: 0
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: ML67017
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: UX52309
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX52309%27 HTTP/1.1" 200 None
2026-03-30 11:45:32 [auto1.de] INFO: Scrape type for UX52309: 0
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: SS86318
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: PT52067
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT52067%27 HTTP/1.1" 200 None
2026-03-30 11:45:32 [auto1.de] INFO: Scrape type for PT52067: 0
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: PB28144
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: MH24339
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH24339%27 HTTP/1.1" 200 None
2026-03-30 11:45:32 [auto1.de] INFO: Scrape type for MH24339: 0
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: LS92843
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: LD63966
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63966%27 HTTP/1.1" 200 None
2026-03-30 11:45:32 [auto1.de] INFO: Scrape type for LD63966: 2
2026-03-30 11:45:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb8396d4-9655-572c-8e63-09596ed21c7d with identifier: LD63966
2026-03-30 11:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb8396d4-9655-572c-8e63-09596ed21c7d with scrape type 2
2026-03-30 11:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb8396d4-9655-572c-8e63-09596ed21c7d with scrape type 2
2026-03-30 11:45:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb8396d4-9655-572c-8e63-09596ed21c7d, identifier: LD63966
2026-03-30 11:45:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb8396d4-9655-572c-8e63-09596ed21c7d with identifier: LD63966
2026-03-30 11:45:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb8396d4-9655-572c-8e63-09596ed21c7d with identifier: LD63966
2026-03-30 11:45:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb8396d4-9655-572c-8e63-09596ed21c7d with identifier: LD63966 to the API
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:45:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:10:25Z',
 'fuel_type': 'petrol',
 'id': 'cb8396d4-9655-572c-8e63-09596ed21c7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD63966',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 68954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-19',
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2018}
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63966%27 HTTP/1.1" 200 None
2026-03-30 11:45:32 [auto1.de] INFO: Saving data for LD63966: {'auction_closing_time': 1774883425.0, 'created_time': 1774596636.321414, 'last_price_update_time': 1774871132.731452}
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD63966') HTTP/1.1" 204 0
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: XS74936
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS74936%27 HTTP/1.1" 200 None
2026-03-30 11:45:32 [auto1.de] INFO: Scrape type for XS74936: 0
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: RG95107
2026-03-30 11:45:32 [auto1.de] INFO: Found listing with ID: AD21201
2026-03-30 11:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:45:51 [auto1.de] INFO: Channel: 24h | Page: 217 | totalHits: 9869 | hits on page: 40
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: XS74936
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS74936%27 HTTP/1.1" 200 None
2026-03-30 11:45:51 [auto1.de] INFO: Scrape type for XS74936: 0
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: RG95107
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: AD21201
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: PX71275
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX71275%27 HTTP/1.1" 200 None
2026-03-30 11:45:51 [auto1.de] INFO: Scrape type for PX71275: 0
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: SV60739
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: FH60355
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: ZD67638
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: UB59521
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: RZ07739
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: EC44311
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC44311%27 HTTP/1.1" 200 None
2026-03-30 11:45:51 [auto1.de] INFO: Scrape type for EC44311: 0
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: TV17454
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV17454%27 HTTP/1.1" 200 None
2026-03-30 11:45:51 [auto1.de] INFO: Scrape type for TV17454: 0
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: GT58505
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: EL23730
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: BD92511
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: TX33214
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: CJ94447
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: BP44038
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP44038%27 HTTP/1.1" 200 None
2026-03-30 11:45:51 [auto1.de] INFO: Scrape type for BP44038: 0
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: LG11243
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG11243%27 HTTP/1.1" 200 None
2026-03-30 11:45:51 [auto1.de] INFO: Scrape type for LG11243: 0
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: KW65379
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED19748%27 HTTP/1.1" 200 None
2026-03-30 11:45:51 [auto1.de] INFO: Scrape type for ED19748: 0
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49272%27 HTTP/1.1" 200 None
2026-03-30 11:45:51 [auto1.de] INFO: Scrape type for AB49272: 0
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: EE25450
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: KU38253
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: NG37948
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG37948%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for NG37948: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: GJ71101
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71101%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for GJ71101: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: UC35648
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: UA95146
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA95146%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for UA95146: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: GG27070
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG27070%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for GG27070: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS33010%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for GS33010: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: GW03247
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: RC84625
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC84625%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for RC84625: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: WP81367
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP81367%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for WP81367: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB99961%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for PB99961: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: VF40931
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF40931%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for VF40931: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: TN24608
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: HD35365
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD35365%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for HD35365: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS86742%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for VS86742: 0
2026-03-30 11:45:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:04 [scrapy.extensions.logstats] INFO: Crawled 965 pages (at 4 pages/min), scraped 1376 items (at 3 items/min)
2026-03-30 11:46:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:29 [auto1.de] INFO: Channel: 24h | Page: 218 | totalHits: 9870 | hits on page: 40
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS86742%27 HTTP/1.1" 200 None
2026-03-30 11:46:29 [auto1.de] INFO: Scrape type for VS86742: 0
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: TB14981
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: CU13937
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU13937%27 HTTP/1.1" 200 None
2026-03-30 11:46:29 [auto1.de] INFO: Scrape type for CU13937: 0
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: ER30285
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: HS66521
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS66521%27 HTTP/1.1" 200 None
2026-03-30 11:46:29 [auto1.de] INFO: Scrape type for HS66521: 0
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: GC05156
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC05156%27 HTTP/1.1" 200 None
2026-03-30 11:46:29 [auto1.de] INFO: Scrape type for GC05156: 0
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: YT67181
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT67181%27 HTTP/1.1" 200 None
2026-03-30 11:46:29 [auto1.de] INFO: Scrape type for YT67181: 0
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: MJ96775
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: KS41473
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC36574%27 HTTP/1.1" 200 None
2026-03-30 11:46:29 [auto1.de] INFO: Scrape type for WC36574: 0
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: GL30880
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL30880%27 HTTP/1.1" 200 None
2026-03-30 11:46:29 [auto1.de] INFO: Scrape type for GL30880: 0
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: LB77280
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU26229%27 HTTP/1.1" 200 None
2026-03-30 11:46:29 [auto1.de] INFO: Scrape type for PU26229: 0
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: SR33990
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR33990%27 HTTP/1.1" 200 None
2026-03-30 11:46:29 [auto1.de] INFO: Scrape type for SR33990: 0
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: ZF63164
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF63164%27 HTTP/1.1" 200 None
2026-03-30 11:46:29 [auto1.de] INFO: Scrape type for ZF63164: 0
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: ET23804
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: GM00936
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM00936%27 HTTP/1.1" 200 None
2026-03-30 11:46:29 [auto1.de] INFO: Scrape type for GM00936: 0
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: NX83651
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: MA09266
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA09266%27 HTTP/1.1" 200 None
2026-03-30 11:46:29 [auto1.de] INFO: Scrape type for MA09266: 0
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: FZ16195
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: RW93776
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW93776%27 HTTP/1.1" 200 None
2026-03-30 11:46:29 [auto1.de] INFO: Scrape type for RW93776: 0
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: NF13899
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF13899%27 HTTP/1.1" 200 None
2026-03-30 11:46:29 [auto1.de] INFO: Scrape type for NF13899: 0
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD88360%27 HTTP/1.1" 200 None
2026-03-30 11:46:29 [auto1.de] INFO: Scrape type for SD88360: 0
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: SS79198
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: EK21596
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK21596%27 HTTP/1.1" 200 None
2026-03-30 11:46:29 [auto1.de] INFO: Scrape type for EK21596: 0
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: TL42173
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL42173%27 HTTP/1.1" 200 None
2026-03-30 11:46:29 [auto1.de] INFO: Scrape type for TL42173: 0
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: EC36203
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36203%27 HTTP/1.1" 200 None
2026-03-30 11:46:29 [auto1.de] INFO: Scrape type for EC36203: 0
2026-03-30 11:46:29 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU13127%27 HTTP/1.1" 200 None
2026-03-30 11:46:29 [auto1.de] INFO: Scrape type for PU13127: 2
2026-03-30 11:46:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 486f9803-6151-5685-92af-9b5451c918dd with identifier: PU13127
2026-03-30 11:46:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 486f9803-6151-5685-92af-9b5451c918dd with scrape type 2
2026-03-30 11:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 486f9803-6151-5685-92af-9b5451c918dd with scrape type 2
2026-03-30 11:46:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 486f9803-6151-5685-92af-9b5451c918dd, identifier: PU13127
2026-03-30 11:46:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 486f9803-6151-5685-92af-9b5451c918dd with identifier: PU13127
2026-03-30 11:46:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 486f9803-6151-5685-92af-9b5451c918dd with identifier: PU13127
2026-03-30 11:46:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 486f9803-6151-5685-92af-9b5451c918dd with identifier: PU13127 to the API
2026-03-30 11:46:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:02:11Z',
 'fuel_type': 'diesel',
 'id': '486f9803-6151-5685-92af-9b5451c918dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU13127',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 220872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-11',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-30 11:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU13127%27 HTTP/1.1" 200 None
2026-03-30 11:46:30 [auto1.de] INFO: Saving data for PU13127: {'auction_closing_time': 1774882931.0, 'created_time': 1774349526.69582, 'last_price_update_time': 1774871190.341622}
2026-03-30 11:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU13127') HTTP/1.1" 204 0
2026-03-30 11:46:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:30 [auto1.de] INFO: Found listing with ID: WK96887
2026-03-30 11:46:30 [auto1.de] INFO: Found listing with ID: NP30819
2026-03-30 11:46:30 [auto1.de] INFO: Found listing with ID: XX31179
2026-03-30 11:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX31179%27 HTTP/1.1" 200 None
2026-03-30 11:46:30 [auto1.de] INFO: Scrape type for XX31179: 0
2026-03-30 11:46:30 [auto1.de] INFO: Found listing with ID: DF28851
2026-03-30 11:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF28851%27 HTTP/1.1" 200 None
2026-03-30 11:46:30 [auto1.de] INFO: Scrape type for DF28851: 0
2026-03-30 11:46:30 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-30 11:46:30 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-30 11:46:30 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-30 11:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU75285%27 HTTP/1.1" 200 None
2026-03-30 11:46:30 [auto1.de] INFO: Scrape type for LU75285: 0
2026-03-30 11:46:30 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-30 11:46:30 [auto1.de] INFO: Found listing with ID: UT28734
2026-03-30 11:46:30 [auto1.de] INFO: Found listing with ID: UC83378
2026-03-30 11:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC83378%27 HTTP/1.1" 200 None
2026-03-30 11:46:30 [auto1.de] INFO: Scrape type for UC83378: 0
2026-03-30 11:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:38 [auto1.de] INFO: Channel: 24h | Page: 219 | totalHits: 9871 | hits on page: 40
2026-03-30 11:46:38 [auto1.de] INFO: Found listing with ID: UC83378
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC83378%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [auto1.de] INFO: Scrape type for UC83378: 0
2026-03-30 11:46:38 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW22662%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [auto1.de] INFO: Scrape type for MW22662: 0
2026-03-30 11:46:38 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-30 11:46:38 [auto1.de] INFO: Found listing with ID: ZA74026
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74026%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [auto1.de] INFO: Scrape type for ZA74026: 0
2026-03-30 11:46:38 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF68220%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [auto1.de] INFO: Scrape type for CF68220: 0
2026-03-30 11:46:38 [auto1.de] INFO: Found listing with ID: XV47877
2026-03-30 11:46:38 [auto1.de] INFO: Found listing with ID: KH38301
2026-03-30 11:46:38 [auto1.de] INFO: Found listing with ID: EC58383
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC58383%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [auto1.de] INFO: Scrape type for EC58383: 0
2026-03-30 11:46:38 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-30 11:46:38 [auto1.de] INFO: Found listing with ID: XF17671
2026-03-30 11:46:38 [auto1.de] INFO: Found listing with ID: GC30737
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30737%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [auto1.de] INFO: Scrape type for GC30737: 0
2026-03-30 11:46:38 [auto1.de] INFO: Found listing with ID: GB76211
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB76211%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [auto1.de] INFO: Scrape type for GB76211: 0
2026-03-30 11:46:38 [auto1.de] INFO: Found listing with ID: SP00408
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP00408%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [auto1.de] INFO: Scrape type for SP00408: 0
2026-03-30 11:46:38 [auto1.de] INFO: Found listing with ID: BD21444
2026-03-30 11:46:38 [auto1.de] INFO: Found listing with ID: NB45839
2026-03-30 11:46:38 [auto1.de] INFO: Found listing with ID: VE08810
2026-03-30 11:46:38 [auto1.de] INFO: Found listing with ID: HL77146
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77146%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.de] INFO: Scrape type for HL77146: 0
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: XW71594
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: WH58707
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: DP78752
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: PZ33404
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: ST45837
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST45837%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.de] INFO: Scrape type for ST45837: 0
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: XR58128
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR58128%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.de] INFO: Scrape type for XR58128: 0
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: TM06695
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM06695%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.de] INFO: Scrape type for TM06695: 0
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: VT41344
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: JU26227
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU26227%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.de] INFO: Scrape type for JU26227: 0
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: FH98757
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: MK98498
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: NZ17394
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ17394%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.de] INFO: Scrape type for NZ17394: 0
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: MU44330
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU44330%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.de] INFO: Scrape type for MU44330: 0
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: GV67460
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV67460%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.de] INFO: Scrape type for GV67460: 0
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: CV09356
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA68492%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.de] INFO: Scrape type for YA68492: 0
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: GH92253
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH92253%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.de] INFO: Scrape type for GH92253: 0
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: AC92366
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: VT94173
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT94173%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.de] INFO: Scrape type for VT94173: 0
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: MY90175
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY90175%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.de] INFO: Scrape type for MY90175: 0
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: NH48980
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH48980%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.de] INFO: Scrape type for NH48980: 0
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: PW96816
2026-03-30 11:46:39 [auto1.de] INFO: Found listing with ID: UZ14919
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ14919%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.de] INFO: Scrape type for UZ14919: 0
2026-03-30 11:46:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:51 [auto1.de] INFO: Channel: 24h | Page: 220 | totalHits: 9871 | hits on page: 40
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: JU61936
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: KC56991
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC56991%27 HTTP/1.1" 200 None
2026-03-30 11:46:51 [auto1.de] INFO: Scrape type for KC56991: 0
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: FY38947
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: MU41228
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: NG13141
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: SP37211
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP37211%27 HTTP/1.1" 200 None
2026-03-30 11:46:51 [auto1.de] INFO: Scrape type for SP37211: 0
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: BP15722
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: ZJ20785
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20785%27 HTTP/1.1" 200 None
2026-03-30 11:46:51 [auto1.de] INFO: Scrape type for ZJ20785: 0
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: PG70940
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: HJ15324
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ15324%27 HTTP/1.1" 200 None
2026-03-30 11:46:51 [auto1.de] INFO: Scrape type for HJ15324: 0
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: YJ96267
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: BH45975
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: JS30878
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: NL79635
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL79635%27 HTTP/1.1" 200 None
2026-03-30 11:46:51 [auto1.de] INFO: Scrape type for NL79635: 0
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: LF10236
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: DP76469
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP76469%27 HTTP/1.1" 200 None
2026-03-30 11:46:51 [auto1.de] INFO: Scrape type for DP76469: 0
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: ST53597
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: AD05986
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: LU20114
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU20114%27 HTTP/1.1" 200 None
2026-03-30 11:46:51 [auto1.de] INFO: Scrape type for LU20114: 0
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: WT09019
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: MA38279
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA38279%27 HTTP/1.1" 200 None
2026-03-30 11:46:51 [auto1.de] INFO: Scrape type for MA38279: 0
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: PZ30496
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ30496%27 HTTP/1.1" 200 None
2026-03-30 11:46:51 [auto1.de] INFO: Scrape type for PZ30496: 0
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: CH12661
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH12661%27 HTTP/1.1" 200 None
2026-03-30 11:46:51 [auto1.de] INFO: Scrape type for CH12661: 0
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: HC35889
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC35889%27 HTTP/1.1" 200 None
2026-03-30 11:46:51 [auto1.de] INFO: Scrape type for HC35889: 0
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: AX97123
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: ZM69821
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM69821%27 HTTP/1.1" 200 None
2026-03-30 11:46:51 [auto1.de] INFO: Scrape type for ZM69821: 0
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: ZW92608
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: KF80964
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF80964%27 HTTP/1.1" 200 None
2026-03-30 11:46:51 [auto1.de] INFO: Scrape type for KF80964: 0
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: CE00984
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: KR40526
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR40526%27 HTTP/1.1" 200 None
2026-03-30 11:46:51 [auto1.de] INFO: Scrape type for KR40526: 0
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: NS83554
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS83554%27 HTTP/1.1" 200 None
2026-03-30 11:46:51 [auto1.de] INFO: Scrape type for NS83554: 0
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: UV09635
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV09635%27 HTTP/1.1" 200 None
2026-03-30 11:46:51 [auto1.de] INFO: Scrape type for UV09635: 0
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: CS70589
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: MK47455
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: ND12794
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: TW63260
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: SE34706
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: LR83897
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR83897%27 HTTP/1.1" 200 None
2026-03-30 11:46:51 [auto1.de] INFO: Scrape type for LR83897: 0
2026-03-30 11:46:51 [auto1.de] INFO: Found listing with ID: EX09851
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX09851%27 HTTP/1.1" 200 None
2026-03-30 11:46:52 [auto1.de] INFO: Scrape type for EX09851: 0
2026-03-30 11:46:52 [auto1.de] INFO: Found listing with ID: RT47788
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT47788%27 HTTP/1.1" 200 None
2026-03-30 11:46:52 [auto1.de] INFO: Scrape type for RT47788: 0
2026-03-30 11:46:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:04 [scrapy.extensions.logstats] INFO: Crawled 968 pages (at 3 pages/min), scraped 1377 items (at 1 items/min)
2026-03-30 11:47:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:48:04 [scrapy.extensions.logstats] INFO: Crawled 968 pages (at 0 pages/min), scraped 1377 items (at 0 items/min)
2026-03-30 11:48:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:49:02 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.558(s), this was the 1st time calling it.
2026-03-30 11:49:02 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.349183857424473 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:49:04 [scrapy.extensions.logstats] INFO: Crawled 968 pages (at 0 pages/min), scraped 1377 items (at 0 items/min)
2026-03-30 11:49:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:49:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:50:04 [scrapy.extensions.logstats] INFO: Crawled 968 pages (at 0 pages/min), scraped 1377 items (at 0 items/min)
2026-03-30 11:50:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:51:04 [scrapy.extensions.logstats] INFO: Crawled 968 pages (at 0 pages/min), scraped 1377 items (at 0 items/min)
2026-03-30 11:51:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:51:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.726(s), this was the 2nd time calling it.
2026-03-30 11:51:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 8.600596655635085 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:51:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:36 [auto1.de] INFO: Channel: 24h | Page: 221 | totalHits: 9918 | hits on page: 40
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: GH92253
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH92253%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for GH92253: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: AC92366
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: VT94173
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT94173%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for VT94173: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: MY90175
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY90175%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for MY90175: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: NH48980
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH48980%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for NH48980: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: PW96816
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: UZ14919
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ14919%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for UZ14919: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: JU61936
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: KC56991
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC56991%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for KC56991: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: FY38947
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: MU41228
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: NG13141
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: SP37211
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP37211%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for SP37211: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: BP15722
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: ZJ20785
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20785%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for ZJ20785: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: PG70940
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: HJ15324
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ15324%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for HJ15324: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: YJ96267
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: BH45975
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: JS30878
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: NL79635
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL79635%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for NL79635: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: LF10236
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: DP76469
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP76469%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for DP76469: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: ST53597
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: AD05986
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: LU20114
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU20114%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for LU20114: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: WT09019
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: MA38279
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA38279%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for MA38279: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: PZ30496
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ30496%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for PZ30496: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: CH12661
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH12661%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for CH12661: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: HC35889
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC35889%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for HC35889: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: AX97123
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: ZM69821
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM69821%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for ZM69821: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: ZW92608
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: KF80964
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF80964%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for KF80964: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: CE00984
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: KR40526
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR40526%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for KR40526: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: NS83554
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS83554%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for NS83554: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: UV09635
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV09635%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for UV09635: 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: CS70589
2026-03-30 11:51:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:37 [auto1.de] INFO: Channel: 24h | Page: 222 | totalHits: 9918 | hits on page: 40
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: MK47455
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: ND12794
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: TW63260
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: SE34706
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: LR83897
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR83897%27 HTTP/1.1" 200 None
2026-03-30 11:51:37 [auto1.de] INFO: Scrape type for LR83897: 0
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: EX09851
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX09851%27 HTTP/1.1" 200 None
2026-03-30 11:51:37 [auto1.de] INFO: Scrape type for EX09851: 0
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: RT47788
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT47788%27 HTTP/1.1" 200 None
2026-03-30 11:51:37 [auto1.de] INFO: Scrape type for RT47788: 0
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: NM77711
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: NF65308
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF65308%27 HTTP/1.1" 200 None
2026-03-30 11:51:37 [auto1.de] INFO: Scrape type for NF65308: 0
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: SM15553
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: RB21288
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB21288%27 HTTP/1.1" 200 None
2026-03-30 11:51:37 [auto1.de] INFO: Scrape type for RB21288: 0
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: TL00985
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL00985%27 HTTP/1.1" 200 None
2026-03-30 11:51:37 [auto1.de] INFO: Scrape type for TL00985: 0
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: WM78340
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: NF79967
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: BP86172
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: SM64754
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM64754%27 HTTP/1.1" 200 None
2026-03-30 11:51:37 [auto1.de] INFO: Scrape type for SM64754: 0
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: PL66942
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL66942%27 HTTP/1.1" 200 None
2026-03-30 11:51:37 [auto1.de] INFO: Scrape type for PL66942: 0
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: LR99893
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: VG16481
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: RU39212
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU39212%27 HTTP/1.1" 200 None
2026-03-30 11:51:37 [auto1.de] INFO: Scrape type for RU39212: 0
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: PH19268
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: ZS99681
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS99681%27 HTTP/1.1" 200 None
2026-03-30 11:51:37 [auto1.de] INFO: Scrape type for ZS99681: 0
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: PU80535
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: AF19813
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: AN91174
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: DK08847
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: JB87569
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: EE75447
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE75447%27 HTTP/1.1" 200 None
2026-03-30 11:51:37 [auto1.de] INFO: Scrape type for EE75447: 0
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: RP15985
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP15985%27 HTTP/1.1" 200 None
2026-03-30 11:51:37 [auto1.de] INFO: Scrape type for RP15985: 0
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: TA77613
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: SP96955
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP96955%27 HTTP/1.1" 200 None
2026-03-30 11:51:37 [auto1.de] INFO: Scrape type for SP96955: 0
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: DW77268
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: DJ18232
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: RL54518
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: GS31332
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS31332%27 HTTP/1.1" 200 None
2026-03-30 11:51:37 [auto1.de] INFO: Scrape type for GS31332: 0
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: GS03100
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: FC21553
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: CT45397
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: TH39634
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH39634%27 HTTP/1.1" 200 None
2026-03-30 11:51:38 [auto1.de] INFO: Scrape type for TH39634: 0
2026-03-30 11:51:38 [auto1.de] INFO: Found listing with ID: MY94359
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY94359%27 HTTP/1.1" 200 None
2026-03-30 11:51:38 [auto1.de] INFO: Scrape type for MY94359: 0
2026-03-30 11:51:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:39 [auto1.de] INFO: Channel: 24h | Page: 223 | totalHits: 9919 | hits on page: 40
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: MY94359
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY94359%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for MY94359: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: FZ92426
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: RE77380
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: ZS85048
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85048%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for ZS85048: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: ZY92659
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY92659%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for ZY92659: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: DK37949
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK37949%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for DK37949: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: ZY32657
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: RF12873
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF12873%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for RF12873: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: WK31693
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: XR35811
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR35811%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for XR35811: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: WL69602
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: NC71734
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC71734%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for NC71734: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: XU03488
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: JN07474
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN07474%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for JN07474: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: CT96582
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: XZ21442
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ21442%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for XZ21442: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: EK71515
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: YE73742
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE73742%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for YE73742: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: CA87699
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA87699%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for CA87699: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: XU33519
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU33519%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for XU33519: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: HK31829
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: NK26673
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK26673%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for NK26673: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: XD40949
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: NM76791
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM76791%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for NM76791: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: HA62575
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: UN89180
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN89180%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for UN89180: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: YH18669
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH18669%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for YH18669: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: EL96080
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: KD63113
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD63113%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for KD63113: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: FL46038
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL46038%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for FL46038: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: NX82618
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX82618%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for NX82618: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: ZD28041
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28041%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for ZD28041: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: LK56613
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK56613%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for LK56613: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: DS29172
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: WE31393
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: CC29120
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: FT90380
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: SA04539
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: KV17598
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV17598%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for KV17598: 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: TV41751
2026-03-30 11:51:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:43 [auto1.de] INFO: Channel: 24h | Page: 224 | totalHits: 9921 | hits on page: 40
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: KV17598
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV17598%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Scrape type for KV17598: 0
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: TV41751
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: HX78633
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX78633%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Scrape type for HX78633: 0
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: TE40935
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: GY13468
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: GY83312
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83312%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Scrape type for GY83312: 0
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: BG42804
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG42804%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Scrape type for BG42804: 0
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: GM83626
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: HG43188
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG43188%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Scrape type for HG43188: 0
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: CW85183
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW85183%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Scrape type for CW85183: 0
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: NP47731
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: KV68719
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV68719%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Scrape type for KV68719: 0
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: GJ18953
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ18953%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Scrape type for GJ18953: 0
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: GR83992
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR83992%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Scrape type for GR83992: 0
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: JJ86463
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: BV89454
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV89454%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Scrape type for BV89454: 0
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: MX21840
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX21840%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Scrape type for MX21840: 0
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: DR45963
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR45963%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Scrape type for DR45963: 0
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: UB44378
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: CE18724
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: WN98696
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: RW68722
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW68722%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Scrape type for RW68722: 0
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: AJ11888
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: YD40390
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: JX30830
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX30830%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Scrape type for JX30830: 0
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: EC85375
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC85375%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Scrape type for EC85375: 0
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: NN03303
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: VX97978
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX97978%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Scrape type for VX97978: 0
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: LB43778
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: ED69500
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED69500%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Scrape type for ED69500: 0
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: HC86157
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: AN99140
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN99140%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.de] INFO: Scrape type for AN99140: 0
2026-03-30 11:51:44 [auto1.de] INFO: Found listing with ID: FD40697
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD40697%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.de] INFO: Scrape type for FD40697: 0
2026-03-30 11:51:44 [auto1.de] INFO: Found listing with ID: UK28270
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28270%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.de] INFO: Scrape type for UK28270: 0
2026-03-30 11:51:44 [auto1.de] INFO: Found listing with ID: TM32674
2026-03-30 11:51:44 [auto1.de] INFO: Found listing with ID: UG29438
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG29438%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.de] INFO: Scrape type for UG29438: 0
2026-03-30 11:51:44 [auto1.de] INFO: Found listing with ID: NY30954
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY30954%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.de] INFO: Scrape type for NY30954: 0
2026-03-30 11:51:44 [auto1.de] INFO: Found listing with ID: AJ75381
2026-03-30 11:51:44 [auto1.de] INFO: Found listing with ID: NZ79152
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ79152%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.de] INFO: Scrape type for NZ79152: 0
2026-03-30 11:51:44 [auto1.de] INFO: Found listing with ID: HH84481
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH84481%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.de] INFO: Scrape type for HH84481: 0
2026-03-30 11:51:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:52 [auto1.de] INFO: Channel: 24h | Page: 225 | totalHits: 9924 | hits on page: 40
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: AJ75381
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: NZ79152
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ79152%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Scrape type for NZ79152: 0
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: HH84481
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH84481%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Scrape type for HH84481: 0
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: KA54911
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA54911%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Scrape type for KA54911: 0
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: TV53465
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV53465%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Scrape type for TV53465: 0
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: UP69379
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP69379%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Scrape type for UP69379: 0
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: TP61394
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP61394%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Scrape type for TP61394: 0
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: SG76993
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: EY95933
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: KR30537
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: BU21003
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU21003%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Scrape type for BU21003: 0
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: JY00372
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: CG91765
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG91765%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Scrape type for CG91765: 0
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: NG66001
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG66001%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Scrape type for NG66001: 0
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: BP09693
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: BT01554
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: MG61327
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: BM00053
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: MK22023
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: EA38947
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA38947%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Scrape type for EA38947: 0
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: BG08845
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: TR37501
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: UL05357
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: HZ69536
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ69536%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Scrape type for HZ69536: 0
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: TK93923
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK93923%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Scrape type for TK93923: 0
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: LW29658
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: DV23135
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: VR46217
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: XH28612
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: KJ41571
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: UD70348
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: CS73315
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS73315%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Scrape type for CS73315: 0
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: SE41978
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE41978%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Scrape type for SE41978: 0
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: NS35557
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS35557%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Scrape type for NS35557: 0
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: JJ64066
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: MD22344
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: LW95470
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW95470%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Scrape type for LW95470: 0
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: GN95458
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: ZG18767
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: GY54695
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY54695%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Scrape type for GY54695: 0
2026-03-30 11:51:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:53 [auto1.de] INFO: Channel: 24h | Page: 226 | totalHits: 9926 | hits on page: 40
2026-03-30 11:51:53 [auto1.de] INFO: Found listing with ID: ZG18767
2026-03-30 11:51:53 [auto1.de] INFO: Found listing with ID: GY54695
2026-03-30 11:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY54695%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for GY54695: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: TM38106
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: TK68896
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: TV85934
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV85934%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for TV85934: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: YN89436
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: YN15081
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN15081%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for YN15081: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: PR24120
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR24120%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for PR24120: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: WB47522
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB47522%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for WB47522: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: PM63573
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: JL46304
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL46304%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for JL46304: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: LL96634
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL96634%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for LL96634: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: HV52023
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV52023%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for HV52023: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: YT21216
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT21216%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for YT21216: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: YW86530
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: EH91304
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH91304%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for EH91304: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: WE57631
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: RR27166
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR27166%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for RR27166: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: SJ72548
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ72548%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for SJ72548: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: XR20146
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: RL75454
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: SY42721
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY42721%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for SY42721: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: RM21545
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM21545%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for RM21545: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: UC78524
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC78524%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for UC78524: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: WG52031
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG52031%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for WG52031: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: RY75144
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY75144%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for RY75144: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: BX11542
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX11542%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for BX11542: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: FL40114
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: DN27813
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN27813%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.de] INFO: Scrape type for DN27813: 0
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: HZ35402
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35402%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.de] INFO: Scrape type for HZ35402: 0
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: WA51516
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA51516%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.de] INFO: Scrape type for WA51516: 0
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: VY12832
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: GA49917
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA49917%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.de] INFO: Scrape type for GA49917: 0
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: CC10989
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC10989%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.de] INFO: Scrape type for CC10989: 0
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: FW05091
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: AZ02782
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: MP53713
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP53713%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.de] INFO: Scrape type for MP53713: 0
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: YA63127
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA63127%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.de] INFO: Scrape type for YA63127: 0
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: YD24318
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: FZ76900
2026-03-30 11:51:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:04 [scrapy.extensions.logstats] INFO: Crawled 974 pages (at 6 pages/min), scraped 1377 items (at 0 items/min)
2026-03-30 11:52:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:52:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:08 [auto1.de] INFO: Channel: 24h | Page: 227 | totalHits: 9930 | hits on page: 40
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: MP53713
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP53713%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for MP53713: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: YA63127
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA63127%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for YA63127: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: YD24318
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: FZ76900
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: WK48382
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK48382%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for WK48382: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: PS79135
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: AN23805
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN23805%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for AN23805: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: VL97674
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL97674%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for VL97674: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: UT78656
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT78656%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for UT78656: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: JE05181
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: LZ68363
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: RT81127
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT81127%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for RT81127: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: XL66615
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: KK21790
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK21790%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for KK21790: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: TV45930
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV45930%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for TV45930: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: DZ20117
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ20117%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for DZ20117: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: BR60141
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR60141%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for BR60141: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: UA53111
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: YA36470
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA36470%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for YA36470: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: VR29597
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR29597%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for VR29597: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: LT01381
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01381%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for LT01381: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: ZX19467
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX19467%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for ZX19467: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: PL33602
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: BC54503
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC54503%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for BC54503: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: SN24216
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: PR44802
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: YR75150
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR75150%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for YR75150: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: TP97389
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP97389%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for TP97389: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: EC10607
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC10607%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for EC10607: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: LE99206
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE99206%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for LE99206: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: KJ49270
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: ZD15058
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: PH13735
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH13735%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for PH13735: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: NR79425
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: CY46145
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY46145%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for CY46145: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: NC58057
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC58057%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for NC58057: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: UF03546
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: TF03370
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF03370%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for TF03370: 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: WU29396
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: FF37262
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF37262%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for FF37262: 0
2026-03-30 11:52:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:19 [auto1.de] INFO: Channel: 24h | Page: 228 | totalHits: 9931 | hits on page: 40
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: FF37262
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF37262%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.de] INFO: Scrape type for FF37262: 0
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: UL28707
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL28707%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.de] INFO: Scrape type for UL28707: 0
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: LM47126
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: FR17679
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR17679%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.de] INFO: Scrape type for FR17679: 0
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: XG50299
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG50299%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.de] INFO: Scrape type for XG50299: 0
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: MU09493
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: VR85555
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR85555%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.de] INFO: Scrape type for VR85555: 0
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: VB32886
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB32886%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.de] INFO: Scrape type for VB32886: 0
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: EF60589
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: MR72428
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: UT14776
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: DC55349
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC55349%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.de] INFO: Scrape type for DC55349: 0
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: LR58414
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: HM04559
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04559%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.de] INFO: Scrape type for HM04559: 0
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: EN17555
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: HN29475
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: UY60901
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: BE81625
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: CE21106
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE21106%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.de] INFO: Scrape type for CE21106: 0
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: GY94515
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: CV44457
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: LM12575
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: BN42758
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN42758%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.de] INFO: Scrape type for BN42758: 0
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: ZH67756
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH67756%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.de] INFO: Scrape type for ZH67756: 0
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: PN96283
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN96283%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.de] INFO: Scrape type for PN96283: 0
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: AZ23133
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: XV62286
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: ZS47010
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: KZ38664
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ38664%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.de] INFO: Scrape type for KZ38664: 0
2026-03-30 11:52:20 [auto1.de] INFO: Found listing with ID: MF03624
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF03624%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.de] INFO: Scrape type for MF03624: 0
2026-03-30 11:52:20 [auto1.de] INFO: Found listing with ID: FX61417
2026-03-30 11:52:20 [auto1.de] INFO: Found listing with ID: EK32140
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK32140%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.de] INFO: Scrape type for EK32140: 0
2026-03-30 11:52:20 [auto1.de] INFO: Found listing with ID: ZG89267
2026-03-30 11:52:20 [auto1.de] INFO: Found listing with ID: WW30345
2026-03-30 11:52:20 [auto1.de] INFO: Found listing with ID: BH61935
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH61935%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.de] INFO: Scrape type for BH61935: 0
2026-03-30 11:52:20 [auto1.de] INFO: Found listing with ID: TH50247
2026-03-30 11:52:20 [auto1.de] INFO: Found listing with ID: CV13370
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV13370%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.de] INFO: Scrape type for CV13370: 0
2026-03-30 11:52:20 [auto1.de] INFO: Found listing with ID: GF54025
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF54025%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.de] INFO: Scrape type for GF54025: 0
2026-03-30 11:52:20 [auto1.de] INFO: Found listing with ID: KK05104
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK05104%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.de] INFO: Scrape type for KK05104: 0
2026-03-30 11:52:20 [auto1.de] INFO: Found listing with ID: DT00553
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00553%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.de] INFO: Scrape type for DT00553: 0
2026-03-30 11:52:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:21 [auto1.de] INFO: Channel: 24h | Page: 229 | totalHits: 9931 | hits on page: 40
2026-03-30 11:52:21 [auto1.de] INFO: Found listing with ID: LR61927
2026-03-30 11:52:21 [auto1.de] INFO: Found listing with ID: PR38296
2026-03-30 11:52:21 [auto1.de] INFO: Found listing with ID: MN30135
2026-03-30 11:52:21 [auto1.de] INFO: Found listing with ID: GM93554
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93554%27 HTTP/1.1" 200 None
2026-03-30 11:52:21 [auto1.de] INFO: Scrape type for GM93554: 0
2026-03-30 11:52:21 [auto1.de] INFO: Found listing with ID: KC33777
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC33777%27 HTTP/1.1" 200 None
2026-03-30 11:52:21 [auto1.de] INFO: Scrape type for KC33777: 0
2026-03-30 11:52:21 [auto1.de] INFO: Found listing with ID: JD18961
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD18961%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for JD18961: 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: EU91257
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU91257%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for EU91257: 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: YV19830
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: TF95367
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: MJ24427
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ24427%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for MJ24427: 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: WE87104
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: TY73105
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY73105%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for TY73105: 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: ZC07667
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC07667%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for ZC07667: 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: RY65257
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY65257%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for RY65257: 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: YC98449
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: AN00284
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN00284%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for AN00284: 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: XZ09557
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ09557%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for XZ09557: 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: PW75443
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW75443%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for PW75443: 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: ZU51849
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU51849%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for ZU51849: 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: KD69831
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: VS08295
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS08295%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for VS08295: 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: DZ10370
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ10370%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for DZ10370: 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: YE71263
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: PW03502
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: LH85097
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH85097%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for LH85097: 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: TZ90544
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: MW28967
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW28967%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for MW28967: 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: ZB32219
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB32219%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for ZB32219: 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: HL71303
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71303%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for HL71303: 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: BU00937
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: CB58662
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: WN13628
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: SC39619
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: HP58071
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP58071%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for HP58071: 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: VW03364
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: DN85056
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: DZ90314
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ90314%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for DZ90314: 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: KV10415
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: SF76682
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: CE35567
2026-03-30 11:52:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:53:04 [scrapy.extensions.logstats] INFO: Crawled 977 pages (at 3 pages/min), scraped 1377 items (at 0 items/min)
2026-03-30 11:53:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:54:04 [scrapy.extensions.logstats] INFO: Crawled 977 pages (at 0 pages/min), scraped 1377 items (at 0 items/min)
2026-03-30 11:54:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:54:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.963(s), this was the 1st time calling it.
2026-03-30 11:54:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.7389700749240853 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:54:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:54:44 [auto1.de] INFO: Channel: 24h | Page: 230 | totalHits: 9963 | hits on page: 40
2026-03-30 11:54:44 [auto1.de] INFO: Found listing with ID: TF95367
2026-03-30 11:54:44 [auto1.de] INFO: Found listing with ID: MJ24427
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ24427%27 HTTP/1.1" 200 None
2026-03-30 11:54:44 [auto1.de] INFO: Scrape type for MJ24427: 0
2026-03-30 11:54:44 [auto1.de] INFO: Found listing with ID: WE87104
2026-03-30 11:54:44 [auto1.de] INFO: Found listing with ID: TY73105
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY73105%27 HTTP/1.1" 200 None
2026-03-30 11:54:44 [auto1.de] INFO: Scrape type for TY73105: 0
2026-03-30 11:54:44 [auto1.de] INFO: Found listing with ID: ZC07667
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC07667%27 HTTP/1.1" 200 None
2026-03-30 11:54:44 [auto1.de] INFO: Scrape type for ZC07667: 0
2026-03-30 11:54:44 [auto1.de] INFO: Found listing with ID: RY65257
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY65257%27 HTTP/1.1" 200 None
2026-03-30 11:54:44 [auto1.de] INFO: Scrape type for RY65257: 0
2026-03-30 11:54:44 [auto1.de] INFO: Found listing with ID: YC98449
2026-03-30 11:54:44 [auto1.de] INFO: Found listing with ID: AN00284
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN00284%27 HTTP/1.1" 200 None
2026-03-30 11:54:44 [auto1.de] INFO: Scrape type for AN00284: 0
2026-03-30 11:54:44 [auto1.de] INFO: Found listing with ID: XZ09557
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ09557%27 HTTP/1.1" 200 None
2026-03-30 11:54:44 [auto1.de] INFO: Scrape type for XZ09557: 0
2026-03-30 11:54:44 [auto1.de] INFO: Found listing with ID: PW75443
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW75443%27 HTTP/1.1" 200 None
2026-03-30 11:54:44 [auto1.de] INFO: Scrape type for PW75443: 0
2026-03-30 11:54:44 [auto1.de] INFO: Found listing with ID: ZU51849
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU51849%27 HTTP/1.1" 200 None
2026-03-30 11:54:44 [auto1.de] INFO: Scrape type for ZU51849: 0
2026-03-30 11:54:44 [auto1.de] INFO: Found listing with ID: KD69831
2026-03-30 11:54:44 [auto1.de] INFO: Found listing with ID: VS08295
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS08295%27 HTTP/1.1" 200 None
2026-03-30 11:54:44 [auto1.de] INFO: Scrape type for VS08295: 0
2026-03-30 11:54:44 [auto1.de] INFO: Found listing with ID: DZ10370
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ10370%27 HTTP/1.1" 200 None
2026-03-30 11:54:44 [auto1.de] INFO: Scrape type for DZ10370: 0
2026-03-30 11:54:44 [auto1.de] INFO: Found listing with ID: YE71263
2026-03-30 11:54:44 [auto1.de] INFO: Found listing with ID: PW03502
2026-03-30 11:54:44 [auto1.de] INFO: Found listing with ID: LH85097
2026-03-30 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH85097%27 HTTP/1.1" 200 None
2026-03-30 11:54:45 [auto1.de] INFO: Scrape type for LH85097: 0
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: TZ90544
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: MW28967
2026-03-30 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW28967%27 HTTP/1.1" 200 None
2026-03-30 11:54:45 [auto1.de] INFO: Scrape type for MW28967: 0
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: ZB32219
2026-03-30 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB32219%27 HTTP/1.1" 200 None
2026-03-30 11:54:45 [auto1.de] INFO: Scrape type for ZB32219: 0
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: HL71303
2026-03-30 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71303%27 HTTP/1.1" 200 None
2026-03-30 11:54:45 [auto1.de] INFO: Scrape type for HL71303: 0
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: BU00937
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: CB58662
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: WN13628
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: SC39619
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: HP58071
2026-03-30 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP58071%27 HTTP/1.1" 200 None
2026-03-30 11:54:45 [auto1.de] INFO: Scrape type for HP58071: 0
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: VW03364
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: DN85056
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: DZ90314
2026-03-30 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ90314%27 HTTP/1.1" 200 None
2026-03-30 11:54:45 [auto1.de] INFO: Scrape type for DZ90314: 0
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: KV10415
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: SF76682
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: CE35567
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: EC92138
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: RN02934
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: UY39264
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: ZD05213
2026-03-30 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD05213%27 HTTP/1.1" 200 None
2026-03-30 11:54:45 [auto1.de] INFO: Scrape type for ZD05213: 0
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: VL59163
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: AH54106
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: WC53392
2026-03-30 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC53392%27 HTTP/1.1" 200 None
2026-03-30 11:54:45 [auto1.de] INFO: Scrape type for WC53392: 0
2026-03-30 11:54:45 [auto1.de] INFO: Found listing with ID: KB62882
2026-03-30 11:54:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:54:46 [auto1.de] INFO: Channel: 24h | Page: 231 | totalHits: 9964 | hits on page: 40
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: KB62882
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: JZ33625
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ33625%27 HTTP/1.1" 200 None
2026-03-30 11:54:46 [auto1.de] INFO: Scrape type for JZ33625: 0
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: SS01468
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS01468%27 HTTP/1.1" 200 None
2026-03-30 11:54:46 [auto1.de] INFO: Scrape type for SS01468: 0
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: RX82336
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: VU61436
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU61436%27 HTTP/1.1" 200 None
2026-03-30 11:54:46 [auto1.de] INFO: Scrape type for VU61436: 0
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: KE07703
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: EW87662
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: YD79813
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD79813%27 HTTP/1.1" 200 None
2026-03-30 11:54:46 [auto1.de] INFO: Scrape type for YD79813: 0
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: WS06165
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: XE70546
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: JR23306
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR23306%27 HTTP/1.1" 200 None
2026-03-30 11:54:46 [auto1.de] INFO: Scrape type for JR23306: 0
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: FK29510
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: YN71631
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN71631%27 HTTP/1.1" 200 None
2026-03-30 11:54:46 [auto1.de] INFO: Scrape type for YN71631: 0
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: AP27322
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: NW52708
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: NH18171
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: EM86154
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM86154%27 HTTP/1.1" 200 None
2026-03-30 11:54:46 [auto1.de] INFO: Scrape type for EM86154: 0
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: JN22818
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: SK06184
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK06184%27 HTTP/1.1" 200 None
2026-03-30 11:54:46 [auto1.de] INFO: Scrape type for SK06184: 0
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: SZ07968
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ07968%27 HTTP/1.1" 200 None
2026-03-30 11:54:46 [auto1.de] INFO: Scrape type for SZ07968: 0
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: RT44513
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT44513%27 HTTP/1.1" 200 None
2026-03-30 11:54:46 [auto1.de] INFO: Scrape type for RT44513: 0
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: JB74543
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB74543%27 HTTP/1.1" 200 None
2026-03-30 11:54:46 [auto1.de] INFO: Scrape type for JB74543: 0
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: HX73394
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX73394%27 HTTP/1.1" 200 None
2026-03-30 11:54:46 [auto1.de] INFO: Scrape type for HX73394: 0
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: ES38254
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES38254%27 HTTP/1.1" 200 None
2026-03-30 11:54:46 [auto1.de] INFO: Scrape type for ES38254: 0
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: PU69799
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU69799%27 HTTP/1.1" 200 None
2026-03-30 11:54:46 [auto1.de] INFO: Scrape type for PU69799: 0
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: BM68891
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM68891%27 HTTP/1.1" 200 None
2026-03-30 11:54:46 [auto1.de] INFO: Scrape type for BM68891: 0
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: AN35443
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN35443%27 HTTP/1.1" 200 None
2026-03-30 11:54:46 [auto1.de] INFO: Scrape type for AN35443: 0
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: XA64298
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: FU18032
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: RT07537
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: CP64572
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP64572%27 HTTP/1.1" 200 None
2026-03-30 11:54:46 [auto1.de] INFO: Scrape type for CP64572: 0
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: CA31284
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA31284%27 HTTP/1.1" 200 None
2026-03-30 11:54:46 [auto1.de] INFO: Scrape type for CA31284: 0
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: JE64211
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE64211%27 HTTP/1.1" 200 None
2026-03-30 11:54:46 [auto1.de] INFO: Scrape type for JE64211: 0
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: FJ20192
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: ZV42561
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: YZ24956
2026-03-30 11:54:46 [auto1.de] INFO: Found listing with ID: RU51924
2026-03-30 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51924%27 HTTP/1.1" 200 None
2026-03-30 11:54:47 [auto1.de] INFO: Scrape type for RU51924: 0
2026-03-30 11:54:47 [auto1.de] INFO: Found listing with ID: UM98970
2026-03-30 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM98970%27 HTTP/1.1" 200 None
2026-03-30 11:54:47 [auto1.de] INFO: Scrape type for UM98970: 0
2026-03-30 11:54:47 [auto1.de] INFO: Found listing with ID: PP81333
2026-03-30 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP81333%27 HTTP/1.1" 200 None
2026-03-30 11:54:47 [auto1.de] INFO: Scrape type for PP81333: 0
2026-03-30 11:54:47 [auto1.de] INFO: Found listing with ID: DG65550
2026-03-30 11:54:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:54:48 [auto1.de] INFO: Channel: 24h | Page: 232 | totalHits: 9964 | hits on page: 40
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: SW06849
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: GZ70356
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: RS29828
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS29828%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for RS29828: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: WB65429
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB65429%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for WB65429: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: BV82977
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV82977%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for BV82977: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: XM98153
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: ZV11386
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV11386%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for ZV11386: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: TM97127
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: FW24707
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW24707%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for FW24707: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: ZB09378
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: NE29415
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE29415%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for NE29415: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: ES97586
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: LF31183
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF31183%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for LF31183: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: RU06209
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU06209%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for RU06209: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: MW27042
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: CN30644
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN30644%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for CN30644: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: VF79484
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: PC42361
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42361%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for PC42361: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: ZD03679
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD03679%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for ZD03679: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: AJ68338
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ68338%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for AJ68338: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: YS53721
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: XY91311
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91311%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for XY91311: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: NX07210
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: UJ32060
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ32060%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for UJ32060: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: LR70378
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: VX51529
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX51529%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for VX51529: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: ZX35580
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX35580%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for ZX35580: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: MB10012
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB10012%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for MB10012: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: JB16135
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB16135%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for JB16135: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: WX88880
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX88880%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for WX88880: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: VG60095
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: AL99999
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL99999%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for AL99999: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: NW19977
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: LD20816
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD20816%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for LD20816: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: FR59515
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR59515%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for FR59515: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: ND45572
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: XK76650
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: CL01053
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: PB68045
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB68045%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for PB68045: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: TD36353
2026-03-30 11:54:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:54:49 [auto1.de] INFO: Channel: 24h | Page: 233 | totalHits: 9964 | hits on page: 40
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: UX88157
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: PS96436
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: CA26041
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: FK87134
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87134%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for FK87134: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: AC64408
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC64408%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for AC64408: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: MS92853
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS92853%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for MS92853: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: HJ08295
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: KJ96076
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96076%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for KJ96076: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: AL40501
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: US66744
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US66744%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for US66744: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: WF58596
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: HP30052
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: RT47702
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: GB90564
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB90564%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for GB90564: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: RL85498
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL85498%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for RL85498: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: NV50024
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV50024%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for NV50024: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: WB83413
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB83413%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for WB83413: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: NX27502
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX27502%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for NX27502: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: BY26931
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: MF21991
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF21991%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for MF21991: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: MV86263
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: GZ82101
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ82101%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for GZ82101: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: XR92513
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR92513%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for XR92513: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: MH61351
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: FT59815
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT59815%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for FT59815: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: TT73177
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: TN55271
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55271%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for TN55271: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: DZ73228
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: ZA78506
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA78506%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for ZA78506: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: BT55955
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: XT21551
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: KB45443
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: XT20747
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20747%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for XT20747: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: GF23268
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF23268%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for GF23268: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: YD01023
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD01023%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for YD01023: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: GJ73585
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ73585%27 HTTP/1.1" 200 None
2026-03-30 11:54:50 [auto1.de] INFO: Scrape type for GJ73585: 0
2026-03-30 11:54:50 [auto1.de] INFO: Found listing with ID: VA37364
2026-03-30 11:54:50 [auto1.de] INFO: Found listing with ID: CA66668
2026-03-30 11:54:50 [auto1.de] INFO: Found listing with ID: NZ98006
2026-03-30 11:54:50 [auto1.de] INFO: Found listing with ID: MP14986
2026-03-30 11:54:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:04 [scrapy.extensions.logstats] INFO: Crawled 981 pages (at 4 pages/min), scraped 1377 items (at 0 items/min)
2026-03-30 11:55:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:06 [auto1.de] INFO: Channel: 24h | Page: 234 | totalHits: 9966 | hits on page: 40
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: NZ98006
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: MP14986
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: YC95910
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC95910%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.de] INFO: Scrape type for YC95910: 0
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: KU30255
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: HE47734
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE47734%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.de] INFO: Scrape type for HE47734: 0
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: JR52179
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR52179%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.de] INFO: Scrape type for JR52179: 0
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: LD23223
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD23223%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.de] INFO: Scrape type for LD23223: 0
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: LM31898
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM31898%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.de] INFO: Scrape type for LM31898: 0
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: HL01555
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01555%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.de] INFO: Scrape type for HL01555: 0
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: WJ67055
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ67055%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.de] INFO: Scrape type for WJ67055: 0
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: EJ09183
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ09183%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.de] INFO: Scrape type for EJ09183: 0
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: TM08126
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: GZ17275
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ17275%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.de] INFO: Scrape type for GZ17275: 0
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: JG89144
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: GY04691
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY04691%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.de] INFO: Scrape type for GY04691: 0
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: WD20973
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD20973%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.de] INFO: Scrape type for WD20973: 0
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: RN07993
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN07993%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.de] INFO: Scrape type for RN07993: 0
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: NT23997
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: EC99072
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC99072%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.de] INFO: Scrape type for EC99072: 0
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: EN09392
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN09392%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.de] INFO: Scrape type for EN09392: 0
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: DT06996
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT06996%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.de] INFO: Scrape type for DT06996: 0
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: LX07481
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: DK35136
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK35136%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.de] INFO: Scrape type for DK35136: 0
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: WJ60429
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ60429%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.de] INFO: Scrape type for WJ60429: 0
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: RX22328
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX22328%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.de] INFO: Scrape type for RX22328: 0
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: XE09172
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: ST78231
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: VE13678
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE13678%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.de] INFO: Scrape type for VE13678: 0
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: FG48361
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48361%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.de] INFO: Scrape type for FG48361: 0
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: XX85358
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: WM91088
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM91088%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.de] INFO: Scrape type for WM91088: 0
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: NY40403
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: JY99626
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: CG06120
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG06120%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.de] INFO: Scrape type for CG06120: 0
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: XX47236
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX47236%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.de] INFO: Scrape type for XX47236: 0
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: MA20139
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: GK17224
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: AY24824
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY24824%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.de] INFO: Scrape type for AY24824: 0
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: CE16613
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: AK16963
2026-03-30 11:55:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:23 [auto1.de] INFO: Channel: 24h | Page: 235 | totalHits: 9967 | hits on page: 40
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: AK16963
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: PG11291
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: HE64708
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: ZK51432
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: JR48888
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR48888%27 HTTP/1.1" 200 None
2026-03-30 11:55:23 [auto1.de] INFO: Scrape type for JR48888: 0
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: JU28029
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: WX17645
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX17645%27 HTTP/1.1" 200 None
2026-03-30 11:55:23 [auto1.de] INFO: Scrape type for WX17645: 0
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: BE75867
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: FP27721
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP27721%27 HTTP/1.1" 200 None
2026-03-30 11:55:23 [auto1.de] INFO: Scrape type for FP27721: 0
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: KV56642
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: KC60426
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC60426%27 HTTP/1.1" 200 None
2026-03-30 11:55:23 [auto1.de] INFO: Scrape type for KC60426: 0
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: ZU41188
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: VD40849
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: EL78604
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL78604%27 HTTP/1.1" 200 None
2026-03-30 11:55:23 [auto1.de] INFO: Scrape type for EL78604: 0
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: ZA94641
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: YL33228
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: XU87047
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: KP52427
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP52427%27 HTTP/1.1" 200 None
2026-03-30 11:55:24 [auto1.de] INFO: Scrape type for KP52427: 0
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: GW71090
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: UZ60031
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ60031%27 HTTP/1.1" 200 None
2026-03-30 11:55:24 [auto1.de] INFO: Scrape type for UZ60031: 0
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: FD59666
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: YP26052
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP26052%27 HTTP/1.1" 200 None
2026-03-30 11:55:24 [auto1.de] INFO: Scrape type for YP26052: 0
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: UW39915
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: GC53202
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: RF84100
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: BW84058
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: UX04638
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX04638%27 HTTP/1.1" 200 None
2026-03-30 11:55:24 [auto1.de] INFO: Scrape type for UX04638: 0
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: WJ96014
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: XT42092
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42092%27 HTTP/1.1" 200 None
2026-03-30 11:55:24 [auto1.de] INFO: Scrape type for XT42092: 0
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: ER27214
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER27214%27 HTTP/1.1" 200 None
2026-03-30 11:55:24 [auto1.de] INFO: Scrape type for ER27214: 0
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: VK18000
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: ZJ88951
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: DS51520
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: DU68074
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU68074%27 HTTP/1.1" 200 None
2026-03-30 11:55:24 [auto1.de] INFO: Scrape type for DU68074: 0
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: AX34662
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: VP32069
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: ZU11253
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: ZN38550
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN38550%27 HTTP/1.1" 200 None
2026-03-30 11:55:24 [auto1.de] INFO: Scrape type for ZN38550: 0
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: TR40985
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR40985%27 HTTP/1.1" 200 None
2026-03-30 11:55:24 [auto1.de] INFO: Scrape type for TR40985: 0
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: BW25069
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW25069%27 HTTP/1.1" 200 None
2026-03-30 11:55:24 [auto1.de] INFO: Scrape type for BW25069: 0
2026-03-30 11:55:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:25 [auto1.de] INFO: Channel: 24h | Page: 236 | totalHits: 9967 | hits on page: 40
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: UH14714
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14714%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for UH14714: 0
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: WR70011
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR70011%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for WR70011: 0
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: FL42692
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: UP55636
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55636%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for UP55636: 0
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: EP24311
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: ZT83144
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT83144%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for ZT83144: 0
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: UY91981
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY91981%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for UY91981: 0
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: AX05001
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: LT27218
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: TG23617
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: DL01383
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: VR01975
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR01975%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for VR01975: 0
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: BC68366
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: UW30616
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: RT08508
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: HL66974
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL66974%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for HL66974: 0
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: CJ73141
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ73141%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for CJ73141: 0
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: LT88740
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT88740%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for LT88740: 0
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: FE36611
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE36611%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for FE36611: 0
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: MY97693
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: VH99628
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: ST78057
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST78057%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for ST78057: 0
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: PV80087
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV80087%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for PV80087: 0
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: HD58306
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: KY32435
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY32435%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for KY32435: 0
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: BE46966
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: ZZ46464
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: PY07739
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY07739%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for PY07739: 0
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: NX87227
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: TH73061
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: DN86096
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN86096%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for DN86096: 0
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: YK83419
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: RV77607
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV77607%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for RV77607: 0
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: PS10948
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: HF23324
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: XA19312
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: UP26126
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP26126%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for UP26126: 0
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: GP53136
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: TV59519
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV59519%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for TV59519: 0
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: XL14326
2026-03-30 11:55:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:26 [auto1.de] INFO: Channel: 24h | Page: 237 | totalHits: 9968 | hits on page: 40
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: XL14326
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: AC34212
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC34212%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.de] INFO: Scrape type for AC34212: 0
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: EW67018
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW67018%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.de] INFO: Scrape type for EW67018: 0
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: KN87388
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: MB20164
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: HL64703
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: YW30232
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: AL30364
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL30364%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.de] INFO: Scrape type for AL30364: 0
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: FW19107
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW19107%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.de] INFO: Scrape type for FW19107: 0
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: HF87037
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: SJ02125
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02125%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.de] INFO: Scrape type for SJ02125: 0
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: GZ99340
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: VL24807
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL24807%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.de] INFO: Scrape type for VL24807: 0
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: FB16153
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: AX69067
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: CM63557
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: YR62229
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: NF97550
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF97550%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.de] INFO: Scrape type for NF97550: 0
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: AR94395
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: RF06599
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: AD51126
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: ZA82087
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA82087%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.de] INFO: Scrape type for ZA82087: 0
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: PR51827
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR51827%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.de] INFO: Scrape type for PR51827: 0
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: KU26816
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU26816%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.de] INFO: Scrape type for KU26816: 0
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: LD78650
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: KB26549
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: VL06986
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: WB94106
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: ZP72952
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: CM42106
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM42106%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.de] INFO: Scrape type for CM42106: 0
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: UP78086
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: WP34859
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: UR14680
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14680%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.de] INFO: Scrape type for UR14680: 0
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: JS00894
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: GZ33681
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ33681%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.de] INFO: Scrape type for GZ33681: 0
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: KE41699
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: WH78013
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: GL25834
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: AB16604
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: PM83477
2026-03-30 11:55:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:04 [scrapy.extensions.logstats] INFO: Crawled 985 pages (at 4 pages/min), scraped 1377 items (at 0 items/min)
2026-03-30 11:56:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:07 [auto1.de] INFO: Channel: 24h | Page: 238 | totalHits: 9972 | hits on page: 40
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: WH78013
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: GL25834
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: AB16604
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: PM83477
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: XE10609
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: XT67395
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT67395%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for XT67395: 0
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: XT85364
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT85364%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for XT85364: 0
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: AU58197
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: KJ39198
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ39198%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for KJ39198: 0
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: ED37424
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: HP09567
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: EX55373
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX55373%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for EX55373: 0
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: BN44220
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN44220%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for BN44220: 0
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: YV25001
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: DF34301
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: KT60539
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60539%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for KT60539: 0
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: VA98416
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: JM65569
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM65569%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for JM65569: 0
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: LX23482
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX23482%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for LX23482: 0
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: RS04004
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: KC29293
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC29293%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for KC29293: 0
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: EP86808
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: YA04256
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: WS15050
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: HM10485
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10485%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for HM10485: 0
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: GZ74020
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ74020%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for GZ74020: 0
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: HZ02763
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ02763%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for HZ02763: 0
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: KZ16493
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ16493%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for KZ16493: 0
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: UN41694
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: DF05561
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF05561%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for DF05561: 0
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: GK39429
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK39429%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for GK39429: 0
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: UJ06873
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: KR32445
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: MV07839
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV07839%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for MV07839: 0
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: YR28195
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: AW19440
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW19440%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for AW19440: 0
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: DG41556
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG41556%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for DG41556: 0
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: SR75246
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: HU15676
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU15676%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for HU15676: 0
2026-03-30 11:56:07 [auto1.de] INFO: Found listing with ID: SV56483
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV56483%27 HTTP/1.1" 200 None
2026-03-30 11:56:07 [auto1.de] INFO: Scrape type for SV56483: 0
2026-03-30 11:56:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:16 [auto1.de] INFO: Channel: 24h | Page: 239 | totalHits: 9973 | hits on page: 40
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: SV56483
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV56483%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for SV56483: 0
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: ZM61762
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM61762%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for ZM61762: 0
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: SC91438
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: LJ25581
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25581%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for LJ25581: 0
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: LL75700
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL75700%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for LL75700: 0
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: RG78174
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: NG57043
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG57043%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for NG57043: 0
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: SK20247
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: KY61393
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: XA48872
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA48872%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for XA48872: 0
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: ZZ30319
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ30319%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for ZZ30319: 0
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: HK51191
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: FJ78997
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78997%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for FJ78997: 0
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: NH81778
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: SC04632
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC04632%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for SC04632: 0
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: CA87929
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA87929%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for CA87929: 0
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: GL40281
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL40281%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for GL40281: 0
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: RZ32125
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: LC33446
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: JA37481
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: ZT00661
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: WC65602
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC65602%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for WC65602: 0
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: HF13996
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF13996%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for HF13996: 0
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: RX58241
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX58241%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for RX58241: 0
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: DG46200
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: BU17582
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: HN71880
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: VN03026
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN03026%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for VN03026: 0
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: NS77188
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS77188%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for NS77188: 0
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: GT32005
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT32005%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for GT32005: 0
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: UT62888
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: CN24608
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: BE39564
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: SF89930
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF89930%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for SF89930: 0
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: FF09080
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF09080%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for FF09080: 0
2026-03-30 11:56:16 [auto1.de] INFO: Found listing with ID: XU36975
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU36975%27 HTTP/1.1" 200 None
2026-03-30 11:56:16 [auto1.de] INFO: Scrape type for XU36975: 2
2026-03-30 11:56:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c07c6e13-b877-5e52-9d28-864d800235c3 with identifier: XU36975
2026-03-30 11:56:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c07c6e13-b877-5e52-9d28-864d800235c3 with scrape type 2
2026-03-30 11:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c07c6e13-b877-5e52-9d28-864d800235c3 with scrape type 2
2026-03-30 11:56:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c07c6e13-b877-5e52-9d28-864d800235c3, identifier: XU36975
2026-03-30 11:56:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c07c6e13-b877-5e52-9d28-864d800235c3 with identifier: XU36975
2026-03-30 11:56:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c07c6e13-b877-5e52-9d28-864d800235c3 with identifier: XU36975
2026-03-30 11:56:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c07c6e13-b877-5e52-9d28-864d800235c3 with identifier: XU36975 to the API
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:09:11Z',
 'fuel_type': 'diesel',
 'id': 'c07c6e13-b877-5e52-9d28-864d800235c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU36975',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 150814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-31',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU36975%27 HTTP/1.1" 200 None
2026-03-30 11:56:17 [auto1.de] INFO: Saving data for XU36975: {'auction_closing_time': 1774883351.0, 'created_time': 1774032302.779476, 'last_price_update_time': 1774871777.326772}
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU36975') HTTP/1.1" 204 0
2026-03-30 11:56:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:17 [auto1.de] INFO: Found listing with ID: WV82579
2026-03-30 11:56:17 [auto1.de] INFO: Found listing with ID: NF23902
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF23902%27 HTTP/1.1" 200 None
2026-03-30 11:56:17 [auto1.de] INFO: Scrape type for NF23902: 2
2026-03-30 11:56:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 169ad459-f862-5e89-b5db-ec445315b82c with identifier: NF23902
2026-03-30 11:56:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 169ad459-f862-5e89-b5db-ec445315b82c with scrape type 2
2026-03-30 11:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 169ad459-f862-5e89-b5db-ec445315b82c with scrape type 2
2026-03-30 11:56:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 169ad459-f862-5e89-b5db-ec445315b82c, identifier: NF23902
2026-03-30 11:56:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 169ad459-f862-5e89-b5db-ec445315b82c with identifier: NF23902
2026-03-30 11:56:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 169ad459-f862-5e89-b5db-ec445315b82c with identifier: NF23902
2026-03-30 11:56:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 169ad459-f862-5e89-b5db-ec445315b82c with identifier: NF23902 to the API
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:03:12Z',
 'fuel_type': 'petrol',
 'id': '169ad459-f862-5e89-b5db-ec445315b82c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF23902',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 109457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-09-21',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF23902%27 HTTP/1.1" 200 None
2026-03-30 11:56:17 [auto1.de] INFO: Saving data for NF23902: {'auction_closing_time': 1774882992.0, 'created_time': 1774694070.677332, 'last_price_update_time': 1774871777.844761}
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF23902') HTTP/1.1" 204 0
2026-03-30 11:56:17 [auto1.de] INFO: Found listing with ID: ZP80469
2026-03-30 11:56:17 [auto1.de] INFO: Found listing with ID: TR04886
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR04886%27 HTTP/1.1" 200 None
2026-03-30 11:56:17 [auto1.de] INFO: Scrape type for TR04886: 2
2026-03-30 11:56:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 609b1033-9c44-5f99-9bac-fda2e590b8cc with identifier: TR04886
2026-03-30 11:56:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 609b1033-9c44-5f99-9bac-fda2e590b8cc with scrape type 2
2026-03-30 11:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 609b1033-9c44-5f99-9bac-fda2e590b8cc with scrape type 2
2026-03-30 11:56:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 609b1033-9c44-5f99-9bac-fda2e590b8cc, identifier: TR04886
2026-03-30 11:56:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 609b1033-9c44-5f99-9bac-fda2e590b8cc with identifier: TR04886
2026-03-30 11:56:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 609b1033-9c44-5f99-9bac-fda2e590b8cc with identifier: TR04886
2026-03-30 11:56:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 609b1033-9c44-5f99-9bac-fda2e590b8cc with identifier: TR04886 to the API
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:47:17Z',
 'fuel_type': 'diesel',
 'id': '609b1033-9c44-5f99-9bac-fda2e590b8cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR04886',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 206563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-12',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2015}
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR04886%27 HTTP/1.1" 200 None
2026-03-30 11:56:18 [auto1.de] INFO: Saving data for TR04886: {'auction_closing_time': 1774885637.0, 'created_time': 1773427570.077662, 'last_price_update_time': 1774871778.267808}
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR04886') HTTP/1.1" 204 0
2026-03-30 11:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:29 [auto1.de] INFO: Channel: 24h | Page: 240 | totalHits: 9978 | hits on page: 40
2026-03-30 11:56:29 [auto1.de] INFO: Found listing with ID: XU36975
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU36975%27 HTTP/1.1" 200 None
2026-03-30 11:56:29 [auto1.de] INFO: Scrape type for XU36975: 0
2026-03-30 11:56:29 [auto1.de] INFO: Found listing with ID: WV82579
2026-03-30 11:56:29 [auto1.de] INFO: Found listing with ID: NF23902
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF23902%27 HTTP/1.1" 200 None
2026-03-30 11:56:29 [auto1.de] INFO: Scrape type for NF23902: 0
2026-03-30 11:56:29 [auto1.de] INFO: Found listing with ID: ZP80469
2026-03-30 11:56:29 [auto1.de] INFO: Found listing with ID: TR04886
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR04886%27 HTTP/1.1" 200 None
2026-03-30 11:56:29 [auto1.de] INFO: Scrape type for TR04886: 0
2026-03-30 11:56:29 [auto1.de] INFO: Found listing with ID: CW56448
2026-03-30 11:56:29 [auto1.de] INFO: Found listing with ID: DL34972
2026-03-30 11:56:29 [auto1.de] INFO: Found listing with ID: JR73784
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR73784%27 HTTP/1.1" 200 None
2026-03-30 11:56:29 [auto1.de] INFO: Scrape type for JR73784: 2
2026-03-30 11:56:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5971df60-ac54-5a7b-ad21-40a94a0553b9 with identifier: JR73784
2026-03-30 11:56:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5971df60-ac54-5a7b-ad21-40a94a0553b9 with scrape type 2
2026-03-30 11:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5971df60-ac54-5a7b-ad21-40a94a0553b9 with scrape type 2
2026-03-30 11:56:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5971df60-ac54-5a7b-ad21-40a94a0553b9, identifier: JR73784
2026-03-30 11:56:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5971df60-ac54-5a7b-ad21-40a94a0553b9 with identifier: JR73784
2026-03-30 11:56:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5971df60-ac54-5a7b-ad21-40a94a0553b9 with identifier: JR73784
2026-03-30 11:56:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5971df60-ac54-5a7b-ad21-40a94a0553b9 with identifier: JR73784 to the API
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-30T15:28:10Z',
 'fuel_type': 'diesel',
 'id': '5971df60-ac54-5a7b-ad21-40a94a0553b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR73784',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 109757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-08',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D5 R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2018}
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR73784%27 HTTP/1.1" 200 None
2026-03-30 11:56:30 [auto1.de] INFO: Saving data for JR73784: {'auction_closing_time': 1774884490.0, 'created_time': 1774694022.727475, 'last_price_update_time': 1774871790.16113}
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR73784') HTTP/1.1" 204 0
2026-03-30 11:56:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:30 [auto1.de] INFO: Found listing with ID: TK15682
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK15682%27 HTTP/1.1" 200 None
2026-03-30 11:56:30 [auto1.de] INFO: Scrape type for TK15682: 2
2026-03-30 11:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60903643-49cb-5ccd-9b82-f03261647587 with identifier: TK15682
2026-03-30 11:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60903643-49cb-5ccd-9b82-f03261647587 with scrape type 2
2026-03-30 11:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60903643-49cb-5ccd-9b82-f03261647587 with scrape type 2
2026-03-30 11:56:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60903643-49cb-5ccd-9b82-f03261647587, identifier: TK15682
2026-03-30 11:56:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60903643-49cb-5ccd-9b82-f03261647587 with identifier: TK15682
2026-03-30 11:56:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60903643-49cb-5ccd-9b82-f03261647587 with identifier: TK15682
2026-03-30 11:56:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60903643-49cb-5ccd-9b82-f03261647587 with identifier: TK15682 to the API
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:16:08Z',
 'fuel_type': 'diesel',
 'id': '60903643-49cb-5ccd-9b82-f03261647587',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK15682',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 157532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-12',
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2017}
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK15682%27 HTTP/1.1" 200 None
2026-03-30 11:56:30 [auto1.de] INFO: Saving data for TK15682: {'auction_closing_time': 1774883768.0, 'created_time': 1774118855.350655, 'last_price_update_time': 1774871790.641999}
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK15682') HTTP/1.1" 204 0
2026-03-30 11:56:30 [auto1.de] INFO: Found listing with ID: ZD10006
2026-03-30 11:56:30 [auto1.de] INFO: Found listing with ID: FX32904
2026-03-30 11:56:30 [auto1.de] INFO: Found listing with ID: DT59270
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT59270%27 HTTP/1.1" 200 None
2026-03-30 11:56:30 [auto1.de] INFO: Scrape type for DT59270: 2
2026-03-30 11:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335 with identifier: DT59270
2026-03-30 11:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335 with scrape type 2
2026-03-30 11:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335 with scrape type 2
2026-03-30 11:56:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335, identifier: DT59270
2026-03-30 11:56:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335 with identifier: DT59270
2026-03-30 11:56:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335 with identifier: DT59270
2026-03-30 11:56:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335 with identifier: DT59270 to the API
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:44:18Z',
 'fuel_type': 'petrol',
 'id': '1a3e11d4-bc1d-57e5-b3d9-ff25ff247335',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT59270',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 45447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-13',
 'seller_name': None,
 'title': 'BMW 1er 118i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2017}
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT59270%27 HTTP/1.1" 200 None
2026-03-30 11:56:31 [auto1.de] INFO: Saving data for DT59270: {'auction_closing_time': 1774885458.0, 'created_time': 1774693928.776859, 'last_price_update_time': 1774871791.346238}
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT59270') HTTP/1.1" 204 0
2026-03-30 11:56:31 [auto1.de] INFO: Found listing with ID: SD29600
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD29600%27 HTTP/1.1" 200 None
2026-03-30 11:56:31 [auto1.de] INFO: Scrape type for SD29600: 2
2026-03-30 11:56:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 590baee3-5512-5e1d-a530-48658d9f3432 with identifier: SD29600
2026-03-30 11:56:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 590baee3-5512-5e1d-a530-48658d9f3432 with scrape type 2
2026-03-30 11:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 590baee3-5512-5e1d-a530-48658d9f3432 with scrape type 2
2026-03-30 11:56:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 590baee3-5512-5e1d-a530-48658d9f3432, identifier: SD29600
2026-03-30 11:56:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 590baee3-5512-5e1d-a530-48658d9f3432 with identifier: SD29600
2026-03-30 11:56:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 590baee3-5512-5e1d-a530-48658d9f3432 with identifier: SD29600
2026-03-30 11:56:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 590baee3-5512-5e1d-a530-48658d9f3432 with identifier: SD29600 to the API
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:42:48Z',
 'fuel_type': 'petrol',
 'id': '590baee3-5512-5e1d-a530-48658d9f3432',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD29600',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Almera',
 'odometer': 96916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-13',
 'seller_name': None,
 'title': 'Nissan Almera 1.5 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2006}
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD29600%27 HTTP/1.1" 200 None
2026-03-30 11:56:31 [auto1.de] INFO: Saving data for SD29600: {'auction_closing_time': 1774885368.0, 'created_time': 1774348995.464131, 'last_price_update_time': 1774871791.912828}
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD29600') HTTP/1.1" 204 0
2026-03-30 11:56:31 [auto1.de] INFO: Found listing with ID: AY51976
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY51976%27 HTTP/1.1" 200 None
2026-03-30 11:56:31 [auto1.de] INFO: Scrape type for AY51976: 2
2026-03-30 11:56:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bfa0bbd-d13d-5301-ae16-bb3e967a884a with identifier: AY51976
2026-03-30 11:56:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bfa0bbd-d13d-5301-ae16-bb3e967a884a with scrape type 2
2026-03-30 11:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bfa0bbd-d13d-5301-ae16-bb3e967a884a with scrape type 2
2026-03-30 11:56:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bfa0bbd-d13d-5301-ae16-bb3e967a884a, identifier: AY51976
2026-03-30 11:56:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bfa0bbd-d13d-5301-ae16-bb3e967a884a with identifier: AY51976
2026-03-30 11:56:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bfa0bbd-d13d-5301-ae16-bb3e967a884a with identifier: AY51976
2026-03-30 11:56:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bfa0bbd-d13d-5301-ae16-bb3e967a884a with identifier: AY51976 to the API
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:59:07Z',
 'fuel_type': 'petrol',
 'id': '8bfa0bbd-d13d-5301-ae16-bb3e967a884a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY51976',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 141497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-16',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY51976%27 HTTP/1.1" 200 None
2026-03-30 11:56:32 [auto1.de] INFO: Saving data for AY51976: {'auction_closing_time': 1774886347.0, 'created_time': 1774694032.577939, 'last_price_update_time': 1774871792.320804}
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY51976') HTTP/1.1" 204 0
2026-03-30 11:56:32 [auto1.de] INFO: Found listing with ID: PB79978
2026-03-30 11:56:32 [auto1.de] INFO: Found listing with ID: KT35256
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT35256%27 HTTP/1.1" 200 None
2026-03-30 11:56:32 [auto1.de] INFO: Scrape type for KT35256: 2
2026-03-30 11:56:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 048e54bd-b608-5f6e-853c-0a5ca9facfb2 with identifier: KT35256
2026-03-30 11:56:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 048e54bd-b608-5f6e-853c-0a5ca9facfb2 with scrape type 2
2026-03-30 11:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 048e54bd-b608-5f6e-853c-0a5ca9facfb2 with scrape type 2
2026-03-30 11:56:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 048e54bd-b608-5f6e-853c-0a5ca9facfb2, identifier: KT35256
2026-03-30 11:56:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 048e54bd-b608-5f6e-853c-0a5ca9facfb2 with identifier: KT35256
2026-03-30 11:56:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 048e54bd-b608-5f6e-853c-0a5ca9facfb2 with identifier: KT35256
2026-03-30 11:56:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 048e54bd-b608-5f6e-853c-0a5ca9facfb2 with identifier: KT35256 to the API
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:04:54Z',
 'fuel_type': 'petrol',
 'id': '048e54bd-b608-5f6e-853c-0a5ca9facfb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT35256',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 55346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-23',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2012}
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT35256%27 HTTP/1.1" 200 None
2026-03-30 11:56:32 [auto1.de] INFO: Saving data for KT35256: {'auction_closing_time': 1774883094.0, 'created_time': 1773400451.799684, 'last_price_update_time': 1774871792.72865}
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT35256') HTTP/1.1" 204 0
2026-03-30 11:56:32 [auto1.de] INFO: Found listing with ID: ZY39038
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY39038%27 HTTP/1.1" 200 None
2026-03-30 11:56:32 [auto1.de] INFO: Scrape type for ZY39038: 2
2026-03-30 11:56:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8865f45d-a5c2-53d1-8c08-6e10660285cd with identifier: ZY39038
2026-03-30 11:56:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8865f45d-a5c2-53d1-8c08-6e10660285cd with scrape type 2
2026-03-30 11:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8865f45d-a5c2-53d1-8c08-6e10660285cd with scrape type 2
2026-03-30 11:56:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8865f45d-a5c2-53d1-8c08-6e10660285cd, identifier: ZY39038
2026-03-30 11:56:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8865f45d-a5c2-53d1-8c08-6e10660285cd with identifier: ZY39038
2026-03-30 11:56:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8865f45d-a5c2-53d1-8c08-6e10660285cd with identifier: ZY39038
2026-03-30 11:56:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8865f45d-a5c2-53d1-8c08-6e10660285cd with identifier: ZY39038 to the API
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:40:13Z',
 'fuel_type': 'petrol',
 'id': '8865f45d-a5c2-53d1-8c08-6e10660285cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY39038',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 109135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-03',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Edition ecoFlex',
 'transmission': 'manual',
 'trim': 'Edition ecoFlex',
 'year': 2015}
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY39038%27 HTTP/1.1" 200 None
2026-03-30 11:56:33 [auto1.de] INFO: Saving data for ZY39038: {'auction_closing_time': 1774885213.0, 'created_time': 1774694074.681259, 'last_price_update_time': 1774871793.106949}
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY39038') HTTP/1.1" 204 0
2026-03-30 11:56:33 [auto1.de] INFO: Found listing with ID: SX18437
2026-03-30 11:56:33 [auto1.de] INFO: Found listing with ID: EA52308
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA52308%27 HTTP/1.1" 200 None
2026-03-30 11:56:33 [auto1.de] INFO: Scrape type for EA52308: 2
2026-03-30 11:56:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e849fe6-7241-5809-921f-b47784246f31 with identifier: EA52308
2026-03-30 11:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e849fe6-7241-5809-921f-b47784246f31 with scrape type 2
2026-03-30 11:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e849fe6-7241-5809-921f-b47784246f31 with scrape type 2
2026-03-30 11:56:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e849fe6-7241-5809-921f-b47784246f31, identifier: EA52308
2026-03-30 11:56:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e849fe6-7241-5809-921f-b47784246f31 with identifier: EA52308
2026-03-30 11:56:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e849fe6-7241-5809-921f-b47784246f31 with identifier: EA52308
2026-03-30 11:56:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e849fe6-7241-5809-921f-b47784246f31 with identifier: EA52308 to the API
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:39:42Z',
 'fuel_type': 'diesel',
 'id': '8e849fe6-7241-5809-921f-b47784246f31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA52308',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 150233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-23',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA52308%27 HTTP/1.1" 200 None
2026-03-30 11:56:33 [auto1.de] INFO: Saving data for EA52308: {'auction_closing_time': 1774885182.0, 'created_time': 1774694051.400092, 'last_price_update_time': 1774871793.514752}
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA52308') HTTP/1.1" 204 0
2026-03-30 11:56:33 [auto1.de] INFO: Found listing with ID: KD45426
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD45426%27 HTTP/1.1" 200 None
2026-03-30 11:56:33 [auto1.de] INFO: Scrape type for KD45426: 2
2026-03-30 11:56:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa4bc764-7243-5587-b194-1babaecb520b with identifier: KD45426
2026-03-30 11:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa4bc764-7243-5587-b194-1babaecb520b with scrape type 2
2026-03-30 11:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa4bc764-7243-5587-b194-1babaecb520b with scrape type 2
2026-03-30 11:56:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa4bc764-7243-5587-b194-1babaecb520b, identifier: KD45426
2026-03-30 11:56:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa4bc764-7243-5587-b194-1babaecb520b with identifier: KD45426
2026-03-30 11:56:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa4bc764-7243-5587-b194-1babaecb520b with identifier: KD45426
2026-03-30 11:56:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa4bc764-7243-5587-b194-1babaecb520b with identifier: KD45426 to the API
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:35:24Z',
 'fuel_type': 'petrol',
 'id': 'fa4bc764-7243-5587-b194-1babaecb520b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD45426',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 141760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-30',
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD45426%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.de] INFO: Saving data for KD45426: {'auction_closing_time': 1774884924.0, 'created_time': 1774694041.978312, 'last_price_update_time': 1774871794.034817}
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD45426') HTTP/1.1" 204 0
2026-03-30 11:56:34 [auto1.de] INFO: Found listing with ID: VZ43833
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ43833%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.de] INFO: Scrape type for VZ43833: 2
2026-03-30 11:56:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91311945-c782-5129-99f1-86f0e2beccdd with identifier: VZ43833
2026-03-30 11:56:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91311945-c782-5129-99f1-86f0e2beccdd with scrape type 2
2026-03-30 11:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91311945-c782-5129-99f1-86f0e2beccdd with scrape type 2
2026-03-30 11:56:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91311945-c782-5129-99f1-86f0e2beccdd, identifier: VZ43833
2026-03-30 11:56:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91311945-c782-5129-99f1-86f0e2beccdd with identifier: VZ43833
2026-03-30 11:56:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91311945-c782-5129-99f1-86f0e2beccdd with identifier: VZ43833
2026-03-30 11:56:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91311945-c782-5129-99f1-86f0e2beccdd with identifier: VZ43833 to the API
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:11:47Z',
 'fuel_type': 'petrol',
 'id': '91311945-c782-5129-99f1-86f0e2beccdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ43833',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 167392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-30',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2006}
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ43833%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.de] INFO: Saving data for VZ43833: {'auction_closing_time': 1774883507.0, 'created_time': 1774694024.004512, 'last_price_update_time': 1774871794.443548}
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ43833') HTTP/1.1" 204 0
2026-03-30 11:56:34 [auto1.de] INFO: Found listing with ID: HA56884
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA56884%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.de] INFO: Scrape type for HA56884: 2
2026-03-30 11:56:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe with identifier: HA56884
2026-03-30 11:56:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe with scrape type 2
2026-03-30 11:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe with scrape type 2
2026-03-30 11:56:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe, identifier: HA56884
2026-03-30 11:56:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe with identifier: HA56884
2026-03-30 11:56:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe with identifier: HA56884
2026-03-30 11:56:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe with identifier: HA56884 to the API
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:41:43Z',
 'fuel_type': 'petrol',
 'id': '54e674f2-ef7a-5dc7-8567-a348a4a1f7fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA56884',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 124438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-14',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Roland Garros',
 'transmission': 'manual',
 'trim': 'Roland Garros',
 'year': 2012}
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA56884%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.de] INFO: Saving data for HA56884: {'auction_closing_time': 1774885303.0, 'created_time': 1774694050.638559, 'last_price_update_time': 1774871794.845449}
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA56884') HTTP/1.1" 204 0
2026-03-30 11:56:34 [auto1.de] INFO: Found listing with ID: FD80393
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80393%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.de] INFO: Scrape type for FD80393: 2
2026-03-30 11:56:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd515e07-5960-5374-8338-10aced789a66 with identifier: FD80393
2026-03-30 11:56:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd515e07-5960-5374-8338-10aced789a66 with scrape type 2
2026-03-30 11:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd515e07-5960-5374-8338-10aced789a66 with scrape type 2
2026-03-30 11:56:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd515e07-5960-5374-8338-10aced789a66, identifier: FD80393
2026-03-30 11:56:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd515e07-5960-5374-8338-10aced789a66 with identifier: FD80393
2026-03-30 11:56:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd515e07-5960-5374-8338-10aced789a66 with identifier: FD80393
2026-03-30 11:56:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd515e07-5960-5374-8338-10aced789a66 with identifier: FD80393 to the API
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:01:27Z',
 'fuel_type': 'diesel',
 'id': 'fd515e07-5960-5374-8338-10aced789a66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD80393',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 247605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-11',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80393%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.de] INFO: Saving data for FD80393: {'auction_closing_time': 1774882887.0, 'created_time': 1774694030.039177, 'last_price_update_time': 1774871795.314545}
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD80393') HTTP/1.1" 204 0
2026-03-30 11:56:35 [auto1.de] INFO: Found listing with ID: GF30877
2026-03-30 11:56:35 [auto1.de] INFO: Found listing with ID: CD84483
2026-03-30 11:56:35 [auto1.de] INFO: Found listing with ID: XB41121
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB41121%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.de] INFO: Scrape type for XB41121: 2
2026-03-30 11:56:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b36653d-e2c2-5ecd-9011-c67d17418b68 with identifier: XB41121
2026-03-30 11:56:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b36653d-e2c2-5ecd-9011-c67d17418b68 with scrape type 2
2026-03-30 11:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b36653d-e2c2-5ecd-9011-c67d17418b68 with scrape type 2
2026-03-30 11:56:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b36653d-e2c2-5ecd-9011-c67d17418b68, identifier: XB41121
2026-03-30 11:56:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b36653d-e2c2-5ecd-9011-c67d17418b68 with identifier: XB41121
2026-03-30 11:56:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b36653d-e2c2-5ecd-9011-c67d17418b68 with identifier: XB41121
2026-03-30 11:56:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b36653d-e2c2-5ecd-9011-c67d17418b68 with identifier: XB41121 to the API
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:42:16Z',
 'fuel_type': 'petrol',
 'id': '2b36653d-e2c2-5ecd-9011-c67d17418b68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB41121',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 77230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-05',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB41121%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.de] INFO: Saving data for XB41121: {'auction_closing_time': 1774885336.0, 'created_time': 1774379326.006103, 'last_price_update_time': 1774871795.712747}
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB41121') HTTP/1.1" 204 0
2026-03-30 11:56:35 [auto1.de] INFO: Found listing with ID: GM88868
2026-03-30 11:56:35 [auto1.de] INFO: Found listing with ID: AT60125
2026-03-30 11:56:35 [auto1.de] INFO: Found listing with ID: WA47251
2026-03-30 11:56:35 [auto1.de] INFO: Found listing with ID: DA22909
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA22909%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.de] INFO: Scrape type for DA22909: 2
2026-03-30 11:56:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32d3a715-6266-5382-bf96-20a3a23861e4 with identifier: DA22909
2026-03-30 11:56:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32d3a715-6266-5382-bf96-20a3a23861e4 with scrape type 2
2026-03-30 11:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32d3a715-6266-5382-bf96-20a3a23861e4 with scrape type 2
2026-03-30 11:56:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32d3a715-6266-5382-bf96-20a3a23861e4, identifier: DA22909
2026-03-30 11:56:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32d3a715-6266-5382-bf96-20a3a23861e4 with identifier: DA22909
2026-03-30 11:56:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32d3a715-6266-5382-bf96-20a3a23861e4 with identifier: DA22909
2026-03-30 11:56:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32d3a715-6266-5382-bf96-20a3a23861e4 with identifier: DA22909 to the API
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:12:31Z',
 'fuel_type': 'petrol',
 'id': '32d3a715-6266-5382-bf96-20a3a23861e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA22909',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 132266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-31',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2017}
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA22909%27 HTTP/1.1" 200 None
2026-03-30 11:56:36 [auto1.de] INFO: Saving data for DA22909: {'auction_closing_time': 1774883551.0, 'created_time': 1774694076.109429, 'last_price_update_time': 1774871796.097219}
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA22909') HTTP/1.1" 204 0
2026-03-30 11:56:36 [auto1.de] INFO: Found listing with ID: RC64872
2026-03-30 11:56:36 [auto1.de] INFO: Found listing with ID: GV73009
2026-03-30 11:56:36 [auto1.de] INFO: Found listing with ID: SR63291
2026-03-30 11:56:36 [auto1.de] INFO: Found listing with ID: BF10429
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF10429%27 HTTP/1.1" 200 None
2026-03-30 11:56:36 [auto1.de] INFO: Scrape type for BF10429: 2
2026-03-30 11:56:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c4af197-bd73-5e48-b752-38c65235f529 with identifier: BF10429
2026-03-30 11:56:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c4af197-bd73-5e48-b752-38c65235f529 with scrape type 2
2026-03-30 11:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c4af197-bd73-5e48-b752-38c65235f529 with scrape type 2
2026-03-30 11:56:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c4af197-bd73-5e48-b752-38c65235f529, identifier: BF10429
2026-03-30 11:56:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c4af197-bd73-5e48-b752-38c65235f529 with identifier: BF10429
2026-03-30 11:56:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c4af197-bd73-5e48-b752-38c65235f529 with identifier: BF10429
2026-03-30 11:56:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c4af197-bd73-5e48-b752-38c65235f529 with identifier: BF10429 to the API
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:15:16Z',
 'fuel_type': 'petrol',
 'id': '5c4af197-bd73-5e48-b752-38c65235f529',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF10429',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 203115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-10',
 'seller_name': None,
 'title': 'Renault Megane 1.3 TCe Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2018}
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF10429%27 HTTP/1.1" 200 None
2026-03-30 11:56:36 [auto1.de] INFO: Saving data for BF10429: {'auction_closing_time': 1774883716.0, 'created_time': 1774694075.495649, 'last_price_update_time': 1774871796.618328}
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF10429') HTTP/1.1" 204 0
2026-03-30 11:56:36 [auto1.de] INFO: Found listing with ID: EP03101
2026-03-30 11:56:36 [auto1.de] INFO: Found listing with ID: XY13632
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY13632%27 HTTP/1.1" 200 None
2026-03-30 11:56:36 [auto1.de] INFO: Scrape type for XY13632: 2
2026-03-30 11:56:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d71bd56-9b91-5743-99d5-0d6926000427 with identifier: XY13632
2026-03-30 11:56:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d71bd56-9b91-5743-99d5-0d6926000427 with scrape type 2
2026-03-30 11:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d71bd56-9b91-5743-99d5-0d6926000427 with scrape type 2
2026-03-30 11:56:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d71bd56-9b91-5743-99d5-0d6926000427, identifier: XY13632
2026-03-30 11:56:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d71bd56-9b91-5743-99d5-0d6926000427 with identifier: XY13632
2026-03-30 11:56:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d71bd56-9b91-5743-99d5-0d6926000427 with identifier: XY13632
2026-03-30 11:56:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d71bd56-9b91-5743-99d5-0d6926000427 with identifier: XY13632 to the API
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:06:44Z',
 'fuel_type': 'petrol',
 'id': '6d71bd56-9b91-5743-99d5-0d6926000427',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY13632',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 152900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-28',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Rip Curl',
 'transmission': 'manual',
 'trim': 'Rip Curl',
 'year': 2009}
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY13632%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.de] INFO: Saving data for XY13632: {'auction_closing_time': 1774883204.0, 'created_time': 1774694076.721366, 'last_price_update_time': 1774871797.056755}
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY13632') HTTP/1.1" 204 0
2026-03-30 11:56:37 [auto1.de] INFO: Found listing with ID: HA64256
2026-03-30 11:56:37 [auto1.de] INFO: Found listing with ID: BH34221
2026-03-30 11:56:37 [auto1.de] INFO: Found listing with ID: MH64159
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH64159%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.de] INFO: Scrape type for MH64159: 2
2026-03-30 11:56:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b903a51-3219-55ce-8cbc-ffc7d2caa415 with identifier: MH64159
2026-03-30 11:56:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b903a51-3219-55ce-8cbc-ffc7d2caa415 with scrape type 2
2026-03-30 11:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b903a51-3219-55ce-8cbc-ffc7d2caa415 with scrape type 2
2026-03-30 11:56:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b903a51-3219-55ce-8cbc-ffc7d2caa415, identifier: MH64159
2026-03-30 11:56:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b903a51-3219-55ce-8cbc-ffc7d2caa415 with identifier: MH64159
2026-03-30 11:56:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b903a51-3219-55ce-8cbc-ffc7d2caa415 with identifier: MH64159
2026-03-30 11:56:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b903a51-3219-55ce-8cbc-ffc7d2caa415 with identifier: MH64159 to the API
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:57:00Z',
 'fuel_type': 'petrol',
 'id': '7b903a51-3219-55ce-8cbc-ffc7d2caa415',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH64159',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 62072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-12-31',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Chiemsee',
 'transmission': 'manual',
 'trim': 'Chiemsee',
 'year': 2002}
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH64159%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.de] INFO: Saving data for MH64159: {'auction_closing_time': 1774886220.0, 'created_time': 1774694062.558846, 'last_price_update_time': 1774871797.477195}
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH64159') HTTP/1.1" 204 0
2026-03-30 11:56:37 [auto1.de] INFO: Found listing with ID: CU51280
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU51280%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.de] INFO: Scrape type for CU51280: 2
2026-03-30 11:56:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2c65ce1-91d9-5ad7-be26-189437fdcd4d with identifier: CU51280
2026-03-30 11:56:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2c65ce1-91d9-5ad7-be26-189437fdcd4d with scrape type 2
2026-03-30 11:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2c65ce1-91d9-5ad7-be26-189437fdcd4d with scrape type 2
2026-03-30 11:56:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2c65ce1-91d9-5ad7-be26-189437fdcd4d, identifier: CU51280
2026-03-30 11:56:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2c65ce1-91d9-5ad7-be26-189437fdcd4d with identifier: CU51280
2026-03-30 11:56:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2c65ce1-91d9-5ad7-be26-189437fdcd4d with identifier: CU51280
2026-03-30 11:56:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2c65ce1-91d9-5ad7-be26-189437fdcd4d with identifier: CU51280 to the API
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 347,
 'expiration_date': '2026-03-30T15:38:40Z',
 'fuel_type': 'diesel',
 'id': 'e2c65ce1-91d9-5ad7-be26-189437fdcd4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU51280',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 196047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-23',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU51280%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.de] INFO: Saving data for CU51280: {'auction_closing_time': 1774885120.0, 'created_time': 1774034236.868814, 'last_price_update_time': 1774871797.949121}
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU51280') HTTP/1.1" 204 0
2026-03-30 11:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:40 [auto1.de] INFO: Channel: 24h | Page: 241 | totalHits: 9981 | hits on page: 40
2026-03-30 11:56:40 [auto1.de] INFO: Found listing with ID: BH34221
2026-03-30 11:56:40 [auto1.de] INFO: Found listing with ID: MH64159
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH64159%27 HTTP/1.1" 200 None
2026-03-30 11:56:40 [auto1.de] INFO: Scrape type for MH64159: 0
2026-03-30 11:56:40 [auto1.de] INFO: Found listing with ID: CU51280
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU51280%27 HTTP/1.1" 200 None
2026-03-30 11:56:40 [auto1.de] INFO: Scrape type for CU51280: 0
2026-03-30 11:56:40 [auto1.de] INFO: Found listing with ID: PT22331
2026-03-30 11:56:40 [auto1.de] INFO: Found listing with ID: TS47391
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS47391%27 HTTP/1.1" 200 None
2026-03-30 11:56:40 [auto1.de] INFO: Scrape type for TS47391: 2
2026-03-30 11:56:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e074c97-29bd-5eb9-b797-cf5e32b11eb5 with identifier: TS47391
2026-03-30 11:56:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e074c97-29bd-5eb9-b797-cf5e32b11eb5 with scrape type 2
2026-03-30 11:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e074c97-29bd-5eb9-b797-cf5e32b11eb5 with scrape type 2
2026-03-30 11:56:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e074c97-29bd-5eb9-b797-cf5e32b11eb5, identifier: TS47391
2026-03-30 11:56:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e074c97-29bd-5eb9-b797-cf5e32b11eb5 with identifier: TS47391
2026-03-30 11:56:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e074c97-29bd-5eb9-b797-cf5e32b11eb5 with identifier: TS47391
2026-03-30 11:56:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e074c97-29bd-5eb9-b797-cf5e32b11eb5 with identifier: TS47391 to the API
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:45:20Z',
 'fuel_type': 'petrol',
 'id': '9e074c97-29bd-5eb9-b797-cf5e32b11eb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS47391',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 148785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-23',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2015}
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS47391%27 HTTP/1.1" 200 None
2026-03-30 11:56:40 [auto1.de] INFO: Saving data for TS47391: {'auction_closing_time': 1774885520.0, 'created_time': 1774694049.978348, 'last_price_update_time': 1774871800.587035}
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS47391') HTTP/1.1" 204 0
2026-03-30 11:56:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:40 [auto1.de] INFO: Found listing with ID: JD30879
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD30879%27 HTTP/1.1" 200 None
2026-03-30 11:56:40 [auto1.de] INFO: Scrape type for JD30879: 2
2026-03-30 11:56:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 986c93bc-34d3-51a7-a902-fd33bb552dce with identifier: JD30879
2026-03-30 11:56:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 986c93bc-34d3-51a7-a902-fd33bb552dce with scrape type 2
2026-03-30 11:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 986c93bc-34d3-51a7-a902-fd33bb552dce with scrape type 2
2026-03-30 11:56:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 986c93bc-34d3-51a7-a902-fd33bb552dce, identifier: JD30879
2026-03-30 11:56:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 986c93bc-34d3-51a7-a902-fd33bb552dce with identifier: JD30879
2026-03-30 11:56:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 986c93bc-34d3-51a7-a902-fd33bb552dce with identifier: JD30879
2026-03-30 11:56:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 986c93bc-34d3-51a7-a902-fd33bb552dce with identifier: JD30879 to the API
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:23:56Z',
 'fuel_type': 'diesel',
 'id': '986c93bc-34d3-51a7-a902-fd33bb552dce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD30879',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 182490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-09',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2019}
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD30879%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.de] INFO: Saving data for JD30879: {'auction_closing_time': 1774884236.0, 'created_time': 1773426835.783957, 'last_price_update_time': 1774871801.119449}
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD30879') HTTP/1.1" 204 0
2026-03-30 11:56:41 [auto1.de] INFO: Found listing with ID: BC15764
2026-03-30 11:56:41 [auto1.de] INFO: Found listing with ID: YW82863
2026-03-30 11:56:41 [auto1.de] INFO: Found listing with ID: AR37862
2026-03-30 11:56:41 [auto1.de] INFO: Found listing with ID: XR83794
2026-03-30 11:56:41 [auto1.de] INFO: Found listing with ID: DM55805
2026-03-30 11:56:41 [auto1.de] INFO: Found listing with ID: ZF87196
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF87196%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.de] INFO: Scrape type for ZF87196: 2
2026-03-30 11:56:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6d0b9f5-b770-5530-a841-cc4d0b3d567e with identifier: ZF87196
2026-03-30 11:56:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d0b9f5-b770-5530-a841-cc4d0b3d567e with scrape type 2
2026-03-30 11:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6d0b9f5-b770-5530-a841-cc4d0b3d567e with scrape type 2
2026-03-30 11:56:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6d0b9f5-b770-5530-a841-cc4d0b3d567e, identifier: ZF87196
2026-03-30 11:56:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6d0b9f5-b770-5530-a841-cc4d0b3d567e with identifier: ZF87196
2026-03-30 11:56:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6d0b9f5-b770-5530-a841-cc4d0b3d567e with identifier: ZF87196
2026-03-30 11:56:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6d0b9f5-b770-5530-a841-cc4d0b3d567e with identifier: ZF87196 to the API
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:27:30Z',
 'fuel_type': 'petrol',
 'id': 'd6d0b9f5-b770-5530-a841-cc4d0b3d567e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF87196',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 170246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-02',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF87196%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.de] INFO: Saving data for ZF87196: {'auction_closing_time': 1774884450.0, 'created_time': 1774694176.87768, 'last_price_update_time': 1774871801.504708}
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF87196') HTTP/1.1" 204 0
2026-03-30 11:56:41 [auto1.de] INFO: Found listing with ID: DK10749
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10749%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.de] INFO: Scrape type for DK10749: 2
2026-03-30 11:56:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7aeb3d03-ea10-5f2f-96bb-3b626b36a651 with identifier: DK10749
2026-03-30 11:56:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aeb3d03-ea10-5f2f-96bb-3b626b36a651 with scrape type 2
2026-03-30 11:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7aeb3d03-ea10-5f2f-96bb-3b626b36a651 with scrape type 2
2026-03-30 11:56:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7aeb3d03-ea10-5f2f-96bb-3b626b36a651, identifier: DK10749
2026-03-30 11:56:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7aeb3d03-ea10-5f2f-96bb-3b626b36a651 with identifier: DK10749
2026-03-30 11:56:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7aeb3d03-ea10-5f2f-96bb-3b626b36a651 with identifier: DK10749
2026-03-30 11:56:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7aeb3d03-ea10-5f2f-96bb-3b626b36a651 with identifier: DK10749 to the API
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 121,
 'expiration_date': '2026-03-30T15:43:08Z',
 'fuel_type': 'diesel',
 'id': '7aeb3d03-ea10-5f2f-96bb-3b626b36a651',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK10749',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 132308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-27',
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi L2H1 2,9t Expression',
 'transmission': 'manual',
 'trim': 'L2H1 2,9t Expression',
 'year': 2019}
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10749%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.de] INFO: Saving data for DK10749: {'auction_closing_time': 1774885388.0, 'created_time': 1773427370.390544, 'last_price_update_time': 1774871801.904758}
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK10749') HTTP/1.1" 204 0
2026-03-30 11:56:41 [auto1.de] INFO: Found listing with ID: DD00982
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD00982%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.de] INFO: Scrape type for DD00982: 2
2026-03-30 11:56:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6e6e885-b7f9-53e4-aa92-4466c522b74d with identifier: DD00982
2026-03-30 11:56:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6e6e885-b7f9-53e4-aa92-4466c522b74d with scrape type 2
2026-03-30 11:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6e6e885-b7f9-53e4-aa92-4466c522b74d with scrape type 2
2026-03-30 11:56:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6e6e885-b7f9-53e4-aa92-4466c522b74d, identifier: DD00982
2026-03-30 11:56:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6e6e885-b7f9-53e4-aa92-4466c522b74d with identifier: DD00982
2026-03-30 11:56:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6e6e885-b7f9-53e4-aa92-4466c522b74d with identifier: DD00982
2026-03-30 11:56:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6e6e885-b7f9-53e4-aa92-4466c522b74d with identifier: DD00982 to the API
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:28:38Z',
 'fuel_type': 'diesel',
 'id': 'c6e6e885-b7f9-53e4-aa92-4466c522b74d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD00982',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 166112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-03',
 'seller_name': None,
 'title': 'Audi A6 40 TDI Mild-Hybrid Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2020}
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD00982%27 HTTP/1.1" 200 None
2026-03-30 11:56:42 [auto1.de] INFO: Saving data for DD00982: {'auction_closing_time': 1774884518.0, 'created_time': 1774694087.022759, 'last_price_update_time': 1774871802.29239}
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD00982') HTTP/1.1" 204 0
2026-03-30 11:56:42 [auto1.de] INFO: Found listing with ID: BR74031
2026-03-30 11:56:42 [auto1.de] INFO: Found listing with ID: JV93942
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV93942%27 HTTP/1.1" 200 None
2026-03-30 11:56:42 [auto1.de] INFO: Scrape type for JV93942: 2
2026-03-30 11:56:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9398a5d0-2ff1-589f-95af-e3891ec6f6d3 with identifier: JV93942
2026-03-30 11:56:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9398a5d0-2ff1-589f-95af-e3891ec6f6d3 with scrape type 2
2026-03-30 11:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9398a5d0-2ff1-589f-95af-e3891ec6f6d3 with scrape type 2
2026-03-30 11:56:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9398a5d0-2ff1-589f-95af-e3891ec6f6d3, identifier: JV93942
2026-03-30 11:56:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9398a5d0-2ff1-589f-95af-e3891ec6f6d3 with identifier: JV93942
2026-03-30 11:56:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9398a5d0-2ff1-589f-95af-e3891ec6f6d3 with identifier: JV93942
2026-03-30 11:56:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9398a5d0-2ff1-589f-95af-e3891ec6f6d3 with identifier: JV93942 to the API
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:41:08Z',
 'fuel_type': 'petrol',
 'id': '9398a5d0-2ff1-589f-95af-e3891ec6f6d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV93942',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 50050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-21',
 'seller_name': None,
 'title': 'Suzuki Swift 1.4 BoosterJet Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2019}
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV93942%27 HTTP/1.1" 200 None
2026-03-30 11:56:42 [auto1.de] INFO: Saving data for JV93942: {'auction_closing_time': 1774885268.0, 'created_time': 1774694205.414746, 'last_price_update_time': 1774871802.659326}
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV93942') HTTP/1.1" 204 0
2026-03-30 11:56:42 [auto1.de] INFO: Found listing with ID: RR37288
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR37288%27 HTTP/1.1" 200 None
2026-03-30 11:56:42 [auto1.de] INFO: Scrape type for RR37288: 2
2026-03-30 11:56:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 233b6197-1e65-53ba-8d93-3013a775cd32 with identifier: RR37288
2026-03-30 11:56:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 233b6197-1e65-53ba-8d93-3013a775cd32 with scrape type 2
2026-03-30 11:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 233b6197-1e65-53ba-8d93-3013a775cd32 with scrape type 2
2026-03-30 11:56:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 233b6197-1e65-53ba-8d93-3013a775cd32, identifier: RR37288
2026-03-30 11:56:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 233b6197-1e65-53ba-8d93-3013a775cd32 with identifier: RR37288
2026-03-30 11:56:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 233b6197-1e65-53ba-8d93-3013a775cd32 with identifier: RR37288
2026-03-30 11:56:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 233b6197-1e65-53ba-8d93-3013a775cd32 with identifier: RR37288 to the API
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:31:00Z',
 'fuel_type': 'diesel',
 'id': '233b6197-1e65-53ba-8d93-3013a775cd32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR37288',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 269195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-02',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2015}
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR37288%27 HTTP/1.1" 200 None
2026-03-30 11:56:43 [auto1.de] INFO: Saving data for RR37288: {'auction_closing_time': 1774884660.0, 'created_time': 1774349103.185941, 'last_price_update_time': 1774871803.132242}
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR37288') HTTP/1.1" 204 0
2026-03-30 11:56:43 [auto1.de] INFO: Found listing with ID: ZG46471
2026-03-30 11:56:43 [auto1.de] INFO: Found listing with ID: ZR61272
2026-03-30 11:56:43 [auto1.de] INFO: Found listing with ID: XL20163
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL20163%27 HTTP/1.1" 200 None
2026-03-30 11:56:43 [auto1.de] INFO: Scrape type for XL20163: 2
2026-03-30 11:56:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d087450b-551e-5784-8900-034cc5670ac3 with identifier: XL20163
2026-03-30 11:56:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d087450b-551e-5784-8900-034cc5670ac3 with scrape type 2
2026-03-30 11:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d087450b-551e-5784-8900-034cc5670ac3 with scrape type 2
2026-03-30 11:56:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d087450b-551e-5784-8900-034cc5670ac3, identifier: XL20163
2026-03-30 11:56:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d087450b-551e-5784-8900-034cc5670ac3 with identifier: XL20163
2026-03-30 11:56:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d087450b-551e-5784-8900-034cc5670ac3 with identifier: XL20163
2026-03-30 11:56:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d087450b-551e-5784-8900-034cc5670ac3 with identifier: XL20163 to the API
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:51:16Z',
 'fuel_type': 'petrol',
 'id': 'd087450b-551e-5784-8900-034cc5670ac3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL20163',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 133363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-10-14',
 'seller_name': None,
 'title': 'Volvo V70 2.5',
 'transmission': 'automatic',
 'trim': '',
 'year': 1998}
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL20163%27 HTTP/1.1" 200 None
2026-03-30 11:56:43 [auto1.de] INFO: Saving data for XL20163: {'auction_closing_time': 1774885876.0, 'created_time': 1774694209.081186, 'last_price_update_time': 1774871803.507175}
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL20163') HTTP/1.1" 204 0
2026-03-30 11:56:43 [auto1.de] INFO: Found listing with ID: YU16554
2026-03-30 11:56:43 [auto1.de] INFO: Found listing with ID: PR78588
2026-03-30 11:56:43 [auto1.de] INFO: Found listing with ID: RK30802
2026-03-30 11:56:43 [auto1.de] INFO: Found listing with ID: RW03523
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW03523%27 HTTP/1.1" 200 None
2026-03-30 11:56:43 [auto1.de] INFO: Scrape type for RW03523: 2
2026-03-30 11:56:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95b405e9-85af-5cdc-a4f4-7fec7227c6ae with identifier: RW03523
2026-03-30 11:56:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95b405e9-85af-5cdc-a4f4-7fec7227c6ae with scrape type 2
2026-03-30 11:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95b405e9-85af-5cdc-a4f4-7fec7227c6ae with scrape type 2
2026-03-30 11:56:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95b405e9-85af-5cdc-a4f4-7fec7227c6ae, identifier: RW03523
2026-03-30 11:56:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95b405e9-85af-5cdc-a4f4-7fec7227c6ae with identifier: RW03523
2026-03-30 11:56:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95b405e9-85af-5cdc-a4f4-7fec7227c6ae with identifier: RW03523
2026-03-30 11:56:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95b405e9-85af-5cdc-a4f4-7fec7227c6ae with identifier: RW03523 to the API
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-30T15:45:51Z',
 'fuel_type': 'petrol',
 'id': '95b405e9-85af-5cdc-a4f4-7fec7227c6ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW03523',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 39336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-18',
 'seller_name': None,
 'title': 'Fiat 500C 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2022}
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW03523%27 HTTP/1.1" 200 None
2026-03-30 11:56:43 [auto1.de] INFO: Saving data for RW03523: {'auction_closing_time': 1774885551.0, 'created_time': 1774694213.021457, 'last_price_update_time': 1774871803.883051}
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW03523') HTTP/1.1" 204 0
2026-03-30 11:56:43 [auto1.de] INFO: Found listing with ID: ZY17523
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY17523%27 HTTP/1.1" 200 None
2026-03-30 11:56:43 [auto1.de] INFO: Scrape type for ZY17523: 2
2026-03-30 11:56:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a718d79f-f2b7-5028-a2ad-de3486db6704 with identifier: ZY17523
2026-03-30 11:56:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a718d79f-f2b7-5028-a2ad-de3486db6704 with scrape type 2
2026-03-30 11:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a718d79f-f2b7-5028-a2ad-de3486db6704 with scrape type 2
2026-03-30 11:56:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a718d79f-f2b7-5028-a2ad-de3486db6704, identifier: ZY17523
2026-03-30 11:56:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a718d79f-f2b7-5028-a2ad-de3486db6704 with identifier: ZY17523
2026-03-30 11:56:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a718d79f-f2b7-5028-a2ad-de3486db6704 with identifier: ZY17523
2026-03-30 11:56:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a718d79f-f2b7-5028-a2ad-de3486db6704 with identifier: ZY17523 to the API
2026-03-30 11:56:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:05:09Z',
 'fuel_type': 'petrol',
 'id': 'a718d79f-f2b7-5028-a2ad-de3486db6704',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY17523',
 'listing': 'auction',
 'make': 'Porsche',
 'model': '911',
 'odometer': 180792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-06-30',
 'seller_name': None,
 'title': 'Porsche 911 996 Carrera',
 'transmission': 'manual',
 'trim': 'Carrera',
 'year': 2001}
2026-03-30 11:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY17523%27 HTTP/1.1" 200 None
2026-03-30 11:56:44 [auto1.de] INFO: Saving data for ZY17523: {'auction_closing_time': 1774883109.0, 'created_time': 1774694188.682929, 'last_price_update_time': 1774871804.256415}
2026-03-30 11:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY17523') HTTP/1.1" 204 0
2026-03-30 11:56:44 [auto1.de] INFO: Found listing with ID: GW53776
2026-03-30 11:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW53776%27 HTTP/1.1" 200 None
2026-03-30 11:56:44 [auto1.de] INFO: Scrape type for GW53776: 2
2026-03-30 11:56:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 384a9e63-8737-5102-a5a5-34fd13756f2b with identifier: GW53776
2026-03-30 11:56:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 384a9e63-8737-5102-a5a5-34fd13756f2b with scrape type 2
2026-03-30 11:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 384a9e63-8737-5102-a5a5-34fd13756f2b with scrape type 2
2026-03-30 11:56:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 384a9e63-8737-5102-a5a5-34fd13756f2b, identifier: GW53776
2026-03-30 11:56:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 384a9e63-8737-5102-a5a5-34fd13756f2b with identifier: GW53776
2026-03-30 11:56:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 384a9e63-8737-5102-a5a5-34fd13756f2b with identifier: GW53776
2026-03-30 11:56:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 384a9e63-8737-5102-a5a5-34fd13756f2b with identifier: GW53776 to the API
2026-03-30 11:56:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:48:04Z',
 'fuel_type': 'petrol',
 'id': '384a9e63-8737-5102-a5a5-34fd13756f2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW53776',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 46165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-06',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 Goal',
 'transmission': 'automatic',
 'trim': 'Goal',
 'year': 2006}
2026-03-30 11:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW53776%27 HTTP/1.1" 200 None
2026-03-30 11:56:44 [auto1.de] INFO: Saving data for GW53776: {'auction_closing_time': 1774885684.0, 'created_time': 1774694211.854835, 'last_price_update_time': 1774871804.631004}
2026-03-30 11:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW53776') HTTP/1.1" 204 0
2026-03-30 11:56:44 [auto1.de] INFO: Found listing with ID: UB66562
2026-03-30 11:56:44 [auto1.de] INFO: Found listing with ID: PH41345
2026-03-30 11:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH41345%27 HTTP/1.1" 200 None
2026-03-30 11:56:44 [auto1.de] INFO: Scrape type for PH41345: 2
2026-03-30 11:56:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85ab0d43-02be-57de-8893-7f844ef04211 with identifier: PH41345
2026-03-30 11:56:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85ab0d43-02be-57de-8893-7f844ef04211 with scrape type 2
2026-03-30 11:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85ab0d43-02be-57de-8893-7f844ef04211 with scrape type 2
2026-03-30 11:56:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85ab0d43-02be-57de-8893-7f844ef04211, identifier: PH41345
2026-03-30 11:56:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85ab0d43-02be-57de-8893-7f844ef04211 with identifier: PH41345
2026-03-30 11:56:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85ab0d43-02be-57de-8893-7f844ef04211 with identifier: PH41345
2026-03-30 11:56:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85ab0d43-02be-57de-8893-7f844ef04211 with identifier: PH41345 to the API
2026-03-30 11:56:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:42:51Z',
 'fuel_type': 'petrol',
 'id': '85ab0d43-02be-57de-8893-7f844ef04211',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH41345',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 210335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-29',
 'seller_name': None,
 'title': 'Honda Civic 1.4 Type S',
 'transmission': 'manual',
 'trim': 'Type S',
 'year': 2009}
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH41345%27 HTTP/1.1" 200 None
2026-03-30 11:56:45 [auto1.de] INFO: Saving data for PH41345: {'auction_closing_time': 1774885371.0, 'created_time': 1774034140.5483, 'last_price_update_time': 1774871805.016033}
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH41345') HTTP/1.1" 204 0
2026-03-30 11:56:45 [auto1.de] INFO: Found listing with ID: FB79072
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB79072%27 HTTP/1.1" 200 None
2026-03-30 11:56:45 [auto1.de] INFO: Scrape type for FB79072: 2
2026-03-30 11:56:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb with identifier: FB79072
2026-03-30 11:56:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb with scrape type 2
2026-03-30 11:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb with scrape type 2
2026-03-30 11:56:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb, identifier: FB79072
2026-03-30 11:56:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb with identifier: FB79072
2026-03-30 11:56:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb with identifier: FB79072
2026-03-30 11:56:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb with identifier: FB79072 to the API
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:38:06Z',
 'fuel_type': 'diesel',
 'id': 'eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB79072',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 231923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-10',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB79072%27 HTTP/1.1" 200 None
2026-03-30 11:56:45 [auto1.de] INFO: Saving data for FB79072: {'auction_closing_time': 1774885086.0, 'created_time': 1774694061.48237, 'last_price_update_time': 1774871805.497503}
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB79072') HTTP/1.1" 204 0
2026-03-30 11:56:45 [auto1.de] INFO: Found listing with ID: DY16606
2026-03-30 11:56:45 [auto1.de] INFO: Found listing with ID: DK90225
2026-03-30 11:56:45 [auto1.de] INFO: Found listing with ID: MC13380
2026-03-30 11:56:45 [auto1.de] INFO: Found listing with ID: KW07987
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW07987%27 HTTP/1.1" 200 None
2026-03-30 11:56:45 [auto1.de] INFO: Scrape type for KW07987: 2
2026-03-30 11:56:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cc3caa2-5686-523e-90f6-99682665dcf9 with identifier: KW07987
2026-03-30 11:56:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc3caa2-5686-523e-90f6-99682665dcf9 with scrape type 2
2026-03-30 11:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cc3caa2-5686-523e-90f6-99682665dcf9 with scrape type 2
2026-03-30 11:56:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4cc3caa2-5686-523e-90f6-99682665dcf9, identifier: KW07987
2026-03-30 11:56:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4cc3caa2-5686-523e-90f6-99682665dcf9 with identifier: KW07987
2026-03-30 11:56:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4cc3caa2-5686-523e-90f6-99682665dcf9 with identifier: KW07987
2026-03-30 11:56:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4cc3caa2-5686-523e-90f6-99682665dcf9 with identifier: KW07987 to the API
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:55:20Z',
 'fuel_type': 'diesel',
 'id': '4cc3caa2-5686-523e-90f6-99682665dcf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW07987',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 180923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-27',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW07987%27 HTTP/1.1" 200 None
2026-03-30 11:56:45 [auto1.de] INFO: Saving data for KW07987: {'auction_closing_time': 1774886120.0, 'created_time': 1774694049.078762, 'last_price_update_time': 1774871805.887373}
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW07987') HTTP/1.1" 204 0
2026-03-30 11:56:45 [auto1.de] INFO: Found listing with ID: HC06893
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC06893%27 HTTP/1.1" 200 None
2026-03-30 11:56:45 [auto1.de] INFO: Scrape type for HC06893: 2
2026-03-30 11:56:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0 with identifier: HC06893
2026-03-30 11:56:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0 with scrape type 2
2026-03-30 11:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0 with scrape type 2
2026-03-30 11:56:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0, identifier: HC06893
2026-03-30 11:56:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0 with identifier: HC06893
2026-03-30 11:56:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0 with identifier: HC06893
2026-03-30 11:56:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0 with identifier: HC06893 to the API
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:57:55Z',
 'fuel_type': 'petrol',
 'id': '43ee5ac4-19e2-58ca-8887-fa2d79f8eac0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC06893',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLK-Klasse',
 'odometer': 110417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-14',
 'seller_name': None,
 'title': 'Mercedes-Benz CLK-Klasse CLK 280 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2005}
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC06893%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.de] INFO: Saving data for HC06893: {'auction_closing_time': 1774886275.0, 'created_time': 1773468614.674972, 'last_price_update_time': 1774871806.26456}
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC06893') HTTP/1.1" 204 0
2026-03-30 11:56:46 [auto1.de] INFO: Found listing with ID: BM85402
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM85402%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.de] INFO: Scrape type for BM85402: 2
2026-03-30 11:56:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e824cdae-8ff0-5fd8-a2bc-9589ffa65c12 with identifier: BM85402
2026-03-30 11:56:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e824cdae-8ff0-5fd8-a2bc-9589ffa65c12 with scrape type 2
2026-03-30 11:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e824cdae-8ff0-5fd8-a2bc-9589ffa65c12 with scrape type 2
2026-03-30 11:56:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e824cdae-8ff0-5fd8-a2bc-9589ffa65c12, identifier: BM85402
2026-03-30 11:56:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e824cdae-8ff0-5fd8-a2bc-9589ffa65c12 with identifier: BM85402
2026-03-30 11:56:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e824cdae-8ff0-5fd8-a2bc-9589ffa65c12 with identifier: BM85402
2026-03-30 11:56:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e824cdae-8ff0-5fd8-a2bc-9589ffa65c12 with identifier: BM85402 to the API
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:56:00Z',
 'fuel_type': 'petrol',
 'id': 'e824cdae-8ff0-5fd8-a2bc-9589ffa65c12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM85402',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 107368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-22',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 Urban Move',
 'transmission': 'manual',
 'trim': 'Urban Move',
 'year': 2009}
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM85402%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.de] INFO: Saving data for BM85402: {'auction_closing_time': 1774886160.0, 'created_time': 1774694066.919696, 'last_price_update_time': 1774871806.670574}
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM85402') HTTP/1.1" 204 0
2026-03-30 11:56:46 [auto1.de] INFO: Found listing with ID: CA67550
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA67550%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.de] INFO: Scrape type for CA67550: 2
2026-03-30 11:56:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb41ac90-c3b7-5844-82da-020b8dbc5e1e with identifier: CA67550
2026-03-30 11:56:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb41ac90-c3b7-5844-82da-020b8dbc5e1e with scrape type 2
2026-03-30 11:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb41ac90-c3b7-5844-82da-020b8dbc5e1e with scrape type 2
2026-03-30 11:56:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb41ac90-c3b7-5844-82da-020b8dbc5e1e, identifier: CA67550
2026-03-30 11:56:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb41ac90-c3b7-5844-82da-020b8dbc5e1e with identifier: CA67550
2026-03-30 11:56:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb41ac90-c3b7-5844-82da-020b8dbc5e1e with identifier: CA67550
2026-03-30 11:56:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb41ac90-c3b7-5844-82da-020b8dbc5e1e with identifier: CA67550 to the API
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:48:49Z',
 'fuel_type': 'petrol',
 'id': 'eb41ac90-c3b7-5844-82da-020b8dbc5e1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA67550',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 98353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-31',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2016}
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA67550%27 HTTP/1.1" 200 None
2026-03-30 11:56:47 [auto1.de] INFO: Saving data for CA67550: {'auction_closing_time': 1774885729.0, 'created_time': 1774694053.661458, 'last_price_update_time': 1774871807.106957}
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA67550') HTTP/1.1" 204 0
2026-03-30 11:56:47 [auto1.de] INFO: Found listing with ID: ZG02351
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG02351%27 HTTP/1.1" 200 None
2026-03-30 11:56:47 [auto1.de] INFO: Scrape type for ZG02351: 2
2026-03-30 11:56:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54c20aeb-4309-5876-a266-66a51436cbe6 with identifier: ZG02351
2026-03-30 11:56:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54c20aeb-4309-5876-a266-66a51436cbe6 with scrape type 2
2026-03-30 11:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54c20aeb-4309-5876-a266-66a51436cbe6 with scrape type 2
2026-03-30 11:56:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54c20aeb-4309-5876-a266-66a51436cbe6, identifier: ZG02351
2026-03-30 11:56:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54c20aeb-4309-5876-a266-66a51436cbe6 with identifier: ZG02351
2026-03-30 11:56:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54c20aeb-4309-5876-a266-66a51436cbe6 with identifier: ZG02351
2026-03-30 11:56:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54c20aeb-4309-5876-a266-66a51436cbe6 with identifier: ZG02351 to the API
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:17Z',
 'fuel_type': 'diesel',
 'id': '54c20aeb-4309-5876-a266-66a51436cbe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG02351',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 167168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-26',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI FR-Line',
 'transmission': 'automatic',
 'trim': 'FR-Line',
 'year': 2018}
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG02351%27 HTTP/1.1" 200 None
2026-03-30 11:56:47 [auto1.de] INFO: Saving data for ZG02351: {'auction_closing_time': 1774885637.0, 'created_time': 1773467251.130645, 'last_price_update_time': 1774871807.520185}
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG02351') HTTP/1.1" 204 0
2026-03-30 11:56:47 [auto1.de] INFO: Found listing with ID: TD16668
2026-03-30 11:56:47 [auto1.de] INFO: Found listing with ID: UK87241
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK87241%27 HTTP/1.1" 200 None
2026-03-30 11:56:47 [auto1.de] INFO: Scrape type for UK87241: 2
2026-03-30 11:56:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22b1e385-5bd9-5cf9-9f7a-77381ab83043 with identifier: UK87241
2026-03-30 11:56:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22b1e385-5bd9-5cf9-9f7a-77381ab83043 with scrape type 2
2026-03-30 11:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22b1e385-5bd9-5cf9-9f7a-77381ab83043 with scrape type 2
2026-03-30 11:56:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22b1e385-5bd9-5cf9-9f7a-77381ab83043, identifier: UK87241
2026-03-30 11:56:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22b1e385-5bd9-5cf9-9f7a-77381ab83043 with identifier: UK87241
2026-03-30 11:56:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22b1e385-5bd9-5cf9-9f7a-77381ab83043 with identifier: UK87241
2026-03-30 11:56:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22b1e385-5bd9-5cf9-9f7a-77381ab83043 with identifier: UK87241 to the API
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:01:29Z',
 'fuel_type': 'petrol',
 'id': '22b1e385-5bd9-5cf9-9f7a-77381ab83043',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK87241',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 136106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-27',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK87241%27 HTTP/1.1" 200 None
2026-03-30 11:56:47 [auto1.de] INFO: Saving data for UK87241: {'auction_closing_time': 1774882889.0, 'created_time': 1774694078.650329, 'last_price_update_time': 1774871807.915166}
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK87241') HTTP/1.1" 204 0
2026-03-30 11:56:48 [auto1.de] INFO: Found listing with ID: GF54285
2026-03-30 11:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:52 [auto1.de] INFO: Channel: 24h | Page: 242 | totalHits: 9985 | hits on page: 40
2026-03-30 11:56:52 [auto1.de] INFO: Found listing with ID: ZG02351
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG02351%27 HTTP/1.1" 200 None
2026-03-30 11:56:52 [auto1.de] INFO: Scrape type for ZG02351: 0
2026-03-30 11:56:52 [auto1.de] INFO: Found listing with ID: TD16668
2026-03-30 11:56:52 [auto1.de] INFO: Found listing with ID: UK87241
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK87241%27 HTTP/1.1" 200 None
2026-03-30 11:56:52 [auto1.de] INFO: Scrape type for UK87241: 0
2026-03-30 11:56:52 [auto1.de] INFO: Found listing with ID: GF54285
2026-03-30 11:56:52 [auto1.de] INFO: Found listing with ID: JM74850
2026-03-30 11:56:52 [auto1.de] INFO: Found listing with ID: PJ27517
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27517%27 HTTP/1.1" 200 None
2026-03-30 11:56:52 [auto1.de] INFO: Scrape type for PJ27517: 2
2026-03-30 11:56:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da2752d5-bd08-5c65-a7f9-0cc37aeb259d with identifier: PJ27517
2026-03-30 11:56:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2752d5-bd08-5c65-a7f9-0cc37aeb259d with scrape type 2
2026-03-30 11:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da2752d5-bd08-5c65-a7f9-0cc37aeb259d with scrape type 2
2026-03-30 11:56:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da2752d5-bd08-5c65-a7f9-0cc37aeb259d, identifier: PJ27517
2026-03-30 11:56:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da2752d5-bd08-5c65-a7f9-0cc37aeb259d with identifier: PJ27517
2026-03-30 11:56:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da2752d5-bd08-5c65-a7f9-0cc37aeb259d with identifier: PJ27517
2026-03-30 11:56:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da2752d5-bd08-5c65-a7f9-0cc37aeb259d with identifier: PJ27517 to the API
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-30T15:06:21Z',
 'fuel_type': 'petrol',
 'id': 'da2752d5-bd08-5c65-a7f9-0cc37aeb259d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ27517',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 16544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-10',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Mild-Hybrid Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2024}
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27517%27 HTTP/1.1" 200 None
2026-03-30 11:56:52 [auto1.de] INFO: Saving data for PJ27517: {'auction_closing_time': 1774883181.0, 'created_time': 1774350281.849803, 'last_price_update_time': 1774871812.832172}
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ27517') HTTP/1.1" 204 0
2026-03-30 11:56:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:52 [auto1.de] INFO: Found listing with ID: MN00804
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN00804%27 HTTP/1.1" 200 None
2026-03-30 11:56:52 [auto1.de] INFO: Scrape type for MN00804: 2
2026-03-30 11:56:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afd08d62-e04d-59c5-a09a-0a28284a469d with identifier: MN00804
2026-03-30 11:56:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afd08d62-e04d-59c5-a09a-0a28284a469d with scrape type 2
2026-03-30 11:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afd08d62-e04d-59c5-a09a-0a28284a469d with scrape type 2
2026-03-30 11:56:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afd08d62-e04d-59c5-a09a-0a28284a469d, identifier: MN00804
2026-03-30 11:56:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afd08d62-e04d-59c5-a09a-0a28284a469d with identifier: MN00804
2026-03-30 11:56:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afd08d62-e04d-59c5-a09a-0a28284a469d with identifier: MN00804
2026-03-30 11:56:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afd08d62-e04d-59c5-a09a-0a28284a469d with identifier: MN00804 to the API
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:32:23Z',
 'fuel_type': 'petrol',
 'id': 'afd08d62-e04d-59c5-a09a-0a28284a469d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN00804',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 180256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-19',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2016}
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN00804%27 HTTP/1.1" 200 None
2026-03-30 11:56:53 [auto1.de] INFO: Saving data for MN00804: {'auction_closing_time': 1774884743.0, 'created_time': 1774694047.652062, 'last_price_update_time': 1774871813.206318}
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN00804') HTTP/1.1" 204 0
2026-03-30 11:56:53 [auto1.de] INFO: Found listing with ID: CR42013
2026-03-30 11:56:53 [auto1.de] INFO: Found listing with ID: GH25955
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH25955%27 HTTP/1.1" 200 None
2026-03-30 11:56:53 [auto1.de] INFO: Scrape type for GH25955: 2
2026-03-30 11:56:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 399c574b-d314-5e64-898d-9b6abd286a56 with identifier: GH25955
2026-03-30 11:56:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 399c574b-d314-5e64-898d-9b6abd286a56 with scrape type 2
2026-03-30 11:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 399c574b-d314-5e64-898d-9b6abd286a56 with scrape type 2
2026-03-30 11:56:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 399c574b-d314-5e64-898d-9b6abd286a56, identifier: GH25955
2026-03-30 11:56:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 399c574b-d314-5e64-898d-9b6abd286a56 with identifier: GH25955
2026-03-30 11:56:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 399c574b-d314-5e64-898d-9b6abd286a56 with identifier: GH25955
2026-03-30 11:56:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 399c574b-d314-5e64-898d-9b6abd286a56 with identifier: GH25955 to the API
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:17:09Z',
 'fuel_type': 'diesel',
 'id': '399c574b-d314-5e64-898d-9b6abd286a56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH25955',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 137748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-11',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 CRDi Platinum Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Platinum Edition 4WD',
 'year': 2014}
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH25955%27 HTTP/1.1" 200 None
2026-03-30 11:56:53 [auto1.de] INFO: Saving data for GH25955: {'auction_closing_time': 1774883829.0, 'created_time': 1774349915.017703, 'last_price_update_time': 1774871813.592673}
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH25955') HTTP/1.1" 204 0
2026-03-30 11:56:53 [auto1.de] INFO: Found listing with ID: AF81396
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF81396%27 HTTP/1.1" 200 None
2026-03-30 11:56:53 [auto1.de] INFO: Scrape type for AF81396: 2
2026-03-30 11:56:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b62c02c-ca5b-5358-a986-8d8e1156bae0 with identifier: AF81396
2026-03-30 11:56:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b62c02c-ca5b-5358-a986-8d8e1156bae0 with scrape type 2
2026-03-30 11:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b62c02c-ca5b-5358-a986-8d8e1156bae0 with scrape type 2
2026-03-30 11:56:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b62c02c-ca5b-5358-a986-8d8e1156bae0, identifier: AF81396
2026-03-30 11:56:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b62c02c-ca5b-5358-a986-8d8e1156bae0 with identifier: AF81396
2026-03-30 11:56:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b62c02c-ca5b-5358-a986-8d8e1156bae0 with identifier: AF81396
2026-03-30 11:56:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b62c02c-ca5b-5358-a986-8d8e1156bae0 with identifier: AF81396 to the API
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:53:51Z',
 'fuel_type': 'petrol',
 'id': '7b62c02c-ca5b-5358-a986-8d8e1156bae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF81396',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 69525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Edition BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Edition BlueMotion Tech',
 'year': 2015}
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF81396%27 HTTP/1.1" 200 None
2026-03-30 11:56:53 [auto1.de] INFO: Saving data for AF81396: {'auction_closing_time': 1774886031.0, 'created_time': 1773467103.296941, 'last_price_update_time': 1774871813.965917}
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF81396') HTTP/1.1" 204 0
2026-03-30 11:56:54 [auto1.de] INFO: Found listing with ID: FJ89028
2026-03-30 11:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ89028%27 HTTP/1.1" 200 None
2026-03-30 11:56:54 [auto1.de] INFO: Scrape type for FJ89028: 2
2026-03-30 11:56:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f6fdad1-e21a-5820-9fae-a30a17add957 with identifier: FJ89028
2026-03-30 11:56:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f6fdad1-e21a-5820-9fae-a30a17add957 with scrape type 2
2026-03-30 11:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f6fdad1-e21a-5820-9fae-a30a17add957 with scrape type 2
2026-03-30 11:56:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f6fdad1-e21a-5820-9fae-a30a17add957, identifier: FJ89028
2026-03-30 11:56:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f6fdad1-e21a-5820-9fae-a30a17add957 with identifier: FJ89028
2026-03-30 11:56:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f6fdad1-e21a-5820-9fae-a30a17add957 with identifier: FJ89028
2026-03-30 11:56:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f6fdad1-e21a-5820-9fae-a30a17add957 with identifier: FJ89028 to the API
2026-03-30 11:56:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-30T15:21:30Z',
 'fuel_type': 'hybrid',
 'id': '0f6fdad1-e21a-5820-9fae-a30a17add957',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ89028',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 272614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-16',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300 de Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2019}
2026-03-30 11:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ89028%27 HTTP/1.1" 200 None
2026-03-30 11:56:54 [auto1.de] INFO: Saving data for FJ89028: {'auction_closing_time': 1774884090.0, 'created_time': 1773401968.489246, 'last_price_update_time': 1774871814.483827}
2026-03-30 11:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ89028') HTTP/1.1" 204 0
2026-03-30 11:56:54 [auto1.de] INFO: Found listing with ID: CU69011
2026-03-30 11:56:54 [auto1.de] INFO: Found listing with ID: GY71036
2026-03-30 11:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY71036%27 HTTP/1.1" 200 None
2026-03-30 11:56:54 [auto1.de] INFO: Scrape type for GY71036: 2
2026-03-30 11:56:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1449c7c0-88ed-558a-b35c-64f012161f92 with identifier: GY71036
2026-03-30 11:56:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1449c7c0-88ed-558a-b35c-64f012161f92 with scrape type 2
2026-03-30 11:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1449c7c0-88ed-558a-b35c-64f012161f92 with scrape type 2
2026-03-30 11:56:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1449c7c0-88ed-558a-b35c-64f012161f92, identifier: GY71036
2026-03-30 11:56:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1449c7c0-88ed-558a-b35c-64f012161f92 with identifier: GY71036
2026-03-30 11:56:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1449c7c0-88ed-558a-b35c-64f012161f92 with identifier: GY71036
2026-03-30 11:56:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1449c7c0-88ed-558a-b35c-64f012161f92 with identifier: GY71036 to the API
2026-03-30 11:56:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:32:52Z',
 'fuel_type': 'petrol',
 'id': '1449c7c0-88ed-558a-b35c-64f012161f92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY71036',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 41702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-05',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.2 Intro Edition+',
 'transmission': 'manual',
 'trim': 'Intro Edition+',
 'year': 2020}
2026-03-30 11:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY71036%27 HTTP/1.1" 200 None
2026-03-30 11:56:54 [auto1.de] INFO: Saving data for GY71036: {'auction_closing_time': 1774884772.0, 'created_time': 1774694063.367726, 'last_price_update_time': 1774871814.859899}
2026-03-30 11:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY71036') HTTP/1.1" 204 0
2026-03-30 11:56:54 [auto1.de] INFO: Found listing with ID: HB96226
2026-03-30 11:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB96226%27 HTTP/1.1" 200 None
2026-03-30 11:56:54 [auto1.de] INFO: Scrape type for HB96226: 2
2026-03-30 11:56:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7 with identifier: HB96226
2026-03-30 11:56:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7 with scrape type 2
2026-03-30 11:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7 with scrape type 2
2026-03-30 11:56:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7, identifier: HB96226
2026-03-30 11:56:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7 with identifier: HB96226
2026-03-30 11:56:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7 with identifier: HB96226
2026-03-30 11:56:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7 with identifier: HB96226 to the API
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:37:24Z',
 'fuel_type': 'diesel',
 'id': '2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB96226',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 221823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-14',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2016}
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB96226%27 HTTP/1.1" 200 None
2026-03-30 11:56:55 [auto1.de] INFO: Saving data for HB96226: {'auction_closing_time': 1774885044.0, 'created_time': 1773426880.942882, 'last_price_update_time': 1774871815.258834}
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB96226') HTTP/1.1" 204 0
2026-03-30 11:56:55 [auto1.de] INFO: Found listing with ID: GS36349
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36349%27 HTTP/1.1" 200 None
2026-03-30 11:56:55 [auto1.de] INFO: Scrape type for GS36349: 2
2026-03-30 11:56:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad5b91dd-e884-5a51-9283-2e39b9dae6a3 with identifier: GS36349
2026-03-30 11:56:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad5b91dd-e884-5a51-9283-2e39b9dae6a3 with scrape type 2
2026-03-30 11:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad5b91dd-e884-5a51-9283-2e39b9dae6a3 with scrape type 2
2026-03-30 11:56:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad5b91dd-e884-5a51-9283-2e39b9dae6a3, identifier: GS36349
2026-03-30 11:56:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad5b91dd-e884-5a51-9283-2e39b9dae6a3 with identifier: GS36349
2026-03-30 11:56:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad5b91dd-e884-5a51-9283-2e39b9dae6a3 with identifier: GS36349
2026-03-30 11:56:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad5b91dd-e884-5a51-9283-2e39b9dae6a3 with identifier: GS36349 to the API
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:49:19Z',
 'fuel_type': 'petrol',
 'id': 'ad5b91dd-e884-5a51-9283-2e39b9dae6a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS36349',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-30',
 'odometer': 50732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-12',
 'seller_name': None,
 'title': 'Mazda CX-30 2.0 Skyactiv-G Mild-Hybrid Selection 2WD',
 'transmission': 'automatic',
 'trim': 'Selection 2WD',
 'year': 2019}
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36349%27 HTTP/1.1" 200 None
2026-03-30 11:56:55 [auto1.de] INFO: Saving data for GS36349: {'auction_closing_time': 1774885759.0, 'created_time': 1774032438.513994, 'last_price_update_time': 1774871815.740637}
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS36349') HTTP/1.1" 204 0
2026-03-30 11:56:55 [auto1.de] INFO: Found listing with ID: HA50795
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA50795%27 HTTP/1.1" 200 None
2026-03-30 11:56:55 [auto1.de] INFO: Scrape type for HA50795: 2
2026-03-30 11:56:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc7b8361-18dd-5948-9838-350ac5ee585e with identifier: HA50795
2026-03-30 11:56:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc7b8361-18dd-5948-9838-350ac5ee585e with scrape type 2
2026-03-30 11:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc7b8361-18dd-5948-9838-350ac5ee585e with scrape type 2
2026-03-30 11:56:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc7b8361-18dd-5948-9838-350ac5ee585e, identifier: HA50795
2026-03-30 11:56:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc7b8361-18dd-5948-9838-350ac5ee585e with identifier: HA50795
2026-03-30 11:56:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc7b8361-18dd-5948-9838-350ac5ee585e with identifier: HA50795
2026-03-30 11:56:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc7b8361-18dd-5948-9838-350ac5ee585e with identifier: HA50795 to the API
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:57:19Z',
 'fuel_type': 'diesel',
 'id': 'fc7b8361-18dd-5948-9838-350ac5ee585e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA50795',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 90462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-04',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L2 Trend',
 'transmission': 'automatic',
 'trim': '320 L2 Trend',
 'year': 2019}
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA50795%27 HTTP/1.1" 200 None
2026-03-30 11:56:56 [auto1.de] INFO: Saving data for HA50795: {'auction_closing_time': 1774886239.0, 'created_time': 1774089338.447405, 'last_price_update_time': 1774871816.154512}
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA50795') HTTP/1.1" 204 0
2026-03-30 11:56:56 [auto1.de] INFO: Found listing with ID: UZ55149
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ55149%27 HTTP/1.1" 200 None
2026-03-30 11:56:56 [auto1.de] INFO: Scrape type for UZ55149: 2
2026-03-30 11:56:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46eb9f3e-63d4-5f4d-b705-acb3dd131886 with identifier: UZ55149
2026-03-30 11:56:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46eb9f3e-63d4-5f4d-b705-acb3dd131886 with scrape type 2
2026-03-30 11:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46eb9f3e-63d4-5f4d-b705-acb3dd131886 with scrape type 2
2026-03-30 11:56:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46eb9f3e-63d4-5f4d-b705-acb3dd131886, identifier: UZ55149
2026-03-30 11:56:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46eb9f3e-63d4-5f4d-b705-acb3dd131886 with identifier: UZ55149
2026-03-30 11:56:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46eb9f3e-63d4-5f4d-b705-acb3dd131886 with identifier: UZ55149
2026-03-30 11:56:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46eb9f3e-63d4-5f4d-b705-acb3dd131886 with identifier: UZ55149 to the API
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:36:37Z',
 'fuel_type': 'diesel',
 'id': '46eb9f3e-63d4-5f4d-b705-acb3dd131886',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ55149',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 188538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-17',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2017}
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ55149%27 HTTP/1.1" 200 None
2026-03-30 11:56:56 [auto1.de] INFO: Saving data for UZ55149: {'auction_closing_time': 1774884997.0, 'created_time': 1774118803.908816, 'last_price_update_time': 1774871816.563171}
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ55149') HTTP/1.1" 204 0
2026-03-30 11:56:56 [auto1.de] INFO: Found listing with ID: NC03535
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC03535%27 HTTP/1.1" 200 None
2026-03-30 11:56:56 [auto1.de] INFO: Scrape type for NC03535: 2
2026-03-30 11:56:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75ad6f15-00d9-5c62-b030-072a353c5614 with identifier: NC03535
2026-03-30 11:56:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75ad6f15-00d9-5c62-b030-072a353c5614 with scrape type 2
2026-03-30 11:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75ad6f15-00d9-5c62-b030-072a353c5614 with scrape type 2
2026-03-30 11:56:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75ad6f15-00d9-5c62-b030-072a353c5614, identifier: NC03535
2026-03-30 11:56:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75ad6f15-00d9-5c62-b030-072a353c5614 with identifier: NC03535
2026-03-30 11:56:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75ad6f15-00d9-5c62-b030-072a353c5614 with identifier: NC03535
2026-03-30 11:56:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75ad6f15-00d9-5c62-b030-072a353c5614 with identifier: NC03535 to the API
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:21:01Z',
 'fuel_type': 'diesel',
 'id': '75ad6f15-00d9-5c62-b030-072a353c5614',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC03535',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 111998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-04',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Join',
 'transmission': 'automatic',
 'trim': 'Join',
 'year': 2019}
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC03535%27 HTTP/1.1" 200 None
2026-03-30 11:56:56 [auto1.de] INFO: Saving data for NC03535: {'auction_closing_time': 1774884061.0, 'created_time': 1774349312.394359, 'last_price_update_time': 1774871816.952192}
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC03535') HTTP/1.1" 204 0
2026-03-30 11:56:56 [auto1.de] INFO: Found listing with ID: HR22131
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR22131%27 HTTP/1.1" 200 None
2026-03-30 11:56:56 [auto1.de] INFO: Scrape type for HR22131: 2
2026-03-30 11:56:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053 with identifier: HR22131
2026-03-30 11:56:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053 with scrape type 2
2026-03-30 11:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053 with scrape type 2
2026-03-30 11:56:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053, identifier: HR22131
2026-03-30 11:56:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053 with identifier: HR22131
2026-03-30 11:56:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053 with identifier: HR22131
2026-03-30 11:56:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053 with identifier: HR22131 to the API
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:58:24Z',
 'fuel_type': 'petrol',
 'id': '4c8e8731-4edb-5ec2-8286-1d6a4e1c9053',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR22131',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 178361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-07',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2012}
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR22131%27 HTTP/1.1" 200 None
2026-03-30 11:56:57 [auto1.de] INFO: Saving data for HR22131: {'auction_closing_time': 1774886304.0, 'created_time': 1774694204.171055, 'last_price_update_time': 1774871817.365861}
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR22131') HTTP/1.1" 204 0
2026-03-30 11:56:57 [auto1.de] INFO: Found listing with ID: YM01256
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM01256%27 HTTP/1.1" 200 None
2026-03-30 11:56:57 [auto1.de] INFO: Scrape type for YM01256: 2
2026-03-30 11:56:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 359cd182-fddc-5adb-907e-808bb578c25c with identifier: YM01256
2026-03-30 11:56:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 359cd182-fddc-5adb-907e-808bb578c25c with scrape type 2
2026-03-30 11:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 359cd182-fddc-5adb-907e-808bb578c25c with scrape type 2
2026-03-30 11:56:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 359cd182-fddc-5adb-907e-808bb578c25c, identifier: YM01256
2026-03-30 11:56:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 359cd182-fddc-5adb-907e-808bb578c25c with identifier: YM01256
2026-03-30 11:56:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 359cd182-fddc-5adb-907e-808bb578c25c with identifier: YM01256
2026-03-30 11:56:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 359cd182-fddc-5adb-907e-808bb578c25c with identifier: YM01256 to the API
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:13:45Z',
 'fuel_type': 'diesel',
 'id': '359cd182-fddc-5adb-907e-808bb578c25c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM01256',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 176943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-12',
 'seller_name': None,
 'title': 'Jaguar E-Pace D240 SE AWD',
 'transmission': 'automatic',
 'trim': 'SE AWD',
 'year': 2020}
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM01256%27 HTTP/1.1" 200 None
2026-03-30 11:56:57 [auto1.de] INFO: Saving data for YM01256: {'auction_closing_time': 1774883625.0, 'created_time': 1774694185.415845, 'last_price_update_time': 1774871817.768028}
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM01256') HTTP/1.1" 204 0
2026-03-30 11:56:57 [auto1.de] INFO: Found listing with ID: WD92607
2026-03-30 11:56:57 [auto1.de] INFO: Found listing with ID: GM28208
2026-03-30 11:56:57 [auto1.de] INFO: Found listing with ID: XE92374
2026-03-30 11:56:57 [auto1.de] INFO: Found listing with ID: EZ06190
2026-03-30 11:56:57 [auto1.de] INFO: Found listing with ID: AD09354
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD09354%27 HTTP/1.1" 200 None
2026-03-30 11:56:57 [auto1.de] INFO: Scrape type for AD09354: 2
2026-03-30 11:56:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15a9a5af-84fd-5697-90e4-bbb7b99220a5 with identifier: AD09354
2026-03-30 11:56:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15a9a5af-84fd-5697-90e4-bbb7b99220a5 with scrape type 2
2026-03-30 11:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15a9a5af-84fd-5697-90e4-bbb7b99220a5 with scrape type 2
2026-03-30 11:56:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15a9a5af-84fd-5697-90e4-bbb7b99220a5, identifier: AD09354
2026-03-30 11:56:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15a9a5af-84fd-5697-90e4-bbb7b99220a5 with identifier: AD09354
2026-03-30 11:56:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15a9a5af-84fd-5697-90e4-bbb7b99220a5 with identifier: AD09354
2026-03-30 11:56:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15a9a5af-84fd-5697-90e4-bbb7b99220a5 with identifier: AD09354 to the API
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:17:55Z',
 'fuel_type': 'diesel',
 'id': '15a9a5af-84fd-5697-90e4-bbb7b99220a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD09354',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 138977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-05',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2016}
2026-03-30 11:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD09354%27 HTTP/1.1" 200 None
2026-03-30 11:56:58 [auto1.de] INFO: Saving data for AD09354: {'auction_closing_time': 1774883875.0, 'created_time': 1774694068.941724, 'last_price_update_time': 1774871818.180019}
2026-03-30 11:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD09354') HTTP/1.1" 204 0
2026-03-30 11:56:58 [auto1.de] INFO: Found listing with ID: RE79871
2026-03-30 11:56:58 [auto1.de] INFO: Found listing with ID: YD36788
2026-03-30 11:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD36788%27 HTTP/1.1" 200 None
2026-03-30 11:56:58 [auto1.de] INFO: Scrape type for YD36788: 2
2026-03-30 11:56:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b81aad7f-8e28-569e-b293-8a98f3cb0996 with identifier: YD36788
2026-03-30 11:56:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b81aad7f-8e28-569e-b293-8a98f3cb0996 with scrape type 2
2026-03-30 11:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b81aad7f-8e28-569e-b293-8a98f3cb0996 with scrape type 2
2026-03-30 11:56:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b81aad7f-8e28-569e-b293-8a98f3cb0996, identifier: YD36788
2026-03-30 11:56:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b81aad7f-8e28-569e-b293-8a98f3cb0996 with identifier: YD36788
2026-03-30 11:56:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b81aad7f-8e28-569e-b293-8a98f3cb0996 with identifier: YD36788
2026-03-30 11:56:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b81aad7f-8e28-569e-b293-8a98f3cb0996 with identifier: YD36788 to the API
2026-03-30 11:56:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:36:06Z',
 'fuel_type': 'petrol',
 'id': 'b81aad7f-8e28-569e-b293-8a98f3cb0996',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD36788',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 185392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-28',
 'seller_name': None,
 'title': 'Ford Fiesta 1.3 Fun',
 'transmission': 'manual',
 'trim': 'Fun',
 'year': 2006}
2026-03-30 11:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD36788%27 HTTP/1.1" 200 None
2026-03-30 11:56:58 [auto1.de] INFO: Saving data for YD36788: {'auction_closing_time': 1774884966.0, 'created_time': 1774694065.856895, 'last_price_update_time': 1774871818.660755}
2026-03-30 11:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD36788') HTTP/1.1" 204 0
2026-03-30 11:56:58 [auto1.de] INFO: Found listing with ID: EY64053
2026-03-30 11:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY64053%27 HTTP/1.1" 200 None
2026-03-30 11:56:58 [auto1.de] INFO: Scrape type for EY64053: 2
2026-03-30 11:56:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03eda04a-a574-5803-a3df-93d480f8bd52 with identifier: EY64053
2026-03-30 11:56:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03eda04a-a574-5803-a3df-93d480f8bd52 with scrape type 2
2026-03-30 11:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03eda04a-a574-5803-a3df-93d480f8bd52 with scrape type 2
2026-03-30 11:56:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03eda04a-a574-5803-a3df-93d480f8bd52, identifier: EY64053
2026-03-30 11:56:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03eda04a-a574-5803-a3df-93d480f8bd52 with identifier: EY64053
2026-03-30 11:56:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03eda04a-a574-5803-a3df-93d480f8bd52 with identifier: EY64053
2026-03-30 11:56:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03eda04a-a574-5803-a3df-93d480f8bd52 with identifier: EY64053 to the API
2026-03-30 11:56:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:02:44Z',
 'fuel_type': 'petrol',
 'id': '03eda04a-a574-5803-a3df-93d480f8bd52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY64053',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'Forester',
 'odometer': 42316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-22',
 'seller_name': None,
 'title': 'Subaru Forester 2.0 Mild-Hybrid Edition Sport40',
 'transmission': 'automatic',
 'trim': 'Edition Sport40',
 'year': 2021}
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY64053%27 HTTP/1.1" 200 None
2026-03-30 11:56:59 [auto1.de] INFO: Saving data for EY64053: {'auction_closing_time': 1774882964.0, 'created_time': 1774694072.32255, 'last_price_update_time': 1774871819.037036}
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY64053') HTTP/1.1" 204 0
2026-03-30 11:56:59 [auto1.de] INFO: Found listing with ID: NK14391
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK14391%27 HTTP/1.1" 200 None
2026-03-30 11:56:59 [auto1.de] INFO: Scrape type for NK14391: 2
2026-03-30 11:56:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb38948e-5a13-5b35-b748-8ede486b53b7 with identifier: NK14391
2026-03-30 11:56:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb38948e-5a13-5b35-b748-8ede486b53b7 with scrape type 2
2026-03-30 11:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb38948e-5a13-5b35-b748-8ede486b53b7 with scrape type 2
2026-03-30 11:56:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb38948e-5a13-5b35-b748-8ede486b53b7, identifier: NK14391
2026-03-30 11:56:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb38948e-5a13-5b35-b748-8ede486b53b7 with identifier: NK14391
2026-03-30 11:56:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb38948e-5a13-5b35-b748-8ede486b53b7 with identifier: NK14391
2026-03-30 11:56:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb38948e-5a13-5b35-b748-8ede486b53b7 with identifier: NK14391 to the API
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:17:51Z',
 'fuel_type': 'petrol',
 'id': 'bb38948e-5a13-5b35-b748-8ede486b53b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK14391',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 182979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-06',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 170',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK14391%27 HTTP/1.1" 200 None
2026-03-30 11:56:59 [auto1.de] INFO: Saving data for NK14391: {'auction_closing_time': 1774883871.0, 'created_time': 1774694069.355559, 'last_price_update_time': 1774871819.40445}
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK14391') HTTP/1.1" 204 0
2026-03-30 11:56:59 [auto1.de] INFO: Found listing with ID: HA88960
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA88960%27 HTTP/1.1" 200 None
2026-03-30 11:56:59 [auto1.de] INFO: Scrape type for HA88960: 2
2026-03-30 11:56:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3 with identifier: HA88960
2026-03-30 11:56:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3 with scrape type 2
2026-03-30 11:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3 with scrape type 2
2026-03-30 11:56:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3, identifier: HA88960
2026-03-30 11:56:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3 with identifier: HA88960
2026-03-30 11:56:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3 with identifier: HA88960
2026-03-30 11:56:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3 with identifier: HA88960 to the API
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:19:37Z',
 'fuel_type': 'petrol',
 'id': '3e727d63-6f2d-5957-8f00-a46b2fe5e7e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA88960',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 237990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-19',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA88960%27 HTTP/1.1" 200 None
2026-03-30 11:57:18 [auto1.de] INFO: Saving data for HA88960: {'auction_closing_time': 1774883977.0, 'created_time': 1774694069.983274, 'last_price_update_time': 1774871838.807543}
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA88960') HTTP/1.1" 204 0
2026-03-30 11:57:18 [auto1.de] INFO: Found listing with ID: CV20886
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV20886%27 HTTP/1.1" 200 None
2026-03-30 11:57:18 [auto1.de] INFO: Scrape type for CV20886: 2
2026-03-30 11:57:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1997982-b8ac-5f76-816e-ddc917d75208 with identifier: CV20886
2026-03-30 11:57:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1997982-b8ac-5f76-816e-ddc917d75208 with scrape type 2
2026-03-30 11:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1997982-b8ac-5f76-816e-ddc917d75208 with scrape type 2
2026-03-30 11:57:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1997982-b8ac-5f76-816e-ddc917d75208, identifier: CV20886
2026-03-30 11:57:18 [scrapy.extensions.logstats] INFO: Crawled 990 pages (at 5 pages/min), scraped 1435 items (at 58 items/min)
2026-03-30 11:57:18 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:57:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1997982-b8ac-5f76-816e-ddc917d75208 with identifier: CV20886
2026-03-30 11:57:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1997982-b8ac-5f76-816e-ddc917d75208 with identifier: CV20886
2026-03-30 11:57:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1997982-b8ac-5f76-816e-ddc917d75208 with identifier: CV20886 to the API
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:51:56Z',
 'fuel_type': 'diesel',
 'id': 'b1997982-b8ac-5f76-816e-ddc917d75208',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV20886',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 136386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-28',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro Ambition',
 'transmission': 'automatic',
 'trim': 'quattro Ambition',
 'year': 2013}
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV20886%27 HTTP/1.1" 200 None
2026-03-30 11:57:19 [auto1.de] INFO: Saving data for CV20886: {'auction_closing_time': 1774885916.0, 'created_time': 1774694068.528611, 'last_price_update_time': 1774871839.261591}
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV20886') HTTP/1.1" 204 0
2026-03-30 11:57:19 [auto1.de] INFO: Found listing with ID: BF20079
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF20079%27 HTTP/1.1" 200 None
2026-03-30 11:57:19 [auto1.de] INFO: Scrape type for BF20079: 2
2026-03-30 11:57:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b754d76a-4fe3-54a0-b42a-64d9c1b640f9 with identifier: BF20079
2026-03-30 11:57:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b754d76a-4fe3-54a0-b42a-64d9c1b640f9 with scrape type 2
2026-03-30 11:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b754d76a-4fe3-54a0-b42a-64d9c1b640f9 with scrape type 2
2026-03-30 11:57:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b754d76a-4fe3-54a0-b42a-64d9c1b640f9, identifier: BF20079
2026-03-30 11:57:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b754d76a-4fe3-54a0-b42a-64d9c1b640f9 with identifier: BF20079
2026-03-30 11:57:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b754d76a-4fe3-54a0-b42a-64d9c1b640f9 with identifier: BF20079
2026-03-30 11:57:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b754d76a-4fe3-54a0-b42a-64d9c1b640f9 with identifier: BF20079 to the API
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:51:44Z',
 'fuel_type': 'petrol',
 'id': 'b754d76a-4fe3-54a0-b42a-64d9c1b640f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF20079',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 157126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI BlueMotion',
 'year': 2018}
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF20079%27 HTTP/1.1" 200 None
2026-03-30 11:57:19 [auto1.de] INFO: Saving data for BF20079: {'auction_closing_time': 1774885904.0, 'created_time': 1774694073.224824, 'last_price_update_time': 1774871839.701673}
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF20079') HTTP/1.1" 204 0
2026-03-30 11:57:19 [auto1.de] INFO: Found listing with ID: GJ71513
2026-03-30 11:57:19 [auto1.de] INFO: Found listing with ID: XT67531
2026-03-30 11:57:19 [auto1.de] INFO: Found listing with ID: PB33753
2026-03-30 11:57:19 [auto1.de] INFO: Found listing with ID: TU57767
2026-03-30 11:57:19 [auto1.de] INFO: Found listing with ID: YH86831
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH86831%27 HTTP/1.1" 200 None
2026-03-30 11:57:19 [auto1.de] INFO: Scrape type for YH86831: 2
2026-03-30 11:57:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 731a2dbc-6a6f-54bb-86fd-416c2bbb9121 with identifier: YH86831
2026-03-30 11:57:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 731a2dbc-6a6f-54bb-86fd-416c2bbb9121 with scrape type 2
2026-03-30 11:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 731a2dbc-6a6f-54bb-86fd-416c2bbb9121 with scrape type 2
2026-03-30 11:57:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 731a2dbc-6a6f-54bb-86fd-416c2bbb9121, identifier: YH86831
2026-03-30 11:57:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 731a2dbc-6a6f-54bb-86fd-416c2bbb9121 with identifier: YH86831
2026-03-30 11:57:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 731a2dbc-6a6f-54bb-86fd-416c2bbb9121 with identifier: YH86831
2026-03-30 11:57:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 731a2dbc-6a6f-54bb-86fd-416c2bbb9121 with identifier: YH86831 to the API
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:47:12Z',
 'fuel_type': 'diesel',
 'id': '731a2dbc-6a6f-54bb-86fd-416c2bbb9121',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH86831',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 177977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-26',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2013}
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH86831%27 HTTP/1.1" 200 None
2026-03-30 11:57:20 [auto1.de] INFO: Saving data for YH86831: {'auction_closing_time': 1774885632.0, 'created_time': 1774694072.797569, 'last_price_update_time': 1774871840.099838}
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH86831') HTTP/1.1" 204 0
2026-03-30 11:57:20 [auto1.de] INFO: Found listing with ID: GU24004
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU24004%27 HTTP/1.1" 200 None
2026-03-30 11:57:20 [auto1.de] INFO: Scrape type for GU24004: 2
2026-03-30 11:57:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1ac83ee-d2d0-5830-bbad-b7457acecb1d with identifier: GU24004
2026-03-30 11:57:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1ac83ee-d2d0-5830-bbad-b7457acecb1d with scrape type 2
2026-03-30 11:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1ac83ee-d2d0-5830-bbad-b7457acecb1d with scrape type 2
2026-03-30 11:57:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1ac83ee-d2d0-5830-bbad-b7457acecb1d, identifier: GU24004
2026-03-30 11:57:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1ac83ee-d2d0-5830-bbad-b7457acecb1d with identifier: GU24004
2026-03-30 11:57:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1ac83ee-d2d0-5830-bbad-b7457acecb1d with identifier: GU24004
2026-03-30 11:57:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1ac83ee-d2d0-5830-bbad-b7457acecb1d with identifier: GU24004 to the API
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:59:58Z',
 'fuel_type': 'petrol',
 'id': 'c1ac83ee-d2d0-5830-bbad-b7457acecb1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU24004',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 55588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-01',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2008}
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU24004%27 HTTP/1.1" 200 None
2026-03-30 11:57:20 [auto1.de] INFO: Saving data for GU24004: {'auction_closing_time': 1774886398.0, 'created_time': 1774031449.386222, 'last_price_update_time': 1774871840.583504}
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU24004') HTTP/1.1" 204 0
2026-03-30 11:57:20 [auto1.de] INFO: Found listing with ID: KR12848
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR12848%27 HTTP/1.1" 200 None
2026-03-30 11:57:20 [auto1.de] INFO: Scrape type for KR12848: 2
2026-03-30 11:57:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e66d2369-84ab-5547-82d1-4404b80b8f02 with identifier: KR12848
2026-03-30 11:57:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e66d2369-84ab-5547-82d1-4404b80b8f02 with scrape type 2
2026-03-30 11:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e66d2369-84ab-5547-82d1-4404b80b8f02 with scrape type 2
2026-03-30 11:57:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e66d2369-84ab-5547-82d1-4404b80b8f02, identifier: KR12848
2026-03-30 11:57:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e66d2369-84ab-5547-82d1-4404b80b8f02 with identifier: KR12848
2026-03-30 11:57:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e66d2369-84ab-5547-82d1-4404b80b8f02 with identifier: KR12848
2026-03-30 11:57:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e66d2369-84ab-5547-82d1-4404b80b8f02 with identifier: KR12848 to the API
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:02:06Z',
 'fuel_type': 'petrol',
 'id': 'e66d2369-84ab-5547-82d1-4404b80b8f02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR12848',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 89270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-31',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR12848%27 HTTP/1.1" 200 None
2026-03-30 11:57:20 [auto1.de] INFO: Saving data for KR12848: {'auction_closing_time': 1774882926.0, 'created_time': 1773427823.4383, 'last_price_update_time': 1774871840.975545}
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR12848') HTTP/1.1" 204 0
2026-03-30 11:57:20 [auto1.de] INFO: Found listing with ID: HR78495
2026-03-30 11:58:04 [scrapy.extensions.logstats] INFO: Crawled 990 pages (at 0 pages/min), scraped 1440 items (at 5 items/min)
2026-03-30 11:58:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:59:04 [scrapy.extensions.logstats] INFO: Crawled 990 pages (at 0 pages/min), scraped 1440 items (at 0 items/min)
2026-03-30 11:59:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 11:59:04 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.845(s), this was the 1st time calling it.
2026-03-30 11:59:04 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.915962767505351 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:59:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:59:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:59:13 [auto1.de] INFO: Channel: 24h | Page: 243 | totalHits: 10019 | hits on page: 40
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: MN00804
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN00804%27 HTTP/1.1" 200 None
2026-03-30 11:59:13 [auto1.de] INFO: Scrape type for MN00804: 0
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: CR42013
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: GH25955
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH25955%27 HTTP/1.1" 200 None
2026-03-30 11:59:13 [auto1.de] INFO: Scrape type for GH25955: 0
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: AF81396
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF81396%27 HTTP/1.1" 200 None
2026-03-30 11:59:13 [auto1.de] INFO: Scrape type for AF81396: 0
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: FJ89028
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ89028%27 HTTP/1.1" 200 None
2026-03-30 11:59:13 [auto1.de] INFO: Scrape type for FJ89028: 0
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: CU69011
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: GY71036
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY71036%27 HTTP/1.1" 200 None
2026-03-30 11:59:13 [auto1.de] INFO: Scrape type for GY71036: 0
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: HB96226
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB96226%27 HTTP/1.1" 200 None
2026-03-30 11:59:13 [auto1.de] INFO: Scrape type for HB96226: 0
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: GS36349
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36349%27 HTTP/1.1" 200 None
2026-03-30 11:59:13 [auto1.de] INFO: Scrape type for GS36349: 0
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: HA50795
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA50795%27 HTTP/1.1" 200 None
2026-03-30 11:59:13 [auto1.de] INFO: Scrape type for HA50795: 0
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: UZ55149
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ55149%27 HTTP/1.1" 200 None
2026-03-30 11:59:13 [auto1.de] INFO: Scrape type for UZ55149: 0
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: NC03535
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC03535%27 HTTP/1.1" 200 None
2026-03-30 11:59:13 [auto1.de] INFO: Scrape type for NC03535: 0
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: HR22131
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR22131%27 HTTP/1.1" 200 None
2026-03-30 11:59:13 [auto1.de] INFO: Scrape type for HR22131: 0
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: YM01256
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM01256%27 HTTP/1.1" 200 None
2026-03-30 11:59:13 [auto1.de] INFO: Scrape type for YM01256: 0
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: WD92607
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: GM28208
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: XE92374
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: EZ06190
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: AD09354
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD09354%27 HTTP/1.1" 200 None
2026-03-30 11:59:13 [auto1.de] INFO: Scrape type for AD09354: 0
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: RE79871
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: YD36788
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD36788%27 HTTP/1.1" 200 None
2026-03-30 11:59:13 [auto1.de] INFO: Scrape type for YD36788: 0
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: EY64053
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY64053%27 HTTP/1.1" 200 None
2026-03-30 11:59:13 [auto1.de] INFO: Scrape type for EY64053: 0
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: NK14391
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK14391%27 HTTP/1.1" 200 None
2026-03-30 11:59:13 [auto1.de] INFO: Scrape type for NK14391: 0
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: HA88960
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA88960%27 HTTP/1.1" 200 None
2026-03-30 11:59:13 [auto1.de] INFO: Scrape type for HA88960: 0
2026-03-30 11:59:13 [auto1.de] INFO: Found listing with ID: CV20886
2026-03-30 11:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV20886%27 HTTP/1.1" 200 None
2026-03-30 11:59:14 [auto1.de] INFO: Scrape type for CV20886: 0
2026-03-30 11:59:14 [auto1.de] INFO: Found listing with ID: BF20079
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF20079%27 HTTP/1.1" 200 None
2026-03-30 11:59:14 [auto1.de] INFO: Scrape type for BF20079: 0
2026-03-30 11:59:14 [auto1.de] INFO: Found listing with ID: GJ71513
2026-03-30 11:59:14 [auto1.de] INFO: Found listing with ID: XT67531
2026-03-30 11:59:14 [auto1.de] INFO: Found listing with ID: PB33753
2026-03-30 11:59:14 [auto1.de] INFO: Found listing with ID: TU57767
2026-03-30 11:59:14 [auto1.de] INFO: Found listing with ID: YH86831
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH86831%27 HTTP/1.1" 200 None
2026-03-30 11:59:14 [auto1.de] INFO: Scrape type for YH86831: 0
2026-03-30 11:59:14 [auto1.de] INFO: Found listing with ID: GU24004
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU24004%27 HTTP/1.1" 200 None
2026-03-30 11:59:14 [auto1.de] INFO: Scrape type for GU24004: 0
2026-03-30 11:59:14 [auto1.de] INFO: Found listing with ID: KR12848
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR12848%27 HTTP/1.1" 200 None
2026-03-30 11:59:14 [auto1.de] INFO: Scrape type for KR12848: 0
2026-03-30 11:59:14 [auto1.de] INFO: Found listing with ID: HR78495
2026-03-30 11:59:14 [auto1.de] INFO: Found listing with ID: RR83304
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR83304%27 HTTP/1.1" 200 None
2026-03-30 11:59:14 [auto1.de] INFO: Scrape type for RR83304: 2
2026-03-30 11:59:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d with identifier: RR83304
2026-03-30 11:59:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d with scrape type 2
2026-03-30 11:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d with scrape type 2
2026-03-30 11:59:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d, identifier: RR83304
2026-03-30 11:59:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d with identifier: RR83304
2026-03-30 11:59:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d with identifier: RR83304
2026-03-30 11:59:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d with identifier: RR83304 to the API
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:41Z',
 'fuel_type': 'petrol',
 'id': '82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR83304',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 164389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-17',
 'seller_name': None,
 'title': 'Mazda 5 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2012}
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR83304%27 HTTP/1.1" 200 None
2026-03-30 11:59:14 [auto1.de] INFO: Saving data for RR83304: {'auction_closing_time': 1774884641.0, 'created_time': 1774694244.551026, 'last_price_update_time': 1774871954.455743}
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR83304') HTTP/1.1" 204 0
2026-03-30 11:59:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:59:14 [auto1.de] INFO: Found listing with ID: UE39516
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE39516%27 HTTP/1.1" 200 None
2026-03-30 11:59:14 [auto1.de] INFO: Scrape type for UE39516: 2
2026-03-30 11:59:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e with identifier: UE39516
2026-03-30 11:59:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e with scrape type 2
2026-03-30 11:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e with scrape type 2
2026-03-30 11:59:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e, identifier: UE39516
2026-03-30 11:59:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e with identifier: UE39516
2026-03-30 11:59:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e with identifier: UE39516
2026-03-30 11:59:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e with identifier: UE39516 to the API
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:01:47Z',
 'fuel_type': 'petrol',
 'id': 'a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE39516',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 12585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-27',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2014}
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE39516%27 HTTP/1.1" 200 None
2026-03-30 11:59:14 [auto1.de] INFO: Saving data for UE39516: {'auction_closing_time': 1774882907.0, 'created_time': 1774694246.582082, 'last_price_update_time': 1774871954.958445}
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE39516') HTTP/1.1" 204 0
2026-03-30 11:59:14 [auto1.de] INFO: Found listing with ID: GM93366
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93366%27 HTTP/1.1" 200 None
2026-03-30 11:59:14 [auto1.de] INFO: Scrape type for GM93366: 2
2026-03-30 11:59:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b8a18e4-a97b-570d-9d0c-32265795a1ab with identifier: GM93366
2026-03-30 11:59:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b8a18e4-a97b-570d-9d0c-32265795a1ab with scrape type 2
2026-03-30 11:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b8a18e4-a97b-570d-9d0c-32265795a1ab with scrape type 2
2026-03-30 11:59:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b8a18e4-a97b-570d-9d0c-32265795a1ab, identifier: GM93366
2026-03-30 11:59:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b8a18e4-a97b-570d-9d0c-32265795a1ab with identifier: GM93366
2026-03-30 11:59:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b8a18e4-a97b-570d-9d0c-32265795a1ab with identifier: GM93366
2026-03-30 11:59:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b8a18e4-a97b-570d-9d0c-32265795a1ab with identifier: GM93366 to the API
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 71,
 'expiration_date': '2026-03-30T15:19:41Z',
 'fuel_type': 'petrol',
 'id': '9b8a18e4-a97b-570d-9d0c-32265795a1ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM93366',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 56254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-22',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.2 Select+',
 'transmission': 'manual',
 'trim': 'Select+',
 'year': 2023}
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93366%27 HTTP/1.1" 200 None
2026-03-30 11:59:15 [auto1.de] INFO: Saving data for GM93366: {'auction_closing_time': 1774883981.0, 'created_time': 1774694248.664675, 'last_price_update_time': 1774871955.350417}
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM93366') HTTP/1.1" 204 0
2026-03-30 11:59:15 [auto1.de] INFO: Found listing with ID: VV13794
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV13794%27 HTTP/1.1" 200 None
2026-03-30 11:59:15 [auto1.de] INFO: Scrape type for VV13794: 2
2026-03-30 11:59:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b with identifier: VV13794
2026-03-30 11:59:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b with scrape type 2
2026-03-30 11:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b with scrape type 2
2026-03-30 11:59:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b, identifier: VV13794
2026-03-30 11:59:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b with identifier: VV13794
2026-03-30 11:59:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b with identifier: VV13794
2026-03-30 11:59:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b with identifier: VV13794 to the API
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:11:56Z',
 'fuel_type': 'diesel',
 'id': '2208c465-4e02-57a6-85a6-2a2d0f9f0d1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV13794',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 41839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-05',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2023}
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV13794%27 HTTP/1.1" 200 None
2026-03-30 11:59:15 [auto1.de] INFO: Saving data for VV13794: {'auction_closing_time': 1774883516.0, 'created_time': 1773302816.426452, 'last_price_update_time': 1774871955.769725}
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV13794') HTTP/1.1" 204 0
2026-03-30 11:59:15 [auto1.de] INFO: Found listing with ID: RU85035
2026-03-30 11:59:15 [auto1.de] INFO: Found listing with ID: YZ93314
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ93314%27 HTTP/1.1" 200 None
2026-03-30 11:59:15 [auto1.de] INFO: Scrape type for YZ93314: 2
2026-03-30 11:59:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d1dd039-1e61-50eb-a5cd-8c14f81b000d with identifier: YZ93314
2026-03-30 11:59:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d1dd039-1e61-50eb-a5cd-8c14f81b000d with scrape type 2
2026-03-30 11:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d1dd039-1e61-50eb-a5cd-8c14f81b000d with scrape type 2
2026-03-30 11:59:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d1dd039-1e61-50eb-a5cd-8c14f81b000d, identifier: YZ93314
2026-03-30 11:59:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d1dd039-1e61-50eb-a5cd-8c14f81b000d with identifier: YZ93314
2026-03-30 11:59:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d1dd039-1e61-50eb-a5cd-8c14f81b000d with identifier: YZ93314
2026-03-30 11:59:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d1dd039-1e61-50eb-a5cd-8c14f81b000d with identifier: YZ93314 to the API
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:37:35Z',
 'fuel_type': 'diesel',
 'id': '9d1dd039-1e61-50eb-a5cd-8c14f81b000d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ93314',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 126211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-30',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2016}
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ93314%27 HTTP/1.1" 200 None
2026-03-30 11:59:16 [auto1.de] INFO: Saving data for YZ93314: {'auction_closing_time': 1774885055.0, 'created_time': 1774349599.288837, 'last_price_update_time': 1774871956.157737}
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ93314') HTTP/1.1" 204 0
2026-03-30 11:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:59:17 [auto1.de] INFO: Channel: 24h | Page: 244 | totalHits: 10020 | hits on page: 40
2026-03-30 11:59:17 [auto1.de] INFO: Found listing with ID: YZ93314
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ93314%27 HTTP/1.1" 200 None
2026-03-30 11:59:17 [auto1.de] INFO: Scrape type for YZ93314: 0
2026-03-30 11:59:17 [auto1.de] INFO: Found listing with ID: VJ45584
2026-03-30 11:59:17 [auto1.de] INFO: Found listing with ID: ZE64138
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE64138%27 HTTP/1.1" 200 None
2026-03-30 11:59:17 [auto1.de] INFO: Scrape type for ZE64138: 2
2026-03-30 11:59:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with identifier: ZE64138
2026-03-30 11:59:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with scrape type 2
2026-03-30 11:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with scrape type 2
2026-03-30 11:59:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8, identifier: ZE64138
2026-03-30 11:59:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with identifier: ZE64138
2026-03-30 11:59:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with identifier: ZE64138
2026-03-30 11:59:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with identifier: ZE64138 to the API
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:28:18Z',
 'fuel_type': 'diesel',
 'id': 'ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE64138',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 167222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-23',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2019}
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE64138%27 HTTP/1.1" 200 None
2026-03-30 11:59:17 [auto1.de] INFO: Saving data for ZE64138: {'auction_closing_time': 1774884498.0, 'created_time': 1773428711.309024, 'last_price_update_time': 1774871957.535707}
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE64138') HTTP/1.1" 204 0
2026-03-30 11:59:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:59:17 [auto1.de] INFO: Found listing with ID: FH72870
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH72870%27 HTTP/1.1" 200 None
2026-03-30 11:59:17 [auto1.de] INFO: Scrape type for FH72870: 2
2026-03-30 11:59:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86906fa7-6293-511d-94fc-741a93ab8427 with identifier: FH72870
2026-03-30 11:59:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86906fa7-6293-511d-94fc-741a93ab8427 with scrape type 2
2026-03-30 11:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86906fa7-6293-511d-94fc-741a93ab8427 with scrape type 2
2026-03-30 11:59:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86906fa7-6293-511d-94fc-741a93ab8427, identifier: FH72870
2026-03-30 11:59:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86906fa7-6293-511d-94fc-741a93ab8427 with identifier: FH72870
2026-03-30 11:59:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86906fa7-6293-511d-94fc-741a93ab8427 with identifier: FH72870
2026-03-30 11:59:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86906fa7-6293-511d-94fc-741a93ab8427 with identifier: FH72870 to the API
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:39:30Z',
 'fuel_type': 'petrol',
 'id': '86906fa7-6293-511d-94fc-741a93ab8427',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH72870',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 230943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-26',
 'seller_name': None,
 'title': 'Volkswagen Beetle 2.0 TSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2012}
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH72870%27 HTTP/1.1" 200 None
2026-03-30 11:59:17 [auto1.de] INFO: Saving data for FH72870: {'auction_closing_time': 1774885170.0, 'created_time': 1774349732.154987, 'last_price_update_time': 1774871957.94767}
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH72870') HTTP/1.1" 204 0
2026-03-30 11:59:17 [auto1.de] INFO: Found listing with ID: GR32471
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR32471%27 HTTP/1.1" 200 None
2026-03-30 11:59:17 [auto1.de] INFO: Scrape type for GR32471: 2
2026-03-30 11:59:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14343135-c4a8-59cd-a600-8b45a60a94b0 with identifier: GR32471
2026-03-30 11:59:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14343135-c4a8-59cd-a600-8b45a60a94b0 with scrape type 2
2026-03-30 11:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14343135-c4a8-59cd-a600-8b45a60a94b0 with scrape type 2
2026-03-30 11:59:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14343135-c4a8-59cd-a600-8b45a60a94b0, identifier: GR32471
2026-03-30 11:59:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14343135-c4a8-59cd-a600-8b45a60a94b0 with identifier: GR32471
2026-03-30 11:59:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14343135-c4a8-59cd-a600-8b45a60a94b0 with identifier: GR32471
2026-03-30 11:59:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14343135-c4a8-59cd-a600-8b45a60a94b0 with identifier: GR32471 to the API
2026-03-30 11:59:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:15Z',
 'fuel_type': 'petrol',
 'id': '14343135-c4a8-59cd-a600-8b45a60a94b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR32471',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 48275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-16',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-30 11:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR32471%27 HTTP/1.1" 200 None
2026-03-30 11:59:18 [auto1.de] INFO: Saving data for GR32471: {'auction_closing_time': 1774886055.0, 'created_time': 1774694093.798396, 'last_price_update_time': 1774871958.357296}
2026-03-30 11:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR32471') HTTP/1.1" 204 0
2026-03-30 11:59:18 [auto1.de] INFO: Found listing with ID: RV36249
2026-03-30 11:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV36249%27 HTTP/1.1" 200 None
2026-03-30 11:59:18 [auto1.de] INFO: Scrape type for RV36249: 2
2026-03-30 11:59:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1db3db65-0326-572c-81bf-2393918dec44 with identifier: RV36249
2026-03-30 11:59:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1db3db65-0326-572c-81bf-2393918dec44 with scrape type 2
2026-03-30 11:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1db3db65-0326-572c-81bf-2393918dec44 with scrape type 2
2026-03-30 11:59:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1db3db65-0326-572c-81bf-2393918dec44, identifier: RV36249
2026-03-30 11:59:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1db3db65-0326-572c-81bf-2393918dec44 with identifier: RV36249
2026-03-30 11:59:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1db3db65-0326-572c-81bf-2393918dec44 with identifier: RV36249
2026-03-30 11:59:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1db3db65-0326-572c-81bf-2393918dec44 with identifier: RV36249 to the API
2026-03-30 11:59:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:39:56Z',
 'fuel_type': 'petrol',
 'id': '1db3db65-0326-572c-81bf-2393918dec44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV36249',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 137396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-05-15',
 'seller_name': None,
 'title': 'Audi TT 1.8 Turbo Roadster',
 'transmission': 'manual',
 'trim': 'Roadster',
 'year': 2000}
2026-03-30 11:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV36249%27 HTTP/1.1" 200 None
2026-03-30 11:59:18 [auto1.de] INFO: Saving data for RV36249: {'auction_closing_time': 1774885196.0, 'created_time': 1774694102.50061, 'last_price_update_time': 1774871958.739132}
2026-03-30 11:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV36249') HTTP/1.1" 204 0
2026-03-30 11:59:18 [auto1.de] INFO: Found listing with ID: UB45344
2026-03-30 11:59:18 [auto1.de] INFO: Found listing with ID: TJ69669
2026-03-30 11:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ69669%27 HTTP/1.1" 200 None
2026-03-30 11:59:18 [auto1.de] INFO: Scrape type for TJ69669: 2
2026-03-30 11:59:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de9788a7-ace5-5900-a7e0-c3dd9f734d80 with identifier: TJ69669
2026-03-30 11:59:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de9788a7-ace5-5900-a7e0-c3dd9f734d80 with scrape type 2
2026-03-30 11:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de9788a7-ace5-5900-a7e0-c3dd9f734d80 with scrape type 2
2026-03-30 11:59:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de9788a7-ace5-5900-a7e0-c3dd9f734d80, identifier: TJ69669
2026-03-30 11:59:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de9788a7-ace5-5900-a7e0-c3dd9f734d80 with identifier: TJ69669
2026-03-30 11:59:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de9788a7-ace5-5900-a7e0-c3dd9f734d80 with identifier: TJ69669
2026-03-30 11:59:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de9788a7-ace5-5900-a7e0-c3dd9f734d80 with identifier: TJ69669 to the API
2026-03-30 11:59:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:54:56Z',
 'fuel_type': 'petrol',
 'id': 'de9788a7-ace5-5900-a7e0-c3dd9f734d80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ69669',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 213913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-10-19',
 'seller_name': None,
 'title': 'BMW 7er 735i L',
 'transmission': 'automatic',
 'trim': 'L',
 'year': 2004}
2026-03-30 11:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ69669%27 HTTP/1.1" 200 None
2026-03-30 11:59:19 [auto1.de] INFO: Saving data for TJ69669: {'auction_closing_time': 1774886096.0, 'created_time': 1774694172.70101, 'last_price_update_time': 1774871959.210278}
2026-03-30 11:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ69669') HTTP/1.1" 204 0
2026-03-30 11:59:19 [auto1.de] INFO: Found listing with ID: CX33153
2026-03-30 11:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX33153%27 HTTP/1.1" 200 None
2026-03-30 11:59:19 [auto1.de] INFO: Scrape type for CX33153: 2
2026-03-30 11:59:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac2daf7a-7463-583c-b610-2b84de3ebca8 with identifier: CX33153
2026-03-30 11:59:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac2daf7a-7463-583c-b610-2b84de3ebca8 with scrape type 2
2026-03-30 11:59:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac2daf7a-7463-583c-b610-2b84de3ebca8 with scrape type 2
2026-03-30 11:59:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac2daf7a-7463-583c-b610-2b84de3ebca8, identifier: CX33153
2026-03-30 11:59:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac2daf7a-7463-583c-b610-2b84de3ebca8 with identifier: CX33153
2026-03-30 11:59:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac2daf7a-7463-583c-b610-2b84de3ebca8 with identifier: CX33153
2026-03-30 11:59:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac2daf7a-7463-583c-b610-2b84de3ebca8 with identifier: CX33153 to the API
2026-03-30 11:59:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:30:02Z',
 'fuel_type': 'diesel',
 'id': 'ac2daf7a-7463-583c-b610-2b84de3ebca8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX33153',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 205182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-15',
 'seller_name': None,
 'title': 'Volvo V50 1.6 D2 Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2012}
2026-03-30 11:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX33153%27 HTTP/1.1" 200 None
2026-03-30 11:59:19 [auto1.de] INFO: Saving data for CX33153: {'auction_closing_time': 1774884602.0, 'created_time': 1774032868.602166, 'last_price_update_time': 1774871959.595739}
2026-03-30 11:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX33153') HTTP/1.1" 204 0
2026-03-30 11:59:19 [auto1.de] INFO: Found listing with ID: XL82798
2026-03-30 11:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL82798%27 HTTP/1.1" 200 None
2026-03-30 11:59:19 [auto1.de] INFO: Scrape type for XL82798: 2
2026-03-30 11:59:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a02ad922-971e-54a5-8fdc-c6567d88302d with identifier: XL82798
2026-03-30 11:59:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a02ad922-971e-54a5-8fdc-c6567d88302d with scrape type 2
2026-03-30 11:59:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a02ad922-971e-54a5-8fdc-c6567d88302d with scrape type 2
2026-03-30 11:59:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a02ad922-971e-54a5-8fdc-c6567d88302d, identifier: XL82798
2026-03-30 11:59:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a02ad922-971e-54a5-8fdc-c6567d88302d with identifier: XL82798
2026-03-30 11:59:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a02ad922-971e-54a5-8fdc-c6567d88302d with identifier: XL82798
2026-03-30 11:59:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a02ad922-971e-54a5-8fdc-c6567d88302d with identifier: XL82798 to the API
2026-03-30 11:59:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-30T15:16:55Z',
 'fuel_type': 'petrol',
 'id': 'a02ad922-971e-54a5-8fdc-c6567d88302d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL82798',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 200178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-01-31',
 'seller_name': None,
 'title': 'Mazda 6 2.0 Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2007}
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL82798%27 HTTP/1.1" 200 None
2026-03-30 11:59:20 [auto1.de] INFO: Saving data for XL82798: {'auction_closing_time': 1774883815.0, 'created_time': 1774694113.341895, 'last_price_update_time': 1774871960.03777}
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL82798') HTTP/1.1" 204 0
2026-03-30 11:59:20 [auto1.de] INFO: Found listing with ID: NF65282
2026-03-30 11:59:20 [auto1.de] INFO: Found listing with ID: DE88009
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE88009%27 HTTP/1.1" 200 None
2026-03-30 11:59:20 [auto1.de] INFO: Scrape type for DE88009: 2
2026-03-30 11:59:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9be9d28-90d2-5cda-b5d8-7e02de97eaaa with identifier: DE88009
2026-03-30 11:59:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9be9d28-90d2-5cda-b5d8-7e02de97eaaa with scrape type 2
2026-03-30 11:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9be9d28-90d2-5cda-b5d8-7e02de97eaaa with scrape type 2
2026-03-30 11:59:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9be9d28-90d2-5cda-b5d8-7e02de97eaaa, identifier: DE88009
2026-03-30 11:59:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9be9d28-90d2-5cda-b5d8-7e02de97eaaa with identifier: DE88009
2026-03-30 11:59:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9be9d28-90d2-5cda-b5d8-7e02de97eaaa with identifier: DE88009
2026-03-30 11:59:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9be9d28-90d2-5cda-b5d8-7e02de97eaaa with identifier: DE88009 to the API
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:21:42Z',
 'fuel_type': 'diesel',
 'id': 'd9be9d28-90d2-5cda-b5d8-7e02de97eaaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE88009',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 121387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2017}
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE88009%27 HTTP/1.1" 200 None
2026-03-30 11:59:20 [auto1.de] INFO: Saving data for DE88009: {'auction_closing_time': 1774884102.0, 'created_time': 1774118823.170682, 'last_price_update_time': 1774871960.42109}
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE88009') HTTP/1.1" 204 0
2026-03-30 11:59:20 [auto1.de] INFO: Found listing with ID: HF51839
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF51839%27 HTTP/1.1" 200 None
2026-03-30 11:59:20 [auto1.de] INFO: Scrape type for HF51839: 2
2026-03-30 11:59:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2652391c-004d-567a-a177-39b2dc05ed5d with identifier: HF51839
2026-03-30 11:59:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2652391c-004d-567a-a177-39b2dc05ed5d with scrape type 2
2026-03-30 11:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2652391c-004d-567a-a177-39b2dc05ed5d with scrape type 2
2026-03-30 11:59:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2652391c-004d-567a-a177-39b2dc05ed5d, identifier: HF51839
2026-03-30 11:59:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2652391c-004d-567a-a177-39b2dc05ed5d with identifier: HF51839
2026-03-30 11:59:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2652391c-004d-567a-a177-39b2dc05ed5d with identifier: HF51839
2026-03-30 11:59:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2652391c-004d-567a-a177-39b2dc05ed5d with identifier: HF51839 to the API
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:34:57Z',
 'fuel_type': 'petrol',
 'id': '2652391c-004d-567a-a177-39b2dc05ed5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF51839',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 157865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-21',
 'seller_name': None,
 'title': 'Opel Adam 1.4 120 Jahre',
 'transmission': 'manual',
 'trim': '120 Jahre',
 'year': 2019}
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF51839%27 HTTP/1.1" 200 None
2026-03-30 11:59:20 [auto1.de] INFO: Saving data for HF51839: {'auction_closing_time': 1774884897.0, 'created_time': 1774694201.465885, 'last_price_update_time': 1774871960.803425}
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF51839') HTTP/1.1" 204 0
2026-03-30 11:59:20 [auto1.de] INFO: Found listing with ID: LM10522
2026-03-30 11:59:20 [auto1.de] INFO: Found listing with ID: VG29831
2026-03-30 11:59:20 [auto1.de] INFO: Found listing with ID: GX51381
2026-03-30 11:59:20 [auto1.de] INFO: Found listing with ID: EC79074
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC79074%27 HTTP/1.1" 200 None
2026-03-30 11:59:20 [auto1.de] INFO: Scrape type for EC79074: 2
2026-03-30 11:59:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1daf73af-3354-5d41-a492-cd78cc06b189 with identifier: EC79074
2026-03-30 11:59:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1daf73af-3354-5d41-a492-cd78cc06b189 with scrape type 2
2026-03-30 11:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1daf73af-3354-5d41-a492-cd78cc06b189 with scrape type 2
2026-03-30 11:59:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1daf73af-3354-5d41-a492-cd78cc06b189, identifier: EC79074
2026-03-30 11:59:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1daf73af-3354-5d41-a492-cd78cc06b189 with identifier: EC79074
2026-03-30 11:59:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1daf73af-3354-5d41-a492-cd78cc06b189 with identifier: EC79074
2026-03-30 11:59:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1daf73af-3354-5d41-a492-cd78cc06b189 with identifier: EC79074 to the API
2026-03-30 11:59:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:44Z',
 'fuel_type': 'diesel',
 'id': '1daf73af-3354-5d41-a492-cd78cc06b189',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC79074',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 324456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-13',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 11:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC79074%27 HTTP/1.1" 200 None
2026-03-30 11:59:21 [auto1.de] INFO: Saving data for EC79074: {'auction_closing_time': 1774884224.0, 'created_time': 1774694105.757887, 'last_price_update_time': 1774871961.202069}
2026-03-30 11:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC79074') HTTP/1.1" 204 0
2026-03-30 11:59:21 [auto1.de] INFO: Found listing with ID: YP50016
2026-03-30 11:59:21 [auto1.de] INFO: Found listing with ID: KE20907
2026-03-30 11:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE20907%27 HTTP/1.1" 200 None
2026-03-30 11:59:21 [auto1.de] INFO: Scrape type for KE20907: 2
2026-03-30 11:59:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 030a247d-f685-53c6-abd3-6e27a13efc2e with identifier: KE20907
2026-03-30 11:59:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 030a247d-f685-53c6-abd3-6e27a13efc2e with scrape type 2
2026-03-30 11:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 030a247d-f685-53c6-abd3-6e27a13efc2e with scrape type 2
2026-03-30 11:59:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 030a247d-f685-53c6-abd3-6e27a13efc2e, identifier: KE20907
2026-03-30 11:59:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 030a247d-f685-53c6-abd3-6e27a13efc2e with identifier: KE20907
2026-03-30 11:59:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 030a247d-f685-53c6-abd3-6e27a13efc2e with identifier: KE20907
2026-03-30 11:59:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 030a247d-f685-53c6-abd3-6e27a13efc2e with identifier: KE20907 to the API
2026-03-30 11:59:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:58:16Z',
 'fuel_type': 'petrol',
 'id': '030a247d-f685-53c6-abd3-6e27a13efc2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE20907',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 129421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-30',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 11:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE20907%27 HTTP/1.1" 200 None
2026-03-30 11:59:21 [auto1.de] INFO: Saving data for KE20907: {'auction_closing_time': 1774886296.0, 'created_time': 1774694321.230602, 'last_price_update_time': 1774871961.694048}
2026-03-30 11:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE20907') HTTP/1.1" 204 0
2026-03-30 11:59:21 [auto1.de] INFO: Found listing with ID: XN06908
2026-03-30 11:59:21 [auto1.de] INFO: Found listing with ID: SY64199
2026-03-30 11:59:21 [auto1.de] INFO: Found listing with ID: ZM57049
2026-03-30 11:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM57049%27 HTTP/1.1" 200 None
2026-03-30 11:59:21 [auto1.de] INFO: Scrape type for ZM57049: 2
2026-03-30 11:59:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ac4764f-d828-590a-822d-84fb53c8f546 with identifier: ZM57049
2026-03-30 11:59:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ac4764f-d828-590a-822d-84fb53c8f546 with scrape type 2
2026-03-30 11:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ac4764f-d828-590a-822d-84fb53c8f546 with scrape type 2
2026-03-30 11:59:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ac4764f-d828-590a-822d-84fb53c8f546, identifier: ZM57049
2026-03-30 11:59:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ac4764f-d828-590a-822d-84fb53c8f546 with identifier: ZM57049
2026-03-30 11:59:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ac4764f-d828-590a-822d-84fb53c8f546 with identifier: ZM57049
2026-03-30 11:59:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ac4764f-d828-590a-822d-84fb53c8f546 with identifier: ZM57049 to the API
2026-03-30 11:59:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:27:44Z',
 'fuel_type': 'petrol',
 'id': '7ac4764f-d828-590a-822d-84fb53c8f546',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM57049',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 263804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-18',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2013}
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM57049%27 HTTP/1.1" 200 None
2026-03-30 11:59:22 [auto1.de] INFO: Saving data for ZM57049: {'auction_closing_time': 1774884464.0, 'created_time': 1774002630.422864, 'last_price_update_time': 1774871962.082354}
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM57049') HTTP/1.1" 204 0
2026-03-30 11:59:22 [auto1.de] INFO: Found listing with ID: KW41122
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW41122%27 HTTP/1.1" 200 None
2026-03-30 11:59:22 [auto1.de] INFO: Scrape type for KW41122: 2
2026-03-30 11:59:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cede8d43-5a9e-5af2-9b7e-31bdee79550a with identifier: KW41122
2026-03-30 11:59:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cede8d43-5a9e-5af2-9b7e-31bdee79550a with scrape type 2
2026-03-30 11:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cede8d43-5a9e-5af2-9b7e-31bdee79550a with scrape type 2
2026-03-30 11:59:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cede8d43-5a9e-5af2-9b7e-31bdee79550a, identifier: KW41122
2026-03-30 11:59:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cede8d43-5a9e-5af2-9b7e-31bdee79550a with identifier: KW41122
2026-03-30 11:59:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cede8d43-5a9e-5af2-9b7e-31bdee79550a with identifier: KW41122
2026-03-30 11:59:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cede8d43-5a9e-5af2-9b7e-31bdee79550a with identifier: KW41122 to the API
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 84,
 'expiration_date': '2026-03-30T15:26:06Z',
 'fuel_type': 'petrol',
 'id': 'cede8d43-5a9e-5af2-9b7e-31bdee79550a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW41122',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 64442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-08',
 'seller_name': None,
 'title': 'Kia Picanto 1.2 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2020}
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW41122%27 HTTP/1.1" 200 None
2026-03-30 11:59:22 [auto1.de] INFO: Saving data for KW41122: {'auction_closing_time': 1774884366.0, 'created_time': 1774349955.289039, 'last_price_update_time': 1774871962.485886}
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW41122') HTTP/1.1" 204 0
2026-03-30 11:59:22 [auto1.de] INFO: Found listing with ID: XV62067
2026-03-30 11:59:22 [auto1.de] INFO: Found listing with ID: EH91582
2026-03-30 11:59:22 [auto1.de] INFO: Found listing with ID: SG58819
2026-03-30 11:59:22 [auto1.de] INFO: Found listing with ID: EU16330
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU16330%27 HTTP/1.1" 200 None
2026-03-30 11:59:22 [auto1.de] INFO: Scrape type for EU16330: 2
2026-03-30 11:59:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b with identifier: EU16330
2026-03-30 11:59:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b with scrape type 2
2026-03-30 11:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b with scrape type 2
2026-03-30 11:59:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b, identifier: EU16330
2026-03-30 11:59:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b with identifier: EU16330
2026-03-30 11:59:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b with identifier: EU16330
2026-03-30 11:59:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b with identifier: EU16330 to the API
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:56:36Z',
 'fuel_type': 'diesel',
 'id': 'efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU16330',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 170520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-21',
 'seller_name': None,
 'title': 'Opel Astra 1.5 CDTI Start/Stop',
 'transmission': 'manual',
 'trim': 'Start/Stop',
 'year': 2020}
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU16330%27 HTTP/1.1" 200 None
2026-03-30 11:59:22 [auto1.de] INFO: Saving data for EU16330: {'auction_closing_time': 1774886196.0, 'created_time': 1774694277.94371, 'last_price_update_time': 1774871962.866514}
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU16330') HTTP/1.1" 204 0
2026-03-30 11:59:22 [auto1.de] INFO: Found listing with ID: FE70575
2026-03-30 11:59:22 [auto1.de] INFO: Found listing with ID: TK97651
2026-03-30 11:59:22 [auto1.de] INFO: Found listing with ID: DR88922
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR88922%27 HTTP/1.1" 200 None
2026-03-30 11:59:22 [auto1.de] INFO: Scrape type for DR88922: 2
2026-03-30 11:59:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f06aac50-c7fe-581f-89c7-06bc526592aa with identifier: DR88922
2026-03-30 11:59:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f06aac50-c7fe-581f-89c7-06bc526592aa with scrape type 2
2026-03-30 11:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f06aac50-c7fe-581f-89c7-06bc526592aa with scrape type 2
2026-03-30 11:59:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f06aac50-c7fe-581f-89c7-06bc526592aa, identifier: DR88922
2026-03-30 11:59:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f06aac50-c7fe-581f-89c7-06bc526592aa with identifier: DR88922
2026-03-30 11:59:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f06aac50-c7fe-581f-89c7-06bc526592aa with identifier: DR88922
2026-03-30 11:59:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f06aac50-c7fe-581f-89c7-06bc526592aa with identifier: DR88922 to the API
2026-03-30 11:59:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:51:00Z',
 'fuel_type': 'diesel',
 'id': 'f06aac50-c7fe-581f-89c7-06bc526592aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR88922',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 216677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-15',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2013}
2026-03-30 11:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR88922%27 HTTP/1.1" 200 None
2026-03-30 11:59:23 [auto1.de] INFO: Saving data for DR88922: {'auction_closing_time': 1774885860.0, 'created_time': 1774694251.403192, 'last_price_update_time': 1774871963.254105}
2026-03-30 11:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR88922') HTTP/1.1" 204 0
2026-03-30 11:59:23 [auto1.de] INFO: Found listing with ID: SL55745
2026-03-30 11:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL55745%27 HTTP/1.1" 200 None
2026-03-30 11:59:23 [auto1.de] INFO: Scrape type for SL55745: 2
2026-03-30 11:59:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a53b9138-9074-555b-b88c-a70257f8f2c4 with identifier: SL55745
2026-03-30 11:59:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a53b9138-9074-555b-b88c-a70257f8f2c4 with scrape type 2
2026-03-30 11:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a53b9138-9074-555b-b88c-a70257f8f2c4 with scrape type 2
2026-03-30 11:59:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a53b9138-9074-555b-b88c-a70257f8f2c4, identifier: SL55745
2026-03-30 11:59:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a53b9138-9074-555b-b88c-a70257f8f2c4 with identifier: SL55745
2026-03-30 11:59:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a53b9138-9074-555b-b88c-a70257f8f2c4 with identifier: SL55745
2026-03-30 11:59:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a53b9138-9074-555b-b88c-a70257f8f2c4 with identifier: SL55745 to the API
2026-03-30 11:59:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:49:42Z',
 'fuel_type': 'petrol',
 'id': 'a53b9138-9074-555b-b88c-a70257f8f2c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL55745',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 127090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-26',
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-30 11:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL55745%27 HTTP/1.1" 200 None
2026-03-30 11:59:23 [auto1.de] INFO: Saving data for SL55745: {'auction_closing_time': 1774885782.0, 'created_time': 1774380238.421618, 'last_price_update_time': 1774871963.731391}
2026-03-30 11:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL55745') HTTP/1.1" 204 0
2026-03-30 11:59:23 [auto1.de] INFO: Found listing with ID: WA61115
2026-03-30 11:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA61115%27 HTTP/1.1" 200 None
2026-03-30 11:59:23 [auto1.de] INFO: Scrape type for WA61115: 2
2026-03-30 11:59:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 564f935f-1fa8-5d14-af3c-585d82b9cefa with identifier: WA61115
2026-03-30 11:59:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 564f935f-1fa8-5d14-af3c-585d82b9cefa with scrape type 2
2026-03-30 11:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 564f935f-1fa8-5d14-af3c-585d82b9cefa with scrape type 2
2026-03-30 11:59:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 564f935f-1fa8-5d14-af3c-585d82b9cefa, identifier: WA61115
2026-03-30 11:59:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 564f935f-1fa8-5d14-af3c-585d82b9cefa with identifier: WA61115
2026-03-30 11:59:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 564f935f-1fa8-5d14-af3c-585d82b9cefa with identifier: WA61115
2026-03-30 11:59:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 564f935f-1fa8-5d14-af3c-585d82b9cefa with identifier: WA61115 to the API
2026-03-30 11:59:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 58,
 'expiration_date': '2026-03-30T15:37:04Z',
 'fuel_type': 'petrol',
 'id': '564f935f-1fa8-5d14-af3c-585d82b9cefa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA61115',
 'listing': 'auction',
 'make': 'Daihatsu',
 'model': 'Cuore',
 'odometer': 14643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-08-07',
 'seller_name': None,
 'title': 'Daihatsu Cuore 1.0 Top',
 'transmission': 'automatic',
 'trim': 'Top',
 'year': 2003}
2026-03-30 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA61115%27 HTTP/1.1" 200 None
2026-03-30 11:59:24 [auto1.de] INFO: Saving data for WA61115: {'auction_closing_time': 1774885024.0, 'created_time': 1774694128.855788, 'last_price_update_time': 1774871964.094367}
2026-03-30 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA61115') HTTP/1.1" 204 0
2026-03-30 11:59:24 [auto1.de] INFO: Found listing with ID: SJ49235
2026-03-30 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ49235%27 HTTP/1.1" 200 None
2026-03-30 11:59:24 [auto1.de] INFO: Scrape type for SJ49235: 2
2026-03-30 11:59:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cdaa351-f824-5eb0-9ac3-0fbe71763305 with identifier: SJ49235
2026-03-30 11:59:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cdaa351-f824-5eb0-9ac3-0fbe71763305 with scrape type 2
2026-03-30 11:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cdaa351-f824-5eb0-9ac3-0fbe71763305 with scrape type 2
2026-03-30 11:59:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cdaa351-f824-5eb0-9ac3-0fbe71763305, identifier: SJ49235
2026-03-30 11:59:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cdaa351-f824-5eb0-9ac3-0fbe71763305 with identifier: SJ49235
2026-03-30 11:59:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cdaa351-f824-5eb0-9ac3-0fbe71763305 with identifier: SJ49235
2026-03-30 11:59:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cdaa351-f824-5eb0-9ac3-0fbe71763305 with identifier: SJ49235 to the API
2026-03-30 11:59:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:10:03Z',
 'fuel_type': 'petrol',
 'id': '5cdaa351-f824-5eb0-9ac3-0fbe71763305',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ49235',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 151614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-10',
 'seller_name': None,
 'title': 'Hyundai i20 1.4 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2010}
2026-03-30 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ49235%27 HTTP/1.1" 200 None
2026-03-30 11:59:24 [auto1.de] INFO: Saving data for SJ49235: {'auction_closing_time': 1774883403.0, 'created_time': 1774694174.949756, 'last_price_update_time': 1774871964.615504}
2026-03-30 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ49235') HTTP/1.1" 204 0
2026-03-30 11:59:24 [auto1.de] INFO: Found listing with ID: ER21698
2026-03-30 11:59:24 [auto1.de] INFO: Found listing with ID: BT33018
2026-03-30 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT33018%27 HTTP/1.1" 200 None
2026-03-30 11:59:24 [auto1.de] INFO: Scrape type for BT33018: 2
2026-03-30 11:59:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c7fa6df-069b-5084-963f-b7b83500914f with identifier: BT33018
2026-03-30 11:59:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c7fa6df-069b-5084-963f-b7b83500914f with scrape type 2
2026-03-30 11:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c7fa6df-069b-5084-963f-b7b83500914f with scrape type 2
2026-03-30 11:59:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c7fa6df-069b-5084-963f-b7b83500914f, identifier: BT33018
2026-03-30 11:59:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c7fa6df-069b-5084-963f-b7b83500914f with identifier: BT33018
2026-03-30 11:59:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c7fa6df-069b-5084-963f-b7b83500914f with identifier: BT33018
2026-03-30 11:59:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c7fa6df-069b-5084-963f-b7b83500914f with identifier: BT33018 to the API
2026-03-30 11:59:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:49:55Z',
 'fuel_type': 'petrol',
 'id': '9c7fa6df-069b-5084-963f-b7b83500914f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT33018',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 97913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-10',
 'seller_name': None,
 'title': 'BMW 3er 320i GT Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2015}
2026-03-30 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT33018%27 HTTP/1.1" 200 None
2026-03-30 11:59:25 [auto1.de] INFO: Saving data for BT33018: {'auction_closing_time': 1774885795.0, 'created_time': 1774694104.084189, 'last_price_update_time': 1774871965.002608}
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT33018') HTTP/1.1" 204 0
2026-03-30 11:59:25 [auto1.de] INFO: Found listing with ID: DY33691
2026-03-30 11:59:25 [auto1.de] INFO: Found listing with ID: KT95165
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT95165%27 HTTP/1.1" 200 None
2026-03-30 11:59:25 [auto1.de] INFO: Scrape type for KT95165: 2
2026-03-30 11:59:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2512c744-7b0b-57cd-b201-b5465d76730b with identifier: KT95165
2026-03-30 11:59:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2512c744-7b0b-57cd-b201-b5465d76730b with scrape type 2
2026-03-30 11:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2512c744-7b0b-57cd-b201-b5465d76730b with scrape type 2
2026-03-30 11:59:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2512c744-7b0b-57cd-b201-b5465d76730b, identifier: KT95165
2026-03-30 11:59:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2512c744-7b0b-57cd-b201-b5465d76730b with identifier: KT95165
2026-03-30 11:59:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2512c744-7b0b-57cd-b201-b5465d76730b with identifier: KT95165
2026-03-30 11:59:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2512c744-7b0b-57cd-b201-b5465d76730b with identifier: KT95165 to the API
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:48:59Z',
 'fuel_type': 'petrol',
 'id': '2512c744-7b0b-57cd-b201-b5465d76730b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT95165',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 100288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-28',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 150 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2009}
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT95165%27 HTTP/1.1" 200 None
2026-03-30 11:59:25 [auto1.de] INFO: Saving data for KT95165: {'auction_closing_time': 1774885739.0, 'created_time': 1774694105.035467, 'last_price_update_time': 1774871965.394683}
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT95165') HTTP/1.1" 204 0
2026-03-30 11:59:25 [auto1.de] INFO: Found listing with ID: WV98635
2026-03-30 11:59:25 [auto1.de] INFO: Found listing with ID: JX65004
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX65004%27 HTTP/1.1" 200 None
2026-03-30 11:59:25 [auto1.de] INFO: Scrape type for JX65004: 2
2026-03-30 11:59:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7ed1071-c499-5702-b65b-3b299dc96b2d with identifier: JX65004
2026-03-30 11:59:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7ed1071-c499-5702-b65b-3b299dc96b2d with scrape type 2
2026-03-30 11:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7ed1071-c499-5702-b65b-3b299dc96b2d with scrape type 2
2026-03-30 11:59:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7ed1071-c499-5702-b65b-3b299dc96b2d, identifier: JX65004
2026-03-30 11:59:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7ed1071-c499-5702-b65b-3b299dc96b2d with identifier: JX65004
2026-03-30 11:59:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7ed1071-c499-5702-b65b-3b299dc96b2d with identifier: JX65004
2026-03-30 11:59:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7ed1071-c499-5702-b65b-3b299dc96b2d with identifier: JX65004 to the API
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:17:39Z',
 'fuel_type': 'petrol',
 'id': 'f7ed1071-c499-5702-b65b-3b299dc96b2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX65004',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 125671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-07',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 43 AMG 4Matic AMG',
 'transmission': 'automatic',
 'trim': '4Matic AMG',
 'year': 2017}
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX65004%27 HTTP/1.1" 200 None
2026-03-30 11:59:25 [auto1.de] INFO: Saving data for JX65004: {'auction_closing_time': 1774883859.0, 'created_time': 1773427187.821561, 'last_price_update_time': 1774871965.780224}
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX65004') HTTP/1.1" 204 0
2026-03-30 11:59:25 [auto1.de] INFO: Found listing with ID: VG77732
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG77732%27 HTTP/1.1" 200 None
2026-03-30 11:59:25 [auto1.de] INFO: Scrape type for VG77732: 2
2026-03-30 11:59:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12179171-19be-5438-b8bc-33c1509085bf with identifier: VG77732
2026-03-30 11:59:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12179171-19be-5438-b8bc-33c1509085bf with scrape type 2
2026-03-30 11:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12179171-19be-5438-b8bc-33c1509085bf with scrape type 2
2026-03-30 11:59:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12179171-19be-5438-b8bc-33c1509085bf, identifier: VG77732
2026-03-30 11:59:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12179171-19be-5438-b8bc-33c1509085bf with identifier: VG77732
2026-03-30 11:59:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12179171-19be-5438-b8bc-33c1509085bf with identifier: VG77732
2026-03-30 11:59:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12179171-19be-5438-b8bc-33c1509085bf with identifier: VG77732 to the API
2026-03-30 11:59:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:53:01Z',
 'fuel_type': 'petrol',
 'id': '12179171-19be-5438-b8bc-33c1509085bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG77732',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 81203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-15',
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 TGDI Premium 2WD',
 'transmission': 'manual',
 'trim': 'Premium 2WD',
 'year': 2018}
2026-03-30 11:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG77732%27 HTTP/1.1" 200 None
2026-03-30 11:59:26 [auto1.de] INFO: Saving data for VG77732: {'auction_closing_time': 1774885981.0, 'created_time': 1774031735.778555, 'last_price_update_time': 1774871966.173318}
2026-03-30 11:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG77732') HTTP/1.1" 204 0
2026-03-30 11:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:59:27 [auto1.de] INFO: Channel: 24h | Page: 245 | totalHits: 10020 | hits on page: 40
2026-03-30 11:59:27 [auto1.de] INFO: Found listing with ID: MW16405
2026-03-30 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW16405%27 HTTP/1.1" 200 None
2026-03-30 11:59:27 [auto1.de] INFO: Scrape type for MW16405: 2
2026-03-30 11:59:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eabf51d-c195-50eb-9294-2db4cf9f9fe6 with identifier: MW16405
2026-03-30 11:59:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eabf51d-c195-50eb-9294-2db4cf9f9fe6 with scrape type 2
2026-03-30 11:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4eabf51d-c195-50eb-9294-2db4cf9f9fe6 with scrape type 2
2026-03-30 11:59:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4eabf51d-c195-50eb-9294-2db4cf9f9fe6, identifier: MW16405
2026-03-30 11:59:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4eabf51d-c195-50eb-9294-2db4cf9f9fe6 with identifier: MW16405
2026-03-30 11:59:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4eabf51d-c195-50eb-9294-2db4cf9f9fe6 with identifier: MW16405
2026-03-30 11:59:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4eabf51d-c195-50eb-9294-2db4cf9f9fe6 with identifier: MW16405 to the API
2026-03-30 11:59:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:28:57Z',
 'fuel_type': 'diesel',
 'id': '4eabf51d-c195-50eb-9294-2db4cf9f9fe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW16405',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 137367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-25',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2019}
2026-03-30 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW16405%27 HTTP/1.1" 200 None
2026-03-30 11:59:27 [auto1.de] INFO: Saving data for MW16405: {'auction_closing_time': 1774884537.0, 'created_time': 1773468073.91769, 'last_price_update_time': 1774871967.649605}
2026-03-30 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW16405') HTTP/1.1" 204 0
2026-03-30 11:59:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:59:27 [auto1.de] INFO: Found listing with ID: WF26983
2026-03-30 11:59:27 [auto1.de] INFO: Found listing with ID: BY24352
2026-03-30 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY24352%27 HTTP/1.1" 200 None
2026-03-30 11:59:27 [auto1.de] INFO: Scrape type for BY24352: 2
2026-03-30 11:59:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ab459e5-aeb8-5306-a7da-d651b0564c61 with identifier: BY24352
2026-03-30 11:59:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ab459e5-aeb8-5306-a7da-d651b0564c61 with scrape type 2
2026-03-30 11:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ab459e5-aeb8-5306-a7da-d651b0564c61 with scrape type 2
2026-03-30 11:59:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ab459e5-aeb8-5306-a7da-d651b0564c61, identifier: BY24352
2026-03-30 11:59:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ab459e5-aeb8-5306-a7da-d651b0564c61 with identifier: BY24352
2026-03-30 11:59:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ab459e5-aeb8-5306-a7da-d651b0564c61 with identifier: BY24352
2026-03-30 11:59:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ab459e5-aeb8-5306-a7da-d651b0564c61 with identifier: BY24352 to the API
2026-03-30 11:59:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:13:02Z',
 'fuel_type': 'petrol',
 'id': '7ab459e5-aeb8-5306-a7da-d651b0564c61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY24352',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 190692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-16',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2011}
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY24352%27 HTTP/1.1" 200 None
2026-03-30 11:59:28 [auto1.de] INFO: Saving data for BY24352: {'auction_closing_time': 1774883582.0, 'created_time': 1774694101.768542, 'last_price_update_time': 1774871968.114464}
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY24352') HTTP/1.1" 204 0
2026-03-30 11:59:28 [auto1.de] INFO: Found listing with ID: SV90594
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV90594%27 HTTP/1.1" 200 None
2026-03-30 11:59:28 [auto1.de] INFO: Scrape type for SV90594: 2
2026-03-30 11:59:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a47f807-665f-57f6-8259-b646dbe17ecc with identifier: SV90594
2026-03-30 11:59:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a47f807-665f-57f6-8259-b646dbe17ecc with scrape type 2
2026-03-30 11:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a47f807-665f-57f6-8259-b646dbe17ecc with scrape type 2
2026-03-30 11:59:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a47f807-665f-57f6-8259-b646dbe17ecc, identifier: SV90594
2026-03-30 11:59:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a47f807-665f-57f6-8259-b646dbe17ecc with identifier: SV90594
2026-03-30 11:59:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a47f807-665f-57f6-8259-b646dbe17ecc with identifier: SV90594
2026-03-30 11:59:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a47f807-665f-57f6-8259-b646dbe17ecc with identifier: SV90594 to the API
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:53:32Z',
 'fuel_type': 'petrol',
 'id': '7a47f807-665f-57f6-8259-b646dbe17ecc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV90594',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 191114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-02-24',
 'seller_name': None,
 'title': 'Smart forfour 1.3 Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2005}
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV90594%27 HTTP/1.1" 200 None
2026-03-30 11:59:28 [auto1.de] INFO: Saving data for SV90594: {'auction_closing_time': 1774886012.0, 'created_time': 1774694290.604188, 'last_price_update_time': 1774871968.505115}
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV90594') HTTP/1.1" 204 0
2026-03-30 11:59:28 [auto1.de] INFO: Found listing with ID: CN43056
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN43056%27 HTTP/1.1" 200 None
2026-03-30 11:59:28 [auto1.de] INFO: Scrape type for CN43056: 2
2026-03-30 11:59:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba9838a0-5635-5efe-a023-88e227b78e90 with identifier: CN43056
2026-03-30 11:59:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba9838a0-5635-5efe-a023-88e227b78e90 with scrape type 2
2026-03-30 11:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba9838a0-5635-5efe-a023-88e227b78e90 with scrape type 2
2026-03-30 11:59:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba9838a0-5635-5efe-a023-88e227b78e90, identifier: CN43056
2026-03-30 11:59:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba9838a0-5635-5efe-a023-88e227b78e90 with identifier: CN43056
2026-03-30 11:59:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba9838a0-5635-5efe-a023-88e227b78e90 with identifier: CN43056
2026-03-30 11:59:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba9838a0-5635-5efe-a023-88e227b78e90 with identifier: CN43056 to the API
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:51:25Z',
 'fuel_type': 'petrol',
 'id': 'ba9838a0-5635-5efe-a023-88e227b78e90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN43056',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 128132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-19',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Celebration',
 'transmission': 'manual',
 'trim': 'Celebration',
 'year': 2016}
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN43056%27 HTTP/1.1" 200 None
2026-03-30 11:59:28 [auto1.de] INFO: Saving data for CN43056: {'auction_closing_time': 1774885885.0, 'created_time': 1774694262.82587, 'last_price_update_time': 1774871968.898638}
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN43056') HTTP/1.1" 204 0
2026-03-30 11:59:28 [auto1.de] INFO: Found listing with ID: RA08562
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA08562%27 HTTP/1.1" 200 None
2026-03-30 11:59:28 [auto1.de] INFO: Scrape type for RA08562: 2
2026-03-30 11:59:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8efef272-f0e7-569f-a3f9-44308784166b with identifier: RA08562
2026-03-30 11:59:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8efef272-f0e7-569f-a3f9-44308784166b with scrape type 2
2026-03-30 11:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8efef272-f0e7-569f-a3f9-44308784166b with scrape type 2
2026-03-30 11:59:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8efef272-f0e7-569f-a3f9-44308784166b, identifier: RA08562
2026-03-30 11:59:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8efef272-f0e7-569f-a3f9-44308784166b with identifier: RA08562
2026-03-30 11:59:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8efef272-f0e7-569f-a3f9-44308784166b with identifier: RA08562
2026-03-30 11:59:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8efef272-f0e7-569f-a3f9-44308784166b with identifier: RA08562 to the API
2026-03-30 11:59:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:04:34Z',
 'fuel_type': 'petrol',
 'id': '8efef272-f0e7-569f-a3f9-44308784166b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA08562',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 128632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Lounge BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2017}
2026-03-30 11:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA08562%27 HTTP/1.1" 200 None
2026-03-30 11:59:29 [auto1.de] INFO: Saving data for RA08562: {'auction_closing_time': 1774883074.0, 'created_time': 1774031664.268552, 'last_price_update_time': 1774871969.270835}
2026-03-30 11:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA08562') HTTP/1.1" 204 0
2026-03-30 11:59:29 [auto1.de] INFO: Found listing with ID: EL77757
2026-03-30 11:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL77757%27 HTTP/1.1" 200 None
2026-03-30 11:59:29 [auto1.de] INFO: Scrape type for EL77757: 2
2026-03-30 11:59:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e18c4836-9a86-536e-906e-bf9f269c6ff1 with identifier: EL77757
2026-03-30 11:59:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e18c4836-9a86-536e-906e-bf9f269c6ff1 with scrape type 2
2026-03-30 11:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e18c4836-9a86-536e-906e-bf9f269c6ff1 with scrape type 2
2026-03-30 11:59:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e18c4836-9a86-536e-906e-bf9f269c6ff1, identifier: EL77757
2026-03-30 11:59:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e18c4836-9a86-536e-906e-bf9f269c6ff1 with identifier: EL77757
2026-03-30 11:59:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e18c4836-9a86-536e-906e-bf9f269c6ff1 with identifier: EL77757
2026-03-30 11:59:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e18c4836-9a86-536e-906e-bf9f269c6ff1 with identifier: EL77757 to the API
2026-03-30 11:59:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:54:50Z',
 'fuel_type': 'petrol',
 'id': 'e18c4836-9a86-536e-906e-bf9f269c6ff1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL77757',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 124617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-28',
 'seller_name': None,
 'title': 'Renault Talisman 1.8 TCe Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2019}
2026-03-30 11:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL77757%27 HTTP/1.1" 200 None
2026-03-30 11:59:29 [auto1.de] INFO: Saving data for EL77757: {'auction_closing_time': 1774886090.0, 'created_time': 1774694370.730648, 'last_price_update_time': 1774871969.651018}
2026-03-30 11:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL77757') HTTP/1.1" 204 0
2026-03-30 11:59:29 [auto1.de] INFO: Found listing with ID: MZ03639
2026-03-30 11:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ03639%27 HTTP/1.1" 200 None
2026-03-30 11:59:29 [auto1.de] INFO: Scrape type for MZ03639: 2
2026-03-30 11:59:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afba7f48-3803-5520-a7ee-cb203868f1e3 with identifier: MZ03639
2026-03-30 11:59:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afba7f48-3803-5520-a7ee-cb203868f1e3 with scrape type 2
2026-03-30 11:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afba7f48-3803-5520-a7ee-cb203868f1e3 with scrape type 2
2026-03-30 11:59:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afba7f48-3803-5520-a7ee-cb203868f1e3, identifier: MZ03639
2026-03-30 11:59:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afba7f48-3803-5520-a7ee-cb203868f1e3 with identifier: MZ03639
2026-03-30 11:59:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afba7f48-3803-5520-a7ee-cb203868f1e3 with identifier: MZ03639
2026-03-30 11:59:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afba7f48-3803-5520-a7ee-cb203868f1e3 with identifier: MZ03639 to the API
2026-03-30 11:59:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:51:35Z',
 'fuel_type': 'diesel',
 'id': 'afba7f48-3803-5520-a7ee-cb203868f1e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ03639',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 224587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-17',
 'seller_name': None,
 'title': 'Volvo XC60 2.4D DRIVe Summum Drive',
 'transmission': 'automatic',
 'trim': 'Summum Drive',
 'year': 2010}
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ03639%27 HTTP/1.1" 200 None
2026-03-30 11:59:30 [auto1.de] INFO: Saving data for MZ03639: {'auction_closing_time': 1774885895.0, 'created_time': 1774348962.067369, 'last_price_update_time': 1774871970.066065}
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ03639') HTTP/1.1" 204 0
2026-03-30 11:59:30 [auto1.de] INFO: Found listing with ID: BS45971
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS45971%27 HTTP/1.1" 200 None
2026-03-30 11:59:30 [auto1.de] INFO: Scrape type for BS45971: 2
2026-03-30 11:59:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc with identifier: BS45971
2026-03-30 11:59:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc with scrape type 2
2026-03-30 11:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc with scrape type 2
2026-03-30 11:59:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc, identifier: BS45971
2026-03-30 11:59:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc with identifier: BS45971
2026-03-30 11:59:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc with identifier: BS45971
2026-03-30 11:59:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc with identifier: BS45971 to the API
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-30T15:41:59Z',
 'fuel_type': 'hybrid',
 'id': '6bf41aa3-5862-5b23-9dfa-3008f24b7ebc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS45971',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 48512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-18',
 'seller_name': None,
 'title': "Kia cee'd 1.6 Plug-in Hybrid Spirit",
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2022}
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS45971%27 HTTP/1.1" 200 None
2026-03-30 11:59:30 [auto1.de] INFO: Saving data for BS45971: {'auction_closing_time': 1774885319.0, 'created_time': 1774118561.163237, 'last_price_update_time': 1774871970.478563}
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS45971') HTTP/1.1" 204 0
2026-03-30 11:59:30 [auto1.de] INFO: Found listing with ID: PB01809
2026-03-30 11:59:30 [auto1.de] INFO: Found listing with ID: NT95392
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT95392%27 HTTP/1.1" 200 None
2026-03-30 11:59:30 [auto1.de] INFO: Scrape type for NT95392: 2
2026-03-30 11:59:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7e07818-2481-54ef-8dcf-68e508dccf12 with identifier: NT95392
2026-03-30 11:59:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7e07818-2481-54ef-8dcf-68e508dccf12 with scrape type 2
2026-03-30 11:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7e07818-2481-54ef-8dcf-68e508dccf12 with scrape type 2
2026-03-30 11:59:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7e07818-2481-54ef-8dcf-68e508dccf12, identifier: NT95392
2026-03-30 11:59:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7e07818-2481-54ef-8dcf-68e508dccf12 with identifier: NT95392
2026-03-30 11:59:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7e07818-2481-54ef-8dcf-68e508dccf12 with identifier: NT95392
2026-03-30 11:59:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7e07818-2481-54ef-8dcf-68e508dccf12 with identifier: NT95392 to the API
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:10Z',
 'fuel_type': 'petrol',
 'id': 'e7e07818-2481-54ef-8dcf-68e508dccf12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT95392',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 124277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-15',
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT95392%27 HTTP/1.1" 200 None
2026-03-30 11:59:30 [auto1.de] INFO: Saving data for NT95392: {'auction_closing_time': 1774885690.0, 'created_time': 1774694214.796644, 'last_price_update_time': 1774871970.875702}
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT95392') HTTP/1.1" 204 0
2026-03-30 11:59:30 [auto1.de] INFO: Found listing with ID: DA97993
2026-03-30 11:59:30 [auto1.de] INFO: Found listing with ID: AD84103
2026-03-30 11:59:30 [auto1.de] INFO: Found listing with ID: NV43592
2026-03-30 11:59:30 [auto1.de] INFO: Found listing with ID: PL81843
2026-03-30 11:59:30 [auto1.de] INFO: Found listing with ID: FB20065
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20065%27 HTTP/1.1" 200 None
2026-03-30 11:59:30 [auto1.de] INFO: Scrape type for FB20065: 2
2026-03-30 11:59:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e3d2333-5cf7-59d3-a06a-3e38f583ca03 with identifier: FB20065
2026-03-30 11:59:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e3d2333-5cf7-59d3-a06a-3e38f583ca03 with scrape type 2
2026-03-30 11:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e3d2333-5cf7-59d3-a06a-3e38f583ca03 with scrape type 2
2026-03-30 11:59:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e3d2333-5cf7-59d3-a06a-3e38f583ca03, identifier: FB20065
2026-03-30 11:59:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e3d2333-5cf7-59d3-a06a-3e38f583ca03 with identifier: FB20065
2026-03-30 11:59:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e3d2333-5cf7-59d3-a06a-3e38f583ca03 with identifier: FB20065
2026-03-30 11:59:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e3d2333-5cf7-59d3-a06a-3e38f583ca03 with identifier: FB20065 to the API
2026-03-30 11:59:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:41:02Z',
 'fuel_type': 'petrol',
 'id': '1e3d2333-5cf7-59d3-a06a-3e38f583ca03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB20065',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 58392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-02',
 'seller_name': None,
 'title': 'Kia Venga 1.6 FIFA World Cup Edition',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2013}
2026-03-30 11:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20065%27 HTTP/1.1" 200 None
2026-03-30 11:59:31 [auto1.de] INFO: Saving data for FB20065: {'auction_closing_time': 1774885262.0, 'created_time': 1774694186.507469, 'last_price_update_time': 1774871971.637833}
2026-03-30 11:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB20065') HTTP/1.1" 204 0
2026-03-30 11:59:31 [auto1.de] INFO: Found listing with ID: YV73995
2026-03-30 11:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV73995%27 HTTP/1.1" 200 None
2026-03-30 11:59:31 [auto1.de] INFO: Scrape type for YV73995: 2
2026-03-30 11:59:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 490edfac-ca32-5de2-a444-b7b49007d687 with identifier: YV73995
2026-03-30 11:59:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 490edfac-ca32-5de2-a444-b7b49007d687 with scrape type 2
2026-03-30 11:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 490edfac-ca32-5de2-a444-b7b49007d687 with scrape type 2
2026-03-30 11:59:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 490edfac-ca32-5de2-a444-b7b49007d687, identifier: YV73995
2026-03-30 11:59:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 490edfac-ca32-5de2-a444-b7b49007d687 with identifier: YV73995
2026-03-30 11:59:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 490edfac-ca32-5de2-a444-b7b49007d687 with identifier: YV73995
2026-03-30 11:59:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 490edfac-ca32-5de2-a444-b7b49007d687 with identifier: YV73995 to the API
2026-03-30 11:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:37:19Z',
 'fuel_type': 'petrol',
 'id': '490edfac-ca32-5de2-a444-b7b49007d687',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV73995',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 94429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-07',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 YES!',
 'transmission': 'manual',
 'trim': 'YES!',
 'year': 2019}
2026-03-30 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV73995%27 HTTP/1.1" 200 None
2026-03-30 11:59:32 [auto1.de] INFO: Saving data for YV73995: {'auction_closing_time': 1774885039.0, 'created_time': 1774694209.611673, 'last_price_update_time': 1774871972.204179}
2026-03-30 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV73995') HTTP/1.1" 204 0
2026-03-30 11:59:32 [auto1.de] INFO: Found listing with ID: WW38185
2026-03-30 11:59:32 [auto1.de] INFO: Found listing with ID: UW13690
2026-03-30 11:59:32 [auto1.de] INFO: Found listing with ID: CW14038
2026-03-30 11:59:32 [auto1.de] INFO: Found listing with ID: HS42053
2026-03-30 11:59:32 [auto1.de] INFO: Found listing with ID: JX55294
2026-03-30 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX55294%27 HTTP/1.1" 200 None
2026-03-30 11:59:32 [auto1.de] INFO: Scrape type for JX55294: 2
2026-03-30 11:59:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dd22b49-f425-52b7-9283-cf249c2f685b with identifier: JX55294
2026-03-30 11:59:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dd22b49-f425-52b7-9283-cf249c2f685b with scrape type 2
2026-03-30 11:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8dd22b49-f425-52b7-9283-cf249c2f685b with scrape type 2
2026-03-30 11:59:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8dd22b49-f425-52b7-9283-cf249c2f685b, identifier: JX55294
2026-03-30 11:59:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8dd22b49-f425-52b7-9283-cf249c2f685b with identifier: JX55294
2026-03-30 11:59:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8dd22b49-f425-52b7-9283-cf249c2f685b with identifier: JX55294
2026-03-30 11:59:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8dd22b49-f425-52b7-9283-cf249c2f685b with identifier: JX55294 to the API
2026-03-30 11:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:23:36Z',
 'fuel_type': 'diesel',
 'id': '8dd22b49-f425-52b7-9283-cf249c2f685b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX55294',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 204078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-25',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX55294%27 HTTP/1.1" 200 None
2026-03-30 11:59:32 [auto1.de] INFO: Saving data for JX55294: {'auction_closing_time': 1774884216.0, 'created_time': 1774694117.876477, 'last_price_update_time': 1774871972.596798}
2026-03-30 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX55294') HTTP/1.1" 204 0
2026-03-30 11:59:32 [auto1.de] INFO: Found listing with ID: PY14416
2026-03-30 11:59:32 [auto1.de] INFO: Found listing with ID: BK93979
2026-03-30 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK93979%27 HTTP/1.1" 200 None
2026-03-30 11:59:32 [auto1.de] INFO: Scrape type for BK93979: 2
2026-03-30 11:59:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e with identifier: BK93979
2026-03-30 11:59:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e with scrape type 2
2026-03-30 11:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e with scrape type 2
2026-03-30 11:59:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e, identifier: BK93979
2026-03-30 11:59:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e with identifier: BK93979
2026-03-30 11:59:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e with identifier: BK93979
2026-03-30 11:59:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e with identifier: BK93979 to the API
2026-03-30 11:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:11:08Z',
 'fuel_type': 'diesel',
 'id': '6dea8a1c-b427-57fe-bd4e-7de622ccbc4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK93979',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 89952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-15',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 2.0 Blue-HDi Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2018}
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK93979%27 HTTP/1.1" 200 None
2026-03-30 11:59:33 [auto1.de] INFO: Saving data for BK93979: {'auction_closing_time': 1774883468.0, 'created_time': 1774694112.198848, 'last_price_update_time': 1774871973.011004}
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK93979') HTTP/1.1" 204 0
2026-03-30 11:59:33 [auto1.de] INFO: Found listing with ID: LC65511
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC65511%27 HTTP/1.1" 200 None
2026-03-30 11:59:33 [auto1.de] INFO: Scrape type for LC65511: 2
2026-03-30 11:59:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a with identifier: LC65511
2026-03-30 11:59:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a with scrape type 2
2026-03-30 11:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a with scrape type 2
2026-03-30 11:59:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a, identifier: LC65511
2026-03-30 11:59:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a with identifier: LC65511
2026-03-30 11:59:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a with identifier: LC65511
2026-03-30 11:59:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a with identifier: LC65511 to the API
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-30T15:07:07Z',
 'fuel_type': 'petrol',
 'id': 'd5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC65511',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Murano',
 'odometer': 164789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-16',
 'seller_name': None,
 'title': 'Nissan Murano 3.5 V6 Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2005}
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC65511%27 HTTP/1.1" 200 None
2026-03-30 11:59:33 [auto1.de] INFO: Saving data for LC65511: {'auction_closing_time': 1774883227.0, 'created_time': 1773402304.385405, 'last_price_update_time': 1774871973.399735}
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC65511') HTTP/1.1" 204 0
2026-03-30 11:59:33 [auto1.de] INFO: Found listing with ID: DM10226
2026-03-30 11:59:33 [auto1.de] INFO: Found listing with ID: NH74164
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH74164%27 HTTP/1.1" 200 None
2026-03-30 11:59:33 [auto1.de] INFO: Scrape type for NH74164: 2
2026-03-30 11:59:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1 with identifier: NH74164
2026-03-30 11:59:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1 with scrape type 2
2026-03-30 11:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1 with scrape type 2
2026-03-30 11:59:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1, identifier: NH74164
2026-03-30 11:59:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1 with identifier: NH74164
2026-03-30 11:59:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1 with identifier: NH74164
2026-03-30 11:59:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1 with identifier: NH74164 to the API
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:58:58Z',
 'fuel_type': 'petrol',
 'id': 'c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH74164',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 127491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-10',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH74164%27 HTTP/1.1" 200 None
2026-03-30 11:59:33 [auto1.de] INFO: Saving data for NH74164: {'auction_closing_time': 1774886338.0, 'created_time': 1774089330.75655, 'last_price_update_time': 1774871973.793349}
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH74164') HTTP/1.1" 204 0
2026-03-30 11:59:33 [auto1.de] INFO: Found listing with ID: EE69038
2026-03-30 11:59:33 [auto1.de] INFO: Found listing with ID: PA12194
2026-03-30 11:59:33 [auto1.de] INFO: Found listing with ID: HZ13405
2026-03-30 11:59:33 [auto1.de] INFO: Found listing with ID: CG50140
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG50140%27 HTTP/1.1" 200 None
2026-03-30 11:59:33 [auto1.de] INFO: Scrape type for CG50140: 2
2026-03-30 11:59:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 121ce847-36ec-551c-b0b2-bd2524907430 with identifier: CG50140
2026-03-30 11:59:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 121ce847-36ec-551c-b0b2-bd2524907430 with scrape type 2
2026-03-30 11:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 121ce847-36ec-551c-b0b2-bd2524907430 with scrape type 2
2026-03-30 11:59:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 121ce847-36ec-551c-b0b2-bd2524907430, identifier: CG50140
2026-03-30 11:59:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 121ce847-36ec-551c-b0b2-bd2524907430 with identifier: CG50140
2026-03-30 11:59:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 121ce847-36ec-551c-b0b2-bd2524907430 with identifier: CG50140
2026-03-30 11:59:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 121ce847-36ec-551c-b0b2-bd2524907430 with identifier: CG50140 to the API
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:21:46Z',
 'fuel_type': 'diesel',
 'id': '121ce847-36ec-551c-b0b2-bd2524907430',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG50140',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 178371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-21',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2017}
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG50140%27 HTTP/1.1" 200 None
2026-03-30 11:59:34 [auto1.de] INFO: Saving data for CG50140: {'auction_closing_time': 1774884106.0, 'created_time': 1774349322.620311, 'last_price_update_time': 1774871974.329572}
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG50140') HTTP/1.1" 204 0
2026-03-30 11:59:34 [auto1.de] INFO: Found listing with ID: YL16347
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL16347%27 HTTP/1.1" 200 None
2026-03-30 11:59:34 [auto1.de] INFO: Scrape type for YL16347: 2
2026-03-30 11:59:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77132a8e-4535-57ec-b73e-078db3aa9b09 with identifier: YL16347
2026-03-30 11:59:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77132a8e-4535-57ec-b73e-078db3aa9b09 with scrape type 2
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77132a8e-4535-57ec-b73e-078db3aa9b09 with scrape type 2
2026-03-30 11:59:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77132a8e-4535-57ec-b73e-078db3aa9b09, identifier: YL16347
2026-03-30 11:59:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77132a8e-4535-57ec-b73e-078db3aa9b09 with identifier: YL16347
2026-03-30 11:59:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77132a8e-4535-57ec-b73e-078db3aa9b09 with identifier: YL16347
2026-03-30 11:59:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77132a8e-4535-57ec-b73e-078db3aa9b09 with identifier: YL16347 to the API
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-30T15:39:02Z',
 'fuel_type': 'petrol',
 'id': '77132a8e-4535-57ec-b73e-078db3aa9b09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL16347',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 198958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-25',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 400 T 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': 'T 4Matic AMG Line',
 'year': 2017}
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL16347%27 HTTP/1.1" 200 None
2026-03-30 11:59:34 [auto1.de] INFO: Saving data for YL16347: {'auction_closing_time': 1774885142.0, 'created_time': 1774694120.426246, 'last_price_update_time': 1774871974.727276}
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL16347') HTTP/1.1" 204 0
2026-03-30 11:59:34 [auto1.de] INFO: Found listing with ID: MN41763
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN41763%27 HTTP/1.1" 200 None
2026-03-30 11:59:34 [auto1.de] INFO: Scrape type for MN41763: 2
2026-03-30 11:59:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b46660f-5c9b-57a1-ad9b-998e17964bb4 with identifier: MN41763
2026-03-30 11:59:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b46660f-5c9b-57a1-ad9b-998e17964bb4 with scrape type 2
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b46660f-5c9b-57a1-ad9b-998e17964bb4 with scrape type 2
2026-03-30 11:59:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b46660f-5c9b-57a1-ad9b-998e17964bb4, identifier: MN41763
2026-03-30 11:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:59:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b46660f-5c9b-57a1-ad9b-998e17964bb4 with identifier: MN41763
2026-03-30 11:59:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b46660f-5c9b-57a1-ad9b-998e17964bb4 with identifier: MN41763
2026-03-30 11:59:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b46660f-5c9b-57a1-ad9b-998e17964bb4 with identifier: MN41763 to the API
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:18:01Z',
 'fuel_type': 'petrol',
 'id': '3b46660f-5c9b-57a1-ad9b-998e17964bb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN41763',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 38433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-24',
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 250 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2023}
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN41763%27 HTTP/1.1" 200 None
2026-03-30 11:59:35 [auto1.de] INFO: Saving data for MN41763: {'auction_closing_time': 1774883881.0, 'created_time': 1774694149.695584, 'last_price_update_time': 1774871975.13948}
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN41763') HTTP/1.1" 204 0
2026-03-30 11:59:35 [auto1.de] INFO: Found listing with ID: LU05124
2026-03-30 11:59:35 [auto1.de] INFO: Found listing with ID: SY55071
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY55071%27 HTTP/1.1" 200 None
2026-03-30 11:59:35 [auto1.de] INFO: Scrape type for SY55071: 2
2026-03-30 11:59:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dca0f26-20ff-5c8d-90cb-b2d373c3f738 with identifier: SY55071
2026-03-30 11:59:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dca0f26-20ff-5c8d-90cb-b2d373c3f738 with scrape type 2
2026-03-30 11:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dca0f26-20ff-5c8d-90cb-b2d373c3f738 with scrape type 2
2026-03-30 11:59:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4dca0f26-20ff-5c8d-90cb-b2d373c3f738, identifier: SY55071
2026-03-30 11:59:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4dca0f26-20ff-5c8d-90cb-b2d373c3f738 with identifier: SY55071
2026-03-30 11:59:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4dca0f26-20ff-5c8d-90cb-b2d373c3f738 with identifier: SY55071
2026-03-30 11:59:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4dca0f26-20ff-5c8d-90cb-b2d373c3f738 with identifier: SY55071 to the API
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:23:26Z',
 'fuel_type': 'diesel',
 'id': '4dca0f26-20ff-5c8d-90cb-b2d373c3f738',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY55071',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 32844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-06',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2022}
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY55071%27 HTTP/1.1" 200 None
2026-03-30 11:59:35 [auto1.de] INFO: Saving data for SY55071: {'auction_closing_time': 1774884206.0, 'created_time': 1773469025.093341, 'last_price_update_time': 1774871975.526719}
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY55071') HTTP/1.1" 204 0
2026-03-30 11:59:35 [auto1.de] INFO: Found listing with ID: TJ50371
2026-03-30 11:59:35 [auto1.de] INFO: Found listing with ID: WT57840
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT57840%27 HTTP/1.1" 200 None
2026-03-30 11:59:35 [auto1.de] INFO: Scrape type for WT57840: 2
2026-03-30 11:59:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e5dce97-6cd0-5aed-958f-d378e5b9ac02 with identifier: WT57840
2026-03-30 11:59:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e5dce97-6cd0-5aed-958f-d378e5b9ac02 with scrape type 2
2026-03-30 11:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e5dce97-6cd0-5aed-958f-d378e5b9ac02 with scrape type 2
2026-03-30 11:59:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e5dce97-6cd0-5aed-958f-d378e5b9ac02, identifier: WT57840
2026-03-30 11:59:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e5dce97-6cd0-5aed-958f-d378e5b9ac02 with identifier: WT57840
2026-03-30 11:59:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e5dce97-6cd0-5aed-958f-d378e5b9ac02 with identifier: WT57840
2026-03-30 11:59:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e5dce97-6cd0-5aed-958f-d378e5b9ac02 with identifier: WT57840 to the API
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:25:11Z',
 'fuel_type': 'petrol',
 'id': '9e5dce97-6cd0-5aed-958f-d378e5b9ac02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT57840',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 78405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-28',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.0 Diamant Edition',
 'transmission': 'manual',
 'trim': 'Diamant Edition',
 'year': 2015}
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT57840%27 HTTP/1.1" 200 None
2026-03-30 11:59:35 [auto1.de] INFO: Saving data for WT57840: {'auction_closing_time': 1774884311.0, 'created_time': 1774694140.114666, 'last_price_update_time': 1774871975.909037}
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT57840') HTTP/1.1" 204 0
2026-03-30 11:59:35 [auto1.de] INFO: Channel: 24h | Page: 246 | totalHits: 10021 | hits on page: 40
2026-03-30 11:59:35 [auto1.de] INFO: Found listing with ID: BZ34179
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ34179%27 HTTP/1.1" 200 None
2026-03-30 11:59:35 [auto1.de] INFO: Scrape type for BZ34179: 2
2026-03-30 11:59:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2f445c9-22bc-57d0-ba5e-3c55a890873f with identifier: BZ34179
2026-03-30 11:59:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2f445c9-22bc-57d0-ba5e-3c55a890873f with scrape type 2
2026-03-30 11:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2f445c9-22bc-57d0-ba5e-3c55a890873f with scrape type 2
2026-03-30 11:59:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2f445c9-22bc-57d0-ba5e-3c55a890873f, identifier: BZ34179
2026-03-30 11:59:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2f445c9-22bc-57d0-ba5e-3c55a890873f with identifier: BZ34179
2026-03-30 11:59:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2f445c9-22bc-57d0-ba5e-3c55a890873f with identifier: BZ34179
2026-03-30 11:59:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2f445c9-22bc-57d0-ba5e-3c55a890873f with identifier: BZ34179 to the API
2026-03-30 11:59:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-30T15:38:30Z',
 'fuel_type': 'petrol',
 'id': 'f2f445c9-22bc-57d0-ba5e-3c55a890873f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ34179',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 44697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-11',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet Mild-Hybrid Comfort+ 4x2',
 'transmission': 'manual',
 'trim': 'Comfort+ 4x2',
 'year': 2021}
2026-03-30 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ34179%27 HTTP/1.1" 200 None
2026-03-30 11:59:36 [auto1.de] INFO: Saving data for BZ34179: {'auction_closing_time': 1774885110.0, 'created_time': 1774694141.399521, 'last_price_update_time': 1774871976.302895}
2026-03-30 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ34179') HTTP/1.1" 204 0
2026-03-30 11:59:36 [auto1.de] INFO: Found listing with ID: CY89611
2026-03-30 11:59:36 [auto1.de] INFO: Found listing with ID: GZ42240
2026-03-30 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ42240%27 HTTP/1.1" 200 None
2026-03-30 11:59:36 [auto1.de] INFO: Scrape type for GZ42240: 2
2026-03-30 11:59:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6aabce2-599c-5322-956f-d3aae5c6ca07 with identifier: GZ42240
2026-03-30 11:59:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6aabce2-599c-5322-956f-d3aae5c6ca07 with scrape type 2
2026-03-30 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6aabce2-599c-5322-956f-d3aae5c6ca07 with scrape type 2
2026-03-30 11:59:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6aabce2-599c-5322-956f-d3aae5c6ca07, identifier: GZ42240
2026-03-30 11:59:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:59:36 [auto1.de] INFO: Found listing with ID: PA26532
2026-03-30 11:59:36 [auto1.de] INFO: Found listing with ID: CY89611
2026-03-30 11:59:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6aabce2-599c-5322-956f-d3aae5c6ca07 with identifier: GZ42240
2026-03-30 11:59:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6aabce2-599c-5322-956f-d3aae5c6ca07 with identifier: GZ42240
2026-03-30 11:59:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6aabce2-599c-5322-956f-d3aae5c6ca07 with identifier: GZ42240 to the API
2026-03-30 11:59:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:15:26Z',
 'fuel_type': 'petrol',
 'id': 'f6aabce2-599c-5322-956f-d3aae5c6ca07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ42240',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Roadster',
 'odometer': 82450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-26',
 'seller_name': None,
 'title': 'MINI Roadster Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ42240%27 HTTP/1.1" 200 None
2026-03-30 11:59:36 [auto1.de] INFO: Saving data for GZ42240: {'auction_closing_time': 1774883726.0, 'created_time': 1774694134.148665, 'last_price_update_time': 1774871976.776456}
2026-03-30 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ42240') HTTP/1.1" 204 0
2026-03-30 11:59:36 [auto1.de] INFO: Found listing with ID: DV90621
2026-03-30 11:59:36 [auto1.de] INFO: Found listing with ID: DZ63249
2026-03-30 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63249%27 HTTP/1.1" 200 None
2026-03-30 11:59:36 [auto1.de] INFO: Scrape type for DZ63249: 2
2026-03-30 11:59:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb671b87-848e-544c-b050-858a564eed61 with identifier: DZ63249
2026-03-30 11:59:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb671b87-848e-544c-b050-858a564eed61 with scrape type 2
2026-03-30 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb671b87-848e-544c-b050-858a564eed61 with scrape type 2
2026-03-30 11:59:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb671b87-848e-544c-b050-858a564eed61, identifier: DZ63249
2026-03-30 11:59:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb671b87-848e-544c-b050-858a564eed61 with identifier: DZ63249
2026-03-30 11:59:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb671b87-848e-544c-b050-858a564eed61 with identifier: DZ63249
2026-03-30 11:59:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb671b87-848e-544c-b050-858a564eed61 with identifier: DZ63249 to the API
2026-03-30 11:59:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:18:59Z',
 'fuel_type': 'petrol',
 'id': 'cb671b87-848e-544c-b050-858a564eed61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ63249',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 148748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-08',
 'seller_name': None,
 'title': 'Opel Zafira 1.8 Family Plus',
 'transmission': 'manual',
 'trim': 'Family Plus',
 'year': 2012}
2026-03-30 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63249%27 HTTP/1.1" 200 None
2026-03-30 11:59:37 [auto1.de] INFO: Saving data for DZ63249: {'auction_closing_time': 1774883939.0, 'created_time': 1774032831.70904, 'last_price_update_time': 1774871977.196702}
2026-03-30 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ63249') HTTP/1.1" 204 0
2026-03-30 11:59:37 [auto1.de] INFO: Found listing with ID: MN76950
2026-03-30 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN76950%27 HTTP/1.1" 200 None
2026-03-30 11:59:37 [auto1.de] INFO: Scrape type for MN76950: 2
2026-03-30 11:59:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fddfe319-a9fe-5bed-9659-b7f3e9a236cc with identifier: MN76950
2026-03-30 11:59:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fddfe319-a9fe-5bed-9659-b7f3e9a236cc with scrape type 2
2026-03-30 11:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fddfe319-a9fe-5bed-9659-b7f3e9a236cc with scrape type 2
2026-03-30 11:59:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fddfe319-a9fe-5bed-9659-b7f3e9a236cc, identifier: MN76950
2026-03-30 11:59:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fddfe319-a9fe-5bed-9659-b7f3e9a236cc with identifier: MN76950
2026-03-30 11:59:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fddfe319-a9fe-5bed-9659-b7f3e9a236cc with identifier: MN76950
2026-03-30 11:59:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fddfe319-a9fe-5bed-9659-b7f3e9a236cc with identifier: MN76950 to the API
2026-03-30 11:59:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:41:42Z',
 'fuel_type': 'diesel',
 'id': 'fddfe319-a9fe-5bed-9659-b7f3e9a236cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN76950',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 118990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Active L2',
 'transmission': 'manual',
 'trim': 'Active L2',
 'year': 2019}
2026-03-30 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN76950%27 HTTP/1.1" 200 None
2026-03-30 11:59:37 [auto1.de] INFO: Saving data for MN76950: {'auction_closing_time': 1774885302.0, 'created_time': 1774350059.881302, 'last_price_update_time': 1774871977.632882}
2026-03-30 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN76950') HTTP/1.1" 204 0
2026-03-30 11:59:37 [auto1.de] INFO: Found listing with ID: AG97842
2026-03-30 11:59:37 [auto1.de] INFO: Found listing with ID: KV46000
2026-03-30 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV46000%27 HTTP/1.1" 200 None
2026-03-30 11:59:37 [auto1.de] INFO: Scrape type for KV46000: 2
2026-03-30 11:59:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e7ba12b-cf48-55f4-84ac-ba6f45290689 with identifier: KV46000
2026-03-30 11:59:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e7ba12b-cf48-55f4-84ac-ba6f45290689 with scrape type 2
2026-03-30 11:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e7ba12b-cf48-55f4-84ac-ba6f45290689 with scrape type 2
2026-03-30 11:59:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e7ba12b-cf48-55f4-84ac-ba6f45290689, identifier: KV46000
2026-03-30 11:59:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e7ba12b-cf48-55f4-84ac-ba6f45290689 with identifier: KV46000
2026-03-30 11:59:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e7ba12b-cf48-55f4-84ac-ba6f45290689 with identifier: KV46000
2026-03-30 11:59:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e7ba12b-cf48-55f4-84ac-ba6f45290689 with identifier: KV46000 to the API
2026-03-30 11:59:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:00:39Z',
 'fuel_type': 'petrol',
 'id': '4e7ba12b-cf48-55f4-84ac-ba6f45290689',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV46000',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 113534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-02',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Style',
 'year': 2014}
2026-03-30 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV46000%27 HTTP/1.1" 200 None
2026-03-30 11:59:38 [auto1.de] INFO: Saving data for KV46000: {'auction_closing_time': 1774882839.0, 'created_time': 1774089287.363021, 'last_price_update_time': 1774871978.0557}
2026-03-30 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV46000') HTTP/1.1" 204 0
2026-03-30 11:59:38 [auto1.de] INFO: Found listing with ID: LA95104
2026-03-30 11:59:38 [auto1.de] INFO: Found listing with ID: TA12646
2026-03-30 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA12646%27 HTTP/1.1" 200 None
2026-03-30 11:59:38 [auto1.de] INFO: Scrape type for TA12646: 2
2026-03-30 11:59:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47d593f1-d7b4-51d7-8bd1-7d59eff12fff with identifier: TA12646
2026-03-30 11:59:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47d593f1-d7b4-51d7-8bd1-7d59eff12fff with scrape type 2
2026-03-30 11:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47d593f1-d7b4-51d7-8bd1-7d59eff12fff with scrape type 2
2026-03-30 11:59:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47d593f1-d7b4-51d7-8bd1-7d59eff12fff, identifier: TA12646
2026-03-30 11:59:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47d593f1-d7b4-51d7-8bd1-7d59eff12fff with identifier: TA12646
2026-03-30 11:59:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47d593f1-d7b4-51d7-8bd1-7d59eff12fff with identifier: TA12646
2026-03-30 11:59:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47d593f1-d7b4-51d7-8bd1-7d59eff12fff with identifier: TA12646 to the API
2026-03-30 11:59:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 510,
 'expiration_date': '2026-03-30T15:32:41Z',
 'fuel_type': 'petrol',
 'id': '47d593f1-d7b4-51d7-8bd1-7d59eff12fff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA12646',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 165255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-25',
 'seller_name': None,
 'title': 'BMW 4er M4 xDrive Competition',
 'transmission': 'automatic',
 'trim': 'xDrive Competition',
 'year': 2022}
2026-03-30 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA12646%27 HTTP/1.1" 200 None
2026-03-30 11:59:38 [auto1.de] INFO: Saving data for TA12646: {'auction_closing_time': 1774884761.0, 'created_time': 1773301374.097241, 'last_price_update_time': 1774871978.475591}
2026-03-30 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA12646') HTTP/1.1" 204 0
2026-03-30 11:59:38 [auto1.de] INFO: Found listing with ID: LX44847
2026-03-30 11:59:38 [auto1.de] INFO: Found listing with ID: LB45550
2026-03-30 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB45550%27 HTTP/1.1" 200 None
2026-03-30 11:59:38 [auto1.de] INFO: Scrape type for LB45550: 2
2026-03-30 11:59:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cef1c38-31d0-5cac-90d6-b1af3864eddb with identifier: LB45550
2026-03-30 11:59:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cef1c38-31d0-5cac-90d6-b1af3864eddb with scrape type 2
2026-03-30 11:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cef1c38-31d0-5cac-90d6-b1af3864eddb with scrape type 2
2026-03-30 11:59:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cef1c38-31d0-5cac-90d6-b1af3864eddb, identifier: LB45550
2026-03-30 11:59:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cef1c38-31d0-5cac-90d6-b1af3864eddb with identifier: LB45550
2026-03-30 11:59:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cef1c38-31d0-5cac-90d6-b1af3864eddb with identifier: LB45550
2026-03-30 11:59:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cef1c38-31d0-5cac-90d6-b1af3864eddb with identifier: LB45550 to the API
2026-03-30 11:59:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 121,
 'expiration_date': '2026-03-30T15:02:34Z',
 'fuel_type': 'petrol',
 'id': '6cef1c38-31d0-5cac-90d6-b1af3864eddb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB45550',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 153567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-20',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Skyactiv-G Prime-Line',
 'transmission': 'manual',
 'trim': 'Prime-Line',
 'year': 2019}
2026-03-30 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB45550%27 HTTP/1.1" 200 None
2026-03-30 11:59:38 [auto1.de] INFO: Saving data for LB45550: {'auction_closing_time': 1774882954.0, 'created_time': 1774694130.866996, 'last_price_update_time': 1774871978.998809}
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB45550') HTTP/1.1" 204 0
2026-03-30 11:59:39 [auto1.de] INFO: Found listing with ID: VG58612
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG58612%27 HTTP/1.1" 200 None
2026-03-30 11:59:39 [auto1.de] INFO: Scrape type for VG58612: 2
2026-03-30 11:59:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c with identifier: VG58612
2026-03-30 11:59:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c with scrape type 2
2026-03-30 11:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c with scrape type 2
2026-03-30 11:59:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c, identifier: VG58612
2026-03-30 11:59:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c with identifier: VG58612
2026-03-30 11:59:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c with identifier: VG58612
2026-03-30 11:59:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c with identifier: VG58612 to the API
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:41:41Z',
 'fuel_type': 'diesel',
 'id': '1a19348c-d2db-58bd-a3fb-68f2cbd7d55c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG58612',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 187854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-31',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Premium Edition',
 'transmission': 'automatic',
 'trim': 'Premium Edition',
 'year': 2018}
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG58612%27 HTTP/1.1" 200 None
2026-03-30 11:59:39 [auto1.de] INFO: Saving data for VG58612: {'auction_closing_time': 1774885301.0, 'created_time': 1774694136.238401, 'last_price_update_time': 1774871979.363495}
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG58612') HTTP/1.1" 204 0
2026-03-30 11:59:39 [auto1.de] INFO: Found listing with ID: YC71395
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC71395%27 HTTP/1.1" 200 None
2026-03-30 11:59:39 [auto1.de] INFO: Scrape type for YC71395: 2
2026-03-30 11:59:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5f42f13-401c-5f80-923b-2eb45551dce0 with identifier: YC71395
2026-03-30 11:59:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5f42f13-401c-5f80-923b-2eb45551dce0 with scrape type 2
2026-03-30 11:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5f42f13-401c-5f80-923b-2eb45551dce0 with scrape type 2
2026-03-30 11:59:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5f42f13-401c-5f80-923b-2eb45551dce0, identifier: YC71395
2026-03-30 11:59:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5f42f13-401c-5f80-923b-2eb45551dce0 with identifier: YC71395
2026-03-30 11:59:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5f42f13-401c-5f80-923b-2eb45551dce0 with identifier: YC71395
2026-03-30 11:59:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5f42f13-401c-5f80-923b-2eb45551dce0 with identifier: YC71395 to the API
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:58:43Z',
 'fuel_type': 'diesel',
 'id': 'c5f42f13-401c-5f80-923b-2eb45551dce0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC71395',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 69107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC71395%27 HTTP/1.1" 200 None
2026-03-30 11:59:39 [auto1.de] INFO: Saving data for YC71395: {'auction_closing_time': 1774886323.0, 'created_time': 1773466897.330164, 'last_price_update_time': 1774871979.77005}
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC71395') HTTP/1.1" 204 0
2026-03-30 11:59:39 [auto1.de] INFO: Found listing with ID: GG20866
2026-03-30 11:59:39 [auto1.de] INFO: Found listing with ID: SW39146
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW39146%27 HTTP/1.1" 200 None
2026-03-30 11:59:39 [auto1.de] INFO: Scrape type for SW39146: 2
2026-03-30 11:59:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 944e7e6f-0b17-54ff-baea-49d4542c53ef with identifier: SW39146
2026-03-30 11:59:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 944e7e6f-0b17-54ff-baea-49d4542c53ef with scrape type 2
2026-03-30 11:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 944e7e6f-0b17-54ff-baea-49d4542c53ef with scrape type 2
2026-03-30 11:59:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 944e7e6f-0b17-54ff-baea-49d4542c53ef, identifier: SW39146
2026-03-30 11:59:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 944e7e6f-0b17-54ff-baea-49d4542c53ef with identifier: SW39146
2026-03-30 11:59:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 944e7e6f-0b17-54ff-baea-49d4542c53ef with identifier: SW39146
2026-03-30 11:59:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 944e7e6f-0b17-54ff-baea-49d4542c53ef with identifier: SW39146 to the API
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:48:03Z',
 'fuel_type': 'petrol',
 'id': '944e7e6f-0b17-54ff-baea-49d4542c53ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW39146',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 76252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-26',
 'seller_name': None,
 'title': 'Jaguar XF 30t Sport AWD',
 'transmission': 'automatic',
 'trim': 'Sport AWD',
 'year': 2019}
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW39146%27 HTTP/1.1" 200 None
2026-03-30 11:59:40 [auto1.de] INFO: Saving data for SW39146: {'auction_closing_time': 1774885683.0, 'created_time': 1774349373.682184, 'last_price_update_time': 1774871980.166802}
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW39146') HTTP/1.1" 204 0
2026-03-30 11:59:40 [auto1.de] INFO: Found listing with ID: WY65265
2026-03-30 11:59:40 [auto1.de] INFO: Found listing with ID: SS56268
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS56268%27 HTTP/1.1" 200 None
2026-03-30 11:59:40 [auto1.de] INFO: Scrape type for SS56268: 2
2026-03-30 11:59:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a09f128-aacd-51ad-a7f5-c28e24a60e69 with identifier: SS56268
2026-03-30 11:59:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a09f128-aacd-51ad-a7f5-c28e24a60e69 with scrape type 2
2026-03-30 11:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a09f128-aacd-51ad-a7f5-c28e24a60e69 with scrape type 2
2026-03-30 11:59:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a09f128-aacd-51ad-a7f5-c28e24a60e69, identifier: SS56268
2026-03-30 11:59:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a09f128-aacd-51ad-a7f5-c28e24a60e69 with identifier: SS56268
2026-03-30 11:59:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a09f128-aacd-51ad-a7f5-c28e24a60e69 with identifier: SS56268
2026-03-30 11:59:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a09f128-aacd-51ad-a7f5-c28e24a60e69 with identifier: SS56268 to the API
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-30T15:36:30Z',
 'fuel_type': 'petrol',
 'id': '1a09f128-aacd-51ad-a7f5-c28e24a60e69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS56268',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 57572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-17',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TSI R',
 'transmission': 'manual',
 'trim': 'R',
 'year': 2015}
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS56268%27 HTTP/1.1" 200 None
2026-03-30 11:59:40 [auto1.de] INFO: Saving data for SS56268: {'auction_closing_time': 1774884990.0, 'created_time': 1773917339.201921, 'last_price_update_time': 1774871980.544583}
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS56268') HTTP/1.1" 204 0
2026-03-30 11:59:40 [auto1.de] INFO: Found listing with ID: HM38388
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM38388%27 HTTP/1.1" 200 None
2026-03-30 11:59:40 [auto1.de] INFO: Scrape type for HM38388: 2
2026-03-30 11:59:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11a11244-40b5-52af-90ab-6bd4f8219b42 with identifier: HM38388
2026-03-30 11:59:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11a11244-40b5-52af-90ab-6bd4f8219b42 with scrape type 2
2026-03-30 11:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11a11244-40b5-52af-90ab-6bd4f8219b42 with scrape type 2
2026-03-30 11:59:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11a11244-40b5-52af-90ab-6bd4f8219b42, identifier: HM38388
2026-03-30 11:59:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11a11244-40b5-52af-90ab-6bd4f8219b42 with identifier: HM38388
2026-03-30 11:59:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11a11244-40b5-52af-90ab-6bd4f8219b42 with identifier: HM38388
2026-03-30 11:59:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11a11244-40b5-52af-90ab-6bd4f8219b42 with identifier: HM38388 to the API
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:45:42Z',
 'fuel_type': 'petrol',
 'id': '11a11244-40b5-52af-90ab-6bd4f8219b42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM38388',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 86270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-01-31',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2001}
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM38388%27 HTTP/1.1" 200 None
2026-03-30 11:59:40 [auto1.de] INFO: Saving data for HM38388: {'auction_closing_time': 1774885542.0, 'created_time': 1774694138.89955, 'last_price_update_time': 1774871980.944687}
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM38388') HTTP/1.1" 204 0
2026-03-30 11:59:40 [auto1.de] INFO: Found listing with ID: SA98041
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA98041%27 HTTP/1.1" 200 None
2026-03-30 11:59:40 [auto1.de] INFO: Scrape type for SA98041: 2
2026-03-30 11:59:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99b12379-1f78-5394-801a-e102a6b1d01b with identifier: SA98041
2026-03-30 11:59:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99b12379-1f78-5394-801a-e102a6b1d01b with scrape type 2
2026-03-30 11:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99b12379-1f78-5394-801a-e102a6b1d01b with scrape type 2
2026-03-30 11:59:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99b12379-1f78-5394-801a-e102a6b1d01b, identifier: SA98041
2026-03-30 11:59:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:59:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99b12379-1f78-5394-801a-e102a6b1d01b with identifier: SA98041
2026-03-30 11:59:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99b12379-1f78-5394-801a-e102a6b1d01b with identifier: SA98041
2026-03-30 11:59:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99b12379-1f78-5394-801a-e102a6b1d01b with identifier: SA98041 to the API
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:43:42Z',
 'fuel_type': 'diesel',
 'id': '99b12379-1f78-5394-801a-e102a6b1d01b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA98041',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 228064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-17',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2016}
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA98041%27 HTTP/1.1" 200 None
2026-03-30 11:59:41 [auto1.de] INFO: Saving data for SA98041: {'auction_closing_time': 1774885422.0, 'created_time': 1774694150.105674, 'last_price_update_time': 1774871981.325154}
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA98041') HTTP/1.1" 204 0
2026-03-30 11:59:41 [auto1.de] INFO: Found listing with ID: RV78416
2026-03-30 11:59:41 [auto1.de] INFO: Found listing with ID: GB67844
2026-03-30 11:59:41 [auto1.de] INFO: Found listing with ID: GJ08958
2026-03-30 11:59:41 [auto1.de] INFO: Found listing with ID: HS55924
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55924%27 HTTP/1.1" 200 None
2026-03-30 11:59:41 [auto1.de] INFO: Scrape type for HS55924: 2
2026-03-30 11:59:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5e40d7a-1df2-509f-8967-6a59f4236ef9 with identifier: HS55924
2026-03-30 11:59:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5e40d7a-1df2-509f-8967-6a59f4236ef9 with scrape type 2
2026-03-30 11:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5e40d7a-1df2-509f-8967-6a59f4236ef9 with scrape type 2
2026-03-30 11:59:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5e40d7a-1df2-509f-8967-6a59f4236ef9, identifier: HS55924
2026-03-30 11:59:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5e40d7a-1df2-509f-8967-6a59f4236ef9 with identifier: HS55924
2026-03-30 11:59:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5e40d7a-1df2-509f-8967-6a59f4236ef9 with identifier: HS55924
2026-03-30 11:59:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5e40d7a-1df2-509f-8967-6a59f4236ef9 with identifier: HS55924 to the API
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:23:17Z',
 'fuel_type': 'diesel',
 'id': 'f5e40d7a-1df2-509f-8967-6a59f4236ef9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS55924',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 142610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-16',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55924%27 HTTP/1.1" 200 None
2026-03-30 11:59:41 [auto1.de] INFO: Saving data for HS55924: {'auction_closing_time': 1774884197.0, 'created_time': 1774694151.662681, 'last_price_update_time': 1774871981.69742}
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS55924') HTTP/1.1" 204 0
2026-03-30 11:59:41 [auto1.de] INFO: Found listing with ID: RM27503
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM27503%27 HTTP/1.1" 200 None
2026-03-30 11:59:41 [auto1.de] INFO: Scrape type for RM27503: 2
2026-03-30 11:59:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccab6dd2-bfa9-575d-b391-4d8448d6049e with identifier: RM27503
2026-03-30 11:59:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccab6dd2-bfa9-575d-b391-4d8448d6049e with scrape type 2
2026-03-30 11:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccab6dd2-bfa9-575d-b391-4d8448d6049e with scrape type 2
2026-03-30 11:59:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccab6dd2-bfa9-575d-b391-4d8448d6049e, identifier: RM27503
2026-03-30 11:59:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccab6dd2-bfa9-575d-b391-4d8448d6049e with identifier: RM27503
2026-03-30 11:59:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccab6dd2-bfa9-575d-b391-4d8448d6049e with identifier: RM27503
2026-03-30 11:59:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccab6dd2-bfa9-575d-b391-4d8448d6049e with identifier: RM27503 to the API
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:07:07Z',
 'fuel_type': 'diesel',
 'id': 'ccab6dd2-bfa9-575d-b391-4d8448d6049e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM27503',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 287117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM27503%27 HTTP/1.1" 200 None
2026-03-30 11:59:42 [auto1.de] INFO: Saving data for RM27503: {'auction_closing_time': 1774883227.0, 'created_time': 1774694257.068653, 'last_price_update_time': 1774871982.165089}
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM27503') HTTP/1.1" 204 0
2026-03-30 11:59:42 [auto1.de] INFO: Channel: 24h | Page: 247 | totalHits: 10021 | hits on page: 40
2026-03-30 11:59:42 [auto1.de] INFO: Found listing with ID: ZD45339
2026-03-30 11:59:42 [auto1.de] INFO: Found listing with ID: BU26829
2026-03-30 11:59:42 [auto1.de] INFO: Found listing with ID: UL74029
2026-03-30 11:59:42 [auto1.de] INFO: Found listing with ID: GB23451
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB23451%27 HTTP/1.1" 200 None
2026-03-30 11:59:42 [auto1.de] INFO: Scrape type for GB23451: 2
2026-03-30 11:59:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03fc369c-9536-51ef-a70a-bc53d0d22c2b with identifier: GB23451
2026-03-30 11:59:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03fc369c-9536-51ef-a70a-bc53d0d22c2b with scrape type 2
2026-03-30 11:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03fc369c-9536-51ef-a70a-bc53d0d22c2b with scrape type 2
2026-03-30 11:59:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03fc369c-9536-51ef-a70a-bc53d0d22c2b, identifier: GB23451
2026-03-30 11:59:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03fc369c-9536-51ef-a70a-bc53d0d22c2b with identifier: GB23451
2026-03-30 11:59:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03fc369c-9536-51ef-a70a-bc53d0d22c2b with identifier: GB23451
2026-03-30 11:59:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03fc369c-9536-51ef-a70a-bc53d0d22c2b with identifier: GB23451 to the API
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:04:13Z',
 'fuel_type': 'diesel',
 'id': '03fc369c-9536-51ef-a70a-bc53d0d22c2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB23451',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 99114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-26',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB23451%27 HTTP/1.1" 200 None
2026-03-30 11:59:42 [auto1.de] INFO: Saving data for GB23451: {'auction_closing_time': 1774883053.0, 'created_time': 1774118663.627219, 'last_price_update_time': 1774871982.54717}
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB23451') HTTP/1.1" 204 0
2026-03-30 11:59:42 [auto1.de] INFO: Found listing with ID: DU93693
2026-03-30 11:59:42 [auto1.de] INFO: Found listing with ID: XV72554
2026-03-30 11:59:42 [auto1.de] INFO: Found listing with ID: RG68419
2026-03-30 11:59:42 [auto1.de] INFO: Found listing with ID: NE45887
2026-03-30 11:59:42 [auto1.de] INFO: Found listing with ID: VZ98908
2026-03-30 11:59:42 [auto1.de] INFO: Found listing with ID: MG84960
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG84960%27 HTTP/1.1" 200 None
2026-03-30 11:59:42 [auto1.de] INFO: Scrape type for MG84960: 2
2026-03-30 11:59:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46b5d5e9-a987-5298-a878-bcf8433f2a7f with identifier: MG84960
2026-03-30 11:59:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46b5d5e9-a987-5298-a878-bcf8433f2a7f with scrape type 2
2026-03-30 11:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46b5d5e9-a987-5298-a878-bcf8433f2a7f with scrape type 2
2026-03-30 11:59:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46b5d5e9-a987-5298-a878-bcf8433f2a7f, identifier: MG84960
2026-03-30 11:59:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:59:42 [auto1.de] INFO: Found listing with ID: GD85387
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD85387%27 HTTP/1.1" 200 None
2026-03-30 11:59:42 [auto1.de] INFO: Scrape type for GD85387: 2
2026-03-30 11:59:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d70cca7-8e41-5f63-82ab-48424c729afd with identifier: GD85387
2026-03-30 11:59:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d70cca7-8e41-5f63-82ab-48424c729afd with scrape type 2
2026-03-30 11:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d70cca7-8e41-5f63-82ab-48424c729afd with scrape type 2
2026-03-30 11:59:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d70cca7-8e41-5f63-82ab-48424c729afd, identifier: GD85387
2026-03-30 11:59:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46b5d5e9-a987-5298-a878-bcf8433f2a7f with identifier: MG84960
2026-03-30 11:59:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46b5d5e9-a987-5298-a878-bcf8433f2a7f with identifier: MG84960
2026-03-30 11:59:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46b5d5e9-a987-5298-a878-bcf8433f2a7f with identifier: MG84960 to the API
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:00:52Z',
 'fuel_type': 'petrol',
 'id': '46b5d5e9-a987-5298-a878-bcf8433f2a7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG84960',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 188478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-23',
 'seller_name': None,
 'title': 'Dacia Lodgy 1.6 SCe Stepway',
 'transmission': 'manual',
 'trim': 'Stepway',
 'year': 2019}
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG84960%27 HTTP/1.1" 200 None
2026-03-30 11:59:43 [auto1.de] INFO: Saving data for MG84960: {'auction_closing_time': 1774882852.0, 'created_time': 1774694176.205294, 'last_price_update_time': 1774871983.032477}
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG84960') HTTP/1.1" 204 0
2026-03-30 11:59:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d70cca7-8e41-5f63-82ab-48424c729afd with identifier: GD85387
2026-03-30 11:59:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d70cca7-8e41-5f63-82ab-48424c729afd with identifier: GD85387
2026-03-30 11:59:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d70cca7-8e41-5f63-82ab-48424c729afd with identifier: GD85387 to the API
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:42:57Z',
 'fuel_type': 'petrol',
 'id': '2d70cca7-8e41-5f63-82ab-48424c729afd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD85387',
 'listing': 'auction',
 'make': 'Infiniti',
 'model': 'QX70',
 'odometer': 105983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-03',
 'seller_name': None,
 'title': 'Infiniti QX70 3.7 V6 S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2016}
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD85387%27 HTTP/1.1" 200 None
2026-03-30 11:59:43 [auto1.de] INFO: Saving data for GD85387: {'auction_closing_time': 1774885377.0, 'created_time': 1774032896.056415, 'last_price_update_time': 1774871983.41547}
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD85387') HTTP/1.1" 204 0
2026-03-30 11:59:43 [auto1.de] INFO: Found listing with ID: KU56806
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU56806%27 HTTP/1.1" 200 None
2026-03-30 11:59:43 [auto1.de] INFO: Scrape type for KU56806: 2
2026-03-30 11:59:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea86f3eb-85a4-59f1-8270-431e62fee293 with identifier: KU56806
2026-03-30 11:59:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea86f3eb-85a4-59f1-8270-431e62fee293 with scrape type 2
2026-03-30 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea86f3eb-85a4-59f1-8270-431e62fee293 with scrape type 2
2026-03-30 11:59:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea86f3eb-85a4-59f1-8270-431e62fee293, identifier: KU56806
2026-03-30 11:59:43 [auto1.de] INFO: Found listing with ID: MF41650
2026-03-30 11:59:43 [auto1.de] INFO: Found listing with ID: NW01608
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01608%27 HTTP/1.1" 200 None
2026-03-30 11:59:43 [auto1.de] INFO: Scrape type for NW01608: 2
2026-03-30 11:59:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff with identifier: NW01608
2026-03-30 11:59:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff with scrape type 2
2026-03-30 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff with scrape type 2
2026-03-30 11:59:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff, identifier: NW01608
2026-03-30 11:59:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea86f3eb-85a4-59f1-8270-431e62fee293 with identifier: KU56806
2026-03-30 11:59:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea86f3eb-85a4-59f1-8270-431e62fee293 with identifier: KU56806
2026-03-30 11:59:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea86f3eb-85a4-59f1-8270-431e62fee293 with identifier: KU56806 to the API
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:30:08Z',
 'fuel_type': 'petrol',
 'id': 'ea86f3eb-85a4-59f1-8270-431e62fee293',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU56806',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 109022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-27',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2010}
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU56806%27 HTTP/1.1" 200 None
2026-03-30 11:59:43 [auto1.de] INFO: Saving data for KU56806: {'auction_closing_time': 1774884608.0, 'created_time': 1774118750.988484, 'last_price_update_time': 1774871983.888876}
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU56806') HTTP/1.1" 204 0
2026-03-30 11:59:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff with identifier: NW01608
2026-03-30 11:59:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff with identifier: NW01608
2026-03-30 11:59:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff with identifier: NW01608 to the API
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:20:46Z',
 'fuel_type': 'diesel',
 'id': '34fbe7c2-cfbe-51fe-ad8f-b648660b13ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW01608',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 77001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-15',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi EcoBlue Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2020}
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01608%27 HTTP/1.1" 200 None
2026-03-30 11:59:44 [auto1.de] INFO: Saving data for NW01608: {'auction_closing_time': 1774884046.0, 'created_time': 1774034112.135944, 'last_price_update_time': 1774871984.192439}
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW01608') HTTP/1.1" 204 0
2026-03-30 11:59:44 [auto1.de] INFO: Found listing with ID: BH58500
2026-03-30 11:59:44 [auto1.de] INFO: Found listing with ID: FN47599
2026-03-30 11:59:44 [auto1.de] INFO: Found listing with ID: YB04799
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB04799%27 HTTP/1.1" 200 None
2026-03-30 11:59:44 [auto1.de] INFO: Scrape type for YB04799: 2
2026-03-30 11:59:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bfdcd9d-0e4d-545c-b615-fc40c3d53514 with identifier: YB04799
2026-03-30 11:59:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bfdcd9d-0e4d-545c-b615-fc40c3d53514 with scrape type 2
2026-03-30 11:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bfdcd9d-0e4d-545c-b615-fc40c3d53514 with scrape type 2
2026-03-30 11:59:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bfdcd9d-0e4d-545c-b615-fc40c3d53514, identifier: YB04799
2026-03-30 11:59:44 [auto1.de] INFO: Found listing with ID: NV71817
2026-03-30 11:59:44 [auto1.de] INFO: Found listing with ID: TG89658
2026-03-30 11:59:44 [auto1.de] INFO: Found listing with ID: GA70819
2026-03-30 11:59:44 [auto1.de] INFO: Found listing with ID: TY06085
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY06085%27 HTTP/1.1" 200 None
2026-03-30 11:59:44 [auto1.de] INFO: Scrape type for TY06085: 2
2026-03-30 11:59:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bce86a12-6770-5592-a386-5a5a62d50f10 with identifier: TY06085
2026-03-30 11:59:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce86a12-6770-5592-a386-5a5a62d50f10 with scrape type 2
2026-03-30 11:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bce86a12-6770-5592-a386-5a5a62d50f10 with scrape type 2
2026-03-30 11:59:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bce86a12-6770-5592-a386-5a5a62d50f10, identifier: TY06085
2026-03-30 11:59:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bfdcd9d-0e4d-545c-b615-fc40c3d53514 with identifier: YB04799
2026-03-30 11:59:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bfdcd9d-0e4d-545c-b615-fc40c3d53514 with identifier: YB04799
2026-03-30 11:59:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bfdcd9d-0e4d-545c-b615-fc40c3d53514 with identifier: YB04799 to the API
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:49:44Z',
 'fuel_type': 'petrol',
 'id': '6bfdcd9d-0e4d-545c-b615-fc40c3d53514',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB04799',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 58474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-05',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Connect',
 'transmission': 'manual',
 'trim': 'Connect',
 'year': 2012}
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB04799%27 HTTP/1.1" 200 None
2026-03-30 11:59:44 [auto1.de] INFO: Saving data for YB04799: {'auction_closing_time': 1774885784.0, 'created_time': 1774694198.880254, 'last_price_update_time': 1774871984.715324}
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB04799') HTTP/1.1" 204 0
2026-03-30 11:59:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bce86a12-6770-5592-a386-5a5a62d50f10 with identifier: TY06085
2026-03-30 11:59:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bce86a12-6770-5592-a386-5a5a62d50f10 with identifier: TY06085
2026-03-30 11:59:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bce86a12-6770-5592-a386-5a5a62d50f10 with identifier: TY06085 to the API
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:44:19Z',
 'fuel_type': 'petrol',
 'id': 'bce86a12-6770-5592-a386-5a5a62d50f10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY06085',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 54764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-09',
 'seller_name': None,
 'title': 'Suzuki Swift 1.3 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2010}
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY06085%27 HTTP/1.1" 200 None
2026-03-30 11:59:45 [auto1.de] INFO: Saving data for TY06085: {'auction_closing_time': 1774885459.0, 'created_time': 1774694142.275416, 'last_price_update_time': 1774871985.020053}
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY06085') HTTP/1.1" 204 0
2026-03-30 11:59:45 [auto1.de] INFO: Found listing with ID: JS16399
2026-03-30 11:59:45 [auto1.de] INFO: Found listing with ID: ME28341
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME28341%27 HTTP/1.1" 200 None
2026-03-30 11:59:45 [auto1.de] INFO: Scrape type for ME28341: 2
2026-03-30 11:59:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09db8b05-6129-57da-a056-0a494dafc844 with identifier: ME28341
2026-03-30 11:59:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09db8b05-6129-57da-a056-0a494dafc844 with scrape type 2
2026-03-30 11:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09db8b05-6129-57da-a056-0a494dafc844 with scrape type 2
2026-03-30 11:59:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09db8b05-6129-57da-a056-0a494dafc844, identifier: ME28341
2026-03-30 11:59:45 [auto1.de] INFO: Found listing with ID: NU23342
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23342%27 HTTP/1.1" 200 None
2026-03-30 11:59:45 [auto1.de] INFO: Scrape type for NU23342: 2
2026-03-30 11:59:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8 with identifier: NU23342
2026-03-30 11:59:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8 with scrape type 2
2026-03-30 11:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8 with scrape type 2
2026-03-30 11:59:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8, identifier: NU23342
2026-03-30 11:59:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09db8b05-6129-57da-a056-0a494dafc844 with identifier: ME28341
2026-03-30 11:59:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09db8b05-6129-57da-a056-0a494dafc844 with identifier: ME28341
2026-03-30 11:59:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09db8b05-6129-57da-a056-0a494dafc844 with identifier: ME28341 to the API
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:29:26Z',
 'fuel_type': 'petrol',
 'id': '09db8b05-6129-57da-a056-0a494dafc844',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME28341',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 69902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-10',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 MPI Joy',
 'transmission': 'manual',
 'trim': 'Joy',
 'year': 2016}
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME28341%27 HTTP/1.1" 200 None
2026-03-30 11:59:45 [auto1.de] INFO: Saving data for ME28341: {'auction_closing_time': 1774884566.0, 'created_time': 1774694147.021136, 'last_price_update_time': 1774871985.525252}
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME28341') HTTP/1.1" 204 0
2026-03-30 11:59:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8 with identifier: NU23342
2026-03-30 11:59:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8 with identifier: NU23342
2026-03-30 11:59:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8 with identifier: NU23342 to the API
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:19:45Z',
 'fuel_type': 'petrol',
 'id': '97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU23342',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 150914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2014}
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23342%27 HTTP/1.1" 200 None
2026-03-30 11:59:45 [auto1.de] INFO: Saving data for NU23342: {'auction_closing_time': 1774883985.0, 'created_time': 1774694171.335417, 'last_price_update_time': 1774871985.887872}
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU23342') HTTP/1.1" 204 0
2026-03-30 11:59:45 [auto1.de] INFO: Found listing with ID: JP40190
2026-03-30 11:59:45 [auto1.de] INFO: Found listing with ID: AU10222
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU10222%27 HTTP/1.1" 200 None
2026-03-30 11:59:45 [auto1.de] INFO: Scrape type for AU10222: 2
2026-03-30 11:59:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5be300ce-81a4-5545-899e-f30d43da3bbe with identifier: AU10222
2026-03-30 11:59:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5be300ce-81a4-5545-899e-f30d43da3bbe with scrape type 2
2026-03-30 11:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5be300ce-81a4-5545-899e-f30d43da3bbe with scrape type 2
2026-03-30 11:59:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5be300ce-81a4-5545-899e-f30d43da3bbe, identifier: AU10222
2026-03-30 11:59:46 [auto1.de] INFO: Found listing with ID: BW55074
2026-03-30 11:59:46 [auto1.de] INFO: Found listing with ID: XE90423
2026-03-30 11:59:46 [auto1.de] INFO: Found listing with ID: SK80695
2026-03-30 11:59:46 [auto1.de] INFO: Found listing with ID: FL62048
2026-03-30 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL62048%27 HTTP/1.1" 200 None
2026-03-30 11:59:46 [auto1.de] INFO: Scrape type for FL62048: 2
2026-03-30 11:59:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3017df4-9d20-5512-8803-bf32bd7385e5 with identifier: FL62048
2026-03-30 11:59:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3017df4-9d20-5512-8803-bf32bd7385e5 with scrape type 2
2026-03-30 11:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3017df4-9d20-5512-8803-bf32bd7385e5 with scrape type 2
2026-03-30 11:59:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3017df4-9d20-5512-8803-bf32bd7385e5, identifier: FL62048
2026-03-30 11:59:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5be300ce-81a4-5545-899e-f30d43da3bbe with identifier: AU10222
2026-03-30 11:59:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5be300ce-81a4-5545-899e-f30d43da3bbe with identifier: AU10222
2026-03-30 11:59:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5be300ce-81a4-5545-899e-f30d43da3bbe with identifier: AU10222 to the API
2026-03-30 11:59:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:37Z',
 'fuel_type': 'diesel',
 'id': '5be300ce-81a4-5545-899e-f30d43da3bbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU10222',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 131251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-11',
 'seller_name': None,
 'title': 'BMW 2er 218d Gran Tourer M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-30 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU10222%27 HTTP/1.1" 200 None
2026-03-30 11:59:46 [auto1.de] INFO: Saving data for AU10222: {'auction_closing_time': 1774883197.0, 'created_time': 1774032207.91939, 'last_price_update_time': 1774871986.408395}
2026-03-30 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU10222') HTTP/1.1" 204 0
2026-03-30 11:59:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3017df4-9d20-5512-8803-bf32bd7385e5 with identifier: FL62048
2026-03-30 11:59:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3017df4-9d20-5512-8803-bf32bd7385e5 with identifier: FL62048
2026-03-30 11:59:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3017df4-9d20-5512-8803-bf32bd7385e5 with identifier: FL62048 to the API
2026-03-30 11:59:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:35:36Z',
 'fuel_type': 'diesel',
 'id': 'c3017df4-9d20-5512-8803-bf32bd7385e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL62048',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 180722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2016}
2026-03-30 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL62048%27 HTTP/1.1" 200 None
2026-03-30 11:59:46 [auto1.de] INFO: Saving data for FL62048: {'auction_closing_time': 1774884936.0, 'created_time': 1774694161.274836, 'last_price_update_time': 1774871986.699326}
2026-03-30 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL62048') HTTP/1.1" 204 0
2026-03-30 11:59:46 [auto1.de] INFO: Found listing with ID: JN77870
2026-03-30 11:59:46 [auto1.de] INFO: Found listing with ID: MN75028
2026-03-30 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN75028%27 HTTP/1.1" 200 None
2026-03-30 11:59:46 [auto1.de] INFO: Scrape type for MN75028: 2
2026-03-30 11:59:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8580c2f3-7247-5588-abc8-9f5343fdb2e4 with identifier: MN75028
2026-03-30 11:59:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8580c2f3-7247-5588-abc8-9f5343fdb2e4 with scrape type 2
2026-03-30 11:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8580c2f3-7247-5588-abc8-9f5343fdb2e4 with scrape type 2
2026-03-30 11:59:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8580c2f3-7247-5588-abc8-9f5343fdb2e4, identifier: MN75028
2026-03-30 11:59:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8580c2f3-7247-5588-abc8-9f5343fdb2e4 with identifier: MN75028
2026-03-30 11:59:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8580c2f3-7247-5588-abc8-9f5343fdb2e4 with identifier: MN75028
2026-03-30 11:59:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8580c2f3-7247-5588-abc8-9f5343fdb2e4 with identifier: MN75028 to the API
2026-03-30 11:59:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:07:30Z',
 'fuel_type': 'diesel',
 'id': '8580c2f3-7247-5588-abc8-9f5343fdb2e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN75028',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 301680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2016}
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN75028%27 HTTP/1.1" 200 None
2026-03-30 11:59:47 [auto1.de] INFO: Saving data for MN75028: {'auction_closing_time': 1774883250.0, 'created_time': 1774694173.488493, 'last_price_update_time': 1774871987.11241}
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN75028') HTTP/1.1" 204 0
2026-03-30 11:59:47 [auto1.de] INFO: Found listing with ID: LR31578
2026-03-30 11:59:47 [auto1.de] INFO: Found listing with ID: SB90605
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB90605%27 HTTP/1.1" 200 None
2026-03-30 11:59:47 [auto1.de] INFO: Scrape type for SB90605: 2
2026-03-30 11:59:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85733017-482c-5aa5-ae3d-39c5cf1e9b63 with identifier: SB90605
2026-03-30 11:59:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85733017-482c-5aa5-ae3d-39c5cf1e9b63 with scrape type 2
2026-03-30 11:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85733017-482c-5aa5-ae3d-39c5cf1e9b63 with scrape type 2
2026-03-30 11:59:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85733017-482c-5aa5-ae3d-39c5cf1e9b63, identifier: SB90605
2026-03-30 11:59:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85733017-482c-5aa5-ae3d-39c5cf1e9b63 with identifier: SB90605
2026-03-30 11:59:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85733017-482c-5aa5-ae3d-39c5cf1e9b63 with identifier: SB90605
2026-03-30 11:59:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85733017-482c-5aa5-ae3d-39c5cf1e9b63 with identifier: SB90605 to the API
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:38:47Z',
 'fuel_type': 'diesel',
 'id': '85733017-482c-5aa5-ae3d-39c5cf1e9b63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB90605',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 166319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-11',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB90605%27 HTTP/1.1" 200 None
2026-03-30 11:59:47 [auto1.de] INFO: Saving data for SB90605: {'auction_closing_time': 1774885127.0, 'created_time': 1774033101.170897, 'last_price_update_time': 1774871987.537927}
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB90605') HTTP/1.1" 204 0
2026-03-30 11:59:47 [auto1.de] INFO: Found listing with ID: HL93382
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL93382%27 HTTP/1.1" 200 None
2026-03-30 11:59:47 [auto1.de] INFO: Scrape type for HL93382: 2
2026-03-30 11:59:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae973c76-46f9-5fa2-8d82-64faa3b77acd with identifier: HL93382
2026-03-30 11:59:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae973c76-46f9-5fa2-8d82-64faa3b77acd with scrape type 2
2026-03-30 11:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae973c76-46f9-5fa2-8d82-64faa3b77acd with scrape type 2
2026-03-30 11:59:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae973c76-46f9-5fa2-8d82-64faa3b77acd, identifier: HL93382
2026-03-30 11:59:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae973c76-46f9-5fa2-8d82-64faa3b77acd with identifier: HL93382
2026-03-30 11:59:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae973c76-46f9-5fa2-8d82-64faa3b77acd with identifier: HL93382
2026-03-30 11:59:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae973c76-46f9-5fa2-8d82-64faa3b77acd with identifier: HL93382 to the API
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:25:52Z',
 'fuel_type': 'petrol',
 'id': 'ae973c76-46f9-5fa2-8d82-64faa3b77acd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL93382',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 32375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-07',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2024}
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL93382%27 HTTP/1.1" 200 None
2026-03-30 11:59:47 [auto1.de] INFO: Saving data for HL93382: {'auction_closing_time': 1774884352.0, 'created_time': 1774694154.259702, 'last_price_update_time': 1774871987.932599}
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL93382') HTTP/1.1" 204 0
2026-03-30 11:59:48 [auto1.de] INFO: Found listing with ID: HU71027
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU71027%27 HTTP/1.1" 200 None
2026-03-30 11:59:48 [auto1.de] INFO: Scrape type for HU71027: 2
2026-03-30 11:59:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b13b881e-706a-5c25-9dd9-c4635d4fbfda with identifier: HU71027
2026-03-30 11:59:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b13b881e-706a-5c25-9dd9-c4635d4fbfda with scrape type 2
2026-03-30 11:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b13b881e-706a-5c25-9dd9-c4635d4fbfda with scrape type 2
2026-03-30 11:59:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b13b881e-706a-5c25-9dd9-c4635d4fbfda, identifier: HU71027
2026-03-30 11:59:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b13b881e-706a-5c25-9dd9-c4635d4fbfda with identifier: HU71027
2026-03-30 11:59:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b13b881e-706a-5c25-9dd9-c4635d4fbfda with identifier: HU71027
2026-03-30 11:59:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b13b881e-706a-5c25-9dd9-c4635d4fbfda with identifier: HU71027 to the API
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:58:02Z',
 'fuel_type': 'petrol',
 'id': 'b13b881e-706a-5c25-9dd9-c4635d4fbfda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU71027',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 144412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-17',
 'seller_name': None,
 'title': 'Kia Picanto 1.1 EX',
 'transmission': 'manual',
 'trim': 'EX',
 'year': 2006}
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU71027%27 HTTP/1.1" 200 None
2026-03-30 11:59:48 [auto1.de] INFO: Saving data for HU71027: {'auction_closing_time': 1774886282.0, 'created_time': 1774694167.32364, 'last_price_update_time': 1774871988.441969}
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU71027') HTTP/1.1" 204 0
2026-03-30 11:59:48 [auto1.de] INFO: Found listing with ID: HW93754
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW93754%27 HTTP/1.1" 200 None
2026-03-30 11:59:48 [auto1.de] INFO: Scrape type for HW93754: 2
2026-03-30 11:59:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb8f772c-f708-53ca-a348-a48fc7e49114 with identifier: HW93754
2026-03-30 11:59:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb8f772c-f708-53ca-a348-a48fc7e49114 with scrape type 2
2026-03-30 11:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb8f772c-f708-53ca-a348-a48fc7e49114 with scrape type 2
2026-03-30 11:59:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb8f772c-f708-53ca-a348-a48fc7e49114, identifier: HW93754
2026-03-30 11:59:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb8f772c-f708-53ca-a348-a48fc7e49114 with identifier: HW93754
2026-03-30 11:59:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb8f772c-f708-53ca-a348-a48fc7e49114 with identifier: HW93754
2026-03-30 11:59:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb8f772c-f708-53ca-a348-a48fc7e49114 with identifier: HW93754 to the API
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-30T15:58:01Z',
 'fuel_type': 'petrol',
 'id': 'fb8f772c-f708-53ca-a348-a48fc7e49114',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW93754',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 21109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-01',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet Mild-Hybrid Club 4x2',
 'transmission': 'manual',
 'trim': 'Club 4x2',
 'year': 2023}
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW93754%27 HTTP/1.1" 200 None
2026-03-30 11:59:48 [auto1.de] INFO: Saving data for HW93754: {'auction_closing_time': 1774886281.0, 'created_time': 1773467875.638911, 'last_price_update_time': 1774871988.850145}
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW93754') HTTP/1.1" 204 0
2026-03-30 11:59:48 [auto1.de] INFO: Found listing with ID: KV33816
2026-03-30 11:59:48 [auto1.de] INFO: Found listing with ID: NB68023
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB68023%27 HTTP/1.1" 200 None
2026-03-30 11:59:48 [auto1.de] INFO: Scrape type for NB68023: 2
2026-03-30 11:59:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d67f1478-1ed0-5810-9654-25dc38d68803 with identifier: NB68023
2026-03-30 11:59:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d67f1478-1ed0-5810-9654-25dc38d68803 with scrape type 2
2026-03-30 11:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d67f1478-1ed0-5810-9654-25dc38d68803 with scrape type 2
2026-03-30 11:59:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d67f1478-1ed0-5810-9654-25dc38d68803, identifier: NB68023
2026-03-30 11:59:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d67f1478-1ed0-5810-9654-25dc38d68803 with identifier: NB68023
2026-03-30 11:59:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d67f1478-1ed0-5810-9654-25dc38d68803 with identifier: NB68023
2026-03-30 11:59:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d67f1478-1ed0-5810-9654-25dc38d68803 with identifier: NB68023 to the API
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:05:27Z',
 'fuel_type': 'diesel',
 'id': 'd67f1478-1ed0-5810-9654-25dc38d68803',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB68023',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 172423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-26',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2016}
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB68023%27 HTTP/1.1" 200 None
2026-03-30 11:59:49 [auto1.de] INFO: Saving data for NB68023: {'auction_closing_time': 1774883127.0, 'created_time': 1773466604.492659, 'last_price_update_time': 1774871989.263043}
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB68023') HTTP/1.1" 204 0
2026-03-30 11:59:49 [auto1.de] INFO: Found listing with ID: BG93361
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG93361%27 HTTP/1.1" 200 None
2026-03-30 11:59:49 [auto1.de] INFO: Scrape type for BG93361: 2
2026-03-30 11:59:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 581f6631-be25-53cb-875a-77c2e6deaf86 with identifier: BG93361
2026-03-30 11:59:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 581f6631-be25-53cb-875a-77c2e6deaf86 with scrape type 2
2026-03-30 11:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 581f6631-be25-53cb-875a-77c2e6deaf86 with scrape type 2
2026-03-30 11:59:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 581f6631-be25-53cb-875a-77c2e6deaf86, identifier: BG93361
2026-03-30 11:59:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 581f6631-be25-53cb-875a-77c2e6deaf86 with identifier: BG93361
2026-03-30 11:59:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 581f6631-be25-53cb-875a-77c2e6deaf86 with identifier: BG93361
2026-03-30 11:59:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 581f6631-be25-53cb-875a-77c2e6deaf86 with identifier: BG93361 to the API
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-30T15:15:51Z',
 'fuel_type': 'petrol',
 'id': '581f6631-be25-53cb-875a-77c2e6deaf86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG93361',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Verso',
 'odometer': 245520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-20',
 'seller_name': None,
 'title': 'Toyota Verso 1.8 Travel',
 'transmission': 'manual',
 'trim': 'Travel',
 'year': 2012}
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG93361%27 HTTP/1.1" 200 None
2026-03-30 11:59:49 [auto1.de] INFO: Saving data for BG93361: {'auction_closing_time': 1774883751.0, 'created_time': 1773468278.96402, 'last_price_update_time': 1774871989.752945}
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG93361') HTTP/1.1" 204 0
2026-03-30 11:59:49 [auto1.de] INFO: Found listing with ID: ZV32018
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV32018%27 HTTP/1.1" 200 None
2026-03-30 11:59:49 [auto1.de] INFO: Scrape type for ZV32018: 2
2026-03-30 11:59:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e8876c3-b03f-5eee-bed9-a39d915b9f60 with identifier: ZV32018
2026-03-30 11:59:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e8876c3-b03f-5eee-bed9-a39d915b9f60 with scrape type 2
2026-03-30 11:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e8876c3-b03f-5eee-bed9-a39d915b9f60 with scrape type 2
2026-03-30 11:59:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e8876c3-b03f-5eee-bed9-a39d915b9f60, identifier: ZV32018
2026-03-30 11:59:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e8876c3-b03f-5eee-bed9-a39d915b9f60 with identifier: ZV32018
2026-03-30 11:59:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e8876c3-b03f-5eee-bed9-a39d915b9f60 with identifier: ZV32018
2026-03-30 11:59:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e8876c3-b03f-5eee-bed9-a39d915b9f60 with identifier: ZV32018 to the API
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:39:43Z',
 'fuel_type': 'petrol',
 'id': '7e8876c3-b03f-5eee-bed9-a39d915b9f60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV32018',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 112053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-24',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost SYNC Edition',
 'transmission': 'manual',
 'trim': 'SYNC Edition',
 'year': 2013}
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV32018%27 HTTP/1.1" 200 None
2026-03-30 11:59:50 [auto1.de] INFO: Saving data for ZV32018: {'auction_closing_time': 1774885183.0, 'created_time': 1774694152.40019, 'last_price_update_time': 1774871990.137408}
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV32018') HTTP/1.1" 204 0
2026-03-30 11:59:50 [auto1.de] INFO: Found listing with ID: MV90577
2026-03-30 11:59:50 [auto1.de] INFO: Found listing with ID: DF55649
2026-03-30 11:59:50 [auto1.de] INFO: Found listing with ID: FT64289
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64289%27 HTTP/1.1" 200 None
2026-03-30 11:59:50 [auto1.de] INFO: Scrape type for FT64289: 2
2026-03-30 11:59:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 133c4d7c-6612-550f-b57f-bdafea4b7b9a with identifier: FT64289
2026-03-30 11:59:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 133c4d7c-6612-550f-b57f-bdafea4b7b9a with scrape type 2
2026-03-30 11:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 133c4d7c-6612-550f-b57f-bdafea4b7b9a with scrape type 2
2026-03-30 11:59:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 133c4d7c-6612-550f-b57f-bdafea4b7b9a, identifier: FT64289
2026-03-30 11:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:59:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 133c4d7c-6612-550f-b57f-bdafea4b7b9a with identifier: FT64289
2026-03-30 11:59:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 133c4d7c-6612-550f-b57f-bdafea4b7b9a with identifier: FT64289
2026-03-30 11:59:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 133c4d7c-6612-550f-b57f-bdafea4b7b9a with identifier: FT64289 to the API
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:21:50Z',
 'fuel_type': 'diesel',
 'id': '133c4d7c-6612-550f-b57f-bdafea4b7b9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT64289',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 8,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-06-01',
 'seller_name': None,
 'title': 'Renault Master 2.0 BLUE dCi 3,5t L2H2 Advance',
 'transmission': 'manual',
 'trim': '3,5t L2H2 Advance',
 'year': 2025}
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64289%27 HTTP/1.1" 200 None
2026-03-30 11:59:50 [auto1.de] INFO: Saving data for FT64289: {'auction_closing_time': 1774884110.0, 'created_time': 1773467046.002436, 'last_price_update_time': 1774871990.553618}
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT64289') HTTP/1.1" 204 0
2026-03-30 11:59:50 [auto1.de] INFO: Found listing with ID: ED71538
2026-03-30 11:59:50 [auto1.de] INFO: Found listing with ID: PJ47645
2026-03-30 11:59:50 [auto1.de] INFO: Found listing with ID: UT04321
2026-03-30 11:59:50 [auto1.de] INFO: Found listing with ID: KE10146
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE10146%27 HTTP/1.1" 200 None
2026-03-30 11:59:50 [auto1.de] INFO: Scrape type for KE10146: 2
2026-03-30 11:59:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc611779-2aff-5dfd-8d68-92ca6cef7719 with identifier: KE10146
2026-03-30 11:59:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc611779-2aff-5dfd-8d68-92ca6cef7719 with scrape type 2
2026-03-30 11:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc611779-2aff-5dfd-8d68-92ca6cef7719 with scrape type 2
2026-03-30 11:59:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc611779-2aff-5dfd-8d68-92ca6cef7719, identifier: KE10146
2026-03-30 11:59:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc611779-2aff-5dfd-8d68-92ca6cef7719 with identifier: KE10146
2026-03-30 11:59:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc611779-2aff-5dfd-8d68-92ca6cef7719 with identifier: KE10146
2026-03-30 11:59:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc611779-2aff-5dfd-8d68-92ca6cef7719 with identifier: KE10146 to the API
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:11:52Z',
 'fuel_type': 'diesel',
 'id': 'cc611779-2aff-5dfd-8d68-92ca6cef7719',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE10146',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 221882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-22',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE10146%27 HTTP/1.1" 200 None
2026-03-30 11:59:50 [auto1.de] INFO: Saving data for KE10146: {'auction_closing_time': 1774883512.0, 'created_time': 1774694274.607095, 'last_price_update_time': 1774871990.947486}
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE10146') HTTP/1.1" 204 0
2026-03-30 11:59:51 [auto1.de] INFO: Found listing with ID: PN64243
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN64243%27 HTTP/1.1" 200 None
2026-03-30 11:59:51 [auto1.de] INFO: Scrape type for PN64243: 2
2026-03-30 11:59:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8bed2b0-5856-501f-b6bc-30ea04bf2272 with identifier: PN64243
2026-03-30 11:59:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8bed2b0-5856-501f-b6bc-30ea04bf2272 with scrape type 2
2026-03-30 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8bed2b0-5856-501f-b6bc-30ea04bf2272 with scrape type 2
2026-03-30 11:59:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8bed2b0-5856-501f-b6bc-30ea04bf2272, identifier: PN64243
2026-03-30 11:59:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8bed2b0-5856-501f-b6bc-30ea04bf2272 with identifier: PN64243
2026-03-30 11:59:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8bed2b0-5856-501f-b6bc-30ea04bf2272 with identifier: PN64243
2026-03-30 11:59:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8bed2b0-5856-501f-b6bc-30ea04bf2272 with identifier: PN64243 to the API
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:41:24Z',
 'fuel_type': 'petrol',
 'id': 'e8bed2b0-5856-501f-b6bc-30ea04bf2272',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN64243',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 218792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-29',
 'seller_name': None,
 'title': 'Renault Kangoo 1.2 Campus',
 'transmission': 'manual',
 'trim': 'Campus',
 'year': 2009}
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN64243%27 HTTP/1.1" 200 None
2026-03-30 11:59:51 [auto1.de] INFO: Saving data for PN64243: {'auction_closing_time': 1774885284.0, 'created_time': 1774089097.285585, 'last_price_update_time': 1774871991.44148}
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN64243') HTTP/1.1" 204 0
2026-03-30 11:59:51 [auto1.de] INFO: Channel: 24h | Page: 248 | totalHits: 10022 | hits on page: 40
2026-03-30 11:59:51 [auto1.de] INFO: Found listing with ID: DF72133
2026-03-30 11:59:51 [auto1.de] INFO: Found listing with ID: RL77282
2026-03-30 11:59:51 [auto1.de] INFO: Found listing with ID: NC99241
2026-03-30 11:59:51 [auto1.de] INFO: Found listing with ID: YW14341
2026-03-30 11:59:51 [auto1.de] INFO: Found listing with ID: WH57282
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH57282%27 HTTP/1.1" 200 None
2026-03-30 11:59:51 [auto1.de] INFO: Scrape type for WH57282: 2
2026-03-30 11:59:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c6d5400-8ffa-525e-953f-58735e846c52 with identifier: WH57282
2026-03-30 11:59:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c6d5400-8ffa-525e-953f-58735e846c52 with scrape type 2
2026-03-30 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c6d5400-8ffa-525e-953f-58735e846c52 with scrape type 2
2026-03-30 11:59:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c6d5400-8ffa-525e-953f-58735e846c52, identifier: WH57282
2026-03-30 11:59:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c6d5400-8ffa-525e-953f-58735e846c52 with identifier: WH57282
2026-03-30 11:59:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c6d5400-8ffa-525e-953f-58735e846c52 with identifier: WH57282
2026-03-30 11:59:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c6d5400-8ffa-525e-953f-58735e846c52 with identifier: WH57282 to the API
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:23:19Z',
 'fuel_type': 'petrol',
 'id': '9c6d5400-8ffa-525e-953f-58735e846c52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH57282',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 146602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH57282%27 HTTP/1.1" 200 None
2026-03-30 11:59:51 [auto1.de] INFO: Saving data for WH57282: {'auction_closing_time': 1774884199.0, 'created_time': 1774694183.405419, 'last_price_update_time': 1774871991.827712}
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WH57282') HTTP/1.1" 204 0
2026-03-30 11:59:51 [auto1.de] INFO: Found listing with ID: WB94546
2026-03-30 11:59:51 [auto1.de] INFO: Found listing with ID: LV05660
2026-03-30 11:59:51 [auto1.de] INFO: Found listing with ID: ZY49257
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY49257%27 HTTP/1.1" 200 None
2026-03-30 11:59:51 [auto1.de] INFO: Scrape type for ZY49257: 2
2026-03-30 11:59:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8da9ac80-f1fa-5145-ac58-89a6e14d239a with identifier: ZY49257
2026-03-30 11:59:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8da9ac80-f1fa-5145-ac58-89a6e14d239a with scrape type 2
2026-03-30 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8da9ac80-f1fa-5145-ac58-89a6e14d239a with scrape type 2
2026-03-30 11:59:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8da9ac80-f1fa-5145-ac58-89a6e14d239a, identifier: ZY49257
2026-03-30 11:59:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:59:51 [auto1.de] INFO: Found listing with ID: SE82228
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE82228%27 HTTP/1.1" 200 None
2026-03-30 11:59:51 [auto1.de] INFO: Scrape type for SE82228: 2
2026-03-30 11:59:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cc868c2-c105-5ea4-a934-cbac36b80516 with identifier: SE82228
2026-03-30 11:59:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cc868c2-c105-5ea4-a934-cbac36b80516 with scrape type 2
2026-03-30 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cc868c2-c105-5ea4-a934-cbac36b80516 with scrape type 2
2026-03-30 11:59:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cc868c2-c105-5ea4-a934-cbac36b80516, identifier: SE82228
2026-03-30 11:59:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8da9ac80-f1fa-5145-ac58-89a6e14d239a with identifier: ZY49257
2026-03-30 11:59:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8da9ac80-f1fa-5145-ac58-89a6e14d239a with identifier: ZY49257
2026-03-30 11:59:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8da9ac80-f1fa-5145-ac58-89a6e14d239a with identifier: ZY49257 to the API
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:10:47Z',
 'fuel_type': 'diesel',
 'id': '8da9ac80-f1fa-5145-ac58-89a6e14d239a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY49257',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 96249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-28',
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi L2H2 HKa 3,5 Komfort',
 'transmission': 'manual',
 'trim': 'L2H2 HKa 3,5 Komfort',
 'year': 2021}
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY49257%27 HTTP/1.1" 200 None
2026-03-30 11:59:52 [auto1.de] INFO: Saving data for ZY49257: {'auction_closing_time': 1774883447.0, 'created_time': 1774264944.585885, 'last_price_update_time': 1774871992.338769}
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY49257') HTTP/1.1" 204 0
2026-03-30 11:59:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cc868c2-c105-5ea4-a934-cbac36b80516 with identifier: SE82228
2026-03-30 11:59:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cc868c2-c105-5ea4-a934-cbac36b80516 with identifier: SE82228
2026-03-30 11:59:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cc868c2-c105-5ea4-a934-cbac36b80516 with identifier: SE82228 to the API
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:38:12Z',
 'fuel_type': 'diesel',
 'id': '5cc868c2-c105-5ea4-a934-cbac36b80516',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE82228',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 65519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-02',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE82228%27 HTTP/1.1" 200 None
2026-03-30 11:59:52 [auto1.de] INFO: Saving data for SE82228: {'auction_closing_time': 1774885092.0, 'created_time': 1774349193.371459, 'last_price_update_time': 1774871992.611614}
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE82228') HTTP/1.1" 204 0
2026-03-30 11:59:52 [auto1.de] INFO: Found listing with ID: PG18082
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG18082%27 HTTP/1.1" 200 None
2026-03-30 11:59:52 [auto1.de] INFO: Scrape type for PG18082: 2
2026-03-30 11:59:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c85aeb97-4f94-58f2-afca-03f8884b1246 with identifier: PG18082
2026-03-30 11:59:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c85aeb97-4f94-58f2-afca-03f8884b1246 with scrape type 2
2026-03-30 11:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c85aeb97-4f94-58f2-afca-03f8884b1246 with scrape type 2
2026-03-30 11:59:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c85aeb97-4f94-58f2-afca-03f8884b1246, identifier: PG18082
2026-03-30 11:59:52 [auto1.de] INFO: Found listing with ID: WB94546
2026-03-30 11:59:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c85aeb97-4f94-58f2-afca-03f8884b1246 with identifier: PG18082
2026-03-30 11:59:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c85aeb97-4f94-58f2-afca-03f8884b1246 with identifier: PG18082
2026-03-30 11:59:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c85aeb97-4f94-58f2-afca-03f8884b1246 with identifier: PG18082 to the API
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:28:09Z',
 'fuel_type': 'petrol',
 'id': 'c85aeb97-4f94-58f2-afca-03f8884b1246',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG18082',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 67980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-27',
 'seller_name': None,
 'title': 'Audi Q2 30 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG18082%27 HTTP/1.1" 200 None
2026-03-30 11:59:53 [auto1.de] INFO: Saving data for PG18082: {'auction_closing_time': 1774884489.0, 'created_time': 1774694240.258648, 'last_price_update_time': 1774871993.111486}
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG18082') HTTP/1.1" 204 0
2026-03-30 11:59:53 [auto1.de] INFO: Found listing with ID: VX47645
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX47645%27 HTTP/1.1" 200 None
2026-03-30 11:59:53 [auto1.de] INFO: Scrape type for VX47645: 2
2026-03-30 11:59:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1 with identifier: VX47645
2026-03-30 11:59:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1 with scrape type 2
2026-03-30 11:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1 with scrape type 2
2026-03-30 11:59:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1, identifier: VX47645
2026-03-30 11:59:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1 with identifier: VX47645
2026-03-30 11:59:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1 with identifier: VX47645
2026-03-30 11:59:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1 with identifier: VX47645 to the API
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:43:20Z',
 'fuel_type': 'diesel',
 'id': '50b043e3-eff0-5c44-9e2d-b8220ee2e8a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX47645',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 238616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-31',
 'seller_name': None,
 'title': 'BMW 3er 335d GT xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2016}
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX47645%27 HTTP/1.1" 200 None
2026-03-30 11:59:53 [auto1.de] INFO: Saving data for VX47645: {'auction_closing_time': 1774885400.0, 'created_time': 1773427825.237389, 'last_price_update_time': 1774871993.629963}
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX47645') HTTP/1.1" 204 0
2026-03-30 11:59:53 [auto1.de] INFO: Found listing with ID: UJ37250
2026-03-30 11:59:53 [auto1.de] INFO: Found listing with ID: BF02767
2026-03-30 11:59:53 [auto1.de] INFO: Found listing with ID: HX00661
2026-03-30 11:59:53 [auto1.de] INFO: Found listing with ID: BV18863
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV18863%27 HTTP/1.1" 200 None
2026-03-30 11:59:53 [auto1.de] INFO: Scrape type for BV18863: 2
2026-03-30 11:59:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d09f1125-44f3-53de-baeb-61e66018ac27 with identifier: BV18863
2026-03-30 11:59:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d09f1125-44f3-53de-baeb-61e66018ac27 with scrape type 2
2026-03-30 11:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d09f1125-44f3-53de-baeb-61e66018ac27 with scrape type 2
2026-03-30 11:59:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d09f1125-44f3-53de-baeb-61e66018ac27, identifier: BV18863
2026-03-30 11:59:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d09f1125-44f3-53de-baeb-61e66018ac27 with identifier: BV18863
2026-03-30 11:59:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d09f1125-44f3-53de-baeb-61e66018ac27 with identifier: BV18863
2026-03-30 11:59:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d09f1125-44f3-53de-baeb-61e66018ac27 with identifier: BV18863 to the API
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:03:39Z',
 'fuel_type': 'diesel',
 'id': 'd09f1125-44f3-53de-baeb-61e66018ac27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV18863',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 248236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-02',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2012}
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV18863%27 HTTP/1.1" 200 None
2026-03-30 11:59:54 [auto1.de] INFO: Saving data for BV18863: {'auction_closing_time': 1774883019.0, 'created_time': 1774032587.235567, 'last_price_update_time': 1774871994.011423}
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV18863') HTTP/1.1" 204 0
2026-03-30 11:59:54 [auto1.de] INFO: Found listing with ID: RC95289
2026-03-30 11:59:54 [auto1.de] INFO: Found listing with ID: HE38410
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE38410%27 HTTP/1.1" 200 None
2026-03-30 11:59:54 [auto1.de] INFO: Scrape type for HE38410: 2
2026-03-30 11:59:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 287198ac-be94-5668-9861-a1b1a2c835af with identifier: HE38410
2026-03-30 11:59:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 287198ac-be94-5668-9861-a1b1a2c835af with scrape type 2
2026-03-30 11:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 287198ac-be94-5668-9861-a1b1a2c835af with scrape type 2
2026-03-30 11:59:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 287198ac-be94-5668-9861-a1b1a2c835af, identifier: HE38410
2026-03-30 11:59:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 287198ac-be94-5668-9861-a1b1a2c835af with identifier: HE38410
2026-03-30 11:59:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 287198ac-be94-5668-9861-a1b1a2c835af with identifier: HE38410
2026-03-30 11:59:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 287198ac-be94-5668-9861-a1b1a2c835af with identifier: HE38410 to the API
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:46:12Z',
 'fuel_type': 'petrol',
 'id': '287198ac-be94-5668-9861-a1b1a2c835af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE38410',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 125595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-15',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2017}
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE38410%27 HTTP/1.1" 200 None
2026-03-30 11:59:54 [auto1.de] INFO: Saving data for HE38410: {'auction_closing_time': 1774885572.0, 'created_time': 1774694187.809622, 'last_price_update_time': 1774871994.40338}
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE38410') HTTP/1.1" 204 0
2026-03-30 11:59:54 [auto1.de] INFO: Found listing with ID: GE96927
2026-03-30 11:59:54 [auto1.de] INFO: Found listing with ID: XL36309
2026-03-30 11:59:54 [auto1.de] INFO: Found listing with ID: FM75567
2026-03-30 11:59:54 [auto1.de] INFO: Found listing with ID: TU93300
2026-03-30 11:59:54 [auto1.de] INFO: Found listing with ID: SH00876
2026-03-30 11:59:54 [auto1.de] INFO: Found listing with ID: YC00182
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00182%27 HTTP/1.1" 200 None
2026-03-30 11:59:54 [auto1.de] INFO: Scrape type for YC00182: 2
2026-03-30 11:59:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a388c19-a9d9-55c9-9ef8-b907272e4d33 with identifier: YC00182
2026-03-30 11:59:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a388c19-a9d9-55c9-9ef8-b907272e4d33 with scrape type 2
2026-03-30 11:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a388c19-a9d9-55c9-9ef8-b907272e4d33 with scrape type 2
2026-03-30 11:59:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a388c19-a9d9-55c9-9ef8-b907272e4d33, identifier: YC00182
2026-03-30 11:59:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a388c19-a9d9-55c9-9ef8-b907272e4d33 with identifier: YC00182
2026-03-30 11:59:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a388c19-a9d9-55c9-9ef8-b907272e4d33 with identifier: YC00182
2026-03-30 11:59:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a388c19-a9d9-55c9-9ef8-b907272e4d33 with identifier: YC00182 to the API
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 625,
 'expiration_date': '2026-03-30T15:25:06Z',
 'fuel_type': 'petrol',
 'id': '9a388c19-a9d9-55c9-9ef8-b907272e4d33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC00182',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 137023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-19',
 'seller_name': None,
 'title': 'BMW X5 M Competition',
 'transmission': 'automatic',
 'trim': 'BW   Competition',
 'year': 2020}
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00182%27 HTTP/1.1" 200 None
2026-03-30 11:59:54 [auto1.de] INFO: Saving data for YC00182: {'auction_closing_time': 1774884306.0, 'created_time': 1773898433.80827, 'last_price_update_time': 1774871994.786905}
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC00182') HTTP/1.1" 204 0
2026-03-30 11:59:54 [auto1.de] INFO: Found listing with ID: AG44580
2026-03-30 11:59:54 [auto1.de] INFO: Found listing with ID: KZ11771
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ11771%27 HTTP/1.1" 200 None
2026-03-30 11:59:54 [auto1.de] INFO: Scrape type for KZ11771: 2
2026-03-30 11:59:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 072680d4-0d47-5699-a1bb-d933ac3faae4 with identifier: KZ11771
2026-03-30 11:59:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 072680d4-0d47-5699-a1bb-d933ac3faae4 with scrape type 2
2026-03-30 11:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 072680d4-0d47-5699-a1bb-d933ac3faae4 with scrape type 2
2026-03-30 11:59:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 072680d4-0d47-5699-a1bb-d933ac3faae4, identifier: KZ11771
2026-03-30 11:59:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 072680d4-0d47-5699-a1bb-d933ac3faae4 with identifier: KZ11771
2026-03-30 11:59:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 072680d4-0d47-5699-a1bb-d933ac3faae4 with identifier: KZ11771
2026-03-30 11:59:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 072680d4-0d47-5699-a1bb-d933ac3faae4 with identifier: KZ11771 to the API
2026-03-30 11:59:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:40:24Z',
 'fuel_type': 'diesel',
 'id': '072680d4-0d47-5699-a1bb-d933ac3faae4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ11771',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 179346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-09',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CDI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2009}
2026-03-30 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ11771%27 HTTP/1.1" 200 None
2026-03-30 11:59:55 [auto1.de] INFO: Saving data for KZ11771: {'auction_closing_time': 1774885224.0, 'created_time': 1773469103.542024, 'last_price_update_time': 1774871995.278421}
2026-03-30 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ11771') HTTP/1.1" 204 0
2026-03-30 11:59:55 [auto1.de] INFO: Found listing with ID: RP91666
2026-03-30 11:59:55 [auto1.de] INFO: Found listing with ID: YS46144
2026-03-30 11:59:55 [auto1.de] INFO: Found listing with ID: BE92832
2026-03-30 11:59:55 [auto1.de] INFO: Found listing with ID: HJ16589
2026-03-30 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ16589%27 HTTP/1.1" 200 None
2026-03-30 11:59:55 [auto1.de] INFO: Scrape type for HJ16589: 2
2026-03-30 11:59:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d533f264-3c68-52e0-aefb-fee3a98eab18 with identifier: HJ16589
2026-03-30 11:59:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d533f264-3c68-52e0-aefb-fee3a98eab18 with scrape type 2
2026-03-30 11:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d533f264-3c68-52e0-aefb-fee3a98eab18 with scrape type 2
2026-03-30 11:59:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d533f264-3c68-52e0-aefb-fee3a98eab18, identifier: HJ16589
2026-03-30 11:59:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d533f264-3c68-52e0-aefb-fee3a98eab18 with identifier: HJ16589
2026-03-30 11:59:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d533f264-3c68-52e0-aefb-fee3a98eab18 with identifier: HJ16589
2026-03-30 11:59:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d533f264-3c68-52e0-aefb-fee3a98eab18 with identifier: HJ16589 to the API
2026-03-30 11:59:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:08Z',
 'fuel_type': 'petrol',
 'id': 'd533f264-3c68-52e0-aefb-fee3a98eab18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ16589',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 66536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-24',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.4 TSI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-30 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ16589%27 HTTP/1.1" 200 None
2026-03-30 11:59:55 [auto1.de] INFO: Saving data for HJ16589: {'auction_closing_time': 1774885688.0, 'created_time': 1774118537.586079, 'last_price_update_time': 1774871995.645157}
2026-03-30 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ16589') HTTP/1.1" 204 0
2026-03-30 11:59:55 [auto1.de] INFO: Found listing with ID: TN63274
2026-03-30 11:59:55 [auto1.de] INFO: Found listing with ID: BJ75751
2026-03-30 11:59:55 [auto1.de] INFO: Found listing with ID: ZT80456
2026-03-30 11:59:55 [auto1.de] INFO: Found listing with ID: VY67413
2026-03-30 11:59:55 [auto1.de] INFO: Found listing with ID: HB69209
2026-03-30 11:59:55 [auto1.de] INFO: Found listing with ID: KM53361
2026-03-30 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM53361%27 HTTP/1.1" 200 None
2026-03-30 11:59:55 [auto1.de] INFO: Scrape type for KM53361: 2
2026-03-30 11:59:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125 with identifier: KM53361
2026-03-30 11:59:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125 with scrape type 2
2026-03-30 11:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125 with scrape type 2
2026-03-30 11:59:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125, identifier: KM53361
2026-03-30 11:59:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125 with identifier: KM53361
2026-03-30 11:59:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125 with identifier: KM53361
2026-03-30 11:59:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125 with identifier: KM53361 to the API
2026-03-30 11:59:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:50:10Z',
 'fuel_type': 'petrol',
 'id': '66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM53361',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 108563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-18',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2015}
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM53361%27 HTTP/1.1" 200 None
2026-03-30 11:59:56 [auto1.de] INFO: Saving data for KM53361: {'auction_closing_time': 1774885810.0, 'created_time': 1774032813.279066, 'last_price_update_time': 1774871996.072701}
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM53361') HTTP/1.1" 204 0
2026-03-30 11:59:56 [auto1.de] INFO: Found listing with ID: GF17035
2026-03-30 11:59:56 [auto1.de] INFO: Found listing with ID: ZV63958
2026-03-30 11:59:56 [auto1.de] INFO: Found listing with ID: VG24913
2026-03-30 11:59:56 [auto1.de] INFO: Found listing with ID: XE04045
2026-03-30 11:59:56 [auto1.de] INFO: Found listing with ID: PU74458
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU74458%27 HTTP/1.1" 200 None
2026-03-30 11:59:56 [auto1.de] INFO: Scrape type for PU74458: 2
2026-03-30 11:59:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20c7fc49-a7c0-518c-984b-ffb89675dd3b with identifier: PU74458
2026-03-30 11:59:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20c7fc49-a7c0-518c-984b-ffb89675dd3b with scrape type 2
2026-03-30 11:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20c7fc49-a7c0-518c-984b-ffb89675dd3b with scrape type 2
2026-03-30 11:59:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20c7fc49-a7c0-518c-984b-ffb89675dd3b, identifier: PU74458
2026-03-30 11:59:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20c7fc49-a7c0-518c-984b-ffb89675dd3b with identifier: PU74458
2026-03-30 11:59:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20c7fc49-a7c0-518c-984b-ffb89675dd3b with identifier: PU74458
2026-03-30 11:59:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20c7fc49-a7c0-518c-984b-ffb89675dd3b with identifier: PU74458 to the API
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 152,
 'expiration_date': '2026-03-30T15:38:44Z',
 'fuel_type': 'diesel',
 'id': '20c7fc49-a7c0-518c-984b-ffb89675dd3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU74458',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 163279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-20',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Mild-Hybrid Trend 2WD',
 'transmission': 'automatic',
 'trim': 'Trend 2WD',
 'year': 2020}
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU74458%27 HTTP/1.1" 200 None
2026-03-30 11:59:56 [auto1.de] INFO: Saving data for PU74458: {'auction_closing_time': 1774885124.0, 'created_time': 1773467233.425054, 'last_price_update_time': 1774871996.552716}
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU74458') HTTP/1.1" 204 0
2026-03-30 11:59:56 [auto1.de] INFO: Found listing with ID: UV81203
2026-03-30 11:59:56 [auto1.de] INFO: Found listing with ID: NK23311
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK23311%27 HTTP/1.1" 200 None
2026-03-30 11:59:56 [auto1.de] INFO: Scrape type for NK23311: 2
2026-03-30 11:59:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0e70dff-d9ca-5752-a0ca-21a4efbb68ec with identifier: NK23311
2026-03-30 11:59:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0e70dff-d9ca-5752-a0ca-21a4efbb68ec with scrape type 2
2026-03-30 11:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0e70dff-d9ca-5752-a0ca-21a4efbb68ec with scrape type 2
2026-03-30 11:59:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0e70dff-d9ca-5752-a0ca-21a4efbb68ec, identifier: NK23311
2026-03-30 11:59:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0e70dff-d9ca-5752-a0ca-21a4efbb68ec with identifier: NK23311
2026-03-30 11:59:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0e70dff-d9ca-5752-a0ca-21a4efbb68ec with identifier: NK23311
2026-03-30 11:59:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0e70dff-d9ca-5752-a0ca-21a4efbb68ec with identifier: NK23311 to the API
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:22:35Z',
 'fuel_type': 'diesel',
 'id': 'f0e70dff-d9ca-5752-a0ca-21a4efbb68ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK23311',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 209235,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-31',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK23311%27 HTTP/1.1" 200 None
2026-03-30 11:59:56 [auto1.de] INFO: Saving data for NK23311: {'auction_closing_time': 1774884155.0, 'created_time': 1773340532.785804, 'last_price_update_time': 1774871996.975625}
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK23311') HTTP/1.1" 204 0
2026-03-30 11:59:56 [auto1.de] INFO: Found listing with ID: HP69948
2026-03-30 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP69948%27 HTTP/1.1" 200 None
2026-03-30 11:59:57 [auto1.de] INFO: Scrape type for HP69948: 2
2026-03-30 11:59:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1d31c80-ff22-5695-b17a-80dea157cc43 with identifier: HP69948
2026-03-30 11:59:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1d31c80-ff22-5695-b17a-80dea157cc43 with scrape type 2
2026-03-30 11:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1d31c80-ff22-5695-b17a-80dea157cc43 with scrape type 2
2026-03-30 11:59:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1d31c80-ff22-5695-b17a-80dea157cc43, identifier: HP69948
2026-03-30 11:59:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1d31c80-ff22-5695-b17a-80dea157cc43 with identifier: HP69948
2026-03-30 11:59:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1d31c80-ff22-5695-b17a-80dea157cc43 with identifier: HP69948
2026-03-30 11:59:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1d31c80-ff22-5695-b17a-80dea157cc43 with identifier: HP69948 to the API
2026-03-30 11:59:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:55:22Z',
 'fuel_type': 'petrol',
 'id': 'b1d31c80-ff22-5695-b17a-80dea157cc43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP69948',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 152439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-30',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP69948%27 HTTP/1.1" 200 None
2026-03-30 11:59:57 [auto1.de] INFO: Saving data for HP69948: {'auction_closing_time': 1774886122.0, 'created_time': 1774550009.091038, 'last_price_update_time': 1774871997.38679}
2026-03-30 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP69948') HTTP/1.1" 204 0
2026-03-30 11:59:57 [auto1.de] INFO: Found listing with ID: FK48222
2026-03-30 11:59:57 [auto1.de] INFO: Found listing with ID: KE90826
2026-03-30 11:59:57 [auto1.de] INFO: Found listing with ID: MN93715
2026-03-30 12:00:04 [scrapy.extensions.logstats] INFO: Crawled 996 pages (at 6 pages/min), scraped 1538 items (at 98 items/min)
2026-03-30 12:00:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-30 12:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:04 [auto1.de] INFO: Channel: 24h | Page: 249 | totalHits: 10022 | hits on page: 40
2026-03-30 12:00:04 [auto1.de] INFO: Found listing with ID: BS68769
2026-03-30 12:00:04 [auto1.de] INFO: Found listing with ID: LJ34502
2026-03-30 12:00:04 [auto1.de] INFO: Found listing with ID: NE48651
2026-03-30 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE48651%27 HTTP/1.1" 200 None
2026-03-30 12:00:04 [auto1.de] INFO: Scrape type for NE48651: 2
2026-03-30 12:00:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eb8350f-f58c-5550-9d2f-01aafce80dcc with identifier: NE48651
2026-03-30 12:00:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eb8350f-f58c-5550-9d2f-01aafce80dcc with scrape type 2
2026-03-30 12:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0eb8350f-f58c-5550-9d2f-01aafce80dcc with scrape type 2
2026-03-30 12:00:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0eb8350f-f58c-5550-9d2f-01aafce80dcc, identifier: NE48651
2026-03-30 12:00:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0eb8350f-f58c-5550-9d2f-01aafce80dcc with identifier: NE48651
2026-03-30 12:00:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0eb8350f-f58c-5550-9d2f-01aafce80dcc with identifier: NE48651
2026-03-30 12:00:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0eb8350f-f58c-5550-9d2f-01aafce80dcc with identifier: NE48651 to the API
2026-03-30 12:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:05:40Z',
 'fuel_type': 'diesel',
 'id': '0eb8350f-f58c-5550-9d2f-01aafce80dcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE48651',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 169912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-06',
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2011}
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE48651%27 HTTP/1.1" 200 None
2026-03-30 12:00:05 [auto1.de] INFO: Saving data for NE48651: {'auction_closing_time': 1774883140.0, 'created_time': 1774694196.858969, 'last_price_update_time': 1774872005.471407}
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE48651') HTTP/1.1" 204 0
2026-03-30 12:00:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:05 [auto1.de] INFO: Found listing with ID: TJ68834
2026-03-30 12:00:05 [auto1.de] INFO: Found listing with ID: BA78869
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA78869%27 HTTP/1.1" 200 None
2026-03-30 12:00:05 [auto1.de] INFO: Scrape type for BA78869: 2
2026-03-30 12:00:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95d50ff8-0666-5550-b36e-7b62fea35fd5 with identifier: BA78869
2026-03-30 12:00:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95d50ff8-0666-5550-b36e-7b62fea35fd5 with scrape type 2
2026-03-30 12:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95d50ff8-0666-5550-b36e-7b62fea35fd5 with scrape type 2
2026-03-30 12:00:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95d50ff8-0666-5550-b36e-7b62fea35fd5, identifier: BA78869
2026-03-30 12:00:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95d50ff8-0666-5550-b36e-7b62fea35fd5 with identifier: BA78869
2026-03-30 12:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95d50ff8-0666-5550-b36e-7b62fea35fd5 with identifier: BA78869
2026-03-30 12:00:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95d50ff8-0666-5550-b36e-7b62fea35fd5 with identifier: BA78869 to the API
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:11:41Z',
 'fuel_type': 'diesel',
 'id': '95d50ff8-0666-5550-b36e-7b62fea35fd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA78869',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 360764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-19',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2007}
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA78869%27 HTTP/1.1" 200 None
2026-03-30 12:00:06 [auto1.de] INFO: Saving data for BA78869: {'auction_closing_time': 1774883501.0, 'created_time': 1774694215.54303, 'last_price_update_time': 1774872006.519064}
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA78869') HTTP/1.1" 204 0
2026-03-30 12:00:06 [auto1.de] INFO: Found listing with ID: NG50641
2026-03-30 12:00:06 [auto1.de] INFO: Found listing with ID: DJ78015
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ78015%27 HTTP/1.1" 200 None
2026-03-30 12:00:06 [auto1.de] INFO: Scrape type for DJ78015: 2
2026-03-30 12:00:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a6d22b5-1389-50e5-abed-e854a99960df with identifier: DJ78015
2026-03-30 12:00:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a6d22b5-1389-50e5-abed-e854a99960df with scrape type 2
2026-03-30 12:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a6d22b5-1389-50e5-abed-e854a99960df with scrape type 2
2026-03-30 12:00:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a6d22b5-1389-50e5-abed-e854a99960df, identifier: DJ78015
2026-03-30 12:00:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a6d22b5-1389-50e5-abed-e854a99960df with identifier: DJ78015
2026-03-30 12:00:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a6d22b5-1389-50e5-abed-e854a99960df with identifier: DJ78015
2026-03-30 12:00:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a6d22b5-1389-50e5-abed-e854a99960df with identifier: DJ78015 to the API
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-30T15:02:17Z',
 'fuel_type': 'petrol',
 'id': '8a6d22b5-1389-50e5-abed-e854a99960df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ78015',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 9299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-28',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2020}
2026-03-30 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ78015%27 HTTP/1.1" 200 None
2026-03-30 12:00:07 [auto1.de] INFO: Saving data for DJ78015: {'auction_closing_time': 1774882937.0, 'created_time': 1774694199.829345, 'last_price_update_time': 1774872007.909987}
2026-03-30 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ78015') HTTP/1.1" 204 0
2026-03-30 12:00:07 [auto1.de] INFO: Found listing with ID: SM71650
2026-03-30 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM71650%27 HTTP/1.1" 200 None
2026-03-30 12:00:07 [auto1.de] INFO: Scrape type for SM71650: 2
2026-03-30 12:00:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2bb0b73-1335-5937-87cb-e159b6fc6b70 with identifier: SM71650
2026-03-30 12:00:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2bb0b73-1335-5937-87cb-e159b6fc6b70 with scrape type 2
2026-03-30 12:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2bb0b73-1335-5937-87cb-e159b6fc6b70 with scrape type 2
2026-03-30 12:00:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2bb0b73-1335-5937-87cb-e159b6fc6b70, identifier: SM71650
2026-03-30 12:00:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2bb0b73-1335-5937-87cb-e159b6fc6b70 with identifier: SM71650
2026-03-30 12:00:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2bb0b73-1335-5937-87cb-e159b6fc6b70 with identifier: SM71650
2026-03-30 12:00:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2bb0b73-1335-5937-87cb-e159b6fc6b70 with identifier: SM71650 to the API
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:09:53Z',
 'fuel_type': 'petrol',
 'id': 'c2bb0b73-1335-5937-87cb-e159b6fc6b70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM71650',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 99464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-27',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM71650%27 HTTP/1.1" 200 None
2026-03-30 12:00:08 [auto1.de] INFO: Saving data for SM71650: {'auction_closing_time': 1774883393.0, 'created_time': 1773467238.566988, 'last_price_update_time': 1774872008.933558}
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM71650') HTTP/1.1" 204 0
2026-03-30 12:00:08 [auto1.de] INFO: Found listing with ID: BA31995
2026-03-30 12:00:08 [auto1.de] INFO: Found listing with ID: ZU52934
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU52934%27 HTTP/1.1" 200 None
2026-03-30 12:00:08 [auto1.de] INFO: Scrape type for ZU52934: 2
2026-03-30 12:00:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5eb92e6-1352-56b0-91aa-325a6ea0f107 with identifier: ZU52934
2026-03-30 12:00:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5eb92e6-1352-56b0-91aa-325a6ea0f107 with scrape type 2
2026-03-30 12:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5eb92e6-1352-56b0-91aa-325a6ea0f107 with scrape type 2
2026-03-30 12:00:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5eb92e6-1352-56b0-91aa-325a6ea0f107, identifier: ZU52934
2026-03-30 12:00:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5eb92e6-1352-56b0-91aa-325a6ea0f107 with identifier: ZU52934
2026-03-30 12:00:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5eb92e6-1352-56b0-91aa-325a6ea0f107 with identifier: ZU52934
2026-03-30 12:00:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5eb92e6-1352-56b0-91aa-325a6ea0f107 with identifier: ZU52934 to the API
2026-03-30 12:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:09:35Z',
 'fuel_type': 'diesel',
 'id': 'c5eb92e6-1352-56b0-91aa-325a6ea0f107',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU52934',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 293441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-30',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2013}
2026-03-30 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU52934%27 HTTP/1.1" 200 None
2026-03-30 12:00:10 [auto1.de] INFO: Saving data for ZU52934: {'auction_closing_time': 1774883375.0, 'created_time': 1773427027.386419, 'last_price_update_time': 1774872010.163165}
2026-03-30 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU52934') HTTP/1.1" 204 0
2026-03-30 12:00:10 [auto1.de] INFO: Found listing with ID: PW89679
2026-03-30 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW89679%27 HTTP/1.1" 200 None
2026-03-30 12:00:10 [auto1.de] INFO: Scrape type for PW89679: 2
2026-03-30 12:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31 with identifier: PW89679
2026-03-30 12:00:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31 with scrape type 2
2026-03-30 12:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31 with scrape type 2
2026-03-30 12:00:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31, identifier: PW89679
2026-03-30 12:00:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31 with identifier: PW89679
2026-03-30 12:00:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31 with identifier: PW89679
2026-03-30 12:00:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31 with identifier: PW89679 to the API
2026-03-30 12:00:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:30:10Z',
 'fuel_type': 'petrol',
 'id': '29da9e3e-0669-5962-8ac1-a3bfcfb4cb31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW89679',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 160628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-09',
 'seller_name': None,
 'title': 'Hyundai i20 1.0 TGDI YES! Plus',
 'transmission': 'manual',
 'trim': 'YES! Plus',
 'year': 2017}
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW89679%27 HTTP/1.1" 200 None
2026-03-30 12:00:11 [auto1.de] INFO: Saving data for PW89679: {'auction_closing_time': 1774884610.0, 'created_time': 1774349711.149055, 'last_price_update_time': 1774872011.692925}
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW89679') HTTP/1.1" 204 0
2026-03-30 12:00:11 [auto1.de] INFO: Found listing with ID: GD61279
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61279%27 HTTP/1.1" 200 None
2026-03-30 12:00:11 [auto1.de] INFO: Scrape type for GD61279: 2
2026-03-30 12:00:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 869db8af-68c6-5fea-be14-893facef5e63 with identifier: GD61279
2026-03-30 12:00:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 869db8af-68c6-5fea-be14-893facef5e63 with scrape type 2
2026-03-30 12:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 869db8af-68c6-5fea-be14-893facef5e63 with scrape type 2
2026-03-30 12:00:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 869db8af-68c6-5fea-be14-893facef5e63, identifier: GD61279
2026-03-30 12:00:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 869db8af-68c6-5fea-be14-893facef5e63 with identifier: GD61279
2026-03-30 12:00:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 869db8af-68c6-5fea-be14-893facef5e63 with identifier: GD61279
2026-03-30 12:00:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 869db8af-68c6-5fea-be14-893facef5e63 with identifier: GD61279 to the API
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:59:01Z',
 'fuel_type': 'petrol',
 'id': '869db8af-68c6-5fea-be14-893facef5e63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD61279',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 25398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-13',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61279%27 HTTP/1.1" 200 None
2026-03-30 12:00:12 [auto1.de] INFO: Saving data for GD61279: {'auction_closing_time': 1774886341.0, 'created_time': 1774032379.306741, 'last_price_update_time': 1774872012.926888}
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD61279') HTTP/1.1" 204 0
2026-03-30 12:00:12 [auto1.de] INFO: Found listing with ID: PF87793
2026-03-30 12:00:12 [auto1.de] INFO: Found listing with ID: KU32415
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU32415%27 HTTP/1.1" 200 None
2026-03-30 12:00:12 [auto1.de] INFO: Scrape type for KU32415: 2
2026-03-30 12:00:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03b29617-0326-54fd-be2c-fbb04bea1850 with identifier: KU32415
2026-03-30 12:00:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03b29617-0326-54fd-be2c-fbb04bea1850 with scrape type 2
2026-03-30 12:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03b29617-0326-54fd-be2c-fbb04bea1850 with scrape type 2
2026-03-30 12:00:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03b29617-0326-54fd-be2c-fbb04bea1850, identifier: KU32415
2026-03-30 12:00:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03b29617-0326-54fd-be2c-fbb04bea1850 with identifier: KU32415
2026-03-30 12:00:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03b29617-0326-54fd-be2c-fbb04bea1850 with identifier: KU32415
2026-03-30 12:00:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03b29617-0326-54fd-be2c-fbb04bea1850 with identifier: KU32415 to the API
2026-03-30 12:00:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:11:01Z',
 'fuel_type': 'diesel',
 'id': '03b29617-0326-54fd-be2c-fbb04bea1850',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU32415',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 5',
 'odometer': 150093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-30',
 'seller_name': None,
 'title': 'Land Rover Discovery 5 3.0 Td6 HSE LUXURY',
 'transmission': 'automatic',
 'trim': 'HSE LUXURY',
 'year': 2018}
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU32415%27 HTTP/1.1" 200 None
2026-03-30 12:00:14 [auto1.de] INFO: Saving data for KU32415: {'auction_closing_time': 1774883461.0, 'created_time': 1774032362.913793, 'last_price_update_time': 1774872014.348763}
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU32415') HTTP/1.1" 204 0
2026-03-30 12:00:14 [auto1.de] INFO: Found listing with ID: RR24690
2026-03-30 12:00:14 [auto1.de] INFO: Found listing with ID: NG84191
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG84191%27 HTTP/1.1" 200 None
2026-03-30 12:00:14 [auto1.de] INFO: Scrape type for NG84191: 2
2026-03-30 12:00:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82a698c1-2f25-5677-a8ae-3ea1784e3a0a with identifier: NG84191
2026-03-30 12:00:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a698c1-2f25-5677-a8ae-3ea1784e3a0a with scrape type 2
2026-03-30 12:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82a698c1-2f25-5677-a8ae-3ea1784e3a0a with scrape type 2
2026-03-30 12:00:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82a698c1-2f25-5677-a8ae-3ea1784e3a0a, identifier: NG84191
2026-03-30 12:00:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82a698c1-2f25-5677-a8ae-3ea1784e3a0a with identifier: NG84191
2026-03-30 12:00:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82a698c1-2f25-5677-a8ae-3ea1784e3a0a with identifier: NG84191
2026-03-30 12:00:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82a698c1-2f25-5677-a8ae-3ea1784e3a0a with identifier: NG84191 to the API
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-30T15:50:19Z',
 'fuel_type': 'diesel',
 'id': '82a698c1-2f25-5677-a8ae-3ea1784e3a0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG84191',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'XV',
 'odometer': 159110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-21',
 'seller_name': None,
 'title': 'Subaru XV 2.0 Diesel Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2016}
2026-03-30 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG84191%27 HTTP/1.1" 200 None
2026-03-30 12:00:15 [auto1.de] INFO: Saving data for NG84191: {'auction_closing_time': 1774885819.0, 'created_time': 1774694207.684197, 'last_price_update_time': 1774872015.462957}
2026-03-30 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG84191') HTTP/1.1" 204 0
2026-03-30 12:00:15 [auto1.de] INFO: Found listing with ID: UX99567
2026-03-30 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX99567%27 HTTP/1.1" 200 None
2026-03-30 12:00:15 [auto1.de] INFO: Scrape type for UX99567: 2
2026-03-30 12:00:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43a2a255-386b-5a9d-819e-981db8359b0b with identifier: UX99567
2026-03-30 12:00:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a2a255-386b-5a9d-819e-981db8359b0b with scrape type 2
2026-03-30 12:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43a2a255-386b-5a9d-819e-981db8359b0b with scrape type 2
2026-03-30 12:00:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43a2a255-386b-5a9d-819e-981db8359b0b, identifier: UX99567
2026-03-30 12:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43a2a255-386b-5a9d-819e-981db8359b0b with identifier: UX99567
2026-03-30 12:00:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43a2a255-386b-5a9d-819e-981db8359b0b with identifier: UX99567
2026-03-30 12:00:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43a2a255-386b-5a9d-819e-981db8359b0b with identifier: UX99567 to the API
2026-03-30 12:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:25:15Z',
 'fuel_type': 'petrol',
 'id': '43a2a255-386b-5a9d-819e-981db8359b0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX99567',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 164698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-04',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-30 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX99567%27 HTTP/1.1" 200 None
2026-03-30 12:00:17 [auto1.de] INFO: Saving data for UX99567: {'auction_closing_time': 1774884315.0, 'created_time': 1774349179.552114, 'last_price_update_time': 1774872017.618957}
2026-03-30 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX99567') HTTP/1.1" 204 0
2026-03-30 12:00:17 [auto1.de] INFO: Found listing with ID: XD36777
2026-03-30 12:00:17 [auto1.de] INFO: Found listing with ID: PC48603
2026-03-30 12:00:17 [auto1.de] INFO: Found listing with ID: SR86923
2026-03-30 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR86923%27 HTTP/1.1" 200 None
2026-03-30 12:00:17 [auto1.de] INFO: Scrape type for SR86923: 2
2026-03-30 12:00:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 067b3bf7-9c0e-549b-8d66-28ef27264a53 with identifier: SR86923
2026-03-30 12:00:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 067b3bf7-9c0e-549b-8d66-28ef27264a53 with scrape type 2
2026-03-30 12:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 067b3bf7-9c0e-549b-8d66-28ef27264a53 with scrape type 2
2026-03-30 12:00:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 067b3bf7-9c0e-549b-8d66-28ef27264a53, identifier: SR86923
2026-03-30 12:00:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 067b3bf7-9c0e-549b-8d66-28ef27264a53 with identifier: SR86923
2026-03-30 12:00:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 067b3bf7-9c0e-549b-8d66-28ef27264a53 with identifier: SR86923
2026-03-30 12:00:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 067b3bf7-9c0e-549b-8d66-28ef27264a53 with identifier: SR86923 to the API
2026-03-30 12:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:22:40Z',
 'fuel_type': 'petrol',
 'id': '067b3bf7-9c0e-549b-8d66-28ef27264a53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR86923',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 132944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-22',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2018}
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR86923%27 HTTP/1.1" 200 None
2026-03-30 12:00:20 [auto1.de] INFO: Saving data for SR86923: {'auction_closing_time': 1774884160.0, 'created_time': 1773426846.074432, 'last_price_update_time': 1774872020.659819}
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR86923') HTTP/1.1" 204 0
2026-03-30 12:00:20 [auto1.de] INFO: Found listing with ID: GJ17699
2026-03-30 12:00:20 [auto1.de] INFO: Found listing with ID: ZX68256
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX68256%27 HTTP/1.1" 200 None
2026-03-30 12:00:20 [auto1.de] INFO: Scrape type for ZX68256: 2
2026-03-30 12:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 148a4ffc-eed3-5dea-ac00-3894180a0b24 with identifier: ZX68256
2026-03-30 12:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 148a4ffc-eed3-5dea-ac00-3894180a0b24 with scrape type 2
2026-03-30 12:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 148a4ffc-eed3-5dea-ac00-3894180a0b24 with scrape type 2
2026-03-30 12:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 148a4ffc-eed3-5dea-ac00-3894180a0b24, identifier: ZX68256
2026-03-30 12:00:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 148a4ffc-eed3-5dea-ac00-3894180a0b24 with identifier: ZX68256
2026-03-30 12:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 148a4ffc-eed3-5dea-ac00-3894180a0b24 with identifier: ZX68256
2026-03-30 12:00:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 148a4ffc-eed3-5dea-ac00-3894180a0b24 with identifier: ZX68256 to the API
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:23:45Z',
 'fuel_type': 'diesel',
 'id': '148a4ffc-eed3-5dea-ac00-3894180a0b24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX68256',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 237615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-25',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CDI 4Matic BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': '4Matic BlueTEC Avantgarde',
 'year': 2015}
2026-03-30 12:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX68256%27 HTTP/1.1" 200 None
2026-03-30 12:00:22 [auto1.de] INFO: Saving data for ZX68256: {'auction_closing_time': 1774884225.0, 'created_time': 1774089046.74303, 'last_price_update_time': 1774872022.499168}
2026-03-30 12:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX68256') HTTP/1.1" 204 0
2026-03-30 12:00:22 [auto1.de] INFO: Channel: 24h | Page: 250 | totalHits: 10022 | hits on page: 40
2026-03-30 12:00:22 [auto1.de] INFO: Found listing with ID: HF47476
2026-03-30 12:00:22 [auto1.de] INFO: Found listing with ID: CZ39134
2026-03-30 12:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ39134%27 HTTP/1.1" 200 None
2026-03-30 12:00:22 [auto1.de] INFO: Scrape type for CZ39134: 2
2026-03-30 12:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 528b345b-aec1-5f55-a634-2d0632c91f25 with identifier: CZ39134
2026-03-30 12:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 528b345b-aec1-5f55-a634-2d0632c91f25 with scrape type 2
2026-03-30 12:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 528b345b-aec1-5f55-a634-2d0632c91f25 with scrape type 2
2026-03-30 12:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 528b345b-aec1-5f55-a634-2d0632c91f25, identifier: CZ39134
2026-03-30 12:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 528b345b-aec1-5f55-a634-2d0632c91f25 with identifier: CZ39134
2026-03-30 12:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 528b345b-aec1-5f55-a634-2d0632c91f25 with identifier: CZ39134
2026-03-30 12:00:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 528b345b-aec1-5f55-a634-2d0632c91f25 with identifier: CZ39134 to the API
2026-03-30 12:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:26:39Z',
 'fuel_type': 'diesel',
 'id': '528b345b-aec1-5f55-a634-2d0632c91f25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ39134',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 87938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-25',
 'seller_name': None,
 'title': 'Peugeot 508 1.6 HDi Business Pack',
 'transmission': 'automatic',
 'trim': 'Business Pack',
 'year': 2012}
2026-03-30 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ39134%27 HTTP/1.1" 200 None
2026-03-30 12:00:24 [auto1.de] INFO: Saving data for CZ39134: {'auction_closing_time': 1774884399.0, 'created_time': 1774350166.249739, 'last_price_update_time': 1774872024.806404}
2026-03-30 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ39134') HTTP/1.1" 204 0
2026-03-30 12:00:24 [auto1.de] INFO: Found listing with ID: EH57829
2026-03-30 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH57829%27 HTTP/1.1" 200 None
2026-03-30 12:00:24 [auto1.de] INFO: Scrape type for EH57829: 2
2026-03-30 12:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97710850-f158-5fa6-af3c-4dad60e26c07 with identifier: EH57829
2026-03-30 12:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97710850-f158-5fa6-af3c-4dad60e26c07 with scrape type 2
2026-03-30 12:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97710850-f158-5fa6-af3c-4dad60e26c07 with scrape type 2
2026-03-30 12:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97710850-f158-5fa6-af3c-4dad60e26c07, identifier: EH57829
2026-03-30 12:00:25 [auto1.de] INFO: Found listing with ID: EU15499
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU15499%27 HTTP/1.1" 200 None
2026-03-30 12:00:25 [auto1.de] INFO: Scrape type for EU15499: 2
2026-03-30 12:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4eb7213-36c4-5868-9c40-af4bbaaa996c with identifier: EU15499
2026-03-30 12:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4eb7213-36c4-5868-9c40-af4bbaaa996c with scrape type 2
2026-03-30 12:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4eb7213-36c4-5868-9c40-af4bbaaa996c with scrape type 2
2026-03-30 12:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4eb7213-36c4-5868-9c40-af4bbaaa996c, identifier: EU15499
2026-03-30 12:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97710850-f158-5fa6-af3c-4dad60e26c07 with identifier: EH57829
2026-03-30 12:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97710850-f158-5fa6-af3c-4dad60e26c07 with identifier: EH57829
2026-03-30 12:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97710850-f158-5fa6-af3c-4dad60e26c07 with identifier: EH57829 to the API
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:23:56Z',
 'fuel_type': 'petrol',
 'id': '97710850-f158-5fa6-af3c-4dad60e26c07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH57829',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 20429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-08',
 'seller_name': None,
 'title': 'Hyundai ix20 1.4 25 Aniversario',
 'transmission': 'manual',
 'trim': '25 Aniversario',
 'year': 2016}
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH57829%27 HTTP/1.1" 200 None
2026-03-30 12:00:25 [auto1.de] INFO: Saving data for EH57829: {'auction_closing_time': 1774884236.0, 'created_time': 1774694220.241338, 'last_price_update_time': 1774872025.689006}
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH57829') HTTP/1.1" 204 0
2026-03-30 12:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4eb7213-36c4-5868-9c40-af4bbaaa996c with identifier: EU15499
2026-03-30 12:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4eb7213-36c4-5868-9c40-af4bbaaa996c with identifier: EU15499
2026-03-30 12:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4eb7213-36c4-5868-9c40-af4bbaaa996c with identifier: EU15499 to the API
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 201,
 'expiration_date': '2026-03-30T15:12:58Z',
 'fuel_type': 'diesel',
 'id': 'f4eb7213-36c4-5868-9c40-af4bbaaa996c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU15499',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 108717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-12',
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Platinum 4WD',
 'transmission': 'automatic',
 'trim': 'Platinum 4WD',
 'year': 2021}
2026-03-30 12:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU15499%27 HTTP/1.1" 200 None
2026-03-30 12:00:26 [auto1.de] INFO: Saving data for EU15499: {'auction_closing_time': 1774883578.0, 'created_time': 1774089317.9504, 'last_price_update_time': 1774872026.982983}
2026-03-30 12:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU15499') HTTP/1.1" 204 0
2026-03-30 12:00:27 [auto1.de] INFO: Found listing with ID: GR42785
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR42785%27 HTTP/1.1" 200 None
2026-03-30 12:00:27 [auto1.de] INFO: Scrape type for GR42785: 2
2026-03-30 12:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc646d6b-7c20-506b-9143-884e56f2e2a8 with identifier: GR42785
2026-03-30 12:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc646d6b-7c20-506b-9143-884e56f2e2a8 with scrape type 2
2026-03-30 12:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc646d6b-7c20-506b-9143-884e56f2e2a8 with scrape type 2
2026-03-30 12:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc646d6b-7c20-506b-9143-884e56f2e2a8, identifier: GR42785
2026-03-30 12:00:27 [auto1.de] INFO: Found listing with ID: DC48276
2026-03-30 12:00:27 [auto1.de] INFO: Found listing with ID: HG48100
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG48100%27 HTTP/1.1" 200 None
2026-03-30 12:00:27 [auto1.de] INFO: Scrape type for HG48100: 2
2026-03-30 12:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39868fd1-b93c-58a8-a754-545dcc2c6020 with identifier: HG48100
2026-03-30 12:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39868fd1-b93c-58a8-a754-545dcc2c6020 with scrape type 2
2026-03-30 12:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39868fd1-b93c-58a8-a754-545dcc2c6020 with scrape type 2
2026-03-30 12:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39868fd1-b93c-58a8-a754-545dcc2c6020, identifier: HG48100
2026-03-30 12:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc646d6b-7c20-506b-9143-884e56f2e2a8 with identifier: GR42785
2026-03-30 12:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc646d6b-7c20-506b-9143-884e56f2e2a8 with identifier: GR42785
2026-03-30 12:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc646d6b-7c20-506b-9143-884e56f2e2a8 with identifier: GR42785 to the API
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:28:23Z',
 'fuel_type': 'diesel',
 'id': 'dc646d6b-7c20-506b-9143-884e56f2e2a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR42785',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 150812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-09',
 'seller_name': None,
 'title': 'BMW 5er 520d Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2018}
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR42785%27 HTTP/1.1" 200 None
2026-03-30 12:00:27 [auto1.de] INFO: Saving data for GR42785: {'auction_closing_time': 1774884503.0, 'created_time': 1774032523.269895, 'last_price_update_time': 1774872027.789109}
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR42785') HTTP/1.1" 204 0
2026-03-30 12:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39868fd1-b93c-58a8-a754-545dcc2c6020 with identifier: HG48100
2026-03-30 12:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39868fd1-b93c-58a8-a754-545dcc2c6020 with identifier: HG48100
2026-03-30 12:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39868fd1-b93c-58a8-a754-545dcc2c6020 with identifier: HG48100 to the API
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:40:34Z',
 'fuel_type': 'petrol',
 'id': '39868fd1-b93c-58a8-a754-545dcc2c6020',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG48100',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 106937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-19',
 'seller_name': None,
 'title': 'Dacia Dokker 1.3 TCe Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2020}
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG48100%27 HTTP/1.1" 200 None
2026-03-30 12:00:28 [auto1.de] INFO: Saving data for HG48100: {'auction_closing_time': 1774885234.0, 'created_time': 1774466689.460129, 'last_price_update_time': 1774872028.216569}
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG48100') HTTP/1.1" 204 0
2026-03-30 12:00:28 [auto1.de] INFO: Found listing with ID: FG97894
2026-03-30 12:00:28 [auto1.de] INFO: Found listing with ID: MM73538
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM73538%27 HTTP/1.1" 200 None
2026-03-30 12:00:28 [auto1.de] INFO: Scrape type for MM73538: 2
2026-03-30 12:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0880bdfe-8678-5703-9558-41b3f6241536 with identifier: MM73538
2026-03-30 12:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0880bdfe-8678-5703-9558-41b3f6241536 with scrape type 2
2026-03-30 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0880bdfe-8678-5703-9558-41b3f6241536 with scrape type 2
2026-03-30 12:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0880bdfe-8678-5703-9558-41b3f6241536, identifier: MM73538
2026-03-30 12:00:28 [auto1.de] INFO: Found listing with ID: DS20438
2026-03-30 12:00:28 [auto1.de] INFO: Found listing with ID: CC34542
2026-03-30 12:00:28 [auto1.de] INFO: Found listing with ID: WA68058
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68058%27 HTTP/1.1" 200 None
2026-03-30 12:00:28 [auto1.de] INFO: Scrape type for WA68058: 2
2026-03-30 12:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b16628e5-1d13-5bc3-aefe-ab3aedcaabcb with identifier: WA68058
2026-03-30 12:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b16628e5-1d13-5bc3-aefe-ab3aedcaabcb with scrape type 2
2026-03-30 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b16628e5-1d13-5bc3-aefe-ab3aedcaabcb with scrape type 2
2026-03-30 12:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b16628e5-1d13-5bc3-aefe-ab3aedcaabcb, identifier: WA68058
2026-03-30 12:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0880bdfe-8678-5703-9558-41b3f6241536 with identifier: MM73538
2026-03-30 12:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0880bdfe-8678-5703-9558-41b3f6241536 with identifier: MM73538
2026-03-30 12:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0880bdfe-8678-5703-9558-41b3f6241536 with identifier: MM73538 to the API
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:28:51Z',
 'fuel_type': 'diesel',
 'id': '0880bdfe-8678-5703-9558-41b3f6241536',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM73538',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Kombi',
 'odometer': 272486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-10',
 'seller_name': None,
 'title': 'Volkswagen T5 Kombi 2.0 TDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2011}
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM73538%27 HTTP/1.1" 200 None
2026-03-30 12:00:29 [auto1.de] INFO: Saving data for MM73538: {'auction_closing_time': 1774884531.0, 'created_time': 1774694285.611527, 'last_price_update_time': 1774872029.570168}
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM73538') HTTP/1.1" 204 0
2026-03-30 12:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b16628e5-1d13-5bc3-aefe-ab3aedcaabcb with identifier: WA68058
2026-03-30 12:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b16628e5-1d13-5bc3-aefe-ab3aedcaabcb with identifier: WA68058
2026-03-30 12:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b16628e5-1d13-5bc3-aefe-ab3aedcaabcb with identifier: WA68058 to the API
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:52:25Z',
 'fuel_type': 'petrol',
 'id': 'b16628e5-1d13-5bc3-aefe-ab3aedcaabcb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA68058',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 105623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-21',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI S line Sportpaket',
 'transmission': 'manual',
 'trim': 'S line Sportpaket',
 'year': 2013}
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68058%27 HTTP/1.1" 200 None
2026-03-30 12:00:29 [auto1.de] INFO: Saving data for WA68058: {'auction_closing_time': 1774885945.0, 'created_time': 1774694216.161216, 'last_price_update_time': 1774872029.878639}
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA68058') HTTP/1.1" 204 0
2026-03-30 12:00:29 [auto1.de] INFO: Found listing with ID: PX49171
2026-03-30 12:00:29 [auto1.de] INFO: Found listing with ID: AH24505
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH24505%27 HTTP/1.1" 200 None
2026-03-30 12:00:29 [auto1.de] INFO: Scrape type for AH24505: 2
2026-03-30 12:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8421d342-f1a6-5edf-af7c-ef54e49bedc4 with identifier: AH24505
2026-03-30 12:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8421d342-f1a6-5edf-af7c-ef54e49bedc4 with scrape type 2
2026-03-30 12:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8421d342-f1a6-5edf-af7c-ef54e49bedc4 with scrape type 2
2026-03-30 12:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8421d342-f1a6-5edf-af7c-ef54e49bedc4, identifier: AH24505
2026-03-30 12:00:30 [auto1.de] INFO: Found listing with ID: WC61131
2026-03-30 12:00:30 [auto1.de] INFO: Found listing with ID: RZ05971
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ05971%27 HTTP/1.1" 200 None
2026-03-30 12:00:30 [auto1.de] INFO: Scrape type for RZ05971: 2
2026-03-30 12:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cba536df-8a11-5edd-9674-7308885b4298 with identifier: RZ05971
2026-03-30 12:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cba536df-8a11-5edd-9674-7308885b4298 with scrape type 2
2026-03-30 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cba536df-8a11-5edd-9674-7308885b4298 with scrape type 2
2026-03-30 12:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cba536df-8a11-5edd-9674-7308885b4298, identifier: RZ05971
2026-03-30 12:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8421d342-f1a6-5edf-af7c-ef54e49bedc4 with identifier: AH24505
2026-03-30 12:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8421d342-f1a6-5edf-af7c-ef54e49bedc4 with identifier: AH24505
2026-03-30 12:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8421d342-f1a6-5edf-af7c-ef54e49bedc4 with identifier: AH24505 to the API
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:10:33Z',
 'fuel_type': 'petrol',
 'id': '8421d342-f1a6-5edf-af7c-ef54e49bedc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH24505',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 165755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-25',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Cup',
 'transmission': 'manual',
 'trim': 'Cup',
 'year': 2015}
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH24505%27 HTTP/1.1" 200 None
2026-03-30 12:00:30 [auto1.de] INFO: Saving data for AH24505: {'auction_closing_time': 1774883433.0, 'created_time': 1774002232.691175, 'last_price_update_time': 1774872030.455623}
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH24505') HTTP/1.1" 204 0
2026-03-30 12:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cba536df-8a11-5edd-9674-7308885b4298 with identifier: RZ05971
2026-03-30 12:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cba536df-8a11-5edd-9674-7308885b4298 with identifier: RZ05971
2026-03-30 12:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cba536df-8a11-5edd-9674-7308885b4298 with identifier: RZ05971 to the API
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:57:58Z',
 'fuel_type': 'petrol',
 'id': 'cba536df-8a11-5edd-9674-7308885b4298',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ05971',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 75673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-11',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport 4Motion',
 'year': 2019}
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ05971%27 HTTP/1.1" 200 None
2026-03-30 12:00:30 [auto1.de] INFO: Saving data for RZ05971: {'auction_closing_time': 1774886278.0, 'created_time': 1773466726.012505, 'last_price_update_time': 1774872030.881226}
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ05971') HTTP/1.1" 204 0
2026-03-30 12:00:30 [auto1.de] INFO: Found listing with ID: SU92609
2026-03-30 12:00:30 [auto1.de] INFO: Found listing with ID: RF00811
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF00811%27 HTTP/1.1" 200 None
2026-03-30 12:00:30 [auto1.de] INFO: Scrape type for RF00811: 2
2026-03-30 12:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 155c56ae-f46b-51b9-9e6e-c431a6bce839 with identifier: RF00811
2026-03-30 12:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 155c56ae-f46b-51b9-9e6e-c431a6bce839 with scrape type 2
2026-03-30 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 155c56ae-f46b-51b9-9e6e-c431a6bce839 with scrape type 2
2026-03-30 12:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 155c56ae-f46b-51b9-9e6e-c431a6bce839, identifier: RF00811
2026-03-30 12:00:31 [auto1.de] INFO: Found listing with ID: RU40839
2026-03-30 12:00:31 [auto1.de] INFO: Found listing with ID: VL73605
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL73605%27 HTTP/1.1" 200 None
2026-03-30 12:00:31 [auto1.de] INFO: Scrape type for VL73605: 2
2026-03-30 12:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7456bbbf-6730-5685-a3a1-c8d69613b341 with identifier: VL73605
2026-03-30 12:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7456bbbf-6730-5685-a3a1-c8d69613b341 with scrape type 2
2026-03-30 12:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7456bbbf-6730-5685-a3a1-c8d69613b341 with scrape type 2
2026-03-30 12:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7456bbbf-6730-5685-a3a1-c8d69613b341, identifier: VL73605
2026-03-30 12:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 155c56ae-f46b-51b9-9e6e-c431a6bce839 with identifier: RF00811
2026-03-30 12:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 155c56ae-f46b-51b9-9e6e-c431a6bce839 with identifier: RF00811
2026-03-30 12:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 155c56ae-f46b-51b9-9e6e-c431a6bce839 with identifier: RF00811 to the API
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:04:34Z',
 'fuel_type': 'diesel',
 'id': '155c56ae-f46b-51b9-9e6e-c431a6bce839',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF00811',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 197615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-19',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Bi-Turbo Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2017}
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF00811%27 HTTP/1.1" 200 None
2026-03-30 12:00:32 [auto1.de] INFO: Saving data for RF00811: {'auction_closing_time': 1774883074.0, 'created_time': 1774694219.449667, 'last_price_update_time': 1774872032.306101}
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF00811') HTTP/1.1" 204 0
2026-03-30 12:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7456bbbf-6730-5685-a3a1-c8d69613b341 with identifier: VL73605
2026-03-30 12:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7456bbbf-6730-5685-a3a1-c8d69613b341 with identifier: VL73605
2026-03-30 12:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7456bbbf-6730-5685-a3a1-c8d69613b341 with identifier: VL73605 to the API
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:03:43Z',
 'fuel_type': 'diesel',
 'id': '7456bbbf-6730-5685-a3a1-c8d69613b341',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL73605',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 211789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-31',
 'seller_name': None,
 'title': 'Audi A5 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL73605%27 HTTP/1.1" 200 None
2026-03-30 12:00:32 [auto1.de] INFO: Saving data for VL73605: {'auction_closing_time': 1774883023.0, 'created_time': 1773340516.652333, 'last_price_update_time': 1774872032.615793}
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL73605') HTTP/1.1" 204 0
2026-03-30 12:00:32 [auto1.de] INFO: Found listing with ID: CA70430
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA70430%27 HTTP/1.1" 200 None
2026-03-30 12:00:32 [auto1.de] INFO: Scrape type for CA70430: 2
2026-03-30 12:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47645817-adc9-52c0-a905-ec71983c9669 with identifier: CA70430
2026-03-30 12:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47645817-adc9-52c0-a905-ec71983c9669 with scrape type 2
2026-03-30 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47645817-adc9-52c0-a905-ec71983c9669 with scrape type 2
2026-03-30 12:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47645817-adc9-52c0-a905-ec71983c9669, identifier: CA70430
2026-03-30 12:00:32 [auto1.de] INFO: Found listing with ID: TZ58013
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ58013%27 HTTP/1.1" 200 None
2026-03-30 12:00:32 [auto1.de] INFO: Scrape type for TZ58013: 2
2026-03-30 12:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97ad947f-1293-59d3-b453-be4bb6e6c61c with identifier: TZ58013
2026-03-30 12:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ad947f-1293-59d3-b453-be4bb6e6c61c with scrape type 2
2026-03-30 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97ad947f-1293-59d3-b453-be4bb6e6c61c with scrape type 2
2026-03-30 12:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97ad947f-1293-59d3-b453-be4bb6e6c61c, identifier: TZ58013
2026-03-30 12:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47645817-adc9-52c0-a905-ec71983c9669 with identifier: CA70430
2026-03-30 12:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47645817-adc9-52c0-a905-ec71983c9669 with identifier: CA70430
2026-03-30 12:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47645817-adc9-52c0-a905-ec71983c9669 with identifier: CA70430 to the API
2026-03-30 12:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:24:48Z',
 'fuel_type': 'diesel',
 'id': '47645817-adc9-52c0-a905-ec71983c9669',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA70430',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 230367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-05',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA70430%27 HTTP/1.1" 200 None
2026-03-30 12:00:33 [auto1.de] INFO: Saving data for CA70430: {'auction_closing_time': 1774884288.0, 'created_time': 1773427209.387325, 'last_price_update_time': 1774872033.862913}
2026-03-30 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA70430') HTTP/1.1" 204 0
2026-03-30 12:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97ad947f-1293-59d3-b453-be4bb6e6c61c with identifier: TZ58013
2026-03-30 12:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97ad947f-1293-59d3-b453-be4bb6e6c61c with identifier: TZ58013
2026-03-30 12:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97ad947f-1293-59d3-b453-be4bb6e6c61c with identifier: TZ58013 to the API
2026-03-30 12:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:15:05Z',
 'fuel_type': 'petrol',
 'id': '97ad947f-1293-59d3-b453-be4bb6e6c61c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ58013',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 48064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-28',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2020}
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ58013%27 HTTP/1.1" 200 None
2026-03-30 12:00:34 [auto1.de] INFO: Saving data for TZ58013: {'auction_closing_time': 1774883705.0, 'created_time': 1773426943.676638, 'last_price_update_time': 1774872034.154702}
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ58013') HTTP/1.1" 204 0
2026-03-30 12:00:34 [auto1.de] INFO: Found listing with ID: CG16297
2026-03-30 12:00:34 [auto1.de] INFO: Found listing with ID: AZ56926
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ56926%27 HTTP/1.1" 200 None
2026-03-30 12:00:34 [auto1.de] INFO: Scrape type for AZ56926: 2
2026-03-30 12:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b77a11-6ac3-5fcc-b310-2d81855a4d86 with identifier: AZ56926
2026-03-30 12:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b77a11-6ac3-5fcc-b310-2d81855a4d86 with scrape type 2
2026-03-30 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94b77a11-6ac3-5fcc-b310-2d81855a4d86 with scrape type 2
2026-03-30 12:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94b77a11-6ac3-5fcc-b310-2d81855a4d86, identifier: AZ56926
2026-03-30 12:00:34 [auto1.de] INFO: Found listing with ID: BC10414
2026-03-30 12:00:34 [auto1.de] INFO: Found listing with ID: LG96250
2026-03-30 12:00:34 [auto1.de] INFO: Found listing with ID: MG73872
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG73872%27 HTTP/1.1" 200 None
2026-03-30 12:00:34 [auto1.de] INFO: Scrape type for MG73872: 2
2026-03-30 12:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8d88997-887b-52df-893c-fbc710dc53df with identifier: MG73872
2026-03-30 12:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8d88997-887b-52df-893c-fbc710dc53df with scrape type 2
2026-03-30 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8d88997-887b-52df-893c-fbc710dc53df with scrape type 2
2026-03-30 12:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8d88997-887b-52df-893c-fbc710dc53df, identifier: MG73872
2026-03-30 12:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94b77a11-6ac3-5fcc-b310-2d81855a4d86 with identifier: AZ56926
2026-03-30 12:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94b77a11-6ac3-5fcc-b310-2d81855a4d86 with identifier: AZ56926
2026-03-30 12:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94b77a11-6ac3-5fcc-b310-2d81855a4d86 with identifier: AZ56926 to the API
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:34:23Z',
 'fuel_type': 'petrol',
 'id': '94b77a11-6ac3-5fcc-b310-2d81855a4d86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ56926',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 105843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-17',
 'seller_name': None,
 'title': 'Skoda Fabia 1.6 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ56926%27 HTTP/1.1" 200 None
2026-03-30 12:00:35 [auto1.de] INFO: Saving data for AZ56926: {'auction_closing_time': 1774884863.0, 'created_time': 1774089480.171647, 'last_price_update_time': 1774872035.329849}
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ56926') HTTP/1.1" 204 0
2026-03-30 12:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8d88997-887b-52df-893c-fbc710dc53df with identifier: MG73872
2026-03-30 12:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8d88997-887b-52df-893c-fbc710dc53df with identifier: MG73872
2026-03-30 12:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8d88997-887b-52df-893c-fbc710dc53df with identifier: MG73872 to the API
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:34:36Z',
 'fuel_type': 'diesel',
 'id': 'f8d88997-887b-52df-893c-fbc710dc53df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG73872',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 253612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-13',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI T BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG73872%27 HTTP/1.1" 200 None
2026-03-30 12:00:35 [auto1.de] INFO: Saving data for MG73872: {'auction_closing_time': 1774884876.0, 'created_time': 1774118525.518917, 'last_price_update_time': 1774872035.740508}
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG73872') HTTP/1.1" 204 0
2026-03-30 12:00:35 [auto1.de] INFO: Found listing with ID: GY33643
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY33643%27 HTTP/1.1" 200 None
2026-03-30 12:00:35 [auto1.de] INFO: Scrape type for GY33643: 2
2026-03-30 12:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d32802e-9aba-5601-81c5-9bd394276e39 with identifier: GY33643
2026-03-30 12:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d32802e-9aba-5601-81c5-9bd394276e39 with scrape type 2
2026-03-30 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d32802e-9aba-5601-81c5-9bd394276e39 with scrape type 2
2026-03-30 12:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d32802e-9aba-5601-81c5-9bd394276e39, identifier: GY33643
2026-03-30 12:00:35 [auto1.de] INFO: Found listing with ID: SB27489
2026-03-30 12:00:35 [auto1.de] INFO: Found listing with ID: RM35826
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM35826%27 HTTP/1.1" 200 None
2026-03-30 12:00:35 [auto1.de] INFO: Scrape type for RM35826: 2
2026-03-30 12:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: befa60f4-4c17-5a6a-b92f-9395611faa5f with identifier: RM35826
2026-03-30 12:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item befa60f4-4c17-5a6a-b92f-9395611faa5f with scrape type 2
2026-03-30 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item befa60f4-4c17-5a6a-b92f-9395611faa5f with scrape type 2
2026-03-30 12:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: befa60f4-4c17-5a6a-b92f-9395611faa5f, identifier: RM35826
2026-03-30 12:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d32802e-9aba-5601-81c5-9bd394276e39 with identifier: GY33643
2026-03-30 12:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d32802e-9aba-5601-81c5-9bd394276e39 with identifier: GY33643
2026-03-30 12:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d32802e-9aba-5601-81c5-9bd394276e39 with identifier: GY33643 to the API
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 99,
 'expiration_date': '2026-03-30T15:48:54Z',
 'fuel_type': 'petrol',
 'id': '6d32802e-9aba-5601-81c5-9bd394276e39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY33643',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 63837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 MPI Select',
 'transmission': 'manual',
 'trim': 'Select',
 'year': 2018}
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY33643%27 HTTP/1.1" 200 None
2026-03-30 12:00:36 [auto1.de] INFO: Saving data for GY33643: {'auction_closing_time': 1774885734.0, 'created_time': 1774349161.132458, 'last_price_update_time': 1774872036.76636}
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY33643') HTTP/1.1" 204 0
2026-03-30 12:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: befa60f4-4c17-5a6a-b92f-9395611faa5f with identifier: RM35826
2026-03-30 12:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: befa60f4-4c17-5a6a-b92f-9395611faa5f with identifier: RM35826
2026-03-30 12:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: befa60f4-4c17-5a6a-b92f-9395611faa5f with identifier: RM35826 to the API
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:08:22Z',
 'fuel_type': 'diesel',
 'id': 'befa60f4-4c17-5a6a-b92f-9395611faa5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM35826',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 208378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-30',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM35826%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.de] INFO: Saving data for RM35826: {'auction_closing_time': 1774883302.0, 'created_time': 1774034162.820759, 'last_price_update_time': 1774872037.134975}
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM35826') HTTP/1.1" 204 0
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: PF97491
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: EK48004
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK48004%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.de] INFO: Scrape type for EK48004: 2
2026-03-30 12:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd23a141-f8a7-52e7-ac9e-14210d0fe2a8 with identifier: EK48004
2026-03-30 12:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd23a141-f8a7-52e7-ac9e-14210d0fe2a8 with scrape type 2
2026-03-30 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd23a141-f8a7-52e7-ac9e-14210d0fe2a8 with scrape type 2
2026-03-30 12:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd23a141-f8a7-52e7-ac9e-14210d0fe2a8, identifier: EK48004
2026-03-30 12:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd23a141-f8a7-52e7-ac9e-14210d0fe2a8 with identifier: EK48004
2026-03-30 12:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd23a141-f8a7-52e7-ac9e-14210d0fe2a8 with identifier: EK48004
2026-03-30 12:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd23a141-f8a7-52e7-ac9e-14210d0fe2a8 with identifier: EK48004 to the API
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:22:00Z',
 'fuel_type': 'diesel',
 'id': 'dd23a141-f8a7-52e7-ac9e-14210d0fe2a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK48004',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 245523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-11',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 350 CDI BlueTEC',
 'transmission': 'automatic',
 'trim': 'BlueTEC',
 'year': 2015}
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK48004%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.de] INFO: Saving data for EK48004: {'auction_closing_time': 1774884120.0, 'created_time': 1774694235.166702, 'last_price_update_time': 1774872037.578355}
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK48004') HTTP/1.1" 204 0
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: WJ88731
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ88731%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.de] INFO: Scrape type for WJ88731: 0
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: GY05092
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: NH74932
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: WA60872
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA60872%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.de] INFO: Scrape type for WA60872: 0
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: PC86018
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: EE70645
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: RJ17594
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ17594%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.de] INFO: Scrape type for RJ17594: 0
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: WC98530
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC98530%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.de] INFO: Scrape type for WC98530: 0
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: ET93890
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET93890%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.de] INFO: Scrape type for ET93890: 0
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: DV01854
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01854%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.de] INFO: Scrape type for DV01854: 0
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: UE23148
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE23148%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.de] INFO: Scrape type for UE23148: 0
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: GV87257
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: MR80797
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: DW63947
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: JG09776
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: KN89851
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: ZS91776
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS91776%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.de] INFO: Scrape type for ZS91776: 0
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: VX64192
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX64192%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.de] INFO: Scrape type for VX64192: 0
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: SN59057
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: HN30713
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: HX26034
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: JM84539
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: ED17592
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED17592%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.de] INFO: Scrape type for ED17592: 0
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: FX10664
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX10664%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.de] INFO: Scrape type for FX10664: 0
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: YS85041
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS85041%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.de] INFO: Scrape type for YS85041: 0
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: SA72016
2026-03-30 12:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:37 [auto1.de] INFO: Channel: 24h | Page: 251 | totalHits: 10024 | hits on page: 24
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: YS85041
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS85041%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.de] INFO: Scrape type for YS85041: 0
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: SA72016
2026-03-30 12:00:37 [auto1.de] INFO: Found listing with ID: WG54603
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG54603%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.de] INFO: Scrape type for WG54603: 0
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: VV82390
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV82390%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.de] INFO: Scrape type for VV82390: 0
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: SK64465
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK64465%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.de] INFO: Scrape type for SK64465: 0
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: GY99851
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY99851%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.de] INFO: Scrape type for GY99851: 0
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: KG73349
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG73349%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.de] INFO: Scrape type for KG73349: 0
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: NR46432
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: GD21382
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: GX76510
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: DT67052
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: ZZ82496
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ82496%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.de] INFO: Scrape type for ZZ82496: 0
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: MA81744
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81744%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.de] INFO: Scrape type for MA81744: 0
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: KG50767
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG50767%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.de] INFO: Scrape type for KG50767: 0
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: AR70360
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR70360%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.de] INFO: Scrape type for AR70360: 0
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: YX36608
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: XL74124
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL74124%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.de] INFO: Scrape type for XL74124: 0
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: WX78972
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX78972%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.de] INFO: Scrape type for WX78972: 0
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: TW02363
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW02363%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.de] INFO: Scrape type for TW02363: 0
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: HR58634
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: LM22131
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: YV43994
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV43994%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.de] INFO: Scrape type for YV43994: 0
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: HY99539
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY99539%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.de] INFO: Scrape type for HY99539: 0
2026-03-30 12:00:38 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-30 12:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:42 [auto1.de] INFO: Channel: 24h | Page: 252 | totalHits: 10024 | hits on page: 0
2026-03-30 12:00:42 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 12:00:42 [auto1.de] INFO: auto1.de Batch config: batch 1/2
2026-03-30 12:00:42 [auto1.de] INFO: auto1.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 3, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 27, <ScrapeType.BATCH_SKIPPED: 5>: 25}
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD45334%27 HTTP/1.1" 200 None
2026-03-30 12:00:42 [auto1.de] INFO: Saving data for HD45334: {'created_time': 1774872042.475212}
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD45334') HTTP/1.1" 204 0
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20last_price_update_time%20lt%201774440042 HTTP/1.1" 200 None
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AA42831') HTTP/1.1" 204 0
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AA58974') HTTP/1.1" 204 0
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AC69066') HTTP/1.1" 204 0
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AD12262') HTTP/1.1" 204 0
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AD21332') HTTP/1.1" 204 0
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AD75568') HTTP/1.1" 204 0
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AG46901') HTTP/1.1" 204 0
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AG75573') HTTP/1.1" 204 0
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AH39617') HTTP/1.1" 204 0
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AH49978') HTTP/1.1" 204 0
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AK17354') HTTP/1.1" 204 0
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AK94804') HTTP/1.1" 204 0
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AL87936') HTTP/1.1" 204 0
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AN38107') HTTP/1.1" 204 0
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AN87442') HTTP/1.1" 204 0
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AS98285') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AT29178') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AU97363') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AX49352') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AY55669') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AY94459') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BA31035') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BD29566') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BD59029') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BF23641') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BG38531') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BM07110') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BN14716') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BN86357') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BP45002') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BR89085') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BS11115') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BY13526') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CF15597') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CG13524') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CG34988') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CM43757') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CN65530') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CS87948') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CT30312') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CT39623') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CT91875') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CW81390') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CX71920') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CY97461') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ17542') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DB13195') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DB28329') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DB98119') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DE94089') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DK15637') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DK58232') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DL12622') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DR89014') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DV79667') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DY53451') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EC09780') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ED47702') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EE05408') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EE35105') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EG19382') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EH91334') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ24973') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EN74068') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EP52517') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ER09649') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ER98750') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ES27277') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ES68400') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ES74106') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EU23813') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EY45788') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ96661') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FB66961') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FB67954') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FF29590') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FG52472') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FG61705') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ68523') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FK22405') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FP50570') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FS19830') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FU54911') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FU87290') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FV24436') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FX25582') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FY29635') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ96757') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GA14134') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GB55411') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GB58879') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GC04213') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GE65180') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GL05784') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GL29577') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GL71404') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GN19428') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GR93275') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GS80543') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GU02558') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GU24980') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GU25244') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GU65521') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GV37022') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GV42259') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GW35230') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GW38888') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GY26944') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GY66607') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GY97091') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HA33376') HTTP/1.1" 204 0
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HD30201') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HG07954') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HG38524') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HH36344') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HK14626') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HP44196') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HU33803') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HU97359') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HV52982') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HW11145') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HY23585') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HY71254') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JA08258') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JD88795') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JE34414') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JG26488') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JH16309') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JK14434') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JK53702') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JP37025') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JT50627') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JT91805') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KA09164') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KC36034') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KC76684') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KD53603') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KD65867') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KH45581') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KH69715') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KK60440') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KL51755') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KN81034') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KP10406') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KS23967') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KS53420') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KT15413') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KU16279') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KU56428') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KU82471') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LD97299') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LG91210') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LH60036') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ62732') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ78302') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LR38494') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LS43418') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LS70978') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LT91423') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LW56455') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MA48568') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MC70344') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MD10160') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MG64101') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MG75927') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MP20907') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MP43771') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MR78667') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MR84899') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MR86284') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MX13443') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NA35546') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NB70327') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NC48116') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NC60109') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ND75134') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NE21112') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NF85194') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NG17072') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NH13417') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ09421') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ69610') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NN76056') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NP34377') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NP42261') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NP61311') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NR20361') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NR87253') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NS49681') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NS73165') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NT16488') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NT82612') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PA00168') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PA89340') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PB25105') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PD06584') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PD48650') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PE04951') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PE18857') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PG94146') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PH68666') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PH72276') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PP65815') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PP71308') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PR08180') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PR85694') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PR99249') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PS09761') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PS62723') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PT53644') HTTP/1.1" 204 0
2026-03-30 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PT71256') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PU93218') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PV78195') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ02420') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RE77479') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RL68707') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ26302') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SB58049') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SB72803') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SD35993') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SE87621') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SF29432') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SK54681') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SL30814') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SX64201') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SY12066') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ71604') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TD24626') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TG26330') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TH38387') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TL63058') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TL77874') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TP65357') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TP77355') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TR70185') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TV08879') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TW86522') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UB64737') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UD42199') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UE37156') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UH05671') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UK54547') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UL91617') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='US14008') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UT03816') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UV87322') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VC73499') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VC77628') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VE09572') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VF26832') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VF91359') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VG52893') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VG88223') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VH36952') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VH62569') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VM24868') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VP77717') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VR35351') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VR54206') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VU12432') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VW45604') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VW46992') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VX20493') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ76052') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WC81426') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WD00050') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WD04090') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WD63226') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WH38374') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WK58431') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WL63533') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WL89698') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WP92316') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WR38040') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WS28298') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WT27644') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WU87183') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WW21597') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XA08423') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XC94793') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XE44242') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XH14158') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XH54883') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ35845') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XL03137') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XM27459') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XP66036') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XP84499') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XR79743') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XV25717') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XV98262') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ11710') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ63387') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YD72742') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YF19027') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YG29159') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YG74140') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ58919') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YK76188') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YM08588') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YT71621') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YU38347') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YV14455') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YV75225') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YW21053') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YX56660') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YX65309') HTTP/1.1" 204 0
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YX80246') HTTP/1.1" 204 0
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ54942') HTTP/1.1" 204 0
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA59821') HTTP/1.1" 204 0
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD69010') HTTP/1.1" 204 0
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE72714') HTTP/1.1" 204 0
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ05743') HTTP/1.1" 204 0
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM33163') HTTP/1.1" 204 0
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR85295') HTTP/1.1" 204 0
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT66338') HTTP/1.1" 204 0
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX14112') HTTP/1.1" 204 0
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ83710') HTTP/1.1" 204 0
2026-03-30 12:00:46 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (1568 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.de/task_17_2026-03-30T10_30_00.jl
2026-03-30 12:00:46 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 5594353,
 'downloader/request_count': 3145,
 'downloader/request_method_count/GET': 2890,
 'downloader/request_method_count/POST': 255,
 'downloader/response_bytes': 2544266945,
 'downloader/response_count': 3145,
 'downloader/response_status_count/200': 3144,
 'downloader/response_status_count/401': 1,
 'dupefilter/filtered': 31,
 'elapsed_time_seconds': 5441.949507,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 12, 0, 46, 91607, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 1568,
 'log_count/DEBUG': 41938,
 'log_count/INFO': 44746,
 'log_count/WARNING': 3,
 'memusage/max': 213901312,
 'memusage/startup': 150142976,
 'photo_download_count': 2145,
 'request_depth_max': 257,
 'response_received_count': 1000,
 'scheduler/dequeued': 3145,
 'scheduler/dequeued/memory': 3145,
 'scheduler/enqueued': 3145,
 'scheduler/enqueued/memory': 3145,
 'scrape_type/batch_skipped': 5070,
 'scrape_type/new': 370,
 'scrape_type/new_duplicate_id': 1,
 'scrape_type/price_update': 1198,
 'scrape_type/skipped': 3394,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 1038,
 'scrapy-zyte-api/error_ratio': 0.036608863198458574,
 'scrapy-zyte-api/errors': 38,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 38,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 8.41954397943756,
 'scrapy-zyte-api/mean_response_seconds': 8.455915829057329,
 'scrapy-zyte-api/processed': 1000,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 1000,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 999,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 1000,
 'scrapy-zyte-api/request_args/httpRequestBody': 255,
 'scrapy-zyte-api/request_args/httpRequestMethod': 255,
 'scrapy-zyte-api/request_args/httpResponseBody': 1000,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 1000,
 'scrapy-zyte-api/request_args/sessionContext': 1000,
 'scrapy-zyte-api/request_args/url': 1000,
 'scrapy-zyte-api/status_codes/0': 38,
 'scrapy-zyte-api/status_codes/200': 1000,
 'scrapy-zyte-api/success': 1000,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 10064,
 'source/total_available': 10024,
 'start_time': datetime.datetime(2026, 3, 30, 10, 30, 4, 142100, tzinfo=datetime.timezone.utc)}
2026-03-30 12:00:46 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 12:00:46 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f13f58d0410>
2026-03-30 12:00:46 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f13f5959ad0>

PROJECT (sourcing_v2)
SPIDER (auto1.de)

Press to refresh